Duplicate files in content search — have you experienced this issue or know how to handle it? The file isn’t large (13 pages), it has been cleaned of unnecessary XML, footers, etc., but I still have this problem. I tried removing and re-adding it. In general, I see this issue with several files, which keeps causing OpenAIModelTokenLimit errors. Has anyone found a solution or has any advice?
Copilot Studio splits one file into many small chunks when indexing it (for example when you upload the file or add a SharePoint library). In the search view, each line you see is one chunk, not a new file. That’s why the same filename appears many times.
All those chunks are then sent to the AI at the same time. Even if the file exists only once, this can use too many tokens and cause the OpenAIModelTokenLimit error.
Was this reply helpful?YesNo
Under review
Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.
6
Share
Report
All responses (
Answers (
