Power Platform Community Forum Thread Details

Analyzing files in autonomous agent and access to Document Processor Managed Agent (preview)

Hi,

I am working on a POC for an autonomous agent that will evaluate incoming requests for proposals. The request consists of a mail with some relevant information in the body and a bunch of more or less structured attachments (PDF, DOCX, XLSX).

We will trigger the agent when an incoming mail lands in a certain mailbox using a mail trigger in PA, store the attachments in a SharePoint Document Set. Then we want the agent to, based on its knowledge, to do its magic and analyze and assess the content of the mail body and the attachments.

We have created an agent in Copilot Studio that does some of the work. However, we would like to have a better way of analyzing and assessing the attachments. I have been looking into the Document Processors Managed Agent but for some reason it isn't available in Copilot Studio, at least not yet. Is there a way to enable it or activate some kind of preview mode in Copilot Studio?

Or is there another smart way of analyzing the files? For example, by using a Tool in the agent (SharePoint - "Get file content" or SharePoint - "Get file content using path" and thus giving the agent access to the files that way.

Any tips or suggestions would be highly appreciated.

All the best, Andreas

I can't comment on the Document Processors Managed Agent, but for your use case, I have a few recommendations:

1. Agree with your approach of processing the mail in power automate to get the files.

2. Once you've got the file, and trigger the agent, I'd use the OneDrive GetFileContent tool (https://learn.microsoft.com/en-us/connectors/onedriveforbusiness/#get-file-content-using-path) -- and you can read the file into the context window. Sadly, this will only work with smaller files. (2k character limit)

3. For the absolute best processing capabilities, you'll likely need to get a bit more complex, treating large unstructured content vs structured data (excel) differently. For unstructured, you'd drop those files into a directory, use AI Foundry to process them (Some accelerator samples here - GitHub - Azure-Samples/chat-with-your-data-solution-accelerator) - then connect to that from copilot studio. Clearly not ideal from a low code perspective, but more features coming in the future! For structured, you'd want to get the excel into a structured format, and build queries against it.

Quick Links

Leaderboard > Copilot Studio