Skip to main content

Notifications

Community site session details

Community site session details

Session Id :
Power Automate - Building Flows
Suggested answer

Array Comparison and Update the differences

(0) ShareShare
ReportReport
Posted on by 18
Hi Experts,
 
My Power Automate flow has two arrays with almost 200,000 objects in each one of them. I am getting one from a dataverse table and another from an API response. I need to compare both and update the table if there are any differences.
I used Filter array as described in the below link but it is taking more than 4 hours which is longer than the requirement of 45 mins to 1 hour.
PowerAutomate - Compare arrays with objects
 
Can you pls provide your inputs on a better way to handle this requirement within or outside of Power Automate
 
Regards,
Jignyasa
  • stampcoin Profile Picture
    2,002 on at
    Array Comparison and Update the differences
    That's also a work around. great job.👍
  • Jignyasa Profile Picture
    18 on at
    Array Comparison and Update the differences
     
    Thank you for your inputs. Unfortunately, we dont have SQL Database.
     
    Meanwhile, I am testing with office scripts. I have to send both arrays in chunks due to limitations. The progress has been good so far. Comparing ~40,000 rows is taking around 1 minute.
  • Suggested answer
    stampcoin Profile Picture
    2,002 on at
    Array Comparison and Update the differences
    If you have SQL Database, stage the API data in SQL and MERGE in T-SQL.
    1. Use any of those you're familiar with: C#, Powershell, Python... 
    2. Fetch data from API into tables, one for data from invoking API. one for data from Dataverse.
    3. USE T-SQL to get the difference and write to another table.
    4. Push the difference back to Dataverse.
     
    you can use Azure function/Synapse...there are many ways.
    Save your time for fun.
     

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Announcing the Engage with the Community forum!

This forum is your space to connect, share, and grow!

🌸 Community Spring Festival 2025 Challenge Winners! 🌸

Congratulations to all our community participants!

Warren Belz – Community Spotlight

We are honored to recognize Warren Belz as our May 2025 Community…

Leaderboard > Power Automate - Building Flows

#1
David_MA Profile Picture

David_MA 385 Super User 2025 Season 1

#2
stampcoin Profile Picture

stampcoin 330

#2
Michael E. Gernaey Profile Picture

Michael E. Gernaey 330 Super User 2025 Season 1

Overall leaderboard