web
You’re offline. This is a read only version of the page.
close
Skip to main content
Community site session details

Community site session details

Session Id :
Power Automate - Using Flows
Suggested answer

Managing bi-weekly updates of SP list from an Excel table (very large data set)

(0) ShareShare
ReportReport
Posted on by 64
I am setting up a power app that uses a large data set that will need to be updated every two weeks.  There normally will be a lot of updates, possibly hundreds/thousands of changes - far too many to do this manually.  The updates will include a combination of the following:
 
  • Some existing rows will have information in a couple of columns updated/changed.
  • Some existing rows will no longer be on the excel report and will need to be deleted.
  • Some rows that do not exist on the report will need to be added.
 
If I was just using an Excel table as the data source in the power app, it would just be a matter of taking a few seconds to overwrite the old with the new and be done with it.  Using a SP list, it gets more complicated and I'm trying to wrap my head around how to do this with Power Automate.  The flows will need to look at the Excel report and:
 
Add anything that is not already on the report.
Look at the SP list and remove the row if it does not exist on the new Excel report
 
Doing these two actions will also take care of updating any row that has changed.
 
Any guidance on the process for doing this is much appreciated.  One option is to simply overwrite the data by deleting all rows in the existing list and then run a flow repopulating the list from the new table.  Thinking I might just go this route, unless there is a compelling reason not to do this...something I am not considering.  That will take several hours (it's a 20,000+ row list), but it could just be scheduled to run in the middle of the night.
 
I have the same question (0)
  • Suggested answer
    wolenberg_ Profile Picture
    506 Moderator on at
    Managing bi-weekly updates of SP list from an Excel table (very large data set)
    Hello @BKayMDOT , Yes — you can manage bi-weekly updates to a large SharePoint list using Power Automate, but instead of deleting all rows and repopulating, a smarter sync flow is more efficient and scalable. This approach compares Excel and SharePoint data to update, add, or delete records as needed.
     
     

    Recommended Approach: Smart Sync Flow Using Power Automate

    Rather than wiping and repopulating the entire list (which is slow and risks data loss), build a flow that performs three key actions:

    1. Update Existing Records

      Use “Apply to Each” to loop through rows in Excel.

      Match each row to SharePoint using a unique key (e.g., Employee ID).

      Use “Update item” if the record exists and values have changed.

    2. Add New Records

      In the same loop, if no match is found in SharePoint, use “Create item” to add it.

    3. Delete Missing Records

      Use a second loop to go through all SharePoint items.

      If an item’s key is not found in Excel, use “Delete item”.

    This ensures your SharePoint list mirrors the Excel file without unnecessary overhead.


    Helpful Resources

      Update SharePoint List Items from Excel using Power Automate

      Sync Excel to SharePoint List – Manuel T. Gomes

      Auto-Sync Data between SharePoint List and Excel – YouTube

     
     

    Summary

      Use Power Automate to compare Excel and SharePoint data.

      Update, add, and delete records based on matching keys.

      Avoid full deletion — it's slower and riskier.

      Schedule the flow to run bi-weekly with concurrency enabled.

     
     

    If this helped or could help others in the community, feel free to give it a like or kudo — it helps surface useful answers for everyone! 

  • Michael E. Gernaey Profile Picture
    50,275 Super User 2025 Season 2 on at
    Managing bi-weekly updates of SP list from an Excel table (very large data set)
     
    Essentially you are doing master data management and when you have thousands of changes, its possible to do against SharePoint as @wolenberg_ showed, its not hard to loop through records etc.
     
    The real question is, is this the right scalable solution. In many cases, yes, wiping and starting over can be a better choice. I am not suggesting it is in this case or not or for SharePoint in general.
     
    For me to really give my best suggestion, I would need to understand how the data and list is used. Is it mapped to a real-time app that wiping will cause everyone to be like What the Heck, if you are making huge changes, we also need to take into account, does this impact the users experience because they are using the App on top and then data changes, but the app hasn't updated yet etc.
     
    So just updating the data, isn't the only thing I would look at in answering you but while you CAN loop through and do updates and maybe that is the best based on your storage (SharePoint) but it might not.
     
    Personally I would review with you, if we worked together the overall architecture of the data and its use, then make my call on how to "update it" or is SharePoint even the right thing to use.
     
    just some thoughts.
     
  • David_MA Profile Picture
    12,411 Super User 2025 Season 2 on at
    Managing bi-weekly updates of SP list from an Excel table (very large data set)
    If you find that the solutions offered by Michael or Wolenberg are too complicated or not robust enough, I suggest investigating Layer2 Cloud Connector. It easily syncs data from a variety of sources including Excel and SharePoint. It is extremely fast and is not too complicated to set up connections. However, to sync Excel files requires the enterprise version which might not be worth the cost if this is the only data you want to keep synched. We use the standard version, which has an annual licensing cost about 1/2 the enterprise version. 
     
    We are syncing about 70 different data sources with this. One of our largest syncs has over 50,000 rows of data, which syncs in several minutes. You can schedule the jobs to run automatically or run them manually as needed. With this, you can keep your data synched in near real time if needed.
    You can get information on Layer2 at Layer2 Cloud Connector ► integrate and sync data and are a Microsoft Certified Partner.
  • BKayMDOT Profile Picture
    64 on at
    Managing bi-weekly updates of SP list from an Excel table (very large data set)
     
    Thanks for the input.  This is all good information. 

Under review

Thank you for your reply! To ensure a great experience for everyone, your content is awaiting approval by our Community Managers. Please check back later.

Helpful resources

Quick Links

Responsible AI policies

As AI tools become more common, we’re introducing a Responsible AI Use…

Tom Macfarlan – Community Spotlight

We are honored to recognize Tom Macfarlan as our Community Spotlight for October…

Leaderboard > Power Automate

#1
Michael E. Gernaey Profile Picture

Michael E. Gernaey 699 Super User 2025 Season 2

#2
Tomac Profile Picture

Tomac 542 Moderator

#3
chiaraalina Profile Picture

chiaraalina 321

Last 30 days Overall leaderboard

Featured topics

Restore a deleted flow