Dataverse Table Not Fully Populating with Power Query Contents

(2) Share

Report

Posted on by BenKraft

154

I have a Dataflow that queries from a large source, then loads into a Dataverse table. I am seeing missing records that present in the query but not in the table after the refresh.

My Power Query has a key column Oracle ID that I have guaranteed there are no duplicates of:

In my dataverse table, I created an alternate key using the column that this populates into, called Oracle Key:

During my load, I import using that Oracle Key as my Primary key and load the Oracle Key into the corresponding field:

However, when the dataflow refreshes, there are entries that I can see in the last step of my Power Query:

That I do not see in my Dataverse table:

Why might they be missing? The original table is around 10,000 entries long, but I can't imagine Dataverse interprets this as too many.

Categories:

Microsoft Dataverse with Power Apps

Power Query

I have the same question (0)

All responses (7)

Answers (0)

Sort by

Suggested answer

Vish WR 807 on at

Like (0)

Report
Copy link

Link copied!

can you check refresh history → click the last refresh → download the log and review

Was this reply helpful? Yes No
BenKraft 154 on at

Like (1)

Report
Copy link

Link copied!

@wrvishnu Thanks for the response!

I've done so and gotten:

Was this reply helpful? Yes No
Vish WR 807 on at

Like (0)

Report
Copy link

Link copied!

let me try to reproduce and see if it can replicate the issues .

do u have Microsoft support or developer tenant if you can you can raise a case with ms they can advice or help with troubleshooting

Was this reply helpful? Yes No
BenKraft 154 on at

Like (1)

Report
Copy link

Link copied!

I've just compared, the Power Query contained 10503 rows and the resulting table contains 10289. For some reason some records don't make it.

Was this reply helpful? Yes No
Suggested answer

Vish WR 807 on at

Like (0)

Report
Copy link

Link copied!

Hi Good Day

I have tested by importing 15K data from excel to Dataverse was able to import all15k records. I would suggest in power query select fewer columns maybe like text column and import into Dataverse and see if it import all records then issue could be related to data type mismatch (double check the mapping column in destination too )

I would recommend raise a Microsoft ticket if you have unified support

Was this reply helpful? Yes No
BenKraft 154 on at

Like (0)

Report
Copy link

Link copied!

@wrvishnu

Unfortunately, I am not able to choose to use fewer columns, and all of them are of type text or datetime in both the query and the Dataverse table:

I have opened a ticket but have not had much luck in the past with Power Apps support; it takes months to be escalated to the point of talking to someone who knows anything about the platform.

Was this reply helpful? Yes No
BenKraft 154 on at

Like (0)

Report
Copy link

Link copied!

Running again, I have 10511 items in my query (all with unique key values) and 10297 items in my resulting Dataverse table. The refresh logs show 10511 upserts, but again the table remains the smaller size.

Was this reply helpful? Yes No