As shown in the attached image, the target is the HK logo or stock - Hong Kong in line N.
📝 Issue Description
When using “Move mouse to image” in Power Automate Desktop, if the target image is located in the Nth row of a dropdown list, the action consistently misselects earlier rows. The flow only succeeds after N retries, effectively requiring one retry per row above the target.
Attempts to adjust parameters (similarity threshold, search scope, multiple image variants, wait delays) do not resolve the issue. Even when capturing both the left-side icon and the text (“Stock – Hong Kong”), the misselection persists.
🔍 Expected Behavior
The image recognition should globally search the screen and directly return the most accurate match of the target image, regardless of its row position in the list.
⚠️ Actual Behavior
-
First row target → selected correctly.
-
Target in Nth row → requires N retries before correct selection.
-
Behavior resembles “stepwise row elimination” rather than true image matching.
📌 Impact
-
Increases automation complexity and runtime.
-
Forces users to design error loops, reducing reliability.
-
Cannot be corrected through configuration, indicating a deeper algorithmic flaw.
💡 Suggested Improvements
-
Fix the image recognition algorithm to perform global best-match search instead of row-by-row priority.
-
Provide an option for multi-image simultaneous matching (e.g., both icon and text must match before returning).
-
Enhance recognition stability in dynamic list scenarios.