Web search only when needed

(0) Share

Report

Posted on by GH-17020853-0

Hello,

I am currently building a helpdesk agent that should search the existing knowledge base based on topics and use generative AI to provide an answer. Web search is generally enabled because the agent should search the web if it doesn’t find anything in the knowledge base — but only if it doesn’t find anything. I have already configured the topics so that individual web search is disabled. The instruction prompt is written so that web search should only be used when explicitly requested.

However, if a request bypasses the topics, the agent immediately starts a web search.

How can I prevent this?

Thx in advance,

Gregor

Categories:

Copilot Studio skills development

Topic creation & management

General topics

I have the same question (0)

All responses (8)

Answers (0)

Suggested answer

Romain The Low-Code... 2,447 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

hello,

In prompt global you could try strong instruction to tell the name of KB. If it still resist to the prompt and web search when you don't want.

I would try something like this (never try but i m pretty sure it will work) :

Remove web search from agent.

Create another agent with web search only.

When first agent failed with it's knowledge use a topic or the conversationnal boosting or/and the prompt with the "/" to call the second agent about searching on internet. the second agent with good instruction and settings could be set to be only activated on demand by topic or the "/"

You need to connect the second agent to the first one in the agent tab (connected agent need to publish before been available to other agent)

I hope this help to resolve you'r problem :) if yes click please the answer as green this is the good answer :) it's important for the community and search engine :)

Was this reply helpful? Yes No
GH-17020853-0 2 on at

Like (0)

Report
Copy link

Link copied!

That sounds like a good idea. I'll try it and give you some feedback.

Was this reply helpful? Yes No
GH-17020853-0 2 on at

Like (0)

Report
Copy link

Link copied!

~~Quick and easy solution, thank you~~

Was this reply helpful? Yes No
GH-17020853-0 2 on at

Like (0)

Report
Copy link

Link copied!

Now after a few more tests i noticed that its not possible to deactivate web search in the parental agent, when you need it in the child agent.
It looks like it's hereditary.

Was this reply helpful? Yes No
Romain The Low-Code... 2,447 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

ooo it seem it solved it and then no :) what happened ?

Was this reply helpful? Yes No
GH-17020853-0 2 on at

Like (0)

Report
Copy link

Link copied!

First, I was able to deactivate the web search button and tested it in the same window, and it worked. After lunch, I opened a new browser window and tried it again. I asked the agent some questions, but the behaviour was different. So I checked the settings and noticed that the parental and child flow settings had synchronized after the restart, and I was no longer able to activate/deactivate the web search setting differently for both agents.

Right now, I haven’t found a solution to my problem.

Was this reply helpful? Yes No
David_MA 13,504 Super User 2026 Season 1 on at

Like (0)

Report
Copy link

Link copied!

I am not an expert on this, as I have only been working on and setting up one agent so far. However, I am allowing web search and only want it used for specific circumstances. I have found that you need to spell this out in the agent's instructions. What works for me, may not work for you. The agent I am working on is based on a book. The agent has 37 source documents in its knowledge, which are individual files for each chapter.

I only want the web to be used if the response to the user contains a reference to something in the book that the user may not be familiar with. This way, the agent can find information on those topics as well.

These are some of the instructions I have provided to my agent, which has been working well in testing so far:

## Web Use — Explicit Allow/Block List
### Allowed (Real‑World Context Only)
Web use is allowed only for real‑world, non‑narrative information tied directly to explicitly named items in the manuscript.

### Forbidden (Never Allowed)
- Story content from A Scout’s Honor
- Plot, characters, themes, timeline, or settings
- Character names (e.g., Léo, Buddy, Wayne)
- Disambiguation of similarly titled works
- Searching for anything containing “Scout’s Honor” or “A Scout’s Honor”
- Comparisons to other books, movies, or media

### If unsure
Do not use the web.

In the testing pane, it will often show that it has searched the web, but the answer provided will not include any information found on the web:

I have yet to find a way to completely eliminate web search when it is enabled. But so far, it has been honoring the instructions I've given it.

If you notice above, the answer mentions hermit bars. If I ask what are hermit bars, the agent then uses the web and finds the answer:

Was this reply helpful? Yes No
GH-17020853-0 2 on at

Like (0)

Report
Copy link

Link copied!

Thank you. So far, the solution with the web search instructions (allowed/denied) is working - even though I already had previously described an explicit ban on web searches without the permission by user. This solution seems to work better. I will continue testing it and provide further feedback.

Was this reply helpful? Yes No