Web Crawling capabilities in AI Agent Chat
planned
kferrero
AI Agent struggling, Initially tells me it can't do web research but reminding it that it can it eventually does. Then researches and provides me results that appear to be from someone else's question. I swapped over to chatgpt directly at openai.com and asked ChatGPT-4 the same question and it nailed it on the first try.
My request was fairly simple, to do web research on 6 hyperlinks, extract recipes and then compile into a shopping list. Taskade "researcher" AI Agent gave me a shopping list for 6 unrelated random meals.
See ChatGPT conversation to see how easily it got this right, I don't understand how Taskade AI agent totally missed the mark. I've noticed over the past few days its been really struggling, providing blank responses or getting stuck and I Have to nudge it a few times to get it to start responding again.
Narek Zograbian
Merged in a post:
Taskade AI Chat with OpenAI plugins
dr.hafeez
The Taskade AI evidently has limitations, confined to the fundamental functionalities of GPT-4 without the ability to browse the web. Integrating web searching capabilities within the chat would be highly advantageous. I feel as though id like to no have to jump back to openai site and start using plugins there when ideally it should all be integrated into taskade.
John at Taskade
planned
Thanks again for all your feedback! We'd love to hear any comments or use cases you have, so please share them right here in this post. Stay tuned for more updates from us.
Don't forget to check out our latest changelog for all the new features and improvements: https://www.taskade.com/blog/updates/.
Narek Zograbian
Merged in a post:
Able/unable to preform web searches under the agents tab.
grahamw
Usually, when using a command which has web search enabled within an agent window, it will refuse to search the web. However, I don't know how, but I was able to get it to search the web. I'm not sure if this is an intended feature, or it is not supposed to have web search (given that it doesn't let me search after I cleared the chat).
Narek Zograbian
Merged in a post:
Allow web access by default for AI agents.
yasser.sharaf
After contacting support, agents don't access the internet by default and I have to define commands to allow the agent to access the internet. As a developer, this is not useful and developers always look for AI agents with the ability to access the internet by default.
Narek Zograbian
Would you like the agents to crawl or scrape the web?
What sort of functionality are you looking for?
yasser.sharaf
Narek Zograbian what I need is to ask the agent about something recently released like Laravel 11 and get recent answers related to it so it should be able to access Laravel 11 docs to find answers without defining commands. That's what most users need from AI agents. So whether you call it scrape or crawl, we care about the end result.
yasser.sharaf
Narek Zograbian I also tried the same question using a command with web search enabled but still, the agent can't find the answer.
yasser.sharaf
Narek Zograbian Go ahead and try it yourself. Very disappointing.
Narek Zograbian
yasser.sharaf: We're working on this. It's a complex feature and I think we'll merge this over with another feature request.
yasser.sharaf
Narek Zograbian but why isn't it working with the command when I enable web search?
Narek Zograbian
yasser.sharaf: That should work at the project-level but not in the agent chat yet.
r
ryantaskade
r
ryantaskade
Hi kferrero,
I noticed that you are attempting to provide hyperlinks to the agent for it to crawl. To clarify, are you trying to achieve this within the AI chat?
If so, please note that the agent doesn't have web searching capabilities directly within the chat. This capability is present in the custom commands (if activated).
As a workaround, you can paste those links within the Agent's knowledge tab using the "Add Link" button. This will allow the agent to crawl the links and have that information in its context to answer your questions.
I've updated the title of this post to reflect a feature request regarding having web crawl capabilities directly within the AI agent chat. Please let me know if I am understanding your request correctly.
kferrero
ryantaskade: Hey Ryan, no so I created a bulleted list of hyperlinks in a project, highlighted them all and then used slash command. In the past this has worked to give the assistant all of the information I want it to process. If I am mistaken, or if that's not the case please let me know. I still haven't quite figured out exactly how everything works in Taskade hah.
r
ryantaskade
kferrero: Hi kferrero,
I appreciate the clarification. The AI assistant found in the editor does not have web search capabilities. Our AI assistant is configured to always provide replies, and in situations where it lacks information, it might generate responses that are not accurate or relevant to the topic.
If you need assistance with your use case, feel free to reach out to support@taskade.com, and I can provide guidance on how to best utilize our AI features.
kferrero
ryantaskade: Makes sense, thanks!
supermario_ai
Narek Zograbian: Look familiar Fam? 🤣
john: How much effort is it to port the project level api web search into project chat? 😊
❤️
r
ryantaskade
supermario_ai: Hello Mario,
To elaborate further on this matter, the challenge isn't just the technical complexity when integrating the same API into the chat. Alongside it, there are difficulties in properly sanitizing input data to ensure the AI accurately understands messages.
Additionally, the extra processing and web search queries involved could increase the cost of each chat message sent.
Providing an option to toggle the tool for the chat is also something we need to carefully consider.
These are some of the aspects we take into account when evaluating features like this.
Best regards,
supermario_ai
ryantaskade: Appreciate you taking the time to educate me, that's not low hanging fruit by any stretch of the imagination! Sometimes the Juice isn't worth the Squeeze!
In other news, I made an agent Command that self-generates its commands based on the agents' instructions, ill tag you!
❤️💯
mac_isleof.ai
ryantaskade
I keep hearing how the Ai isn’t able for what ever reason … then I go to ChatGPT and presto.
So everything you guys are saying as to “WHY” the bot doesn’t do this makes no sense when we can get ChatGPT to do it! 🤷♂️
mac_isleof.ai
As a follow-up I decided to ask a custom gpt because these custom GPTs appear to be what Taskade is using for the Ai agents.
Sooooo, a custom gpt from ChatGPT returns similar behavior. My apologies for seeming to be overly critical of Taskade. It appears this is something that originates with ChatGPT custom gpt limitations.
r
ryantaskade
Hi there, thank you for the feedback, i've updated this post title and moved it the appropriate board as the suggestion is targetted at incorporating more of the plugins offered in OpenAi into Taskade.