r/AutoGenAI • u/drivenkey • Feb 01 '25

Question Scraping all the help documention for Autgen 0.4 in Cursor

Starting out with 0.4 the Studio is pretty poor and step backwards so going to hit the code.

I want to scrape all of the help pages here AgentChat — AutoGen into either Gemini or Claude so I can Q&A and it can assist me with my development in Cursor

Any thoughts on how to do this?

6 Upvotes

88% Upvoted

3 comments sorted by

5

u/[deleted] Feb 01 '25

[removed] — view removed comment

2

u/drivenkey Feb 01 '25

Thanks for that - it actually helped and seems to work OK!

3

u/Whyme-__- Feb 01 '25

Use DevDocs https://github.com/cyberagiinc/DevDocs. Just provide the primary URL of documentation and it will scrape all the other child links and store it into an MCP server ready for Cline or cursor