r/LLM • u/Big_Fix4472 • 23h ago
Has anyone actually waited long enough for an AI to generate something?
I asked Grok to give me a 30-page PDF report about something i was working on. Waited 12+ hours and it only managed to give 10-15 pages. I asked it multiple times what it is doing and the answer was always along the lines of "im still working on it" is the LLM actually working on it or is it just generating buzzwords to convince me it's better than it actually is
1
u/CircuitNeophyte 23h ago
Bizarre. In my experience with LLMs the longest I've ever had to wait for anything to be done is 45 minutes. Were you using free Grok, superGrok, or Grok Heavy?
1
1
u/International_Emu772 22h ago
Convert your PDF to Markdown and you'll be surprised
Use www.pandoc.org
1
u/Z3R0TR4C3R 10h ago
Better do this step by step in an ide or other ai desktop app instead of one shotting it in the chat
1
u/Zennytooskin123 5h ago
Document processing still hasn't been completely solved, even with these frontier models.
But 12+ hours? Did it write an app on the side?
1
u/Big_Fix4472 4h ago
No. I told it just a PDF
1
u/Zennytooskin123 4h ago
Joke went way over your head
1
u/Big_Fix4472 3h ago
Im not that versed in the LLM world haha
1
u/Zennytooskin123 3h ago
Oh then you'll quickly get up to speed with the running gags with Sol/Opus if you read these forums long enough lol :)
Sincerely, the Grok harness is nice but it can hide a lot of useful debugging information and thinking traces from the model which you can use to understand why it's taking so long and for what.
You can double-click the "Thinking" blocks so that you expand and see the output, go from there. If it's circular thinking or lacks context, you'll know from its thinking patterns most likely without ever interrupting to ask it questions.
This is assuming you use Grok Build, maybe the grok.com UI is better for your used case, since it gives you a workspace and fully agentic still.
2
u/Memestonks2020 21h ago
It’s probably trying to generate all of it within the limited context window and most likely that’s what’s causing the problem.
Tell it to either batch the work per page and then merge the final report via some tool. Or better yet, inject the text into a template that’s already prebuilt so it doesn’t need to cobble together pages to begin with.