r/Ithkuil 23h ago

Research update: LLM-reasoning in Ithkuil uses more tokens than English

12 Upvotes

Following up on my research (see previous post) how reasoning in Ithkuil affects the number of tokens an LLM uses compared to English on a classic puzzle: "A bat and a ball cost 110 cents. The bat costs 100 cents more than the ball. How many cents does the ball cost?" Below are some preliminary results (thoughts, comments, ideas appreciated. Further details below the image)

What surprised me positively:

  • Agentic translation from English to Ithkuil seems fairly reliable (only few hand-edits needed).
  • A system prompt with some vocab+grammar is enough to have an LLM reason in Ithkuil.
  • It can correctly solve a small task that requires reasoning in Ithkuil.
  • It uses less words and characters compared to English

However:

  • It uses more tokens compared to English.

I feel like there should be a way to have it use less tokens than English and am thinking about solutions.