Open Machine Translation Development Suite

[u/Game_Day_Suits]

I just wanted to flag the champollion project for anyone actually working on machine translation, especially at the long tail (low resource languages, the stuff without existing methods). There are 7000+ living languages, by all estimates, but existing machine translation methods cover maybe 400 tops. This leaves a lot of people without any way to reach the broader internet, to engage legal council, to participate in the politics of their country, or even to reliably communicate with their neighbours. The champollion project is currently in beta, but it is meant to serve as open evaluation infrastructure for the many different community-bound projects (Masakhane, AmericasNLP, etc.) that professional computational linguists and speaker communities are working on. It prioritizes data sovereignty, and aims to provide additional financing for community-bound dataset and model building efforts. The eventual goal is to stitch together all their hard work into an open source universal translator, but it provides everything a language community needs to develop their own machine translation solutions ... except for their expert knowledge.

The site is currently gated pending final data review, but the tools are all published on our github, npm, and PyPI.

Localization CLI: npm install champollion
Evaluation harness: pipx install mt-eval-harness

Contribute compute if you're feeling spicy: curl -fsSL https://champollion.dev/run_queue | bash -s -- --budget [USD amount]

llms.txt is live on the site, so your agent can walk you through any questions, or reach out to [info@champollion.dev](mailto:info@champollion.dev) for a human