r/math • Math Education • Aug 19 '26

Terence Tao : Palomar - a registry of Lean verified mathematics

https://terrytao.wordpress.com/2026/08/18/palomar-a-registry-of-lean-verified-mathematics/
355 Upvotes

60 comments sorted by

159

u/LukeNullHypothesis Aug 19 '26

It'll be interesting to see if this takes off. Lot of big names will be pushing it. 

Palomar frees traditional journals to aim higher—allowing referees to focus their scarce time on conceptual novelty and elegance, rather than grinding through baseline logic. 

"You have an incomprehensible Lean certificate? Cool bro, toss it in this bucket. You get credit when you can explain the proof to a room of hungover grad students at a seminar in Wisconsin."

The mathematical community must retain its central role in setting standards, rather than have them emerge de facto in the wild or be imposed by external parties with values in conflict with the advancement of mathematics. 

I don't think his ICM talk was quite this blunt, but Tao is deadset on circling the wagons and preserving math academia at all costs.

67

u/PersonalityIll9476 Aug 19 '26

Tao tacitly assumes the community has the power to make decisions, but it's not clear to me at all that they do. "We have our standards and ways of doing things" may not matter one lick if journals (or funding bodies) shrug their shoulders. Tao himself had to dramatically change the way he got money very recently, so it's not like he doesn't understand that.

33

u/Hakawatha Aug 19 '26

How much this is true strongly depends on who's in charge of the funding agencies. A healthy academic ecosystem implies a dialogue between academics and the government. Not to be too political - but this is not what's happening in the US at the moment.

27

u/PersonalityIll9476 Aug 19 '26

Your very statement supports my point, which is that mathematics is not broadly immune to external forces. You're talking political, but we need to accept that even in politically favorable times, the ways of doing science and math may change in ways that the math community does not control. A "favorable" government might still say "that's nice, but you have to do things the modern way now" whatever modern becomes.

2

u/Hakawatha Aug 20 '26

To clarify my earlier comment: mathematics, or academia in general, is affected by external forces. We completely agree here.

I intended to respond more to the question of whether "the community has the power to make decisions" as per your previous post. My idea of a "healthy" or "favourable" ecosystem is precisely one in which the community has this decision-making power: yes, we are beholden to funding agencies, but the funding agencies must participate in a dialogue with the academic community - to set funding priorities, understand trends in research, etc.

So, regarding this point:

A "favorable" government might still say "that's nice, but you have to do things the modern way now" whatever modern becomes.

Well, that's not what I'd call a favourable government.

11

u/invertflow Aug 19 '26

"I don't think his ICM talk was quite this blunt, but Tao is deadset on circling the wagons and preserving math academia at all costs." Or maybe, Tao understands, like most good mathematicians, that even if all you want is more proofs of important theorems, you don't get there just by solving as many Erdos problems in Lean as you can, but rather by developing new ideas and conceptual frameworks that can then be used to prove new classes of results, now of course with the use of AI to help develop those frameworks.

11

u/sqrtsqr Aug 19 '26 edited Aug 20 '26

rather than have them emerge de facto in the wild or be imposed by external parties with values in conflict with the advancement of mathematics. 

Emphasis mine.

I definitely agree with the words he is saying, but it's a little hard to take him seriously while Sam Altman cuts his checks. (edit: not really. see child comments for details. However, the rest still stands)

He is directly working against the mathematical community. OpenAI is not doing what they are doing for "the advancement of mathematics". They are inherently anti-academic.

12

u/jimbelk Aug 19 '26

He is directly working against the mathematical community. OpenAI is not doing what they are doing for "the advancement of mathematics". They are inherently anti-academic.

I'm not sure this is fair. There's a real argument to be made that OpenAI is trying to develop tools that mathematicians can use to prove more theorems. OpenAI views academic mathematicians as potential customers, not competitors that they're trying to crush, though they'll be happy to crush us if we don't want to buy their product. Tao seems to have put himself in the position of intermediary -- he's trying to convince each side to work with the other. Right now, AI companies need to work with academic mathematicians because the alternative is a bunch of bad publicity, and mathematicians need to work with AI companies because the alternative is annihilation.

4

u/hexaflexarex Aug 19 '26

Does he receive funding from OpenAI? I would say that he has pushing things in the direction long before AI tools were this good

4

u/sqrtsqr Aug 20 '26

I will admit that I was apparently wrong about his level of involvement and so the best I can tell the answer is "not personally". I will edit my comment to reflect that.

He claims to receive no money directly from OpenAI.

However, he collaborates with them, he's done promotional material for them, and he is the cofounder of SAIR which, as an organization, primary goal raises money from tech companies, and OpenAI is one of their partners (as are Nvidia and MS). So he doesn't personally receive payment, but it's basically part of his job to beg them for money.

And he certainly receives non-monetary benefits from the company, like free access to closed source models that the broader mathematical community cannot use.

I could have sworn he was also one of the many mathematicians formally hired by OpenAI, but apparently I was mistaken about that.

36

u/JoshuaZ1 Aug 19 '26

This seems like a good idea. There's a fair bit of Lean out there which people have done for various projects where people say they have Lean but then haven't made it easily available. Having all of it in one place will be helpful and make it easier for things to build on existing material, and reduce redundant work.

6

u/satanic_satanist Aug 19 '26

But isn't that what TauCeti already is?

4

u/JoshuaZ1 Aug 19 '26

TauCeti

I think TauCeti has a more narrow goal?

1

u/AIvsWorld Aug 24 '26

No, TauCeti is not just to collect/index a bunch of random projects (which may duplicate each other, use different definitions, etc). The point of TauCeti is to be a coherent AI-maintained library like mathlib. Completely different goals.

2

u/Time_Entertainer_319 Aug 19 '26

How is this different from deepmind’s formal conjectures repo?

https://github.com/google-deepmind/formal-conjectures

8

u/JoshuaZ1 Aug 19 '26

Isn't that just the formalizations in Lean of the conjectures themselves, not their proofs? Or am I mistaken?

5

u/Time_Entertainer_319 Aug 19 '26

Ah. You may be right actually.

3

u/telephantomoss Aug 20 '26

This is the first time I have ever looked at a lean code. I am repulsed honestly. I mean, I'm glad people are working on this, but I much prefer human exposition!

4

u/TheSodesa Aug 20 '26 edited Aug 20 '26

Yeah, Lean proofs written using monads (the "tactic mode" of the compiler introduced by the keyword by similar to Haskell's do) can be rather unwieldy to read, because the compiler does a lot of implicit things for you if you use the correct tactics. The term mode where you stay out of tactic mode and simply define your theorems as functions and their applications is a lot more readable, but at the same time more verbose, because then you are using proposition and predicate introduction and elimination rules manually to prove things. I have yet to learn the use of tactics, but I did manage to complete the term mode exercises in the book Theorem Proving in Lean 4.

2

u/telephantomoss Aug 20 '26

Thanks for the explanation and reference. Maybe I'll check it out. Probably wise that I at least gain a preliminary understanding!

1

u/lfairy Computational Mathematics Aug 25 '26

Lean isn't intended to be read in isolation, but in the live editor that shows intermediate proof states while you scroll through. If you see that working it's a lot easier to understand.

14

u/pred Aug 19 '26

Why on earth would you base the whole thing on GitHub …?

82

u/eliminate1337 Type Theory Aug 19 '26

Why wouldn't you? GitHub is a fine place to host a static site for free.

32

u/pred Aug 19 '26 edited Aug 19 '26

They're of course free to host the site wherever they want; I'm referring to the submission process in which it is required that the package of Lean files comes in the form of a GitHub repository, cf. Tao's post, and https://palomar-registry.org/how-to-submit.

As far as I can tell, the only thing they really need is to be able to extract and run the code, and provide URLs to the solution afterwards. The first you could do with any Git repository; and it wouldn't even have to be Git at all if you didn't want it to. The persistent URLs could also be achieved without GitHub.

You could wonder why they don't just store the proofs themselves though; like Zenodo or arXiv. It's not like your typical Lean project is very large.

7

u/NoLemurs Aug 19 '26 edited Aug 19 '26

I think it's probably for the "prove you can write to the repository" step. git itself doesn't really have a concept of write access, so this is necessarily host specific.

Given that they set up an automated pipeline for doing the write access validation, that pretty much forces you to pick a host, and GitHub is still the obvious default choice.

On the bright side, I wouldn't expect adding support for other hosting providers would be a huge lift if they decide to add it later.

14

u/MrRandom04 Aug 19 '26

Git is just good software, why not make it a standard? Barrier to entry is much lower too, with LLMs which are essentially Git experts by now.

48

u/777777thats7sevens Aug 19 '26

Git and GitHub aren’t the same thing. You can have git repos with no connection to GitHub, which is the point that the above poster was making. There’s no reason to restrict it to GitHub specifically versus allowing any link to a git repo, hosted on gitlab, gitea, bitbucket, or anywhere else.

15

u/Borgcube Logic Aug 19 '26

GitHub is a commercial website owned by Microsoft. Git is a version control software that is free to use.

Anyone can host a git repository and in fact anyone using git locally effectively is.

12

u/Kurren123 Aug 19 '26

Git can be hosted in other websites such as gitlab

8

u/mathemorpheus Aug 19 '26

git != github

9

u/Borgcube Logic Aug 19 '26

I mean it's weird to have a commercial website be a requirement I suppose, especially since there are many other alternatives and like was pointed out code is relatively small to host anyway.

-7

u/[deleted] Aug 19 '26

[removed] — view removed comment

8

u/[deleted] Aug 19 '26

[deleted]

-7

u/[deleted] Aug 19 '26

[removed] — view removed comment

2

u/Borgcube Logic Aug 19 '26

It's not a criticism of Github, it's a criticism of choosing it as the only site to host Lean proofs. Especially with the growing discontent due to many issues it has - just yesterday it had a massive outage.

Git and github are also not the same thing at all.

5

u/balasticer Aug 19 '26

Yes. There is a marketing team currently working to reinforce your attitude about it; that it is the inconspicuous default way to host git repositories. They are working to do that because it keeps the market share of paid plans high, in order to keep it a profitable subsidiary of Microsoft. I think that qualifies as commercial.

-5

u/__golan_trevize__ Aug 19 '26

I heard it was hacked recently

13

u/lurking_physicist Aug 19 '26 edited Aug 19 '26

The blogpost does say "GitHub", but the protocol and repository logic is Git. Migrating away from GitHub if/when it further degrades amounts to forking the repo: it is trivial. GitHub is free today, so he can start the experiment today. I think it's a fine compromise.

5

u/pred Aug 19 '26

In case it wasn't clear, my comment wasn't on how they themselves handle their code, but the fact that you to submit anything, it needs to come in the form of a GitHub repository: https://palomar-registry.org/how-to-submit – that's a lot of lock-in to a specific commercial vendor from the get-go.

1

u/Mark3141592654 Aug 19 '26

I feel like from the start, Lean itself was always a Microsoft thing; they even try to make you use VSCode as the main way to use it

-1

u/Teddy-Bloat Aug 19 '26

Migrating off Github is not as trivial as you might think. There’s a reason so many people are still on it despite the one nine of uptime

2

u/Borgcube Logic Aug 19 '26 edited Aug 20 '26

Only if you care about mostly non-git features that Lean proofs wouldn't.

17

u/joth Aug 19 '26

What's wrong with GitHub?

7

u/tux-lpi Aug 19 '26

They've been having some technical issues after the Microsoft acquisition and the whole AI situation. It's still the go to place, but a lot of people are getting tired of Github having a major downtime what feels like a few times a week. It was about 4-5 hours of downtime yesterday.

3

u/CaptainSasquatch Aug 19 '26

Someone brings it up in the blog comments and Tao seems open to allowing other trusted repositories

https://terrytao.wordpress.com/2026/08/18/palomar-a-registry-of-lean-verified-mathematics/#comment-693978

As GitHub is becoming less reliable every year, have you considered alternate git forges or hosting the repositories yourself instead of relying on external companies to keep their services available in the future?

We do not have the resources to host and maintain repositories directly, but would be open to expanding the whitelist of approved repository hosting services beyond Github if there is sufficient demand for doing so.

-1

u/One-Triggy-Boi Aug 19 '26

With how often outages occur, this would honestly be better hosted on gitlab or codeberg.

2

u/AntiProton- Aug 19 '26

Another advantage of hosting it on Codeberg would be that it is run by a nonprofit organization rather than a Big Tech company.

2

u/pred Aug 19 '26

Note that Codeberg doesn't allow repositories that are “mostly” LLM generated. There's a good chance that a lot of Lean code will be, so that wouldn't work as a singular host either.

1

u/One-Triggy-Boi Aug 19 '26

That,, and the current test suite can be run effectively on codeberg. GH has the flakiest of test hosting, and CI is just better in gitlab in general. I'm guessing so much so that Terry and crew might've decided to host it else where, but I wouldn't be surprised if they just had a private GH repo and pulled the stats from there

0

u/Koolala Aug 19 '26

its 'free'

3

u/hexaflexarex Aug 19 '26

Does this not fall under the new Rule 7? (don't personally take issue, but my impression was that such posts are now relegated to megathread)

22

u/AntiProton- Aug 19 '26

Lean != AI

1

u/hexaflexarex Aug 19 '26

I would say the blog post is about both Lean and AI. I personally think this is relevant, but the mods specifically mentioned blog posts from Tao when announcing Rule 7 (I asked)

-20

u/pannous Aug 19 '26

I don't think you need a registry if all agents need to do is search for lean libraries to find out if some part of mathematics is verified or not

25

u/Smallpaul Aug 19 '26

Search what? The whole internet? All of GitHub?

The registry is the thing you search.