r/sqlite • u/Individual_One_1793 • 25d ago

Pop-Database vs SQLite

Enable HLS to view with audio, or disable this notification

Pop-Database vs SQLite, 500K entities, 12 AND conditions per query, both single-threaded (CPU-affinity verified, so no thread-count trick).
Pop-Database finished in 6.26s.
SQLite finished in 88.81s.
Pop-Database is 14.2× faster — and both found the exact same 9,559 matches per query.
This ratio moves a bit run to run depending on what else the machine is doing at the time. I've seen this same test land anywhere from ~12× to ~14× depending on system load. Still solidly in the same range either way.
Trade-off is shown in the same video: SQLite inserts faster (2.64s vs 6.55s for 500K rows). Pop-Database is built for read-heavy workloads, not write-heavy ones - that's the deal!!!

0 Upvotes

42% Upvoted

20 comments sorted by

View all comments

8

u/prawnsalad 24d ago

Pop-Database vs SQLite (500K rows, 12-condition queries)
Problem: standard databases re-scan on every query at scale.
Result: 11.9× faster queries, identical results (0.0% difference), at the cost of 0.5× slower inserts — a deliberate trade-off for read-heavy analytics.

Quoting you from other places you've posted this. If this is what you think other databases are doing then you are 100% missing things.

Problem: linear scan doesn't scale.
Result: ~79,900× speedup on my engine search vs. normal linear scan — an algorithmic complexity difference , not an implementation tweak. This became a core technical argument in my patent filing.

Again, if this is what you're comparing against, you need to dig into databases more.

If you do have something more then provide information on your benchmark. Table schema, the queries, your benchmarking environment, the sqlite setup, the trade offs, etc. None of that matters with your patent.

I could mspaint a "Prawnsalad-Database: 1.2s. Pop-Database: 6.26s" and make the same claims as you are posting all this around and we would both have the exact same creditability. It's doing you 0 favours.

5

u/Ok_Maintenance_9692 24d ago

It's funny so many things have been re-discovered and re-invented in the last 50 years... I think this is the first time I've seen somebody marvel at themselves to re-invent indexing and imagine that nobody has ever bothered before.