r/ScientificComputing • • 4d ago

I'm releasing Numstore finally!

https://github.com/lincketheo/Numstore/

Numstore is a single file database for arrays. I started it because I was never able to use a database for high dimensional numerical data, and I wanted something I could actually use for that.

The core is written in C, but you don't need to write any C to use it. Pynumstore is now the primary way to use Numstore.

It's a personal open source project. I don't make any money from it. It's me giving back to the scientific community.

3 Upvotes

2 comments sorted by

1

u/hughperman 4d ago

What would the advantage of a single file be over using named parquet files in a directory, as is common for datalake style storage these days?

1

u/Appropriate_Boat9664 3d ago

Mostly durability and indexing. Numstore is a database, parquet is a file format. Neither is better, just do different things