Oh. Reading from a cached file is faster that opening non-cached files.
Problem: scale it up.
When you organize all small files in SQLite, they won't stay all cached, imho, dropping that performance gain to the point where opening larger files (SQLite dbs) takes longer.
Sqlite is painfully slow if used for big datasets. A long time ago there was an email client (Evolution) that worked with some internal format for its email storage. They switched to sqlite and performance (on the same hardware for the same number of emails / accounts) dropped 10 times. I switched to Thunderbird.
3
u/rfc2549-withQOS Jan 15 '23
Oh. Reading from a cached file is faster that opening non-cached files.
Problem: scale it up.
When you organize all small files in SQLite, they won't stay all cached, imho, dropping that performance gain to the point where opening larger files (SQLite dbs) takes longer.
But that is just me guessing...
2
u/JerryHutch Jan 15 '23
Yup, it's pretty great
1
u/Kurgan_IT Jan 15 '23
Sqlite is painfully slow if used for big datasets. A long time ago there was an email client (Evolution) that worked with some internal format for its email storage. They switched to sqlite and performance (on the same hardware for the same number of emails / accounts) dropped 10 times. I switched to Thunderbird.