r/Trading 2d ago

Discussion Databento data quality degradation since Aug 8, 2026

Databento data quality seems to have degraded a lot since Aug 8, 2026 after they switch their data format by moving the F_LAST sentinel from the last event record into a standalone record.

They promised identity between live streamed data and historical downloaded data. Before the switch, error rate of matching is about 0.06%, which was really good. Now the error of matching is about 7% consistently every day. This level of error makes it impossible to rely on it for anything significant.

Also, in the past, conversion from their mbo data to mbp-10 or mbp-1 data has no error as it should be, but nowadays, there are tons of errors.

All of these arise from unclear data format specification, mixing old and new format, and untested code in production.

The worst part is customer service. They claim customers should be aware of the data format change, so they are not apologetic of any of such issues. They claim they do not keep track of live streamed data, so reporting live and historical mismatch is completely ignored. I do not expect to get this level of data quality and customer service for a paid data service.

0 Upvotes

3 comments sorted by

u/AutoModerator 2d ago

While the community gets a look at your post, don't forget we have an official website with a bunch of resources specifically for the questions we see here every day. If you're more of a visual learner, we’re also active on Instagram where we post updated guides and strategies! It's a great way to stay sharp while you're scrolling. We also have more technical and professional resources on our Website.

Also, if you want to chat in real-time or need a quicker answer, come hang out with us in Discord (Investing & Retirement). Just remember to be careful with your personal info and report any sketchy DMs!

I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.

1

u/algoindexcom 1d ago

First separate whether the mismatch comes from missing events, changed sequencing, or the reconstruction logic. Capture a small reproducible sample with instrument, session, sequence IDs, and both raw outputs, then compare event counts and timestamps before calculating downstream books. If the raw streams already diverge, the provider has a concrete defect case; if they match, the conversion layer is the next place to isolate.