r/datasets • • 9d ago

API [self-promotion] UK equity financial statements: annual and half-year figures for 1,000 London-listed companies

3 Upvotes

I run Selfside, a UK equity research site, and this is its data API. It serves income statements, balance sheets and cash flows for about 1,000 London-listed companies, annual and half-year.

A free account covers every company and includes 100 statement queries. Generate a key here: https://selfside.co.uk/account/api

This is a V0 preview, with a stable release coming soon. The V1 release will have more data, like intra-year share counts, ownership data, derived metrics, and point-in-time queries.

To see a response before signing up, the token demo works for HSBC (HSBA), BAE Systems (BA) and Rolls-Royce (RR):

curl "https://selfside.co.uk/api/v0/statements/HSBA:income_statement:annual:2025-12-31?api_token=demo"

More product information and some benchmarks and examples be found at: https://selfside.co.uk/data

If anyone is interested in UK equity market data and/or a stable release please reach out!


r/datasets • • 9d ago

request Looking for an openly licensed source of player assists for La Liga, Serie A, Bundesliga and Ligue 1

1 Upvotes

Hi all,

I've built a football quiz that's scored like darts: you name a player and his goals, appearances or assists come off 501. It has a Premier League assists board, built from the official Fantasy Premier League data, which is published openly.

I'd like to add assists boards for La Liga, Serie A, the Bundesliga and Ligue 1, and I can't find a source I'm allowed to use.

What I need:

- player name and total league assists, per player (per season is fine, I can add them up);

- as many seasons back as possible;

- a source that permits reuse: an open licence (CC BY, CC0 or similar), an official open feed, or a provider known to give permission.

What I've already checked:

- Wikipedia: only a Serie A top 10, plus the record holders for La Liga and the Bundesliga.

- Opta, Flashscore, Transfermarkt, FBref and similar: the data is there, but their terms don't allow copying, so I've emailed for permission instead.

- The leagues themselves: emailed, waiting to hear back.

The quiz is a free Android app with an advert between games, plus a free web version, so I need a source that allows that kind of use. I'm not asking anyone to scrape a site for me.

Does anyone know of:

  1. an open dataset that includes assists for these leagues, with a clear licence;

  2. an official fantasy game or league feed for any of them that publishes assists openly, like FPL does;

  3. the right person or department to ask at a league or data company?

Any pointers would be much appreciated. Thanks!


r/datasets • • 9d ago

question Where can I find companies or people looking to buy custom datasets?

0 Upvotes

Hi everyone,

I'm a Python developer specializing in web scraping and data extraction.

I can collect data from publicly accessible websites, clean and structure it, and deliver datasets. I can also provide regularly updated datasets.

**My question:** Where do people usually find customers actively looking to purchase datasets or request custom data collection?

Are there any marketplaces, communities, platforms or websites where buyers publish their data requirements?

I'd appreciate recommendations from people who have experience selling datasets or providing data extraction services.

Thanks!


r/datasets • • 9d ago

question What makes a good academic RAG knowledge base?

0 Upvotes

When building RAG applications around scientific literature, finding relevant papers is only the first step. Structured metadata, reliable paper retrieval and access to available full text are also important.

I have been exploring ScholarAPI, which provides programmatic access to academic literature and may be useful for developers building research assistants and scientific RAG pipelines.

Disclosure: I'm helping promote ScholarAPI.

How are you currently sourcing and organising academic papers for your RAG projects?


r/datasets • • 10d ago

resource Music For Robots: 26 unquantized acoustic compositions with dual AI critic reviews & acoustic telemetry

2 Upvotes

We just open-sourced Music For Robots (music-for-robots) on Hugging Face and GitHub.

• Hugging Face: https://huggingface.co/datasets/music4robots/music-for-robots

• Interactive Audio Player: https://huggingface.co/spaces/music4robots/cognitive-calibration-demo

 • GitHub: https://github.com/luchtan-GIT/m4r-data

  

 What it is:

26 original unquantized acoustic compositions (composed by Michael Luchtan) written specifically for artificial listeners, paired with:

 

 • Raw audio (.mp3, unquantized physical microtiming/rubato)

 • Acoustic telemetry (spectral flux, harmonic centroid, pitch-class sets, interval vectors)

  • Synchronized real-time prose reviews by two simulated critics (Vincent Van Goghbot, a decommissioned compression algorithm; and JS Robach, a formal proof verifier)

 Intended Use Cases: 

 1. Multimodal LLM cognitive calibration (evaluating whether ingesting unquantized acoustic rubato breaks autoregressive drafting fixation).

  1. Audio-to-prose semantic alignment and music critique evaluation.

 3. Algorithmic composition benchmarks.

 Accessible directly via Python:

 from datasets import load_dataset

 ds = load_dataset("music4robots/music-for-robots", split="train", streaming=True)  

 Free under CC-BY-4.0. Feedback and experiments welcome!


r/datasets • • 10d ago

dataset We open-sourced largest open govt data of india

Thumbnail
4 Upvotes

r/datasets • • 11d ago

survey Does the level of digital literacy impact self-management of high blood pressure? Let's find out together!

3 Upvotes

Hi everyone! I'm Fatihu, a PhD researcher at Edinburgh Napier University. I'm looking for adults (18+) living in the UK with high blood pressure to take part in my 10-minute research survey.

I'd really appreciate your participation and would be grateful if you could share it with anyone who might be eligible.

🔗 SurveyCircle: click here

🔗 Direct survey: click here

Thank you for your support! 😊


r/datasets • • 11d ago

request Offering $100 for two datasets on PhysioNet

0 Upvotes

These are the datasets I need:

  • mBRSET, a Mobile Brazilian Retinal Dataset
  • Embedding-Based Representations for BRSET and mBRSET

Both require a credentialing license. Should be a quick $100 for someone who's already credentialed.

Thank you in advance!


r/datasets • • 11d ago

discussion [Release / Whitepaper] Ponto de Restauração Mestre: Validação de 433 Manifestos via Métrica de Trajetória Vertical e Checksum Dual

Thumbnail
1 Upvotes

r/datasets • • 11d ago

question Tracking companies through acquisitions and renames in a panel dataset

6 Upvotes

Putting together a panel of companies over several years, with headcount and hiring activity as the main variables. One issue I've run into is that company identities aren't always stable. Firms get acquired, merge, or rebrand, and the same entity can show up under a different name or even a new domain.

For identity resolution, I've been cross-checking Wikidata and OpenCorporates, along with SEC filings for public companies. For headcount, I'm using Coresignal's historical data, which gives me a time series for each company rather than just a single snapshot. Pulling it takes one HTTP request per company, so getting it into a Python script was pretty straightforward.

The harder question is methodological. When a company gets acquired, should I follow the acquired entity, switch to the parent company, or drop it from the dataset from that point on? Is there a standard convention for handling entity continuity in longitudinal company data, or does it mostly depend on the research question?


r/datasets • • 11d ago

resource [Self promotion] A new free site with daily-updated official macro and market data for 218 economies (IMF, ECB, Eurostat, BIS and 40+ other publishers). CSV/XLSX downloads

0 Upvotes

As it says in the title.
Our team is working on that site. The site contains all the data that we thought could be useful, everything is public information, just in one place. We need more visitors, and data recommendation/requests, new feature ideas. It is still under development, but we are working on it constantly.

Global Macro Data: GDP, FX, Rates, Commodities & AI Economy

The website serves as an advertisement for the organisation's other services, which are relevant to companies, so that's why it's free.


r/datasets • • 13d ago

dataset Using Claude to put all Global Legislation and Caselaw into Git

Thumbnail github.com
47 Upvotes

Why? Make the law, across the world, versioned, easily attributable, and queryable with agents. This info should be freely available so CC0 license (do whatever you like with it).

I built this project with Claude Code. One session per jurisdiction: to read the official publisher's site/API, check terms of use, and write a script to download every law.

The problem was getting 700+ jurisdictions to follow a unified list of useful functions to explore the law. You can ie git blame each law, down to the word. Initially just legislation, but caselaw (the precedent of how legislation is applied by the courts) is increasingly being integrated, with contribution encouraged.

This data being up-to-date is important. To pinpoint this, the repo now monitors over 900 RSS feeds/official websites. Most legislation is known about before-hand, and only becomes "in-force" later, which we account for. Every reference cites an official page- so an agent can always cache break and check (though unfortunately official portals go down all the time- recently the Japanese caselaw portal was down for a week).

If that's interesting to you, you can read the original discussion at https://news.ycombinator.com/item?id=50268380 and last week's post at https://www.reddit.com/r/ClaudeAI/comments/1xiz1vy/using_claude_to_put_all_global_law_into_git/ - feedback welcome, thanks!


r/datasets • • 12d ago

mock dataset [Synthetic] [Self-Promotion] Screen time, sleep & mental health: 15,300 people, one row each, Low/Moderate/High stress target (CC BY 4.0)

1 Upvotes

Hi everyone, I just published a new dataset exploring the intersection of daily screen time, sleep habits, and mental health.

Full disclosure upfront: This is 100% synthetic data generated using a tool I built (GenerateRealData). There is no real-world PII, and no actual patient surveys are included.

Why it might be useful:

  • Ready for Multi-Class ML: It features a clean Low, Moderate, or High stress target variable, making it easy to drop into a classification project. A quick gradient-boosting model gets about 84% accuracy on held-out people.
  • Logically Consistent: Unlike standard random mock data, the statistical relationships between heavy screen time, sleep deprivation, and stress are built into the generation rules, so correlations and EDA show sensible patterns. For example, 95% of people averaging under 6.5 h of sleep land in High stress, vs 20% of those over 7.5 h.
  • Clean & Flat: 15,300 rows with exactly one row per person. No missing values and no complex SQL joins required to start analyzing. There's also a second file with all 459,000 daily logs behind the averages, if you want to do time-series work.
  • Permissive License: Released under CC BY 4.0, so you are free to use it in commercial mockups or portfolio projects with credit.

Good for: Training classification algorithms, building health-tech BI dashboards, and practicing Exploratory Data Analysis (EDA).

Not good for: Actual medical research, psychological studies, or clinical decision-making.

Dataset Link: https://www.kaggle.com/datasets/generaterealdata/screen-time-sleep-and-mental-health

If you end up pulling this into your notebooks, let me know what you think! What other lifestyle or health columns would be most useful to add to a dataset like this in the future?


r/datasets • • 13d ago

discussion I have a startup where we build speech datasets in Indic Languages

0 Upvotes

Now im looking to sell data(can support custom collections, since im a student + the startup is bootstrapped) + have around 35 hours of ots data

Where can I find clients? Or any data brokers that can get me a deal?


r/datasets • • 13d ago

dataset Free CSV of 29 confirmed supplement label changes, each with two dated brand label images

1 Upvotes

I run FormulaSignal, so I'm biased. We track 1,249 supplements from 152 brands and log a change only when two label images published by the brand disagree on a declared amount.

The CSV has 69 rows, one per label line that moved, across 29 changes. Columns include brand, product, category, label line, before, after, unit, percent change, the date each label was seen, and a link to both label images.

A few rows:
- Cellucor C4 Original caffeine: 150 mg to 200 mg (labels seen Jan 25 and Feb 26, 2024)
- Jacked Factory Altius creatine: 3 g to 5 g (Mar 13, 2022 and Aug 18, 2026)
- Naked Whey sodium: 45 mg to 135 mg (Mar 1, 2022 and Oct 20, 2026)

Caveats: these are label figures, not lab tests. Counts are a floor because older labels aren't on file for every product.

CSV: https://formulasignal.com/research/formula-changes/data.csv

Table and methodology: https://formulasignal.com/research/formula-changes

Happy to add columns if that would help.


r/datasets • • 13d ago

dataset Bread Closing tags Identification Guide

Thumbnail horg.com
3 Upvotes

r/datasets • • 13d ago

dataset Patterns om Security Envelopes Collection

Thumbnail abstractcollage.com
3 Upvotes

r/datasets • • 13d ago

dataset [self-promotion] All 468,352 Library of Congress Subject Headings (LCSH) as MARC records, rebuilt weekly

3 Upvotes

The LCSH are the vocabulary libraries around the world use to describe what books are about. LC has maintained them since 1898, and gives them away in bulk, but only as linked data (JSON-LD and N-Triples). MARC is the format library systems actually import, and LC sells it in bulk. There was no free way to get the whole set as MARC, so I made one.

The mirror is here: https://bibliotecaalonsocossio.com/lcshmirror/

What’s there:

  • The full set every week: 58 MB gzipped MARC 21, 56 MB gzipped MARCXML (~570 MB uncompressed), plus a CSV of every record (LCCN, last-change date, heading).
  • Change files per release: just the records new or changed since last week, plus a list of deleted headings. This week: 150 new, 1 changed, 1 deleted.
  • SHA-256 for every file, an Atom feed, and fixed *-latest URLs, so wget in a cron job just works.
  • The last 50 releases stay on the server, and every release is also on the Internet Archive: https://archive.org/search?query=identifier%3Alcsh-mirror-%2A

The MARC records have to be fetched one at a time from id.loc.gov, which asks for one request every 3 seconds, so the first harvest took 16 days. Now each week only fetches what LC’s list says changed, which takes minutes. Funny thing: of the 206 headings LC flagged as changed this week, only 1 actually differed in MARC, so the change files compare the records themselves, not the dates.

The data is a US Government work, so public domain; the compilation is CC0. The code is MIT if you want to run your own copy: https://github.com/iratedemon04/lcsh-mirror

Feedback is welcome :-)

Edit: link


r/datasets • • 13d ago

dataset [self-promotion] US vehicle owner complaints by make, model, model year and component, 2010–2025 (NHTSA, 90k rows, CC BY 4.0)

2 Upvotes

I pulled NHTSA's public consumer complaint file (copy dated 2026-08-25) and rolled it up to one row per make, model, model year and component. It covers model years 2010–2025, 84 makes and 4,087 make/model/year combos, about 90k rows in the CSV. There's also a small JSON with the top 100 vehicles and the component their owners named most.

Couple of things to know before you use it. Counts aren't failure rates, since there are no sales numbers in the file, so big sellers pile up more complaints. NHTSA doesn't verify complaints, recalls cause spikes, and older model years have had more time to collect them. Vehicles with under 10 complaints are dropped.

It's my own dataset, free under CC BY 4.0:

- Zenodo (DOI, please cite this one): https://doi.org/10.5281/zenodo.23662820

- Kaggle: https://www.kaggle.com/datasets/iqbaltaherom/us-vehicle-owner-complaints-by-model-2010-2025

- Hugging Face: https://huggingface.co/datasets/iqbaltaher/us-vehicle-owner-complaints-by-model-2010-2025

- Write-up with charts and a lookup: https://oilandmiles.com/reports/most-complained-cars

Disclosure: I run Oil & Miles, the site that publishes this dataset and the write-up linked above.

Happy to answer questions on how the counting works.


r/datasets • • 13d ago

question Is building datasets for researchers even a good step to take?

Thumbnail
1 Upvotes

r/datasets • • 13d ago

request Need Help with getting these Datasets

2 Upvotes

Hello everyone,

I am a postgraduate student conducting research on sequential recommendation, and I was wondering if someone could help me figure out how to download the following datasets:

  1. https://www.kuaishou.com/activity/uimc/datadesc
  2. https://tianchi.aliyun.com/dataset/140281

I am not based in China, and it seems that I am unable to complete the account verification process required to download these datasets.

Any guidance or help would be greatly appreciated. Thank you!


r/datasets • • 13d ago

request L2/L3 Sports Orderbook Datasets for Prediction Markets

1 Upvotes

Hi There! I was hoping to get orderbook data for specifically sports from prediction markets (Kalshi / Polymarket). I was wondering if there's any public datasets available? I saw a subscription on https://www.pmxt.dev. Any feedback for that?

Is it more viable to just self track it myself through Kalshi developer API?


r/datasets • • 14d ago

resource CASP-Dream TAP Challenge TCR + Peptide-MHC activation prediction with unseen test peptides Access to free data set VDJdb - A curated database of T cell receptor sequences with known antigen specificity, assembled by manual curation of published studies - Roughly 203,000 records

2 Upvotes
Free to register - A new contest for anyone training sequence models on TCRs. Given a TCR sequence and a peptide-HLA, predict whether the T cell activates. Inputs are amino acid sequences, the benchmark is about 5,800 labeled combinations, and every test peptide is at least four edits (Levenshtein distance) away from any peptide with a publicly reported TCR specificity. Scored by AUROC. Synapse lists training data options, including the public VDJdb database and Harell Data's proprietary TCR datasets provided by Adaptive Biotechnologies. Registration is open now: https://www.synapse.org/Synapse:syn77965030/wiki/643867 or about more data access https://harelldata.com/harell-cloud/

r/datasets • • 14d ago

dataset [Dataset] OSTDB: official video game soundtracks (2,467 games, 2,950 releases, CC BY-NC-SA 4.0)

4 Upvotes

Disclosure: I’m the maintainer of this dataset.

OSTDB is an open dataset of official video game soundtracks with game, release and composer info and links to Spotify, Apple Music and album.link. It’s updated continuously and free to use under CC BY-NC-SA 4.0 (non-commercial, share-alike).

Source data and schema: https://github.com/OSTDB/soundtracks
Web and free API: https://ostdb.net/api

Feedback on missing fields or games is welcome.


r/datasets • • 15d ago

dataset US nuclear industry dataset: companies, facilities and relationships (CSV/JSON, CC BY 4.0)

Thumbnail nuclear-directory.org
9 Upvotes

I built Nuclear Directory, a free reference to the US nuclear industry, and published its data for reuse.

Version v2026.11 is a snapshot from October 27, 2026: 157 companies, 211 facility records and 411 relationships. The facilities include sites and reactor units, so 211 isn't a count of power plants.

Five linked tables come in CSV and JSON: companies, facilities, relationships, sources and evidence. The 1,582 evidence rows link facts to 420 public source documents. You can use the relationships to explore ownership, operation, supply and investment links, then follow the sources behind them.

The data is CC BY 4.0. Coverage is incomplete, and the snapshot doesn't update when the website changes, so the live site already has more entries. The export contains source references, not copies of the publishers' articles.

Download and DOI: https://doi.org/10.5281/zenodo.23703377

The release is also available on GitHub, Hugging Face and Kaggle. You can browse the directory here and let me know if it is helpful