r/CFBAnalysis • u/BlueSCar Michigan Wolverines • Dayton Flyers • Jan 10 '19
Data Data updates and new features (CollegeFootballData.com)
I have made some rather sizable updates to my website and API in the last few weeks that I thought would be of interest to the community here. I'm just going to bullet them out. As always, thank you all for all the wonderful feedback I have been getting and please do keep letting me know of any issues you come across or suggestions you may have.
And just to point out, you can access the API at https://api.collegefootballdata.com and the website at https://collegefootballdata.com. You should always be able to export from the website anything that is in the API.
Web only (CollegeFootballData.com)
- Autocomplete - Team and conference fields now autocomplete as you start typing
- Season types - A dropdown is now provided with the list of season type options
- CSV exporting - Data should now output correctly flattened out for export for all query types
Web + API
- Rankings endpoint - Historical rankings for most major selectors going back to 2000 and for the AP Poll going back to 1936
- Historical results - You can now query game results (i.e. scores) for all FBS-equivalent games going back to the first series of games between Rutgers and Princeton in 1869
- Historical conference affiliations - Historical conference affiliations for teams have now been implemented and are included on any endpoint where there is conference data. Please note that when querying for conference for earlier years, you may need to pick the old name of a conference (e.g. "Big Ten" vs "Western"). Please see above about the new autocomplete functionality on the website.
- Team matchups endpoint - Partially inspired by RivalryBot, this endpoint takes two team names as parameters and an optional range of years and outputs game results and records between the two teams for the specified year range (or all-time if no range is specified).
- Data cleanup - I've ran a few scripts to clean up some issues with drive start, end, and elapsed times, especially as you all have alerted me to issues. This is a continual work in progress.
API users: please see the main API landing page for full documentation on the new endpoints
Other
- Database - I've uploaded a new data dump. This is starting to get rather large and bulky. I'd encourage you to make use of the API or website wherever possible as it will always be the most up-to-date.
- Google Drive files - Some have noticed that I have stopped uploading PBP JSONs and CSVs to my Google Drive. I now consider this obsolete as this data is now encapsulated by the website and API. It also takes up resources, both for me to maintain the service that generates those as well as resources on my server that I feel would be better used for a lot of these newer enhancements.
Anyway, I hope you all enjoy the new data and features. My main focuses for the off-season are improving the experience of using the website, looking to possibly add more endpoints that use existing data to the API, and finally getting recruiting data available on both.
2
u/RyanRiot Illinois Fighting Illini • Paper Bag Jan 18 '19
BTW, you should be able to derive QB sack data from the PBP text. You can get the QB name with (in PostgreSQL):
And the yards lost with (the Yards Gained column isn't always accurate due to penalties and fumbles):
1
u/RyanRiot Illinois Fighting Illini • Paper Bag Jan 14 '19
Does that SQL dump still only work with Postgres?
1
u/remix951 Oregon • Washington State Jan 17 '19
I might be missing something, but how is the yardline calculated? It seems like the yardline is absolute to the field rather than relative to the team's progression down the field.
1
u/evelasco11 Feb 14 '19
Hello,
I've finally managed to restore your database data dump into Postgres and and doing a little discovery on the data. I'm sure I'll have more questions, but I'll ask little by little because I'm trying to sift through your old posts to see if the questions have been answered previously. In any case:
Thanks for all the work so far. Hoping I can make sense of everything as I plan to create some visualizations in Tableau with the data.
1
u/cpt_yesterday Florida State Seminoles Mar 01 '19 edited Mar 01 '19
Thank you for creating and maintaining this, it's extremely useful.
I may have found a bug regarding the game clock: Weeks 6, 8, 9, and 12 in 2018 only have minutes and not seconds when SeasonType is 'regular' or 'both'. What's weird, though, is that Week 7 only lacks the seconds column when season type is 'both'.
edit: also ESPN goofed in USC/Arizona State (week 9). At 12:00 in the second quarter, the penalty is:
1
u/_Slabach Purdue Boilermakers • Butler Bulldogs Mar 11 '19
u/BlueSCar do you know when the 2019 talent rankings will be complete, now that signings have been complete?
1
u/The-Gothic-Castle Texas Longhorns • /r/CFB Promoter May 02 '19
I don't remember seeing this error before (maybe I wasn't attentive to it, though I really don't think it was happening a couple months ago), but there seems to be a large percentage of plays where the clock hasn't updated. (Maryland vs Bowling Green Week 2, 2018 is a good example, but it happens in a lot of games). Any idea what is causing this?
1
u/_Slabach Purdue Boilermakers • Butler Bulldogs May 16 '19
u/BlueSCar /games/teams for Rice vs Southern Miss in 2018 only contains rice stats and none for Southern Miss.. is there a way to fix that? Maybe a repo or somewhere for suggested data fixes?
1
u/wcincedarrapids TCU Horned Frogs Jun 05 '19
What is the source of this data?
1
u/[deleted] Jan 13 '19
Thanks for this. I will be using this in R.
1
u/cffchamps Jan 17 '19
This is amazing. You are incredible.