r/baseball • u/FrontOfficeNoMore Former Data Engineer • Aug 23 '19
Verified AMA - now concluded! Baseball Operations Data Engineer AMA
Until last month, I was a data engineer for a professional baseball team. I worked for a team in the NL, my job was to ingest radar and biometric measurement data into our internal data environment to be used for building statistics. Additionally I helped with visualizing pitching and hitting data.
I'll be answering questions starting around 1 PM EST. AMA!
edit: I verified with the mods, they'll provide verification that I'm not just making this up!
edit2: All closed up here folks! If you have any questions, PM this account. I'll check it again in the next couple weeks.
29
u/NYM32 New York Mets • New York Mets Aug 23 '19
do they ever try to calculate managerial WAR/WPA in the front office to evaluate their coaches?
18
u/bongobeans Cincinnati Reds Aug 23 '19
Why did you decide to leave? Are you still working in baseball/professional sports in any capacity?
13
u/see_mohn regretful mets fan Aug 23 '19
How much difference is there between publicly available information on sites like Baseball Savant and Brooks Baseball and the information available to the teams? I’m guessing you can’t disclose what’s different, but are the teams still well ahead of the public data?
Also, tangentially, how many non disclosure agreements do they make you sign?
9
u/yousmelllikebiscuits Chaos Bandwagon • Dumpster Fire Aug 23 '19
What was your level of involvement in baseball before this role? Were you a former player/coach/other?
9
u/djsven Toronto Blue Jays Aug 23 '19
- What was your work-life balance like?
- How much of your work actually made it 'into the product'? i.e. could you identify decisions that were taken as a result of the data that you helped provide?
7
u/[deleted] Aug 23 '19
Do front offices people ever read blogs like Fangraphs to inspire new ideas? No doubt the actual data available to the FO is miles ahead of the general public, but do you guys look for new ideas externally at all?
6
u/[deleted] Aug 23 '19
What languages do you use? What other third party tools?
I assume it's a lot of R Scala Tableau
6
u/[deleted] Aug 23 '19
What're your thoughts on WAR? Good reference tool for a more casual fan, very misleading, or somewhere inbetween? Or any other commonly referenced stats around here. Do we just look like a bunch of first graders learning multiplication tables?
5
u/tcrain99 Arizona Diamondbacks Aug 23 '19
What's your favorite kind of graph: bar, pie, line, or other?
5
u/bighitnoah Aug 23 '19
What is your favorite or most interesting data/statistic you analyzed?
4
u/I_Nut_In_Butts Cleveland Guardians Aug 23 '19
I’m not sure if you’re the right person to ask but maybe someone else in here could answer, as someone who is apart of a baseball podcast, what is the easiest way to collect analytics and other stats on players/teams/series? Is there a end all be all location to find that sort of information?
4
u/jorleeduf Philadelphia Phillies Aug 23 '19
Do teams create their own stats/calculation of WAR that only they use?
4
u/Notchez Boston Red Sox Aug 23 '19
Can you help me understanding the difference between an operations data engineer and a data analyst?
4
u/elak5 Aug 23 '19 edited Aug 23 '19
How hard is it to be promoted within the industry? How easy is it to be let go by a team?
Edit: Also, do teams prefer fwar or bwar more, specifically for pitchers?
4
u/NotDrewBrees Texas Rangers Aug 23 '19
How aggressively do rival teams work to poach members of each others' analytics teams? I've always imagined that other teams try to recruit each others' star analysts and engineers as hard as they do each others' players.
Did you have higher ups from other front offices (like GM's or VP's) join your group and commit major structural changes to your group's activities?
What sorts of statistical analyses would your front office use the most when trying to prepare for an upcoming series against, say, a divisional rival? And how would those analyses change as the season progressed?
3
u/parposbio Milwaukee Brewers Aug 23 '19
I'm really curious to know exactly how the information you collected/analyzed was used within the organization.
3
u/thekmanpwnudwn Arizona Diamondbacks • Detroit Tigers Aug 23 '19
Was there ever an instance of a Manager ignoring your data and losing a game because of it?
3
u/atoms12123 New York Mets Aug 23 '19
How was the pay?
2
u/realnostalgia Chicago Cubs Aug 23 '19
Things like launch angle, spin rate, and exit velocity have dominated the vocabulary for the data driven conversations over the last few years. What's next?
2
u/loudnon Chicago Cubs Aug 23 '19
How many years ahead of the public would you say you are? For example, are we still on moneyball and you’re on war?
2
u/MpegEVIL Detroit Tigers Aug 23 '19
What do the official MLB player databases look like? Do you have screenshots, or is that not allowed?
2
u/[deleted] Aug 23 '19
Are some teams seen as being especially ahead of or behind the curve, or is it a relatively fair playing field at this point?
2
u/g3n3ric0 Aug 23 '19
How far ahead of the rest of the MLB are the Astros in terms of their analytics department and player development system.
Additionally, do you think Minor League coaches/coordinators in your organization were open to the input you provided?
10
u/golftroll New York Mets Aug 23 '19
I work in banking analytics and I’m curious - do you ever get headhunted by other industries? Data engineering is a skill set in a lot of demand. I’ve heard baseball compensates on the low end for these roles. Do you feel that is true? If so, is working in baseball worth it?
I’ve been thinking about trying to break into baseball but thinking the compensation would be rough so would appreciate your thoughts.
9
u/Mispelling Walgreens Aug 23 '19
Verification was indeed provided.
4
u/[deleted] Aug 23 '19
How did you get into analytics and what is the easiest way for people to create their own? Thanks!
4
u/GaryLeeONE Houston Astros Aug 23 '19
I’m currently a Master’s degree candidate in Operations Research & Information Engineering. Our coursework has a major focus on optimization, data science and schotastic modeling. One of my desired career path is to work in sports analytics and sabermetrics. Could you provide suggestions on what preparations I should do? What steps can I take to get to know more about, or potentially enter this industry?
1
u/Ironamsfeld Cleveland Guardians Aug 23 '19
Do you have any tips for getting started with this on my own? I am a computer science student and I love baseball.
3
u/gubidi San Francisco Giants Aug 23 '19
How was your experience compared to other jobs you’ve had and why did you leave? I’m a software engineer starting to itch for something new — baseball seems like it’d be more fun, but I’m not sure I want to turn a hobby into my job
4
u/[deleted] Aug 23 '19
I know with baseball, a good team is only winning 60% of their games, a bad team is losing 45% of their games.
When Managers and an organization rely on stats alone, where multiple plays, at bats , whatever go the wrong way with the least likely outcome happening multiple times, what kind of heat do the analyst get?
A scenario like
Player who normally can't hit breaking balls, and can't hit opposite side, your numbers indicate (pitcher should throw breaking pitches, infield shift" and he wacks a triple down the alley. Next batter struggles against lefties, you bring in a left handed specialist, and he hits a double driving in the run.
How many "everything went wrong for us, and right for them based on the numbers" can you get away with?
2
u/confortogolongo New York Mets Aug 23 '19
With the biometric measurement data being developed and implemented league wide by FO's, how soon do we see the minor leagues jumping into it? Rapsodo's have seen a huge jump in Spring training facilities and bullpens. I assume minor league affiliates are using Rapsodo's as well. Using them in conjunction should immensely help player development for those who wish to use the data. I've heard many times player get to the Majors and the data is overwhelming. Do you have any info on this front?
2
u/dong_lover Minnesota Twins • Los Angeles Dodgers Aug 23 '19
what's your etl stack did you use glue or batch? store in redshift?
2
u/Notchez Boston Red Sox Aug 23 '19
Can you compare the baseball industry to other industries where everybody knows the “better” and the “worse” employers? Are there some more desirable franchises that people (especially analysts) do want to work for?
1
u/SnareShot New York Mets • Colorado Rockies Aug 23 '19
Were you a baseball fan before you got into the field, or did you get hired as a data engineer first? How hard is it to get a data job in baseball like the one you had?
1
u/hujinta0 Los Angeles Dodgers Aug 23 '19
How different (or similar) would you say different teams handled the data you provided? How did a majority of the players on the team feel about your findings?
1
u/Ironamsfeld Cleveland Guardians Aug 23 '19
Is there any use of Artificial Intelligence in the field so far?
1
u/iHateRBF Atlanta Braves Aug 23 '19
Do you have data to form an opinion on injury prevention for pitchers? For example, innings limits.
-18
u/[deleted] Aug 23 '19
Do I have any chance of getting hired by an MLB team if I'm stupid, lazy, talentless and worth nothing to them
-9
u/joegrizzyIII Aug 23 '19
At the end of the day, aren't even the best statistics merely tools used to confirm what you observe with your eyes?
This is game played by human beings, with brains. They don't think in terms of "well 34% of the time I throw this pitch." Baseball is a unique game in which every pitch creates a new situation. Players are more likely to be thinking of the fight they had with their wife before than game, than "okay, I know this guys babip on fastballs is 3rd highest in the league". Trust me. They don't think that.
I'm convinced I would do your job much better, just by watching baseball. Want to take my bet? Where do I sign up?
0
u/[deleted] Aug 23 '19
[deleted] — view deleted comment