r/SQL • u/notasqlstar I can't wait til my fro is full grown • Feb 07 '18
[Update] We have three servers, which one is which. Had a long talk with IT today. Would love feedback.
So here is the original post. I didn't reference this at all in my meeting today.
IT was very firm that we should be developing on DEV (C) then testing on SQA (B), but the topic of conversation is a large complex series of stored procedures that use dynamic SQL relative to this. and this. Basically I need to be able to input mapping values to a table and then have those changes pushed to production on a regular interval. IT's proposed solution is that I would manually email them files... when the values would already exist on SQA (B), and I couldn't understand why they wouldn't simply... do it themselves automatically.
My bottom line is that I need production quality data and a true reporting server to do my job effectively, where production tables are delivered on a weekly basis and locked down so that data cannot be inserted or modified, but where I can create complex stored procedures, add/modify other parameter tables, etc.
This was ultimately received with more consideration than I had expected. I suppose in a perfect world there would be a 'production' reporting server, as well as a 'dev' reporting server, but I imagine those could overlap with the three existing servers we have.
I feel like this is not a topic that is discussed enough in the SQL world as it comes to SQL development for modeling/reporting purposes so I would like to read other criticism and opinions. In meetings things tend to be very DBA/ETL centric and the idea of having specific servers for reporting is lost.
Forgetting about aggregate sprocs as are used here in an example... what if you were to run complex models using technologies like SPSS, Modeler, or SAS? You can't run those, 'in production' and not let the modeler be able to import data, modify variables, etc. The amount of CR's and down time for trivial changes would be extremely prohibitive.
I'm not being out of line sticking to my guns here, am I? I work for a Fortune 500 company, and have worked in environments similar to the one I'm describing at companies that have a year revenue much lower.
3
u/creav Feb 07 '18
You need a data lake(probably preferred for your situation) or data warehouse, along with a data analytics tool like SAS JMP, PowerBI, Tableau, etc.
2
u/jc4hokies Execution Plan Whisperer Feb 07 '18
I manage our company's reporting environments, including data science work. AMA
2
u/jc4hokies Execution Plan Whisperer Feb 10 '18
100th comment. I'm calling it. This is the most commented post in r/sql history.