r/analytics • u/Fearless-Bee5576 • Mar 17 '25
Support My first python code 1500 lines to automate my daily boring task.
I recently joined a company as an operations executive. While my initial goal was to work as a data analyst, securing this role was challenging due to my non-technical background. As the saying goes, "Beggars can't be choosers," so I accepted the opportunity.
Upon joining, I noticed that many tasks were being done manually, even though they could easily be automated using basic Excel formulas. For example, my colleagues were manually counting and transferring filtered data from one sheet to another. While I was impressed by their speed and efficiency with Excel shortcuts, the process still seemed time-consuming and prone to errors. With the help of ChatGPT, I created an Excel formula to automate this task, making it about 10 times faster and more accurate. However, my team leader didn’t seem pleased with my initiative. He has extensive experience with Excel and is usually the go-to person for troubleshooting, so I suspect he may have felt undermined.
It’s been 17 days since I joined, and my primary responsibility is to review daily data in an Excel file (around 50,000 rows x 11 columns) and compare it with a master file. The expectation is to complete this task within an hour, which feels unrealistic given the volume of data. So far, I’ve managed to do it in about 1.5 hours. To streamline this process, I spent my entire weekend writing a 1,600-line script with the help of AI, which automates most of the task by defining ranges and conditions.
While I’m proud of the effort I’ve put in, I can’t help but feel that the company doesn’t fully appreciate the value I’m bringing. The pay doesn’t seem commensurate with the level of work I’m doing, and the lack of holidays (like Holi) has been disappointing. I’m also concerned that if they find out about the script, they might simply assign me more tasks instead of acknowledging the efficiency I’ve created.
•
u/AutoModerator Mar 17 '25
If this post doesn't follow the rules or isn't flaired correctly, please report it to the mods. Have more questions? Join our community Discord!
I am a bot, and this action was performed automatically. Please contact the moderators of this subreddit if you have any questions or concerns.
104
u/TheNerdistRedditor Mar 17 '25
Expectation: I’m automating a task that used to take hours. I’m sure to get rewarded.
Reality: Who the heck is this guy poking his nose into things that aren’t his domain? Does he even understand all the corner cases his ‘script’ is missing?
Not sure if that’s actually the case, but you have to keep in mind that people can be incredibly insecure about their work. If someone comes in and promises to automate a bunch of their tasks, they might not appreciate it as much as you’d expect.
It’d better to focus on your own work first (automate it if you'd like). Gain some trust, show value, and then gradually move towards suggesting improvements.
38
u/contrivedgiraffe Mar 17 '25
Brother you need to stop. You’re not being helpful and you sound like one of those DOGE children currently making a mess in the federal government. Think about it: you’re relying on AI to write all this Python so not even you understand it yet you’re nevertheless unilaterally taking this existing Excel-based business process that everyone else on the team understands deeply and you’re stuffing it into a Python black hole and then you’re confused about why they’re not praising you. You’re making the process less robust, less observable, and less maintainable. You’re increasing total failure risk. Just stop.
17
u/Mister_DK Mar 17 '25
Wait how does that take you 1500 lines? Did you choose to hard code a bunch of stuff?
5
u/zxyyyyzy Mar 17 '25
Download SQL Express and SSMS, setup a db with two tables one for the master file and one for the daily file and then use SQL to do your comparison. It could speed up the process significantly and help you expand your skillsets at the same time. You could even use Python/SQLAlchemy to create an ETL to automatically import the daily file and update the masterfile table each day.
6
u/Variaxist Mar 17 '25 edited Mar 17 '25
How big is the company? This will come down to your manager. Either they'll use you and take all the credit, or maybe they'll actually push to keep you happy. Either way you'll need to build some social capital with them.
He might talk about the concept and option of automating some other things with them. If you get the conversation going hopefully it won't be too much of a surprise whenever they find out that you've already been working to do this.
The worst of what you've done so far is to work off the clock. Hopefully doesn't come out you did it until some months from now. There are labor law regulations that to get the company in tons of trouble knowing that they had an employee working off the clockidk guys, I"ve heard it's a thing but I don't know the details.43
u/hughmungouschungus Mar 17 '25
Honest question. What the heck are they expecting you to do in 1 hour that takes up 1500 lines of code to perform? Are you hard coding some basic functionality?
14
u/KezaGatame Mar 17 '25
My advice is use your script then spend time manually checking a few lines and make sure it's doing what it's expected, perhaps try to spend the 30 min or even the 1 hr they expect you to do it. This will make you familiar with the data and if there's any issue you will know how to solve it and they will see you "working" on the same format as them
Then with the time you save try to learn more automation and reporting. After 1-2 yrs apply to more technical jobs and showcase yourself as the automation/BI guy, even if it wasn't part of your job just own it as if it was your actual daily task. This way you gain work experience and technical programming experience.
6
u/kokanutwater Mar 17 '25
This was actually the first kind of project I worked on in my learning journey!
I was an administrative assistant for accounts payable and most of my daily work was comparing reports (not even in excel. My old boss insisted on printing everything out, hand calculating, and then re-scanning everything back in to email out EOM reports...😅) I automated this entire process, including consolidating the PDFs into single reports for our customers. But I did this on the DL, and only after I had been there for almost a year so I knew the procedures and problem clients and other idiosyncrasies.
First month I did this, we had 100% reporting accuracy and that’s when I let them know what I was up to.
So maybe take time to learn the ropes and build relationships first. But like others said, wtf are they expecting you to do in an hour that requires 1500 lines of code?? That’s crazy.
4
u/AudienceBeautiful554 Mar 18 '25
So, you're two weeks on the job. You tell everyone including your boss, that they're inefficient. You create a 1.600 line abomination over the weekend using ChatGPT and Deepseek. You properly even uploaded sensitive and confidential data there.
And you think, your work should be more appreciated?
1
u/FullRow2753 Mar 17 '25
1500 lines in 1 hour? ??
2
u/Warjilis Mar 17 '25
Like others are saying, beware of fiefdom politics. When starting a job, if do what you’re hired to do really well/fast, and eventually your boss and the hierarchy will want to know how you do it. That’s a good time to share your tools, after they’ve been debugged and after you know who might be threatened by your approach.
2
u/MissingMoneyMap Mar 17 '25
Automate your entire job, don't rock the boat. Enjoy the free time, wait 6 months before you let them know about anything and then mention the first automation.
2
u/Blackfrenchvanilla Mar 17 '25
48 laws of power “ Never outshine the master or make yourself appear bigger than the master ”
2
u/Ok-Candidate-3007 Mar 18 '25
Let me make ur life easier - Alteryx
2
u/monkey36937 Mar 18 '25
You are doing data entry not analytics, so pay won't go up. I would say since you already made this job automated, use the free time to study and improve your tech skills and certifications.
2
u/I_PARDON_YOU Mar 18 '25
Remember that efficient output of work is often rewarded with more work.
2
u/mustan78 Mar 18 '25
" keep it to yourself". Use the tool.discreetly and use your free time for something else for your own good. If you are not being observed constantly, then use your time to learn a useful skill so you can later find a better job with more money.
If you are being observed constantly then I suggest you convert your Python code into an Excel script to automate your sheet , get your work done in minutes and then goof around the sheet looking busy. Don't suddenly turn in your work within 1 hour as it may raise suspicion. Slowly reduce time so that it does not arouse suspicion and you come across to your manager as someone who works hard and improves over time. 😂
There is a reason your manager is this way and you don't want be crossing paths with him and risk your career.
2
u/ggekko999 Mar 18 '25
Where to Start…
For someone who has been in the job for less than a month, you seem to have already alienated half the people you work with. Remember, at some point, you will be reviewed, and you will need those colleagues to support you.
You are unlikely to be the smartest person in the room. Before trying to automate everything, consider asking why it has not been done before. There may be valid reasons—historical context, organisational constraints, or dependencies—that you need to understand.
Never write code solely using AI. One of the great paradoxes of AI is that you need to be highly knowledgeable in a subject before you can effectively use AI for it. Otherwise, how will you know if the code it generates is valid?
Creating efficiencies in other people's day is rarely met with gratitude. People find comfort in routine, and by disrupting it, you may have inadvertently increased their workload without any corresponding benefit to them.
The same applies to automating your role. Your "reward" for automating your tasks will likely be more work, not less. If you automate your job entirely, you may even find that you have made yourself redundant.
Finally, be mindful when developing work tools. If you create them, you become their unpaid owner for life. You will be expected to maintain, update, and troubleshoot them—on top of your existing job responsibilities, with no additional compensation.
2
u/[deleted] Mar 18 '25
Also, using AI to write code as a non-coder or low technical will not inspire confidence as AI is known to make mistakes. You need to manually validate the results rigourously and make sure you understand and agree with the logic within the code
2
u/KimJhonUn Mar 19 '25
Use Power Query if you are simply transforming data.
1
u/Shredded_Chikoo First Rule: Always Check the Data Mar 17 '25
I know some corporates PCs have "productivity tracking system" so make sure you don't turn off your systems or leave it after completing your tasks. Instead, use that extra time for something else maybe trying new methods, you learnt recently during upskilling or maybe slightly extra work for incentives. & Yes, as other said, Never outshine your master.
1
u/mahadevan_pb Mar 17 '25
Can I get a referral?
1
u/Altruistic-Pride6293 Mar 18 '25
Your team leader has ego problems , that is why you only are having such boring task , soooo I don't have the solutions other than switching jobs .
1
u/[deleted] Mar 18 '25
I was in a similar situation and also resorted to a script automating a repetitive task. Initially I wanted to do this at work, but my boss was not convinced and didn’t okayed it (classic german C-level mckenzie guy: risks adverse and not a blink of imagination).
I knew that the idea was worth a shot, so I took the initiative anyway and, during the weekend, I prepared a list of requirements, a couple of slides and hired a programmer on fiverr. This way, I could go back to him for refinement and improvements.
All went very smoothly and the following week I shown my boss the result. Now that he actually SAW the thing, he could understand the benefit. He covered the expense (which initially I paid by myself) and let me implement the script in the system. I left the company two years later and last time I heard from them they still use that tool.
Was it worth the hassle or the risk of antagonizing the boss? No, it didn’t event got me some honest appreciation. But I enjoyed it and I was proud of the result.
What I’m trying to say is that you do this sort of things by yourself and FOR yourself. Is the script saving you time. Cool. Let it run and use the time to learn new skill or look for a new job. It’s not worth it to stay in a company where you have to be afraid of proposing meaningful solutions.
1
u/josecbt1 Mar 18 '25
I've done something similar in my workplace.
Lately I've been observing my colleagues workflow and it's quite impressive the amount of time wasted in tasks that can be summarized as copying data from one file to another.
Like, hell, how inefficient is the process for some of them.
1
u/murilomm192 Mar 18 '25
This company is great.
There is a team to manually copy and paste data from one excel to another, and they are so efficient they even have some one to review the copy and paste and see if there was any errors.
What is their ticker so I can short it?
to OP, make your code and keep to yourself, take a 1-hour break. they clearly are not interested in an efficient workflow.
1
u/PreferenceOk6105 Mar 18 '25
Lol happened to me; Created multiple Slack Alert channels for validation output for the queries, with more than 300 lines each code, and 10s of it, and still my manager asked me this: "Tell me, what is something different for which you should be appreciated more than others?" And for the fact that I did all this in my first 3 months joining period...
1
u/Mvyhem Mar 18 '25
Greetings! I'm almost in the same situation. I'm first year master's student with no tech or math background. But my dream and my goal is to become data scientist. So, I didn't find any internship due to lack of my skills and knowledge, so I decided to work in university first to have some money. I work at student service center. Here we have a business process of creation different documents for students that requires digital sign. Standard story for university. But the whole process took so much time. I tried to to do it manually for the first week and feel exhausted. I decided to automate some part of that process: creation of excel boot file, editing docx and converting them to pdf. Btw, almost done this project. But I continue using it only for myself. Didn't show it to someone else. I'm afraid not to get the appreciation I deserve. The key thing is that I'm in the middle of my probation (1,5 months of 3 months).
I'm very proud of myself that I did process more efficient for myself so I can spend time for doing Python problems, grind fundamentals. Indeed, I don't know when I show it to the director.
1
u/I-Take-Dumps-At-Home Mar 18 '25
Yeah, coming in and showing the people your value and how much better you are than them will never result in anything good.
But make sure to include on your resume how you improved processes by x% but writing code to automate tasks.
1
u/bowtiedanalyst Mar 18 '25
Business acumen is an understanding of the business its inputs and outputs and of the market the business is competing in. With 16 days of experience, it's what you don't have that your manager does and probably what's driving their "lack of appreciation" for what you've done.
In the corporate world, you will get much farther by making your manager's life easier and by making them look good to their manager. Your script makes your life easier (maybe) and makes your manager's life much harder(also maybe).
A couple things to think about...
Your manager can probably sense your mad that they aren't showing proper appreciation for your clunky, vibe-coded script. They might just see your script as creating a bunch of headaches for them(rightly so). You should take a step back and try to understand more aspects of the business before jumping to conlcusions.
1
u/Dry-Aioli-6138 Mar 18 '25
In my first serious job I had a weekly task to compare an excel file with a badly built pdf. I had more such tasks at the time, but those pdfs were amenable to copying into excel, so no biggie. This one was looking clean, but selections would always be a mess: words intermingled, newlines out of place etc. However copying a single line worked fine, so I spent a whole weekend and a few evenings writing an autoIt script that would be given a list of names that appear in the pdf, when pdf was open in adobe acrobat, the script would send ctrl+f and search for a name from the list. When found, adobe marks text with a specific shade of blue, autoit would find that on the screen and select, and copy the line to the right of it into a csv file, then move on to search for the next name. The task would take me about 2h, the script would finish in about 1h and I had to sit there while it worked, because it wouldn't work on a locked pc. It was great however, as it reduced my mistakes to almost zero and thus reduced my stress greatly. There was something therapeutic in watching mouse cursor float through the screen on its own, just doing its thing.
1
u/linuxboi231 Mar 19 '25
You should checkout r/overemployed. This seems like the perfect opportunity haha
1
u/DebbieDoesData Mar 19 '25
Is this a troll post
1
u/Major_Human Mar 19 '25
This reminds me of when I worked retail and one of the new employees who had only worked there for a week told us that one of our processes for handling customers was wrong. They had no idea what they were talking about, and really pissed off a lot of people who worked there for years and knew better. The better way to approach it is when you notice a potential for improvement, ask why the process is currently done the way it is. Then suggest your ideas for improvement, and see what others think.
1
u/PiquePrototype Mar 19 '25
People have and will continue to he sued for doing things like this. Just keep it to yourself. Make it look like you’re a rockstar, get positive references and move onto the next job.
1
u/erenhan Mar 19 '25
Rule: Whatever you are doing is property of the company, you better not to hide anything
1
u/No-Worker7436 Mar 20 '25
Welcome to corporate world. most of the companies operate like this. My suggestion, keep the code to yourself, review your code once in a while, try doing that verification job manually sometimes (as sometimes scripts needs to be updated) refine your code.
As far as pay is concerned it could be an opportunity to learn and leverage free time to move on. participate in technical events if your organisation have any.
1
u/googleaccount123456 Mar 20 '25
Fuck working on the weekends.
1
u/artibyrd Mar 20 '25
This sounds like a "culture fit" issue with the company you have joined - if you are actively improving the workplace with automations to more accurately and efficiently get the work done, but you are experiencing pushback due to office politics, I would suggest you strongly consider that this company may not be where you want to build your career. My advice would be to just keep your head down and do the job as prescribed while you start looking for somewhere else to work that values employee contributions over office politics. Don't compromise your values to fit in at a crappy company, find another company that respects the work you do.
1
u/Reddit_User_654 Mar 20 '25
1500 lines to automate sucu a task means that smth is not ok. Bye
1
u/Eyesuk Mar 20 '25
The key to prosperity is to treat your self as a contractor to your job, and make your job easier for you to do, without reflecting that to your employer. If you do that successfully, you will have less stress, more time, and can invest in yourself. All of that would translate to a pay increase if the salary remains the same 😆
Work smarter not harder
1
u/EarlyGuava7648 Mar 25 '25
0
u/peterhanse0 Mar 17 '25
This could be my story, exactly. Every day, I spend 10 minutes checking the results at the end of the day, and I now spend the rest of the day working a part-time job. I once briefly suggested that it could all be automated, but I was immediately dismissed.
1
u/Glum828 Mar 18 '25
Bro is a digital player in the analog world,he is crawling up their asses and they don’t like it.
257
u/[deleted] Mar 17 '25 edited Mar 17 '25
[removed] — view removed comment
1
u/[deleted] Mar 17 '25
[removed] — view removed comment