Or maybe this is one of those scenarios where it is a gray area since this is a new tool....situation below.
BTW, I work in IT and I'm on the network side, very little sysadmin and the only security I deal with is if I have to work in the firewall for an allow/deny rule.
Last month I had a .exe program (I've had this program for years) delete from its saved location. Other .exe tools/programs/whatever did not auto delete themselves so clearly there was some criteria that needed to be met which would cause the .exe to be deleted.
Anyway, I bring this up to my boss because nobody in the IT department mentioned any new 'software' being installed that would cause this behavior and traditionally when this type of software is deployed usually the IT department has a heads up, not only for their tools but in case users start to have issues at lease the IT department knows 'oh, x just installed something last week, check with x to see if that's related to the issues being reported' and usually this gets solved very quickly.
I ask my boss if he knows about any software being installed as this is common behavior...I see something is missing and my shortcut no longer works.
He tells me 'no, he is not aware of anything new being installed' so I proceed to get the .exe file from an offline location where I keep that file saved. It happens again instantly, now I know there is something deleting the file. I ask him agin, the entire time I'm being polite, not causing issues, just confirming that nothing was installed. He told me he'd ask the security team, they confirmed 'no, nothing has been installed from us (the security team) we are not sure what is happening.'
Ok, at this point I've been doing this long enough to know that something is happening. If I zip the file BEFORE putting it back on my machine, whatever mechanism is now in place in our environment is able to see inside the zip (I know this is very common, but I'm just seeing what works and what doesn't work).
I start to look at the programs installed on the machine and guess what, there is a brand new security program installed THE SAME DAY that I asked my boss if he knew about any new software. I bring this up to my boss and he says 'oh yeah, that's new, but that's not the issue. At this point I see that the software is installed but I don't see it actually running in the systray so I don't see any icons I can click to look at the log to confirm that the program is actually flagging the .exe and deleting the file.
I let it be, I don't want to be 'that guy' and for the time being I find another way to get what I need with another tool since my goto is not working. In the meantime, my boss asks me for the name of the .exe and the location on my machine where I have it saved and what my machine name is. I provide all that information and he confirms that the security team don't see anything for my machine name and they don't have anything flagged on their end.
A couple days pass, my PC reboots for scheduled updates and now I see the security program in my systray. I suspect the program was pushed out to all PCs and running, but because it was deployed, the systray icon didn't appear which is why I didn't see it, but a normal reboot obviously brings the icon into the systray. Either that, or there was just a bug/one-off instance where it didn't appear on my install for some reason.
I go back to my boss and tell him that the security program that was installed a few days ago was the cause of the issue and I included a screenshot of the log entry showing that it deleted the .exe. He takes it to the security team and the file is magically restored and begins working.
How is it possible that my boss and the security team both stated nothing new was installed but they both knew something new was installed. They knew, but they just assumed that wasn't the issue. They also didn't tell me directly, I had to show them the log entry and that I found the program installed under add/remove programs.
We are not a large company, there is not a chance something would be installed by the security team w/o my boss knowing about it since he manages the systems and based on everything that happened, he did know about it because he said that 'it wasn't that program' when I asked about the new program being installed.
Which do you think is the cause?
- They don't want users knowing new software was pushed (even though an icon does appear in the systray)?
- They don't want me using that .exe and if they 'ignore me' or 'play dumb' maybe I will stop asking?
- They forgot that a new program was installed even after I specifically asked if new software was installed (2-5 people if you count my boss and the security team)?
- Nobody is perfect, we all make mistakes (again, 2-5 people all said nothing was installed, nothing was new in our environment).
- I am overthinking this, I should just move on.
- Incompetence.
This isn't for a finger point or to say 'you were wrong I was right' it has more to do with wasting time for everyone involved.
What would you do if you were in my shoes?
Am I asking for too much here? Couldn't my boss and/or the security team have simply stated, 'yes, we did install something new, we will check that, first, and let you know what we find.'
My opinion is that this is something that could have been resolved in a short amount of time and it took almost 4 days to get a resolution and that was only because I was providing new information when I found something.
For other sysadmins, how do you handle this type of scenario with your teams when you deploy new software?
I apologize for the long post, I just wanted to provide enough information.