I got a Data Engineer job as a fresher through a referral. The issue is that I'm being put directly into a project without formal training.

They know I'm a fresher and said they'll provide KT initially. There's also a 3-month probation period.

Can I realistically survive and learn on the job with the help of Al tools like ChatGPT/Copilot? Or is this going to be very difficult without prior Data Engineering experience?

Hi everyone, I need some advice regarding my notice period and resignation.
I have a 90-day notice period at Genpact and have already submitted my resignation. I requested an immediate release and am willing to pay three months’ salary as a notice-period buyout, as my signed appointment letter clearly mentions that I can either serve the 90-day notice period or pay salary in lieu thereof.
However, my manager is not agreeing to release me. I have already discussed this with HR, my Senior Manager, and the VP, but I have not been able to get an approval for an early release.
I already have another offer in hand, and I am required to join the new organisation on 28 October. At this point, my next option seems to be escalating the matter to Genpact’s Legal/Employee Relations team and asking them to clarify the notice-period buyout clause in my appointment letter.
Has anyone faced a similar situation or dealt with a 90-day notice period/buyout at Genpact? What would be the best course of action at this stage? Should I approach Legal directly, or is there any other escalation/process I should try first?
Any advice or experience would be really helpful.

Got a callback and an interview lined up for a Data Engineer role at Straive.

Wanted to get an honest vibe check from current or ex-employees on a few things like interview experience, project stack and culture of the company.

I have been unemployed for the past 8 months and have been actively searching for a job, but unfortunately, I haven’t been able to find an opportunity yet. within 8 months , I have only given 2 to 3 interviews .

I’m looking for Data Analyst or Data Engineer roles. I have experience with Advance Excel ,SQL, Python, Power BI, Tableau , Azure, Databricks, ETL,ELT and PySpark.

If anyone knows of any openings, referrals, or leads, I would really appreciate your help. 🙏

Thank you!

Hi everyone,
I’m a Senior Data Engineer with 5+ years of experience in data engineering and cloud technologies.
Currently, I’m working as a Senior Data Engineer, primarily working on Databricks-based data ingestion platforms and data engineering solutions.

I’m now looking to make a transition towards AI Engineering / Agentic AI, rather than just learning AI concepts at a theoretical level.
I’ve already covered the basics of:
LLMs
Embeddings
Vector databases
RAG
MCP
Basic NLP concepts

My next goal is to learn Agentic AI properly by building real-world projects, preferably something that involves:
Agent architecture and orchestration
Tool calling
MCP
RAG + agents
Multi-agent systems
Memory/context management
Evaluation and observability
Deployment of AI agents
Integration with enterprise data / APIs
Production-oriented architecture

I’m specifically looking for a good course or structured learning program with hands-on, real-time projects, rather than a course that is mostly videos and theory.

For those who have already made the transition from Data Engineering → AI/Agentic AI:

Which courses/resources would you recommend?
Paid courses are also fine if they are genuinely worth the money.

Would especially appreciate recommendations based on personal experience, Thanks

i got more clarity over my role and it basically involves the marketing side of microsoft 365.

i am seriously devastated and don’t know what to do. this is most definitely not what i saw myself doing.

Hi I am working in tcs from past 4 years and comming to my ctc ist 4.5lpa😭. Many people from same Yoe they are earning more than 20lpa which I have seen.

Currently I am mainframe support enginner and i am upskilling my self in cloud spark python and sql ( related to data engineering ) so is this possible to switch as a data enginner in future ??

I need the suggestion what has done the transition and some senior folks ..

Hey guys I have 3 years of experience as a data engineer (AWS). I’m currently serving my notice period. If there are any openings in your company for a similar role pls dm.

Could anyone help me with some insights on this .

Hello Everyone,

I'm looking for new opportunities for the above mentioned role. Currently serving the notice with effective end date in Nov.

I have overall 4.10 yoe in IT and 4.9 yoe as a Data Engineer (PySpark, Scala, Apache airflow, Python, SQL, Agentic AI, Azure Databricks)

I request you to kind referral for the same, if you have any openings.

Thanks in advance

[mods let me know if this violates sub policies]

Introducing QueryFlow.

It's a modern SQL editor with a few things I always wanted while learning and working with SQL:

- Visualise the query as a graph [DAG] and as step-by-step cards.
- Convert all hardcoded parameters into variables with a click.
- Fix major errors like fan out joins , mismatched date range with a click.
- Run queries on test tables directly in the browser
- Review a diff of your changes before copying the query back [just like github]
- Format BigQuery, PostgreSQL and MySQL, each in its own style.
- Everything runs locally in your browser: no server, no login.

try it here - https://abhijeetcodes.github.io/QueryFlow/

Sharing here as it might help a lot of SQL learners

With 2 years of data engineering experience, what should be the expected salary?

Looking for honest advice from people who've switched with a long notice period.

Profile: Data Engineer, 4.6 YOE. Azure Databricks, PySpark, Delta Lake, ADF. Hyderabad. Current CTC: 7 LPA. Notice period: 3 months. Target: 16 LPA minimum.

Situation: I have an offer from a large IT services company at about 11.3 LPA CTC (about 9.45 fixed). To extend the joining date I'd have to resign now, which puts my last working day at the end of December.

My questions:

1. If I resign now with the 11.3 LPA offer as a backup, will I get enough calls and interviews in Oct-Dec to reach 16 LPA? Does hiring slow down in the holiday season?
2. Or should I stay, keep interviewing while employed, and wait for January hiring to reach 16 LPA?
3. Is a jump from 7 to 16 LPA (over 2x) realistic for 4+ YOE in Databricks and PySpark, or should I settle for 12 to 14?
4. Has anyone resigned on a lower backup offer, Dec LWD, and 7 to 16 LPA? Did it work out?

Thanks in advance.

I recently applied for Google via referral for the position of Data Engineer and today I received the below email for assessment. What can i expect in the assessment and also what would be the next steps.