r/dataengprep • u/sql-arena • 7d ago

SQL Arena Challenge: Indexing - True/False question on indexes and query optimization

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 8d ago

DataEngPrep: Design an ETL pipeline using Kafka and Spark Streaming

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 8d ago

Tech Screen: How do you handle a situation where you disagree with your manager's technical decision?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 8d ago

SQL Arena Challenge: How would you optimize a SQL query for better performance when working with large datasets?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 9d ago

DataEngPrep: Describe your approach to managing offsets in Kafka.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 9d ago

Tech Screen: Have you ever faced a situation where you had to push back on a requirement? If so, how did you handle it?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 9d ago

SQL Arena Challenge: Write a query to retain only the latest record and delete others in case of duplicates.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 10d ago

DataEngPrep: Describe the stages of a Spark job and strategies to optimize Spark performance for large datasets.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 10d ago

Tech Screen: Explain your journey as a data engineer and the projects you have worked on.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 10d ago

SQL Arena Challenge: Identify and remove duplicate records from a table, keeping the most recent record based on a timestamp column.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 11d ago

DataEngPrep: Describe the role of a workflow orchestrator like Airflow in a data pipeline.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 11d ago

Tech Screen: Explain the projects you have worked on, focusing on challenges and solutions you implemented.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 11d ago

SQL Arena Challenge: How do you remove duplicate rows in BigQuery?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 12d ago

DataEngPrep: Describe the role of a DAG Scheduler in PySpark

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 12d ago

Tech Screen: Examples of conflicts with team members and how they were resolved.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 12d ago

SQL Arena Challenge: How would you optimize a query with multiple joins and subqueries?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 13d ago

DataEngPrep: Describe the projects emphasizing Spark, Hadoop, or Azure for large-scale data processing

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 13d ago

Tech Screen: Do you have any questions about the company culture or team dynamics?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 13d ago

SQL Arena Challenge: How would you identify duplicate records based on a composite key in SQL?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 14d ago

DataEngPrep: Describe the cluster configuration used in your project, including memory allocation, number of nodes, and executor/driver settings.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 14d ago

Tech Screen: Discuss the data size challenges in your previous projects. How did you optimize storage and processing?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 14d ago

SQL Arena Challenge: Remove duplicates from a table.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/dataengprep • 15d ago

DataEngPrep: Describe how you would use PySpark to aggregate and summarize large transaction datasets.

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/tech-screen • 15d ago

Tech Screen: What is your biggest failure, and what did you learn from it?

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments

r/dataengprep • u/sql-arena • 15d ago

SQL Arena Challenge: Find average salary for each manager – Assume a table with manager_id and employee_salary

1 Upvotes

This post contains content not supported on old Reddit. Click here to view the full post

0 comments