Azure Data Engineer_F2F in Bangalore_10-Oct Sat_Permanent

Jobworld India; Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Jobworld India in Bengaluru is seeking an experienced Associate Data Engineer (ADE) with hands-on Python, PySpark, and Databricks to join our data engineering team.

You will design scalable data pipelines, optimize workflows on Databricks, work with large datasets, implement ETL/ELT processes, and ensure clean, well-tested code in collaboration with stakeholders.

The role requires strong debugging, performance tuning, and effective communication to deliver reliable data solutions.

Qualifications

• 8–10 years of Data Engineering experience.
• Hands-on Python, PySpark, and Databricks.
• Proficient in SQL and ETL/ELT concepts.
• Experience with large datasets and Spark tuning.
• Strong debugging and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Develop and optimize data processing workflows on Databricks.
• Work with large datasets and implement efficient ETL/ELT processes.
• Develop data transformation and integration solutions using PySpark.
• Write clean, reusable, and optimized Python code.
• Perform data validation, troubleshooting, and performance tuning.
• Collaborate with data engineers, architects, analysts, and business teams.
• Monitor data pipelines and troubleshoot production issues.
• Follow best practices for coding, testing, deployment, and documentation.
• Collaborate with data engineers, architects, analysts, and business teams.

Skills

Python

PySpark

Databricks

SQL

ETL/ELT concepts

Data pipelines

Spark performance tuning

Debugging & troubleshooting

Communication & collaboration

Tools

Git

CI/CD

Cloud data services (Azure/AWS/GCP)

Job description

CGI Drive F2F Interview

Position: Associate Data Engineer (ADE)

Skills: Python, PySpark, Databricks

Experience: 810 Years

Location: Bangalore

Interview Mode: Face-to-Face (F2F)

Interview Date: 10th October

Job Description

We are looking for experienced Data Engineers with strong hands-on experience in Python, PySpark, and Databricks to join our data engineering team.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using Python and PySpark.
• Develop and optimize data processing workflows on Databricks.
• Work with large datasets and implement efficient ETL/ELT processes.
• Develop data transformation and integration solutions using PySpark.
• Write clean, reusable, and optimized Python code.
• Perform data validation, troubleshooting, and performance tuning.
• Work with stakeholders to understand data requirements and deliver reliable solutions.
• Monitor data pipelines and troubleshoot production issues.
• Follow best practices for coding, testing, deployment, and documentation.
• Collaborate with data engineers, architects, analysts, and business teams.

Required Skills

• 8–10 years of overall experience in Data Engineering.
• Strong hands-on experience in Python.
• Strong experience with PySpark and distributed data processing.
• Good experience working with Databricks.
• Strong understanding of ETL/ELT concepts and data pipelines.
• Good knowledge of SQL and data manipulation.
• Experience in performance tuning and optimization of Spark jobs.
• Strong debugging and problem-solving skills.
• Good communication and collaboration skills.

Preferred Skills

• Experience with Azure/AWS/GCP data services.
• Knowledge of Delta Lake and Databricks workflows.
• Experience with CI/CD and version control such as Git.
• Understanding of data warehousing and cloud-based data platforms.

Candidate Details

• Experience: 8–10 Years
• Location: Bangalore
• Interview: F2F
• Date: 10th October
• Primary Skills: Python, PySpark, Databricks