Azure Data Engineer

Ascendion Engineering; Bengaluru; Hybrid; INR 1,200,000 - 2,300,000; Full time

Benefits offered by this job

Power BI

Delta Lake

Synapse Analytics

Git

Job summary

Ascendion Engineering in Bengaluru is seeking a Data Engineer with 4-8 years of experience to design, build, and maintain scalable data pipelines using PySpark and Databricks.

You will develop ETL/ELT workflows, integrate data with Azure Data Factory, and collaborate with analysts and stakeholders to define data requirements.

The role emphasizes data quality, governance, security, and performance tuning of Spark jobs to ensure reliable, cost-efficient data platforms.

Qualifications

• 4-8 years of data engineering experience.
• Hands-on PySpark, Databricks, and Azure Data Factory.
• Strong SQL and data warehousing knowledge.
• Experience with Azure cloud services and ETL processes.
• Ability to optimize Spark jobs for performance and cost.

Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
• Build and optimize ETL/ELT workflows for large data volumes.
• Develop and manage data integration using Azure Data Factory (ADF).
• Collaborate with analysts and stakeholders to understand data requirements.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Ensure data quality, governance, and security across data platforms.
• Troubleshoot and resolve data pipeline issues while ensuring high availability.

Skills

PySpark

Databricks

SQL

Azure Cloud

Spark Tuning

Analytical

Communication

Education

CS/IT Degree

Tools

Azure Data Factory

Power BI

Delta Lake

Synapse Analytics

Git

Job description

Job Description Data Engineer

Position: Data Engineer

Experience: 4-8 Years

Location: Bangalore

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using PySpark and Databricks.
• Build and optimize ETL/ELT workflows for processing large volumes of structured and unstructured data.
• Develop and manage data integration solutions using Azure Data Factory (ADF).
• Collaborate with data analysts, business stakeholders, and cross-functional teams to understand data requirements.
• Optimize Spark jobs for performance, scalability, and cost efficiency.
• Ensure data quality, governance, and security across data platforms.
• Troubleshoot and resolve data pipeline issues while ensuring high availability.

Required Skills

• Strong hands-on experience with PySpark.
• Experience working with Databricks for data engineering and analytics.
• Hands-on experience with Azure Data Factory (ADF).
• Strong knowledge of SQL and data warehousing concepts.
• Good understanding of Azure cloud services and ETL processes.
• Experience with performance tuning and optimization of Spark jobs.
• Excellent analytical, problem-solving, and communication skills.

Good to Have

• Experience with Power BI for reporting and dashboard development.
• Knowledge of Azure Data Lake, Delta Lake, or Synapse Analytics.
• Familiarity with CI/CD pipelines and version control tools such as Git.

Education

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.