Data Engineer 6+ Exp (Azure, ADF, Databricks, PySpark)

Innova ESI; Bengaluru; On-site; USD 681 - 1,136; Full time

Job summary

Join a forward-thinking company as a Talent Acquisition Specialist II in IT Hiring. This exciting role involves developing and optimizing data pipelines using cutting-edge technologies like Azure Data Factory and Databricks. With a focus on innovation and collaboration, you'll implement robust data governance practices and work on projects that push the boundaries of data engineering. If you have a passion for data and a drive for continuous growth, this opportunity is perfect for you. Become part of a dynamic team that values your contributions and fosters professional development.

Qualifications

• 6+ years of experience in Data Engineering with a focus on data pipelines.
• Proficient in PySpark and SQL for optimizing data processes.

Responsibilities

• Develop and optimize data pipelines using Azure Data Factory and Databricks.
• Implement data governance and collaborate with teams for data solutions.

Skills

Data Engineering

PySpark

SQL

Data Pipeline Optimization

Data Governance

Security Practices

CI/CD Practices

Kafka/Event Hub

Education

Azure Certifications (DP-203, DP-900)

Databricks Certifications

Tools

Azure Data Factory (ADF)

Azure Databricks

Azure Synapse Analytics

Data Lakes

Power BI

Job description

Direct message the job poster from Innova ESI

Working as Talent Acquisition Specialist II IT Hiring II IT Recruitment

Experience: 6+ years

What You'll Do:

• Develop and optimize data pipelines using Azure Data Factory (ADF) & Azure Databricks
• Implement Slowly Changing Dimension Type 2 (SCD2) in Delta Tables
• Leverage Unity Catalog for robust data governance
• Collaborate with cross-functional teams to drive data-driven solutions

Qualifications:

• 6+ years of Data Engineering experience
• Proficient in PySpark, SQL, and data pipeline optimization
• Knowledge of data governance, security, and CI/CD practices
• Experience with Azure Synapse Analytics, Data Lakes, Power BI
• Knowledge of Kafka/Event Hub for real-time data ingestion
• Azure (DP-203, DP-900) or Databricks certifications

Be part of a team that values innovation, collaboration, and continuous growth. Work on exciting projects that push the boundaries of data engineering!

Seniority level

Mid-Senior level

Employment type

Full-time

Job function

Information Technology

Industries

IT Services and IT Consulting