DEandA - Core - Cloud Data Engineering - Azure Data Engineering

Zensar Technologies; Pune District; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

Zensar Technologies Limited seeks a Senior Data Engineer with deep expertise in Databricks, Azure, Delta Lake, and Spark. You will architect end-to-end data solutions, develop robust data pipelines, and enable data-driven decision-making across the organization while adhering to modern data engineering best practices.

Responsibilities include designing scalable Azure-based architectures, building ETL/ELT pipelines, collaborating with data scientists and stakeholders, and implementing governance

Qualifications

• 5+ years of hands-on data engineering experience with at least 3 years on Databricks and Azure.
• Proficiency in Spark (PySpark/Scala) and Delta Lake for large-scale processing.
• Strong knowledge of Azure services (Data Lake Storage, Synapse, Functions, DevOps).
• Experience designing and implementing ETL/ELT pipelines with modern orchestration tools.
• Proficiency in SQL and Python/Scala.
• Knowledge of data modeling and data warehousing best practices.
• Ability to optimize performance and cost in cloud environments.
• Excellent problem-solving and collaboration within cross-functional teams.
• Strong communication skills to convey technical concepts to stakeholders.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or related field.

Responsibilities

• Design scalable data architectures on Azure using Databricks, Delta Lake and Spark.
• Develop, test, and maintain ETL/ELT pipelines handling large data volumes.
• Collaborate with data scientists, analysts, and stakeholders to translate requirements into technical solutions.
• Optimize performance and cost of data workloads with tuning and resource management.
• Implement data governance, security, and compliance controls.
• Automate deployment and monitoring of pipelines using CI/CD and Azure DevOps.
• Create and maintain documentation for data models, pipelines, and processes.
• Mentor junior engineers and promote best practices in data engineering.
• Evaluate emerging technologies and recommend enhancements to the data platform.
• Troubleshoot and resolve production issues ensuring high availability.

Skills

Databricks

Azure

Spark

Python/Scala

SQL

Delta Lake

ETL/ELT

Data Modeling

Azure DevOps

Azure Data Lake Storage

Azure Synapse

Communication

Education

Bachelor's or Master's degree in Computer Science/Engineering/related field

Tools

CI/CD tooling

Job description

Job Description:

Zensar Technologies Limited is seeking a highly skilled Senior Data Engineer with deep expertise in Databricks, Azure, Delta Lake, and Spark. In this role you will architect end-to-end data solutions, develop robust data pipelines, and enable data-driven decision-making across the organization while adhering to modern data engineering best practices.

Responsibilities

• Design and implement scalable data architectures on Azure using Databricks, Delta Lake, and Spark.
• Develop, test, and maintain ETL/ELT pipelines that ingest and transform large volumes of data.
• Collaborate with data scientists, analysts, and business stakeholders to translate requirements into technical solutions.
• Optimize performance and cost of data workloads through tuning, caching, and resource management.
• Implement data governance, security, and compliance controls in line with enterprise standards.
• Automate deployment and monitoring of data pipelines using CI/CD tools and Azure DevOps.
• Create and maintain comprehensive documentation for data models, pipelines, and processes.
• Mentor junior engineers and promote best practices in data engineering and cloud services.
• Evaluate emerging technologies and recommend enhancements to the data platform.
• Troubleshoot and resolve production issues, ensuring high availability and reliability.

Qualifications

• 5+ years of hands-on experience in data engineering, with at least 3 years focused on Databricks and Azure.
• Strong proficiency in Spark (PySpark/Scala) and Delta Lake for large-scale data processing.
• Deep understanding of Azure services such as Azure Data Lake Storage, Azure Synapse, Azure Functions, and Azure DevOps.
• Experience designing and implementing ETL/ELT pipelines using modern orchestration tools.
• Proficiency in SQL and programming languages like Python or Scala.
• Knowledge of data modeling, data warehousing concepts, and best practices for data governance.
• Demonstrated ability to optimize performance and cost in cloud environments.
• Excellent problem-solving skills and ability to work in a fast-paced, collaborative team.
• Strong communication skills to convey technical concepts to non-technical stakeholders.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.

At Zensar, we’re 'experience-led everything'. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: 'Together, we shape experiences for better futures'. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.