Data Engineer

Persistent Systems; Mumbai; Hybrid; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Competitive salary and benefits package

Quarterly growth opportunities

Company-sponsored higher education

Job summary

A leading technology firm in India is seeking a Mid-Senior level Data Engineer to design and manage data pipelines using Azure Databricks and Spark. The ideal candidate will have 5 to 11 years of experience and a strong background in building scalable data solutions. This role offers competitive salary and benefits, with a commitment to fostering a diverse and inclusive work environment.

Qualifications

• 5 to 11 years of experience in data engineering roles.
• Strong hands-on experience with Azure Databricks and Spark.
• Proficiency in building data pipelines and implementing CDC mechanisms.

Responsibilities

• Design, build, and maintain scalable data pipelines.
• Implement CDC pipelines to ingest data into analytics.
• Process large-scale datasets using PySpark and Kafka.

Skills

Azure Databricks

Spark

Kafka

PySpark

Power BI

Job description

As a Data Engineer, you will design and manage robust data pipelines using Azure Databricks, Spark, and Kafka. You’ll process large-scale datasets and implement CDC pipelines to power analytics platforms. Your role includes modeling data using the Medallion Architecture and ensuring data quality and governance. Collaboration with analytics teams for visualization and insights is key to success.

• Experience: 5 to 11 Years
• Job Type: Full Time Employment

What You'll Do:

• Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory and Azure Databricks.
• Implement Change Data Capture (CDC) pipelines to ingest data from origination and servicing platforms into the analytics ecosystem.
• Process and transform large-scale datasets using PySpark, Spark SQL, and Kafka for real-time and batch data processing.
• Model data using the Medallion Architecture (Bronze, Silver, Gold layers) to support structured and governed data flows.
• Ensure data quality, lineage, and compliance with governance standards across all stages of the data lifecycle.
• Collaborate with analytics teams and support data visualization using Power BI for business insights.

Expertise You'll Bring:

• Strong hands‑on experience with Azure Databricks, Spark, Kafka, PySpark, and Power BI.
• Proficiency in building data pipelines and implementing CDC mechanisms.
• Solid understanding of data modeling principles and data governance best practices.
• Competitive salary and benefits package
• Culture focused on talent development with quarterly growth opportunities and company‑sponsored higher education and certifications
• Opportunity to work with cutting‑edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values‑Driven, People‑Centric & Inclusive Work Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility‑friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment.

Let’s unleash your full potential at Persistent – persistent.com/careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Seniority Level

Mid‑Senior level

Employment type

Full‑time

Job function

Engineering and Information Technology

Industries

IT Services and IT Consulting

Referrals increase your chances of interviewing at Persistent Systems by 2x