Senior Data Engineer

Cognizant; Hyderabad, Pune District, Bengaluru; On-site; INR 1,200,000 - 2,100,000; Full time

Job summary

Cognizant in Hyderabad is hiring Databricks Data Engineers and Azure Data Engineers. Candidates with expertise in either domain, or a combination of both, are encouraged to apply.

The role covers designing, building, and supporting data pipelines using Databricks, PySpark, Delta Lake, and Spark SQL on cloud platforms, with production-ready responsibilities and cross-team collaboration.

Qualifications

• Recent hands-on Databricks experience is mandatory.
• 5+ years of strong Databricks-focused experience preferred.
• Ability to work across batch and streaming data processing.

Responsibilities

• Design, develop, and support data pipelines using Databricks and PySpark.
• Work on batch and streaming data processing with Apache Spark.
• Build and manage data solutions with Delta Lake for reliability.
• Support production systems, troubleshoot issues, and resolve incidents.
• Contribute to migration initiatives to modern cloud platforms.
• Collaborate with onshore and offshore teams on design and delivery.

Skills

Databricks

Azure Cloud

Apache Spark

PySpark

Delta Lake

Spark SQL

Distributed data processing concepts

Cloud-based data platforms

Python (via PySpark)

Tools

Azure Data Factory

Azure SQL

Event Hubs

Synapse Analytics

Unity Catalog

Delta Live Tables

Job description

We are hiring for both Databricks Data Engineers and Azure Data Engineers. Candidates with expertise in either domain, or a combination of both, are encouraged to apply. Please ensure your skills and experience are accurately reflected in the screening responses so your profile can be assessed for the appropriate role.

Role & responsibilities

• Design, develop, and support data pipelines using Databricks and PySpark
• Work on batch and streaming data processing using Apache Spark
• Build and manage data solutions using Delta Lake, ensuring data reliability and consistency
• Support production systems, troubleshoot issues, and resolve incidents independently
• Contribute to migration initiatives to modern, cloud-based data platforms
• Collaborate with onshore and offshore teams on solution design and deliver

Skillset

• Databricks strong, hands-on, core experience
• Experience working on Azure cloud environments
• Apache Spark (deep understanding; not theoretical)
• PySpark
• Delta Lake
• Spark SQL
• Distributed data processing concepts
• Cloud-based data platforms Experience with distributed storage (e.g. ADLS or equivalent)
• Python (via PySpark) Focus on data processing concepts rather than framework development

GoodtoHave Skills

• Azure Data Factory (ADF)
• Azure SQL
• Event Hubs
• Synapse Analytics
• Unity Catalog
• Delta Live Tables

Experience Expectations

• Meaningful, recent hands-on experience with Databricks is mandatory
• Candidates with 5+ years of strong Databricks-focused experience are acceptable
• Superficial, training-only, or very recent Databricks exposure is not sufficient

Technical Maturity Expectations

• Strong understanding of modern data engineering mindsets
• • Distributed systems over traditional RDBMS concepts
• Comfortable handling production scenarios independently
• Able to clearly explain design decisions and trade-offs during interviews
• Demonstrates problem-solving ability beyond tool familiarity