Azure Databricks Tech Lead - PySpark Data Engineering

Cognizant; Seattle (WA); Hybrid; USD 120,000 - 135,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays + PTO

401(k) plan and contributions

Disability (Long-term/Short-term)

Paid Parental Leave

Employee Stock Purchase Plan

Job summary

Cognizant in Seattle offers a hybrid Technical Lead role focusing on PySpark, Python, and Azure Databricks to design scalable data solutions and guide implementation with a focus on high-quality delivery. You will collaborate with cross-functional teams to support airline and enterprise analytics use cases with measurable business impact.

The position requires leading data engineering efforts, overseeing code quality, and mentoring engineers while ensuring alignment with enterprise data

Qualifications

• Extensive practical experience in PySpark development including transformations and large-scale processing.
• Strong proficiency in Python with modular design, error handling, logging, and cloud integration.
• Hands-on expertise with Azure Databricks including workspace configuration, job orchestration, secret management, and integration with Azure data platforms.

Responsibilities

• Design robust data engineering solutions using PySpark and Python for large-scale analytics.
• Develop reusable data pipelines on Azure Databricks supporting batch and near real-time processing.
• Translate analytical needs into technical designs aligned with enterprise data architecture.
• Oversee code reviews and enforce engineering best practices for readability and maintainability.
• Guide Azure Databricks configurations to balance cost, performance, and resilience.
• Implement testing strategies including unit and integration tests to ensure data accuracy.
• Monitor production pipelines via dashboards and alerts to minimize downtime.
• Collaborate with data scientists and analysts to deliver curated data products for analytics.
• Improve development workflows with better version control and deployment automation.
• Document designs, data models and procedures for onboarding and governance.
• Coordinate with security/compliance to adhere to governance requirements.
• Optimize Spark jobs by tuning partitions and resources for performance and cost.
• Mentor junior engineers with feedback and exposure to modern data practices.

Skills

PySpark

Python

Azure Databricks

Data engineering

Data warehousing

Mentoring

Tools

Azure Databricks

Synapse

Data Lake

Job description

Cognizant in Seattle offers a hybrid Technical Lead role focusing on PySpark, Python, and Azure Databricks to design scalable data solutions and guide implementation with a focus on high-quality delivery. You will collaborate with cross-functional teams to support airline and enterprise analytics use cases with measurable business impact.

The position requires leading data engineering efforts, overseeing code quality, and mentoring engineers while ensuring alignment with enterprise data