Sr. Azure Databricks Data Engineer / Architect

Cognizant; San Francisco (CA); Hybrid; USD 100,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays and PTO

401(k) plan

Job summary

Cognizant is seeking a Senior Azure Databricks Data Engineer/Architect to design scalable cloud-based data platform solutions on Azure. You will collaborate with product owners, data engineers, and analysts to deliver secure, high-performing analytics capabilities.

The role requires strong skills in Databricks, PySpark, ADF, ODI, and SQL/PLSQL, plus experience with data governance and CI/CD practices. Hybrid work with 1–2 days per week in Irvine, CA; visa sponsorship not offered.

Qualifications

• Strong experience with Azure Databricks and PySpark in enterprise-scale data engineering environments.
• Hands-on experience with Azure Data Factory (ADF) and cloud-based data integration solutions.
• Experience working with ODI and relational database technologies.
• Strong SQL and PL/SQL development skills with performance tuning and query optimization.
• Experience designing and maintaining data lakes, data pipelines, and cloud-based analytics platforms on Microsoft Azure.
• Proficiency with Azure DevOps, version control, CI/CD methodologies, and automated deployment practices.
• Experience implementing data governance, security controls, and access management using services such as Azure Key Vault.
• Strong communication and stakeholder management skills with the ability to translate business requirements into technical solutions.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent professional experience.

Responsibilities

• Design and architect end-to-end data platform solutions using Azure Databricks and Azure Data Services.
• Build and optimize scalable data pipelines using Python and PySpark.
• Configure and administer Databricks environments, including workspace management and security.
• Develop and maintain data models, Databricks SQL queries, and analytics solutions.
• Implement CI/CD and data platform best practices using Azure DevOps while ensuring data quality and governance.

Skills

Azure Databricks

PySpark

SQL/PLSQL

Education

Bachelor's degree in CS/IS/Engineering

Tools

Azure Data Factory

ODI

Databricks Workflows

Job description

About the role

As a Senior Azure Databricks Data Engineer / Architect, you will make an impact by designing and delivering scalable cloud-based data platform solutions that enable enterprise analytics, reporting, and data-driven decision-making. You will be a valued member of the Data Engineering team and work collaboratively with product owners, data engineers, business analysts, and other stakeholders to deliver secure, high-performing data solutions on Azure.

In this role, you will:

• Design and architect end-to-end data platform solutions using Azure Databricks, Azure Data Services, and modern cloud technologies.
• Build and optimize scalable data pipelines using Python and PySpark to ingest, transform, and validate large volumes of data.
• Configure and administer Databricks environments, including workspace management, security, access controls, and cluster optimization.
• Develop and maintain data models, Databricks SQL queries, and analytics solutions that support reporting and business intelligence initiatives.
• Implement CI/CD and data platform best practices using Azure DevOps while ensuring data quality, governance, performance, and operational reliability.

Work model

We believe hybrid work is the way forward as we strive to provide flexibility wherever possible. Based on this role's business requirements, this is a hybrid position requiring 1-2 days per week in a client or Cognizant office in Irvine, California. Regardless of your working arrangement, we are here to support a healthy work-life balance through our various wellbeing programs.

The working arrangements for this role are accurate as of the date of posting. This may change based on the project you're engaged in, as well as business and client requirements. Rest assured; we will always be clear about role expectations.

What you need to have to be considered

• Strong experience with Azure Databricks and PySpark in enterprise-scale data engineering environments.
• Hands‑on experience with Azure Data Factory (ADF) and cloud-based data integration solutions.
• Experience working with Oracle Data Integrator (ODI) and relational database technologies.
• Strong SQL and PL/SQL development skills with expertise in performance tuning and query optimization.
• Experience designing and maintaining data lakes, data pipelines, and cloud-based analytics platforms on Microsoft Azure.
• Proficiency with Azure DevOps, version control, CI/CD methodologies, and automated deployment practices.
• Experience implementing data governance, security controls, and access management using services such as Azure Key Vault.
• Strong communication and stakeholder management skills with the ability to translate business requirements into technical solutions.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent professional experience.

These will help you stand out

• Experience with Microsoft Fabric and modern analytics platforms.
• Knowledge of data modeling, data warehousing, and lakehouse architectures.
• Experience supporting automotive industry data and analytics initiatives.
• Familiarity with Databricks Workflows, job orchestration, and monitoring frameworks.
• Experience driving architecture standards, technical governance, and cloud modernization initiatives.

We're excited to meet people who share our mission and can make an impact in a variety of ways.

*Please note, this role is not able to offer visa transfer or sponsorship now or in the future*

Applications will be accepted until September 13, 2026.

Salary and Other Compensation

The annual salary for this position is between $ 100,000 - $ 117,000 depending on experience and other qualifications of the successful candidate.

This position is also eligible for Cognizant’s discretionary annual incentive program, based on performance and subject to the terms of Cognizant’s applicable plans.

Benefits: Cognizant offers the following benefits for this position, subject to applicable eligibility requirements:

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

Disclaimer: The salary, other compensation, and benefits information is accurate as of the date of this posting. Cognizant reserves the right to modify this information at any time, subject to applicable law.