Senior Azure Databricks Architect – Hybrid Data Platform

Cognizant; San Francisco (CA); Hybrid; USD 100,000 - 117,000; Full time

Benefits offered by this job

Medical/Dental/Vision/Life Insurance

Paid holidays and PTO

401(k) plan

Job summary

Cognizant is seeking a Senior Azure Databricks Data Engineer/Architect to design scalable cloud-based data platform solutions on Azure. You will collaborate with product owners, data engineers, and analysts to deliver secure, high-performing analytics capabilities.

The role requires strong skills in Databricks, PySpark, ADF, ODI, and SQL/PLSQL, plus experience with data governance and CI/CD practices. Hybrid work with 1–2 days per week in Irvine, CA; visa sponsorship not offered.

Qualifications

• Strong experience with Azure Databricks and PySpark in enterprise-scale data engineering environments.
• Hands-on experience with Azure Data Factory (ADF) and cloud-based data integration solutions.
• Experience working with ODI and relational database technologies.
• Strong SQL and PL/SQL development skills with performance tuning and query optimization.
• Experience designing and maintaining data lakes, data pipelines, and cloud-based analytics platforms on Microsoft Azure.
• Proficiency with Azure DevOps, version control, CI/CD methodologies, and automated deployment practices.
• Experience implementing data governance, security controls, and access management using services such as Azure Key Vault.
• Strong communication and stakeholder management skills with the ability to translate business requirements into technical solutions.
• Bachelor's degree in Computer Science, Information Systems, Engineering, or equivalent professional experience.

Responsibilities

• Design and architect end-to-end data platform solutions using Azure Databricks and Azure Data Services.
• Build and optimize scalable data pipelines using Python and PySpark.
• Configure and administer Databricks environments, including workspace management and security.
• Develop and maintain data models, Databricks SQL queries, and analytics solutions.
• Implement CI/CD and data platform best practices using Azure DevOps while ensuring data quality and governance.

Skills

Azure Databricks

PySpark

SQL/PLSQL

Education

Bachelor's degree in CS/IS/Engineering

Tools

Azure Data Factory

ODI

Databricks Workflows

Job description

Cognizant is seeking a Senior Azure Databricks Data Engineer/Architect to design scalable cloud-based data platform solutions on Azure. You will collaborate with product owners, data engineers, and analysts to deliver secure, high-performing analytics capabilities.

The role requires strong skills in Databricks, PySpark, ADF, ODI, and SQL/PLSQL, plus experience with data governance and CI/CD practices. Hybrid work with 1–2 days per week in Irvine, CA; visa sponsorship not offered.