Senior Databricks Architect — Remote Data Lakehouse Lead

Cognizant; City of Albany (NY); On-site; USD 180,000 - 240,000; Full time

Job summary

Cognizant is hiring a Databricks Architect to lead the design and implementation of enterprise data modernization initiatives. The role requires deep expertise in Databricks Lakehouse architecture, Apache Spark/PySpark, Delta Lake, Unity Catalog, and AWS.

You will drive architecture decisions, establish best practices, and guide modernization of legacy data platforms into a scalable Databricks ecosystem. The ideal candidate will have 12+ years in data engineering/architecture, 5+ years in

Qualifications

• 12+ years of Data Engineering/Data Architecture experience.
• 5+ years of hands-on Databricks Architecture experience.
• Strong expertise in Databricks Lakehouse, Spark, Delta Lake, Unity Catalog, and AWS.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architecture.
• Lead data modernization and migration programs to Databricks.
• Architect ELT/ETL pipelines using Databricks, Spark, Delta Lake, and Python.
• Define data governance, security, lineage, and metadata using Unity Catalog.
• Design batch and real-time data processing solutions.
• Provide architecture guidance for AWS cloud-native solutions.
• Collaborate with business, analytics, and engineering teams to define data strategies.
• Establish best practices for data quality, monitoring, and cost optimization.
• Create architecture standards and technical documentation.
• Mentor data engineers and leads throughout development.
• Evaluate emerging technologies and AI/ML capabilities within Databricks ecosystem.

Skills

Databricks Lakehouse

Apache Spark / PySpark

Delta Lake

Databricks Workflows

Unity Catalog

Databricks SQL

Python

SQL

AWS Cloud

Job description

Cognizant is hiring a Databricks Architect to lead the design and implementation of enterprise data modernization initiatives. The role requires deep expertise in Databricks Lakehouse architecture, Apache Spark/PySpark, Delta Lake, Unity Catalog, and AWS.

You will drive architecture decisions, establish best practices, and guide modernization of legacy data platforms into a scalable Databricks ecosystem. The ideal candidate will have 12+ years in data engineering/architecture, 5+ years in