Remote Senior Databricks Lakehouse Architect

Cognizant; Bismarck (ND); Remote; USD 150,000 - 210,000; Full time

Job summary

Cognizant is seeking a Databricks Architect to lead enterprise data modernization efforts, focusing on Databricks Lakehouse architecture, Spark/PySpark, Delta Lake, and Unity Catalog. Remote, with 12+ years of data engineering/architecture experience preferred.

Responsibilities include designing scalable ELT/ETL pipelines, guiding cloud-native AWS solutions, and setting governance and metadata strategies while mentoring engineers and collaborating with analytics teams.

Qualifications

• 12+ years of Data Engineering/Data Architecture experience.
• 5+ years of hands-on Databricks Architecture experience.
• Strong expertise in: Databricks Lakehouse, Apache Spark/PySpark, Delta Lake, Unity Catalog, Databricks SQL, Python, SQL.
• AWS Cloud experience (S3, IAM, networking, security).

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architecture.
• Lead data modernization and migration programs from legacy platforms to Databricks.
• Architect scalable ELT/ETL pipelines using Databricks, Spark, Delta Lake, and Python.
• Define data governance, security, lineage, and metadata management strategies using Unity Catalog.
• Design batch and real-time data processing solutions.
• Provide architecture guidance for cloud-native solutions on AWS.
• Collaborate with business, analytics, and engineering teams to define data strategies.
• Establish best practices for data quality, monitoring, performance tuning, and cost optimization.
• Create architecture standards, reference architectures, and technical documentation.
• Mentor data engineers and technical leads throughout the development lifecycle.
• Evaluate and recommend emerging technologies and AI/ML capabilities within the Databricks ecosystem.

Skills

Databricks Lakehouse

Apache Spark / PySpark

Delta Lake

Unity Catalog

Databricks SQL

Python

SQL

AWS Cloud

Data Modeling

ETL/ELT Pipelines

Data Governance

MLOps (Databricks)

Terraform (IaC)

Tools

Terraform

Job description

Cognizant is seeking a Databricks Architect to lead enterprise data modernization efforts, focusing on Databricks Lakehouse architecture, Spark/PySpark, Delta Lake, and Unity Catalog. Remote, with 12+ years of data engineering/architecture experience preferred.

Responsibilities include designing scalable ELT/ETL pipelines, guiding cloud-native AWS solutions, and setting governance and metadata strategies while mentoring engineers and collaborating with analytics teams.