Remote Databricks Lakehouse Architect | Data Modernization

Cognizant; Frankfort (KY); Remote; USD 150,000 - 210,000; Full time

Job summary

Cognizant is seeking a Databricks Architect to lead enterprise data modernization initiatives. The role focuses on creating scalable Databricks Lakehouse solutions, guiding migration programs from legacy systems, and establishing governance, security, and metadata management on Unity Catalog.

The ideal candidate has 12+ years in data engineering/architecture and 5+ years in hands-on Databricks design, working with Spark, Delta Lake, and AWS-based cloud architectures.

Qualifications

• 12+ years of Data Engineering/Data Architecture experience.
• 5+ years of hands-on Databricks Architecture experience.
• Strong expertise in Databricks Lakehouse, Spark/PySpark, Delta Lake, Unity Catalog, and Databricks SQL.
• Experience with AWS, S3, IAM, networking, and cloud architecture.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architecture.
• Lead data modernization and migration programs from legacy platforms to Databricks.
• Architect scalable ELT/ETL pipelines using Databricks, Spark, Delta Lake, and Python.
• Define data governance, security, lineage, and metadata management strategies using Unity Catalog.
• Design batch and real-time data processing solutions.
• Provide architecture guidance for cloud-native solutions on AWS.
• Collaborate with business, analytics, and engineering teams to define data strategies.
• Establish best practices for data quality, monitoring, performance tuning, and cost optimization.
• Create architecture standards, reference architectures, and technical documentation.
• Mentor data engineers and technical leads throughout the development lifecycle.
• Evaluate and recommend emerging technologies and AI/ML capabilities within the Databricks ecosystem.

Skills

Databricks Lakehouse

Apache Spark

Delta Lake

Databricks Workflows

Unity Catalog

Databricks SQL

Python

SQL

AWS Cloud

Data Modeling

Data Governance

Data Integration

Cloud Migration

Stakeholder Mgmt

Architecture Leadership

Tools

AWS Cloud

Job description

Cognizant is seeking a Databricks Architect to lead enterprise data modernization initiatives. The role focuses on creating scalable Databricks Lakehouse solutions, guiding migration programs from legacy systems, and establishing governance, security, and metadata management on Unity Catalog.

The ideal candidate has 12+ years in data engineering/architecture and 5+ years in hands-on Databricks design, working with Spark, Delta Lake, and AWS-based cloud architectures.