Databricks Lakehouse Architect - Remote Data Modernization

Cognizant; Dover (DE); On-site; USD 140,000 - 200,000; Full time

Job summary

Cognizant is seeking an experienced Databricks Architect to lead the modernization of enterprise data using a Databricks Lakehouse on AWS. The role focuses on designing scalable data platforms, guiding migration from legacy systems, and establishing best practices for governance and performance.

The ideal candidate has 12+ years in data engineering/architecture, 5+ years in Databricks, and strong skills in Spark, Delta Lake, Unity Catalog, Databricks SQL, Python, and SQL, with AWS cloud

Qualifications

• 12+ years of Data Engineering/Data Architecture experience.
• 5+ years of hands-on Databricks Architecture experience.
• Deep expertise in Databricks Lakehouse, Spark/PySpark, Delta Lake.
• Experience with Unity Catalog, Databricks SQL, Python and SQL.
• AWS cloud experience and enterprise data migration exposure.
• Strong data governance, security and compliance knowledge.
• Excellent stakeholder management and communication skills.

Responsibilities

• Design and implement enterprise-scale Databricks Lakehouse architecture.
• Lead data modernization and migration from legacy systems to Databricks.
• Architect scalable ELT/ETL pipelines using Databricks, Spark, Delta Lake, Python.
• Define data governance, security, lineage, and metadata strategies with Unity Catalog.
• Design batch and real-time data processing solutions.
• Provide architecture guidance for cloud-native AWS solutions.
• Collaborate with business, analytics, and engineering teams on data strategy.
• Establish best practices for data quality, monitoring, performance, and cost.
• Create architecture standards, reference architectures, and docs.
• Mentor data engineers and technical leads throughout projects.
• Evaluate emerging technologies and AI/ML within Databricks ecosystem.

Skills

Stakeholder management

Communication

Data Engineering experience

Data Architecture experience

Mentoring

Tools

Databricks Lakehouse

Apache Spark / PySpark

Delta Lake

Databricks Workflows

Unity Catalog

Databricks SQL

Python

SQL

AWS Cloud (S3, IAM)

Job description

Cognizant is seeking an experienced Databricks Architect to lead the modernization of enterprise data using a Databricks Lakehouse on AWS. The role focuses on designing scalable data platforms, guiding migration from legacy systems, and establishing best practices for governance and performance.

The ideal candidate has 12+ years in data engineering/architecture, 5+ years in Databricks, and strong skills in Spark, Delta Lake, Unity Catalog, Databricks SQL, Python, and SQL, with AWS cloud