Databricks Solution Architect

Tata Consultancy Services; Malvern (Chester County); On-site; USD 152,000 - 157,000; Full time

Benefits offered by this job

Discretionary Incentive

Medical Coverage

Parental Leave

Insurance Options

Commuter Benefits

Training Reimbursement

Vacation & Holidays

401K Plan

Job summary

Tata Consultancy Services in the United States is seeking a Databricks Solution Architect with 15+ years of experience in designing and delivering enterprise-scale data platforms, cloud modernization initiatives, and complex system integrations.

The role leads architecture strategy, defines scalable Lakehouse solutions, and collaborates with business and engineering stakeholders to enable data-driven transformation.

Qualifications

• Must have 15+ years of experience in designing and delivering enterprise-scale data platforms, cloud modernization initiatives, and complex system integrations.
• Proven ability to lead architecture strategy, define scalable Lakehouse solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data-driven transformation.

Responsibilities

• Architect and implement enterprise data platforms using Databricks Lakehouse, Delta Lake, Unity Catalog, and Spark.
• Design scalable batch, streaming, CDC, and real-time data integration solutions across enterprise applications.
• Lead migration of legacy data warehouses, Hadoop ecosystems, and on-prem platforms to modern cloud architectures.
• Define data governance, security, lineage, metadata management, and compliance frameworks.
• Provide technical leadership, architecture governance, solution reviews, and mentoring for engineering teams.
• Partner with business stakeholders to build analytics, AI/ML, and GenAI-ready data ecosystems.

Skills

Databricks Lakehouse

Delta Lake

Unity Catalog

DLT

Databricks SQL

MLflow

Spark

PySpark

Scala

Kafka

Streaming Architectures

Azure Databricks

ADF

ADLS

Synapse

AWS S3

Glue

EMR

Redshift

Snowflake

Data Vault

Star Schema

CDC

REST APIs

Event-Driven Architecture

Enterprise SaaS/ERP/CRM integrations

Terraform

Azure DevOps

GitHub Actions

Jenkins

CI/CD

Data Quality

Metadata Management

Security & Compliance

Education

BACHELOR OF COMPUTER SCIENCE

Job description

• Databricks: Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, MLflow
• Big Data: Spark, PySpark, Scala, Kafka, Streaming Architectures
• Data Warehousing: Snowflake, Data Vault, Star/Snowflake Schema, CDC
• Governance: Data Quality, Metadata Management, Security & Compliance

Job Description

Must Have Technical/Functional Skills

• Databricks: Lakehouse, Delta Lake, Unity Catalog, DLT, Databricks SQL, MLflow
• Big Data: Spark, PySpark, Scala, Kafka, Streaming Architectures
• Cloud: Azure Databricks, ADF, ADLS, Synapse, AWS S3, Glue, EMR, Redshift
• Data Warehousing: Snowflake, Data Vault, Star/Snowflake Schema, CDC
• Integration: REST APIs, Event-Driven Architecture, Enterprise SaaS/ERP/CRM integrations
• DevOps: Terraform, Azure DevOps, GitHub Actions, Jenkins, CI/CD
• Governance: Data Quality, Metadata Management, Security & Compliance

Preferred: Databricks, Azure, AWS, and TOGAF certifications with experience in BFSI, Capital Markets, Asset Management, or large enterprise environments.

Roles & Responsibilities

We are seeking a Databricks Solution Architect with 15+ years of experience in designing and delivering enterprise-scale data platforms, cloud modernization initiatives, and complex system integrations. The ideal candidate will lead architecture strategy, define scalable Lakehouse solutions, and collaborate with business, engineering, and enterprise stakeholders to enable data-driven transformation.

Key Responsibilities

• Architect and implement enterprise data platforms using Databricks Lakehouse, Delta Lake, Unity Catalog, and Spark.
• Design scalable batch, streaming, CDC, and real-time data integration solutions across enterprise applications.
• Lead migration of legacy data warehouses, Hadoop ecosystems, and on-prem platforms to modern cloud architectures.
• Define data governance, security, lineage, metadata management, and compliance frameworks.
• Provide technical leadership, architecture governance, solution reviews, and mentoring for engineering teams.
• Partner with business stakeholders to build analytics, AI/ML, and GenAI-ready data ecosystems.

Generic Managerial Skills, If any

• Ability to collaborate with an onsite-offshore model.
• Influence and guiding junior team members

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range: $152,000 - $157,000 a year

Qualifications:

BACHELOR OF COMPUTER SCIENCE