Databricks Solution Architect

Tata Consultancy Services Limited; Dallas (TX); On-site; USD 120,000 - 135,000; Full time

Job summary

Tata Consultancy Services Limited in Dallas, TX seeks a senior Data Platform Architect to design end-to-end Databricks Lakehouse architectures and lead modernization across platforms. You will define standards, patterns, and governance while enabling AI-ready workloads and secure data sharing across regions.

You will collaborate with executives, enterprise architects, and customer stakeholders to deliver scalable, compliant data solutions that support banking and financial services initiatives

Qualifications

• 10+ years in Data & Analytics Architecture.
• 5+ years of Databricks implementation experience.
• Experience with large-scale cloud data modernization programs.
• Experience migrating Cloudera/Hadoop to Databricks.
• Banking/Financial Services domain experience preferred.
• Experience engaging with executive stakeholders and enterprise architecture boards.
• Must work from customer location in Dallas.

Responsibilities

• Design end-to-end Databricks Lakehouse architectures.
• Define enterprise data architecture standards and reusable patterns.
• Architect Bronze, Silver, and Gold data products using Medallion Architecture.
• Establish scalable data integration frameworks for batch, streaming, and CDC workloads.
• Design resilient multi-region and data residency compliant solutions.
• Lead modernization of Cloudera Hadoop, Hive, Impala, Spark, and legacy Data Warehouse platforms.
• Define migration strategies, migration factories, and cutover approaches.
• Establish metadata, lineage, and governance migration frameworks.
• Drive workload optimization and performance tuning.
• Mentor engineering teams on Databricks best practices.

Skills

Data & Analytics Architecture

Databricks

Cloud Data Modernization

Cloudera/Hadoop to Databricks

Banking & Financial Services domain

Executive Stakeholders engagement

Dallas location constraint

Education

Bachelor's degree in Computer Science

Tools

Cloudera Hadoop Administrator

Job description

Roles & Responsibilities

Key Responsibilities

Data Platform Architecture

• Design end-to-end Databricks Lakehouse architectures.
• Define enterprise data architecture standards and reusable patterns.
• Architect Bronze, Silver, and Gold data products using Medallion Architecture.
• Establish scalable data integration frameworks for batch, streaming, and CDC workloads.
• Design resilient multi-region and data residency compliant solutions.

Data Modernization

• Lead modernization of Cloudera Hadoop, Hive, Impala, Spark, and legacy Data Warehouse platforms.
• Define migration strategies, migration factories, and cutover approaches.
• Establish metadata, lineage, and governance migration frameworks.
• Drive workload optimization and performance tuning.

Databricks Governance

• Design Unity Catalog architecture.
• Implement RBAC, ABAC, row-level and column-level security.
• Establish lineage, audit, compliance, and data quality frameworks.
• Define workspace, catalog, and metastore architecture across regions.
• Implement data sharing and data residency controls.

AI / GenAI Enablement

• Design AI-ready Lakehouse architectures.
• Enable MLOps and LLMOps frameworks.
• Implement Feature Stores and Vector Search architectures.
• Support GenAI, Agentic AI, and Retrieval-Augmented Generation (RAG) use cases.
• Evaluate emerging Databricks AI capabilities and accelerators.

Architecture Governance

• Conduct architecture reviews and design approvals.
• Define technical standards, guardrails, and reference architectures.
• Lead Proof of Concepts and innovation initiatives.
• Mentor engineering teams on Databricks best practices.
• Ensure compliance with security, risk, and regulatory requirements.

Required Skills & Qualifications

• 10+ years in Data & Analytics Architecture.
• 5+ years of Databricks implementation experience.
• Strong experience in large-scale cloud data modernization programs.
• Experience migrating Cloudera/Hadoop environments to Databricks.
• Banking and Financial Services domain experience preferred.
• Experience engaging with executive stakeholders and enterprise architecture boards
• Must work from customer location in Dallas.

Salary Range: $120,000 to $135,000 per year

Location

Dallas, TX

Function

TECHNOLOGY

Role

Solution Architect

ID

435869

Skills

Cloudera Hadoop Administrator

Salary Range

$120,000 - $135,000

Desired Candidate Profile

Qualifications

BACHELOR OF COMPUTER SCIENCE