Databricks Architect

Tata Consultancy Services; Malvern (Chester County); On-site; USD 130,000 - 165,000; Full time

Benefits offered by this job

Discretionary Annual Incentive

Comprehensive Medical Coverage (Health

Dental & Vision

401K Plan

Certification & Training Reimbursement

Paid Time Off & Holidays

Job summary

Tata Consultancy Services is seeking a Senior Databricks Architect to design and implement enterprise-scale lakehouse architectures on cloud platforms. You will bring expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing to define data strategy and governance.

You will lead architecture standards, collaborate with stakeholders, and scale analytics platforms supporting AI/ML and BI initiatives across the organization.

Qualifications

• Bachelor's degree in Computer Science or related field.
• Strong experience with AWS data services and data lake architectures.
• Proven track record delivering enterprise-scale data lakehouse architectures.

Responsibilities

• Design and implement enterprise-scale lakehouse architectures on cloud platforms.
• Define data strategy, standards, governance, and scalable analytics platforms.

Skills

Data Modeling

Data Lake Architecture

Big Data Processing

SQL Expertise

Streaming

Security & Governance

Infrastructure as Code

Architecture & Stakeholder Management

AWS Data Services

ETL/ELT Development

Databricks/Spark

Education

Bachelor's degree in Computer Science

Tools

Airflow

AWS Glue

Terraform

CloudFormation

Databricks

Job description

• Data Modeling – Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture – Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing – Spark/PySpark, Amazon EMR.
• SQL Expertise – Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data – Kinesis and/or Kafka
• Security & Governance – IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code – Terraform and/or CloudFormation.
• Architecture & Stakeholder Management – Solution design, cloud migration, business requirement translation.

Job Description

Must Have Technical/Functional Skills

• AWS Data Services – S3, Redshift, Glue, Lambda, Athena.
• Data Modeling – Dimensional Modeling (Star/Snowflake), Data Warehouse Design.
• Data Lake Architecture – Amazon S3, Lake Formation, Data Lake best practices.
• Big Data & Processing – Spark/PySpark, Amazon EMR.
• ETL/ELT Development – AWS Glue, Airflow, Data Pipeline orchestration.
• SQL Expertise – Advanced SQL, query optimization, performance tuning.
• Streaming & Real-Time Data – Kinesis and/or Kafka
• Security & Governance – IAM, KMS, Lake Formation, Encryption, Data Governance.
• Infrastructure as Code – Terraform and/or CloudFormation.
• Architecture & Stakeholder Management – Solution design, cloud migration, business requirement translation.

Roles & Responsibilities

Senior Databricks Architect with strong experience in designing and implementing enterprise-scale Lakehouse architectures on cloud platforms. Expertise in Databricks, Spark, PySpark, Delta Lake, data modeling, and real-time data processing. Responsible for defining data strategy, architecture standards, governance, and scalable analytics platforms supporting AI/ML and business intelligence initiatives

Generic Managerial Skills, If any

• Strong leadership and stakeholder management skills, with experience leading cross-functional teams and driving delivery excellence.
• Proven effective communication with business and technical stakeholders.

TCS Employee Benefits Summary

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Auto & Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.
• Salary Range: $130,000 - $165,000 a year

Qualifications:

BACHELOR OF COMPUTER SCIENCE