Databricks Data Architect

Tata Consultancy Services Limited; Boynton Beach (FL); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Medical Coverage

Dental & Vision

Parental Leave

401K Plan

Training Reimbursement

Vacation & Holidays

Commuter Benefits

Job summary

Tata Consultancy Services Limited (TCS) in Boynton Beach, FL, seeks a Technical Architect with 10+ years in data engineering to lead scalable data platforms on Databricks and AWS. You will guide data modeling, governance, and security while driving modernization across streaming and batch pipelines.

Collaborate with stakeholders to define requirements, mentor engineers, and set standards for performance and reliability. Deep expertise in Delta Lake, Lakehouse, and Spark ecosystems is required.

Qualifications

• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years with Databricks, PySpark and Apache Spark.
• Expert PySpark and Spark SQL proficiency.
• Designing analytics platforms for enterprise scale.
• Governance, quality and metadata management expertise.

Responsibilities

• Architect scalable data platforms using Databricks and AWS.
• Lead data modeling and enterprise data architecture initiatives.
• Design and optimize batch and real-time pipelines.
• Collaborate with stakeholders to define requirements.
• Establish data governance, security, quality, and performance standards.
• Provide technical leadership and mentoring to teams.
• Drive cloud modernization and platform optimization.

Skills

Databricks

PySpark

Spark SQL

Delta Lake

Lakehouse Architecture

Data Modeling

Data Governance

Streaming Architectures

Job description

Must Have Technical/Functional Skills

• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years of hands‑on experience with Databricks, PySpark, and Apache Spark.
• Strong expertise in - Databricks Lakehouse Architecture, Delta Lake, Unity Catalog, Delta Live Tables (DLT), Databricks Workflows, Medallion Architecture
• Experience designing enterprise-scale analytics and data platforms.
• Expert-level proficiency in PySpark and Spark SQL.
• Advanced SQL development and query optimization skills.
• Strong understanding of batch and streaming architectures.
• Experience with data warehousing, ETL/ELT, and large-scale data processing.
• Expertise in dimensional, relational, and analytical data modeling.
• Experience implementing data governance, data quality, and metadata management solutions.
• Knowledge of CI/CD practices, Git, DevOps, and Infrastructure as Code (Terraform preferred).
• Experience establishing architectural standards and engineering best practices.

Roles & Responsibilities

• Architect and design scalable, secure, and high-performance data platforms using Databricks and AWS.
• Lead solution design, data modeling, and enterprise data architecture initiatives.
• Design and optimize batch and real-time data pipelines using Databricks, PySpark, and Delta Lake.
• Partner with business and technology stakeholders to define requirements and deliver strategic data solutions.
• Establish standards for data governance, security, quality, performance, and operational excellence.
• Provide technical leadership, mentoring, and architectural guidance to engineering teams.
• Drive cloud modernization, platform optimization, and data transformation initiatives.

TCS Employee Benefits Summary:

• Discretionary Annual Incentive.
• Comprehensive Medical Coverage: Medical & Health, Dental & Vision, Disability Planning & Insurance, Pet Insurance Plans.
• Family Support: Maternal & Parental Leaves.
• Insurance Options: Aut& Home Insurance, Identity Theft Protection.
• Convenience & Professional Growth: Commuter Benefits & Certification & Training Reimbursement.
• Time Off: Vacation, Time Off, Sick Leave & Holidays.
• Legal & Financial Assistance: Legal Assistance, 401K Plan, Performance Bonus, College Fund, Student Loan Refinancing.

Salary Range-$120,000-$160,000 a year

Location: Boynton Beach, FL

Function: TECHNOLOGY

Role: Technical Architect

ID: 435474

Skills: Spark | SQL | Apache Spark

Salary Range: $120,000 - $160,000