Databricks Data Architect — Enterprise Data Platform Lead

Tata Consultancy Services Limited; Boynton Beach (FL); In loco; USD 120.000 - 160.000; Tempo pieno

Vantaggi offerti da questo lavoro

Medical Coverage

Dental & Vision

Parental Leave

401K Plan

Training Reimbursement

Vacation & Holidays

Commuter Benefits

Descrizione del lavoro

Tata Consultancy Services Limited (TCS) in Boynton Beach, FL, seeks a Technical Architect with 10+ years in data engineering to lead scalable data platforms on Databricks and AWS. You will guide data modeling, governance, and security while driving modernization across streaming and batch pipelines.

Collaborate with stakeholders to define requirements, mentor engineers, and set standards for performance and reliability. Deep expertise in Delta Lake, Lakehouse, and Spark ecosystems is required.

Competenze

• 10+ years of experience in Data Engineering and Data Architecture.
• 5+ years with Databricks, PySpark and Apache Spark.
• Expert PySpark and Spark SQL proficiency.
• Designing analytics platforms for enterprise scale.
• Governance, quality and metadata management expertise.

Mansioni

• Architect scalable data platforms using Databricks and AWS.
• Lead data modeling and enterprise data architecture initiatives.
• Design and optimize batch and real-time pipelines.
• Collaborate with stakeholders to define requirements.
• Establish data governance, security, quality, and performance standards.
• Provide technical leadership and mentoring to teams.
• Drive cloud modernization and platform optimization.

Conoscenze

Databricks

PySpark

Spark SQL

Delta Lake

Lakehouse Architecture

Data Modeling

Data Governance

Streaming Architectures

Descrizione del lavoro

Tata Consultancy Services Limited (TCS) in Boynton Beach, FL, seeks a Technical Architect with 10+ years in data engineering to lead scalable data platforms on Databricks and AWS. You will guide data modeling, governance, and security while driving modernization across streaming and batch pipelines.

Collaborate with stakeholders to define requirements, mentor engineers, and set standards for performance and reliability. Deep expertise in Delta Lake, Lakehouse, and Spark ecosystems is required.