Senior Data Platform Architect & Consulting Leader

Tata Consultancy Services Limited; Irvine (CA); Presencial; USD 190.000 - 240.000; Jornada completa

Descripción de la vacante

Tata Consultancy Services Limited in Irvine, CA seeks a Consulting Partner specializing in Data Engineering & Modern Data Platforms. You will lead enterprise-scale transformations, architect data platforms, and drive modernization from executive discussions to hands-on engineering reviews.

The role requires deep expertise in Spark/PySpark, SQL, cloud data platforms, dbt, and Airflow, with proven ability to collaborate across engineers, architects, platform teams, and senior stakeholders.

Formación

• Minimum 15+ years in data engineering, data platforms, analytics, or technology architecture.
• At least 10+ years of hands-on experience in data engineering and data platforms.
• Demonstrated ability to architect and deliver enterprise-scale data platforms.
• Hands-on Spark/PySpark and SQL expertise.
• Proven experience with cloud data platforms such as Databricks or Snowflake.
• Experience with dbt and modern data transformation frameworks.
• Experience with Airflow and orchestration technologies.
• Strong understanding of distributed computing, performance, and scalability.
• Experience leading large-scale data modernization or migration programs.
• Ability to engage with engineers, architects, platform teams, and executives

Responsabilidades

• Lead technical consulting and architecture for large data modernization programs.
• Provide hands-on data engineering leadership when required.
• Oversee programs with hundreds or thousands of pipelines and datasets.
• Define migration strategies for legacy ETL to modern ELT and cloud migrations.
• Review SQL transformations, PySpark/Spark apps, and dbt models.
• Guide data governance, security, and lifecycle management.
• Review Airflow DAGs and orchestration architecture; ensure performance optimization.
• Communicate architecture trade-offs to executive stakeholders.

Conocimientos

15+ years data engineering

10+ years hands-on data engineering

Enterprise-scale data platforms

SparkPySpark

SQL

Databricks or Snowflake

dbt

Airflow

Distributed computing

Data modernization programs

Stakeholder engagement

Herramientas

Spark

PySpark

Databricks

Snowflake

dbt

Airflow

Descripción del empleo

Tata Consultancy Services Limited in Irvine, CA seeks a Consulting Partner specializing in Data Engineering & Modern Data Platforms. You will lead enterprise-scale transformations, architect data platforms, and drive modernization from executive discussions to hands-on engineering reviews.

The role requires deep expertise in Spark/PySpark, SQL, cloud data platforms, dbt, and Airflow, with proven ability to collaborate across engineers, architects, platform teams, and senior stakeholders.