Senior AWS Data Engineer — Data Lakes & Pipelines

Tata Consultancy Services; Owings Mills (MD); On-site; USD 110,000 - 125,000; Full time

Benefits offered by this job

Discretionary incentive

Medical coverage

Family leaves

Auto & Home Insurance

Commuter benefits

Vacation & Holidays

Legal & financial assistance

401K & retirement

Job summary

Tata Consultancy Services is seeking a senior data engineer to lead the design and implementation of data lakes, data marts, and data meshes. You will own data integration pipelines, collaborating with business stakeholders to align data models with enterprise strategy.

Ideal candidates have 12+ years of hands-on experience with Python, AWS Data Services, DBT, Apache Airflow, SQL and PySpark, and are skilled at agile delivery and performance tuning. On-site opportunity in the US.

Qualifications

• 12+ years hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (Astronomer), SQL and PySpark.
• Strong SQL and Data Warehousing lifecycle knowledge required.
• Experience in building data pipelines and orchestrating with DBT & Apache Airflow.
• Data migrations and development of ODS, EDW, Data Lake and Data Marts.
• Performance tuning and data modeling exposure essential.
• Cloud ETL/ELT experience with Glue/EMR or similar tools is a plus.
• Experience with Snowflake, DB2, Postgres and other databases is beneficial.
• Excellent communication to liaise with Business & IT stakeholders.
• Ability to plan execution and estimate effort; familiar with Agile.

Responsibilities

• Lead design of data lakes, data marts, and data meshes that are reliable and secure.
• Develop and maintain data integration solutions using Python and AWS Data Services with DBT and Airflow.
• Collaborate with stakeholders to define enterprise data strategy, data models, and migration roadmaps.
• Translate technical constraints into business insights and manage cross-functional expectations.
• Modify, configure, and debug existing data pipelines to meet business needs.
• Troubleshoot, tune, and optimize code for performance.
• Review new requirements, perform gap analysis, and fix performance issues.
• Mentor junior/mid-level data engineers on best practices and data patterns.
• Document data flows, mappings, sessions and workflows.
• Handle tickets in an Agile/POD framework.

Skills

Python

AWS Data Services

DBT

Apache Airflow

SQL

PySpark

Data Warehousing

Data Pipelines

Agile

Communication

Education

Bachelor's degree in Computer Science

Tools

Airflow

DBT

Snowflake

DB2

Postgres

Job description

Tata Consultancy Services is seeking a senior data engineer to lead the design and implementation of data lakes, data marts, and data meshes. You will own data integration pipelines, collaborating with business stakeholders to align data models with enterprise strategy.

Ideal candidates have 12+ years of hands-on experience with Python, AWS Data Services, DBT, Apache Airflow, SQL and PySpark, and are skilled at agile delivery and performance tuning. On-site opportunity in the US.