Python Data Engineer — ETL & AWS Data Pipelines

LTM; West Virginia; In loco; USD 110.000 - 165.000; Tempo pieno

Vantaggi offerti da questo lavoro

Comprehensive Medical Plan Covering

Short & Long-Term Disability

401(k) Plan with Company match

Life Insurance

Vacation Time

Sick Leave

Paid Holidays

Paid Paternity Leave

Paid Maternity Leave

Descrizione del lavoro

LTIMindtree is seeking a skilled Python Data Engineer to design and build scalable ETL pipelines using AWS data services. The role emphasizes data quality, validation, and robust data modeling for hierarchical and dimensional data structures.

Responsibilities include implementing schema-driven pipelines, collaborating with cross-functional teams, and integrating Databricks JDBC feeds, SageMaker endpoints, and Chronos interfaces while maintaining secure data handling practices.

Competenze

• Experience designing and implementing ETL pipelines.
• Proficiency with Python data engineering tools (pandas, numpy).
• Strong SQL and data modeling skills for hierarchical and dimensional structures.
• Experience with AWS data services (S3, IAM, DynamoDB, SSM).
• Data validation and data quality engineering expertise.
• Familiarity with Databricks JDBC data feeds and analytics formats (Parquet, CSV).
• Version control with Git and CI/CD workflows (GitHub Actions).
• Infrastructure as code using Terraform; SageMaker/Chronos integration familiarity.

Mansioni

• Develop, maintain, and optimize ETL pipelines and data workflows.
• Build data models for analytics and reporting across hierarchical and dimensional datasets.
• Manage AWS data services to store, secure, and process large datasets.
• Perform data validation and quality checks to ensure integrity.
• Collaborate with cross-functional teams to integrate SQL queries and Databricks JDBC feeds.
• Work with columnar data formats for storage optimization and analytics.
• Process and analyze timeseries data; write unit/integration tests for data code.
• Use version control and automation to maintain codebase and infrastructure.
• Support machine learning endpoints integration (SageMaker and Chronos).
• Ensure secure data handling and compliance across data lifecycle.

Conoscenze

Python

ETL pipelines

SQL

Data modeling

Data validation

Data quality

Git & GitHub Actions

Terraform

Databricks JDBC

SageMaker integration

Chronos endpoints

AWS services

Strumenti

Databricks

JDBC

Parquet

CSV

SageMaker

Chronos

Git

Terraform

Descrizione del lavoro

LTIMindtree is seeking a skilled Python Data Engineer to design and build scalable ETL pipelines using AWS data services. The role emphasizes data quality, validation, and robust data modeling for hierarchical and dimensional data structures.

Responsibilities include implementing schema-driven pipelines, collaborating with cross-functional teams, and integrating Databricks JDBC feeds, SageMaker endpoints, and Chronos interfaces while maintaining secure data handling practices.