Senior Data Integration Engineer - AI Pipelines on AWS

EPAM Systems Inc; United States; À distance; USD 120 000 - 190 000; Plein temps

Résumé du poste

EPAM Systems Inc. seeks a Senior Data Integration Engineer to design and operate scalable data pipelines across AWS and GCP using Python, SQL, Airflow, Spark, and Databricks or Snowflake.

You will collaborate with cross-functional teams to ensure delivery quality and continuously improve data integration architectures to support analytics at scale.

Deep knowledge of CI/CD, SDLC practices, and strong English communication in an Agile environment are required to drive pragmatic data solutions.

Qualifications

• At least 3 years of relevant professional experience.
• Strong AI awareness and familiarity with AI principles.
• Advanced Python capability for data integration development.
• Experience with AWS and Google Cloud environments.
• Strong background in data integration across multiple sources.
• Proficient in SQL and NoSQL concepts.
• Familiar with CI/CD practices for automated releases.
• Experience with Apache Airflow for workflow orchestration.
• Experience with Databricks or Snowflake for large-scale processing.
• Experience with Apache Spark and SDLC methodologies.
• Excellent English communication (B2+) in Agile settings.

Responsabilités

• Build scalable and durable data integration systems aligned with requirements.
• Coordinate with multidisciplinary teams to ensure timely delivery.
• Participate in architecture discussions and guide project direction.
• Review code and provide feedback to maintain engineering standards.
• Resolve technical issues in the data pipeline lifecycle.
• Mentor junior colleagues and share knowledge.
• Assist with planning, scope refinement, and reliable estimates.
• Monitor technology trends and adopt worthwhile methods.
• Document key decisions and data workflows for stability.
• Align with stakeholders on objectives and verify delivery meets expectations.

Connaissances

Python

SQL

Apache Spark

CI/CD

Agile

English (B2+)

Outils

AWS

Google Cloud Platform

Airflow

Databricks

Snowflake

Description du poste

EPAM Systems Inc. seeks a Senior Data Integration Engineer to design and operate scalable data pipelines across AWS and GCP using Python, SQL, Airflow, Spark, and Databricks or Snowflake.

You will collaborate with cross-functional teams to ensure delivery quality and continuously improve data integration architectures to support analytics at scale.

Deep knowledge of CI/CD, SDLC practices, and strong English communication in an Agile environment are required to drive pragmatic data solutions.