Senior Data Integration Engineer

EPAM Systems, Inc.; Turkey; On-site; TRY 450,000 - 750,000; Full time

Benefits offered by this job

Private health insurance

Well-being events

IT equipment provided

Job summary

EPAM Systems, Inc. seeks a Senior Data Integration Engineer to design and optimize scalable ETL/ELT pipelines using Python, PySpark, and SQL within cloud environments.

You will build robust data products, orchestrate complex workflows with Airflow, and implement lakehouse architectures across Snowflake, Synapse, or Redshift. You will ensure data quality with dbt/Soda and lead CI/CD practices, collaborating with product, engineering, and architecture teams to deliver reliable, scalable data

Qualifications

• 5+ years of hands-on experience in data engineering, data warehousing, database design, and end-to-end data integration.
• Advanced knowledge of cloud data integration tools (ADF, Glue, Dataflow).
• Proficiency in SQL (advanced optimization), Python, and PySpark / Apache Spark.
• Experience with high-performance databases and cloud-native systems (Snowflake, ClickHouse, Azure Synapse, PostgreSQL, MS SQL Server).
• Familiarity with CDC or real-time streaming tools (Kafka, Debezium).
• Strong communication skills in English; ability to articulate complex ideas to stakeholders.

Responsibilities

• Design, build, and optimize scalable batch and near-real-time ETL/ELT pipelines using Python, PySpark, SQL and cloud integration engines.
• Develop and manage complex workflow orchestrations (Airflow or cloud schedulers) and automate ingestion routines.
• Design and implement modern data warehouse/lakehouse layers (Snowflake, Synapse, Redshift) with optimal partitioning and SCD2 patterns.
• Establish data quality checks and validation frameworks (dbt, Soda, PySpark tests).
• Collaborate with product owners and architects to define data requirements and STTM mappings; document data dictionaries.
• Maintain a clean code repository, lead code reviews, and configure CI/CD pipelines (Azure DevOps, GitLab CI, GitHub Actions) with Docker.

Skills

SQL

Python

PySpark

Airflow

CI/CD

Git

Snowflake

Azure Synapse

Kafka

dbt

Docker

Kubernetes

English

CDC

Tools

Azure Data Factory

AWS Glue

GCP Dataflow

dbt

Job description

We are seeking a highly skilled, solution-oriented Senior Data Integration Engineer with deep expertise in modern data engineering, cloud-native architectures, and robust pipeline development.In this role, you will be a senior technical driver in creating, optimizing, and modernizing advanced data integration systems. You will collaborate closely with product, engineering, and architecture teams to bridge raw source environments and analytical databases. If you excel in cloud ecosystems, thrive on automating complex data workflows, and value precision, reliability, and data quality above all, we encourage you to apply!ResponsibilitiesDesign, build, and optimize scalable, reliable batch and near-real-time ETL/ELT pipelines using Python, PySpark, SQL, and modern cloud integration enginesDevelop and manage complex workflow orchestrations (using Apache Airflow or cloud native schedulers) and automate ingestion routines to minimize manual operationsDesign and implement modern data warehouse/lakehouse layers (using Snowflake, ClickHouse, Azure Synapse, or Redshift), establishing optimal partitioning, indexing, and Slowly Changing Dimension (SCD Type 2) patternsEstablish rigorous data quality checks and validation frameworks utilizing tools like dbt (data build tool), Soda, or customized PySpark testing suitesWork closely with product owners, business analysts, and systems architects to define data requirements, analyze technical constraints, design Source-to-Target Mappings (STTM), and make critical architectural decisionsMaintain a clean, modular code repository. Lead code reviews, enforce engineering standards, and configure robust CI/CD pipelines (Azure DevOps, GitLab CI, or GitHub Actions) with Docker containersDeliver comprehensive, clear technical specs, metadata lineage documentation, architectural diagrams, and data dictionariesRequirements5+ years of hands-on experience in data engineering, data warehousing, database design, and end-to-end data integrationAdvanced knowledge of Cloud Integration tools such as Azure Data Factory (ADF), AWS Glue, or GCP DataflowProficiency in workflow orchestrators like Apache Airflow and exposure to CDC (Change Data Capture) or real-time streaming tools (e.g., Kafka, Debezium)Strong production-level coding skills in SQL (advanced optimization/stored procedures), Python, and PySpark / Apache SparkExperience working with high-performance databases and cloud-native systems (e.g., Snowflake, ClickHouse, PostgreSQL, MS SQL Server, or Azure Synapse)Master-level understanding of data modeling practices (OLAP, OLTP, Star/Snowflake schemas, Delta Lake/Lakehouse patterns, and Data staging processes)Hands-on experience with version control (Git) and building automated deployment pipelines (CI/CD) for data productsProven ability to articulate complex technical ideas clearly to both business stakeholders and developersFluency in English (Upper-Intermediate level or higher)Nice to haveDeep knowledge of dbt (data build tool) and schema validation practicesExperience using Docker or Kubernetes to package and deploy data applicationsExperience building lightweight, serverless ingestion services (e.g., using AWS Lambda / Azure Functions and RESTful APIs)We offerCONTINUOUS UPSKILLING, LEARNING & DEVELOPMENTDiversity of tasks and projectsAssessment center for objective review of competency levelPersonal development planMentoring programs and leadership developmentCertification and professional development supportAccess to learning platforms including more than 2,500 internal coursesEnglish courses taught by certified teachersCORPORATE BENEFITSExtra leave daysReferral bonusesCOMPENSATION PACKAGECompetitive compensation paid in USDRegular salary and performance reviewsMEDICAL & HEALTHCAREPrivate health insuranceWell-being eventsWORKING ENVIRONMENTRecreation areas and kitchensTea, coffee and snacksSports equipment and game consolesIT EquipmentMicrosoft’s Software Assurance Home Use Program (HUP)Please note that our Talent Attraction Team reviews applications and CVs submitted in English.EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.