Senior Data Platform Engineer - Airflow, Snowflake, AI

EPAM Systems; Turkey; On-site; TRY 4,442,000 - 6,417,000; Full time

Benefits offered by this job

Private health insurance

English courses

Continuous upskilling

Referral bonuses

Learning platforms with 2,500+ courses

Mentoring programs

Job summary

EPAM Systems seeks a Senior Data Software Engineer to implement monitoring, incident management, and operational capabilities for an automated Data Platform Monitoring solution. You will design robust monitoring rules and operator health views to ensure reliability of data products and pipelines.

Role involves integrating monitoring data with Snowflake and other components, developing automation with Jira, and continuously improving monitoring logic.

Qualifications

• 3+ years of experience in data engineering roles.
• Expertise in Apache Airflow, Snowflake, and dbt.
• Experience building and maintaining data pipelines and monitoring data platforms.
• Experience with incident automation and Jira integration.
• English proficiency at an Upper-Intermediate level (B2) or higher.

Responsibilities

• Implement monitoring rules for data pipeline health, freshness, volume, run outcomes, and other objectives.
• Develop data processing and transformation logic for monitoring events and operational data.
• Build automated Jira incident creation based on detected monitoring events.
• Ensure incidents contain component, region, DAG/job, run, timestamp, detecting check, error reference, and severity.
• Support incident recurrence handling, stakeholder notification, and monitoring of incident status.
• Develop and maintain the operator workspace/health view for monitoring data products and pipeline status.
• Enable integration of monitoring data with Snowflake and other components of the solution.
• Participate in testing monitoring rules and incident automation against real and historical failures.
• Troubleshoot issues, improve monitoring logic, and support solution handover.

Skills

Airflow

Snowflake

dbt

Data pipelines

Monitoring

Incident automation

Jira integration

AI capabilities

English (B2+)

Tools

Jira

Snowflake

dbt

Apache Airflow

Job description

EPAM Systems seeks a Senior Data Software Engineer to implement monitoring, incident management, and operational capabilities for an automated Data Platform Monitoring solution. You will design robust monitoring rules and operator health views to ensure reliability of data products and pipelines.

Role involves integrating monitoring data with Snowflake and other components, developing automation with Jira, and continuously improving monitoring logic.