Lead Data Engineer with Terraform

EPAM Systems; Turkey; Hybrid; TRY 4,442,000 - 6,417,000; Full time

Benefits offered by this job

Private health insurance

Continuous upskilling

English courses

Extra leave days

Referral bonuses

Job summary

EPAM Systems is seeking an experienced Lead Data Engineer with Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. You will lead the development of robust data pipelines, drive infrastructure automation and DevOps practices, and mentor the team to uphold engineering standards.

Responsibilities include building data pipelines with BigQuery and Dataflow, orchestrating workflows with Airflow, managing real-time streams via Pub/Sub, and implementing

Qualifications

• 5+ years of hands-on experience with SQL and Python.
• Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt.
• Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage.
• Skills in DevOps practices including CI/CD, GitHub Actions and Terraform.
• Good verbal and written communication skills.
• Good business acumen.
• English proficiency at B2 level or higher.

Responsibilities

• Design and build scalable data pipelines using GCP services.
• Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt.
• Orchestrate workflows with Cloud Composer/Airflow.
• Manage real-time data streaming through Pub/Sub and Cloud Storage.
• Implement infrastructure as code using Terraform.
• Establish and maintain CI/CD pipelines with GitHub Actions.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Ensure data quality, reliability and performance across all systems.
• Mentor team members and promote engineering best practices.

Skills

SQL

Python

GCP

Airflow

Terraform

CI/CD

GitHub Actions

Communication

English (B2+)

Tools

BigQuery

Dataflow

Dataform/dbt

Cloud Composer

Pub/Sub

Cloud Storage

Job description

We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes.

Responsibilities

• Design and build scalable data pipelines using GCP services
• Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt
• Orchestrate workflows with Cloud Composer/Airflow
• Manage real-time data streaming through Pub/Sub and Cloud Storage
• Implement infrastructure as code using Terraform
• Establish and maintain CI/CD pipelines with GitHub Actions
• Collaborate with stakeholders to translate business requirements into technical solutions
• Ensure data quality, reliability and performance across all systems
• Mentor team members and promote engineering best practices

Requirements

• 5+ years of hands-on experience with SQL and Python
• Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt
• Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage
• Skills in DevOps practices including CI/CD, GitHub Actions and Terraform
• Good verbal and written communication skills
• Good business acumen
• English proficiency at B2 level or higher

Nice to have

• Google Cloud Professional Data Engineer Certified
• Familiarity with Data Lake technologies such as Iceberg
• Knowledge of CDC using Datastream
• Understanding of Dataplex, Knowledge Catalog and Analytics Hub
• Competency in Looker

We offer

• CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
  • Diversity of tasks and projects
  • Assessment center for objective review of competency level
  • Personal development plan
  • Mentoring programs and leadership development
  • Certification and professional development support
  • Access to learning platforms including more than 2,500 internal courses
  • English courses taught by certified teachers
• CORPORATE BENEFITS
  • Extra leave days
  • Referral bonuses
• COMPENSATION PACKAGE
  • Competitive compensation paid in USD
  • Regular salary and performance reviews
• MEDICAL & HEALTHCARE
  • Private health insurance
  • Well-being events
• WORKING ENVIRONMENT
  • Recreation areas and kitchens
  • Tea, coffee and snacks
  • Sports equipment and game consoles
  • IT Equipment
  • Microsoft’s Software Assurance Home Use Program (HUP)

Please note that our Talent Attraction Team reviews applications and CVs submitted in English.

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.