Senior Data Engineer | GCP Pipelines & Terraform

EPAM Systems; Georgia; On-site; USD 46,000 - 69,000; Full time

Benefits offered by this job

Remote work from Georgia

Relocation support

Career development programs

Stock Purchase Plan

Medical & family care

English language classes

Job summary

EPAM Georgia is seeking an experienced Lead Data Engineer to design and maintain scalable data solutions on Google Cloud Platform. You will lead data pipelines, drive infra automation, and DevOps practices while mentoring teammates.

Key requirements include 5+ years with SQL and Python, GCP expertise (BigQuery/Dataflow/Dataform/dbt), and proficiency in Cloud Composer/Airflow, Pub/Sub, Terraform and GitHub Actions. English at B2+ is expected.

Qualifications

• 5+ years of hands-on experience with SQL and Python.
• Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt.
• Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage.
• Skills in DevOps practices including CI/CD, GitHub Actions and Terraform.
• Good verbal and written communication skills.
• Good business acumen.
• English proficiency at B2 level or higher.

Responsibilities

• Design and build scalable data pipelines using GCP services.
• Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt.
• Orchestrate workflows with Cloud Composer/Airflow.
• Manage real-time data streaming through Pub/Sub and Cloud Storage.
• Implement infrastructure as code using Terraform.
• Establish and maintain CI/CD pipelines with GitHub Actions.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Ensure data quality, reliability and performance across all systems.
• Mentor team members and promote engineering best practices.

Skills

SQL

Python

GCP

Airflow

Terraform

GitHub Actions

BigQuery

Dataflow

Dataform/dbt

Pub/Sub

CI/CD

Tools

BigQuery

Dataflow

Dataform/dbt

Cloud Composer/Airflow

Pub/Sub

Cloud Storage

Terraform

GitHub Actions

Job description

EPAM Georgia is seeking an experienced Lead Data Engineer to design and maintain scalable data solutions on Google Cloud Platform. You will lead data pipelines, drive infra automation, and DevOps practices while mentoring teammates.

Key requirements include 5+ years with SQL and Python, GCP expertise (BigQuery/Dataflow/Dataform/dbt), and proficiency in Cloud Composer/Airflow, Pub/Sub, Terraform and GitHub Actions. English at B2+ is expected.