Lead Data Engineer with Terraform

EPAM Systems, Inc.; Turkey; On-site; TRY 5,897,000 - 7,862,000; Full time

Job summary

EPAM Systems, Inc. is seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform.

You will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes. Design and build scalable data pipelines using GCP services, lead data solutions leveraging BigQuery, Dataflow and Dataform/dbt, orchestrate workflows with Cloud Composer/Airflow, and

Qualifications

• 5+ years of hands-on experience with SQL and Python.
• Expertise in GCP services including BigQuery, Dataflow and Dataform/dbt.
• Proficiency in Cloud Composer/Airflow, Pub/Sub and Cloud Storage.
• DevOps practices including CI/CD, GitHub Actions and Terraform.
• Good verbal and written communication skills.
• English proficiency at B2 level or higher.
• Nice to have Google Cloud Professional Data Engineer Certification.
• Familiarity with Data Lake technologies such as Iceberg.
• Knowledge of CDC using Datastream.
• Understanding of Dataplex, Knowledge Catalog and Analytics Hub.
• Competency in Looker.

Responsibilities

• Design and build scalable data pipelines using GCP services.
• Lead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbt.
• Orchestrate workflows with Cloud Composer/Airflow.
• Manage real-time data streaming through Pub/Sub and Cloud Storage.
• Implement infrastructure as code using Terraform.
• Establish and maintain CI/CD pipelines with GitHub Actions.
• Collaborate with stakeholders to translate business requirements into technical solutions.
• Ensure data quality, reliability and performance across all systems.
• Mentor team members and promote engineering best practices.

Skills

SQL

Python

GCP

Airflow

Terraform

GitHub Actions

CI/CD

Pub/Sub

Dataflow

Dataform/dbt

Datastream

Iceberg

Dataplex

Looker

BigQuery

Cloud Composer

Tools

BigQuery

Dataflow

Dataform/dbt

Cloud Composer

Airflow

Pub/Sub

Datastream

Dataplex

Iceberg

Looker

Job description

We are seeking an experienced Lead Data Engineer with strong Terraform expertise to design, build and maintain scalable data solutions on Google Cloud Platform. In this role, you will lead the development of robust data pipelines while driving best practices across infrastructure automation and DevOps processes.ResponsibilitiesDesign and build scalable data pipelines using GCP servicesLead the development of data solutions leveraging BigQuery, Dataflow and Dataform/dbtOrchestrate workflows with Cloud Composer/AirflowManage real-time data streaming through Pub/Sub and Cloud StorageImplement infrastructure as code using TerraformEstablish and maintain CI/CD pipelines with GitHub ActionsCollaborate with stakeholders to translate business requirements into technical solutionsEnsure data quality, reliability and performance across all systemsMentor team members and promote engineering best practicesRequirements5+ years of hands-on experience with SQL and PythonExpertise in GCP services including BigQuery, Dataflow and Dataform/dbtProficiency in Cloud Composer/Airflow, Pub/Sub and Cloud StorageSkills in DevOps practices including CI/CD, GitHub Actions and TerraformGood verbal and written communication skillsGood business acumenEnglish proficiency at B2 level or higherNice to haveGoogle Cloud Professional Data Engineer CertifiedFamiliarity with Data Lake technologies such as IcebergKnowledge of CDC using DatastreamUnderstanding of Dataplex, Knowledge Catalog and Analytics HubCompetency in LookerWe offerCONTINUOUS UPSKILLING, LEARNING & DEVELOPMENTDiversity of tasks and projectsAssessment center for objective review of competency levelPersonal development planMentoring programs and leadership developmentCertification and professional development supportAccess to learning platforms including more than 2,500 internal coursesEnglish courses taught by certified teachersCORPORATE BENEFITSExtra leave daysReferral bonusesCOMPENSATION PACKAGECompetitive compensation paid in USDRegular salary and performance reviewsMEDICAL & HEALTHCAREPrivate health insuranceWell-being eventsWORKING ENVIRONMENTRecreation areas and kitchensTea, coffee and snacksSports equipment and game consolesIT EquipmentMicrosoft’s Software Assurance Home Use Program (HUP)Please note that our Talent Attraction Team reviews applications and CVs submitted in English.EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.