Senior GCP Data Engineer

eClerx; Navi Mumbai, Pune District; On-site; INR 4,200,000 - 6,500,000; Full time

Job summary

eClerx is seeking an experienced Senior Data Engineer to design, build, and manage complex data architectures and BI solutions in Navi Mumbai. You will drive end-to-end data strategy, optimize workflows, and mentor junior team members.

The role emphasizes hands-on work with SQL, Snowflake, Looker, and GCP, along with strong stakeholder management and a focus on cost efficiency and performance optimization.

Qualifications

• Bachelor's degree in data science, computer science or similar majors with a GPA of at least 3.0 or equivalent experience
• 7+ years of experience in Data Engineering
• 7+ years of experience in at least one OOP language, preferably Python
• Deep SQL knowledge / experience
• Experience in complex pipeline task management (i.e., Airflow and Beam)
• Experience building Data Models
• Experience with Github
• Google Cloud Platform tools or equivalent platform experience using tools s/a BigQuery, Dataflow / Apache Beam, Cloud Composer / Airflow, Pub/Sub, Apache Spark
• Experience using DBT
• Experience with Scalr/Terraform
• Experience with CI/CD
• Experience with marketing technologies like a CDP (Customer Data Platform) and SFMC (Salesforce Marketing Cloud)

Responsibilities

• Build, maintain and optimize data pipelines for our Enterprise Data Platform using Google Cloud Platform technologies.
• Ingest new data sources from initial discovery & data architecture, through ETL authoring, operationalizing using Dataflow, Airflow (Cloud Composer) DAGs, and post launch lifecycle.
• Research and test new big-data technologies and tools.
• Advanced SQL queries, and modeling.
• Engage vendors with required features to meet business needs.
• Leverage the full value of our vendor integrations and APIs.
• Optimize BigQuery and ETL resources to decrease spend & increase performance.

Skills

Data Engineering

Python

SQL

Airflow

Apache Beam

Data Modeling

GitHub

Education

Bachelor's degree (Data Science / CS)

Tools

Snowflake

Looker

Google Cloud Platform

BigQuery

Dataflow

Cloud Composer / Airflow

Pub/Sub

Apache Spark

DBT

Terraform

CI/CD

Job description

We are looking for an experienced Senior Data Engineer of hands-on experience in designing, building, and managing complex data architectures and BI solutions. The ideal candidate will have deep expertise in SQL, Snowflake, Looker, and Google Cloud Platform (GCP), paired with strong analytical and stakeholder management skills. This role will involve driving end-to-end data strategy, optimizing data workflows, and mentoring junior team members.

Key Responsibilities:

Responsibilities

• Build, maintain and optimize data pipelines for our Enterprise Data Platform using Google Cloud Platform technologies.
• Ingest new data sources from initial discovery & data architecture, through ETL authoring, operationalizing using Dataflow, Airflow (Cloud Composer) DAGs, and post launch lifecycle.
• Research and test new big-data technologies and tools.
• Advanced SQL queries, and modeling.
• Engage vendors with required features to meet business needs.
• Leverage the full value of our vendor integrations and APIs.
• Optimize BigQuery and ETL resources to decrease spend & increase performance.

Minimum Qualifications

• Bachelors degree in data science, computer science or similar majors with a GPA of at least 3.0 or equivalent experience
• 7+ years of experience in Data Engineering
• 7+ years of experience in at least one OOP language, preferably Python
• Deep SQL knowledge / experience
• Experience in complex pipeline task management (i.e., Airflow and Beam)
• Experience building Data Models
• Experience with Github

Desired Qualifications

• Google Cloud Platform tools or equivalent platform experience using tools s/a BigQuery, Dataflow / Apache Beam, Cloud Composer / Airflow, Pub/Sub, Apache Spark
• Experience using DBT
• Experience with Scalr/Terraform
• Experience with CI/CD
• Experience with marketing technologies like a CDP (Customer Data Platform) and SFMC (Saleforce Marketing Cloud)