Tech Lead

Saama; Chennai; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

A leading data solutions company in Tamil Nadu, India, is searching for a Google Cloud Lead Data Engineer to build robust data integration pipelines. The role demands designing and developing scalable data pipelines on Google Cloud Platform (GCP) while ensuring data quality and governance. Ideal candidates have strong programming skills in PySpark and Python, along with experience in SQL and GCP services like BigQuery and Dataflow. Competitive pay and opportunities for professional growth are offered.

Qualifications

• Proven experience as a Data Engineer focused on Google Cloud Platform (GCP).
• Strong programming skills in PySpark, Python, and similar languages.
• Experience with SQL and relational databases.

Responsibilities

• Design, develop, and maintain scalable data pipelines on GCP.
• Implement data processing solutions using various GCP services.
• Optimize data processing and storage for performance and cost.

Skills

Data integration pipelines

Google Cloud Platform (GCP)

PySpark

Python

SQL

Data modeling

ETL processes

Problem-solving skills

Communication skills

Tools

BigQuery

Dataproc

Dataflow

Pub/Sub

Cloud Storage

Cloud Functions

GitHub

Job description

Overview

We are looking for a Google Cloud Lead Data Engineer. They will be responsible for building solid data integration pipelines by integrating various source data to enable near real-time data delivery using next-gen technologies.

Responsibilities

• Design, develop, and maintain scalable data pipelines on Google Cloud Platform (GCP).
• Implement data processing solutions using GCP services such as BigQuery, Python, Dataproc, Dataflow, Pub/Sub, Cloud Storage, Cloud Function and other GCP services.
• Optimize data processing and storage for performance, cost, and scalability in GCP BigQuery.
• Ensure data quality and integrity by implementing best practices for data governance and monitoring.
• Develop and maintain documentation for data pipelines and ETL pipeline processes.
• Stay up-to-date with the latest advancements in data engineering and GCP technologies.

Qualifications

• Proven experience as a Data Engineer with a focus on Google Cloud Platform (GCP).
• Strong programming skills in PySpark and Python and additional similar languages.
• Experience with SQL and relational databases.
• Familiarity with data modeling, ETL processes, and data warehousing concepts.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.

Preferred Skills

• BigQuery, Python, Dataproc, Dataflow, Pub/Sub, Cloud Composer/Airflow, Github
• Google Cloud Data Engineer certification is a good to have.
• A solid grip over programming languages, like Python, Scala, C++, etc.
• In-depth knowledge about SQL databases and ability to execute queries quickly.
• Knowledge of data warehousing and data modeling.
• Fundamentals of Google Kubernetes Engine to design and develop microservices for real-time data feeds.
• Conducting end-to-end analyses, including data collection, processing, and analysis.