Data Specialist

Jobtailor; Bengaluru; On-site; INR 1,500,000 - 2,400,000; Full time

Job summary

Jobtailor in Bengaluru, India, is seeking an experienced Data Engineer to design and develop scalable ETL/ELT data pipelines on GCP. You will build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub, and develop data processing apps with Python, PySpark, and SQL.

You will ingrain data quality, governance, and security practices, collaborate with data scientists, architects, analysts, and stakeholders, and support cloud migration and modernization

Qualifications

• 6+ years of experience in GCP Data Engineering.
• Strong hands-on experience with GCP Data Engineering.
• Experience with BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL.
• Good knowledge of data warehousing and ETL processes.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Develop data processing applications using Python, PySpark, and SQL.
• Perform data ingestion, transformation, cleansing, and validation.
• Design efficient data models and data warehouse solutions in BigQuery.
• Implement batch and real-time data processing pipelines.

Skills

GCP Data Engineering

ETL processes

Data Modeling

Data Warehousing

SQL

Python

PySpark

Data Ingestion

Data Transformation

Data Cleansing

Tools

BigQuery

Dataflow

Dataproc

Cloud Storage

Pub/Sub

Job description

• Design and develop scalable ETL/ELT data pipelines on GCP
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub
• Develop data processing applications using Python, PySpark, and SQL
• Perform data ingestion, transformation, cleansing, and validation
• Design efficient data models and data warehouse solutions in BigQuery
• Implement batch and real-time data processing pipelines
• Optimize pipeline performance and BigQuery queries for scalability and cost efficiency
• Integrate data from multiple sources into cloud-based data platforms
• Implement data quality, security, monitoring, and governance practices
• Work closely with Data Scientists, Architects, Analysts, and business stakeholders
• Support cloud migration and modernization initiatives

Requirements

• +6 years of experience in GCP Data Engineering
• Strong hands-on experience with GCP Data Engineering
• Experience with BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL
• Good knowledge of data warehousing and ETL processes

Core Competencies

Demonstrates extensive experience in designing and developing scalable ETL/ELT data pipelines on GCP, utilizing tools such as BigQuery and Dataflow. Proficient in data processing applications with Python, PySpark, and SQL, while ensuring data quality and governance.

Highest-signal resume keywords

• GCP Data Engineering
• BigQuery
• Dataflow
• Python
• ETL Processes

Hard Skills

• ETL
• ELT
• Data Processing
• Data Modeling
• Data Warehousing
• SQL
• PySpark
• Data Ingestion
• Data Transformation
• Data Cleansing

Soft Skills

• Collaboration
• Communication

Industry Keywords

• Data Governance
• Data Quality
• Cloud Migration
• Data Solutions
• Real-Time Processing

Tools & Technologies

• BigQuery
• Dataflow
• Dataproc
• Cloud Storage
• Pub/Sub