Data Specialist - R01569531

Brillio 2; Hyderabad; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Brillio 2 seeks an experienced GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform in Bangalore.

The candidate will have hands-on experience with GCP Data Engineering, BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL, and will collaborate with Data Scientists, Analysts, and stakeholders to deliver robust cloud data platforms.

Qualifications

• Experience designing and developing scalable ETL/ELT data pipelines on cloud platforms.
• Hands-on expertise with Python, PySpark, and SQL for data processing and analysis.
• Strong knowledge of data warehousing concepts, data modelling, and governance on clouds.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Develop data processing applications using Python, PySpark, and SQL.
• Perform data ingestion, transformation, cleansing, and validation.
• Design efficient data models and data warehouse solutions in BigQuery.
• Implement batch and real-time data processing pipelines.
• Optimize pipeline performance and BigQuery queries for scalability and cost efficiency.
• Integrate data from multiple sources into cloud-based data platforms.
• Implement data quality, security, monitoring, and governance practices.
• Work closely with Data Scientists, Architects, Analysts, and business stakeholders.
• Support cloud migration and modernization initiatives.

Skills

ETL design

Python

PySpark

SQL

Data warehousing

GCP data engineering

Tools

BigQuery

Dataflow

Dataproc

Cloud Storage

Pub/Sub

Job description

GCP Data Engineer-

Location : Bangalore

Experience : +6yrs

About the Role

We are looking for an experienced GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform.

The ideal candidate should have strong hands-on experience in GCP Data Engineering, BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL, along with good knowledge of data warehousing and ETL processes.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Develop data processing applications using Python, PySpark, and SQL.
• Perform data ingestion, transformation, cleansing, and validation.
• Design efficient data models and data warehouse solutions in BigQuery.
• Implement batch and real-time data processing pipelines.
• Optimize pipeline performance and BigQuery queries for scalability and cost efficiency.
• Integrate data from multiple sources into cloud-based data platforms.
• Implement data quality, security, monitoring, and governance practices.
• Work closely with Data Scientists, Architects, Analysts, and business stakeholders.
• Support cloud migration and modernization initiatives.

Azure Data Engineering Advanced: Senior Data Engineer