Data Specialist - R01569531

Brillio; Hyderabad; On-site; INR 2,500,000 - 4,500,000; Full time

Job summary

Brillio in Bangalore is seeking an experienced GCP Data Engineer to design, develop, and optimize scalable data pipelines on Google Cloud Platform. The role requires hands-on work with GCP Data Engineering tools and SQL-based data warehousing.

The ideal candidate will contribute to data ingestion, processing, and governance while collaborating with data scientists and stakeholders to drive cloud modernization initiatives.

Qualifications

• Experience designing and developing scalable data pipelines on GCP.
• Strong knowledge of data warehousing, ETL/ELT processes, and SQL.
• Hands-on experience with BigQuery, Dataflow and Dataproc.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Develop data processing apps using Python, PySpark, and SQL.
• Perform data ingestion, transformation, cleansing, and validation.
• Design data models and data warehouse solutions in BigQuery.
• Implement batch and real-time data processing pipelines.
• Optimize pipeline performance and BigQuery queries for scalability and cost efficiency.
• Integrate data from multiple sources into cloud-based data platforms.
• Implement data quality, security, monitoring, and governance practices.
• Work with Data Scientists, Architects, Analysts, and business stakeholders.
• Support cloud migration and modernization initiatives.

Skills

ETL pipeline design

Data pipeline design

Cloud data engineering

Python

PySpark

SQL

Tools

BigQuery

Dataflow

Dataproc

Cloud Storage

Pub/Sub

Job description

GCP Data Engineer-

Location : Bangalore

Experience : +6yrs

About the Role

We are looking for an experienced GCP Data Engineer to design, develop, and optimize scalable data pipelines and cloud-based data solutions on Google Cloud Platform.

The ideal candidate should have strong hands-on experience in GCP Data Engineering, BigQuery, Dataflow, Dataproc, Python/PySpark, and SQL, along with good knowledge of data warehousing and ETL processes.

Primary Skills

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and optimize data solutions using BigQuery, Dataflow, Dataproc, Cloud Storage, and Pub/Sub.
• Develop data processing applications using Python, PySpark, and SQL.
• Perform data ingestion, transformation, cleansing, and validation.
• Design efficient data models and data warehouse solutions in BigQuery.
• Implement batch and real-time data processing pipelines.
• Optimize pipeline performance and BigQuery queries for scalability and cost efficiency.
• Integrate data from multiple sources into cloud-based data platforms.
• Implement data quality, security, monitoring, and governance practices.
• Work closely with Data Scientists, Architects, Analysts, and business stakeholders.
• Support cloud migration and modernization initiatives.

Specialization

• Azure Data Engineering Advanced: Senior Data Engineer