GCP(Big query + SQL) Data Engineer

Weekday (YC W21)

Chennai

On-site

INR 2,800,000 - 4,000,000

Full time

3 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Brillio is seeking a mid-senior data engineer to join its India-based team. You will develop scalable cloud-native data pipelines on GCP and work with BigQuery, DataFlow, Pub/Sub, and Airflow to design and run robust data platforms.

The role emphasizes production-grade Python/SQL coding, data quality controls, and cross-functional collaboration to deliver enterprise-scale data lakes and warehouses. Strong debugging and end-to-end pipeline experience are essential.

Qualifications

  • Hands-on experience with debugging/production issues.
  • Experience resolving data duplication or data quality issues.
  • End-to-end data pipeline creation and monitoring experience.

Responsibilities

  • Develop and maintain scalable, cloud-native data processing pipelines on GCP.
  • Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration.
  • Automate infrastructure using Terraform and follow agile development practices.
  • Implement data solutions for enterprise-scale data lakes and data warehouses.
  • Write clean, efficient, and production-ready code using Python and SQL.
  • Handle data quality issues including data duplication and debugging code failures.
  • Collaborate with cross-functional teams to build resilient and reliable data platforms.

Skills

Python
SQL
BigQuery
Apache Airflow
GCP
Data engineering

Tools

Terraform
DataFlow
Cloud Pub/Sub
Airflow

Job description

This role is for one of our clients

Industry: Artificial Intelligence

Company Name: Brillio

Seniority level: Mid-Senior Level

Min Experience: 5+ years

Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India

JobType: full-time

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Roles & Responsibilities:
  • Develop and maintain scalable, cloud-native data processing pipelines on GCP
  • Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
  • Automate infrastructure using Terraform and follow agile development practices
  • Implement data solutions for enterprise-scale data lakes and data warehouses
  • Write clean, efficient, and production-ready code using Python and SQL
  • Handle data quality issues including data duplication and debugging code failures
  • Collaborate with cross-functional teams to build resilient and reliable data platforms
Additional Screening Points:
  • Hands-on experience with debugging/analyzing production issues
  • Exposure to identifying and resolving data duplication or consistency issues
  • Should have worked on end-to-end data pipeline creation and monitoring
  • Experience in the data engineering field is preferred
  • Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
  • Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms
Hands On Strong Experience In The Below Technology
  • GBQ Query
  • Python
  • Apache Airflow
  • SQL (BigQuery preferred)
  • Extensive hands-on experience working with data using SQL and Python
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Pune

On-site
INR 1,200,000 - 2,400,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Hyderabad

On-site
INR 1,500,000 - 3,000,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Bengaluru

On-site
INR 1,400,000 - 2,200,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday • Pune District

On-site
INR 1,400,000 - 2,000,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday • Bengaluru

On-site
INR 1,400,000 - 2,000,000
GCP(Big query SQL) Data Engineer
GCP(Big query SQL) Data Engineer

VettedBench • India

On-site
INR 1,400,000 - 2,000,000
GCP Data Engineer
GCP Data Engineer

Infosys • Hyderabad, Pune District, Bengaluru

On-site
INR 900,000 - 1,800,000
GCP Data Engineer
GCP Data Engineer

ValueLabs • Hyderabad

On-site
INR 1,200,000 - 1,800,000
GCP Data Engineer (BiqQuery, Data Flow, DataProc, Data Fusion, TERRAFORM)
GCP Data Engineer (BiqQuery, Data Flow, DataProc, Data Fusion, TERRAFORM)

TekWissen India • Chennai District

Hybrid
INR 800,000 - 1,200,000
Senior Data Engineer - GCP
Senior Data Engineer - GCP

AuxoAI Inc. • Bengaluru

On-site
INR 1,200,000 - 2,000,000