GCP(Big query + SQL) Data Engineer

Weekday (YC W21)

Bengaluru

On-site

INR 1,400,000 - 2,200,000

Full time

4 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Brillio is hiring a Mid-Senior Data Engineer to design and maintain scalable cloud-native data pipelines on GCP. You will work with BigQuery, DataFlow, Pub/Sub, and Airflow to build enterprise-grade data platforms and ensure robust data quality.

Role involves scripting in Python and SQL, collaborating across teams, and driving automation with Terraform. The candidate should have 5+ years of experience, hands-on data engineering expertise, and a solid understanding of data lakes and data

Qualifications

  • Experience building scalable data pipelines on cloud platforms.
  • Strong proficiency in Python and SQL for data processing.
  • Hands-on with BigQuery, Dataflow, Pub/Sub, and Airflow.
  • Experience with end-to-end data pipelines and data warehousing concepts.

Responsibilities

  • Develop and maintain scalable, cloud-native data processing pipelines on GCP
  • Work with BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
  • Automate infrastructure using Terraform and follow agile practices
  • Implement data solutions for data lakes and data warehouses
  • Write production-ready Python and SQL code and ensure data quality

Skills

Python
SQL
Apache Airflow
Data pipelines

Tools

BigQuery
Dataflow
Pub/Sub
Airflow
Terraform
Cloud Storage

Job description

This role is for one of our clients

Industry: Artificial Intelligence

Company Name: Brillio

Seniority level: Mid-Senior Level

Min Experience: 5+ years

Location: Bengaluru, Pune, Maharashtra, India, Hyderabad, Telangana, India, Chennai, Tamil Nadu, India

JobType: full-time

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses and identifying potential inconsistencies or verification signals in application materials based on available information. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

Roles & Responsibilities:
  • Develop and maintain scalable, cloud-native data processing pipelines on GCP
  • Work extensively on BigQuery, DataFlow, Pub/Sub, Cloud Storage, and Airflow for orchestration
  • Automate infrastructure using Terraform and follow agile development practices
  • Implement data solutions for enterprise-scale data lakes and data warehouses
  • Write clean, efficient, and production-ready code using Python and SQL
  • Handle data quality issues including data duplication and debugging code failures
  • Collaborate with cross-functional teams to build resilient and reliable data platforms
Additional Screening Points:
  • Hands-on experience with debugging/analyzing production issues
  • Exposure to identifying and resolving data duplication or consistency issues
  • Should have worked on end-to-end data pipeline creation and monitoring
  • Experience in the data engineering field is preferred
  • Hands-on experience in GCP cloud data implementation suite such as Bl Query, Pub Sub, Data Flow/Apache Beam Airflow/Composer, Cloud Storage
  • Strong experience and understanding of very large-scale data architecture, solutioning, and operationalization of data warehouses, data lakes, and analytics platforms
Hands On Strong Experience In The Below Technology
  • GBQ Query
  • Python
  • Apache Airflow
  • SQL (BigQuery preferred)
  • Extensive hands-on experience working with data using SQL and Python
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Chennai

On-site
INR 2,800,000 - 4,000,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Hyderabad

On-site
INR 1,500,000 - 3,000,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday (YC W21) • Pune

On-site
INR 1,200,000 - 2,400,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday • Pune District

On-site
INR 1,400,000 - 2,000,000
GCP(Big query + SQL) Data Engineer
GCP(Big query + SQL) Data Engineer

Weekday • Bengaluru

On-site
INR 1,400,000 - 2,000,000
GCP(Big query SQL) Data Engineer
GCP(Big query SQL) Data Engineer

VettedBench • India

On-site
INR 1,400,000 - 2,000,000
GCP Data Engineer
GCP Data Engineer

Infosys • Hyderabad, Pune District, Bengaluru

On-site
INR 900,000 - 1,800,000
GCP Data Engineer
GCP Data Engineer

ValueLabs • Hyderabad

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer - GCP
Senior Data Engineer - GCP

AuxoAI Inc. • Bengaluru

On-site
INR 1,200,000 - 2,000,000
Gcp Data Engineer
Gcp Data Engineer

IntraEdge Technology • Chennai District

Hybrid
INR 1,500,000 - 2,100,000
Hybrid work model