Event Streaming Developer

Burns & McDonnell

Bengaluru

On-site

INR 3,000,000 - 6,000,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Burns & McDonnell in Bengaluru seeks a senior data engineer with an architecture mindset to design scalable data pipelines on Google Cloud and deliver end-to-end production solutions. You will own ingestion, storage, and transformation for enterprise data products.

Responsibilities include building production pipelines from source systems to GCS/BigQuery, applying CIM patterns, and ensuring reliability, cost controls, and security across platforms.

Qualifications

  • 7-10 years of work experience in data engineering.
  • Experience designing scalable data platforms on Google Cloud.

Responsibilities

  • Architect end-to-end data platform solutions from source to data product delivery.
  • Personally build and ship production pipelines, from commit to deployment and monitoring.
  • Apply Google Cloud AI services and LLMs to extract structured data from unstructured content.

Skills

Architecture mindset
Production engineering
Google Cloud Platform
Data modeling
SQL & Python

Education

BCA / MCA / B.Tech in IT

Tools

BigQuery
Dataflow / Apache Beam
Cloud Composer / Airflow
Cloud Storage / GCS
Vertex AI

Job description

Google Cloud Architecture Mindset Hands-On Pipeline & Production Builder

Experience Required 7-10 years

We are building a central Data Engineering team responsible for ingesting data from enterprise source systems and engineering applications — including Oracle, CRM platforms, and internal engineering tools — loading it into our data platform and delivering foundational data products that serve Group Practices across the firm. We're looking for a senior engineer who combines an architecture mindset with deep hands-on experience — someone who can design scalable systems and personally build and ship them into production. You will own pipelines end-to-end, from whiteboard to running code, on Google Cloud.

What You'll Do
Architecture & Design
  • Architect end-to-end data platform solutions: from source system connectivity through ingestion, storage, transformation, and data product delivery — making deliberate decisions on scalability, cost, and maintainability.
  • Define reference architectures and reusable patterns: for pipelines, storage layout, IAM boundaries, and CIM modeling that the whole engineering team builds from.
  • Evaluate and select Google Cloud services: for each workload: streaming vs. batch, event-driven vs. scheduled, structured vs. unstructured.
  • Translate business requirements: from Portfolio Data Managers and domain data owners into clear, implementable technical designs.
Hands-On Pipeline & Production Engineering
  • Personally build and ship production pipelines: this role codes, not just designs. You will own your work from first commit through deployment, monitoring, and ongoing reliability.
  • Build end-to-end ingestion pipelines: from source systems (Oracle, CRM, engineering applications) into Google Cloud Storage and BigQuery.
  • Build multimodal unstructured data processing workflows: handling PDFs, Excel, PowerPoint, audio recordings, video files, and engineering drawings.
  • Apply Google Cloud AI services: Document AI, Speech-to-Text, Video Intelligence, Vision API, Vertex AI — to extract structured information from unstructured content and ship results to production datasets.
  • Use LLMs: to classify, summarize, and transform unstructured text and documents into structured, queryable data products.
  • Build and maintain Common Information Model (CIM) semantic layers: aligning ingested data with business-domain meaning across Group Practices.
  • Design and manage Google Cloud Storage buckets: lifecycle policies, folder structure, access controls, and cost optimization.
  • Configure and enforce Google Cloud IAM: service accounts, role bindings, workload identity, and least-privilege policies across all platform resources.
  • Write observability into every pipeline: logging, alerting, data quality checks, and SLA monitoring from day one.
Required Skills
Architecture Mindset & Production Engineering
  • Proven record of designing systems and then personally building them for production, not delegating implementation after the whiteboard session.
  • Architecture trade-off decisions: streaming vs. batch, managed vs. custom, normalized vs. denormalized — and the ability to explain the reasoning clearly.
  • Reliability patterns: idempotency, dead-letter queues, retry logic, schema evolution, and data quality gates.
  • Technical design documents that a team can build from, and are equally comfortable writing the code.
Google Cloud Platform
  • BigQuery
  • Cloud Storage (GCS)
  • Cloud IAM
  • Dataflow / Apache Beam
  • Cloud Composer / Airflow
  • Pub/Sub
  • Vertex AI
  • Cloud Functions / Run
Unstructured Data & AI Transformation
  • Google Document AI
  • Speech-to-Text API
  • Video Intelligence API
  • Vision API / OCR
  • PDF & Office file parsing
  • Audio processing
  • Engineering drawing extraction
  • LLM-based data extraction
Data Engineering Fundamentals
  • Python
  • SQL (BigQuery dialect)
  • dbt
  • ELT / ETL pipeline design
  • Data modeling
  • Git / CI-CD
  • Terraform / IaC
Security & Governance
  • Google Cloud IAM: service accounts, custom roles, workload identity federation, least-privilege design across projects and datasets.
  • GCS access controls: uniform bucket-level access, IAM conditions, VPC Service Controls, audit logging.
Data Modeling & CIM
  • Common Information Model (CIM): experience building CIM semantic layers — ideally in energy, utilities, or infrastructure domains (IEC 61968 / 61970).
  • Source-aligned data products: faithful to source systems, enriched with business-domain meaning ("zero layer").
  • Dimensional modeling: medallion architecture (bronze / silver / gold), and structuring data for downstream BI and AI consumers.

The candidate should have a BCA / MCA / B.TECH degree in Information Technology. The candidate should have a work experience of 7-10 years.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Cloud Platform Engineer
Cloud Platform Engineer

Accenture PLC • Navi Mumbai

On-site
INR 3,500,000 - 5,500,000
Data Architect
Data Architect

Kanini Software Solutions • Pune District, Chennai, Bengaluru

Hybrid
INR 2,500,000 - 4,200,000
Data Engineer - GCP
Data Engineer - GCP

Dentsu International Americas • Pune District

On-site
INR 1,200,000 - 2,500,000
Custom Software Engineer
Custom Software Engineer

Hackajob • Hyderabad, Pune District, Bengaluru

Hybrid
INR 2,500,000 - 4,200,000
Senior Consultant - Cloud Data Engineer
Senior Consultant - Cloud Data Engineer

enGen Global • Chennai District

On-site
INR 3,500,000 - 7,000,000
Google Cloud Data Engineer
Google Cloud Data Engineer

Cloudnyx.ai • Pune District

On-site
INR 1,800,000 - 2,800,000
Senior Group Technical Architect
Senior Group Technical Architect

HCLTech • Bengaluru

On-site
INR 4,000,000 - 7,000,000
Data Engineer-Data Platforms-Google
Data Engineer-Data Platforms-Google

codingcircle • Bengaluru

Hybrid
INR 600,000 - 900,000
Senior Data Engineer - GCP
Senior Data Engineer - GCP

AuxoAI Inc. • Bengaluru

On-site
INR 1,200,000 - 2,000,000
GCP Data Architect - S
GCP Data Architect - S

Tata Consultancy Services Limited • Chennai

On-site
INR 4,000,000 - 6,000,000