Senior Data Engineer

Bureau; Bengaluru; On-site; INR 2,800,000 - 4,200,000; Full time

Benefits offered by this job

Health benefits

Flexible PTO

Learning budget

Potential equity

Job summary

Bureau is hiring a Senior Data Engineer in Bengaluru to design and own the data platform for fraud detection and identity intelligence at scale, across cloud data lake and lakehouse architectures.

You will build and operate scalable batch and streaming pipelines, ensure data quality and governance, and collaborate with data scientists, ML engineers, and product teams to deliver fast, reliable data for research, model training, and real-time decisioning; you will shape how a scaling global

Qualifications

• 4–8 years of hands-on big data engineering on cloud platforms (AWS preferred).
• Deep experience with data lake stacks: EMR, Spark, S3, Athena, and modern warehouses/lakehouses (ClickHouse, Databricks, Snowflake).
• Strong knowledge of OLAP vs OLTP and when to use each.
• Production experience with pipeline orchestration tools (Airflow or Astronomer).
• Experience building RESTful APIs and scalable data services with monitoring.
• Proficient in Python and/or Scala/Java with expert SQL.

Responsibilities

• Design and architect Bureau's cloud data lake and lakehouse as the source of truth for identity signals.
• Build and operate scalable batch and streaming pipelines ingesting data from diverse sources.
• Develop and maintain Airflow-based workflows powering research, reporting, ML training, and feature pipelines.
• Own reliability, observability, and cost-efficiency of production data infrastructure with SLAs.
• Collaborate with data science and ML teams to design feature stores and data pipelines.
• Champion data engineering best practices including data quality and schema governance.
• Contribute to graph-based fraud intelligence using graph databases.

Skills

4-8 years big data eng

AWS

Spark

EMR

S3

Athena

ClickHouse

Databricks

Snowflake

OLAP/OLTP

Airflow

Astronomer

Kubernetes

Kafka

RESTful APIs

Python/Scala/Java

SQL

Tools

Airflow orchestration

Kubernetes

Kafka

RDS

Job description

Bureau is a unified risk decisioning platform for Compliance, Fraud, and Transaction risks. Our platform is a single decision-making engine, powered by a 1 billion+ identity knowledge graph. Over 150 Banks, fintechs, retailers, and digital platforms use Bureau to verify identities faster and stop fraud earlier globally.

Bureau has raised $50M+ from renowned Silicon Valley and global investors including Sorenson Capital and PayPal Ventures and is expanding rapidly from APAC to Americas, Europe, and beyond.

Why Bureau?

Bureau is building the infrastructure that makes digital identities and transactions safe and trustworthy for billions of people. The mission is big, the problems are complex, and the impact is real.

We hire people who want that level of responsibility. People who move fast, build systems from scratch, and care deeply about turning strategy into execution. If you want predictability or narrow scope, this won't be your place. If you want to shape how a scaling global company operates—keep reading.

About the Role - Senior Data Engineer

As a Senior Data Engineer at Bureau, you will design and own the data platform that fuels our fraud detection and identity intelligence products. You'll work at serious scale, high-throughput streaming signals, a growing cloud data lake, and low-latency serving requirements where it directly impacts fraud detection.

You'll partner closely with data scientists, ML engineers, and product teams to make sure the right data is available, trustworthy, and fast, for research, reporting, model training, and real-time decisioning alike.

What You'll Do

• Design and architect Bureau's cloud data lake and lakehouse, the single source of truth for identity signals, risk events, and decision outcomes across all our products
• Build and operate scalable batch and streaming pipelines that ingest, clean, transform, and aggregate data from disparate sources, device SDKs, APIs, third-party data partners, and internal services
• Develop and maintain orchestration workflows (Airflow) that power research, reporting, compliance analytics, and ML model training and feature pipelines
• Own the reliability, observability, and cost-efficiency of production data infrastructure , with monitoring, alerting, and SLAs appropriate for a system that makes real-time risk decisions
• Collaborate with data science and ML teams to design feature stores and data pipelines that shorten the path from raw signal to deployed model
• Champion data engineering best practices, data quality, schema governance, testing, documentation, and mentor engineers across the team
• Contribute to graph-based fraud intelligence: modeling identity networks and fraud rings using graph databases

What You'll Bring

Must have

• 4-8 years of hands-on big data engineering experience (batch and streaming) on the cloud, ideally AWS
• Deep experience with the data lake stack: EMR, Spark, S3, Athena, and modern warehouses/lakehouses such as ClickHouse, Databricks, or Snowflake
• Strong grasp of both OLAP and OLTP systems, and when to use each
• Production experience with pipeline orchestration tools like Airflow or Astronomer
• Familiarity with the AWS and Kubernetes ecosystem, EMR on EKS / self-hosted K8s workloads, MSK/Kafka, and RDS
• Experience building RESTful APIs and architecting systems that serve both batch and real-time workloads, with solid monitoring and instrumentation practices
• Strong programming skills in Python and/or Scala/Java, plus expert-level SQL

Nice to have

• Graph database experience (Neo4j, TigerGraph, Amazon Neptune); we use graph technology to uncover fraud networks and hidden identity linkages
• Exposure to fraud detection, risk, identity, fintech, or other high-stakes real-time data domains
• Experience with data quality frameworks, data cataloging, or lakehouse table formats (Iceberg, Delta Lake, Hudi)
• Experience supporting ML platforms: feature stores, training pipelines, or model-serving data flows

Our Culture

We hire self-motivated people and get out of their way

We value performance, not hours worked

Speed, ownership, and impact matter most

Compensation

• Competitive salary + potential equity
• Health benefits, flexible PTO, learning budget