Senior Data Engineer

Bureau; Bengaluru; On-site; INR 2,000,000 - 4,000,000; Full time

Job summary

Bureau is seeking a Senior Data Engineer in Bengaluru to design and own the data platform powering our fraud detection and identity intelligence products. You will build scalable data pipelines, maintain a cloud data lake, and enable fast, trustworthy data for research, reporting, model training, and real-time decisions.

You will collaborate with data scientists and ML engineers to ensure data quality, governance, and feature pipelines, while mentoring the team and advancing graph-based fraud

Qualifications

• 4-8 years of hands-on big data engineering experience on the cloud (AWS preferred).
• Deep experience with the data lake stack: EMR, Spark, S3, Athena; modern warehouses/lakehouses.
• Strong understanding of OLAP vs OLTP systems and usage scenarios.
• Production experience with orchestration tools like Airflow or Astronomer.
• Familiarity with AWS and Kubernetes, EMR on EKS and Kafka/RDS.
• Experience building RESTful APIs serving batch and real-time workloads; solid monitoring.
• Strong programming in Python and/or Scala/Java; expert SQL.

Responsibilities

• Design and architect Bureau’s cloud data lake and lakehouse as a single source of truth.
• Build scalable batch and streaming pipelines ingesting from diverse sources and services.
• Develop and maintain Airflow workflows powering research, reporting, and ML pipelines.
• Own reliability, observability, and cost-efficiency of production data infra with SLAs.
• Collaborate with data science and ML teams to design feature stores and pipelines.
• Champion data engineering best practices, data quality, governance, and docs; mentor engineers.
• Contribute to graph-based fraud intelligence using graph databases.

Skills

Big data engineering

Python

Scala/Java

SQL

RESTful APIs

Cloud computing

Data modeling

Tools

AWS

EMR

Spark

S3

Athena

Databricks

Snowflake

Airflow

Kubernetes

Kafka

RDS

Neo4j

ClickHouse

Delta Lake

Iceberg

Hudi

Job description

Bureau is a unified risk decisioning platform for Compliance, Fraud, and Transaction risks. Our platform is a single decision-making engine, powered by a 1 billion+ identity knowledge graph. Over 150 Banks, fintechs, retailers, and digital platforms use Bureau to verify identities faster and stop fraud earlier globally.

Bureau has raised $50M+ from renowned Silicon Valley and global investors including Sorenson Capital and PayPal Ventures and is expanding rapidly from APAC to Americas, Europe, and beyond.

Why Bureau?

Bureau is building the infrastructure that makes digital identities and transactions safe and trustworthy for billions of people. The mission is big, the problems are complex, and the impact is real.

We hire people who want that level of responsibility. People who move fast, build systems from scratch, and care deeply about turning strategy into execution. If you want predictability or narrow scope, this won't be your place. If you want to shape how a scaling global company operates, keep reading.

About the Role - Senior Data Engineer

As a Senior Data Engineer at Bureau, you will design and own the data platform that fuels our fraud detection and identity intelligence products. You'll work at serious scale, high-throughput streaming signals, a growing cloud data lake, and low-latency serving requirements where it directly impacts fraud detection.

You’ll partner closely with data scientists, ML engineers, and product teams to make sure the right data is available, trustworthy, and fast, for research, reporting, model training, and real-time decisioning alike.

What You’ll Do

• Design and architect Bureau’s cloud data lake and lakehouse, the single source of truth for identity signals, risk events, and decision outcomes across all our products
• Build and operate scalable batch and streaming pipelines that ingest, clean, transform, and aggregate data from disparate sources, device SDKs, APIs, third-party data partners, and internal services
• Develop and maintain orchestration workflows (Airflow) that power research, reporting, compliance analytics, and ML model training and feature pipelines
• Own the reliability, observability, and cost-efficiency of production data infrastructure , with monitoring, alerting, and SLAs appropriate for a system that makes real-time risk decisions
• Collaborate with data science and ML teams to design feature stores and data pipelines that shorten the path from raw signal to deployed model
• Champion data engineering best practices, data quality, schema governance, testing, documentation, and mentor engineers across the team
• Contribute to graph-based fraud intelligence: modeling identity networks and fraud rings using graph databases

What You’ll Bring

Must have

• 4-8 years of hands-on big data engineering experience (batch and streaming) on the cloud, ideally AWS
• Deep experience with the data lake stack: EMR, Spark, S3, Athena, and modern warehouses/lakehouses such as ClickHouse, Databricks, or Snowflake
• Strong grasp of both OLAP and OLTP systems, and when to use each
• Production experience with pipeline orchestration tools like Airflow or Astronomer
• Familiarity with the AWS and Kubernetes ecosystem, EMR on EKS / self-hosted K8s workloads, MSK/Kafka, and RDS
• Experience building RESTful APIs and architecting systems that serve both batch and real-time workloads, with solid monitoring and instrumentation practices
• Strong programming skills in Python and/or Scala/Java, plus expert-level SQL

Nice to have

• Graph database experience (Neo4j, TigerGraph, Amazon Neptune); we use graph technology to uncover fraud networks and hidden identity linkages
• Exposure to fraud detection, risk, identity, fintech, or other high-stakes real-time data domains
• Experience with data quality frameworks, data cataloging, or lakehouse table formats (Iceberg, Delta Lake, Hudi)
• Experience supporting ML platforms: feature stores, training pipelines, or model-serving data flows

Our Culture

• We hire self-motivated people and get out of their way
• We value performance, not hours worked
• Speed, ownership, and impact matter most

Compensation

• Competitive salary + potential equity
• Health benefits, flexible PTO, learning budget