Senior Data Engineer

Out Of The Blue.ai; Pune District; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

An innovative AI startup in Pune is seeking a Senior Data Engineer to architect and build data infrastructure. The successful candidate will own the orchestration layer connecting various data sources and ensure seamless data flow. Candidates should have 5-8 years of experience in data pipeline production, strong skills in Python and SQL, and hands-on experience with GCP. This role involves building scalable systems and collaborating with cross-functional teams to drive impactful business outcomes.

Qualifications

• 5–8 years of experience building production data pipelines.
• Experience with workflow orchestration using Airflow or similar tools.
• Hands-on experience with GCP services.

Responsibilities

• Build orchestration layers for data flows across the eCommerce ecosystem.
• Own end-to-end data engineering solutions using Airflow and Python.
• Optimize existing data infrastructure and plan for future pipeline modernization.

Skills

Building production data pipelines

Strong coding skills in Python

Expert-level SQL

Workflow orchestration using Airflow

Hands-on experience with GCP

Data modeling for analytics and ML

Code quality awareness

Tools

Airflow

GCP (BigQuery, Cloud Storage, Dataflow)

Supermetrics

Job description

About Out of the Blue

Out of the Blue is building an agentic AI platform to help eCommerce brands scale smarter and protect revenue. Our platform proactively detects and acts on what breaks growth—misfiring pixels, broken tracking, underperforming funnels.

We combine GenAI, classic ML, and optimization to surface insights, recommend fixes, and deploy autonomous agents that take action across the stack.

We’re a post-product, post-revenue startup backed by SF-based investors, with a team from Google, PayPal, eBay, and alumni of Stanford, Berkeley, and Booth.

The Role

As a Senior Data Engineer, you'll architect and build the critical data infrastructure that powers our intelligent platform. You'll own the orchestration layer connecting ad channels, website engagement data, and eCommerce platforms—ensuring data flows seamlessly, context is preserved, and insights drive action.

You’ll work across the full data lifecycle—from ingestion and transformation to delivery and monitoring—while building scalable systems that serve our ML and product teams.

You’ll join an existing data engineering team and collaborate closely with ML engineers, product teams, and customers to build reliable data pipelines that power real business outcomes.

Your Impact

• Build orchestration layers that manage data flows across the eCommerce ecosystem.
• Maintain context for intelligent summarization and action—design data models and systems that preserve business context, enabling the right insights at the right time for autonomous agents and human decision-makers.
• Own end-to-end data engineering solutions using Airflow, Python, and GCP services—from design through deployment and monitoring.
• Extend and optimize existing data infrastructure—work with current ingestion tools (Supermetrics) while building custom pipelines where needed.
• Plan and execute future pipeline modernization—identify opportunities to improve scalability, reliability, and maintainability of existing systems.
• Shape the future of data engineering at Out of the Blue by bringing ideas on automation, optimization, and best practices.

What You Bring

• 5–8 years of experience building production data pipelines.
• Strong coding skills in Python with expert-level SQL.
• Experience with workflow orchestration using Airflow or similar tools.
• Hands‑on experience with GCP (BigQuery, Cloud Storage, Dataflow, Pub/Sub, etc.).
• Understanding of data modeling for analytics and ML use cases.
• Passion for code quality—you write maintainable, well‑documented, testable code.

Nice to Have

• Experience with eCommerce platforms (Shopify, BigCommerce) and their data models.
• Knowledge of adtech/martech ecosystems—tracking pixels, attribution, ad platform APIs.
• Experience with stream processing technologies (Kafka, Pub/Sub, Dataflow).
• Familiarity with agent‑based approaches for data orchestration and quality monitoring.
• Understanding of ML pipelines and feature engineering for production ML systems.
• Experience with data quality frameworks and observability tools (Great Expectations, Monte Carlo, etc.).
• Background in reverse ETL and data activation use cases.

Our values help us make decisions that determine how we achieve our goals. Our ideal candidate is someone who is very hands‑on and passionate about solving problems and displays a strong sense of curiosity and ownership towards their work.