Senior Data Engineer

Zensar Technologies; Bengaluru Urban; In loco; INR 1.500.000 - 2.100.000; Tempo pieno

Descrizione del lavoro

Zensar Technologies is seeking a Senior Data Engineer to design, build, and own end-to-end production pipelines powering analytics across the org. You will focus on Python + SQL, robust transaction-level fact tables, and stringent data quality and auditability in finance/risk/compliance domains.

Candidates with experience in Ubers data platform stack (Piper/uWorc, Databook, uSecret, DSW, SourceGraph, Query Builder, OneETL) will be prioritized, and you will own CI/CD for pipelines using standard

Competenze

• 6+ years in data engineering.
• Expert-level Python and SQL; end-to-end production ownership.
• Experience building transaction/fact tables and medallion architecture.
• Finance/risk/compliance data domain familiarity is a plus.

Mansioni

• Own data architecture and system design decisions for pipelines and data models.
• End-to-end ownership of pipelines in production: design, build, deploy, monitor, operate.
• Build and support transaction/fact tables with bronze/silver/gold medallion architecture.
• Implement data quality, auditability, data lineage, and validation checks.
• Write complex cross-dialect SQL and handle late-arriving records without duplicates.
• Orchestrate DAGs with secure credential handling; CI/CD via Git workflows.
• Develop Python ETL tooling using pandas, SQLAlchemy, and class-based pipelines.
• Integrate with Google Drive/Sheets; build YAML-driven pipeline configs.

Conoscenze

Python

SQL

Data pipelines

Airflow

Strumenti

Piper/uWorc

Databook

uSecret

DSW

SourceGraph

Query Builder

OneETL

Descrizione del lavoro

Job Description

Were looking for a Senior Data Engineer with strong data architecture and system design skills to design, build, and own end-to-end production pipelines powering analytics and decision-making across the org. The role centers on deep Python + SQL expertise, robust transaction-level fact tables, and rigorous data quality and auditability, ideally within a finance, risk, or compliance data domain. Internal candidates familiar with Ubers data platform stack (Piper/uWorc, Databook, uSecret, DSW, SourceGraph, Query Builder, OneETL) will be prioritized.

Responsibilities

• Own data architecture and system design decisions for pipelines and data models - grain, partitioning, schema evolution, and scalability tradeoffs.
• Take end-to-end ownership of pipelines in production: design, build, deploy, monitor, and operate.
• Design and build transaction tables (append-only, immutable event/transaction-grain fact tables) alongside standard fact/dimension models using medallion (bronze/silver/gold) architecture.
• Build and support pipelines for finance, risk, or compliance use cases where accuracy, auditability, and data lineage are critical.
• Implement data quality and auditability controls: validation checks, reconciliation logic, anomaly detection, and audit trails for every pipeline you own.
• Write complex, cross-dialect SQL (MySQL + PostgreSQL): window functions, multi-layered CTEs, CASE-driven logic, COALESCE/NULLIF, type casting, and date/timestamp handling.
• Build idempotent reload patterns (DELETE+INSERT), UNION ALL/set operations, and templated (Jinja-style) SQL including handling for late-arriving/corrected transaction records without double-counting.
• Orchestrate Airflow-style DAGs (Pipeline/BaseTask, ExternalTaskSensor for cross-pipeline deps) with secure credential handling via uSecret.
• Build Python ETL tooling: pandas (CSV DB), SQLAlchemy + raw drivers (MySQLdb, psycopg2), type hints/dataclasses, class-based pipeline design.
• Integrate with Google Drive/Sheets APIs; build YAML-driven pipeline configs; handle Piper staging/user_staging quirks.
• Own CI/CD for pipelines via standard Git workflows.
• Use Ubers internal stack day-to-day: OneETL for pipeline authoring, Piper/uWorc for scheduling, Databook for lineage, uSecret for credentials, DSW notebooks for CSV/table work, SourceGraph for code search, Query Builder for ad hoc SQL.

Qualifications

• 6+ years in data engineering.
• Strong data architecture and system design skills to make sound tradeoffs on modeling, partitioning, and scalability, not just write queries.
• Demonstrated end-to-end production ownership of data pipelines from design through deployment, monitoring, and operational support.
• Expert-level Python + SQL as the primary toolset. Hive/Hadoop is a nice-to-have only.
• Robust data quality and auditability practices - validation, reconciliation, anomaly detection, audit trails.
• Experience working with finance, risk, or compliance data - comfort with the heightened accuracy, auditability, and data-lineage requirements typical of these domains.
• Proven experience designing and building transaction/fact tables.
• Expert SQL (window functions, CTEs, CASE logic, cross-dialect MySQL/PostgreSQL).
• Strong Python (pandas, SQLAlchemy, type hints/dataclasses, class-based pipelines).
• Airflow-like orchestration experience (Piper/uWorc a plus).
• Solid data modeling fundamentals (fact/dim, normalization, medallion architecture).
• YAML-based config experience; standard CI/CD and Git workflows.

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.
Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensarand join us to Grow. Own. Achieve. Learn.to be the best version of yourself.
We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.