Senior / Staff Data Engineer

Tandem Inc.

Lahore

In loco

PKR 2.400.000 - 4.200.000

Tempo pieno

2 giorni fa
Candidati tra i primi

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

Tandem Inc. seeks a senior data engineer to own the engineering foundation turning enterprise data into reliable, secure, discoverable analytics assets.

You will build production-grade ingestion and transformation systems, establish trusted identities, and enable scalable data products across customers and providers. Responsibilities span designing resilient ingestion, canonical models, data quality, lineage, and automated tests, with collaboration across ML, security and product teams.

Competenze

  • 5+ years of data engineering/software engineering experience.
  • Advanced SQL including window functions, indexing and data modeling.
  • Production Python: modular services, testing, typing and API integrations.
  • Experience building cloud data pipelines and warehouses at scale (Snowflake preferred).
  • Orchestrators like Airflow, Dagster or equivalents with data testing.

Mansioni

  • Own enterprise data ingestion and interoperability across systems.
  • Design resilient ingestion from enterprise customers and partners (APIs, SFTP, CDC).
  • Build Snowflake ingestion and transformation patterns with SLAs and isolation.
  • Develop batch and near-real-time pipelines; ensure data quality and lineage.
  • Collaborate with ML, security and product teams to enable data products.

Conoscenze

SQL
Python
Data Modeling
Airflow
Dagster
dbt
CI/CD
Data Governance

Formazione

Bachelor's degree in CS or related field

Strumenti

Snowflake
Airflow
Dagster
dbt
CI/CD
OpenLineage
Monte Carlo

Descrizione del lavoro

Role overview

Own the engineering foundation that turns complex enterprise, operational and platform data into reliable, secure, discoverable assets for analytics, machine learning and Burq Intelligence. Build production-grade ingestion and transformation systems, establish trusted identities across entities, and enable data products that scale across customers and delivery providers.

Key responsibilities
Enterprise ingestion and interoperability
  • Design resilient ingestion from enterprise customers and strategic partners using APIs, webhooks, SFTP/file drops, CDC and scheduled exports as appropriate.
  • Integrate OMS, WMS, TMS and FMS sources; normalize heterogeneous order, shipment, location, driver and provider records into documented contracts.
  • Define schema evolution, idempotency, backfills, reconciliation, late-arriving data, retries, dead-letter handling and auditability.
  • Build Snowflake ingestion and transformation patterns with clear SLAs and secure customer-specific isolation.
Data architecture, quality and identity
  • Build and optimize batch and near-real-time pipelines using SQL, Python and suitable orchestration/stream-processing frameworks.
  • Design canonical models and stable entity resolution across merchants, customers, orders, deliveries, drivers and providers; document confidence and exception handling.
  • Implement automated tests for completeness, accuracy, uniqueness, timeliness, referential integrity and contract compatibility.
  • Maintain data lineage, catalogs, ownership, observability, incident alerts and cost/performance telemetry.
  • Develop reusable dimensional, event-driven and data-product patterns for BI, enterprise reporting and operational intelligence.
ML and agent-ready data
  • Partner with ML engineering to produce reproducible, versioned training, validation and evaluation datasets with provenance and leakage controls.
  • Support feature pipelines, offline/online consistency, drift detection and retraining triggers; integrate quality gates into model/agent release workflows.
  • Expose trustworthy, permission-aware datasets and interfaces for AI agents, with freshness indicators, access logs and safe failure behavior.
Security, governance and operations
  • Implement least-privilege access, tenant separation, encryption practices, secrets management, PII minimization and retention/deletion enforcement in pipelines.
  • Create CI/CD, infrastructure-as-code where appropriate, automated deployment and rollback, operational runbooks and disaster recovery procedures.
  • Own SLOs, incident response, root-cause analysis, capacity planning, query optimization and warehouse spend efficiency for assigned data services.
  • Work with Security and Product to translate enterprise security requirements and customer contracts into verifiable technical controls.
Required qualifications
  • 5+ years of relevant data engineering/software engineering experience for Senior; typically 8+ years with demonstrable cross-team technical leadership for Staff (scope matters more than tenure).
  • Advanced SQL: window functions, query plans, indexing/clustering concepts, performance tuning, data modeling and analytical transformations.
  • Production Python: modular services, typing, testing, packaging, API integrations, logging, error handling and maintainability.
  • Hands-on experience building and operating cloud data pipelines and warehouses at meaningful scale, preferably Snowflake or a comparable platform.
  • Practical orchestration and transformation experience (e.g., Airflow, Dagster, dbt or equivalents) and experience with CI/CD and automated data testing.
  • Strong understanding of distributed data reliability: retries, idempotency, event time, schema changes, backfills and reconciliation.
  • Experience implementing access controls, PII protection and multi-tenant data boundaries.
  • Clear written technical communication, architecture documentation and cross-functional collaboration with product, analytics, platform and ML teams.
Preferred technical experience
  • Snowflake: Snowpipe, Streams/Tasks, dynamic tables, RBAC, resource monitors, clustering and query profiling.
  • Streaming/event systems such as Kafka, Kinesis, Pub/Sub or equivalent; CDC and event-driven architecture.
  • Cloud services on AWS, GCP or Azure; Terraform and containerized deployment.
  • Data observability/catalog tools (e.g., Monte Carlo, Great Expectations, OpenLineage, DataHub) or equivalent practices.
  • Feature stores, MLflow or comparable model/data versioning and evaluation workflows.
  • Enterprise logistics integrations (OMS/WMS/TMS/FMS), EDI, SFTP and API contract governance.
  • Security and compliance delivery in SOC 2 / ISO 27001 environments; privacy and deletion workflows.
Senior vs Staff expectations
  • Senior: independently delivers critical pipelines, owns operational quality, mentors peers and improves standards within a domain.
  • Staff: defines cross-domain architecture and data contracts, resolves complex tradeoffs, drives standards across teams, mentors senior engineers and influences multi-quarter technical strategy without direct people management.
What success looks like in your first year
  • Enterprise onboarding: agreed enterprise data integration milestones delivered with documented reconciliation and acceptance criteria.
  • Reliability: measurable freshness and availability SLOs; faster incident detection and recovery with owned runbooks.
  • Trust: automated quality coverage and documented lineage on critical datasets, so teams can rely on the data with confidence.
  • ML readiness: reproducible versioned datasets and quality gates adopted by model/agent teams.
  • Efficiency: transparent pipeline cost and resource usage with demonstrated optimization against baseline.
  • Governance: validated tenant access controls, retention/deletion workflows and auditable data access.
Who you’ll work with

Key partners: Data & BI, ML Engineering, Platform Engineering, Security, Enterprise Product and customer integration teams. You own the architecture, implementation and operational quality of the data systems you build, and partner with Product on priorities and with ML Engineering on model needs.

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Senior / Staff Data Engineer
Senior / Staff Data Engineer

Burq, Inc. • Lahore

In loco
PKR 3.600.000 - 6.000.000
Senior / Staff Data Engineer
Senior / Staff Data Engineer

Burq • Lahore

In loco
PKR 2.500.000 - 6.000.000
Senior AI & Data Engineer - Strategy & Operational Intelligence
Senior AI & Data Engineer - Strategy & Operational Intelligence

PackageX, Inc. • Islamabad

In loco
PKR 3.500.000 - 5.200.000
Snowflake, Python
Snowflake, Python

Infosys • Hyderabad City Taluka

In loco
PKR 2.400.000 - 3.600.000
Data Engineer
Data Engineer

Software Finder • Punjab

In loco
PKR 1.800.000 - 3.000.000
SVP - Enterprise Data, Business Intelligence & Analytics
SVP - Enterprise Data, Business Intelligence & Analytics

Pakistan Single Window • Pakistan

In loco
PKR 8.000.000 - 11.000.000
Competitive salary
Fuel Card
Health benefits
+2
Databricks, Snowflake, Power BI, Solution Architecture
Databricks, Snowflake, Power BI, Solution Architecture

Infosys • Hyderabad City Taluka

In loco
PKR 4.000.000 - 6.500.000
Senior Product Manager - Data Security & Trust
Senior Product Manager - Data Security & Trust

Tandem Inc. • Lahore

In loco
PKR 5.000.000 - 10.000.000
Data and BI Engineer
Data and BI Engineer

Simplex Suite • Lahore

In loco
PKR 2.000.000 - 3.000.000
Senior Product Manager - Data Security & Trust
Senior Product Manager - Data Security & Trust

Burq • Lahore

In loco
PKR 6.000.000 - 9.000.000
Luoghi più richiesti