Senior / Staff Data Engineer

Burq, Inc.

Lahore

In loco

PKR 3.600.000 - 6.000.000

Tempo pieno

4 giorni fa
Candidati tra i primi

Una candidatura completa in un minuto

Curriculum e lettera di presentazione personalizzati, pronti da inviare.

Supera i filtri ATS

Descrizione del lavoro

Burq, Inc. is seeking an experienced data engineer to own the ingestion and transformation foundation for enterprise data assets. You will design resilient pipelines, establish trusted identities across entities, and enable scalable data products for analytics, ML and operational intelligence.

The role emphasizes batch and near-real-time data processing, canonical models, data stewardship and secure, auditable data workflows across customers and partners.

Competenze

  • 5+ years of data engineering/software engineering experience with senior staff expectations.
  • Advanced SQL with performance tuning, data modeling and transformations.
  • Production Python services, API integrations and reliable logging.

Mansioni

  • Own enterprise ingestion and interoperability from APIs, webhooks, SFTP/file drops, CDC and exports.
  • Design and optimize Snowflake ingestion and transformation with isolation for customers.
  • Build batch and near-real-time pipelines using SQL, Python and orchestration frameworks.
  • Maintain data lineage, catalogs, observability, and cost/performance telemetry.
  • Develop data-product patterns for BI, reporting and operational intelligence.

Conoscenze

Advanced SQL
Python
Snowflake
Airflow
CI/CD
Data governance
Multi-tenant data

Formazione

Bachelor's degree in CS/EE/Math

Strumenti

Kafka
Terraform
OpenLineage
Monte Carlo

Descrizione del lavoro

Role overview

Own the engineering foundation that turns complex enterprise, operational and platform data into reliable, secure, discoverable assets for analytics, machine learning and Burq Intelligence. Build production-grade ingestion and transformation systems, establish trusted identities across entities, and enable data products that scale across customers and delivery providers.

Key responsibilities
Enterprise ingestion and interoperability
  • Design resilient ingestion from enterprise customers and strategic partners using APIs, webhooks, SFTP/file drops, CDC and scheduled exports as appropriate.
  • Integrate OMS, WMS, TMS and FMS sources; normalize heterogeneous order, shipment, location, driver and provider records into documented contracts.
  • Define schema evolution, idempotency, backfills, reconciliation, late-arriving data, retries, dead-letter handling and auditability.
  • Build Snowflake ingestion and transformation patterns with clear SLAs and secure customer-specific isolation.
Data architecture, quality and identity
  • Build and optimize batch and near-real-time pipelines using SQL, Python and suitable orchestration/stream-processing frameworks.
  • Design canonical models and stable entity resolution across merchants, customers, orders, deliveries, drivers and providers; document confidence and exception handling.
  • Implement automated tests for completeness, accuracy, uniqueness, timeliness, referential integrity and contract compatibility.
  • Maintain data lineage, catalogs, ownership, observability, incident alerts and cost/performance telemetry.
  • Develop reusable dimensional, event-driven and data-product patterns for BI, enterprise reporting and operational intelligence.
ML and agent-ready data
  • Partner with ML engineering to produce reproducible, versioned training, validation and evaluation datasets with provenance and leakage controls.
  • Support feature pipelines, offline/online consistency, drift detection and retraining triggers; integrate quality gates into model/agent release workflows.
  • Expose trustworthy, permission-aware datasets and interfaces for AI agents, with freshness indicators, access logs and safe failure behavior.
Security, governance and operations
  • Implement least-privilege access, tenant separation, encryption practices, secrets management, PII minimization and retention/deletion enforcement in pipelines.
  • Create CI/CD, infrastructure-as-code where appropriate, automated deployment and rollback, operational runbooks and disaster recovery procedures.
  • Own SLOs, incident response, root-cause analysis, capacity planning, query optimization and warehouse spend efficiency for assigned data services.
  • Work with Security and Product to translate enterprise security requirements and customer contracts into verifiable technical controls.
Required qualifications
  • 5+ years of relevant data engineering/software engineering experience for Senior; typically 8+ years with demonstrable cross-team technical leadership for Staff (scope matters more than tenure).
  • Advanced SQL: window functions, query plans, indexing/clustering concepts, performance tuning, data modeling and analytical transformations.
  • Production Python: modular services, typing, testing, packaging, API integrations, logging, error handling and maintainability.
  • Hands-on experience building and operating cloud data pipelines and warehouses at meaningful scale, preferably Snowflake or a comparable platform.
  • Practical orchestration and transformation experience (e.g., Airflow, Dagster, dbt or equivalents) and experience with CI/CD and automated data testing.
  • Strong understanding of distributed data reliability: retries, idempotency, event time, schema changes, backfills and reconciliation.
  • Experience implementing access controls, PII protection and multi-tenant data boundaries.
  • Clear written technical communication, architecture documentation and cross-functional collaboration with product, analytics, platform and ML teams.
Preferred technical experience
  • Snowflake: Snowpipe, Streams/Tasks, dynamic tables, RBAC, resource monitors, clustering and query profiling.
  • Streaming/event systems such as Kafka, Kinesis, Pub/Sub or equivalent; CDC and event-driven architecture.
  • Cloud services on AWS, GCP or Azure; Terraform and containerized deployment.
  • Data observability/catalog tools (e.g., Monte Carlo, Great Expectations, OpenLineage, DataHub) or equivalent practices.
  • Feature stores, MLflow or comparable model/data versioning and evaluation workflows.
  • Enterprise logistics integrations (OMS/WMS/TMS/FMS), EDI, SFTP and API contract governance.
  • Security and compliance delivery in SOC 2 / ISO 27001 environments; privacy and deletion workflows.
Senior vs Staff expectations
  • Senior: independently delivers critical pipelines, owns operational quality, mentors peers and improves standards within a domain.
  • Staff: defines cross-domain architecture and data contracts, resolves complex tradeoffs, drives standards across teams, mentors senior engineers and influences multi-quarter technical strategy without direct people management.
What success looks like in your first year
  • Enterprise onboarding: agreed enterprise data integration milestones delivered with documented reconciliation and acceptance criteria.
  • Reliability: measurable freshness and availability SLOs; faster incident detection and recovery with owned runbooks.
  • Trust: automated quality coverage and documented lineage on critical datasets, so teams can rely on the data with confidence.
  • ML readiness: reproducible versioned datasets and quality gates adopted by model/agent teams.
  • Efficiency: transparent pipeline cost and resource usage with demonstrated optimization against baseline.
  • Governance: validated tenant access controls, retention/deletion workflows and auditable data access.
Who you’ll work with

Key partners: Data & BI, ML Engineering, Platform Engineering, Security, Enterprise Product and customer integration teams. You own the architecture, implementation and operational quality of the data systems you build, and partner with Product on priorities and with ML Engineering on model needs.

Ottieni la revisione del curriculum gratis e riservata.

o trascina qui il file.

Similar jobs

Offerte di lavoro simili che vale la pena confrontare

Senior / Staff Data Engineer
Senior / Staff Data Engineer

Burq • Lahore

In loco
PKR 2.500.000 - 6.000.000
Senior / Staff Data Engineer
Senior / Staff Data Engineer

Tandem Inc. • Lahore

In loco
PKR 2.400.000 - 4.200.000
Senior AI & Data Engineer - Strategy & Operational Intelligence
Senior AI & Data Engineer - Strategy & Operational Intelligence

PackageX, Inc. • Islamabad

In loco
PKR 3.500.000 - 5.200.000
Snowflake, Python
Snowflake, Python

Infosys • Hyderabad City Taluka

In loco
PKR 2.400.000 - 3.600.000
Data Engineer
Data Engineer

Software Finder • Punjab

In loco
PKR 1.800.000 - 3.000.000
SVP - Enterprise Data, Business Intelligence & Analytics
SVP - Enterprise Data, Business Intelligence & Analytics

Pakistan Single Window • Pakistan

In loco
PKR 8.000.000 - 11.000.000
Competitive salary
Fuel Card
Health benefits
+2
Data and BI Engineer
Data and BI Engineer

Simplex Suite • Lahore

In loco
PKR 2.000.000 - 3.000.000
Databricks, Snowflake, Power BI, Solution Architecture
Databricks, Snowflake, Power BI, Solution Architecture

Infosys • Hyderabad City Taluka

In loco
PKR 4.000.000 - 6.500.000
Senior Product Manager - Data Security & Trust
Senior Product Manager - Data Security & Trust

Burq, Inc. • Lahore

In loco
PKR 3.500.000 - 7.000.000
Senior Product Lead, Agent Fleet and AI Platform
Senior Product Lead, Agent Fleet and AI Platform

Tandem Inc. • Lahore

In loco
PKR 2.500.000 - 5.000.000
Luoghi più richiesti