Data Engineer PK (Python/PySpark/AWS Glue/Amazon Athena/SQL/Apache Airflow)

Wizdaa; Pakistan; Remote; PKR 22,586,000 - 28,233,000; Full time

Job summary

A leading technology company is seeking a Technical Data Engineer to build and optimize data pipelines using Python and TypeScript. You should have over 4 years of experience in data engineering, with strong skills in Apache Airflow and SQL. This fully remote role offers compensation in USD and requires alignment with EST or PT time zones.

Qualifications

• 4+ years of production data engineering experience.
• Deep experience with Apache Airflow and Python-based data pipelines.
• Strong SQL skills and experience with PostgreSQL in live environments.

Responsibilities

• Build and optimize data pipelines and infrastructure using Python and TypeScript.
• Integrate pipeline health and metrics into engineering dashboards.
• Collaborate with teams to automate workflows.

Skills

Apache Airflow

AWS Glue

PySpark

Python

SQL

Tools

PostgreSQL

Snowflake

TypeScript

Job description

Let’s be direct: We’re looking for a technical powerhouse. If you’re the developer who:

• Is the clear technical leader on your team
• Consistently solves problems others can’t crack
• Ships complex features in half the time it takes others
• Writes code so clean it could be published as a tutorial
• Takes pride in elevating the entire codebase

Then we want to talk to you.

This isn’t a role for everyone, and that’s by design.

We’re seeking developers who know they’re exceptional and have the track record to prove it.

What you’ll do

• Build, optimize, and scale data pipelines and infrastructure using Python, TypeScript, Apache Airflow, PySpark, AWS Glue, and Snowflake.
• Design, operationalize, and monitor ingest and transformation workflows: DAGs, alerting, retries, SLAs, lineage, and cost controls.
• Collaborate with platform and AI/ML teams to automate ingestion, validation, and real‑time compute workflows; work toward a feature store.
• Integrate pipeline health and metrics into engineering dashboards for full visibility and observability.
• Model data and implement efficient, scalable transformations in Snowflake and PostgreSQL.
• Build reusable frameworks and connectors to standardize internal data publishing and consumption.

Required qualifications

• 4+ years of production data engineering experience.
• Deep, hands‑on experience with Apache Airflow, AWS Glue, PySpark, and Python-based data pipelines.
• Strong SQL skills and experience operating PostgreSQL in live environments.
• Solid understanding of cloud‑native data workflows (AWS preferred) and pipeline observability (metrics, logging, tracing, alerting).
• Proven experience owning pipelines end‑to‑end: design, implementation, testing, deployment, monitoring, and iteration.

Preferred qualifications

• Experience with Snowflake performance tuning (warehouses, partitions, clustering, query profiling) and cost optimization.
• Real‑time or near‑real‑time processing experience (e.g., streaming ingestion, incremental models, CDC).
• Hands‑on experience with a backend TypeScript framework (e.g., NestJS) is a strong plus.
• Experience with data quality frameworks, contract testing, or schema management (e.g., Great Expectations, dbt tests, OpenAPI/Protobuf/Avro).
• Background in building internal developer platforms or data platform components (connectors, SDKs, CI/CD for data).

Additional Information

• This is a fully remote position.
• Compensation will be in USD.
• Work hours are aligned with the EST time zone (9 AM to 6 PM EST) or PT time zone.