Data Engineer

BearPlex; United States; Remote; USD 120,000 - 180,000; Full time

Job summary

BearPlex seeks a data engineering professional to build and operate data pipelines and models powering analytics and AI systems. The role spans ingestion, transformation, warehouse design, streaming, and dataset preparation with built-in quality controls and auditability.

You will develop batch and streaming ETL/ELT pipelines with Python and SQL, maintain dbt models, and orchestrate with Airflow, Dagster, or Prefect, plus work with cloud data services.

Qualifications

• Production data pipelines used by other teams.
• Strong Python and advanced SQL skills with performance focus.
• dbt projects and modern warehouse schemas with tests and docs.
• Orchestrator experience with scheduling, retries, backfills.
• Cloud data services on AWS/GCP/Azure.
• Careful approach to correctness and data provenance.

Responsibilities

• Develop and run batch and streaming ETL/ELT pipelines using Python and SQL.
• Maintain dimensional and analytical warehouse models in dbt with tests and lineage.
• Add validation and anomaly monitoring to guard dashboards and models.
• Prepare curated data for retrieval augmented generation and AI workflows.
• Reconcile real-time and batch feeds and optimize queries and storage.
• Document pipelines and ensure observability and recovery mechanisms.

Skills

Python

Advanced SQL

Data modeling

Data lineage

Auditability

Tools

dbt

Airflow

Dagster

Prefect

PostgreSQL

Kafka

Kinesis

Flink

Docker/Kubernetes

Terraform

Job description

Role overview

Build and operate the data pipelines and models that supply analytics and AI systems with dependable, traceable data. The role spans ingestion, transformation, warehouse design, streaming, and dataset preparation, with quality controls and auditability built into production workflows.

Responsibilities

• Develop and run batch and streaming ETL/ELT pipelines using Python and SQL.


• Maintain dimensional and analytical warehouse models in dbt, with versioned transformations, tests, documentation, and lineage.


• Add validation, freshness checks, and anomaly monitoring to catch and isolate problematic data before it reaches dashboards or models.


• Prepare curated, deduplicated, and labeled data for retrieval augmented generation, embeddings, and fine tuning while preserving provenance.


• Reconcile real time and batch feeds, and improve query, partitioning, and storage performance in PostgreSQL and cloud warehouses.


• Document pipelines and provide observability, reproducibility, and recovery mechanisms.

Requirements

• A record of delivering production data pipelines used by other teams.


• Strong Python and advanced SQL skills, including query performance and data modeling.


• Experience building and maintaining dbt projects and modern warehouse schemas with tests and documentation.


• Experience operating an orchestrator such as Airflow, Dagster, or Prefect, including scheduling, retries, and backfills.


• Familiarity with AWS, GCP, or Azure data services.


• A careful approach to correctness, data lineage, and auditability.

Nice to have

• Real time processing experience with Kafka, Kinesis, or Flink.


• Dataset preparation for AI workflows, including labeling and deduplication.


• Docker, Kubernetes, or Terraform experience; familiarity with data catalogs, PII handling, or compliance controls.

Benefits and work setup

• Fully remote within Pakistan, with collaboration centered around Lahore.


• A budget for learning, courses, certifications, and conferences.


• A defined path toward data architecture or platform leadership.