Data Engineer

US Health Partners, LLC; Polska; Hybrid; PLN 190,000 - 270,000; Full time

Job summary

Nous is seeking a data engineer to build and own data pipelines powering analytics and model training. The role focuses on long-horizon, agentic data at scale, turning millions of tool-conditioned interactions into reliable datasets for the company.

The role requires strong SQL, Python, and data modeling skills, plus production experience with orchestration tools. Open to any time zone with overlap with US hours, remote work possible.

Qualifications

• 4+ years of data engineering experience building and operating production data pipelines.
• Strong fundamentals in SQL, data modeling, and schema design and evolution.
• Deep understanding of storage formats and database types and their use cases.
• Working model of the data stack across ingestion, storage, transformation, orchestration, cataloging, and serving.
• Strong Python, plus shell skills for batch and storage operations.
• Hands-on cloud experience with object storage, batch compute, and identity and access management.
• Production experience with a workflow orchestrator (Airflow, Dagster, Prefect, or equivalent).
• An instinct for data quality: data must be good, not just pipelines running.
• Experience with AI-assisted development tools and disciplined reviews.

Responsibilities

• Build, operate, and continuously improve the data pipelines that feed analytics and model training.
• Deliver reliable internal analytics so teams across Nous can make decisions on their own data.
• Wrangle long-horizon agentic data into structured, well-documented datasets ready for analysis and training.
• Choose ETL/ELT approaches based on destination capabilities, reproducibility, latency, and cost, and explain the tradeoffs behind each choice.
• Own pipeline operations in production, including failures, re-runs, and backfills, and debug issues across jobs, storage, permissions, and downstream consumers.
• Design and evolve schemas, storage formats, and data models as needs change.
• Build memory-efficient processing that scales, using streaming and partitioning, and recognize when a workload has outgrown a single machine.
• Communicate clearly about data location, lineage, quality, limitations, and fitness for use to engineers and non-engineers alike.

Skills

SQL

Python

Shell

Data Modeling

Data Quality

Data Pipelines

Tools

Airflow

Dagster

Prefect

Job description

The role

Join Nous to build and own the data pipelines behind our analytics and model training. This role centers on long-horizon agentic data at scale, turning millions of multi-step, tool-conditioned interactions into reliable datasets the whole company can trust. Open to any time zone with meaningful overlap with US hours.

Responsibilities

• Build, operate, and continuously improve the data pipelines that feed analytics and model training.

• Deliver reliable internal analytics so teams across Nous can make decisions on their own data.

• Wrangle long-horizon agentic data into structured, well-documented datasets ready for analysis and training.

• Choose ETL/ELT approaches based on destination capabilities, reproducibility, latency, and cost, and explain the tradeoffs behind each choice.

• Own pipeline operations in production, including failures, re-runs, and backfills, and debug issues across jobs, storage, permissions, and downstream consumers.

• Design and evolve schemas, storage formats, and data models as needs change.

• Build memory-efficient processing that scales, using streaming and partitioning, and recognize when a workload has outgrown a single machine.

• Communicate clearly about data location, lineage, quality, limitations, and fitness for use to engineers and non-engineers alike.

Qualifications

• 4+ years of data engineering experience building and operating production data pipelines.

• Strong fundamentals in SQL, data modeling, and practical schema design and evolution.

• Deep understanding of storage formats and database types, and when each one fits.

• A working model of the data stack: ingestion, storage, transformation, orchestration, cataloging, and serving, and where responsibilities belong in each layer.

• Strong Python, plus solid shell skills for batch and storage operations.

• Hands-on cloud experience with object storage, batch compute, and identity and access management.

• Production experience with at least one workflow orchestration system such as Airflow, Dagster, Prefect, or an in-house equivalent.

• An instinct for data quality: you ask "is the data good?" and not just "did the pipeline run?"

• Extensive use of AI-assisted development tools, with disciplined review of what those tools produce.

Preferred

• Experience working with agentic or LLM-generated data, including structured, multi-step, tool-conditioned interactions.

• Experience building data pipelines for model training.

• Experience processing datasets at the scale of millions of interactions or more.

• Background at data infrastructure, observability, or AI data companies.