Data Platform & Systems Engineer

Stellar Virtual; None; In loco; EUR 70.000 - 100.000; Tempo pieno

Descrizione del lavoro

Stellar Virtual is seeking a Data Platform & Systems Engineer to own and evolve its data platform, including ingestion pipelines, data warehouse, and orchestration. You will work with Python, Azure, SQL, dbt, and automation to ensure reliability and scalability while enabling data-driven decisions.

The role emphasizes ownership, clear communication, and contributing to platform roadmap. The ideal candidate can work across the full stack with a strong engineering mindset, focusing on maintainable

Competenze

• Build, maintain, and improve Python-based ingestion pipelines integrating APIs, SFTP sources, files, and other external systems.
• Design pipelines using reliable engineering patterns, including incremental processing, idempotency, retry and backoff handling, checkpointing, and recoverability.
• Develop reusable ingestion patterns and shared components to reduce duplication and improve maintainability across integrations.
• Develop, maintain, and optimize SQL and dbt models across staging, intermediate, and analytical layers.

Mansioni

• Ingest, transform, and validate data from APIs, files, and external sources.
• Develop and optimize SQL/dbt models across warehouse layers.
• Orchestrate multi-stage pipelines and ensure reliability and performance.
• Implement data-quality checks and dbt tests.

Conoscenze

Python

SQL

dbt

Azure

Data pipelines

Data modeling

Orchestration

Data quality

ETL

Strumenti

dbt

Airflow

Descrizione del lavoro

Position Details

• Reporting Manager: Director, Digital Learning Systems
• Status: Salary, Exempt
• Type: Regular, Full-Time (12 Months)
• Program: Stellar Virtual OMG - Corp

Overview

The Data Platform & Systems Engineer will be responsible for developing, maintaining, and progressively assuming day-to-day ownership of Stellar Virtual's data platform, including its ingestion pipelines, data warehouse, transformation layer, orchestration, integrations, and delivery systems. The engineer works across the full stack—Python, Azure, SQL, dbt, orchestration, and downstream delivery to ensure the platform is reliable, scalable, maintainable, and operationally sound. Effective use of AI-assisted development and automation is an essential part of the role, both to accelerate engineering work and to improve system monitoring, management, and reliability. As familiarity with the platform grows, the engineer will be expected to work increasingly independently, identify opportunities for improvement, and contribute meaningfully to technical architecture and the platform roadmap. Success in this role requires strong engineering judgment, ownership, clear communication, and consistent follow-through, in support of Stellar Virtual's mission of empowering families and unleashing potential.

Essential Duties

• Data Ingestion
  • Build, maintain, and improve Python-based ingestion pipelines integrating APIs, SFTP sources, files, and other external systems.
  • Design pipelines using reliable engineering patterns, including incremental processing, idempotency, retry and backoff handling, checkpointing, and recoverability.
  • Diagnose and resolve source-system, authentication, schema, and data-transfer issues.
  • Develop reusable ingestion patterns and shared components to reduce duplication and improve maintainability across integrations
• Data Modeling & Transformation
  • Develop, maintain, and optimize SQL and dbt models across staging, intermediate, and analytical layers.
  • Translate source-system data into well-defined, reusable data models that support reporting, analytics, operational workflows, and downstream applications.
  • Evaluate model performance, query efficiency, materialization strategies, and data volume as the platform scales.
  • Maintain clear lineage and consistent modeling conventions across the warehouse.
• Data Modeling & Transformation
  • Develop, maintain, and optimize SQL and dbt models across staging, intermediate, and analytical layers.
  • Translate source-system data into well-defined, reusable data models that support reporting, analytics, operational workflows, and downstream applications.
  • Evaluate model performance, query efficiency, materialization strategies, and data volume as the platform scales.
  • Maintain clear lineage and consistent modeling conventions across the warehouse.
• Orchestration & Pipeline Operations
  • Build and maintain orchestration across ingestion, data movement, transformation, validation, and delivery workflows.
  • Manage dependencies, scheduling, retries, failure handling, and recovery across multi-stage pipelines.
  • Troubleshoot failed or degraded production jobs and perform root-cause analysis.
  • Improve pipeline reliability, runtime, scalability, and operational simplicity over time.
  • Develop automation that reduces manual intervention and supports reliable day-to-day operation of the platform.
• Data Quality, Testing & Validation
  • Design and implement data-quality checks across all pipeline stages: ingestion to Blob, Blob to SQL, SQL to dbt models, and dbt to downstream outputs.
  • Build and maintain dbt tests