Senior Data Platform Engineer – Azure & PostgreSQL

Terminal; Colombia; Presencial; COP 120.000.000 - 180.000.000; Jornada completa

Descripción de la vacante

VolFront is seeking a senior data engineer to own the data-loader fleet, the loader repository, its scheduled tasks, the live-quote infrastructure, and the PostgreSQL schema behind it. You will transform product direction into a robust, observable, scalable pipeline.

You will design ingestion standards, manage partitioned tables, optimize FDW and indexing, monitor data quality, and mentor junior engineers within a fast-paced, Azure-based environment.

Formación

• 6+ years building and running production data systems with end-to-end ownership.
• Deep PostgreSQL knowledge: partitioning, indexing, 100M+ row tables, FDW, vacuum/storage health.
• Strong Python for architecting loaders.
• Experience on Windows Server and Linux.
• Data-integrity obsession; fail-loud discipline.
• Pub/Sub over polling for live data.
• Mentoring or guiding junior engineers.
• Overlap with US Central Time window for pre-market monitoring.

Responsabilidades

• Own the market-data pipeline end-to-end across Windows Azure batch VM, Linux quote-cache, and PostgreSQL layers.
• Set ingestion standards: schema design, idempotency, partitioning, backfill, error handling.
• Own and optimize the PostgreSQL data layer at scale (partitioned tables, indexing, vacuum, storage).
• Ensure overnight/evening batch runs land complete data before US market open.
• Lead data-ops monitoring and incident response with runbooks.
• Eliminate recurring failures and tighten durability and observability.
• Harden the fleet with row-count checks, freshness metrics, and robust alerts.
• Reduce toil through logging standardization, IaC, and automation.
• Design and ship new loaders and data sources as the product grows.
• Evolve live-quote architecture (in-memory cache, FDW, HTTP API) and push-delta design.

Conocimientos

End-to-end ownership

PostgreSQL expertise

Python

Windows & Linux

Data integrity

Pub/Sub

Monitoring

Self-directed

US Central overlap

Herramientas

Go

Python

PostgreSQL

Azure

Terraform

Linux

Windows Server

PowerShell

GitHub CI/CD

Descripción del empleo

VolFront is seeking a senior data engineer to own the data-loader fleet, the loader repository, its scheduled tasks, the live-quote infrastructure, and the PostgreSQL schema behind it. You will transform product direction into a robust, observable, scalable pipeline.

You will design ingestion standards, manage partitioned tables, optimize FDW and indexing, monitor data quality, and mentor junior engineers within a fast-paced, Azure-based environment.