Recebe uma resposta deste empregador
O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.
HRBaires is expanding a data engineering team and seeks a mid-senior Data Engineer to migrate legacy SQL Server/Azure Synapse pipelines to Apache Spark and Delta Lake. You will implement typed PySpark pipelines, validate outputs against legacy results, and deploy FastAPI services to monitor and report on jobs.
You will also integrate provider-neutral LLM features into data workflows, writing tests and docs alongside code changes. Remote work is available with alignment to SA hours.
Location: Europe (Remote) — must work South Africa hours (UTC+2)
Employment: Full-time
Seniority: Mid-Senior Level
Salary: $80,000 – $120,000 (estimate; client hasn’t disclosed range)
A fast-growing privacy-preserving data collaboration fintech (Series A, backed by a global credit bureau and a major retailer), with teams spanning South Africa, the UK, the US, the UAE and Brazil. Banks and lenders use the platform to work with retailer and telco data without raw personal data changing hands — mainly to help people with no credit history access credit.
The Data Team Is Migrating Legacy SQL Server / Azure Synapse Stored‑procedure Pipelines Onto Open‑source Apache Spark And Delta Lake. You Will
Spec-first codebase: design docs and ADRs, with tests and documentation shipped alongside every change.
Python, PySpark, Spark SQL, Delta Lake, FastAPI, pytest, Docker, T‑SQL, LLM integration
Skills: apache spark,credit,fastapi,pipelines,apache,azure,fintech,data,sql,python,spark,english