Senior Data Engineer

Kilwa Technologies; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Kilwa Technologies is seeking a senior data engineer to own ingestion pipelines for macroeconomic, policy, and news data across multiple African markets and languages. The role emphasizes data quality as a product feature, provenance, and handling sparse sources while maintaining security standards.

You will work in a production environment, ensuring reliability and integrity of data, with a focus on cross-market coverage and multilingual data handling.

Qualifications

• Production data pipelines across multiple sources and formats.
• Ability to treat data quality as a product feature for downstream consumers.
• Experience with modern data infrastructure in live environments.
• Comfort with multilingual and irregular data sources from diverse markets.

Responsibilities

• Own the end-to-end ingestion pipelines for macroeconomic, policy, and news data.
• Maintain end-to-end provenance tagging for all inputs (verified or estimate).
• Engineer around sparse, irregular sources without masking gaps.
• Operate the platform to reliability standards including encryption in transit/rest.

Skills

Data pipelines

Data quality as product

Production orchestration

Encryption & security

Job description

Role overview

A senior data engineering role responsible for the ingestion backbone behind a multilingual, multi-market intelligence platform. The scope spans macroeconomic, policy, and news data across dozens of African markets and dozens of registered languages, with provenance carried end to end. It is fundamentally a data quality and reliability problem set against genuinely uneven source coverage.

Responsibilities

• Own the pipelines that ingest macroeconomic, policy, and news data across a broad set of African markets.
• Carry provenance end to end so every input arrives at the model tagged as verified or estimate.
• Engineer around sparse and irregular source data without silently imputing values that mask the gaps.
• Operate the platform to institutional reliability standards, including AES-256 encryption in transit and at rest.
• Treat data quality as a first-class product feature surfaced to downstream consumers rather than a cleanup task.

Requirements

• Deep experience with modern data infrastructure and orchestration in production environments.
• Comfort with genuinely messy international sources — inconsistent schedules, formats, and languages.
• An instinct for data quality as a product feature rather than a backlog item.
• Familiarity with low-resource, multilingual data environments and the discipline those settings demand.

Nice to have

• Experience designing provenance frameworks that survive auditing by external stakeholders.
• Background handling official statistical, policy, and news sources in multiple African languages.