Senior Data Engineer - Multilingual Data Pipelines

Kilwa Technologies; United States; Remote; USD 150,000 - 190,000; Full time

Job summary

Kilwa Technologies is seeking a senior data engineer to own ingestion pipelines for macroeconomic, policy, and news data across multiple African markets and languages. The role emphasizes data quality as a product feature, provenance, and handling sparse sources while maintaining security standards.

You will work in a production environment, ensuring reliability and integrity of data, with a focus on cross-market coverage and multilingual data handling.

Qualifications

• Production data pipelines across multiple sources and formats.
• Ability to treat data quality as a product feature for downstream consumers.
• Experience with modern data infrastructure in live environments.
• Comfort with multilingual and irregular data sources from diverse markets.

Responsibilities

• Own the end-to-end ingestion pipelines for macroeconomic, policy, and news data.
• Maintain end-to-end provenance tagging for all inputs (verified or estimate).
• Engineer around sparse, irregular sources without masking gaps.
• Operate the platform to reliability standards including encryption in transit/rest.

Skills

Data pipelines

Data quality as product

Production orchestration

Encryption & security

Job description

Kilwa Technologies is seeking a senior data engineer to own ingestion pipelines for macroeconomic, policy, and news data across multiple African markets and languages. The role emphasizes data quality as a product feature, provenance, and handling sparse sources while maintaining security standards.

You will work in a production environment, ensuring reliability and integrity of data, with a focus on cross-market coverage and multilingual data handling.