Data Engineer (CITDE)

CGAP; Chennai; In loco; INR 1.800.000 - 2.800.000; Tempo pieno

Descrizione del lavoro

International Finance Corporation (IFC) in Chennai is seeking a data engineer to own data products end-to-end on Databricks, modernize legacy pipelines with AI-assisted techniques, and design evaluation frameworks that ensure trusted outputs at global scale.

Design and maintain secure batch and streaming pipelines using Python, SQL, and PySpark; develop data models, lakehouse layers, and data contracts; translate business needs into measurable outcomes, own the data product lifecycle, and lead

Competenze

• Experience designing data products and pipelines.
• Proficiency in Python, SQL, and Spark-based workloads.
• Ability to translate business needs into measurable data outcomes.

Mansioni

• Design and maintain secure batch and streaming pipelines using Python, SQL, PySpark, and modern frameworks.
• Develop data models, lakehouse layers, and data contracts for reliable downstream use.
• Translate business needs into product outcomes, acceptance criteria, service levels, and a prioritized backlog.
• Own assigned data products from source discovery through release, adoption, operation, improvement, and retirement.
• Use approved AI tools responsibly while retaining accountability for quality, security, privacy, and production outcomes.
• Improve reliability, freshness, performance, cost, lineage, access controls, testing, and production readiness.
• Lead technical decisions, review engineering work, mentor colleagues, and communicate risks and trade-offs clearly.

Conoscenze

Python

SQL

PySpark

Data modeling

Strumenti

Databricks

Descrizione del lavoro

At the International Finance Corporation (IFC), a member of the World Bank Group (WBG) , you’ll join a diverse, global community working across cultures, disciplines, and borders to address the world’s most pressing development challenges. With 1.2 billion young people reaching working age in the decade ahead, the challenge of job creation has never been greater. Through partnerships across 145 countries and more than 182 offices worldwide, we work with governments, private sector, development partners and other stakeholders to invest in people, strengthen markets, and deliver scalable, data-driven solutions that generate more and better jobs and improve lives. In fiscal year 2026, IFC committed a record $105.6 billion to private companies and financial institutions in developing countries. For more information, visit www.ifc.org. The Corporate Information Technologies Department enables IFC’s strategic priorities and operations through secure, reliable technology solutions. CIT partners with the business to automate processes, improve responsiveness and efficiency, manage risk, and strengthen data, analytics, information, knowledge, and learning capabilities.CITDE is IFC’s data solutions organization, building trusted data foundations, scalable platforms, and data products that power decisions, analytics, AI, and operational excellence. We combine modern engineering, product thinking, and business impact to solve institution-wide challenges, accelerate innovation, and create measurable value across global development programs. In FY26, IFC committed $105.6 billion to private-sector development in emerging markets. Development finance at that scale depends on data that stands up to scrutiny, whether the question comes from an investment officer, an executive, or an AI agent. This team builds that foundation. In this role, you'll own data products end-to-end on Databricks, modernize legacy pipelines with AI doing part of the heavy lifting, and design the evaluation frameworks that help us decide when agent-generated outputs can be trusted. You’ll work at the intersection of data engineering, AI-enabled development, and data quality, helping shape how one of the world's leading development finance institutions uses data and AI to make better decisions. If you already use Claude Code, Copilot, or agents you've built yourself in real engineering work, even if only on personal projects, this could be your opportunity to apply those skills to problems that matter at global scale. Duties and accountabilities:

• Design and maintain secure batch and streaming pipelines using Python, SQL, PySpark, and modern frameworks.
• Develop data models, curated datasets, lakehouse layers, and data contracts for reliable downstream use.
• Translate business needs into product outcomes, acceptance criteria, service levels, and a prioritized backlog.
• Own assigned data products from source discovery through release, adoption, operation, improvement, and retirement.
• Use approved AI tools responsibly while retaining accountability for quality, security, privacy, and production outcomes.
• Improve reliability, freshness, performance, cost, lineage, access controls, testing, and production readiness.
• Lead technical decisions, review engineering work, mentor colleagues, and communicate risks and trade-offs clearly.