Data Engineer (CITDE)

World Bank Group; Chennai; On-site; INR 4,000,000 - 7,000,000; Full time

Job summary

World Bank Group's IFC unit is seeking a Data Engineer (CITDE) in Chennai to own data products end-to-end, modernize pipelines with AI-assisted tooling, and build scalable data platforms.

You will work with Python, SQL, PySpark, and Databricks, delivering reliable lakehouse architectures, data contracts, and governance at scale, while mentoring teammates and guiding technical decisions.

Qualifications

• Master's degree in Computer Science, Data Engineering, Information Systems, or a closely related field with demonstrably equivalent depth of technical experience across the required stack.
• At least 7 years of hands-on data engineering experience, with at least 3 years in a lead or senior role designing and owning end-to-end pipelines (batch and streaming) at enterprise scale using Python, SQL, and Apache Spark.
• Demonstrated hands-on experience with Databricks (notebooks, jobs, Delta Lake, Unity Catalog) and lakehouse architecture, not just familiarity — the candidate should have built and operated production-grade solutions on this stack.
• Evidence of owning data products through their full lifecycle — from source discovery and design through release, adoption, and operational improvement — including writing data contracts, acceptance criteria, and service level definitions.
• Hands-on experience with cloud-native data infrastructure (Azure preferred, given IFC's environment), including security, governance, performance tuning, and cost management at scale.
• Experience integrating AI or ML pipelines into data product workflows, or responsible use of AI tooling within a production data engineering context.
• Desirable certifications: Databricks Certified Data Engineer; Microsoft Certified: Fabric Data Engineer Associate; relevant product ownership, product management, or SAFe certification.

Responsibilities

• Design and maintain secure batch and streaming pipelines using Python, SQL, PySpark, and modern frameworks.
• Develop data models, curated datasets, lakehouse layers, and data contracts for reliable downstream use.
• Translate business needs into product outcomes, acceptance criteria, service levels, and a prioritized backlog.
• Own assigned data products from source discovery through release, adoption, operation, improvement, and retirement.
• Use approved AI tools responsibly while retaining accountability for quality, security, privacy, and production outcomes.
• Improve reliability, freshness, performance, cost, lineage, access controls, testing, and production readiness.
• Lead technical decisions, review engineering work, mentor colleagues, and communicate risks and trade-offs clearly.

Skills

Python

SQL

PySpark

Databricks

Delta Lake

Unity Catalog

Lakehouse

Data contracts

Azure

AI pipelines

Education

Master's degree in Computer Science / Data Engineering / Information Systems

Tools

Databricks Notebooks

Job description

Data Engineer (CITDE)

Job # : req39191

Organization : IFC

Sector : Information Technology

Grade : GF

Term Duration : Open-Ended Staff (OPEN-OP)

Recruitment Type : Local Recruitment

Location : Chennai,India

Required Language(s) : English

Preferred Language(s) :

Closing Date : 11/16/2026 (MM/DD/YYYY) at 11:59pm UTC

At the International Finance Corporation (IFC), a member of the World Bank Group (WBG), you’ll join a diverse, global community working across cultures, disciplines, and borders to address the world’s most pressing development challenges. With 1.2 billion young people reaching working age in the decade ahead, the challenge of job creation has never been greater. Through partnerships across 145 countries and more than 182 offices worldwide, we work with governments, private sector, development partners and other stakeholders to invest in people, strengthen markets, and deliver scalable, data-driven solutions that generate more and better jobs and improve lives. In fiscal year 2026, IFC committed a record $105.6 billion to private companies and financial institutions in developing countries. For more information, visit www.ifc.org.

The Corporate Information Technologies Department enables IFC’s strategic priorities and operations through secure, reliable technology solutions. CIT partners with the business to automate processes, improve responsiveness and efficiency, manage risk, and strengthen data, analytics, information, knowledge, and learning capabilities. CITDE is IFC’s data solutions organization, building trusted data foundations, scalable platforms, and data products that power decisions, analytics, AI, and operational excellence. We combine modern engineering, product thinking, and business impact to solve institution-wide challenges, accelerate innovation, and create measurable value across global development programs.

In FY26, IFC committed $105.6 billion to private-sector development in emerging markets. Development finance at that scale depends on data that stands up to scrutiny, whether the question comes from an investment officer, an executive, or an AI agent. This team builds that foundation.

In this role, you'll own data products end-to-end on Databricks, modernize legacy pipelines with AI doing part of the heavy lifting, and design the evaluation frameworks that help us decide when agent-generated outputs can be trusted. You'll work at the intersection of data engineering, AI-enabled development, and data quality, helping shape how one of the world's leading development finance institutions uses data and AI to make better decisions. If you already use Claude Code, Copilot, or agents you've built yourself in real engineering work, even if only on personal projects, this could be your opportunity to apply those skills to problems that matter at global scale.

Duties and accountabilities:

• Design and maintain secure batch and streaming pipelines using Python, SQL, PySpark, and modern frameworks.
• Develop data models, curated datasets, lakehouse layers, and data contracts for reliable downstream use.
• Translate business needs into product outcomes, acceptance criteria, service levels, and a prioritized backlog.
• Own assigned data products from source discovery through release, adoption, operation, improvement, and retirement.
• Use approved AI tools responsibly while retaining accountability for quality, security, privacy, and production outcomes.
• Improve reliability, freshness, performance, cost, lineage, access controls, testing, and production readiness.
• Lead technical decisions, review engineering work, mentor colleagues, and communicate risks and trade-offs clearly.

Selection Criteria

• Master's degree in Computer Science, Data Engineering, Information Systems, or a closely related field with demonstrably equivalent depth of technical experience across the required stack.
• At least 7 years of hands-on data engineering experience, with at least 3 years in a lead or senior role designing and owning end-to-end pipelines (batch and streaming) at enterprise scale using Python, SQL, and Apache Spark.
• Demonstrated hands-on experience with Databricks (notebooks, jobs, Delta Lake, Unity Catalog) and lakehouse architecture, not just familiarity — the candidate should have built and operated production-grade solutions on this stack.
• Evidence of owning data products through their full lifecycle — from source discovery and design through release, adoption, and operational improvement — including writing data contracts, acceptance criteria, and service level definitions
• Hands-on experience with cloud-native data infrastructure (Azure preferred, given IFC's environment), including security, governance, performance tuning, and cost management at scale.
• Experience integrating AI or ML pipelines into data product workflows, or responsible use of AI tooling within a production data engineering context.
• Desirable certifications: Databricks Certified Data Engineer; Microsoft Certified: Fabric Data Engineer Associate; relevant product ownership, product management, or SAFe certification.

As the World Bank Group continues to evolve, we value candidates who:

• Demonstrate the ability to collaborate effectively across teams, disciplines, cultures, and institutional boundaries.
• Responsibly leverage digital and AI-enabled tools to enhance productivity, learning, and decision-making.
• Bring experience working in fragile, conflict-affected, and violent (FCV) contexts and are encouraged to highlight relevant experience in their application materials, where applicable.

WBG Culture Attributes:

• 1. Sense of urgency: Anticipate and quickly respond to the needs of internal and external stakeholders.
• 2. Thoughtful risk-taking: Challenge the status quo and push boundaries to achieve greater impact.
• 3. Empowerment and accountability: Empower yourself and others to act and hold each other accountable for results.

World Bank Group Core Competencies

The World Bank Group offers comprehensive benefits, including a retirement plan; medical, life and disability insurance; and paid leave, including parental leave, as well as reasonable accommodations for individuals with disabilities.

We are proud to be an equal opportunity and inclusive employer with a dedicated and committed workforce, and do not discriminate based on gender, gender identity, religion, race, ethnicity, sexual orientation, or disability.

Learn more about working at the World Bank and IFC including our values and inspiring stories.