Data Engineer

Description Ciklum; India; On-site; INR 1,500,000 - 2,100,000; Full time

Benefits offered by this job

Medical insurance

Mental health support

Financial & legal consultations

Job summary

Ciklum is seeking a Data Engineer to join our India team on a full-time basis. You will build and optimize enterprise data pipelines using PySpark, Python, Unity Catalog, and Delta Lake, enabling robust data remediation and entity resolution.

The role emphasizes API integration and AI-enabled workflows within enterprise data platforms. You will work in a dynamic environment with a focus on Large Language Model-assisted data workflows, data quality, and scalable architecture, contributing to

Qualifications

• 5+ years of Data Engineering experience.
• Strong experience with PySpark, Python, and Databricks Unity Catalog & Delta Lake.
• Experience building enterprise data pipelines and data remediation.
• Experience integrating APIs into data workflows.
• Familiarity with AI-enabled data workflows or LLMs is a plus.

Responsibilities

• Strengthens the remediation and matching layer of the pipeline, focusing on automatic remediation.
• D&B DataBlocks matching.
• LLM-assisted remediation.
• Supports the CMG redesign project.

Skills

PySpark

Python

Databricks Unity Catalog

Delta Lake

APIs integration

LLM-enabled workflows

5+ years exp

Job description

Ciklum is looking for a Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About the role:

As a Data Engineer, become a part our Enterprise Data Strategy team. In this role, you will build and enhance enterprise data pipelines that ingest data from multiple sources into Databricks Unity Catalog and Delta Lake, supporting entity resolution, data remediation, and AI-enabled data workflows.

Responsibilities:

• Strengthens the remediation and matching layer of that pipeline, specifically automatic remediation
• D&B DataBlocks matching
• LLM-assisted remediation
• Supports the CMG redesign project

Requirements:

• Strong experience in PySpark, Python, and Databricks (Unity Catalog & Delta Lake)
• Hands-on experience with enterprise data pipelines, entity resolution/matching, and data remediation
• Experience integrating APIs into data engineering workflows
• Exposure to LLM-assisted data workflows or AI-enabled data engineering is a plus
• 5+ years of experience in Data Engineering
• Experience working with large-scale enterprise data platforms and modern data architectures

What’s in it for you?

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
• Care: We’ve got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

About us:

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Explore, empower, engineer with Ciklum!