Data Engineer

Ciklum India; Chennai District; On-site; INR 1,200,000 - 2,400,000; Full time

Benefits offered by this job

Company-paid medical insurance

Mental health support

Udemy access

Certifications

Job summary

Ciklum is seeking a Data Engineer to join our team in India on a full-time basis. The role focuses on building and enhancing enterprise data pipelines that ingest data from multiple sources into Databricks Unity Catalog and Delta Lake, enabling entity resolution, data remediation, and AI-enabled workflows.

Ideal candidates have strong PySpark and Python experience, with hands-on work on data pipelines and API integrations.

Qualifications

• Strong experience in PySpark, Python, and Databricks (Unity Catalog & Delta Lake).
• Hands-on experience with enterprise data pipelines, entity resolution/matching, and data remediation.
• Experience integrating APIs into data engineering workflows.
• Exposure to LLM-assisted data workflows or AI-enabled data engineering is a plus.
• 5+ years of experience in Data Engineering.
• Experience with large-scale enterprise data platforms and modern data architectures.

Responsibilities

• Strengthens the remediation and matching layer of that pipeline, specifically automatic remediation.
• D&B DataBlocks matching.
• LLM-assisted remediation.
• Supports the CMG redesign project.

Skills

PySpark

Python

Databricks Unity Catalog

Delta Lake

Data Pipelines

APIs

LLM/AI workflows

Tools

Databricks

Job description

Job Description

Ciklum is looking for a Data Engineer to join our team full-time in India.

We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About The Role

As a Data Engineer, become a part our Enterprise Data Strategy team. In this role, you will build and enhance enterprise data pipelines that ingest data from multiple sources into Databricks Unity Catalog and Delta Lake, supporting entity resolution, data remediation, and AI-enabled data workflows.

Responsibilities

• Strengthens the remediation and matching layer of that pipeline, specifically automatic remediation
• D&B DataBlocks matching
• LLM-assisted remediation
• Supports the CMG redesign project

Requirements

• Strong experience in PySpark, Python, and Databricks (Unity Catalog & Delta Lake)
• Hands-on experience with enterprise data pipelines, entity resolution/matching, and data remediation
• Experience integrating APIs into data engineering workflows
• Exposure to LLM-assisted data workflows or AI-enabled data engineering is a plus

Desirable

• 5+ years of experience in Data Engineering
• Experience working with large-scale enterprise data platforms and modern data architectures

What's in it for you?

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company-paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands-on experience with cutting-edge technologies
• Care: We've got you covered with company-paid medical insurance, mental health support, and financial & legal consultations

About Us

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you'll work with cutting-edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game-changing solutions and take your career to the next level.

Explore, empower, engineer with Ciklum!