Senior Data Engineer

Ciklum India; Chennai District; On-site; INR 3,500,000 - 5,500,000; Full time

Benefits offered by this job

Company-paid medical insurance

Mental health support

Financial & legal consultations

Udemy access

Language courses

Company-paid certifications

Job summary

Ciklum India is seeking a Senior Data Engineer to join our fast-growing product engineering team in India. You will design, build, and deploy data solutions that deliver key business insights at scale, partnering with analytics, software, and product teams to solve complex challenges.

In this role you’ll work with PySpark, Spark, Databricks, Delta Lake, and Parquet to develop robust data pipelines, optimize queries, and drive efficient data models and dashboards that empower decision makers

Qualifications

• 5+ years of hands-on software development experience
• Strong expertise in Apache Spark, including delivery on Databricks
• Proficient in Python with advanced data engineering skills using PySpark, Pandas, and related libraries
• Experience developing and maintaining unit tests for Databricks workloads
• Solid understanding of columnar storage (e.g., Parquet) and hands-on experience with Delta Lake / Delta Tables
• Proven ability to handle large data volumes and performance tuning
• Familiarity with Databricks DevOps practices (nice to have)
• Demonstrated ability to build data ingestion, transformation, and analytics pipelines
• Strong analytical and problem-solving skills with close attention to detail

Responsibilities

• Designing, developing, and deploying solutions, providing advanced data analytics, and creating dashboards and reports that deliver key insights to the business
• Data models design and implementation
• Optimize reports and dashboards for better performance by improving query speed and ensuring efficient data model design
• Contributes design, code, configurations, manage data ingestion, close to real-time processing, batch processing, ETL across multiple data storages
• Responsible for performance tuning of complicated SQL and DAX queries
• Identify gaps and improve the platform’s quality, robustness, maintainability, and speed
• Cross-train other team members on technologies being developed, while also continuously learning new technologies from other team members
• Contribute in the Unit’s activities and community building, participate in conferences, and provide excellence in exercise and best practices

Skills

Python

PySpark

Spark

Databricks

Delta Lake

SQL

Data Modeling

ETL

Pandas

Unit Testing

Tools

Databricks

Parquet

Delta Lake

DevOps

Job description

Job Description

Ciklum is looking for a Senior Data Engineer to join our team full-time in India. We are a custom product engineering company that supports both multinational organizations and scaling startups to solve their most complex business challenges. With a global team of over 4,000 highly skilled developers, consultants, analysts and product owners, we engineer technology that redefines industries and shapes the way people live.

About The Role

As a Senior Data Engineer, become a part of a cross-functional development team engineering experiences of tomorrow.

Responsibilities

• Designing, developing, and deploying solutions, providing advanced data analytics, and creating dashboards and reports that deliver key insights to the business
• Data models design and implementation
• Optimize reports and dashboards for better performance by improving query speed and ensuring efficient data model design
• Contributes design, code, configurations, manage data ingestion, close to real-time processing, batch processing, ETL across multiple data storages
• Responsible for performance tuning of complicated SQL and DAX queries
• Identify gaps and improve the platform’s quality, robustness, maintainability, and speed
• Cross-train other team members on technologies being developed, while also continuously learning new technologies from other team members
• Contribute in the Unit’s activities and community building, participate in conferences, and provide excellence in exercise and best practices

Requirements

• 5+ years of hands-on software development experience
• Strong expertise in Apache Spark, including delivery on Databricks
• Proficient in Python with advanced data engineering skills using PySpark, Pandas, and related libraries
• Experience developing and maintaining unit tests for Databricks workloads
• Solid understanding of columnar storage (e.g., Parquet) and hands‑on experience with Delta Lake / Delta Tables
• Proven ability to handle small to large data volumes, including performance tuning and optimizations
• Familiarity with Databricks DevOps practices (nice to have)
• Demonstrated ability to build data ingestion, transformation, and analytics pipelines
• Strong analytical and problem‑solving skills with close attention to detail

What’s in it for you?

• Strong community: Work alongside top professionals in a friendly, open-door environment
• Growth focus: Take on large-scale projects with a global impact and expand your expertise
• Tailored learning: Boost your skills with internal events (meetups, conferences, workshops), Udemy access, language courses, and company‑paid certifications
• Endless opportunities: Explore diverse domains through internal mobility, finding the best fit to gain hands‑on experience with cutting‑edge technologies
• Care: We’ve got you covered with company‑paid medical insurance, mental health support, and financial & legal consultations

About Us

At Ciklum, we are always exploring innovations, empowering each other to achieve more, and engineering solutions that matter. With us, you’ll work with cutting‑edge technologies, contribute to impactful projects, and be part of a One Team culture that values collaboration and progress.

India is a strategic innovation hub for Ciklum, with growing teams in Chennai and Pune leading advancements in EdgeTech, AR/VR, IoT, and beyond. Join us to collaborate on game‑changing solutions and take your career to the next level.

Explore, empower, engineer with Ciklum!