Eucloid - Lead Data Engineer - ETL/Apache Spark

Eucloid Data Solutions; Chennai District; On-site; INR 3,500,000 - 5,500,000; Full time

Job summary

Eucloid Data Solutions in Chennai is seeking a Lead Data Engineer to design and optimise scalable data infrastructure. The role requires hands-on experience with Spark, SQL, Python, and cloud platforms, delivering reliable pipelines in production environments.

You will drive data modeling, ETL/ELT architectures, and ensure data quality, latency and availability through rigorous testing and automation. Knowledge of Databricks is a plus.

Qualifications

• B.Tech/BS degree in CS/CE/Statistics or engineering disciplines.
• 6+ years of data engineering experience with scalable pipelines.
• Strong experience with Azure/AWS/GCP cloud data platforms.
• Hands-on with Apache Spark for large-scale batch/streaming processing.
• Expert-level SQL for complex transformations and analytics.
• Proficiency in Python for data engineering tasks and API integrations.
• Knowledge of data modeling techniques and analytics-friendly schemas.
• Experience designing scalable ETL/ELT architectures for large-scale platforms.
• Databricks experience is a plus.

Responsibilities

• Design, implement, and improve data infrastructure processes and automation.
• Tune data pipelines for reliability and performance.
• Build tools and scripts to develop, monitor, and troubleshoot ETLs.
• Regular scalability, latency, and availability testing.
• Conduct code reviews and QA data from various processes.
• Investigate, analyze, correct and document data defects.
• Create and maintain technical specification documentation.

Skills

SQL

Python

Data Modeling

ETL/ELT

Databricks

Education

B.Tech/BS degree in CS/CE/Statistics or engineering

Tools

Azure

AWS

GCP

Job description

Lead Data Engineer

Location: Chennai

Key Skills

• B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines.
• 6+ years of experience in data engineering, building scalable and reliable data pipelines in production environments.
• Strong experience with any cloud data platforms such as Azure/ AWS/ GCP.
• Hands‑on expertise with distributed data processing frameworks such as Apache Spark for large‑scale batch and/or streaming data processing.
• Expert‑level SQL skills with the ability to write optimized queries, perform complex transformations, and tune queries for large‑scale analytical workloads.
• Proficiency in Python for data engineering tasks including pipeline development, automation, data transformations, and integration with APIs or cloud services.
• Strong knowledge of data modeling techniques, including dimensional modeling, star/snowflake schemas, and designing data models optimized for analytics and reporting.
• Experience designing scalable ETL/ELT architectures, ensuring high data quality, reliability, and performance for large-scale data platforms.
• Strong experience or knowledge of Databricks will be a plus.

Responsibilities

• Design, implementation, and improvement of processes & automation of Data infrastructure.
• Tuning of Data pipelines for reliability & performance.
• Building tools and scripts to develop, monitor, and troubleshoot ETLs.
• Perform scalability, latency, and availability tests on a regular basis.
• Perform code reviews and QA data imported by various processes.
• Investigate, analyze, correct and document reported data defects.
• Create and maintain technical specification documentation.