Senior / Lead Data Engineer

Eucloid Data Solutions; Chennai District; On-site; INR 2,800,000 - 4,200,000; Full time

Job summary

Eucloid Data Solutions is seeking a Lead Data Engineer to join our Data Platform team in Chennai on-site. The role focuses on building scalable data pipelines and infrastructure to support multiple business applications.

The ideal candidate has 5+ years of data engineering experience, strong Python, PySpark, SQL, and cloud expertise (AWS/GCP preferred, Azure also). You will collaborate with software developers, DBAs, and data analysts to design and optimize end-to-end data flows and ETL/ELT

Qualifications

• 5+ years of data engineering experience.
• Experience with cloud data platforms (Azure/AWS/GCP).
• Proficiency with Apache Spark for large-scale processing.
• Advanced SQL skills for analytics and transformations.
• Proficient in Python for data engineering tasks.
• Knowledge of data modeling (star/snowflake) for analytics.
• Experience designing scalable ETL/ELT architectures.
• Databricks knowledge is a plus.

Responsibilities

• Design, implement, and improve data infrastructure processes and automation.
• Tune data pipelines for reliability and performance.
• Build tools and scripts to develop, monitor, and troubleshoot ETLs.
• Perform scalability, latency, and availability testing regularly.
• Conduct code reviews and QA of data imports.
• Investigate, analyze, and document data defects.
• Create and maintain technical specification documentation.

Skills

Python

Pyspark

SQL

DSA

AWS

GCP

Azure

Education

B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines

Tools

Databricks

Apache Spark

Job description

Lead Data Engineer

Location: Chennai - onsite

Experience : 5+ years

Mandatory skills : Python, Pyspark , SQL , DSA, Cloud (AWS /GCP - 1st priority , Azure)

About us :

• Website: Eucloid Data Solutions Pvt. Ltd.
• LinkedIn: https://www.linkedin.com/company/eucloid-data-solutions
• Eucloid Journey: https://bit.ly/eucloidvideo

Job Description

Eucloid is looking for a Lead Data Engineer to join our Data Platform team supporting various business applications.

The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of different components.

Candidate will also involve in projects like integrating data from various sources, managing big data pipelines that are easily accessible with optimized performance of overall ecosystem.

The ideal candidate is an experienced data wrangler who will support our software developers, database architects and data analysts on business initiatives.

You must be self-directed and comfortable supporting the data needs of cross-functional teams, systems, and technical solutions.

Location: Chennai

Key Skills

• B.Tech/BS degree in Computer Science, Computer Engineering, Statistics, or other Engineering disciplines
• 6+ years of experience in data engineering, building scalable and reliable data pipelines in production environments.
• Strong experience with any cloud data platforms such as Azure/ AWS/ GCP.
• Hands-on expertise with distributed data processing frameworks such as Apache Spark for large-scale batch and/or streaming data processing.
• Expert-level SQL skills with the ability to write optimized queries, perform complex transformations, and tune queries for large-scale analytical workloads.
• Proficiency in Python for data engineering tasks including pipeline development, automation, data transformations, and integration with APIs or cloud services.
• Strong knowledge of data modeling techniques, including dimensional modeling, star/snowflake schemas, and designing data models optimized for analytics and reporting.
• Experience designing scalable ETL/ELT architectures, ensuring high data quality, reliability, and performance for large-scale data platforms.
• Strong experience or knowledge of Databricks will be a plus.

Responsibilities

• Design, implementation, and improvement of processes & automation of Data infrastructure
• Tuning of Data pipelines for reliability & performance
• Building tools and scripts to develop, monitor, and troubleshoot ETLs
• Perform scalability, latency, and availability tests on a regular basis.
• Perform code reviews and QA data imported by various processes.
• Investigate, analyze, correct and document reported data defects.
• Create and maintain technical specification documentation.