Data Engineer

Crayon Data; Chennai District; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A technology firm in Chennai is seeking a Data Engineer to develop scalable data pipelines and integrate data from multiple sources. You will work closely with data scientists and software engineers. Ideal candidates should have 2–3 years experience in data engineering and strong skills in Python or Java. This full-time role offers the opportunity to work on exciting analytics solutions in a collaborative environment.

Qualifications

• 2–3 years of experience in data engineering, data warehousing, or big data environments.
• Strong programming skills in Python or Java.
• Hands-on experience with ETL tools and data pipeline frameworks.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines for data.
• Ingest data from various sources into centralized data platforms.
• Enhance data processing speed, reliability, and scalability.

Skills

Python

Java

Spark

Kafka

Airflow

Tools

ETL tools

Airflow

Spark

Kafka

PostgreSQL

MySQL

Job description

Data Engineer – Chennai

Location: Chennai, India

Experience: 2–3 years in data engineering or data-driven product development

As a Data Engineer, you will be responsible for building and maintaining scalable data pipelines and architectures that enable AI and analytics solutions. You’ll work closely with data scientists, software engineers, and product teams to ensure data is clean, reliable, and ready for advanced modeling and insights.

What You’ll Do

• Data Pipeline Development – Design, build, and maintain robust ETL/ELT pipelines for structured and unstructured data.
• Data Integration – Ingest data from various sources (APIs, databases, cloud storage) into centralized data platforms.
• Performance Optimization – Enhance data processing speed, reliability, and scalability.
• Cloud Data Engineering – Work with cloud platforms (AWS, Azure, or GCP) for data storage, processing, and orchestration.
• Collaboration – Partner with data scientists and analysts to ensure data availability and quality for downstream use cases.
• Best Practices – Ensure code quality, data security, and maintainability through testing, automation, and documentation.

What Makes You Right for This Role

• 2–3 years of experience in data engineering, data warehousing, or big data environments.
• Strong programming skills in Python or Java (experience with PySpark or Scala is a plus).
• Hands‑on experience with ETL tools and data pipeline frameworks (e.g., Airflow, Spark, Kafka).
• Proficiency in working with SQL and relational databases (PostgreSQL, MySQL, etc.).
• Familiarity with cloud platforms such as AWS (Glue, S3, Redshift), Azure (Data Factory, Synapse), or GCP (BigQuery, Dataflow).
• Exposure to containerization (Docker, Kubernetes) and CI/CD workflows is a plus.
• Passionate about data, automation, and building systems that drive intelligent decision‑making.
• Based in Chennai, with flexibility to collaborate with global teams.

Java | Python | Spark | Kafka | Airflow |

Seniority Level

Associate

Employment Type

Full-time

Job Function

IT Services and IT Consulting