Data Engineer | Python SQL | 6 To 10 years | Short joiners

Capgemini; Hyderabad, Chennai, Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

Capgemini is seeking a Data Engineer with strong Python expertise to design, build, and optimize scalable data pipelines and architectures. The ideal candidate will work closely with data scientists, analysts, and business teams to ensure reliable data availability and quality.

This full-time role will involve building data pipelines, integrating sources, and deploying workflows on cloud platforms such as AWS, Azure, or GCP, with emphasis on data quality and scalability.

Qualifications

• Strong proficiency in Python.
• Experience with SQL and relational databases.
• Hands-on ETL experience.
• Familiarity with Spark or Hadoop.
• Knowledge of data warehousing.
• Experience with REST APIs.
• Understanding of data structures and algorithms.

Responsibilities

• Design, develop, and maintain robust data pipelines using Python.
• Build scalable ETL/ELT workflows.
• Work with large datasets using Pandas, PySpark, or Dask.
• Integrate data from multiple sources.
• Optimize data storage and retrieval.
• Ensure data quality and validation standards.
• Collaborate with cross-functional teams.
• Deploy and monitor pipelines using Airflow.
• Work on cloud platforms like AWS, Azure, or GCP.

Skills

Python

SQL

ETL

Spark

Hadoop

Data warehousing

REST APIs

Algorithms

Tools

Airflow

Pandas

PySpark

Docker

Kubernetes

Kafka

Job description

JD :

Location: Bangalore / Pune / Chennai / Hyderabad / Mumbai

Experience : 6 to 10 years

Job Type : Full-time

Job Summary:

We are seeking a skilled Data Engineer with strong Python expertise to design, build, and optimize scalable data pipelines and architectures. The ideal candidate will work closely with data scientists, analysts, and business teams to ensure reliable data availability and quality.

Key Responsibilities:

• Design, develop, and maintain robust data pipelines using Python
• Build scalable ETL/ELT workflows
• Work with large datasets using Pandas, PySpark, or Dask
• Integrate data from multiple sources
• Optimize data storage and retrieval
• Ensure data quality and validation standards
• Collaborate with cross-functional teams
• Deploy and monitor pipelines using Airflow
• Work on cloud platforms like AWS, Azure, or GCP

Required Skills & Qualifications

• Strong proficiency in Python
• Experience with SQL and relational databases
• Hands‑on ETL experience
• Familiarity with Spark or Hadoop
• Knowledge of data warehousing
• Experience with REST APIs
• Understanding of data structures and algorithms

Preferred Skills

• Cloud platform experience
• Docker/Kubernetes
• Kafka or stream processing
• CI/CD for data workflows
• Basic ML pipeline understanding

Note : Notice period - Immediate to serving notice till October.