Python Developer -2

CloudThat Technologies Pvt. Ltd.; Mumbai; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

CloudThat Technologies Pvt. Ltd. is seeking a Python Developer with strong data engineering skills to build scalable data pipelines and automate workflows for analytics and ML teams.

You will design ETL processes, integrate diverse data sources, and deploy data workflows in production, collaborating with data engineers, analysts, and stakeholders to ensure clean, reliable data solutions across platforms.

Qualifications

• Bachelor's degree in CS, Engineering, or related technical field.
• Proven experience with Python data engineering and ETL.
• Strong knowledge of SQL databases and data patterns.

Responsibilities

• Develop, optimize, and maintain data pipelines using Python.
• Work with large datasets and ensure efficient ETL.
• Integrate data from various internal and external sources.
• Build reusable Python modules and automation scripts.
• Collaborate with data engineers, analysts, and stakeholders to understand requirements.
• Optimize performance of data processes and troubleshoot issues.
• Ensure data quality, validation, and integrity across systems.
• Deploy and monitor data workflows in production environments.

Skills

Python

Pandas

NumPy

PySpark

ETL development

SQL

PostgreSQL

MySQL

MongoDB

Spark/Hadoop

AWS/Azure/GCP

Airflow

Cron

Git

CI/CD

FastAPI/Flask for data services

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

Docker

Kubernetes

Job description

We are looking for a Python Developer with strong data engineering and data handling skills. The ideal candidate will work on building scalable data pipelines, automating workflows, integrating datasets, and supporting analytics and ML teams with clean, reliable data solutions.

Key Responsibilities:

• Develop, optimize, and maintain data pipelines using Python.
• Work with large datasets and ensure efficient extraction, transformation, and loading (ETL).
• Integrate data from various internal and external sources.
• Build reusable Python modules and automation scripts.
• Work closely with data engineers, analysts, and stakeholders to understand requirements.
• Optimize performance of data processes and troubleshoot issues.
• Ensure data quality, validation, and integrity across systems.
• Deploy and monitor data workflows in production environments.

Technical Skills Required:

• Strong hands-on experience in Python (Pandas, NumPy, PySpark preferred).
• Experience with ETL development and building data pipelines.
• Good understanding of SQL , complex queries, and stored procedures.
• Experience with databases (PostgreSQL, MySQL, MongoDB, or similar).
• Exposure to big data frameworks (Spark/Hadoop) is a strong advantage.
• Experience with cloud platforms (AWS/Azure/GCP) for data services.
• Familiarity with API integrations , automation, and scheduling tools (Airflow, Cron).
• Knowledge of version control (Git) and CI/CD practices.

Preferred Qualifications:

• Advanced experience with Python libraries used in data workflows (Pandas, NumPy, PySpark, FastAPI/Flask for data services).
• Hands-on experience with data warehousing concepts and building scalable data models.
• Practical understanding of ML model pipelines and supporting data science teams with clean, production-ready datasets.
• Experience working with workflow orchestration tools (Airflow, Prefect, Luigi).
• Familiarity with containerization and deployment (Docker/Kubernetes) for data applications.
• Strong understanding of cloud-based data services (AWS Glue, Redshift, Azure Data Factory, BigQuery).
• Bachelor’s degree in Computer Science, Engineering, or a related technical field.