Mid. Python Data Engineer

VMC Soft Technologies, Inc; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

VMC Soft Technologies, Inc in Chennai is seeking a Python Data Engineer with 6+ years of experience to design, build and maintain scalable data pipelines.

You will develop high-performance SQL and Python solutions, transform SQL logic into PySpark/Snowpark code, and collaborate with cross-functional teams using CI/CD pipelines and modern tools.

The role emphasizes testing with PyTest, data quality, and efficient data processing on Linux environments.

Qualifications

• Python with advanced SQL skills and data tooling experience.
• Hands-on PySpark/Snowpark and ETL/data pipeline development.
• Strong Pandas/NumPy skills for data manipulation.
• Linux commands and shell scripting proficiency.
• Ability to optimize data processing and performance.
• Experience with version control, CI/CD and modern development tools.
• Relevant experience with testing using PyTest and unit tests.
• Familiarity with RDBMS, data warehousing and data lakes.
• Analytical thinking and problem-solving abilities.

Responsibilities

• Design, build, deploy, and maintain scalable ETL/data pipelines.
• Develop high-performance SQL and Python solutions.
• Transform SQL logic into PySpark/Snowpark code.
• Perform testing, debugging, and unit testing using PyTest.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Work with CI/CD pipelines and modern development tools.

Skills

Python & SQL

PySpark

Snowpark

ETL

Pandas

NumPy

Linux

Shell scripting

Performance optimization

PyTest

Unit testing

RDBMS

Data Warehousing

Data Lakes

Analytical thinking

Tools

GitHub

Jenkins

VS Code

CI/CD

Snowflake

DBT

Autosys

Talend

Orchestration Tools

CDC

Java

Angular

API Design

AWS

Job description

We're Hiring | Python Data Engineer | Chennai | 6+ Years

Are you passionate about building scalable data pipelines and solving complex data engineering challenges? We're looking for an experienced Python Data Engineer to join our team in Chennai.

Location: Chennai

Experience: 6+ Years

Must-Have Skills

• Python & Advanced SQL
• PySpark / Snowpark
• ETL & Data Pipeline Development
• Pandas & NumPy
• Linux Commands & Shell Scripting
• Performance Optimization & Data Processing
• GitHub, Jenkins, VS Code & CI/CD
• PyTest / Unit Testing for Python & PySpark Code
• Experience with RDBMS, Data Warehousing & Data Lakes
• Strong analytical and problem-solving skills

Good-to-Have Skills

• AWS (S3, EC2)
• Snowflake
• DBT
• Autosys
• Talend
• Orchestration Tools
• CDC (Change Data Capture)
• Java & Angular
• API Design

Key Responsibilities

• Design, build, deploy, and maintain scalable ETL/data pipelines.
• Develop high-performance SQL and Python solutions.
• Transform SQL logic into PySpark/Snowpark code.
• Perform testing, debugging, and unit testing using PyTest.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Work with CI/CD pipelines and modern development tools.