Data Engineer

Skillfort Technologies; Chennai District; Hybrid; INR 3,500,000 - 7,500,000; Full time

Benefits offered by this job

Performance bonuses

Modern data stack & AI-ready pipelines

Learning & certification support

Remote options

Health insurance

Job summary

Skillfort Technologies is seeking a seasoned Data Engineer to design, build, and maintain data pipelines for batch and streaming workflows. You will optimize ETL/ELT processes using SQL, Python, and orchestration tools, and integrate data into data warehouses and lakehouses on cloud platforms.

The role requires strong SQL and Python skills, hands-on experience with Spark, Kafka, Airflow, and dbt, and a solid understanding of data modeling and governance.

Qualifications

• Strong expertise in SQL and Python.
• Hands-on with Spark, Kafka, Airflow, dbt.
• Experience with cloud data warehouses (Snowflake, BigQuery, Redshift).
• Familiar with Docker, Kubernetes, Terraform for deployment.
• Understanding of data modeling (Star/Snowflake schema, partitioning).
• Knowledge of data governance tools and CI/CD workflows.
• Strong problem-solving, debugging, and communication skills.
• 14 years of experience.

Responsibilities

• Design, build, and maintain data pipelines for batch and streaming workflows.
• Develop and optimize ETL/ELT processes using SQL, Python, and orchestration tools.
• Manage and integrate data from multiple sources into data warehouses/lakehouses.
• Ensure data quality, lineage, and governance across systems.
• Collaborate with analysts, scientists, and business teams to deliver reliable datasets.
• Monitor and troubleshoot pipeline performance, scalability, and security.
• Work with cloud platforms (AWS/Azure/GCP) for storage, compute, and deployment.

Skills

SQL

Python

Apache Spark

Kafka

Airflow

dbt

Cloud DW

Snowflake

BigQuery

Redshift

Docker

Kubernetes

Terraform

Data modeling

CI/CD

Communication

Tools

Docker

Kubernetes

Terraform

Job description

Role & responsibilities

• Design, build, and maintain data pipelines for batch and streaming workflows.
• Develop and optimize ETL/ELT processes using SQL, Python, and modern orchestration tools.
• Manage and integrate data from multiple sources into data warehouses/lakehouses.
• Ensure data quality, lineage, and governance across systems.
• Collaborate with analysts, scientists, and business teams to deliver reliable datasets.
• Monitor and troubleshoot pipeline performance, scalability, and security.
• Work with cloud platforms (AWS/Azure/GCP) for storage, compute, and deployment.

Preferred candidate profile

• Strong expertise in SQL and Python.
• Handson experience with Apache Spark, Kafka, Airflow, dbt.
• Knowledge of cloud data warehouses (Snowflake, BigQuery, Redshift).
• Familiarity with Docker, Kubernetes, Terraform for deployment.
• Good understanding of data modeling (Star/Snowflake schema, partitioning).
• Exposure to data governance tools and CI/CD workflows.
• Strong problemsolving, debugging, and communication skills.
• Experience range: 14 years

Perks and benefits

• Competitive salary package with performance bonuses.
• Opportunity to work on modern data stack & AIready pipelines.
• Learning & certification support for cloud/data engineering tools.
• Flexible work culture with remote options (role dependent).
• Health insurance and wellness programs.
• Fasttrack career path for high performers.