Data Engineer

TechRuiter; India; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

TechRuiter in India is seeking a Data Engineer to design, develop, and maintain scalable ETL pipelines that process large-scale datasets. You will integrate data from multiple sources while ensuring quality, security, and consistency.

You will collaborate with data scientists, analysts, and software engineers to deliver well-structured datasets, build data infrastructure using Spark, Hadoop, and Kafka, and deploy cloud solutions on AWS, GCP or Azure.

Qualifications

• At least 5 years of related data engineering experience.
• Strong SQL skills and experience with PostgreSQL, MySQL, MongoDB, etc.
• Proficient in Python, Java, or Scala for data processing.
• Deep ETL, data modeling, and data warehousing expertise.
• Hands-on experience with Spark, Hadoop, or Kafka.
• Experience with cloud data platforms (AWS Redshift, BigQuery, Azure Synapse).
• Experience optimizing data pipelines for scalability and performance.
• Knowledge of data governance, security, and compliance best practices.
• Strong leadership, collaboration, and communication skills.

Responsibilities

• Design, develop, and maintain scalable ETL pipelines for large-scale datasets.
• Integrate structured and unstructured data from multiple sources with quality and security.
• Collaborate with data scientists, analysts, and engineers to deliver accessible datasets.
• Build and optimize data infrastructure using Spark, Hadoop, and Kafka.
• Deploy and manage cloud-based data solutions on AWS, GCP, or Azure.
• Monitor and troubleshoot data pipeline performance for reliability.
• Implement data governance, security, and compliance best practices.
• Drive automation, testing, and continuous improvements in data workflows.

Skills

data governance and security

leadership and collaboration

problem solving

communication skills

Education

Bachelor’s degree or equivalent

Tools

SQL

PostgreSQL

MySQL

MongoDB

Python

Java

Scala

Apache Spark

Hadoop

Kafka

AWS Redshift

Google BigQuery

Azure Synapse

Job description

Posted On 08/24/2026

Job Description

Responsibilities

• Design, develop, and maintain scalable ETL pipelines to process and transform large-scale datasets.
• Integrate structured and unstructured data from multiple sources, ensuring quality, security, and consistency.
• Collaborate with data scientists, analysts, and software engineers to deliver well-structured and accessible datasets.
• Build and optimize data infrastructure using big data technologies such as Apache Spark, Hadoop, and Kafka.
• Deploy and manage cloud-based data solutions on AWS, GCP, or Azure.
• Monitor and troubleshoot data pipeline performance, ensuring reliability and efficiency.
• Implement data governance, security, and compliance best practices.
• Drive automation, testing strategies, and continuous improvements in data engineering workflows.
  

Qualifications

• 5 years of related experience with a Bachelor’s degree or equivalent work experience.
• Advanced proficiency in SQL and experience with relational and NoSQL databases (PostgreSQL, MySQL, MongoDB, etc.).
• Strong programming skills in Python, Java, or Scala for data processing and automation.
• Deep expertise in ETL processes, data modeling, and data warehousing.
• Hands‑on experience with big data frameworks such as Apache Spark, Hadoop, or Kafka.
• Proficiency in cloud platforms (AWS Redshift, Google BigQuery, Azure Synapse) and data infrastructure automation.
• Experience optimizing data pipeline performance and scalability.
• Strong problem‑solving skills with the ability to work on complex, large-scale datasets.
• Knowledge of data governance, security, and compliance best practices.
• Excellent leadership, collaboration, and communication skills to work effectively across teams.