Senior Data Engineer

StartAppss System India Pvt. Ltd.; Indore District; On-site; INR 1,800,000 - 3,600,000; Full time

Job summary

StartAppss System India Pvt. Ltd. is seeking an experienced Data Engineer to design, build and maintain scalable data infrastructure, pipelines, warehouses and real-time analytics capabilities.

You will work with Spark, Airflow, and cloud platforms (AWS/GCP/Azure), optimize queries and collaborate with data scientists to turn data into actionable insights. This role emphasizes data quality, monitoring, and documentation of data architecture within a fast-growing team in India.

Qualifications

• 5+ years of experience in data engineering.
• Strong proficiency in Python, SQL, and Scala.
• Experience with Spark, Airflow and cloud platforms (AWS, GCP, Azure).
• Knowledge of data warehousing concepts and ETL processes.
• Experience with real-time streaming data (Kafka, Kinesis preferred).
• Strong problem-solving skills and attention to detail.

Responsibilities

• Design and implement scalable data pipelines using Apache Spark and Airflow.
• Build data warehouses and data lakes on cloud platforms (AWS/GCP).
• Optimize database queries and improve data processing performance.
• Collaborate with data scientists and analytics teams to deliver insights.
• Implement data quality checks and monitoring systems.
• Document technical designs and maintain data architecture documentation.

Skills

Python

SQL

Scala

Tools

Apache Spark

Airflow

AWS

GCP

Azure

Job description

We're looking for an experienced Data Engineer to build and maintain our data infrastructure. You'll work on scalable data pipelines, data warehousing, and real-time analytics systems.

What You'll Do

• Design and implement scalable data pipelines using Apache Spark and Airflow
• Build data warehouses and data lakes on cloud platforms (AWS/GCP)
• Optimize database queries and improve data processing performance
• Collaborate with data scientists and analytics teams to deliver insights
• Implement data quality checks and monitoring systems
• Document technical designs and maintain data architecture documentation

What We're Looking For

• 5+ years of experience in data engineering
• Strong proficiency in Python, SQL, and Scala
• Experience with Apache Spark, Airflow, and cloud platforms (AWS/GCP/Azure)
• Knowledge of data warehousing concepts and ETL processes
• Experience with real-time streaming data (Kafka, Kinesis preferred)
• Strong problem-solving skills and attention to detail
• Experience with distributed systems and big data technologies