Senior Data Engineer

Moolya Software Testing; Bengaluru; On-site; INR 1,500,000 - 2,300,000; Full time

Job summary

Moolya Software Testing is seeking a Senior Data Engineer in Bangalore to design, build, and optimize scalable data pipelines using Spark, SQL, and Airflow. You will work on large datasets, ETL/ELT workflows, and reliable data delivery for analytics.

The ideal candidate has 5+ years of data engineering experience, strong SQL proficiency, and hands-on Spark and Airflow skills, with additional exposure to Data Modeling, Data Warehousing, and Python.

Qualifications

• 5+ years of experience in Data Engineering.
• Strong expertise in SQL (primary evaluation area).
• Hands-on experience with Apache Spark and Airflow.

Responsibilities

• Design, build, and optimize large-scale ETL/ELT pipelines using Apache Spark.
• Develop, optimize, and maintain complex SQL queries for processing large volumes of data.
• Build, schedule, and monitor data pipelines using Apache Airflow.

Skills

SQL

Apache Spark

Apache Airflow

Data Modeling

Data Warehousing

Python

Tools

Delta Lake

Parquet

Job description

Job Title: Senior Data Engineer (Spark | SQL | Airflow)

Experience: 5+ Years
Location: Bangalore
Work Mode: Work from Office (WFO)

About the Role

We are looking for a highly skilled Senior Data Engineer with strong expertise in SQL, Apache Spark, and Apache Airflow to build and optimize scalable data pipelines. The ideal candidate should have hands-on experience working with large datasets, designing efficient ETL/ELT workflows, and ensuring reliable data delivery for analytics and business intelligence.

Key Responsibilities

• Design, build, and optimize large-scale ETL/ELT pipelines using Apache Spark.
• Develop, optimize, and maintain complex SQL queries for processing large volumes of data.
• Build, schedule, and monitor data pipelines using Apache Airflow.
• Collaborate with Data Science, Analytics, and Engineering teams to ensure high-quality and reliable data.
• Implement best practices for data engineering, performance optimization, and pipeline reliability.
• Work with structured and semi-structured data to support business reporting and analytics.

Required Skills & Qualifications

• 5+ years of experience in Data Engineering.
• Strong expertise in SQL (Primary evaluation area).
  • Complex SQL queries
  • Query optimization
  • Joins, CTEs, Window Functions
  • Performance tuning
• Hands-on experience with Apache Spark.
  • Distributed data processing
  • Spark DataFrame APIs
  • Performance optimization
• Experience with Apache Airflow for workflow orchestration and scheduling.
• Strong understanding of Data Modeling and Data Warehousing concepts.
• Excellent problem-solving and analytical skills.

Good to Have

• Experience with cloud platforms (AWS, GCP, or Azure).
• Proficiency in Python.
• Experience with Delta Lake and Parquet.

Interview Focus

The technical evaluation will primarily focus on SQL proficiency, including:

• Complex query writing
• Query optimization
• Window functions
• Joins and CTEs
• Performance tuning

Candidates should also demonstrate practical knowledge of Apache Spark and Apache Airflow through hands-on problem-solving and technical discussions.