Senior Data Engineer

Terasol Technologies Pvt. Ltd.; Gurgaon; Remote; INR 1,000,000 - 1,500,000; Full time

Benefits offered by this job

Remote work flexibility

Paid leaves

Performance incentives

Learning opportunities

Job summary

A leading technology firm is seeking a Senior Data Engineer with at least 3 years of experience to design and build scalable data pipelines. This remote role in India requires expertise in Scala and PySpark, along with strong SQL and Apache Spark skills. The ideal candidate will work with data teams to enhance infrastructure performance and support data-driven decision-making. The position includes benefits like paid leaves and a supportive work environment focused on growth.

Qualifications

• 3+ years of hands-on experience in Data Engineering.
• Strong experience with Apache Spark and understanding of distributed systems.
• Experience with cloud-based data platforms and Delta Lake architecture.

Responsibilities

• Design and build scalable data pipelines for ETL from various data sources.
• Enhance internal processes by automating tasks and optimizing data workflows.
• Collaborate with teams to understand data needs and provide solutions.

Skills

Scala

PySpark

SQL

Apache Spark

Linux/macOS

Education

Bachelor's degree in Computer Science, Engineering, or related field

Tools

Databricks

Job description

Job Title: Senior Data Engineer

No. of Positions: 3

Employment Type: Full-Time, Permanent

Location: Remote (Pan India)

Shift Timings: 10:00 AM – 7:00 PM IST

Experience Required: Minimum 3+ Years

Mandatory Skills: Scala & PySpark

Role Overview

We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and architectures. The ideal candidate should have hands‑on experience working with Big Data technologies, distributed systems, and ETL pipelines. You will work closely with cross‑functional teams including Data Analysts, Data Scientists, and Software Engineers to ensure efficient data flow and reliable data infrastructure.

Key Responsibilities

• Design and build scalable data pipelines for extraction, transformation, and loading (ETL) from various data sources.
• Enhance internal processes by automating tasks, optimizing data workflows, and improving infrastructure performance.
• Collaborate with Product, Engineering, Data, and Business teams to understand data needs and provide solutions.
• Work closely with machine learning and analytics teams to support advanced data modeling and innovation.
• Ensure systems are highly reliable, maintainable, and optimized for performance.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3+ years of hands‑on experience in Data Engineering.
• Strong experience with Apache Spark, with solid understanding of distributed data processing.
• Proficiency in Scala and PySpark is mandatory.
• Strong SQL skills and experience working with relational and non‑relational data.
• Experience with cloud‑based data platforms (preferably Databricks).
• Good understanding of Delta Lake architecture, Parquet, JSON, CSV, and related data file formats.
• Comfortable working in Linux/macOS environments with scripting capabilities.
• Ability to work in an Agile environment and deliver independently.
• Good communication and collaboration skills.
• Knowledge of Machine Learning concepts is an added advantage.

Reporting

• This role will report to the CEO or a designated Team Lead.

Benefits & Work Environment

• Remote work flexibility across India.
• Encouraging and diverse work culture.
• Paid leaves, holidays, performance incentives, and learning opportunities.
• Supportive environment that promotes personal and professional growth.