Senior Data Engineer

Terasol Technologies Pvt. Ltd.; Remote; USD 60,000 - 80,000; Full time

Job summary

A technology firm is seeking an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines. This remote position requires a Bachelor's degree in Computer Science and 3+ years of hands-on experience in Data Engineering, with strong skills in Scala, PySpark, and Apache Spark. The ideal candidate will collaborate closely with cross-functional teams to enhance data workflows and infrastructure performance. Benefits include paid leaves, holidays, and a supportive work environment.

Benefits

Remote work flexibility

Paid leaves

Performance incentives

Learning opportunities

Qualifications

• 3+ years of hands-on experience in Data Engineering.
• Strong experience with Apache Spark and solid understanding of distributed data processing.
• Comfortable working in Linux/macOS environments with scripting capabilities.

Responsibilities

• Design and build scalable data pipelines for extraction, transformation, and loading (ETL).
• Enhance internal processes by automating tasks and optimizing data workflows.
• Collaborate with teams to understand data needs and provide solutions.

Skills

Scala

PySpark

Apache Spark

SQL

Linux

Education

Bachelor’s degree in Computer Science or related field

Tools

Databricks

Job description

Job Title: Senior Data Engineer

No. of Positions: 3

Employment Type: Full-Time, Permanent

Location: Remote (Pan India)

Shift Timings: 10:00 AM – 7:00 PM IST

Experience Required: Minimum 3+ Years

Mandatory Skills: Scala & PySpark

Role Overview

We are looking for an experienced Senior Data Engineer to design, build, and optimize scalable data pipelines and architectures. The ideal candidate should have hands‑on experience working with Big Data technologies, distributed systems, and ETL pipelines. You will work closely with cross‑functional teams including Data Analysts, Data Scientists, and Software Engineers to ensure efficient data flow and reliable data infrastructure.

Key Responsibilities

• Design and build scalable data pipelines for extraction, transformation, and loading (ETL) from various data sources.
• Enhance internal processes by automating tasks, optimizing data workflows, and improving infrastructure performance.
• Collaborate with Product, Engineering, Data, and Business teams to understand data needs and provide solutions.
• Work closely with machine learning and analytics teams to support advanced data modeling and innovation.
• Ensure systems are highly reliable, maintainable, and optimized for performance.

Required Qualifications & Skills

• Bachelor’s degree in Computer Science, Engineering, or related field.
• 3+ years of hands‑on experience in Data Engineering.
• Strong experience with Apache Spark, with solid understanding of distributed data processing.
• Proficiency in Scala and PySpark is mandatory.
• Strong SQL skills and experience working with relational and non‑relational data.
• Experience with cloud‑based data platforms (preferably Databricks).
• Good understanding of Delta Lake architecture, Parquet, JSON, CSV, and related data file formats.
• Comfortable working in Linux/macOS environments with scripting capabilities.
• Ability to work in an Agile environment and deliver independently.
• Good communication and collaboration skills.
• Knowledge of Machine Learning concepts is an added advantage.

Reporting

• This role will report to the CEO or a designated Team Lead.

Benefits & Work Environment

• Remote work flexibility across India.
• Encouraging and diverse work culture.
• Paid leaves, holidays, performance incentives, and learning opportunities.
• Supportive environment that promotes personal and professional growth.