Data Engineer

Carrerlift; Bengaluru; On-site; INR 900,000 - 1,300,000; Full time

Job summary

Carrerlift in Bengaluru, Karnataka, India is seeking a software engineer to design, build and maintain data systems that move, transform and store data at scale.

You will develop pipelines for large volumes, write backend services and REST APIs, and collaborate with teams to ensure performance and reliability, using Python, Java or Scala, SQL, and Spark on AWS.

Qualifications

• 1-3 years experience as software engineer working with large datasets
• Proficiency in Python, Java, or Scala and production-quality code
• Deep SQL knowledge with joins, window functions, and aggregations
• Understanding of OLTP vs OLAP and when to use each
• Hands-on experience with distributed data processing framework, preferably Spark
• Track record building or maintaining backend services and REST APIs
• Exposure to AWS cloud services such as S3 and EC2
• Solid CS fundamentals: data structures, concurrency, and distributed systems concepts

Responsibilities

• Design, build and maintain systems that move, transform and store data at scale
• Develop pipelines that process large volumes of information reliably and efficiently
• Write backend services and APIs that integrate with data infrastructure
• Collaborate with teams to ensure data systems meet performance and reliability standards

Skills

Python

Java/Scala

SQL

REST APIs

Distributed systems

Spark

AWS

Data structures

Concurrency

Tools

Spark

AWS

S3

EC2

Job description

About the role:

• Design, build and maintain systems that move, transform and store data at scale


• Develop pipelines that process large volumes of information reliably and efficiently


• Write backend services and APIs that integrate with data infrastructure


• Collaborate with teams to ensure data systems meet performance and reliability standards

What we're looking for:

• 1-3 years working as a software engineer, including substantial work on systems handling large datasets


• Proficiency in Python, Java, or Scala with the discipline to ship tested, production-ready code


• Deep SQL knowledge including joins, window functions, and aggregations


• Understanding of how OLTP and OLAP databases differ and when to use each


• Hands‑on experience with at least one distributed data processing framework, preferably Spark


• Track record building or maintaining backend services and REST APIs


• Exposure to a major cloud platform (AWS preferred) and familiarity with services such as S3 and EC2


• Solid grasp of computer science fundamentals: data structures, concurrency, and distributed systems concepts