Senior Data Engineer

Luxoft; India; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Luxoft is seeking a Senior Software Engineer I, Data Engineer to design, build, and operate resilient data platforms at scale. You will own data storage, access, and analytics components, ensuring secure data access and real-time analytics pipelines.

Collaboration with security and platform teams is essential to maintain reliability. The role requires 6–9 years in software engineering with hands-on work in distributed data technologies and Kubernetes-based deployments.

Qualifications

• 6–9 years of software engineering experience, including distributed data stores and computation.
• Hands-on experience with Elasticsearch, Cassandra, Hadoop, or MongoDB.
• Strong proficiency in Scala.
• Experience with Spark and Presto/Trino for large-scale data processing.
• Experience with microservice-based architectures.
• Hands-on experience with Kubernetes and container deployment.
• Working knowledge of NoSQL data stores.
• Experience operating in Unix/Linux environments.
• Familiarity with Agile/Scrum delivery practices.

Responsibilities

• Design, build, and operate structured, semi-structured, and unstructured data stores with real-time and batch analytics workloads.
• Recommend and apply distributed data and computation technologies for use cases balancing performance and scalability.
• Implement secure, reliable access patterns to connect to multiple data sources.
• Apply encryption and controls to protect data at rest per security standards.
• Build and maintain real-time analytics pipelines using Spark and Presto/Trino.
• Containerize and deploy data services using Kubernetes and orchestration tooling.
• Design data replication strategies for active/active data center resilience.
• Design, implement, and test backup and recovery procedures for data platforms.
• Own code quality, testing, and documentation for data engineering components.
• Collaborate with engineering, security, and platform teams to meet reliability and operational standards.

Skills

Distributed data stores

Elasticsearch

Cassandra

Hadoop

MongoDB

Scala

Spark

Presto/Trino

Microservices

Kubernetes

NoSQL

Unix/Linux

Agile/Scrum

AWS

GCP

Java

Job description

Project description

Our client is a comprehensive-stack digital banking solutions provider empowering banks and financial institutions to scale and modernise at speed.We're looking for a Senior Software Engineer I, Data Engineer to design, build, and operate resilient, secure data platforms supporting structured, semi-structured, and unstructured data at scale. In this role, you'll own the delivery of data storage, access, and analytics components within your assigned scope — implementing secure data access, real-time analytics pipelines, and disaster-resilient replication and backup strategies. You'll work closely with engineering, security, and platform teams to ensure data solutions are reliable, secure, and maintainable.

Responsibilities

• Design, build, and operate structured, semi-structured, and unstructured data stores supporting real-time and batch analytics workloads within your assigned scope.
• Recommend and apply appropriate distributed data and computation technologies for assigned use cases, balancing performance, scalability, and maintainability.
• Implement secure, reliable access patterns for connecting to multiple internal and external data sources.
• Apply encryption and other controls to protect data at rest in line with security standards.
• Build and maintain real-time analytics pipelines using distributed processing frameworks such as Spark and Presto/Trino.
• Containerize and deploy data services using Kubernetes and related orchestration tooling.
• Design and implement data replication strategies to support active/active data center resilience.
• Design, implement, and test backup and recovery procedures for owned data platforms.
• Own code quality, testing, and documentation for data engineering components within your scope.
• Collaborate with engineering, security, and platform teams to ensure data solutions meet reliability and operational standards.

SKILLS

Must have

• 6–9 years of software engineering experience, including at least 2–3 years working with distributed data stores and distributed computation.
• Hands‑on experience with one or more distributed data technologies such as Elasticsearch, Cassandra, Hadoop, or MongoDB.
• Strong proficiency in Scala
• Experience with Spark and Presto or Trino for large‑scale data processing.
• Experience with microservice‑based architectures.
• Hands‑on experience with Kubernetes and container‑based deployment.
• Working knowledge of NoSQL data stores.
• Experience operating in Unix/Linux environments.
• Familiarity with Agile/Scrum delivery practices.

Nice to have

• Cloud platform experience (AWS or GCP)
• Retail banking data experience
• Java