Senior Data Engineer

Luxoft

Bengaluru

On-site

INR 1,200,000 - 2,000,000

Full time

10 days ago

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Luxoft is seeking an experienced Data Engineer to design, develop, and support scalable data solutions in our Client Technology team. You will focus on onboarding new data sources, building data ingestion and transformation pipelines, and implementing data quality controls for surveillance and regulatory reporting use cases.

You will work with GCP tools (BigQuery, Dataflow, Pub/Sub) to enable reliable data processing, governance, and metadata requirements while supporting both strategic

Qualifications

  • 8+ years of data engineering experience with strong SQL and data manipulation.
  • Deep experience with GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, and Cloud Composer.
  • Proficiency in Python, SQL, Java, Scala, or Golang.
  • Bachelor's or Master's degree in Computer Science or Engineering.

Responsibilities

  • Design, build, and maintain scalable batch and real-time streaming data pipelines (ETL/ELT) using Dataflow, Pub/Sub, and Dataproc.
  • Architect and optimize enterprise data warehouses, data lakes, and dimensional models inside BigQuery, Cloud Storage, and Cloud SQL.
  • Tune query performance, configure partitioning and clustering, and manage data lifecycle/retention policies.
  • Enforce security controls, encryption, access management, and automated data quality checks.
  • Implement Infrastructure as Code (Terraform) and CI/CD pipelines via GitHub or cloud-native deployment tools.

Skills

SQL
Python
Java
Scala
Golang
Data Modeling
Big Data
Apache Beam
dbt
ETL/ELT

Education

Bachelors in CS/Engineering
Masters in CS/Engineering (preferred)

Tools

GCP
BigQuery
Dataflow
Pub/Sub
Dataproc
Cloud Composer
Terraform
GitHub

Job description

Project description

As part of Client Technology team, the data Engineer will work to design, develop, and support scalable data solutions that underpin strong engineering practices, implicit data controls and the functional requirements for effective surveillance and regulatory reporting use cases. The scope will focus on onboarding new data sources, developing data ingestion and transformation pipelines, implementing data quality controls, supporting lineage and metadata requirements, and enabling efficient management of transactional and non-transactional/ reference data across the platform. The role will support both strategic initiatives and ongoing operational requirements

Responsibilities
  • Data Pipeline Development: Design, build, and maintain scalable batch and real-time streaming data pipelines (ETL/ELT) using tools like Dataflow, Pub/Sub, and Dataproc.
  • Data Warehousing & Modeling: Architect and optimize enterprise data warehouses, data lakes, and dimensional models inside BigQuery, Cloud Storage, and Cloud SQL.
  • Performance & Cost Optimization: Tune query performance, configure proper partitioning and clustering, and manage data lifecycle/retention policies.
  • Data Governance & Security: Enforce security controls, encryption, access management, and automated data quality checks.
  • Automation & DevOps: Implement Infrastructure as Code (Terraform) and CI/CD pipelines via GitHub or cloud-native deployment tools.
SKILLS
Must have
  • Minimum of 8 years of experience in data engineering, with a strong focus on SQL and data manipulation.
  • Cloud Platform: Deep experience with GCP services including BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, and Cloud Composer.
  • Programming & Query Languages: Proficiency in Python, SQL, Java, Scala, or Golang.
  • Big Data & Analytics Concepts: Data modeling, star schemas, slowly changing dimensions (SCD), Apache Beam, and dbt.
  • Education & Experience: Typically a Bachelor's or Master's degree in Computer Science or Engineering,
Nice to have

Banking

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

DXC Luxoft • Pune District

On-site
INR 2,500,000 - 4,200,000
Data Engineer with GCP
Data Engineer with GCP

Luxoft • Bengaluru

On-site
INR 4,000,000 - 6,000,000
Senior Data Engineer
Senior Data Engineer

Luxoft India • India

On-site
INR 1,500,000 - 2,000,000
Senior Data Engineer
Senior Data Engineer

Flipkart Group • Bengaluru

On-site
INR 1,100,000 - 2,100,000
Sr. Data Engineer
Sr. Data Engineer

Bigthinkcode • Chennai District

On-site
INR 800,000 - 1,200,000
Senior Data Engineer (10–12 Years' Experience Required)
Senior Data Engineer (10–12 Years' Experience Required)

General Mills • Mumbai

On-site
INR 4,500,000 - 7,000,000
Data Engineer
Data Engineer

VRINDA INTERNATIONAL • Maharashtra

On-site
INR 3,500,000 - 7,200,000
Senior Data Engineer
Senior Data Engineer

Impronics Technologies • Indore

On-site
INR 1,200,000 - 1,800,000
Senior Data Engineer (Data & Analytics)
Senior Data Engineer (Data & Analytics)

Summit Consulting Services • Ernakulam

On-site
INR 1,000,000 - 1,800,000
Collaborative culture
Opportunity to influence architecture
Modern cloud-native tech stack
Data Engineer
Data Engineer

Smart Ims • Bengaluru

On-site
INR 800,000 - 1,200,000