Sr. Data Engineer - Amazon redshift & AWS(Glue) 3 - 5 Years Mumbai

OneTure Technologies Private Limited

Mumbai

Sur place

INR 3 500 000 - 7 500 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Résumé du poste

OneTure Technologies Private Limited is seeking a Senior Data Engineer in Mumbai to build and optimize enterprise-scale data pipelines. You will own Redshift clusters, orchestrate workloads with Airflow or Step Functions, and drive multi-terabyte workflows across complex environments.

You will translate business requirements into robust data solutions, work with stakeholders, and champion data governance, security, and lineage. Proficiency in Python, SQL, and data modeling is essential.

Qualifications

  • Proven experience building data pipelines and ETL/ELT on large datasets.
  • Strong SQL development and data modeling skills.
  • Hands-on AWS Redshift performance tuning and concurrency management.
  • Experience with workflow orchestration tools (Airflow or Step Functions).
  • CI/CD, Git, and IaC concepts familiarity.

Responsabilités

  • Design, develop, and maintain high-throughput ETL/ELT pipelines using AWS Glue (PySpark).
  • Own and optimize large-scale Amazon Redshift clusters and concurrent workloads.
  • Lead data migration projects from Azure or traditional RDBMS to Redshift.
  • Integrate data from REST APIs, AWS Aurora, streaming inputs, and flat files.

Connaissances

Python
SQL
Data modeling
Stakeholder communication

Formation

Bachelor's degree in CS/Engineering

Outils

AWS Glue
Apache Airflow
AWS Step Functions
Amazon Redshift
Terraform

Description du poste

We are looking for a highly skilled and hands-on Senior Data Engineer to join our growing data engineering practice in Mumbai. This role requires deep technical expertise in building and managing enterprise-grade data pipelines, with a primary focus on Amazon Redshift, AWS Glue, and data orchestration using Airflow or Step Functions. You will be responsible for building scalable, high-performance data workflows that ingest and process multi-terabyte-scale data across complex, concurrent environments.

The ideal candidate is someone who thrives in solving performance bottlenecks, has led or participated in data warehouse migrations (e.g., Azure to Redshift), and is confident interfacing with business stakeholders to translate requirements into robust data solutions.

Key Responsibilities:
  • Design, develop, and maintain high-throughput ETL/ELT pipelines using AWS Glue (PySpark), orchestrated via Apache Airflow or AWS Step Functions.
  • Own and optimize large-scale Amazon Redshift clusters and managing high concurrency workloads for very large user base:
  • Lead and contribute to migration projects from Azure or traditional RDBMS to Redshift, ensuring minimal downtime and robust validation.
  • Integrate and normalize data from heterogeneous sources including REST APIs, AWS Aurora (MySQL/Postgres), streaming inputs, and flat files.
  • Implement intelligent caching strategies, leverage EC2 and serverless compute (Lambda, Glue) for custom transformations and processing at scale.
  • Write advanced SQL for analytics, data reconciliation, and validation, demonstrating strong SQL development and tuning experience.
  • Implement comprehensive monitoring, alerting, and logging for all data pipelines to ensure reliability, availability, and cost optimization.
  • Collaborate directly with product managers, analysts, and client-facing teams to gather requirements and deliver insights-ready datasets.
  • Champion data governance, security, and lineage, ensuring data is auditable and well-documented across all environments.
Required Qualifications & Experience:
  • 3-5 years of core data engineering experience, especially focused in Amazon Redshift hands-on performance tuning and large-scale management capacity.
  • Demonstrated experience handling multi-terabyte Redshift clusters, concurrent query loads, and managing complex workload segmentation and queue priorities.
  • Strong experience with AWS Glue (PySpark) for large-scale ETL jobs.
  • Solid understanding and implementation experience of workflow orchestration using Apache Airflow or AWS Step Functions.
  • Strong proficiency in Python, advanced SQL, and data modeling concepts.
  • Familiarity with CI/CD pipelines, Git, DevOps processes, and infrastructure-as-code concepts.
Preferred/Bonus Skills:
  • Experience with Amazon Athena, Lake Formation, or S3-based data lakes.
  • Hands-on participation in Azure, BigQuery, or Teradata migration projects.
  • AWS Certifications such as:
  • AWS Certified Data Analytics - Specialty
  • AWS Certified Solutions Architect - Associate/Professional
  • Exposure to real-time streaming architectures or Lambda architectures.
  • Excellent communication skills - must be able to confidently engage with both technical and non-technical stakeholders, including clients.
  • Strong problem-solving mindset and a keen attention to performance, scalability, and reliability.
  • Demonstrated ability to work independently, lead tasks, and take ownership of large-scale systems.
  • Comfortable working in a fast-paced, dynamic, and client-facing environment.
Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Sr. Data Engineer
Sr. Data Engineer

Minfy Technologies • Gurugram District

Sur place
INR 1 800 000 - 2 400 000
Opportunity AWS Data Engineer professional
Opportunity AWS Data Engineer professional

Atos • Chennai District, Bengaluru, Mumbai

Sur place
INR 2 500 000 - 4 000 000
AWS Redshift Data Engineer
AWS Redshift Data Engineer

Vouchagram India • New Delhi

Sur place
INR 900 000 - 1 400 000
Senior Data Engineer
Senior Data Engineer

RITWIK IT SERVICES PRIVATE LIMITED • Bengaluru

Hybride
INR 4 500 000 - 6 500 000
Lead AWS Data Engineer
Lead AWS Data Engineer

Weekday • Bengaluru

Sur place
INR 1 000 000 - 1 500 000
AWS Redshift Data Engineer
AWS Redshift Data Engineer

Mployee.me • Delhi

Sur place
INR 180 000 - 300 000
AWS Data Engineer
AWS Data Engineer

Softview Infotech • Chennai District

Sur place
INR 1 200 000 - 2 400 000
AWS Data Engineer (Redshift)
AWS Data Engineer (Redshift)

Anblicks Inc. • Hyderabad

Sur place
INR 1 200 000 - 1 800 000
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS

Datavail • Bengaluru, Mumbai, Hyderabad

Hybride
INR 2 500 000 - 4 000 000
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS
Senior Technical Specialist - AWS/AWS Lambda/AWS Glue/AWS SNS

Datavail Infotech • Bengaluru

Sur place
INR 2 400 000 - 4 000 000