Senior Software Engineer - Data Platform Engineering

Myntra

Bengaluru

Presencial

INR 1 200 000 - 1 600 000

Tempo integral

Há 5 dias
Torna-te num dos primeiros candidatos

Recebe uma resposta deste empregador

O teu currículo e carta de apresentação, adaptados exatamente ao que estão a contratar.

Ultrapassa os filtros ATS

Resumo da oferta

Myntra Data Platform (MDP) is seeking a Senior Software Engineer - Data Engineering to design and build scalable data pipelines and a robust lakehouse architecture. You will work on large-scale batch and near real-time processing, focusing on reliability, data quality, and production-grade standards.

You will collaborate with platform, analytics, product, and engineering teams to deliver high-impact data solutions, using Spark, Python, SQL, Airflow, Databricks, Delta Lake, and modern data

Qualificações

  • 3-5 years of hands-on experience in Data Engineering or Software Engineering.
  • Strong experience with Apache Spark, PySpark, and Spark SQL.
  • Proficiency in Python and SQL with solid coding fundamentals.
  • Experience building production-grade ETL/ELT pipelines and Airflow.
  • Knowledge of data warehousing concepts, data modeling, and lakehouse platforms.

Responsabilidades

  • Design, develop, and maintain scalable ETL/ELT pipelines for large-scale data processing.
  • Build reliable ingestion, transformation, validation, and publishing workflows.
  • Develop reusable components to improve engineering productivity.
  • Implement incremental processing, backfills, retries, and failure recovery.
  • Ensure pipelines meet reliability, scalability, and performance requirements.

Conhecimentos

Apache Spark
PySpark
Spark SQL
Python
SQL
ETL development
Airflow
Data warehousing concepts

Ferramentas

Databricks
Apache Airflow
Delta Lake
Apache Iceberg
Parquet
Hadoop

Descrição da oferta de emprego

Myntra Data Platform (MDP) powers the data foundation behind analytics, experimentation, personalization, machine learning, and critical business decisions across Myntra.We are looking for a Senior Software Engineer - Data Engineering who is passionate about building scalable data platforms and production-grade data pipelines. You will work on large-scale batch and near real-time data processing systems, drive data quality and reliability, and contribute to the evolution of Myntra's modern lakehouse architecture. This role requires strong software engineering fundamentals combined with hands-on expertise in Apache Spark, SQL, Python, ETL development, workflow orchestration, data modeling, and modern data platforms. You will collaborate with platform, analytics, product, and engineering teams to build highly reliable and scalable data solutions that power business-critical use cases across the organization.

What You'll Do:
  • Design, develop, and maintain scalable ETL/ELT pipelines for large-scale data processing.
  • Build reliable data ingestion, transformation, validation, and publishing workflows.
  • Develop reusable components and frameworks to improve engineering productivity.
  • Implement incremental processing, backfills, retries, and failure recovery mechanisms.
  • Ensure data pipelines meet reliability, scalability, and performance requirements.
Apache Spark & Big Data Processing:
  • Build and optimize large-scale data processing jobs using Apache Spark, PySpark, and Spark SQL.
  • Develop production-grade transformations, aggregations, and data enrichment pipelines.
  • Analyze Spark execution plans and optimize jobs for performance and cost.
  • Troubleshoot issues related to partitioning, joins, data skew, shuffles, and memory utilization.
  • Follow engineering best practices for efficient distributed processing.
Data Modeling & Warehousing:
  • Design and implement scalable data models for analytics and reporting.
  • Build curated datasets supporting business intelligence and downstream applications.
  • Apply dimensional modeling concepts including facts, dimensions, star schemas, and SCDs.
  • Translate business requirements into reusable and maintainable data models.
Workflow Orchestration:
  • Develop and manage workflows using Apache Airflow or equivalent orchestration platforms.
  • Define task dependencies, scheduling strategies, retries, and monitoring mechanisms.
  • Improve operational visibility and reliability of data workflows.
  • Support self-service capabilities for pipeline onboarding and deployment.
Lakehouse & Data Platform Engineering:
  • Build and operate workloads on Databricks and Spark-based platforms.
  • Work with Delta Lake, Apache Iceberg, Parquet, or similar storage formats.
  • Optimize storage layouts, partitioning strategies, compaction, and metadata management.
  • Contribute to platform capabilities that simplify data consumption and processing.
Data Quality & Governance:
  • Implement automated data quality validations and monitoring frameworks.
  • Develop checks for freshness, completeness, schema validation, and consistency.
  • Ensure proper metadata management, lineage tracking, and discoverability.
  • Follow data governance and security best practices.
Operational Excellence:
  • Monitor pipeline health, SLAs, performance, and cost metrics.
  • Investigate production issues and perform root cause analysis.
  • Improve platform stability through automation and continuous optimization.
  • Participate in on-call support and incident management when required.
Engineering Excellence:
  • Write clean, maintainable, and testable code.
  • Participate in code reviews and design discussions.
  • Contribute to engineering standards, best practices, and reusable frameworks.
  • Collaborate with cross-functional teams to deliver high-quality solutions.
What We're Looking For:
Required Qualifications:
  • 3-5 years of hands-on experience in Data Engineering or Software Engineering.
  • Strong experience with Apache Spark, PySpark, and Spark SQL.
  • Proficiency in Python and strong coding fundamentals.
  • Excellent knowledge of SQL and query optimization techniques.
  • Experience building production-grade ETL/ELT pipelines.
  • Hands-on experience with Apache Airflow or similar workflow orchestration tools.
  • Good understanding of data warehousing and data modeling concepts.
  • Experience working with Databricks, Hadoop, or cloud-based data platforms.
  • Familiarity with Delta Lake, Apache Iceberg, or Parquet.
  • Strong debugging, troubleshooting, and problem-solving skills.
  • Good understanding of software engineering best practices, CI/CD, and version control systems.
Preferred Qualifications:
  • Experience working with Kafka or other streaming technologies.
  • Exposure to near real-time data processing architectures.
  • Experience with dbt or similar SQL transformation frameworks.
  • Knowledge of modern lakehouse architectures and cloud-native data platforms.
  • Understanding of data governance, metadata management, and lineage concepts.
  • Exposure to AI-assisted development tools and data engineering automation.
  • Experience with Kubernetes, Docker, or cloud platforms such as GCP, AWS, or Azure.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Senior Software Engineer - Data Platform
Senior Software Engineer - Data Platform

Myntra • Bengaluru

Presencial
INR 1 500 000 - 2 500 000
Senior Software Engineer – Data Platform Engineering
Senior Software Engineer – Data Platform Engineering

Myntra • Bengaluru

Presencial
INR 2 400 000 - 4 200 000
Restaurant d'entreprise
Indemnités de stage/alternance
Technical Lead – Data Engineering
Technical Lead – Data Engineering

Myntra Designs Private Limited • Bengaluru

Presencial
INR 1 000 000 - 1 800 000
Data Engineer
Data Engineer

PW (PhysicsWallah) • Dadri

Presencial
INR 900 000 - 1 300 000
Senior Data Engineer
Senior Data Engineer

Wissen Technology Pte Ltd • Bengaluru

Híbrido
INR 3 000 000 - 5 400 000
Data Enginner
Data Enginner

Garg Ventures Pvt Ltd • Delhi

Presencial
INR 1 200 000 - 2 100 000
Lead Data Engineer (Lead Software Engineer)
Lead Data Engineer (Lead Software Engineer)

DigitalXNode • Ahmedabad District

Presencial
INR 1 800 000 - 2 600 000
Databricks Developer
Databricks Developer

Kumaran Systems • Índia

Presencial
INR 900 000 - 1 500 000
Senior Data Platform Engineer
Senior Data Platform Engineer

Relevance Lab • Bengaluru

Presencial
INR 400 000 - 700 000
Senior ETL / Data Engineer
Senior ETL / Data Engineer

Durapid Technologies Pvt Ltd • Índia

Presencial
INR 2 500 000 - 4 500 000