Software Development Engineer III Data

Meesho; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Meesho in Bengaluru is looking for a Data Engineer to design and implement scalable data pipelines using tools like Apache Spark and Kafka. The ideal candidate will have strong programming skills in Java, Scala, or Python and at least 5-8 years of experience in data engineering.

The role involves optimizing data quality and collaborating with cross-functional teams. Enthusiasts of big data systems and modern cloud-native environments are encouraged to apply.

Qualifications

• Strong programming skills in Java, Scala, or Python.
• Experience with big data systems including Apache Kafka and Spark.
• Ability to debug complex issues in large-scale systems.

Responsibilities

• Design and implement scalable and fault-tolerant data pipelines.
• Lead development of data platforms and reusable frameworks.
• Optimize data quality, consistency, and governance.

Skills

Java

Scala

Python

SQL

Data modeling

Analytical skills

Education

5-8 years of professional experience in software/data engineering

Tools

Apache Spark

Kafka

Apache Flink

Delta Lake

MySQL

Docker

Job description

What You’ll Do

• Design and implement scalable and fault‑tolerant data pipelines (batch and streaming) using frameworks like Apache Spark, Flink, and Kafka.
• Lead the design and development of data platforms and reusable frameworks that serve multiple teams and use cases.
• Build and optimize data models and schemas to support large‑scale operational and analytical workloads.
• Deeply understand Apache Spark internals and be capable of modifying or extending the open‑source Spark codebase as needed.
• Develop streaming solutions using tools like Apache Flink, Spark Structured Streaming.
• Drive initiatives that abstract infrastructure complexity, enabling ML, analytics, and product teams to build faster on the platform.
• Champion a platform‑building mindset focused on reusability, extensibility, and developer self‑service.
• Ensure data quality, consistency, and governance through validation frameworks, observability tooling, and access controls.
• Optimize infrastructure for cost, latency, performance, and scalability in modern cloud‑native environments.
• Mentor and guide junior engineers, contribute to architecture reviews, and uphold high engineering standards.
• Collaborate cross‑functionally with product, ML, and data teams to align technical solutions with business needs.

What We’re Looking For

• 5-8 years of professional experience in software/data engineering with a focus on distributed data systems.
• Strong programming skills in Java, Scala, or Python, and expertise in SQL.
• At least 2 years of hands‑on experience with big data systems including Apache Kafka, Apache Spark/EMR/Dataproc, Hive, Delta Lake, Presto/Trino, Airflow, and data lineage tools (e.g., Datahb, Marquez, OpenLineage).
• Experience implementing and tuning Spark/Delta Lake/Presto at terabyte‑scale or beyond.
• Strong understanding of Apache Spark internals (Catalyst, Tungsten, shuffle, etc.) with experience customizing or contributing to open‑source code.
• Familiarity and worked with modern open‑source and cloud‑native data stack components such as:
• Apache Iceberg, Hudi, or Delta Lake
• Trino/Presto, DuckDB, or ClickHouse, Pinot, Druid
• Airflow, Dagster, or Prefect
• DBT, Great Expectations, DataHub, or OpenMetadata
• Kubernetes, Terraform, Docker
• Strong analytical and problem‑solving skills, with the ability to debug complex issues in large‑scale systems.
• Exposure to data security, privacy, observability, and compliance frameworks is a plus.

Good to Have

• Contributions to open‑source projects in the big data ecosystem (e.g., Spark, Kafka, Hive, Airflow)
• Hands‑on data modeling experience and exposure to end‑to‑end data pipeline development
• Familiarity with OLAP data cubes and BI/reporting tools such as Tableau, Power BI, Superset, or Looker
• Working knowledge of tools and technologies like ELK Stack (Elasticsearch, Logstash, Kibana), Redis, and MySQL
• Exposure to backend technologies including RxJava, Spring Boot, and Microservices architecture

Equal Employment Opportunity

• Equal Opportunity: We ensure employment opportunities are never denied on the grounds of disability if the candidate is otherwise competent to perform the job.
• Accessible Workplace: Our facilities are designed to be fully accessible, with amenities and assistive devices provided to support differently‑abled individuals in their work.
• Inclusive Hiring Process: We adopt a transparent and non‑discriminatory selection process, including providing application forms in alternate formats and offering reasonable accommodations during interviews upon request.
• Career Growth: We provide adequate training post‑recruitment and pre‑promotion, with training materials available in accessible formats to enable equal career progression.
• Support & Confidentiality: A dedicated liaison officer/committee addresses concerns and grievances, while maintaining strict confidentiality of disability‑related information.
• Awareness & Inclusion: We conduct awareness programs to promote a culture of inclusivity across the organization.