Senior Data Engineer

Mployee.me; Hyderabad; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Mployee.me is seeking a seasoned data engineer in Hyderabad to join the in-house Data Foundation team. You will work under the Data Engineering Lead and collaborate with DataOps teams to design, develop, and optimize data pipelines and ETL processes for data foundation initiatives.

Ideal candidates will have 5+ years of hands-on experience with Azure Databricks, Python, PySpark, SQL, and cloud data services, and a strong background in data modelling and architecture.

Qualifications

• Hands-on experience with the listed mandatory technologies and cloud data services.
• Strong software engineering practices, coding standards, and modern architecture.
• Experience across diverse projects with multiple tech stacks.

Responsibilities

• Design, develop, and deliver scalable, reliable data solutions.
• Build and maintain scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment.
• Ensure coding standards and architectural guidelines are followed.
• Inspire and drive development approach choices.
• Engage with other teams and stakeholders on technical topics.
• Coordinate with Engineering Manager, Product Owner, and Scrum Master on goals and timelines.

Skills

Azure Databricks

Unity Catalog

Delta Live Tables

Data Modelling & Architecture

ETL pipeline design

Python

PySpark

SQL

Azure Data Factory

Azure DevOps

Logging & Monitoring (Azure/Databricks

Apache Kafka

Azure cloud data services

Tools

Jira

Azure CLI

Shell scripting

Job description

Your Role

You will be a part of the data engineering team and working on in-house products in for Data Foundation Collaborating closely with Data Engineering Leads and managers and other DataOps teams. This role involves hands‑on development work and will directly report to Data Engineering Lead.

Must have skills

• Azure Databricks, Unity Catalog, Delta live tables
• Data Modelling & Architecture
• ETL pipeline design
• Expert in Python, Pyspark and SQL
• Azure Data Factory
• Azure DevOps
• Logging and Monitoring using Azure / Databricks services
• Apache Kafka
• Strong experience in Azure cloud data services & technologies

Nice to have

• Synapse, Fabric, PowerBI, Azure Functions, Azure Logic apps
• Azure API service
• Microsoft EntraID
• GCP & AWS cloud services knowledge
• Azure Networking
• Databricks online table
• Jira
• Shell scripting / Azure CLI knowledge

Your responsibilities will include

• Experience in designing, developing, and delivering scalable, reliable, and high-performing software solutions.
• Design, development, and maintenance of scalable data pipelines and ETL processes.
• Monitor and optimize data infrastructure performance.
• Participate in code reviews, design reviews, testing, and deployment processes.
• Ensure adherence to coding standards, best practices, and architectural guidelines.
• Inspire, advise, and drive the selection of development approaches.
• Participate in technical discussions with other teams/departments.
• Communicate with the Engineering Manager, Product Owner, Business Analyst, and Scrum Master to align on project/sprint goals, timelines, and resource allocation.

You are a good match if you have

• Min 5-7+ years of working experience in the field of Data Engineering or Software Engineering.
• Hands‑on experience and in‑depth knowledge of the technologies listed as mandatory in the Technology Stack section.
• Strong understanding and implementation of software development principles, coding standards, and modern architecture.
• Experience working on diverse projects with varying technologies, products, and systems.
• Strong problem‑solving skills and the ability to make critical technical decisions.
• Ability to guide and mentor other team members.
• Strong stakeholder engagement and influencing skills.
• Pragmatic and collaborative team player.
• Experience with Databricks, data pipelines, and CI/CD.
• Proficiency in Python, SQL, and big data technologies in cloud environments.
• Pragmatic and collaborative team player.