Consulting Data Engineer

Elsevier; Delhi; On-site; INR 5,000,000 - 6,000,000; Full time

Benefits offered by this job

Comprehensive Health Insurance

Flexible Working Arrangements

Employee Assistance Program

Long-Service Awards

Free Transport for commutes

Job summary

A global information and analytics leader is seeking an experienced Consulting/Principal Data Engineer to lead their data platform evolution. This role combines hands-on technical expertise and leadership. The ideal candidate will have over 8 years of experience in data engineering, skilled in technologies like Python, AWS, Kafka, and Snowflake. The position promotes a healthy work-life balance and offers comprehensive benefits, including health insurance, flexible working arrangements, and paid time off.

Qualifications

• 8+ years of experience in data engineering or data platform development.
• Strong hands-on experience with relevant technologies and frameworks.
• Experience designing both batch and real-time data pipelines.
• Experience in Agile/Scrum environments with iterative delivery.
• Proven ability to translate complex requirements into implementable solutions.
• Strong data modeling, data quality and platform best practices.
• Excellent stakeholder communication and leadership.

Responsibilities

• Serve as a primary technical point of contact for stakeholders.
• Design and deliver scalable batch and streaming data solutions.
• Ensure data quality, reliability, and governance through strong processes.
• Design and deliver scalable batch and streaming data solutions.
• Design with a customer-centric mindset and adaptability to evolving needs.
• Collaborate with Product Managers, Architects, and Engineering teams to meet commitments.
• Build and enhance the data platform using latest and proven technologies.
• Ensure data quality, reliability, and governance through strong processes.
• Proactively manage technical debt and ensure long-term platform sustainability.
• Provide technical leadership, mentorship, and coaching to team members.

Skills

Python based API

ORM frameworks

pySpark

SQL

AWS (Glue, Lambda, SQS, Kinesis, RDS)

Kafka

Snowflake

DBT

Terraform

Agile/Scrum

Agile/Scrum

Leadership

Job description

Love working with data? Ready to create the data models that convert complex sources into scalable, trusted datasets that drive business decisions?

Would you like to be part of a team that delivers high-quality software to our customers?

Are you a highly visible champion with a ‘can do’ attitude and enthusiasm that inspires others?

About Our Team

Our global team supports products in electronic health records that introduce students to digital charting and prepare them to document care in today’s modern clinical environment. We have a very stable product that we strive to maintain. Our team values trust, respect, collaboration, agility, and quality.

About The Role

We are looking for an experienced and customer-focused Consulting/Principal Data Engineer to lead the evolution of our data platform. This role combines hands‑on technical expertise with strong architectural thinking and cross‑functional leadership.

You will translate high‑level and sometimes ambiguous requirements into scalable technical solutions, guide implementation across the engineering team, and ensure our data platform remains reliable, flexible, and trusted.

Responsibilities

• Serve as a primary technical point of contact for stakeholders.
• Refine high‑level requirements into clear technical designs and actionable work.
• Write and review portions of detailed specifications for the development of system components of moderate complexity.
• Design and deliver scalable batch and streaming data solutions.
• Design solutions with a strong customer‑centric mindset and adaptability to evolving needs.
• Collaborate closely with Product Managers, Architects, and Engineering teams to meet customer commitments.
• Build and enhance our data platform using latest & proven technologies.
• Ensure data quality, reliability, and governance through strong processes and monitoring.
• Proactively manage technical debt and ensure long‑term platform sustainability.
• Provide technical leadership, mentorship, and coaching to team members.

Requirements

• 8+ years of experience in data engineering or data platform development.
• Strong hands‑on experience with Python based API and ORM frameworks, pySpark, SQL, AWS (Glue, Lambda, SQS, Kinesis, RDS), Kafka, Snowflake, DBT and Terraform.
• Experience designing both batch and real‑time data pipelines.
• Experience working in Agile/Scrum environments with iterative delivery practices.
• Proven ability to turn complex, incomplete requirements into implementable solutions.
• Strong understanding of data modeling, data quality, and platform best practices.
• Excellent stakeholder communication and leadership skills.
• Experience guiding and mentoring engineers.
• Strong collaboration skills, with the ability to work effectively with cross‑functional teams.
• Advocate of Continuous Integration/Continuous Deployment (CI/CD) and Test‑Driven Development TDD.

Work in a Way that Works for You

We promote a healthy work‑life balance across our organization. We offer various well‑being initiatives, shared parental leave, study assistance, and sabbaticals to help you meet both your immediate responsibilities and long‑term goals.

Working for You

We understand that your well‑being and happiness are essential to a successful career. Here are some benefits we offer:

• Comprehensive Health Insurance covers you and your immediate family.
• Enhanced Health Insurance Options with competitive rates.
• Group Life Insurance ensuring financial security for your loved ones.
• Group Accident Insurance offering extra protection.
• Flexible Working Arrangements to achieve a balanced work‑life schedule.
• Employee Assistance Program providing support for personal and work‑related challenges.
• Medical Screening prioritizing your well‑being.
• Modern Family Benefits including parental and adoption support.
• Long‑Service Awards recognizing dedication and commitment.
• Celebratory New Baby Gift.
• Subsidized Meals (location‑specific).
• Various Paid Time Off options including Casual Leave, Sick Leave, Privilege Leave, Compassionate Leave, Special Sick Leave, and Gazetted Public Holidays.
• Free Transport for home‑office‑home commutes (location‑specific).

About The Business

A global leader in information and analytics, we assist researchers and healthcare professionals in advancing science and improving health outcomes for society's benefit. Leveraging our publishing heritage, we combine quality information and extensive data sets with analytics to support visionary science and research, health education, and interactive learning. At Elsevier, your work contributes to addressing the world's grand challenges and fostering a sustainable future. We utilize innovative technologies to support science and healthcare, partnering for a better world.

We know your well‑being and happiness are key to a long and successful career. We are delighted to offer country specific benefits. Click here to access benefits specific to your location.