DEandA - Core - Advanced Data Engineering - Advanced Data Engineering Other

Zensar Technologies; Pune District; Hybrid; INR 2,500,000 - 4,000,000; Full time

Job summary

Zensar Technologies in India is seeking a seasoned Data Engineer to design, build and test end-to-end data pipelines for Predictive Maintenance solutions, collaborating with product architects and business SMEs. You will work with Spark, Kafka, and cloud data services, contributing to CI/CD automation and scalable, secure data processing across global customer sites.

You will help develop data services for customer sites using automation, templates, and standardization, ensuring high-quality

Qualifications

• Minimum 5 years of experience building complex data pipelines and data solutions.
• Bachelor's or Master's degree in Computer Science, IT, or equivalent.
• Hands-on experience with data modeling.
• Hands-on programming in Java and Scala (Python a plus).
• Hands-on experience with streaming processing (Spark) and streaming/batch storage (Kafka, Oracle).
• Experience in building APIs and data engineering using DevOps principles.
• Experience in building high-performance and secure data pipelines.
• Knowledge of data schemas (JSON/XML/Avro) and storage formats (Azure Blob, SQL, NoSQL).
• Deploying services as containers (Docker).
• Experience with MLOps (end-to-end data and ML pipelines) and cloud services (preferably Azure and Databricks).
• Fluent in English.

Responsibilities

• Develop, test, and document data pipelines for Predictive Maintenance solutions.
• Align implementation with back-end developers across teams.
• Create scalable data pipelines for business use using Spark and related frameworks.
• Develop data services for customer sites with automation, templates, and standardization.
• Contribute to design, build, and improve CI/CD pipelines and test automation for data pipelines.

Skills

Java

Scala

Python

Data modeling

DevOps

Education

Bachelor's or Master's degree in Computer Science/IT or equivalent

Tools

Spark

Kafka

Oracle

Docker

Azure Blob

SQL

NoSQL

Databricks

Job description

Job Description:

In your role, you will participate together with the other Data Engineers in solution design discussions led by our product architect, where your knowledge and input will be highly valued. You will collaboratively work with IT and business SMEs to ensure delivery of high-quality end-to-end data pipelines.

Responsibilities

Your responsibilities:

• You will be developing, testing, and documenting the data (collection and processing) pipelines for Predictive Maintenance solutions. The data collection consists of (IoT) sensors and low/high level control components to our data platform. When the data is in the cloud, it must be processed and made available as data products to our data scientists.
• Align implementation efforts with other back-end developers across multiple development teams.
• You will develop scalable data pipelines to transform and aggregate data for business use, following software engineering best practices. For these data pipelines you will make use of the best frameworks available for data processing like Spark. We are continuously improving on the solutions we use and encourage you to keep challenging the status quo.
• You develop our data services for customer sites towards a product, using (test & deployment) automation, componentization, templates, and standardization to reduce delivery time of our projects for customers. The product provides insights into the performance of our material handling systems at customers all around the globe.
• You will contribute to the design, build, and improve a CI/CD pipeline, including (integration) test automation for data pipelines. In this process you strive for an ever-increasing degree of automation.

Qualifications

• Minimum 5 years experience with building complex data pipelines and data solutions.
• Bachelors or Masters degree in Computer Science, IT, or equivalent.
• Hands-on experience with data modeling
• Hands-on experience with programming in Java and Scala (python is a plus).
• Hands-on experience with Streaming processing (e.g., Spark) and Streaming and/or batch storage (e.g. Kafka, Oracle)
• Experience in building APIs
• Experience in data engineering using DevOps principles
• Experience in building highly performant and secure data pipelines
• Data Schema’s (e.g., JSON/XML/Avro)
• Storage formats (e.g., Azure Blob, SQL, NoSQL)
• Deploying services as containers (e.g., Docker)
• Experience in building highly performant and secure data pipelines
• Knowledge and experience with MLOps (E2E Data and Machine Learning Pipelines)
• Working with cloud services (preferably with Azure and Databricks)
• Experience in data quality management and monitoring is a plus.
• Experience with Predictive Maintenance model development is a plus.
• You are fluent in English.

At Zensar, we’re “experience-led everything”. We are committed to conceptualizing, designing, engineering, marketing, and managing digital solutions and experiences for over 130 leading enterprises. We are a company driven by a bold purpose: Together, we shape experiences for better futures. Whether for our clients, our people, or the world around us, this belief powers everything we do. At the heart of our culture is ONE with Client - a set of four core values that reflect who we are and how we work: One Zensar, Nurturing, Empowering, and Client Focus.

Part of the $4.8 billion RPG Group, we’re a community of 10,000+ innovators across 30+ global locations, including Milpitas, Seattle, Princeton, Cape Town, London, Zurich, Singapore, and Mexico City. Explore Life at Zensar and join us to Grow. Own. Achieve. Learn. to be the best version of yourself.

We believe the best work happens when individuality is celebrated, growth is encouraged, and well-being is prioritized. We are an equal employment opportunity (EEO) and affirmative action employer, committed to creating an inclusive workplace. All qualified applicants will be considered without regard to race, creed, color, ancestry, religion, sex, national origin, citizenship, age, sexual orientation, gender identity, disability, marital status, family medical leave status, or protected veteran status.