Data Engineer

Enterprise Minds, Inc; Pune District; On-site; INR 1,400,000 - 2,400,000; Full time

Job summary

Enterprise Minds, Inc. in Pune seeks an experienced Data Engineer to design, build, and run scalable data pipelines and solutions for global customers. You will own ingestion, processing, data modeling, and dashboards end-to-end, collaborating with cross-functional teams.

The role requires strong hands-on expertise with Databricks, Java, SQL, Spark/PySpark, and cloud platforms (Azure), plus a focus on data quality and performance.

Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or related field.
• 5–9 years of experience in Data Engineering or data solutions.
• Strong hands-on experience with Databricks.
• Strong programming experience in Java and SQL.
• Hands-on with Apache Spark/PySpark.
• Experience with data visualization tools (Splunk, Grafana, Prometheus, Power BI, Tableau).
• Experience with JSON, XML, Avro, or similar data schemas.
• Experience with Docker and Kubernetes.
• Experience with cloud services, preferably Microsoft Azure.

Responsibilities

• Design, develop, and implement scalable data pipelines and data solutions.
• Build end-to-end data ingestion, transformation, and processing pipelines.
• Deploy and automate data pipelines and dashboards for customer implementations.
• Develop and maintain data models, schemas, and data processing workflows.
• Work with distributed data processing technologies such as Apache Spark/PySpark.
• Build and optimize dashboards and data visualizations using Splunk, Grafana, Power BI, Tableau.
• Develop and maintain data-driven services using Java and SQL.
• Work with structured and semi-structured data formats including JSON, XML, and Avro.
• Deploy applications and data services using Docker and Kubernetes.
• Work with cloud platforms, preferably Microsoft Azure.
• Design and implement batch and streaming data solutions using Kafka.
• Ensure data quality, monitoring, reliability, and performance of data pipelines.
• Collaborate with international, cross-functional teams to understand requirements and deliver customer-focused solutions.
• Take ownership of projects from solution design and development through deployment and client handover.
• Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement.
• Communicate effectively with customers, stakeholders, and internal technical teams.

Skills

English communication

Analytical

Troubleshooting

Agile/Scrum

Education

Bachelor's or Master's in CS/IT

Tools

Databricks

Java

SQL

Spark/PySpark

Azure

Docker

Kubernetes

Kafka

JSON

XML

Avro

Tableau

Power BI

Job description

We are looking for an experienced Data Engineer to join our team in Pune. The ideal candidate will have strong hands‑on experience in building, deploying, and automating scalable data pipelines and data solutions. You will work on end‑to‑end data ingestion, processing, data modeling, visualization, and dashboarding solutions while collaborating with global customers and cross‑functional teams.

The role requires strong expertise in Databricks, Java, SQL, Spark/PySpark, data modeling, and cloud technologies, preferably Azure.

Key Responsibilities

• Design, develop, and implement scalable data pipelines and data solutions.
• Build end‑to‑end data ingestion, transformation, and processing pipelines.
• Deploy and automate data pipelines and dashboards for customer implementations.
• Develop and maintain data models, schemas, and data processing workflows.
• Work with distributed data processing technologies such as Apache Spark/PySpark.
• Build and optimize dashboards and data visualizations using Splunk, Grafana, Power BI, Tableau, or similar tools.
• Develop and maintain data‑driven services using Java and SQL.
• Work with structured and semi‑structured data formats including JSON, XML, and Avro.
• Deploy applications and data services using Docker and Kubernetes.
• Work with cloud platforms, preferably Microsoft Azure.
• Design and implement batch and streaming data solutions using technologies such as Kafka.
• Ensure data quality, monitoring, reliability, and performance of data pipelines.
• Collaborate with international, cross‑functional teams to understand requirements and deliver customer‑focused solutions.
• Take ownership of projects from solution design and development through deployment and client handover.
• Participate in Agile/Scrum activities including story creation, refinement, planning, and continuous improvement.
• Communicate effectively with customers, stakeholders, and internal technical teams.

Required Skills & Experience

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 5–9 years of experience in Data Engineering, data pipelines, or data solutions.
• Strong hands‑on experience with Databricks.
• Strong programming experience in Java.
• Strong proficiency in SQL and data modeling.
• Hands‑on experience with Apache Spark / PySpark.
• Experience with data visualization tools such as Splunk, Grafana, Prometheus, Power BI, or Tableau.
• Good knowledge of Splunk SPL is an advantage.
• Experience working with JSON, XML, Avro, or similar data schemas.
• Experience with Docker and Kubernetes.
• Experience with cloud services, preferably Microsoft Azure.
• Knowledge of Kafka or other streaming platforms is a plus.
• Understanding of data quality, monitoring, and validation.
• Strong analytical, problem‑solving, and troubleshooting skills.
• Excellent communication skills in English.

Good to Have

• Experience working with real‑time/streaming data pipelines.
• Knowledge of Kafka and event‑driven architectures.
• Experience with data quality frameworks and monitoring solutions.
• Experience working in Agile/Scrum environments.
• Experience working with international customers or distributed teams.

Why Join Us?

• Work on innovative data intelligence and analytics solutions.
• Opportunity to work with global customers and multidisciplinary teams.
• Exposure to modern technologies including Databricks, Spark, Azure, Kafka, Docker, Kubernetes, and Splunk.
• Be part of an Agile environment focused on innovation, ownership, and continuous improvement.