Data Engineer

Enterprise Minds, Inc; Pune District; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Enterprise Minds, Inc. is seeking a Data Engineer in Pune to design, build, and deploy scalable data pipelines. You will develop end-to-end data engineering solutions, implement dashboards, and collaborate with global teams in an Agile setting.

Strong Databricks, PySpark, Java, SQL, and data modeling skills are required. You will work with JSON/XML/Avro data, deploy with Docker/Kubernetes, and utilize visualization tools like Splunk, Grafana, Power BI, or Tableau to deliver actionable insights.

Qualifications

• Bachelor's or Master's degree in Computer Science, IT, or a related field.
• 4–8 years of experience in Data Engineering or Big Data technologies.
• Strong hands-on experience with Databricks.
• Proficiency in Java and SQL.
• Strong PySpark/Spark experience for distributed processing.
• Hands-on data modeling experience.
• Experience with JSON, XML, Avro data formats.
• Experience with data visualization tools (Splunk, Grafana, Power BI, Tableau).
• Experience with Docker and Kubernetes.
• Hands-on experience with Azure or cloud platforms.
• Strong communication and stakeholder management skills.

Responsibilities

• Design, develop, and implement scalable data pipelines and data engineering solutions.
• Build, deploy, and automate ETL/ELT pipelines using Databricks and PySpark.
• Develop robust data models and optimize SQL queries for high-performance analytics.
• Create and deploy dashboards using Splunk, Grafana, Power BI, Tableau, or similar tools.
• Work with structured and semi-structured data formats such as JSON, XML, and Avro.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Collaborate with global stakeholders to understand business requirements and deliver high-quality data solutions.
• Participate in Agile/Scrum ceremonies and contribute to sprint planning and reviews.
• Monitor, troubleshoot, and improve data quality, pipeline reliability, and platform performance.
• Continuously identify opportunities to enhance products, processes, and customer solutions.

Skills

Databricks

Java

SQL

PySpark/Spark

Data Modeling

Cloud platforms (Azure)

Education

Bachelor's or Master's degree in Computer Science/IT

Tools

Docker

Kubernetes

Splunk

Grafana

Power BI

Tableau

JSON/XML/Avro

Azure

Job description

We are looking for a skilled Data Engineer to join our growing team in Pune. In this role, you will design, build, and deploy scalable data engineering solutions that enable customers to gain actionable insights from their material handling systems. You will work on modern data platforms, develop end-to-end data pipelines, and implement dashboards while collaborating with global cross-functional teams in an Agile environment.

Key Responsibilities

• Design, develop, and implement scalable data pipelines and data engineering solutions.
• Build, deploy, and automate ETL/ELT pipelines using Databricks and PySpark/Spark.
• Develop robust data models and optimize SQL queries for high-performance analytics.
• Create and deploy dashboards using Splunk, Grafana, Power BI, Tableau, or similar visualization tools.
• Work with structured and semi-structured data formats such as JSON, XML, and Avro.
• Deploy and manage containerized applications using Docker and Kubernetes.
• Collaborate with global stakeholders to understand business requirements and deliver high-quality data solutions.
• Participate in Agile/Scrum ceremonies, including sprint planning, story creation, refinement, and retrospectives.
• Monitor, troubleshoot, and improve data quality, pipeline reliability, and overall platform performance.
• Continuously identify opportunities to enhance existing products, processes, and customer solutions.

Required Skills & Qualifications

• Bachelor's or Master's degree in Computer Science, Information Technology, or a related field.
• 4–8 years of experience in Data Engineering, Data Pipeline Development, or Big Data technologies.
• Strong hands-on experience with Databricks.
• Proficiency in Java and SQL.
• Strong experience in PySpark/Spark for distributed data processing.
• Hands-on experience with Data Modeling.
• Experience with data formats such as JSON, XML, and Avro.
• Experience with data visualization tools such as Splunk, Grafana, Power BI, or Tableau.
• Experience with Docker and Kubernetes.
• Hands-on experience with cloud platforms, preferably Microsoft Azure.
• Strong communication and stakeholder management skills.

Good to Have

• Knowledge of Splunk SPL.
• Experience with Kafka or other streaming platforms.
• Experience with batch and streaming data architectures.
• Knowledge of data quality, monitoring, and observability frameworks.
• Experience working in Agile/Scrum environments.

Primary Skills

• Databricks
• Java
• SQL
• Data Modeling

Secondary Skills

• Splunk (SPL)
• Docker
• Kafka
• Data Quality & Monitoring
• Agile / Scrum

What We Offer

• Opportunity to work on large-scale, cloud-based data platforms.
• Exposure to global customers and enterprise data solutions.
• Collaborative, diverse, and innovation-driven work environment.
• Career growth with modern Data Engineering and Cloud technologies.