Data Engineer

Enterprise Minds; Pune District; Hybrid; INR 1,000,000 - 1,500,000; Full time

Job summary

Enterprise Minds is seeking a Data Engineer to design and deploy end-to-end data pipelines and dashboards. You will work on data ingestion, transformation, and visualization, ensuring scalable data solutions for global customers.

The role involves implementing the product, collaborating with an energetic team, and aligning with customer needs. You will use Databricks, SQL, Java, and PySpark to build and deploy pipelines.

Qualifications

• Bachelor's or master's degree in computer science, IT, or equivalent.

Responsibilities

• Design and implement data pipelines and dashboards to maximize customer value.
• Deploy and automate data pipelines and dashboards for project delivery.
• Collaborate with an international, diverse team to support platform vision.
• Ensure data is accessible for other teams to enable analytics and insights.
• Participate in Scrum/ Agile processes and create stories for refinements.
• Engage with stakeholders to communicate project progress and blockers.
• Contribute to improving the standardized product based on feedback.

Skills

Databricks

SQL

Java

PySpark

Data modeling

Dashboarding/Visualization

Education

Bachelor's or Master's in CS/IT or equivalent

Tools

Docker

Kubernetes

Azure

Grafana/PowerBI/Tableau (viz tools)

Splunk

Job description

Role & responsibilities

We are looking for Data Engineer

Position Name- Data Engineer

No of Positions-2

Exp-4-8 Years

Mode-Hybrid

Location-Pune

Your Position

As a data engineer, you will be responsible for delivering data intelligence solutions to our customers all around the globe, based on an innovative product, which provides insights into the performance of their material handling systems. You will be working on implementing and deploying the product as well as designing solutions to fit it to our customer needs. You will work together with an energetic and multidisciplinary team to build end-to-end data ingestion pipelines and implement and deploy dashboards.

Your tasks and responsibilities

• You will design and implement data & dashboarding solutions to maximize customer value.
• You will deploy and automate the data pipelines and dashboards to enable further project implementation.
• You embrace working in an international, diverse team, with an open and respectful atmosphere.
• You leverage data by making it available for other teams within our department as well to enable our platform vision.
• You enjoy an independent and self-reliant way of working with a proactive style of communication to take ownership to provide the best possible solution.
• You will be part of an agile team that encourages you to speak up freely about improvements, concerns, and blockages. As part of Scrum methodology, you will independently create stories and participate in the refinement process.
• You collect feedback and always search for opportunities to improve the existing standardized product.
• Execute projects from conception through client handover with a positive contribution on technical performance and the organization.
• You will take the lead in communication with different stakeholders that are involved in the projects that are being deployed.

Your profile

• Bachelor's or master's degree in computer science, IT, or equivalent and a minimum of 4 to 8 years of experience building and deploying complex data pipelines and data solutions.
• Bachelor's or master's degree in computer science, IT, or equivalent (for junior profiles).
• Experience deploying data pipelines using technologies like Databricks.
• Hands on experience with Java.
• Hands-on experience in Databricks.
• Experience with visualization software, preferably Splunk (or else Grafana, Prometheus, PowerBI, Tableau, or similar).
• Strong experience with SQL , Java with hands-on experience in data modeling.
• Experience with Pyspark or Spark to deal with distributed data.
• Good to have knowledge on Splunk (SPL)
• Experience with data schemas (e.g.JSON/XML/Avro).
• Experience in deploying services as containers (e.g.Docker, Kubernetes).
• Experience in working with cloud services (preferably with Azure).
• Experience with streaming and/or batch storage (e.g.Kafka, streaming platform) is a plus.
• Experience in data quality management and monitoring is a plus.
• Strong communication skills in English.