Data Engineer 3

Cummins Inc.; Pune District; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Cummins Inc. is building and maintaining a data and analytics platform to enable agile data delivery at scale.

The role partners with Business and IT to understand requirements and leverages technologies for efficient data processing, storage, and accessibility for analysts and other consumers. The environment emphasizes automation, data quality, governance, and scalable data pipelines across distributed and cloud platforms, with an emphasis on DevOps and agile practices within a data-driven

Responsibilities

• Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources.
• Monitors data quality and data integrity issues and troubleshoots them.
• Develops data governance processes for metadata, access, retention to data for internal and external users?
• Develops reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms using ETL/ELT tools or scripting languages.
• Develops physical data models and storage architectures per design guidelines.
• Analyzes complex data elements and systems, data flow, dependencies, and relationships to contribute to data models.
• Participates in testing and troubleshooting of data pipelines.
• Develops and operates large scale data storage and processing solutions using distributed and cloud platforms.
• Uses DevOps, Scrum, Kanban and continuous improvement cycle for data driven applications.

Job description

Job Summary

Supports, develops and maintains a data and analytics platform. Effectively and efficiently process, store and make data available to analysts and other consumers. Works with the Business and IT teams to understand the requirements to best leverage the technologies to enable agile data delivery at scale.

Key Responsibilities

Implements and automates deployment of our distributed system for ingesting and transforming data from various types of sources (relational, event-based, unstructured). Implements methods to continuously monitor and troubleshoot data quality and data integrity issues. Implements data governance processes and methods for managing metadata, access, retention to data for internal and external users. Develops reliable, efficient, scalable and quality data pipelines with monitoring and alert mechanisms that combine a variety of sources using ETL/ELT tools or scripting languages. Develops physical data models and implements data storage architectures as per design guidelines. Analyzes complex data elements and systems, data flow, dependencies, and relationships in order to contribute to conceptual physical and logical data models. Participates in testing and troubleshooting of data pipelines. Develops and operates large scale data storage and processing solutions using different distributed and cloud based platforms for storing data (e.g. Data Lakes, Hadoop, Hbase, Cassandra, MongoDB, Accumulo, DynamoDB, others). Uses agile development technologies, such as DevOps, Scrum, Kanban and continuous improvement cycle, for data driven application.
Cummins is an equal opportunity employer. Our policy is to provide equal employment opportunities to all qualified persons without regard to race, sex, color, disability, national origin, age, religion, union affiliation, sexual orientation, veteran status, citizenship, gender identity, or other status protected by law.