Cloud Data Engineer: Lakehouse & ETL Specialist

Cummins Inc; Saddar; Vor Ort; PKR 1.800.000 - 3.200.000; Vollzeit

Zusammenfassung

Cummins Inc. is seeking a Data Engineer to design, develop, and sustain data pipelines and storage solutions that enable scalable analytics across business units.

The role partners with IT and business teams to translate requirements into robust data engineering solutions using Azure Databricks, PySpark, Python/Scala, and SQL. You will build and govern data platforms, ensure data quality, and contribute to cloud-based data initiatives while applying Agile practices to continuously improve data

Qualifikationen

• Strong programming skills in Python/PySpark or Scala, with the ability to develop, test, and maintain production-quality code.
• Strong knowledge of SQL and experience working with data extraction, transformation, and loading processes.
• Hands-on experience with Azure Databricks and cloud-based data engineering solutions.
• Experience with Azure data services, including ADLS, Event Hub, and Azure Functions.
• Good understanding of Data Lake, Delta Lake, Lakehouse, ETL/ELT, data modeling, and distributed data processing.
• Exposure to Big Data technologies such as Spark, MapReduce, Hive, HBase, Kafka, or equivalent technologies.
• Familiarity with Agile software development, DevOps, Scrum, or Kanban methodologies.
• Strong problem-solving and analytical skills, with the ability to identify root causes and implement robust solutions.

Aufgaben

• Develop and maintain reliable, scalable, and efficient ETL/ELT data pipelines in Azure Databricks using PySpark, Python/Scala, and SQL.
• Design and implement ingestion and transformation solutions for relational, event-based, and unstructured data.
• Build and maintain Data Lake and Lakehouse architectures and optimize processing and storage performance.
• Develop physical data models and implement data storage architectures per design guidelines.
• Implement data quality checks, monitoring, and troubleshooting to resolve data quality issues.
• Collaborate with stakeholders to deliver analytics and data solutions through Agile practices.

Jobbeschreibung

Cummins Inc. is seeking a Data Engineer to design, develop, and sustain data pipelines and storage solutions that enable scalable analytics across business units.

The role partners with IT and business teams to translate requirements into robust data engineering solutions using Azure Databricks, PySpark, Python/Scala, and SQL. You will build and govern data platforms, ensure data quality, and contribute to cloud-based data initiatives while applying Agile practices to continuously improve data