Cloud Data Engineer

Global Business Ser. 4u; Ann Arbor (MI); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Global Business Ser. 4u in Dearborn, MI is seeking an Azure Cloud Data Engineer to design and develop on the data lake platform and all Azure-based applications, with strong Python and data modeling skills.

The role is hybrid (Tue/Wed/Thu) and involves collaborating across teams to implement data pipelines, Azure services, and data integration with APIs. Bachelor's in Computer Science and 7 years of distributed data pipeline experience are required.

Qualifications

• Bachelor's degree in Computer Science
• 7 years of hands-on experience in designing and developing distributed data pipelines
• 5 years of hands-on experience in Azure data service technologies
• 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
• Experience with data integration with APIs, Web services, Queues
• Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence
• Working experience with writing SQL queries from scratch

Responsibilities

• Understand requirements and engage with team to design and deliver projects.
• Design and implement data lake house projects within azure.
• Design and develop application lifecycle utilizing Microsoft Azure technologies
• Participate in design and planning and necessary documentation
• Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
• Hands on with Python development and Azure data pipelines
• Engage with team to develop and deliver cross functional products
• Postgres SQL knowledge is a plus

Skills

Data Engineering

Python

SQL

ETL

OOP

Education

Bachelor's degree in Computer Science

Tools

Azure Data Lake

Azure Data Factory

Azure DevOps

JIRA

Job description

Job Summary

Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

Description

Azure Cloud Data Engineer

Hybrid Position :: Tue/Wed/Thu

Location :: Dearborn MI

Job Summary

Cloud Data Engineer will be responsible for developing on the data lake platform and all applications on Azure cloud. Good data Engineering, data modeling is a must with Python programming background. The Data Engineer will be responsible for providing design and development solutions for applications in the cloud.

Essential Job Functions

• Understand requirements and engage with team to design and deliver projects.
• Design and implement data lake house projects within azure.
• Design and develop application lifecycle utilizing Microsoft Azure technologies
• Participate in design and planning and necessary documentation
• Participate in Agile ceremonies including daily standups, scrum, retrospectives,demos, code reviews.
• Hands on with Python development and Azure data pipelines
• Engage with team to develop and deliver cross functional products
• Postgres SQL knowledge is a plus

Key Skills

• Data Engineering and SQL
• Python
• PySpark
• Azure Data lake and ADF

Minimum Qualifications And Requirements

• Bachelor's degree in Computer Science.
• 7 years of hands-on experience in designing and developing distributed data pipelines.
• 5 years of hands-on experience in Azure data service technologies.
• 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
• Experience with data integration with APIs, Web services, Queues
• Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
• Working experience with writing SQL queries from scratch

Other Responsibilities

Document and maintain project artifacts.

• Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
• Complete training as required for Privacy, Code of Conduct etc.
• Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
• Adhere to the company's compliance program.
• Safeguard the company's intellectual property, information, and assets.