Job opening For Cloud Data Engineer (Azure) in our organisation at Hyd

Youngsoft India Pvt Ltd; United States; Remote; USD 90,000 - 130,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to join their dynamic team. In this role, you will design and implement innovative data lake house projects using Microsoft Azure technologies, ensuring seamless integration and delivery of cross-functional products. Your expertise in Python, SQL, and Azure services will be essential as you engage in Agile practices and collaborate with diverse teams. This is a fantastic opportunity to contribute to cutting-edge projects while furthering your career in a supportive environment that values innovation and compliance.

Qualifications

• 7 years of experience in designing and developing distributed data pipelines.
• 5 years of experience with Azure data service technologies.

Responsibilities

• Design and implement data lake house projects within Azure.
• Participate in Agile ceremonies including daily standups and code reviews.

Skills

Data Engineering

SQL

Python

PySpark

Azure Data Lake

Databricks

Postgres SQL

CI/CD

Strong Communication

Education

Bachelor's degree in Computer Science

Tools

Azure Data Factory

Azure DevOps

JIRA

Confluence

Job description

Role & responsibilities

Essential Job Functions:

• Understand requirements and engage with the team to design and deliver projects.
• Design and implement data lake house projects within azure.
• Design and develop application lifecycle utilizing Microsoft Azure technologies
• Participate in design and planning and necessary documentation
• Participate in Agile ceremonies including daily standups, scrum, retrospectives, demos, code reviews.
• Hands on with Python and Postgres SQL development and Azure data pipelines
• Engage with team to develop and deliver cross functional products

Key Skills

a. Data Engineering and SQL

b. Python

c. PySpark

d. Azure Data lake and ADF

e. Databricks

f. Postgres database and coding experience

g. CICD

h. Strong communication

Other Responsibilities:

• Document and maintain project artifacts.
• Maintain comprehensive knowledge of industry standards, methodologies, processes, and best practices.
• Complete training as required for Privacy, Code of Conduct etc.
• Promptly report any known or suspected loss, theft or unauthorized disclosure or use of PI to the General Counsel/Chief Compliance Officer or Chief Information Officer.
• Adhere to the company's compliance program.
• Safeguard the company's intellectual property, information, and assets.
• Other duties as assigned.

Minimum Qualifications and Job Requirements:

• Required: Azure data engineering associate and data bricks data engineering certification and {color:#ff0000}Postgres SQL experience{color}*
• Bachelor's degree in CS.
• 7 years of hands-on experience in designing and developing distributed data pipelines.
• 5 years of hands-on experience in Azure data service technologies.
• 5 years of hands-on experience in Python, SQL, Object oriented programming, ETL and unit testing
• Experience with data integration with APIs, Web services, Queues
• Experience with Azure DevOps and CI/CD as well as agile tools and processes including JIRA, confluence.
• {color:#FF0000}Working experience with writing SQL queries from scratch{color}