Azure Data Platform Architect: AI-Driven Pipelines

AdventHealth; Town of Florida (NY); On-site; USD 96,266 - 179,046; Full time

Benefits offered by this job

Medical, Dental, and Vision Insurance

Paid Time Off

Retirement Plan

Parental Leave

Career Development

Job summary

AdventHealth in the Town of Florida is seeking a skilled Data Engineer to design and implement data pipelines using Cloud infrastructure and Azure services. The ideal candidate will have extensive experience in software design, particularly with big data and cloud platforms, and a strong knowledge of AI capabilities.

Responsibilities include gathering project requirements, building CI/CD pipelines, and collaborating with various teams to optimize data processes. A Bachelor’s degree in Computer Science or related field is required, with preference given to candidates holding a Master’s degree.

Qualifications

• 10+ years of professional experience with software design in database and big data platforms.
• 5+ years of experience with any programming language such as Java, Python or Scala.
• Experience in designing Infrastructure as Code (IaC) solutions to manage Azure resources.

Responsibilities

• Design and support data pipelines using Cloud infrastructure and Azure services.
• Collaborate with stakeholders to gather project requirements and implement security standards.
• Develop and manage the full data lifecycle from acquisition to end-user consumption.

Skills

SQL

Big Data technologies (Spark, NiFi, Impala)

AI and Cloud Tools Knowledge

CI/CD pipelines

Communication Skills

Education

Bachelor's in Computer Science or related field

Master's in Computer Science, Data Science or related field

Tools

Azure Data Factory

Snowflake

Databricks

Terraform

Git

Job description

AdventHealth in the Town of Florida is seeking a skilled Data Engineer to design and implement data pipelines using Cloud infrastructure and Azure services. The ideal candidate will have extensive experience in software design, particularly with big data and cloud platforms, and a strong knowledge of AI capabilities.

Responsibilities include gathering project requirements, building CI/CD pipelines, and collaborating with various teams to optimize data processes. A Bachelor’s degree in Computer Science or related field is required, with preference given to candidates holding a Master’s degree.