Azure Devops with Data Engineer

Cloud Hybrid Technologies, LLC; Cincinnati (OH); On-site; USD 90,000 - 120,000; Full time

Job summary

A leading cloud services company in Cincinnati is looking for a skilled professional with expertise in Azure cloud, data engineering, and strong Python and SQL capabilities. The successful candidate will manage large datasets, oversee data orchestration using Airflow, and collaborate effectively with teams to ensure high-quality project outcomes. Experience in AI/ML application monitoring and DevOps practices is essential for this role, along with a commitment to continuous learning and adapting to emerging technologies.

Qualifications

• Experience in migrating applications to Azure cloud.
• Strong understanding of machine learning algorithms and evaluation techniques.
• Effective collaboration with cross-functional teams.

Responsibilities

• Manage and preprocess large datasets efficiently.
• Develop and troubleshoot data orchestration with Airflow.
• Monitor and maintain AI/ML model performance.

Skills

Azure cloud

Data Science

Python

SQL

DevOps

AI/ML monitoring

Kubernetes

Docker

Airflow

Tools

PostgreSQL

Git

Kibana

Job description

• Azure cloud–Devops, CICD, Artifactory and experience in migrating application to cloud
• Data Science– Experience in Model ops, understanding of AIML model monitoring metrics and model development
• Data engineering– Airflow, ELK, Dockers and Kubernetes
• Strong hands on in Python and SQL
• · Data Science and data engineering Experience with good understanding ofData Science, AzureDevOps, Azure data factory, Model Ops, Python, SQL, Dashboarding, Model Ops, Airflow, CI/CD, Kubernetes, Kibana and model governance
• · Demonstrates a strong capacity to understand client needs and collaborate effectively with both internal teams and external stakeholders to achieve successful project outcomes. This involves actively listening to client feedback, translating business requirements into actionable technical tasks, and fostering open communication channels throughout the project lifecycle. By engaging in regular status updates and collaborative planning sessions, ensures alignment of project objectives, timely delivery of milestones, and overall client satisfaction.
• · Ability to quickly learn and adapt to emerging tools and technologies, as well as support the team in understanding and ramping up on new platforms or frameworks through effective knowledge sharing and training sessions.
• · Data Engineering Ability to manage, preprocess, and pipeline large datasets efficiently.
• · Machine Learning: Strong understanding of ML algorithms, model monitoring, and evaluation techniques.
• · Understanding of AI, ML and GenAI application post production monitoring metrics
• · Performance monitoring of AI/ML Models, understanding of metrics for model monitoring and maintenance.
• · DevOps: Strong experience with CI/CD pipelines, containerization (e.g., Docker), orchestration (e.g., Kubernetes), and automation tools.
• · Cloud Computing: Experience with cloud platforms such as Azure, Cloud for scalable deployment and management.
• · Experience in onboarding applications in Azure cloud
• · Software Development: Proficiency in Python programming languages; version control (e.g., Git).
• · Hands on with SQL and experience in PostgresSQL DB
• · Monitoring & Maintenance: Skills in deploying monitoring solutions, troubleshooting, and maintaining model performance in production.
• · Utilise Airflow for data orchestration, develop DAGs, and effectively troubleshoot any issues
• · Security & Compliance: Knowledge of data privacy, security best practices, and regulatory requirements.
• · Collaboration & Communication: Ability to work with cross-functional teams and clearly document processes and findings.

Cloud Hybrid is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. Cloud Hybrid will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will Cloud Hybrid require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract