Azure Devops with Data Engineer

Ethereum Technologies LLC; Connecticut; On-site; USD 100,000 - 180,000; Full time

Job summary

Ethereum Technologies LLC is seeking professionals with strong data engineering and data science capabilities to design, implement, and monitor AI/ML workflows in cloud environments. The role emphasizes building robust data pipelines with Airflow, containers with Docker, and scalable deployments using Kubernetes on Azure.

You will collaborate across client teams and internal engineers to translate business needs into actionable tasks, track progress, and maintain governance and monitoring of

Qualifications

• Experience with Python and SQL in data engineering/science roles.
• Hands-on with Azure cloud, DevOps, and CI/CD pipelines.
• Knowledge of model ops, monitoring metrics, and governance.

Responsibilities

• Collaborate with internal and external stakeholders to translate business requirements into technical tasks.
• Provide regular status updates and ensure timely milestone delivery.

Skills

Python

SQL

Data Science

DevOps

Model Ops

Dashboarding

Tools

Azure DevOps

Azure Data Factory

Airflow

ELK

Docker

Kubernetes

Kibana

CI/CD

Job description

• Azure cloud –Devops, CICD, Artifactory and experience in migrating application to cloud
• Data Science – Experience in Model ops, understanding of AIML model monitoring metrics and model development
• Data engineering – Airflow, ELK, Dockers and Kubernetes
• Strong hands on in Python and SQL
• Data Science and data engineering Experience with good understanding ofData Science, AzureDevOps, Azure data factory, Model Ops, Python, SQL, Dashboarding, Model Ops, Airflow, CI/CD, Kubernetes, Kibana and model governance
• Demonstrates a strong capacity to understand client needs and collaborate effectively with both internal teams and external stakeholders to achieve successful project outcomes. This involves actively listening to client feedback, translating business requirements into actionable technical tasks, and fostering open communication channels throughout the project lifecycle. By engaging in regular status updates and collaborative planning sessions, ensures alignment of project objectives, timely delivery of milestones, and overall client satisfaction.
• Ability to quickly learn and adapt to emerging tools and technologies, as well as support the team in understanding and ramping up on new platforms or frameworks through effective knowledge sharing and training sessions.
• Data Engineering Ability to manage, preprocess, and pipeline large datasets efficiently.
• Machine Learning: Strong understanding of ML algorithms, model monitoring, and evaluation techniques.
• Understanding of AI, ML and GenAI application post production monitoring metrics
• Performance monitoring of AI/ML Models, understanding of metrics for model monitoring and maintenance.
• DevOps: Strong experience with CI/CD pipelines, containerization (e.g., Docker), orchestration (e.g., Kubernetes), and automation tools.
• Cloud Computing: Experience with cloud platforms such as Azure, Cloud for scalable deployment and management.
• Experience in onboarding applications in Azure cloud
• Software Development: Proficiency in Python programming languages; version control (e.g., Git).
• Hands on with SQL and experience in PostgresSQL DB
• Monitoring & Maintenance: Skills in deploying monitoring solutions, troubleshooting, and maintaining model performance in production.
• Utilise Airflow for data orchestration, develop DAGs, and effectively troubleshoot any issues
• Security & Compliance: Knowledge of data privacy, security best practices, and regulatory requirements.
• Collaboration & Communication: Ability to work with cross‑functional teams and clearly document processes and findings.

ETHEREUM TECHNOLOGIES LLC is an equal opportunity employer inclusive of female, minority, disability and veterans, (M/F/D/V). Hiring, promotion, transfer, compensation, benefits, discipline, termination and all other employment decisions are made without regard to race, color, religion, sex, sexual orientation, gender identity, age, disability, national origin, citizenship/immigration status, veteran status or any other protected status. ETHEREUM TECHNOLOGIES LLC will not make any posting or employment decision that does not comply with applicable laws relating to labor and employment, equal opportunity, employment eligibility requirements or related matters. Nor will ETHEREUM TECHNOLOGIES LLC require in a posting or otherwise U.S. citizenship or lawful permanent residency in the U.S. as a condition of employment except as necessary to comply with law, regulation, executive order, or federal, state, or local government contract