data engineer in AI

HireHi; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

Remote work options

Modern offices and coworking spaces

Career development paths

Sponsored training and conferences

Team-building events

Onboarding buddy

Medical and wellness packages

Laptop and equipment provided

Opportunities to speak at conferences

Blog contributions

Job summary

Addepto — компания по консалтингу в области ИИ и обработки данных, ищет инженера данных для проектирования и поддержки конвейеров ADF, разработки ETL/ELT и интеграций. Требуется глубокое владение Python, Azure Functions, SQL и Power BI, а также опыт работы в средах Azure.

В обязанности входит взаимодействие с Product Owner и Architect, настройка CI/CD в Azure DevOps и обеспечение качества данных. График гибкий: удаленная работа или современные офисы, поддержка развития сотрудников.

Qualifications

• Опыт работы с Azure Data Factory в корпоративной среде.
• Глубокие знания Python, Azure Functions, REST API и автоматизации.
• Сильные SQL-навыки и моделирование данных для ETL/ELT.
• Опыт CI/CD в Azure DevOps и развёртываний в нескольких средах.
• Знание Azure сервисов для дата-решений (Azure SQL, Key Vault).
• Опыт работы с Power BI для отчетности.
• Навыки взаимодействия с заказчиком и стейкхолдерами.
• Уровень английского не ниже C1.
• Будет плюсом dbt и внедрение хранилищ на Azure.

Responsibilities

• Проектирование, разработка и поддержка конвейеров ADF.
• Настройка и управление связями и наборами данных.
• Мониторинг, устранение проблем и оптимизация конвейеров ADF.
• Разработка ETL/ELT и развитие слоя хранилища.
• Сотрудничество с Product Owner и Architect.
• Разработка компонентов на Python, Azure Functions и интеграций API.
• Участие в CI/CD через Azure DevOps.
• Поддержка Power BI отчетности по мере необходимости.
• Коммуникация со стейкхолдерами и управление рисками.
• Бесперебойная коммуникация и ответственность за качество.

Tools

Azure Data Factory

Azure Functions

REST APIs

Azure DevOps

Power BI

dbt

Azure SQL Database

Azure Key Vault

Job description

Описание: Addepto is an AI consulting and data engineering company that builds scalable, ROI-focused AI solutions for enterprises and startups. It develops the ContextClue product and contributes open-source solutions to the AI community.

Задачи:

• Design, develop, and maintain Azure Data Factory pipelines, including orchestration, parameterization, and trigger management.
• Configure and manage linked services and datasets in ADF.
• Monitor, troubleshoot, and optimize ADF pipelines for performance and reliability.
• Develop and maintain ETL/ELT processes and support the evolution of the data warehouse layer.
• Translate business requirements into technical solutions with the Product Owner and Architect.
• Develop and maintain Python-based components, including Azure Functions, API integrations, and automation scripts.
• Contribute to Azure DevOps CI/CD pipelines, releases, and environment promotion.
• Support occasional Power BI reporting and dashboarding.
• Maintain proactive communication, stakeholder alignment, and visibility of risks and impacts.
• Take ownership of assigned tasks and contribute to continuous platform improvement.

Требования:

• Strong hands-on experience with Azure Data Factory, including pipeline and orchestration design, linked services, datasets, triggers, parameterization, monitoring, troubleshooting, performance tuning, and deployment-aware development in enterprise environments.
• Excellent knowledge of Python, Azure Functions, REST APIs, and automation.
• Strong SQL skills and a solid understanding of data modeling for ETL/ELT and warehouse workloads.
• Experience with CI/CD processes in Azure DevOps, including pipelines, releases, and multi-environment deployments.
• Solid understanding of Azure services and cloud-based data solutions, such as Azure SQL Database and Azure Key Vault.
• Experience with Power BI for occasional dashboarding and reporting.
• Experience with modern development practices and tools.
• Consulting mindset, proactive communication, and strong stakeholder alignment skills.
• Ability to collaborate effectively with a Product Owner and Architect during planning and delivery.
• Independent and responsible approach to delivering high-quality solutions.
• Excellent command of English, at least C1.
• Будет плюсом: Knowledge of dbt, experience implementing data warehouses on Azure

Условия:

• Flexible work arrangements, including remote work or modern offices and coworking spaces.
• Career development paths, knowledge-sharing initiatives, language classes, and sponsored training and conferences.
• Partnerships with Databricks and Anthropic provide access to training materials and certification programs.
• Team-building events and an integration budget.
• Work anniversary, birthday, and milestone celebrations.
• Medical and sports packages, eye care, psychotherapy, coaching, and well-being support.
• Full work equipment, including a laptop and other necessary devices.
• Opportunities to speak at conferences, write for the company blog, and participate in meetups.
• Dedicated onboarding buddy.