Data engineer for drug discovery

Software Country; United States; Remote; USD 110,000 - 170,000; Full time

Benefits offered by this job

Company laptop

Flexible work schedule

Remote work option

Growth opportunities

Job summary

Arcadia Inc. ищет Data Engineer/ETL разработчика для построения масштабируемых конвейеров данных, поддерживающих ИИ-исследования и вычислительные исследования в области биоинформатики.

Требуется опыт Python, Airflow, Docker, PostgreSQL и Snowflake, знание ETL/ELT и API-интеграции. Возможна удаленная работа; сотрудничество по B2B или трудовому договору.

Qualifications

• Требуется сильное владение Python и опыт разработки обработчиков данных и автоматизации.
• Опыт работы с Airflow или аналогичными инструментами оркестрации рабочих процессов.
• Практический опыт работы с Docker и контейнеризованными приложениями.
• Опыт работы с PostgreSQL и/или Snowflake.
• Понимание ETL/ELT, интеграции данных и автоматизации рабочих процессов.

Responsibilities

• Проектирование, разработка и сопровождение ETL/ELT конвейеров на Python.
• Разработка и поддержка автоматизированных рабочих процессов с использованием Apache Airflow, включая планирование и мониторинг.
• Разработка и обслуживание Docker-окружений для повторимого выполнения задач обработки данных.
• Интеграция источников данных, API и вычислительных инструментов в автоматизированные рабочие процессы.
• Улучшение надежности, масштабируемости и поддерживаемости конвейеров через тестирование, логирование и оптимизацию производительности.

Skills

Python

Airflow

Docker

PostgreSQL

Snowflake

ETL/ELT

Data integration

Troubleshooting

API integration

Kubernetes

Tools

Airflow

Docker

PostgreSQL

Snowflake

Kubernetes

GitOps

Job description

Описание:

We have 30 years of expertise in designing and building custom software systems. We provide software development services focusing on complex high-load applications, AI and BI solutions, and mobile apps. We are looking for a Data Engineer / ETL Developer to build and maintain reliable, scalable data pipelines supporting AI-driven drug discovery and computational research.

Задачи:

Design, develop, and maintain ETL/ELT pipelines using Python to process and transform data efficiently and reliably. Build and manage automated workflows using Apache Airflow, including scheduling, dependency management, monitoring, and error handling. Develop and maintain Docker-based environments to ensure consistent execution of data processing tasks. Integrate data sources, APIs, and computational tools into automated workflows. Improve pipeline reliability, scalability, and maintainability through testing, logging, and performance optimization. Collaborate with engineering and scientific teams to support data-driven research and AI-powered applications.

Требования:

Strong Python programming skills and experience developing data processing or automation solutions. Hands-on experience with Apache Airflow or similar workflow orchestration tools. Practical experience with Docker and containerized applications. Hands-on experience with PostgreSQL and/or Snowflake. Understanding of ETL/ELT processes, data integration, and workflow automation. Ability to troubleshoot pipeline failures and build reliable, maintainable solutions. Будет плюсом: Experience with other workflow orchestration or workflow management tools; Familiarity with AWS cloud services; Experience with API design and integration; Knowledge of Kubernetes and GitOps practices; Experience developing AI-driven applications; Background in life sciences, computational chemistry, bioinformatics, or drug discovery

Условия:

Collaboration via a B2B contract with payments in USD or EUR, depending on your preference, or through a labor contract Flexible work schedule. Possibility to work remotely Opportunities for professional growth. A company laptop to ensure a comfortable and efficient work setup.