Data Engineer

HireHi; Spain (TX); Hybrid; USD 110,000 - 170,000; Full time

Benefits offered by this job

Private medical insurance

Company-provided laptop

Training and development

Flexible working hours

International environment

Job summary

BETWEEN Group ищет опытного инженера данных для разработки масштабируемых архитектур, конвейеров данных и интеграции источников с использованием Azure, Spark и Databricks. Вы будете работать в междисциплинарной команде над проектами AI.

Требуются сильные навыки Python и SQL, опыт ETL-процессов и англ. язык на высоком уровне. Гибкий график, международная среда, обучение и возможность участия в проектах ML/LLM.

Qualifications

• Степень магистра в области информатики или смежной дисциплины.
• 4–5 лет опыта в Data Engineering, Data Analytics или Data Modeling.
• Сильные навыки Python и SQL, опыт ETL-процессов.
• Опыт работы в Azure, Spark и Databricks, CI/CD приветствуется.
• Свободное владение английским языком.

Responsibilities

• Проектирование и поддержка высокопроизводительных архитектур данных.
• Построение и оптимизация конвейеров данных для структурированной и неструктурированной информации.
• Разработка ETL-процессов и интеграция источников данных.
• Моделирование данных и развитие корпоративного хранилища.
• Обеспечение качества данных и мониторинг.
• Аналитика и требования к отчетности совместно с другими командами.
• Участие в проектах ML, Data Products и интеграциях LLM.
• Координация разработки, тестирования и развёртывания решений.
• Наставничество и техническая поддержка младших специалистов.

Skills

Python

SQL

Power BI

Databricks

Azure

Spark

LLM integrations

Machine Learning

Education

Магистр по информатике или смежной области

Tools

Azure

Apache Spark

Databricks

Power BI

Job description

Описание: BETWEEN Group provides IT and engineering career opportunities and develops technology solutions for leading clients in Infrastructure, Cloud, Software, Project Management, and other areas.

Задачи

• Design, develop, and maintain secure, scalable, high-performance data architectures;
• Build, optimize, and maintain data pipelines for structured and unstructured information;
• Develop ETL processes to extract, transform, and integrate data from multiple sources;
• Design data models and contribute to the evolution of the company’s data warehouse;
• Ensure data quality and integrity through validation, cleansing, and monitoring processes;
• Investigate data-related incidents, perform root cause analysis, and implement corrective actions;
• Collaborate with multidisciplinary teams to define reporting and analytics requirements;
• Participate in projects involving Machine Learning, Data Products, LLM integrations, and enterprise Generative Artificial Intelligence applications;
• Coordinate the development, testing, and deployment of data solutions;
• Provide technical guidance and mentoring to junior profiles when necessary.

Требования

• Degree or Master’s degree in Computer Science, Software Engineering, Mathematics, Statistics, or a related field;
• 4–5 Years of experience in Data Engineering, Data Analytics, Data Modeling, or related positions;
• Strong experience designing and developing ETL processes;
• Advanced Python and SQL skills;
• Practical experience working with Microsoft Azure;
• Knowledge of Apache Spark and Big Data technologies;
• Experience working in Agile environments;
• Experience using Power BI;
• Experience with Databricks;
• High level of English;
• Nice to have: Experience with Microsoft Fabric, knowledge of Machine Learning projects, experience with LLM integration projects and enterprise Generative Artificial Intelligence applications.

Условия

• Flexible working hours;
• International and collaborative environment;
• Modern cloud technology projects;
• Multidisciplinary Agile teams;
• Company-provided laptop and peripherals;
• Private medical insurance;
• Company-funded training and development;
• Personalized support from the Talent team and monthly follow-up meetings;
• Flexible benefits with tax advantages for meals, transport, and childcare;
• Access to the Wellhub platform;
• Exclusive discounts through the Inspiring Benefits Club;
• Financial rewards through the referral program.