Data engineer

GuestWorld; Lisboa; Presencial; EUR 40.000 - 70.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Competitive salary

Ongoing training

Professional growth

Dynamic work environment

Descripción de la vacante

GuestWorld ищет инженера по данным для разработки и реализации стратегии обработки данных, политики управления и архитектур. Вы будете проектировать эволюцию Data Lake/Warehouse/Lakehouse, настраивать конвейеры ETL/ELT и обеспечивать качество данных.

Требуется опыт в SQL, Python/PySpark, DataOps и GDPR. Работа в динамичной среде c возможностями профессионального роста и обучением.

Formación

• 3+ года опыта в data engineering.
• Знания Data Lake / Data Warehouse / Lakehouse.
• SQL и Python/PySpark на продвинутом уровне.
• Знание инфо-пайплайнов, инжекции данных и трансформаций.
• Опыт Data Governance, метаданных и MDM.
• Опыт DataOps, CI/CD и мониторинга.
• Понимание GDPR и privacy.
• Аналитический склад ума и коммуникабельность.

Responsabilidades

• Определение и внедрение стратегии обработки данных и политики управления.
• Проектирование и эволюция архитектур и моделей данных.
• Разработка конвейеров поглощения, трансформации и доставки данных.
• Внедрение решений по интеграции источников данных.
• Обеспечение управления метаданными, качества и трассируемости.
• Продвижение DataOps, CI/CD, автоматизации и мониторинга.
• Сотрудничество с техническими и бизнес-единицами для улучшения решений.

Conocimientos

Data Engineering

SQL

Python

PySpark

Data Governance

CI/CD

GDPR

Agile

Communication

Analytical Thinking

Herramientas

Databricks

Spark

Azure Synapse

Microsoft Fabric

Descripción del empleo

Описание

We are GuestWorld, a company specializing in outsourcing and human resources development. We are guided by a culture of excellence and promote a positive environment, aligning our clients' objectives with the motivation of our people. We focus on effective solutions, continuous training, and partnerships based on trust and value creation.

Задачи

• Contribute to defining and implementing the data strategy and related governance policies, ensuring the quality, security, consistency, and compliance of information;
• Design, implement, and evolve data architectures and models, ensuring scalability, performance, and alignment with business needs and the technology architecture;
• Develop and maintain data ingestion, transformation, and delivery pipelines, promoting process automation, reuse, and efficiency;
• Implement data engineering solutions and frameworks, ensuring the integration of different information sources and the availability of data for analytical exploration;
• Ensure data metadata management, cataloging, quality, and traceability, promoting the consistency and reliability of information;
• Implement DataOps and continuous integration and delivery practices, ensuring the monitoring, maintenance, and optimization of data platforms and solutions;
• Collaborate with technical and business teams, promoting good practices in information management and use and the continuous improvement of data solutions.

Требования

• At least 3 years of experience in data engineering, with a broad understanding of architecture and governance;
• Knowledge of modern data architectures, namely Data Lake, Data Warehouse, and Lakehouse, and distributed processing platforms (Databricks, Spark, Azure Synapse, or Microsoft Fabric);
• Experience developing data solutions using SQL and programming languages such as Python and PySpark;
• Knowledge of data ingestion and transformation frameworks, information modeling, and pipeline development;
• Knowledge of Data Governance, data quality, metadata management, and Master Data Management practices;
• Experience with Agile methodologies and DataOps/DevSecOps practices, including CI/CD, automation, version control, and monitoring;
• Knowledge of security, privacy, and compliance as applied to data management, namely GDPR;
• Analytical ability, structured thinking, and complex problem-solving skills, with a focus on quality;
• Ability to communicate and collaborate with technical teams and business areas, demonstrating autonomy, initiative, organization, and a focus on innovation and continuous improvement.

Условия

• Competitive salary and benefits package;
• Ongoing training and specific certifications;
• Opportunity for professional growth and development;
• Dynamic and collaborative work environment;
• A growing company with a promising future.