Data Engineer

Antal International Network; Sabadell; Presencial; Confidencial; Jornada completa

Descripción de la vacante

A leading company is seeking a Data Engineer to oversee data transformation and integration processes. You will play a crucial role in ensuring data reliability for impactful decision-making, working collaboratively on projects utilizing modern cloud technologies. Ideal candidates will possess a strong background in data engineering and must be proficient with cloud platforms and data orchestration tools.

Servicios

Opportunity to work on impactful projects

Access to modern technologies and cloud platforms

Ongoing training and career development

Formación

• Proven experience in data engineering, preferably in cloud environments.
• Intermediate level of English (spoken and written) required.
• Familiarity with CI/CD tools and version control systems.

Responsabilidades

• Identify, evaluate, and integrate suitable data sources for business needs.
• Design and automate data collection and transformation workflows.
• Ensure data integrity and implement cleaning and validation processes.
• Develop and maintain database models for structured and unstructured data.

Conocimientos

Data Acquisition

Pipeline Development

Data Cleaning

Data Modeling

Database Optimization

Cloud Integration

Collaboration

Educación

Academic background in Computer Science, Engineering, Mathematics

Herramientas

Azure Data Factory

Apache Airflow

Azure

AWS

GCP

Git

Azure DevOps

Descripción del empleo

Mission of the Role

The Data Engineer will be responsible for collecting, transforming, and storing data to ensure it is accessible, reliable, and secure. This role plays a key part in supporting data-driven decision-making by maintaining high-quality data pipelines and infrastructure.

Key Responsibilities

• Data Acquisition: Identify, evaluate, and integrate the most suitable data sources for business and operational needs.

• Pipeline Development: Design and automate data collection and transformation workflows using modern orchestration tools.

• Data Cleaning: Ensure data integrity and quality by implementing cleansing and validation processes to prevent analytical misinterpretations.

• Data Modeling: Develop and maintain logical and physical database models for both structured and unstructured data.

• Database Optimization: Perform routine maintenance, monitoring, and performance tuning of company databases to ensure efficiency and scalability.

• Cloud Integration: Implement cloud-based data solutions with a focus on availability, scalability, and security.

• Collaboration: Work closely with data analysts, scientists, and other stakeholders to understand data requirements and translate them into scalable solutions.

Qualifications & Skills

Education & Experience:

• Academic background in Computer Science, Engineering, Mathematics, or related scientific disciplines.

• Proven experience in data engineering, preferably in cloud environments.

Technical Skills:

• Proficiency in working with relational and non-relational databases.

• Experience with cloud platforms (e.g., Azure, AWS, or GCP) and data orchestration tools (e.g., Azure Data Factory, Apache Airflow).

• Familiarity with CI/CD tools and version control systems (e.g., Git, Azure DevOps).

• Understanding of IT infrastructure and basic coding practices (soft coding).

Languages:

• Intermediate level of English (spoken and written) required.

Benefits:

• Opportunity to work on impactful projects in a dynamic and collaborative environment.

• Access to modern technologies and cloud platforms.

• Ongoing training and career development.