Data Engineering Tech Lead - Porto

Alpineo Consulting; Porto; Híbrido; EUR 60 000 - 100 000; Tempo integral

Resumo da oferta

Alpineo Consulting in Porto, Portugal seeks a Data Engineering Tech Lead to design and implement scalable data platforms on AWS, with emphasis on Lambda, Glue, and Step Functions, plus SQL and Python. The role blends hands-on engineering with technical leadership across projects and teams.

Hybrid work model: on-site 3 days a week in Porto, with collaboration across the EU. You will mentor engineers, influence data strategy, and help drive architecture decisions while delivering robust,

Qualificações

• BS/MS degree in Computer Science, Engineering or equivalent experience.
• English B2 or higher.
• Strong AWS and data engineering foundation.
• Experience with AWS: Lambda, Glue, Step Functions, CloudFormation, CloudWatch.
• Experience with relational and NoSQL databases: Redshift, MySQL, PostgreSQL; Iceberg tables.
• Nice to have Azure Databricks and Databricks exposure.
• Senior to mid-senior level, full-time.

Responsabilidades

• Design, implement, and maintain scalable data solutions on AWS.
• Develop robust architectures focusing on scalability, performance, security, and cost.
• Manage cloud networking including VPCs, subnets, security groups, and routing.
• Write and optimise SQL queries; identify bottlenecks.
• Manage ETL processes and data integration into Redshift, MySQL, PostgreSQL.
• Create documentation and provide training to team members.
• Set up logging and tracing with CloudTrail and X-Ray.
• Orchestrate workflows with Apache Airflow and AWS Step Functions.
• Use Athena for interactive analysis on S3 data.
• Provide technical leadership and SME guidance in AWS and data engineering.
• Write technical documentation.
• Stay updated on emerging technologies.

Conhecimentos

AWS

Lambda

Glue

Step Functions

CloudFormation

Python

SQL

Redshift

MySQL

PostgreSQL

Iceberg

Apache Airflow

CloudWatch

X-Ray

Athena

Azure

Data Engineering

Kafka

Databricks

Azure Databricks

NoSQL

Formação académica

BS/MS degree in Computer Science, Engineering or equivalent

Ferramentas

Apache Airflow

Databricks

Kafka

Azure Databricks

Iceberg Tables

Redshift

MySQL

PostgreSQL

NoSQL Databases

Descrição da oferta de emprego

Business Director Alpineo Portugal - We are hiring! We are seeking a skilled Tech Lead with a strong foundation in AWS and extensive experience in solution architecture, database management, and data engineering. The ideal candidate will possess deep expertise in AWS services such as Lambda, Glue, Step Functions, and CloudFormation, alongside proficiency in Python, SQL, and database technologies. Familiarity with Iceberg tables for managing large datasets is highly advantageous, and experience with Azure platform technologies is a nice‐to‐have.

HYBRID: 3X WEEK ONSITE Key Responsibilities

Utilise expert knowledge of AWS services like Lambda, Glue, and Step Functions to design, implement, and maintain scalable data solutions.

Develop robust solution architectures considering scalability, performance, security, and cost optimisation.

Demonstrate proficiency in cloud networking, including VPCs, subnets, security groups, and routing tables.

Write and optimise SQL queries and identify performance bottlenecks.

Manage ETL processes and data integration into Redshift, MySQL, and PostgreSQL.

Create documentation and provide training to team members.

Set up and manage logging and tracing mechanisms in AWS using services like AWS CloudTrail and AWS X‐Ray.

Implement orchestration solutions using Apache Airflow and AWS Step Functions.

Utilise Athena for interactive query analysis of large datasets in Amazon S3.

Provide technical leadership and guidance, acting as a subject‐matter expert in AWS and data engineering technologies.

Write comprehensive solution documents and technical documentation.

Stay updated on emerging technologies and industry trends.

Challenge business requirements and propose innovative solutions for efficiency and performance improvement.

The base skills we are searching for

Expertise in AWS: Extensive experience with Lambda, Glue, Step Functions, CloudFormation, and CloudWatch.

Strong solution‐architecture knowledge: Ability to design scalable and efficient data solutions on AWS, adhering toshaled best practices.

Proficiency in Python and databases: Strong programming skills in Python and experience with relational databases (MySQL, PostgreSQL, Redshift) and NoSQL databases.

Orchestration and workflow management: Experience with Apache Airflow and AWS Step Functions for automating and managing data workflows.

ETL tools and big‐data experience: Knowledge of ETL tools and experience working with large volumes of data;
preference for Kafka experience.

Experience with Iceberg tables: Familiarity with Iceberg tables for managing large datasets efficiently and ensuring ACID transactions.

Production awareness and troubleshooting: Proactive approach to production monitoring and troubleshooting, with the ability to anticipate and mitigate potential issues.

Technical leadership and communication: Capability to evolve into a technical lead role, with excellent communication and teamwork skills.

Strong analytical and problem‐solving skills: Ability to analyse requirements, define technical approaches, and propose innovative solutions.

Documentation and requirements analysis: Experience writing solution documents and technical documentation, with the ability to challenge and refine business requirements.

Exposure to Azure Databricks: Familiarity with Databricks for data engineering and analytics tasks.

Salt>

Candidate profile

BS/MS degree in Computer Science, Engineering or equivalent working experience.

English (B2 or higher level).

Passion for technology and support.

Problem‐solving skills.

Nice to have

Knowledge in Apache Flink, Kafka, and other streaming data technologies.

Experience with cloud‐native architectures and serverless computing.

Certification in AWS, Azure or relevant technologies.

Seniority level Mid‐Senior level

Employment type Full‐time

Job function Finance – IT Services and IT Consulting

Data Engineering Tech Lead - Porto • Porto, Portuguese Republic, PT