Tech Lead in Data Engineering (M/F)

HITO Solutions; Porto; Presencial; EUR 50 000 - 70 000; Tempo integral

Resumo da oferta

A leading technology company in Porto is seeking a Tech Lead in Data Engineering. This role involves managing data engineering initiatives, mentoring junior engineers, and designing scalable solutions using Python, Azure, and Databricks. Candidates should have a strong background in data architecture and proven experience in building production pipelines. Excellent opportunities for career growth are offered.

Qualificações

• Minimum of 5 years of production-level Python coding experience.
• Advanced SQL skills required.
• Minimum of 2 years experience in Azure services.

Responsabilidades

• Lead design and development of data pipelines.
• Optimize data storage formats and implement quality checks.
• Mentor junior team members in best practices.

Conhecimentos

Production-grade Python coding

SQL expertise

Azure services management

Data architecture

ETL processes

Mentoring

Formação académica

Masters or PhD in related field

Ferramentas

Databricks

PySpark

CI/CD tools

Descrição da oferta de emprego

Overview

As a Tech Lead in Data Engineering, you will serve as a key technical advisor to stakeholders, own end-to-end data engineering initiatives, manage technical debt, and mentor junior engineers. You will play a critical role in designing, architecting, and building robust, scalable data solutions.

This role requires a strong software engineering mindset, with proven experience writing production-grade Python code, and solid expertise in Azure, Databricks (PySpark), and SQL.

Responsibilities

• Lead the design and development of batch and real-time data pipelines using tools like Databricks, PySpark, and DBT.
• Optimize data storage formats (e.g., Delta Lake, Parquet) and implement data quality checks.
• Collaborate with data scientists and analysts to provide seamless access to data for analytics and machine learning.
• Manage Azure cloud infrastructure and ensure compliance with data privacy regulations.
• Mentor junior team members and promote best practices in data engineering.

Qualifications

• Masters or PhD in a related field.
• Python: minimum of 5 years of production-level coding experience
• SQL: advanced level
• Azure (Data Factory, managed services): minimum of 2 years of experience
• Databricks with PySpark: minimum of 3 years of experience
• Proven experience in building production pipelines, making technical decisions, and mentoring other engineers.
• Strong skills in data architecture, ETL processes, and cloud infrastructure management.
• Experience with CI/CD tools and data security best practices.