Lead Data Engineer

Decskill; Portugal; Presencial; EUR 60 000 - 80 000; Tempo integral

Resumo da oferta

A leading IT consulting firm in Portugal is seeking a skilled Lead Data Engineer. The ideal candidate will have over 6 years of experience, expertise in data modeling, and strong programming skills, particularly in Python and SQL. Responsibilities include participating in architecture discussions, creating data validation rules, and improving delivery processes. Interested candidates should send their CV to the provided email.

Qualificações

• 6+ years of experience in Data Engineering or a similar role.
• Proven experience in data requirement gathering and analysis.
• Strong SQL skills, especially T-SQL.

Responsabilidades

• Participate in architectural discussions with the data engineering team.
• Create single sources of truth for activity data.
• Implement data validation rules.

Conhecimentos

Data Modeling

Python

SQL

Data mining

Machine Learning

Kafka

AWS Kinesis

Pentaho

Ferramentas

Snowflake

Apache Hop

Descrição da oferta de emprego

Direct message the job poster from Decskill

Decskill, founded in 2014 as an IT Consulting Company, places paramount importance on its greatest asset: its people. Our main mission is to deliver value through knowledge and talent, and we achieve this by fostering a culture of excellence and investing in the development and well-being of our people. With over 600 dedicated professionals and offices in Lisbon, Porto, Madrid, and Luxembourg, Decskill operates across three core areas:

• DECSKILL TALENT: We believe that our people are key to our success. Through Decskill Talent, we empower our team to embrace the digital transformation challenges of our clients. We collaborate with clients to drive innovation, ensuring project success and business growth.
• DECSKILL BOOST: Equipping our team with the latest tools and methodologies, we optimize Time-to-Market and deliver innovative solutions exceeding client expectations.
• DECSKILL CONNECT: Our team collaborates closely with clients to implement and manage IT infrastructures that generate long-term value.

At Decskill, we believe that by nurturing and empowering our people to confront the challenges of digital transformation, we create value not only for our clients but also for our entire ecosystem, fostering a digital community dedicated to growth and progress.

We are looking for a Lead Data Engineer!

Responsibilities:

• Actively participate in architectural discussions and planning with the senior data engineering team members.
• Creating single sources of truth for activity data.
• Implementing technical and business data validation rules.
• Accelerate analyses by exposing Data Products via REST APIs and consolidated dimensional modeling.
• Improve our best practices, ensuring a reliable and solid delivery process
• Assist in the creation and upkeep of MLOps pipelines.

Requirements:

• Proven experience in data requirement gathering and analysis.
• Excellent knowledge of Data Modeling (emphasis on Dimensional Modeling).
• Programming knowledge to clean and process data sets (ideally Python).
• Transparency and ability to establish lasting trusting and supportive relationships.
• Experience in modern data architectures, like streaming or real-time pipelines with technologies similar to Kafka, AWS Kinesis or Snowflake Dynamic Tables.
• Knowledge in data mining, machine learning and/or NLP.
• 6+ years of experience in an Data Engineering or similar role.
• 6+ years of experience creating data sets and models.
• Strong SQL skills, namely T-SQL (knowing Snowflake is a plus)
• Knowledge of Pentaho Data Integration, Kettle or Apache Hop. Plus
• Experience with Kafka or similar technologie.
• Good level of english.

If you’re interested in this job, please send your CV to [e-mail] with reference “CA/LeadDataEngineer".

Decskill is committed to equality and non-discrimination with all our talents. We recruit and promote talent, based on diversity and inclusion, regardless of age, gender, ethnicity, race, nationality or any other form of discrimination incompatible with the dignity of the human being.

Job details

• Senioriry level: Not Applicable
• Employment type: Contract
• Job function: Information Technology
• Industries: IT Services and IT Consulting

Referrals increase your chances of interviewing at Decskill by 2x