Data Engineer & Infra Specialist — AWS Cloud

Decskill; Portugal; Presencial; EUR 42 000 - 70 000; Tempo integral

Resumo da oferta

Decskill, an IT consulting company with over 10 years of experience, is seeking a Data Engineer & Data Infrastructure Specialist in Portugal. You will develop and operate data analytics applications on an AWS-based Big Data platform, using Python and SQL to build end-to-end features and support data science initiatives.

You will participate in architecture discussions, deploy across environments, and ensure production readiness, while collaborating with multi-disciplinary teams in a dynamic,

Qualificações

• Up to 5 years of professional experience in Data Engineer roles.
• Bachelor's degree in Software Engineering, Computer Engineering, or a related field.
• Experience with Python for data manipulation and processing.
• Experience with SQL and NoSQL databases.
• Experience in production environments and model deployment to production.
• Fluent English is mandatory.

Responsabilidades

• Develop end-to-end features on a cloud-based Big Data platform (AWS) focused on data analysis and processing.
• Actively participate in architecture discussions, defining data flows and processes for new features.
• Develop PoCs to validate technical approaches and solutions.
• Develop production-ready solutions and perform testing.
• Deploy solutions across development, QA, and production environments.
• Monitor initial operation of deployed solutions and perform debugging, troubleshooting, and maintenance.
• Document features, solutions, and processes developed.
• Provide support with data extraction and exploratory data analysis.
• Collaborate with technical and business teams to identify and solve problems.
• Contribute to continuous improvement of data solution quality, performance, and reliability.

Conhecimentos

Python

SQL

Git

Agile methodologies

JIRA

Confluence

Fluent English

Data Science interest

Exploratory data analysis

AWS cloud services

Apache Spark / PySpark

Jupyter Notebooks

GDPR

NoSQL databases

Production environments

Model deployment

Independent work

Teamwork

Learn new technologies

Quality of deliverables

Formação académica

Bachelor's degree in Software Engineering/Computer Engineering

Ferramentas

AWS CDK / CloudFormation

PySpark

Descrição da oferta de emprego

Decskill, an IT consulting company with over 10 years of experience, is seeking a Data Engineer & Data Infrastructure Specialist in Portugal. You will develop and operate data analytics applications on an AWS-based Big Data platform, using Python and SQL to build end-to-end features and support data science initiatives.

You will participate in architecture discussions, deploy across environments, and ensure production readiness, while collaborating with multi-disciplinary teams in a dynamic,