AWS Data Engineer

NTT; Bologna; In loco; EUR 40.000 - 60.000; Tempo pieno

Descrizione del lavoro

A leading IT services provider is seeking an AWS Data Engineer to work on data platforms. The role involves migrating infrastructure, setting up monitoring stacks, and ensuring data processing for analytics and machine learning. Ideal candidates will have at least 5 years of AWS experience and familiarity with tools like Docker, Kubernetes, and AWS Lambda.

Competenze

• Minimum 5 years of experience with AWS preferred.
• Experience in migrating workloads from on-premise to cloud.
• Working experience with Agile Methodology.

Mansioni

• Deliver data acquisition, transformations, cleansing, and loading.
• Migrate infrastructure to a highly available, scalable architecture.
• Set up a monitoring stack using tools like CloudWatch and Prometheus.

Conoscenze

Cloud native experience (AWS preferred)

Big Data Architectures

Docker and Kubernetes

AWS Lambda

Security best practices

AWS infrastructure and networking

Agile Methodology

Java

Scala

Python

Shell scripting

Formazione

AWS Certification: AWS Certified Solutions Architect or Developer

Strumenti

CloudFormation

CloudWatch

Prometheus

ELK stack

Descrizione del lavoro

Social network you want to login/join with:

Responsibilities

For Data Intelligence Line NTT DATA is looking for an AWS Data Engineer.

Your role as an AWS Data Engineerin NTT Data will be work on AWS Data Platform projects, working in partnership with business analysts and solution architects to understand use cases, data needs, and outcome objectives. In this role, you will deliver data acquisition, transformations and improvement, cleansing, conversion, compression, and loading of data into data lakes in order to be consumed by analytics and machine learning models

• Understand the current application infrastructure and suggest changes to it
• Define and document best practices and strategies regarding application deployment and infrastructure maintenance.
• Migrate our infrastructure with zero downtime to a highly available, scalable one.
• Set up a monitoring stack such as CloudWatch, Prometheus, and the ELK stack.
• Define service capacity planning strategies.
• Implement the application’s CI/CD pipeline using the AWS CI/CD stack.
• Write infrastructure as code using CloudFormation or similar.

Required Skills

• Working experience in a cloud native environment in at least one of the 3 major public clouds (GCP, AWS, Azure), at least 5 year experience on AWS is preferred
• Experience and knowledge of Big Data Architectures, cloud and on premise
• Experience with Docker and Kubernetes. Having used ECS/EKS in the past is a plus
• Experience with the serverless approaches using AWS Lambda
• Strong notions of security best practices (, KMS, etc.).
• AWS infrastructure and networking working experience
• Working experience in migrating workloads from on premise to cloud environment
• Experience in monitoring distributed infrastructure, using AWS tools or open source ones such as CloudWatch, Prometheus, and the ELK stack
• Proven experience in: Java, Scala, Python, and shell scripting
• Working experience with Agile Methodology and Kanban
• AWS Certification: AWS Certified Solutions Architect and/or AWS Certified Developer.