Job Search and Career Advice Platform

Ativa os alertas de emprego por e-mail!

Senior Data Engineer

Stefanini Group

Manaus

Presencial

BRL 80.000 - 120.000

Tempo integral

Há 21 dias

Cria um currículo personalizado em poucos minutos

Consegue uma entrevista e ganha mais. Sabe mais

Resumo da oferta

A global technology solutions provider is seeking a Data Management Specialist based in Manaus, Brazil. This role focuses on building, managing, and optimizing data pipelines while ensuring compliance with data governance and security requirements. The ideal candidate will have strong experience in various Data Management architectures, primarily in AWS, and possess advanced English skills. This position provides the flexibility of remote work.

Qualificações

  • Advanced or Fluent in English.
  • Strong experience with various Data Management architectures, mainly in AWS environment.
  • Experience in compliance and governance during data use.

Responsabilidades

  • Create, maintain, and optimize data pipelines for various data structures.
  • Drive Automation through effective metadata management.
  • Collaborate with data owners and stakeholders around data topics.
  • Ensure compliance with data architecture and security principles.

Conhecimentos

Data Management architecture expertise
Data Modeling
Building and managing data pipelines
Commercial and open source message queuing technologies
Creativity and collaboration
Effective communication skills

Ferramentas

Databrics
Spark
Python
Terraform
SQL
Scala
S3
AWS Glue
AWS Athena
AWS Lambda
AWS Step Functions
Big Data
Relational Databases
EMR
Gitflow
Agile Methodology
DevOps
Descrição da oferta de emprego
Mission
  • Responsible for building, managing, and optimizing data pipelines;
  • Support for defining data flows and access to data sources;
  • Ensure compliance with data governance, data architecture, and data security requirements.
Responsibilities
  • Create, maintain, and optimize data pipelines for data structures that encompass data modeling, data transformation, schemas, metadata, and workload management;
  • Drive Automation through effective metadata management;
  • Participate in ensuring compliance and governance during data use, including the maintenance of the data catalog;
  • Collaborate and support data owners and other stakeholders around data topics;
  • Ensure the proper use of the data architecture defined by Data Factory team;
  • Respect and follow security principles ensuring compliance with data delivery.
Competencies & Skills
  • Strong experience with various Data Management architectures, mainly AWS environment;
  • Strong experience with Data Modeling;
  • Ability to design, build and manage data pipelines;
  • Experience working with commercial and open source message queuing technologies;
  • Highly creative and collaborative;
  • Excellent communication skills and the ability to collaborate effectively with cross-functional teams.
Specific Technical Knowledge
  • Solid knowledge in : Databrics, Spark, python, terraform, SQL, Scala, S3, AWS Glue, AWS Athena, AWS Lambda, AWS Step Functions; Big data, Relational Databases;
  • Experience in : EMR, Gitflow, Agile Metodology; DevOps.
Languages
  • English : Advanced or Fluent
Additional information
  • Remote work
Obtém a tua avaliação gratuita e confidencial do currículo.
ou arrasta um ficheiro em formato PDF, DOC, DOCX, ODT ou PAGES até 5 MB.