Big Data Architect

Caylent; Brasil; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

An established industry player is seeking a Big Data Architect to join their dynamic team. This role involves designing and implementing innovative big data solutions on the AWS cloud, ensuring optimal data processing and migration strategies. You will collaborate with cross-functional teams, guiding engineers through complex projects while honing your skills in a supportive environment. With a commitment to employee development, this forward-thinking company prioritizes your growth and success, making it an ideal place for passionate professionals eager to make a significant impact in the cloud services domain.

Qualificações

• Experience in designing and implementing ETL and data lakes.
• Proficient in NoSQL databases and cloud security governance.

Responsabilidades

• Deliver top-quality data solutions on AWS for customers.
• Lead engineers and address technical issues in daily standups.

Conhecimentos

ETL

Orchestration

CI/CD pipelines

Data Lakes

Data Warehouses

Hadoop

Spark

Kafka

NoSQL DBs

Excellent communication skills

Ferramentas

AWS Glue

AWS Lambda

Terraform

CloudFormation

CDK

CI/CD tools

Descrição da oferta de emprego

Caylent is a cloud native services company that helps organizations bring the best out of their people and technology using Amazon Web Services (AWS). We provide a full range of AWS services including: workload migrations & modernization, cloud native application development, DevOps, data engineering, security & compliance, and everything in between. At Caylent, our people always come first.

The Mission

At Caylent, a Big Data Architect works as an integral part of a cross-functional delivery team to design and implement big data solutions on the AWS cloud for our customers. You will design and document the big data and NoSQL solutions, and provide guidance to the engineers performing the hands-on implementation of your design. You will participate in daily standup meetings with your team and bi-weekly agile ceremonies with the customer. Your manager will have a weekly 1:1 with you to help guide you in your career and make the most of your time at Caylent.

Your Assignment

• Work with a team to deliver top-quality data solutions on AWS for customers
• Participate in daily standup meetings and address technical issues
• Design, optimization and migration of web-scale data processing operations
• Be able to write code whenever needed and possible
• Lead and help engineers without any direct supervision

Your Qualifications

• Design and implementation of at least two of these:
  • ETL, Orchestration and CI/CD pipelines
  • Data Lakes, Data Warehouses
  • Analytics and visualization
• Design and implementation of at least two of these:
  • Data processing: eg. Hadoop, Spark, EMR
  • Streaming/Messaging: eg. Kafka, RabbitMQ, Kinesis
  • NoSQL DBs like KeyValue stores, Document Databases, Graph Databases
  • Caching: eg. Redis, Memcache
  • Search: eg. ElasticSearch, Solr
• Design and implementation of at least one of these:
  • Large scale application migration and modernization with a heavy focus on data
  • Security, access controls and governance on cloud
• Experience with IaC tools such as CloudFormation, CDK, Terraform
• Experience with AWS Glue, Lambda, SDK
• Experience with CI/CD tools
• Excellent written and verbal communication skills

This role may require up to 25% travel, depending on business needs.