Mid-level Data Engineer – Data Platform

Jobtailor; Rio de Janeiro; Presencial; BRL 120 000 - 240 000; Tempo integral

Resumo da oferta

Jobtailor in Rio de Janeiro, Brazil, seeks a data engineer to develop and maintain data pipelines on cloud platforms with a focus on governance and quality. You will collaborate with the Data team to promote best practices, document data flows, and ensure scalable, reliable data processing across analytics workloads.

Applicants should have hands-on experience with SQL, Python, and modern data tooling to build robust ETL/ELT pipelines.

Qualificações

• Proficiency with cloud data platforms, preferably GCP.
• Experience with SQL and programming languages such as Python, Scala, or Java.
• Experience with code versioning tools and CI/CD processes.
• Experience with workload management and orchestration tools, such as Airflow and Workflows.
• Knowledge of Docker or similar container technologies.
• Familiarity with monitoring tools for metrics, applications, and logs, such as Datadog, Grafana, Kibana, Cloud Logging, and log-based metrics.
• Knowledge of agile methodologies such as Scrum and Kanban.
• Plus: experience with Data Quality processes.
• Plus: experience with maintenance and support of CI/CD pipelines.
• Plus: knowledge of messaging architectures and flows.
• Plus: knowledge of DBT (Data Build Tool).
• Plus: experience with publish/subscribe flows using Pub/Sub.

Responsabilidades

• Develop and maintain data engineering pipelines and processes, following governance guidelines and development best practices.
• Promote and share development standards, best practices, and quality criteria with peers in the Data team.
• Create and maintain technical documentation for the implemented data flows and processes.

Conhecimentos

SQL

Python

Scala

Java

CI/CD

Data Quality

DBT

Pub/Sub

Docker

Agile Methodologies

Ferramentas

Airflow

Datadog

Grafana

Kibana

Cloud Logging

Descrição da oferta de emprego

Responsibilities

• Develop and maintain data engineering pipelines and processes, following governance guidelines and development best practices
• Promote and share development standards, best practices, and quality criteria with peers in the Data team
• Create and maintain technical documentation for the implemented data flows and processes

Requirements

• Proficiency with cloud data platforms, preferably GCP
• Experience with SQL and programming languages such as Python, Scala, or Java
• Experience with code versioning tools and CI/CD processes
• Experience with workload management and orchestration tools, such as Airflow and Workflows
• Knowledge of Docker or similar container technologies
• Familiarity with monitoring tools for metrics, applications, and logs, such as Datadog, Grafana, Kibana, Cloud Logging, and log-based metrics
• Knowledge of agile methodologies such as Scrum and Kanban
• Plus: experience with Data Quality processes
• Plus: experience with maintenance and support of CI/CD pipelines
• Plus: knowledge of messaging architectures and flows
• Plus: knowledge of DBT (Data Build Tool)
• Plus: experience with publish/subscribe flows using Pub/Sub

Core Competencies

Demonstrates expertise in developing and maintaining data engineering pipelines using cloud data platforms like GCP, along with proficiency in SQL and programming languages such as Python, Scala, or Java. Familiarity with CI/CD processes, workload management tools, and agile methodologies is essential for ensuring high-quality data flows and processes.

Highest-signal resume keywords

• GCP Cloud Data Platforms
• SQL Programming
• Python Programming
• CI/CD Processes
• Airflow Workload Management

ATS Optimization Keywords

Hard Skills

• SQL
• Python
• Scala
• Java
• CI/CD
• Data Quality
• DBT
• Pub/Sub
• Docker
• Agile Methodologies

Industry Keywords

• Data Engineering
• Development Best Practices
• Governance Guidelines
• Technical Documentation
• Messaging Architectures

Tools & Technologies

• Airflow
• Datadog
• Grafana
• Kibana
• Cloud Logging