Senior Data Engineer

Jobtailor; Brasília; Presencial; BRL 120 000 - 240 000; Tempo integral

Resumo da oferta

Jobtailor is seeking a data engineer in Brazil to design and operate data ingestion, ETL, and integration workflows. You will work with data warehouses/lakes and build scalable pipelines using SQL and Python, leveraging Kafka, Kubernetes, and modern data stack components. Proficiency with Power BI or Grafana is essential.

Ideal candidates have BI, data engineering, and predictive analytics experience, plus knowledge of MinIO, Trino, and Kafka Connect to connect enterprise systems and databases.

Qualificações

• Bachelor’s degree in IT or MEC-recognized IT postgraduate degree.
• Solid experience in BI, Data Engineering, data modeling, and integration.
• Strong SQL and Python proficiency.
• Knowledge of Data Warehouses, Data Lakes, and Data Lakehouses.
• Experience with data engineering pipelines and processes.
• Familiarity with Kafka, Kubernetes, and data visualization tools.

Responsabilidades

• Develop data ingestion, extraction, transformation, and integration processes.
• Build, monitor, and validate data processing pipelines.
• Work with Data Warehouses, Data Lakes, and Data Lakehouses.
• Develop solutions using SQL and Python.
• Work with Big Data and messaging technologies, especially Kafka.
• Deploy and configure components and applications in Kubernetes.
• Work with MinIO, Kafka Connect, and Trino (PrestoDB).
• Configure connectivity with databases and enterprise systems.
• Support BI and data analytics projects.
• Use visualization tools such as Power BI and Grafana.
• Support initiatives involving data analysis and predictive analytics techniques.

Conhecimentos

SQL

Python

Data Engineering

Kafka

Kubernetes

Formação académica

Bachelor’s Degree in Information Technology

Postgraduate Degree in IT

Ferramentas

Power BI

Grafana

MinIO

Kafka Connect

Trino

Descrição da oferta de emprego

• Develop data ingestion, extraction, transformation, and integration processes
• Build, monitor, and validate data processing pipelines
• Work with Data Warehouses, Data Lakes, and Data Lakehouses
• Develop solutions using SQL and Python
• Work with Big Data and messaging technologies, especially Kafka
• Deploy and configure components and applications in Kubernetes
• Work with MinIO, Kafka Connect, and Trino (PrestoDB)
• Configure connectivity and integration with databases and enterprise systems
• Support Business Intelligence and data analytics projects
• Use visualization tools such as Power BI and Grafana
• Support initiatives involving data analysis and predictive analytics techniques

Requirements

• Bachelor’s degree in Information Technology, or a bachelor’s degree in any field combined with a postgraduate degree in IT, recognized by the Brazilian Ministry of Education (MEC)
• Solid experience in Business Intelligence, Data Engineering, data repository modeling, data integration, or related projects and activities
• Experience with SQL and Python
• Knowledge of Data Warehouses, Data Lakes, and/or Data Lakehouses
• Experience with Data Engineering processes and pipelines
• Knowledge of Kafka and Kubernetes
• Knowledge of or experience with MinIO, Kafka Connect, and Trino
• Experience integrating databases and enterprise systemsKnowledge of visualization tools such as Power BI, Grafana, or equivalent platforms
• Knowledge of data analysis and predictive analytics techniques

Core Competencies

Demonstrates expertise in Data Engineering processes, including data ingestion, transformation, and integration, while utilizing SQL and Python for building and validating data processing pipelines. Proficient in leveraging Business Intelligence tools and techniques for data analysis and visualization.

Highest-signal resume keywords

• SQL
• Python
• Data Engineering
• Kafka
• Kubernetes

Hard Skills

• Data Ingestion
• Data Transformation
• Data Integration
• Data Warehousing
• Data Lakes
• Data Lakehouses
• Data Processing Pipelines
• Predictive Analytics
• Data Repository Modeling
• Business Intelligence

Certifications & Qualifications

• Bachelor’s Degree in Information Technology
• Postgraduate Degree in IT

Industry Keywords

• Big Data
• Data Analytics
• Data Visualization
• Enterprise Systems
• Database Integration

Tools & Technologies

• Power BI
• Grafana
• MinIO
• Kafka Connect
• Trino