A leading consulting firm in Espírito Santo is looking for a skilled data engineer with expertise in cloud platforms like AWS and modern data architectures. The ideal candidate will have proficiency in ingestion tools like Kafka and AWS Glue, along with a strong background in SQL and DevOps practices. This role demands familiarity with streaming architectures and tools, as well as transformation processes using Spark. Join a dynamic team focused on innovation and data excellence.
Familiarity with major cloud platforms (AWS)Experience with modern data architectures (data lakes, lakehouses, hubs)Proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)Knowledge of streaming architectures and tools (Kafka, Flink)Strong background in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow).
Experience with SCD and schema evolutionFamiliarity with Spark for transformation, streaming, tuning, debugging with Spark UIProficient in Python.
Expert-level SQLDemonstrated experience in DevOps practices (code management, CI / CD, deployment)Understanding of governance principles (quality, privacy, security)
* The salary benchmark is based on the target salaries of market leaders in their relevant sectors. It is intended to serve as a guide to help Premium Members assess open positions and to help in salary negotiations. The salary benchmark is not provided directly by the company, which could be significantly higher or lower.