Data Engineer

Pyramid Consulting, Inc; Betim; Presencial; BRL 80.000 - 120.000; Tempo integral

Resumo da oferta

A leading consulting firm is seeking skilled professionals familiar with AWS cloud platforms and modern data architectures. Ideal candidates will have proficiency in ingestion tools and SQL frameworks, and experience in DevOps practices is highly valued. This role offers opportunities for growth and involvement in various data projects in Betim, Minas Gerais.

Qualificações

• Experience with modern data architectures including data lakes and lakehouses.
• Strong background in SQL-based frameworks and orchestration tools like dbt and Airflow.
• Demonstrated experience in DevOps practices including CI/CD.

Conhecimentos

Cloud platforms (AWS)

Data architectures

Ingestion tools (Kafka, AWS Glue)

Streaming architectures (Kafka, Flink)

SQL-based frameworks

DevOps practices

Python

Expert-level SQL

Descrição da oferta de emprego

Familiarity with major cloud platforms (AWS)Experience with modern data architectures (data lakes, lakehouses, hubs)Proficiency in ingestion tools (Kafka, AWS Glue) and formats (Iceberg, Parquet)Knowledge of streaming architectures and tools (Kafka, Flink)Strong background in SQL-based frameworks and orchestration tools (dbt, Glue, Airflow).

Experience with SCD and schema evolutionFamiliarity with Spark for transformation, streaming, tuning, debugging with Spark UIProficient in Python.

Expert-level SQLDemonstrated experience in DevOps practices (code management, CI / CD, deployment)Understanding of governance principles (quality, privacy, security)