Data Engineer ID43407

AgileEngine; Belo Horizonte; Híbrido; BRL 624 000 - 936 000; Tempo integral

Vantagens oferecidas por esta oferta de emprego

Professional growth

Competitive compensation

A selection of exciting projects

Flextime

Resumo da oferta

A leading software development company in Belo Horizonte, Brazil is seeking a Senior Data Engineer to shape data solutions that enhance decision-making. You will collaborate with diverse teams to build scalable pipelines and contribute to a professional growth-focused culture. Ideal candidates have over 5 years of experience, strong Python and SQL skills, and proficiency with databases like Snowflake and Google BigQuery. This position offers competitive USD-based compensation and a flexible work schedule.

Qualificações

• 5+ years of experience working as a Data Engineer.
• Comprehensive documentation skills.
• Experience with Snowflake and DBT.
• Strong English communication skills.

Responsabilidades

• Develop and maintain secure and efficient data pipelines using DBT, PySpark, and Python.
• Build the infrastructure and tooling for optimal ETL of data.
• Identify and implement internal process improvements.
• Apply the Data Quality Framework by developing unit tests.
• Monitor data pipelines to ensure minimum 99.5% data availability.
• Create and maintain intuitive data models.
• Write and update project documentation.

Conhecimentos

Python for object-oriented programming and data scripting

Experience with Snowflake

Strong SQL experience

Experience using DBT for data transformations

Experience with Airflow

Experience with REST API for integration and data ingestion

Experience with Google BigQuery

Handling large-scale and sensitive data securely

Real-time data processing

Advanced English communication

Ferramentas

DBT

Terraform

AWS (Glue, EMR, S3)

REST API

Google BigQuery

Terraform

AWS

Descrição da oferta de emprego

AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in areas such as application development and AI/ML, and our people‑first culture has earned us multiple Best Place to Work awards.

Senior Data Engineer

WHY JOIN USIf you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!

ABOUT THE ROLE

As a Senior Data Engineer, you’ll play a key role in shaping high-impact data solutions that power smarter decision‑making and support a global mission to connect people with meaningful work. You’ll collaborate with diverse teams to build secure, scalable pipelines and drive innovation in cloud-based data infrastructure. This is a chance to grow technically, influence product evolution, and thrive in an open, collaborative culture that values learning and excellence.

WHAT YOU WILL DO

• Develop and maintain secure and efficient data pipelines using DBT, PySpark, and Python in an Indeed-supported cloud environment, integrating all HR data sources to enable analytics and insights for HR COEs and HR leadership.
• Build the infrastructure and tooling required for optimal extraction, transformation, and loading (ETL) of data from various sources using Python, DBT, Terraform, and AWS technologies such as Glue, EMR, and S3.
• Identify, design, and implement internal process improvements, including automating manual workflows, debugging and optimizing data delivery, and re‑architecting infrastructure for enhanced scalability.
• Apply the Data Quality Framework in the HRDM repository by developing unit tests, and creating both manual and automated test cases.
• Monitor data pipelines to ensure a minimum of 99.5% data availability.
• Create and maintain data models that are intuitive and easily consumable by business partners.
• Write and update project documentation (most data ingestion scripts are written in Python).

MUST HAVE

• 5+ years of experience working as a Data Engineer.
• Python for object‑oriented programming and data scripting.
• Experience with Snowflake.
• Strong SQL experience.
• Experience using DBT for data transformations.
• Experience with Airflow.
• Experience with REST API for integration and data ingestion.
• Experience with Google BigQuery.
• Handling large‑scale and sensitive data securely.
• Real‑time data processing (e.g., from Google Sheets or APIs).
• Comprehensive documentation skills.
• Advanced English communication.

PERKS AND BENEFITS

• Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps.
• Competitive compensation: We match your ever-growing skills, talent, and contributions with competitive USD‑based compensation and budgets for education, fitness, and team activities.
• A selection of exciting projects: Join projects with modern solutions development and top-tier clients that include Fortune 500 enterprises and leading product brands.
• Flextime: Tailor your schedule for an optimal work‑life balance, by having the options of working from home and going to the office – whatever makes you the happiest and most productive.