Data Architect / Data Engineer

buscojobs Brasil; Santa Catarina; Teletrabalho; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A leading AI-powered food tech company is seeking a Data Engineer / Cloud Architect to design and build their data platform. This hands-on role involves creating scalable ETL pipelines and managing cloud environments. Ideal candidates have strong expertise in Azure Data Factory, PySpark, and Databricks. The company offers a competitive compensation package and a remote-first culture, allowing flexibility to work from anywhere in Brazil.

Serviços

Competitive compensation

Remote-first culture

Growth opportunities

Collaborative company culture

Qualificações

• Proven experience as a Data Engineer or Cloud Architect.
• Strong proficiency in Azure Data Factory and PySpark.
• Hands-on experience with the Databricks platform and Lakehouse architecture.
• Solid knowledge of Kubernetes for container management.
• Familiarity with monitoring tools like Grafana.
• Ability to work independently and solve problems.

Responsabilidades

• Design and develop scalable ETL/ELT pipelines.
• Manage Databricks environment and Unity Catalog.
• Implement infrastructure on Kubernetes.
• Develop monitoring solutions to ensure system performance.
• Collaborate with team members to resolve data needs.
• Promote data governance and security best practices.

Conhecimentos

Data pipeline development with Azure Data Factory

Processing large-scale data with PySpark

Databricks platform experience

Container orchestration with Kubernetes

Monitoring with Grafana

Problem-solving skills

Descrição da oferta de emprego

Overview

About Us

At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join our dynamic team and help us build a scalable, world-class data infrastructure.

The Role

As a Data Engineer / Cloud Architect, you will be at the heart of our data operations. You'll design, build, and maintain our cutting-edge data platform, empowering our entire organization to make data-driven decisions. This is a hands-on role where you will architect robust data pipelines, optimize our cloud environment, and ensure our data is secure, reliable, and accessible.

Your primary responsibilities

• Designing, developing, and deploying scalable ETL / ELT pipelines using Azure Data Factory and PySpark.
• Architecting and managing our Databricks environment, leveraging Unity Catalog to build a state-of-the-art Lakehouse architecture.
• Implementing and managing infrastructure on container orchestration platforms like Kubernetes.
• Developing monitoring and observability solutions using tools like Grafana to ensure system health and performance.
• Collaborating with data scientists, analysts, and software engineers to understand data needs and deliver effective solutions.
• Championing best practices in data governance, data quality, and cloud security.

What You\'ll Bring

We\'re looking for a seasoned expert with a passion for building great things. You should be comfortable working in a fast-paced environment and have a strong foundation in data engineering and cloud principles.

Key Qualifications

• Proven experience as a Data Engineer, Cloud Architect, or a similar role.
• Strong proficiency in building data pipelines with Azure Data Factory and processing large-scale data with PySpark.
• Deep, hands-on experience with the Databricks platform, including a strong understanding of Unity Catalog and the principles of Lakehouse architecture.
• Solid experience with containerization and orchestration using Kubernetes.
• Familiarity with monitoring and visualization tools, specifically Grafana.
• Excellent problem-solving skills and the ability to work independently.
• Must currently reside in Brazil. Preference will be given to candidates in the greater São Paulo area to facilitate occasional team meetups.

Why You\'ll Love Working With Us

We believe that our team is our greatest asset, and we invest in our people accordingly. When you join us, you can expect :

• Competitive Compensation: An attractive salary and benefits package.
• Remote-First Culture: The flexibility to work from anywhere in Brazil, with the technology and support you need to succeed.
• Amazing Startup Environment: A vibrant, inclusive, and collaborative culture where your ideas are valued and your impact is real.
• Growth Opportunities: The chance to grow your skills and career in a rapidly expanding company.
• Meaningful Work: The opportunity to work on challenging projects that have a direct impact on our business and customers.

If you are a data visionary ready to make a significant impact, we'd love to hear from you!