Data Architect / Data Engineer

buscojobs Brasil; Paraná; Teletrabalho; BRL 120.000 - 160.000; Tempo integral

Resumo da oferta

A dynamic tech startup is seeking a Data Engineer / Cloud Architect to design and maintain scalable data pipelines and cloud environments. The ideal candidate has extensive experience with Azure Data Factory, PySpark, and Databricks. This remote-first role allows you to work from anywhere in Brazil, emphasizing growth opportunities and a collaborative culture.

Serviços

Competitive compensation

Remote-first culture

Inclusive startup environment

Growth opportunities

Challenging projects

Qualificações

• Experience as a Data Engineer or Cloud Architect.
• Proficient in Azure Data Factory and PySpark.
• Hands-on with Databricks and Lakehouse architecture.

Responsabilidades

• Design and maintain data pipelines for optimal performance.
• Manage Databricks environment and Lakehouse architecture.
• Implement container orchestration with Kubernetes.

Conhecimentos

Building scalable ETL/ELT pipelines

Data processing with PySpark

Databricks platform expertise

Containerization with Kubernetes

Monitoring tools like Grafana

Problem-solving skills

Ferramentas

Azure Data Factory

PySpark

Unity Catalog

Grafana

Descrição da oferta de emprego

About Us

At Aravita, we're not just building a product; we're building the future of AI-enabled fresh food operations. We are a fast-paced, innovative startup on a mission to solve complex problems with data. Our culture is built on collaboration, curiosity, and a passion for technology. We're looking for a brilliant Data Engineer / Cloud Architect to join our dynamic team and help us build a scalable, world-class data infrastructure.

The Role

As a Data Engineer / Cloud Architect, you will be at the heart of our data operations. You'll design, build, and maintain our cutting-edge data platform, empowering our entire organization to make data-driven decisions. This is a hands-on role where you will architect robust data pipelines, optimize our cloud environment, and ensure our data is secure, reliable, and accessible.

Your primary responsibilities

• Designing, developing, and deploying scalable ETL / ELT pipelines using Azure Data Factory and PySpark.
• Architecting and managing our Databricks environment, leveraging Unity Catalog to build a state-of-the-art Lakehouse architecture.
• Implementing and managing infrastructure on container orchestration platforms like Kubernetes.
• Developing monitoring and observability solutions using tools like Grafana to ensure system health and performance.
• Collaborating with data scientists, analysts, and software engineers to understand data needs and deliver effective solutions.
• Championing best practices in data governance, data quality, and cloud security.

What You\'ll Bring

We\'re looking for a seasoned expert with a passion for building great things. You should be comfortable working in a fast-paced environment and have a strong foundation in data engineering and cloud principles.

Key Qualifications

• Proven experience as a Data Engineer, Cloud Architect, or a similar role.
• Strong proficiency in building data pipelines with Azure Data Factory and processing large-scale data with PySpark.
• Deep, hands-on experience with the Databricks platform, including a strong understanding of Unity Catalog and the principles of Lakehouse architecture.
• Solid experience with containerization and orchestration using Kubernetes.
• Familiarity with monitoring and visualization tools, specifically Grafana.
• Excellent problem-solving skills and the ability to work independently.
• Must currently reside in Brazil. Preference will be given to candidates in the greater São Paulo area to facilitate occasional team meetups.

Why You'll Love Working With Us

We believe that our team is our greatest asset, and we invest in our people accordingly. When you join us, you can expect:

• Competitive Compensation: An attractive salary and benefits package.
• Remote-First Culture: The flexibility to work from anywhere in Brazil, with the technology and support you need to succeed.
• Amazing Startup Environment: A vibrant, inclusive, and collaborative culture where your ideas are valued and your impact is real.
• Growth Opportunities: The chance to grow your skills and career in a rapidly expanding company.
• Meaningful Work: The opportunity to work on challenging projects that have a direct impact on our business and customers.

If you are a data visionary ready to make a significant impact, we\'d love to hear from you!