Data Engineer - Tech Lead

Digibee Inc.; São Paulo; Híbrido; BRL 20.000 - 80.000; Tempo integral

Resumo da oferta

A leading company in integration solutions is looking for a Lead Data Engineer to architect their data backbone. The role involves defining data management strategies, developing scalable solutions, leading engineering teams, and ensuring compliance with data security standards. Ideal candidates will possess deep technical expertise in cloud computing and data management while also showcasing leadership capabilities.

Serviços

R$ 1.200,00/month on Caju card for allowances

Life insurance

Child care assistance

Gympass

Partnership for English courses

Qualificações

• Proven experience in large-scale data management.
• Extensive experience with Google Cloud Platform.
• Strong skills in data privacy laws and best practices.

Responsabilidades

• Define and implement data management strategies.
• Develop and optimize ELT/ETL pipelines.
• Lead data engineering teams and mentor junior engineers.

Conhecimentos

Data Management

Data Pipeline Development

Data Visualization

Team Leadership

Cloud Computing

Python

Java

Go

Formação académica

Degree in Computer Science or related field

Ferramentas

Google Cloud Platform

Hadoop

Spark

Kafka

Tableau

Descrição da oferta de emprego

About Digibee

Digibee is an iPaaS that scales integration workflows while reducing cost and technical debt. Rather than require specialized integration experts, Digibee lets every developer quickly build, test, deploy, govern, and monitor integrations across on-premise and cloud environments using a simple but powerful low-code interface.

About Digibee

Digibee is an iPaaS that scales integration workflows while reducing cost and technical debt. Rather than require specialized integration experts, Digibee lets every developer quickly build, test, deploy, govern, and monitor integrations across on-premise and cloud environments using a simple but powerful low-code interface.

Founded in São Paulo, Brazil, in 2017 and headquartered in Weston, Florida, our team is widely distributed throughout the Americas. In May of 2023, Digibee closed a Series B funding round of $60 million that is intended to drive our expansion in the United States.

About the role

Join our growing team as a Lead Data Engineer and architect the data backbone that powers Digibee business intelligence. In this high-impact role, you will take on a pivotal role in designing, building, and managing Digibee’s internal data platform. This hands-on position requires both deep technical expertise and leadership capability, with responsibility for shaping our data architecture, developing scalable data solutions, and driving the strategic use of data across the organization. You will lead the end-to-end data product lifecycle, from planning and development to operational maintenance, ensuring that our data systems are robust, compliant, and cost-effective. As a technical leader within our lean data team, you’ll set best practices, guide your engineering partner in execution, deliver impactful data solutions that align with Digibee’s strategic objectives, and integrate FinOps principles to build efficient and cost-conscious data pipelines leveraging Google Cloud Platform (GCP) and best-in-class SaaS tools. If you thrive in shaping data strategy while staying close to the code and driving tangible results, this is your opportunity to make a significant impact.

Key Responsibilities:

• Data Strategy & Architecture: Define and implement data management strategies, building robust data lakes, warehouses, and pipelines that support data-driven decisions. Ensure compliance with data security standards such as GDPR, LGPD, HIPAA, and CCPA.
• Pipeline & Processing Development: Develop and optimize end-to-end ELT/ETL pipelines that connect various data sources (databases, APIs) to user interfaces and analytics platforms. Utilize Google Cloud services, including Cloud Storage, BigQuery, and Pub/Sub.
• Cost & Operational Management: Forecast and manage data-related costs for tools, storage, and processing. Post-implementation, oversee data ingestion, tool evaluation, and ongoing maintenance for continuous improvements.
• Data Visualization & Insights: Recommend and utilize visualization tools to deliver actionable insights and uncover trends across datasets. Communicate findings and project value effectively to stakeholders.
• Team Leadership & Mentorship: Lead data engineering teams, mentoring junior engineers, and championing best practices in software engineering, compliance, and cost-effective data management.

Required Qualifications:

• Technical Expertise: Proven experience in large-scale data management, including data lake and warehouse architectures, automation, access control, and segregation of data for security and compliance.
• Programming Skills: Demonstrated proficiency in Python, Java, or Go and experience with big data processing frameworks like Hadoop, Spark, and Kafka is required.
• Cloud Computing: Extensive experience with Google Cloud Platform (e.g., Cloud Run, Cloud Functions, Pub/Sub).
• Data Modeling & Compliance: Strong skills in data modeling, ETL processes, and knowledge of data privacy laws and best practices.
• Cost Management: Ability to forecast and manage costs associated with data tools and services, optimizing for scalability and efficiency.
• Communication & Stakeholder Management: Ability to effectively present technical concepts and project impact to both technical and non-technical stakeholders.

Preferred Qualifications:

• Data Visualization & Orchestration: Experience with visualization tools (e.g., Tableau, Power BI, Looker Studio) and orchestration frameworks (e.g., Apache Airflow, Dagster).
• DevOps & CI/CD: Familiarity with Terraform or OpenTofu for infrastructure management and GitLab CI for continuous integration.
• We're remote first, with a flexible working schedule
• R$ 1.200,00/month on Caju card (for food and meal allowance, mobility, home office supplies, culture, health, and education)
• Life insurance
• Child care assistance
• Gympass
• English course: we have a partnership for group classes for R$100 monthly
  
  

Our culture

We believe in a highly collaborative work environment in order to foster constant development and exchange between teams. We encourage learning, sharing knowledge, and using new technologies to create disruptive ideas - we want to create something great together!

At Digibee, we know it's our people who make the difference. We embrace and value diversity and are dedicated to encouraging a supportive and respectful culture in our community.

Create a Job Alert

Interested in building your career at Digibee Inc.? Get future opportunities sent straight to your email.

Accepted file types: pdf, doc, docx, txt, rtf

Enter manually

Accepted file types: pdf, doc, docx, txt, rtf

LinkedIn Profile *

What is your English Level? * Select...

A1 - Beginner

• Can understand basic phrases and simple conversations
• Limited workplace communication ability
• Can handle routine tasks requiring simple information exchange
• Basic email communication

B1 - Intermediate

• Can participate in meetings and handle most workplace situations
• Comfortable with technical discussions with some limitations

B2 - Upper-Intermediate

• Can interact fluently with native speakers in professional contexts
• Can present technical concepts clearly

C1 - Advanced

• Can express ideas fluently and spontaneously
• Effective in leadership and complex technical discussions
• Near-native fluency
• Can handle any professional situation with ease

When do you choose a raw object store lake over a warehouse for a brand-new domain, and how do you enforce governance on day 1? *

Name one common anti-pattern you’ve seen in BigQuery that blows up cost. *

How do you handle schema evolution in streaming pipelines? *

How do you guarantee idempotency in an ELT load triggered every hour? *

When would you prefer Airflow over Cloud Composer? *

When would you prefer Airflow over Cloud Composer?

Describe a FinOps win you delivered in under 30 seconds. *

Name two ways to secure PII in GCP without sacrificing query performance. *

U.S. Standard Demographic Questions

We are committed to building a better place for all and providing a welcoming and inclusive work environment. To help us with this purpose, we invite you to complete this optional survey. Your responses will be used to identify areas of improvement in our hiring process and to support diversity initiatives. Submission of this information is entirely voluntary, and whatever your decision, it will not affect your application status.

How would you describe your gender identity? (mark all that apply) Select...

How would you describe your racial/ethnic background? (mark all that apply) Select...

How would you describe your sexual orientation? (mark all that apply) Select...

Do you identify as transgender? Select...

Do you have a disability or chronic condition (physical, visual, auditory, cognitive, mental, emotional, or other) that substantially limits one or more of your major life activities, including mobility, communication (seeing, hearing, speaking), and learning? Select...

Are you a veteran or active member of the United States Armed Forces? Select...