Data Engineer GCP (inglês avançado)

Insi; Brasil; Remote; BRL 350.000 - 550.000; Vollzeit

Zusammenfassung

Meta is seeking a Senior Data Engineer to design and implement robust Data Warehouse and Data Lake architectures on GCP. You will lead data analytics and engineering initiatives, shaping scalable data models and end-to-end pipelines for diverse analytical use cases.

You will partner with cross‑functional teams to drive secure, high‑performing data platforms, migrate legacy systems to cloud, and influence architectural decisions across the data landscape in Brazil.

Qualifikationen

• GCP is core: strong BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, and Composer experience.
• Experience in designing scalable data models for analytics and operations.
• Proficient in Python and SQL with focus on performance.
• English advanced for collaboration.

Aufgaben

• Design and implement Data Warehouse and Data Lake on GCP.
• Lead analytics and data engineering initiatives in GCP ecosystem.
• Define scalable data repository models for multiple use cases.
• Build and maintain data pipelines for ingestion, transformation, storage.
• Support architectural decisions across Big Data on GCP.
• Ensure secure, reliable, high-performance data processing for multiple consumers.
• Identify risks and provide operational recommendations.
• Support performance testing, monitoring, optimization of cloud data platforms.
• Contribute to migration of legacy on-prem systems to GCP architectures.

Kenntnisse

Spark / PySpark

Python for Data Engineering

SQL analytics

English Advanced

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Storage

Dataproc

Composer (Airflow)

Git / GitFlow

Jira

GitLab CI

SonarQube

Jobbeschreibung

• Design and implement robust Data Warehouse and Data Lake architectures using Google Cloud Platform (GCP) services;
• Act as a technical leader in Data Analytics and Data Engineering solutions within the GCP ecosystem;
• Define and develop scalable data repository models to support multiple analytical and operational use cases;
• Build and maintain efficient data pipelines for ingestion, transformation, and storage using GCP-native tools;
• Support and influence architectural decisions across the Big Data and Cloud Data Platform landscape on GCP;
• Ensure secure, reliable, and high-performance data processing pipelines for multiple consumers;
• Identify technical risks and provide recommendations based on operational insights and support team feedback;
• Support performance testing, monitoring, and optimization of cloud-based data platforms;
• Contribute to the migration of legacy on-premise systems to modern GCP-based architectures.

What are we looking for?

• Design and implement robust Data Warehouse and Data Lake architectures using Google Cloud Platform (GCP) services;
• Act as a technical leader in Data Analytics and Data Engineering solutions within the GCP ecosystem;
• Define and develop scalable data repository models to support multiple analytical and operational use cases;
• Build and maintain efficient data pipelines for ingestion, transformation, and storage using GCP-native tools;
• Support and influence architectural decisions across the Big Data and Cloud Data Platform landscape on GCP;
• Ensure secure, reliable, and high-performance data processing pipelines for multiple consumers;
• Identify technical risks and provide recommendations based on operational insights and support team feedback;
• Support performance testing, monitoring, and optimization of cloud-based data platforms;
• Contribute to the migration of legacy on-premise systems to modern GCP-based architectures.

Requirements

• Google Cloud Platform (GCP): Strong experience with BigQuery, Dataflow, Pub/Sub, Cloud Storage, Dataproc, Composer (Airflow)
• Apache Spark / PySpark: Intermediate to advanced
• Python for Data Engineering: Advanced
• SQL (analytical and performance optimization): Advanced
• Git / GitFlow workflows: Intermediate
• CI/CD & DevOps tools (JIRA, GitLab, GitLab CI, Artifact Registry, SonarQube): Basic to intermediate
• English Advanced

Location of this position:

Remote/Brazil

Why build your carrer at Meta?

We offer autonomy, clear goals and a dynamic and challenging environment, where professionals have the opportunity to interact with different technologies, participate in all types of projects, bring new ideas and work from anywhere in Brazil and (why not?) anywhere in the world. In addition, we are one of the best companies to work for in Brazil according to Great Place to Work and one of the 10 fastest growing technology companies in the country for 3 consecutive years, according to Anuário Informático Hoje.

What are our values?

• We are people serving people
• We all think and act like owners
• We are hungry for performance
• We grow and learn together
• We pursue excellence and simplicity
• We have innovation and creativity in our DNA

All people are welcome regardless of their condition, disability, ethnicity, religious belief, sexual orientation, appearance, age or others. We want you to grow up with us in a welcoming environment full of opportunities.

Did you relate? Then, #ComeBeMeta!