Sr Data Engineering Specialist, Sumaré

3M; Sumaré; Presencial; BRL 180 000 - 270 000; Tempo integral

Resumo da oferta

3M is seeking a Senior Data Engineer to join Corporate Research Digital Platforms (CRDP) to design, build, and operate scalable data pipelines and data products within a modern cloud-based Lakehouse platform.

You’ll collaborate with Data Engineers, Platform Engineers, Backend/Temporal Engineers, and Governance teams to deliver production-grade data solutions that support analytics, AI-driven use cases across research and business domains.

Qualificações

• Bachelor's degree or higher in Computer Science or related field.

Responsabilidades

• Design, build, and operate scalable data pipelines and data products.

Conhecimentos

SQL

Python

Databricks

AWS

English

Formação académica

Bachelor's degree or higher in Computer Science, Engineering, or related field

Ferramentas

Databricks

Temporal

Airflow

Delta Lake

DataHub

Descrição da oferta de emprego

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description:

Sr Data Engineering Specialist, Sumaré/SP

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it's equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with 93,000 other curious, creative 3Mers.

The Impact You'll Make in this Role

3M is seeking a Senior Data Engineer to join Corporate Research Digital Platforms (CRDP) to design, build, and operate scalable data pipelines and data products within a modern cloud-based Lakehouse platform.

In this role, you will contribute to the development of data pipelines, data products, and AI-enabled workflows, supporting analytics, informatics, and emerging AI-driven use cases across research and business domains. You will work within a platform that integrates Databricks, DataHub, Temporal workflows, and AWS infrastructure, enabling reliable and scalable data and AI operations.

You will collaborate closely with Data Engineers, Platform Engineers, Backend/Temporal Engineers, and Governance teams to deliver high-quality, production-grade data solutions that are reliable, scalable, and aligned with platform standards.

In this role, you will have the opportunity to:

• Design, build, and maintain scalable data pipelines for structured and unstructured data, supporting analytics, AI, GenAI, and agentic workflows.
• Develop batch and streaming pipelines using modern cloud data platforms, with a strong focus on Databricks, Delta Lake, and AWS.
• Optimize data pipelines for performance, scalability, reliability, observability, and cost efficiency.
• Support modern Lakehouse architecture by integrating pipelines with platform services such as DataHub, Temporal, metadata, orchestration, and cloud infrastructure.
• Enable AI and GenAI use cases by preparing data for feature engineering, document ingestion, structured data extraction, LLM workflows, vector search, and downstream AI services.
• Build and maintain logical and physical data models aligned with business, analytics, machine learning, and AI requirements.
• Implement data quality checks, validation rules, monitoring, lineage, cataloging, and governance standards.
• Collaborate with Platform Engineering, Governance, Backend, AI, and Reliability teams to deliver well-integrated and production-ready data solutions.
• Apply software engineering best practices, including modular design, testing, version control, CI/CD, infrastructure-as-code, and code reviews.
• Monitor production pipelines, troubleshoot operational issues, support root cause analysis, and contribute to continuous improvements in platform stability.
• Promote reusable patterns, frameworks, and pipeline components to improve engineering efficiency across teams.

Work in a modern data environment where cloud, Lakehouse, automation, and AI come together to deliver scalable data products.

Your Skills and Expertise

• Bachelor's degree or higher in Computer Science, Engineering, or related field.
• Senior experience in data engineering, data platforms, or related roles.
• Strong proficiency in SQL and Python.
• Hands-on experience building scalable data pipelines and data processing workflows.
• Experience working with distributed processing systems such as Apache Spark.
• Experience with modern cloud data platforms - Databricks or similar.
• Experience working with cloud platforms such as AWS (S3, Glue, etc.).
• Understanding of data modeling, data transformation, and data warehousing concepts.
• Experience working in cross-functional engineering environments.
• Proficiency in English.

Additional qualifications that could help you succeed even further in this role include:

• Experience with Delta Lake, Unity Catalog, and Lakehouse architectures.
• Familiarity with metadata and catalog systems such as DataHub.
• Experience with workflow orchestration tools (Temporal, Airflow, Step Functions).
• Experience with PySpark.
• Experience supporting AI/ML use cases, including feature engineering and dataset preparation.
• Familiarity with LLM-based applications, vector databases, or GenAI pipelines.
• Experience with streaming technologies (Kafka, Kinesis, Spark Streaming).
• Exposure to CI/CD pipelines and infrastructure-as-code concepts.
• Experience with APIs and event-driven architectures.
• Understanding of data governance principles including lineage, cataloging, and access control.

Work location: This role follows an on-site worki