Sr Data Engineering Specialist, Sumaré

3M; São Paulo; Presencial; BRL 180 000 - 320 000; Tempo integral

Resumo da oferta

3M is seeking a Sr Data Engineering Specialist in Sumaré/SP to design, build, and operate scalable data pipelines and data products on a modern cloud Lakehouse platform.

You will work with Databricks, DataHub, Temporal workflows, and AWS, enabling AI-enabled analytics and GenAI workflows across research and business domains while collaborating with cross-functional teams to deliver production-grade data solutions.

Qualificações

• Bachelor’s degree or higher in Computer Science, Engineering, or related field.
• Senior experience in data engineering, data platforms, or related roles.
• Strong proficiency in SQL and Python.
• Hands-on experience building scalable data pipelines and data processing workflows.
• Experience with Apache Spark.
• Experience with cloud data platforms like Databricks.
• Experience with AWS (S3, Glue, etc.).
• Understanding of data modeling, data transformation, and data warehousing concepts.
• Experience working in cross-functional engineering environments.
• Proficiency in English.

Responsabilidades

• Design, build, and operate scalable data pipelines and data products in a cloud Lakehouse.
• Develop batch and streaming pipelines using Databricks, Delta Lake, and AWS.
• Implement data quality checks, monitoring, lineage, and governance standards.
• Collaborate with Platform Engineers, Governance, Backend, AI, and Reliability teams.
• Promote reusable patterns and CI/CD practices.
• Monitor production pipelines and troubleshoot operational issues.
• Prepare data for feature engineering and AI/GenAI workflows.

Conhecimentos

SQL

Python

Data pipelines

Apache Spark

Databricks

AWS

English

Formação académica

Bachelor’s degree or higher in Computer Science, Engineering, or related field

Ferramentas

Databricks

Temporal

Airflow

Step Functions

DataHub

Unity Catalog

Apache Spark

Descrição da oferta de emprego

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description:

Sr Data Engineering Specialist, Sumaré/SP

Collaborate with Innovative 3Mers Around the World

Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you.With a diversity of people, global locations, technologies and products, 3M is a place where you can collaborate with 93,000othercurious, creative 3Mers.

The Impact You’ll Make in this Role

3M is seeking a Senior Data Engineer to join Corporate Research Digital Platforms (CRDP) to design, build, and operate scalable data pipelines and data products within a modern cloud-based Lakehouse platform.

In this role, you will contribute to the development of data pipelines, data products, and AI-enabled workflows, supporting analytics, informatics, and emerging AI-driven use cases across research and business domains. You will work within a platform that integrates Databricks, DataHub, Temporal workflows, and AWS infrastructure, enabling reliable and scalable data and AI operations.

You will collaborate closely with Data Engineers, Platform Engineers, Backend/Temporal Engineers, and Governance teams to deliver high-quality, production-grade data solutions that are reliable, scalable, and aligned with platform standards.

In this role, you will have the opportunity to:

• Design, build, and maintain scalable data pipelines for structured and unstructured data, supporting analytics, AI, GenAI, and agentic workflows.
• Develop batch and streaming pipelines using modern cloud data platforms, with a strong focus onDatabricks, Delta Lake, and AWS.
• Optimize data pipelines for performance, scalability, reliability, observability, and cost efficiency.
• Support modern Lakehouse architecture by integrating pipelines with platform services such asDataHub, Temporal, metadata, orchestration, and cloud infrastructure.
• Enable AI and GenAI use cases by preparing data for feature engineering, document ingestion, structured data extraction, LLM workflows, vector search, and downstream AI services.
• Build and maintain logical and physical data models aligned with business, analytics, machine learning, and AI requirements.
• Implement data quality checks, validation rules, monitoring, lineage, cataloging, and governance standards.
• Collaborate with Platform Engineering, Governance, Backend, AI, and Reliability teams to deliver well-integrated and production-ready data solutions.
• Apply software engineering best practices, including modular design, testing, version control, CI/CD, infrastructure-as-code, and code reviews.
• Monitor production pipelines, troubleshoot operational issues, support root cause analysis, and contribute to continuous improvements in platform stability.
• Promote reusable patterns, frameworks, and pipeline components to improve engineering efficiency across teams.
• Work in a modern data environment where cloud, Lakehouse, automation, and AI come together to deliver scalable data products.

Your Skills and Expertise

To set you up for success in this role from day one, 3M requires the following qualifications:

• Bachelor’s degree or higher in Computer Science, Engineering, or related field.
• Senior experience in data engineering, data platforms, or related roles.
• Strong proficiency in SQL and Python.
• Hands-on experience building scalable data pipelines and data processing workflows.
• Experience working with distributed processing systems such as Apache Spark.
• Experience with modern cloud data platforms - Databricks or similar.
• Experience working with cloud platforms such as AWS (S3, Glue, etc.).
• Understanding of data modeling, data transformation, and data warehousing concepts.
• Experience working in cross-functional engineering environments.
• Proficiency in English.

Additional qualifications that could help you succeed even further in this role include:

• Experience with Delta Lake, Unity Catalog, and Lakehouse architectures.
• Familiarity with metadata and catalog systems such as DataHub.
• Experience with workflow orchestration tools (Temporal, Airflow, Step Functions).
• Experience with PySpark.
• Experience supporting AI/ML use cases, including feature engineering and dataset preparation.
• Familiarity with LLM-based applications, vector databases, or GenAI pipelines.
• Experience with streaming technologies (Kafka, Kinesis, Spark Streaming).
• Exposure to CI/CD pipelines and infrastructure-as-code concepts.
• Experience with APIs and event-driven architectures.
• Understanding of data governance principles including lineage, cataloging, and access control.

Work location:

This role follows an on-site working model, requiring the employee to work at least four days a week in Sumaré/SP.

Supporting Your Well-being

3M offers many programs to help you live your best life – both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope.

Chat with Max

For assistance with searching through our current job openings or for more information about all things 3M, visit Max, our virtual recruiting assistant on 3M.com/careers.

Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Instagram, Facebook, and LinkedIn @3M.

A 3M é um empregador que oferece oportunidades iguais à todos. A 3M não discriminará nenhum candidato baseado em sua raça, cor, idade, religião, gênero, orientação sexual, identidade ou expressão de gênero, nacionalidade ou deficiência.

Safety is a core value at 3M. All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.