Data Engineer

3M India Limited; Bengaluru; Hybrid; INR 1,500,000 - 2,300,000; Full time

Job summary

3M India Limited is seeking a Data Engineer to own the design and delivery of scalable data pipelines and data products on an AWS-based Enterprise Data Lakehouse. You will collaborate with analysts, product owners and architects across Finance, Supply Chain, R&D, Tax and Commercial to create analytics-ready datasets.

You will implement data quality, validation and monitoring controls, RBAC and data masking, and contribute to data contracts and observability.

Qualifications

• Bachelor's degree or higher in Computer Science, Information Technology, Engineering or a related discipline (completed and verified prior to start).
• 5+ years of experience in data engineering or analytics engineering in a private, public, government or military environment.
• Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation.
• Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services (S3, Glue, Lambda, Athena or equivalent).
• Experience developing and supporting production data pipelines using Git and CI/CD practices, with an understanding of data modeling, data quality, validation and monitoring.
• Experience with data build tool for SQL-based transformation and testing, Snowflake as a SQL consumption layer, and Apache Iceberg or Delta Lake.
• Experience with Databricks Unity Catalog and orchestration tools (Step Functions, Airflow), and knowledge of data contracts, observability, SOX-compliant controls and catalog tools (Collibra, Alation, Glue Data Catalog).
• Relevant Databricks, AWS, Snowflake or data build tool certifications.
• Skills include clear communication, analytical problem-solving, and collaborating with business stakeholders in Agile, data-product-oriented teams.

Responsibilities

• Lead the design and delivery of scalable data pipelines and data products on 3M's AWS-based Enterprise Data Lakehouse.
• Implement data quality, validation, reconciliation and monitoring controls, along with RBAC and data masking.
• Determine data needs by partnering with analysts, product owners and architects across Finance, Supply Chain, R&D, Tax and Commercial.
• Support the platform and consumption layers including AWS services, Apache Iceberg, Databricks, Snowflake objects, CI/CD, Power BI and semantic models.

Skills

SQL

Python

PySpark

Data wrangling

Communication

Education

Bachelor's degree in Computer Science / IT / Engineering

Relevant Databricks / AWS certifications

Tools

Databricks

Snowflake

Apache Iceberg/Delta Lake

Airflow

CI/CD

Power BI

AWS (S3, Glue, Lambda, Athena)

Job description

Data Engineer - Enterprise Data Lakehouse & Data Products

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description: Collaborate with Innovative 3Mers Around the World Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a wide variety of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

The Impact You’ll Make in this Role

• Leads the design and delivery of scalable data pipelines and data products on 3M's AWS-based Enterprise Data Lakehouse. These use Databricks, PySpark, Python and SQL, and follow the Bronze -> Silver -> Gold Medallion architecture.
• Implements data quality, validation, reconciliation and monitoring controls, along with RBAC and data masking. These include SOX-compliant controls for close-critical financial data.
• Determines data needs by partnering with analysts, product owners and architects across Finance, Supply Chain, R&D, Tax and Commercial. Then turns them into reusable, analytics-ready datasets through the POC -> Pilot -> Prod pathway.
• Supports the platform and consumption layers. That covers AWS services (S3, Glue, Step Functions, Lambda, Athena), Apache Iceberg, Databricks, Snowflake objects, CI/CD, and Power BI and semantic models.

Your Skills and Expertise

• Bachelor's degree or higher in Computer Science, Information Technology, Engineering or a related discipline (completed and verified prior to start).
• 5+ years of experience in data engineering or analytics engineering in a private, public, government or military environment.
• Hands-on experience with SQL and relational databases, plus Python and PySpark for data processing and transformation.
• Experience with Databricks and Lakehouse/Medallion architecture, and with AWS data services (S3, Glue, Lambda, Athena or equivalent).
• Experience developing and supporting production data pipelines using Git and CI/CD practices, with an understanding of data modeling, data quality, validation and monitoring.
• Experience with data build tool for SQL-based transformation and testing, Snowflake as a SQL consumption layer, and Apache Iceberg or Delta Lake.
• Experience with Databricks Unity Catalog and orchestration tools (Step Functions, Airflow), and knowledge of data contracts, observability, SOX-compliant controls and catalog tools (Collibra, Alation, Glue Data Catalog).
• Relevant Databricks, AWS, Snowflake or data build tool certifications.
• Skills include clear communication, analytical problem-solving, and collaborating with business stakeholders in Agile, data-product-oriented teams.

Location: Bangalore (Hebbal), Hybrid Mode

Supporting Your Well-being 3M offers many programs to help you live your best life – both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope.

All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.

Learn more about 3M’s creative solutions to the world’s problems at www.3M.com or on Instagram, Facebook, and LinkedIn @3M.Safety is a core value at 3M.

Experience Level Mid Level