Associate Data Engineer

3M India Limited; Bengaluru; Hybrid; INR 1,200,000 - 2,400,000; Full time

Job summary

3M India Limited is seeking an Associate Developer - Data Engineering in Bengaluru. You will design, build, and maintain scalable data pipelines using AWS services, PySpark, and Databricks, supporting data models and metadata management across the data platform.

Responsibilities include collaborating with global teams, creating design documents, data dictionaries, and ensuring data lineage. A Bachelor's degree and 2–4 years in data warehousing are required, with a hybrid work arrangement in

Qualifications

• Bachelor’s degree or higher, completed and verified before start.
• 2 to 4 years of solid experience in data warehousing, including data pipelines and data modeling, on AWS and Databricks platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines in AWS Lake using AWS services and PySpark.
• Analyze, design, and deploy data models in AWS S3 with Spark SQL from multiple sources.
• Build and manage data ingestion frameworks in Databricks using PySpark and SQL.

Skills

Python programming

SQL scripting

Analytical thinking

English fluency

Education

Bachelor’s degree or higher

Tools

PySpark

Databricks

AWS services

Job description

Associate Developer - Data Engineering

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter.

Job Description

Collaborate with Innovative 3Mers Around the World. Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a wide variety of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

The Impact You’ll Make in this Role

As an Associate Developer, Data Engineering, you will be part of the Data & Analytics Platform Engineering Team, designing, developing, testing, and supporting various platform foundational frameworks in Amazon Web Services (AWS) and Databricks.

Here, you will make an impact by:

• Designing, developing, and maintaining scalable data pipelines with delta mechanism in the AWS Lake using AWS services and PySpark.
• Analysing, designing, developing, testing, deploying, and supporting data models in AWS S3 using Spark SQL based on extracts from various sources and functional design specifications.
• Building and administering data ingestion frameworks in Databricks using PySpark and SQL and managing Platform Engineering tasks.
• Reviewing business requirements and creating functional and technical design documents, data lineage, data dictionaries, and metadata management, including SQL scripting.
• Staying current with industry trends and best practices in data engineering, Databricks, AWS services, AWS Lakehouse, PySpark, and Athena while participating actively in local and global teams.

Your Skills and Expertise

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications:

• Bachelor’s degree or higher (completed and verified prior to start).
• Two (2) to four (4) years of solid experience in data warehousing, including data pipelines and data modeling, particularly on AWS and Databricks platforms, in a private, public, government or military environment.

Additional Qualifications That Could Help You Succeed Even Further in This Role

• Two (2) to three (3) years of strong experience in Python and PySpark with SQL scripting, plus hands-on experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue, and Athena.
• Two (2) to three (3) years of solid experience with Databricks, including automated user provisioning, RBACs, ABACs, AI/ML, and workspace management, along with good experience in relational databases and concepts.
• Extensive working knowledge of one or more business processes such as sales, finance, supply chain, manufacturing, or Master Data.
• Detail-oriented, self-directed problem solver with strong analytical and multitasking skills, a strong interest in technology, and English fluency.

Work Location

Hebbal, Bangalore (Karnataka), Hybrid Mode.

Supporting Your Well-Being

3M offers many programs to help you live your best life - both physically and financially. To ensure competitive pay and benefits, 3M regularly benchmarks with other companies that are comparable in size and scope.

Experience Level: Mid Level