Associate Developer – Data Engineering

3M; Bengaluru; Hybrid; INR 900,000 - 1,500,000; Full time

Job summary

3M is seeking an Associate Developer, Data Engineering, to join the Data & Analytics Platform Engineering Team in Bengaluru. You will design, develop, test, and support data pipelines and models across AWS Lakehouse using PySpark and Spark SQL.

Hybrid work location in Hebbal, Bangalore, with collaboration across global teams. A Bachelor's degree and 2–4 years in data warehousing on AWS/Databricks are required; strong Python and SQL skills are essential.

Qualifications

• Bachelor's degree or higher required. Two to four years of data warehousing experience on AWS and Databricks.

Responsibilities

• Design, develop, test, and support scalable data pipelines with delta mechanism in AWS Lake using AWS services and PySpark.
• Develop data models in AWS S3 using Spark SQL based on diverse sources and specs.
• Build data ingestion frameworks in Databricks using PySpark and SQL; manage Platform Engineering tasks.
• Create design docs, data lineage, metadata, and SQL scripts; review business requirements.

Skills

Python

PySpark

SQL

AWS

Databricks

Data warehousing

Education

Bachelor's degree

Tools

Databricks

Spark SQL

AWS

Job description

3M has a long-standing reputation as a company committed to innovation. We provide the freedom to explore and encourage curiosity and creativity. We gain new insight from diverse thinking, and take risks on new ideas. Here, you can apply your talent in bold ways that matter. Job Description: Collaborate with Innovative 3Mers Around the World Choosing where to start and grow your career has a major impact on your professional and personal life, so it’s equally important you know that the company that you choose to work at, and its leaders, will support and guide you. With a wide variety of people, global locations, technologies and products, 3M is a place where you can collaborate with other curious, creative 3Mers.

The Impact You’ll Make in this Role

As an Associate Developer, Data Engineering, you will be part of the Data & Analytics Platform Engineering Team, designing, developing, testing, and supporting various platform foundational frameworks in Amazon Web Services (AWS) and Databricks. Here, you will make an impact by:

• Designing, developing, and maintaining scalable data pipelines with delta mechanism in the AWS Lake using AWS services and PySpark.
• Analysing, designing, developing, testing, deploying, and supporting data models in AWS S3 using Spark SQL based on extracts from various sources and functional design specifications.
• Building and administering data ingestion frameworks in Databricks using PySpark and SQL and managing Platform Engineering tasks.
• Reviewing business requirements and creating functional and technical design documents, data lineage, data dictionaries, and metadata management, including SQL scripting.
• Staying current with industry trends and best practices in data engineering, Databricks, AWS services, AWS Lakehouse, PySpark, and Athena while participating actively in local and global teams.

Your Skills and Expertise

To set you up for success in this role from day one, 3M requires (at a minimum) the following qualifications: Bachelor’s degree or higher (completed and verified prior to start). Two (2) to four (4) years of solid experience in data warehousing, including data pipelines and data modeling, particularly on AWS and Databricks platforms, in a private, public, government or military environment.

Additional qualifications that could help you succeed even further in this role include:

• Two (2) to three (3) years of strong experience in Python and PySpark with SQL scripting, plus hands‑on experience with AWS services such as S3, Amazon EKS, Amazon EMR, CloudFormation, AWS Secrets Manager, Glue, and Athena.
• Two (2) to three (3) years of solid experience with Databricks, including automated user provisioning, RBACs, ABACs, AI/ML, and workspace management, along with good experience in relational databases and concepts.
• Extensive working knowledge of one or more business processes such as sales, finance, supply chain, manufacturing, or Master Data.
• Detail‑oriented, self‑directed problem solver with strong analytical and multitasking skills, a strong interest in technology, and English fluency.

Work Location: Hebbal, Bangalore (Karnataka), Hybrid Mode

Supporting Your Well‑being

3M offers many programs to help you live your best life – both physically and financially.

Safety

Safety is a core value at 3M. All employees are expected to contribute to a strong Environmental Health and Safety (EHS) culture by following safety policies, identifying hazards, and engaging in continuous improvement.