Associate Data Engineer

BCBSM, Inc.; United States; Hybrid; USD 61,000 - 98,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Life insurance

401k

Paid Time Off (PTO)

Volunteer Paid Time Off (VPTO)

Job summary

Blue Cross and Blue Shield of Minnesota is hiring an Associate Data Engineer to design, build, and support cloud-based data pipelines and data products. You will work with AWS, Databricks, Spark, and Python to enable secure, governed analytics and reporting across the enterprise.

The role emphasizes collaboration with analysts, product owners, and architects, and requires a foundation in data engineering concepts with a willingness to learn and grow within a hybrid work environment.

Qualifications

• 2+ years of related experience or a bachelor's degree in lieu of experience.
• High school diploma (or equivalent).
• Exposure to data engineering concepts, data integration, and analytics engineering.

Responsibilities

• Design, build, and support scalable cloud-based data pipelines and integration solutions.
• Develop data processing, transformation, and quality capabilities using SQL, Spark, Python, and cloud services.
• Collaborate with stakeholders to translate data requirements into technical tasks and deliverables.
• Contribute to engineering standards, reusable patterns, and continuous improvement.

Skills

SQL fundamentals

Python

Problem solving

Strong communication

Curiosity

Willingness to learn

Time management

Education

Bachelor's degree in related field

High school diploma or equivalent

Tools

Databricks

Apache Spark / Spark SQL

Delta Lake

AWS

Terraform (IaC)

GitLab / GitHub Actions / Jenkins

Job description

About Blue Cross and Blue Shield of Minnesota

At Blue Cross and Blue Shield of Minnesota, we are committed to paving the way for everyone to achieve their healthiest life. We are looking for dedicated and motivated individuals who share our vision of transforming healthcare. As a Blue Cross associate, you are joining a culture that is built on values of succeeding together, finding a better way, and doing the right thing. If you are ready to make a difference, join us.

The Impact You'll Have

The Associate Data Engineer supports the design, development, delivery, and ongoing support of enterprise data products, data integration solutions, and cloud-native data platforms. The role works with structured and unstructured data to help enable analytics, operational reporting, interoperability, and digital business capabilities through reliable data engineering solutions. This position focuses on building and maintaining modern data pipelines, cloud-native integration patterns, event-driven workflows, and data transformation capabilities under the guidance of senior engineers and architects. The Associate Data Engineer collaborates with application engineers, product owners, analysts, and business stakeholders to deliver secure, governed, and scalable data solutions. The ideal candidate brings foundational experience with data engineering concepts, SQL, Python, cloud data platforms, and distributed processing technologies, with a strong willingness to learn and grow in modern enterprise data engineering practices.

What You'll Do

Design, build, and support scalable cloud-based data pipelines and integration solutions that enable secure, reliable, and efficient data movement across enterprise systems.

Develop and maintain data processing, transformation, and quality capabilities using technologies such as AWS, Databricks, SQL, Spark, and Python, while following best practices for security, governance, testing, and DevOps.

Partner with business and technical teams to translate data requirements into solutions, troubleshoot issues, improve platform performance, and contribute to engineering standards, reusable frameworks, and continuous innovation.

How You'll Do It

Core Responsibilities

• Develop, deploy, and support data pipelines, integration solutions, and data products that support enterprise business capabilities.
• Assist with implementation of cloud-native data processing solutions using AWS services, Databricks, and distributed data processing frameworks.
• Develop and support batch, API, file-based, and event-driven integration patterns that enable secure and reliable data exchange.
• Contribute to technical design activities for data engineering solutions, including data models, transformation logic, ingestion patterns, and consumption layers.
• Develop and test data transformation logic using SQL, Spark, Python, and related technologies.
• Build and support data ingestion, enrichment, quality, lineage, and observability capabilities that improve trust, transparency, and operational supportability.
• Support CI/CD pipelines, infrastructure automation, testing strategies, and DevOps practices for data platforms and data products.
• Partner with business stakeholders, application teams, and architects to understand requirements and translate them into technical tasks and deliverables.
• Follow enterprise standards for security, governance, reliability, performance, and maintainability.
• Troubleshoot data processing and integration issues while contributing to improvements in platform performance, resiliency, and operational efficiency.
• Contribute to engineering standards, reusable patterns, documentation, and team best practices.

Additional Responsibilities

• Participate in technology evaluations, proof-of-concept initiatives, and architecture reviews as directed.
• Contribute to reusable integration, transformation, and data platform patterns.
• Share knowledge through documentation and team learning activities.
• Stay current on cloud, data engineering, AI, and interoperability technologies relevant to the role.

Required Skills & Experience

2+ years related experience or bachelor's degree in lieu of experience. High school diploma (or equivalent)

Preferred Skills & Experience

• Related technical, professional, internship, academic, or project experience. All relevant experience including work, education, transferable skills, and military experience will be considered.
• Exposure to data engineering, data integration, software development, analytics engineering, or data platform development.

Essential Candidate Qualities

• Curiosity, willingness to learn, problem-solving mindset, strong communication skills, self-motivation, and time management skills.

Data Engineering & Analytics

• Exposure to Databricks or similar cloud data platforms.
• Exposure to Apache Spark / Spark SQL.
• Familiarity with Delta Lake or similar storage formats.
• Python SQL.
• Foundational understanding of data modeling and schema design.
• Familiarity with data quality, lineage, and observability concepts.
• Exposure to operational and analytical data platforms.
• Interest in data modeling and performance optimization.

Cloud & DevOps

• Exposure to AWS services such as Lambda, Glue, EMR, S3, DynamoDB, SNS/SQS, or EventBridge.
• Familiarity with Infrastructure as Code concepts; Terraform experience is a plus.
• Exposure to CI/CD concepts and tools such as GitLab, GitHub Actions, Jenkins, or similar tools.

AI and Emerging Technologies (Nice to have)

• Exposure to AI-assisted development tools such as Microsoft Copilot, GitHub Copilot, Claude, etc.
• Interest in applying AI capabilities to software development, automation, testing, and operational processes.

Ideal Candidate Profile

• Eager to grow across data engineering, integration engineering, cloud development, and platform enablement.
• Foundational experience with Databricks or cloud-based data platforms.
• Experience contributing to data pipelines, integration solutions, or data transformation processes.
• Exposure to modern cloud data platforms using Databricks, Apache Spark, Delta Lake, or similar technologies.
• Strong SQL fundamentals with experience developing data transformations and analytical queries.
• Familiarity with cloud-native platforms and distributed data processing technologies.
• Able to take ownership of assigned engineering tasks and contribute to technical discussions within a team.
• Collaborative technical partner who is open to coaching, feedback, and continuous learning.
• Strong collaboration, problem-solving, and communication skills.
• Comfortable operating in agile product teams and cross-functional environments.

Role Designation

Hybrid Role designation definition: Teleworking is working full time remote. Hybrid is a minimum of 2 days onsite. Onsite is full-time onsite.

Anchored in Connection

Our hybrid approach is designed to balance flexibility with meaningful in-person connection and collaboration. We come together in the office two days each week – most teams designate at least one anchor day to ensure team interaction. These in-person moments foster relationships, creativity, and alignment. The rest of the week you are empowered to work remote.

Compensation and Benefits

$61,200.00 - $79,500.00 - $97,800.00 Annual Pay is based on several factors which vary based on position, including skills, ability, and knowledge the selected individual is bringing to the specific job.

• Medical, dental, and vision insurance
• Life insurance
• 401k
• Paid Time Off (PTO)
• Volunteer Paid Time Off (VPTO)
• And more

To discover more about what we have to offer, please review our benefits page.

Equal Employment Opportunity Statement

At Blue Cross and Blue Shield of Minnesota, we are committed to paving the way for everyone to achieve their healthiest life. Blue Cross of Minnesota is an Equal Opportunity Employer and maintains an Affimitive Action plan, as required by Minnesota law applicable to state contractors. All qualified applications will receive consideration for employment without regard to, and will not be discriminated against based on any legally protected characteristic. Individuals with a disability who need a reasonable accommodation in order to apply, please contact us at: [e-mail].

Blue Cross® and Blue Shield® of Minnesota and Blue Plus® are nonprofit independent licensees *of the Blue Cross and Blue Shield Association.

Physical requirements.

Chartered in 1933 as Minnesota’s first health plan, this company is one of the most recognized and trusted healthcare brands in the world. It has more members, the largest network of doctors, and more products and services than any other health plan in Minnesota. Headquartered in Eagan, Minnesota.