Senior Data Engineer - Databricks, Spark & Python

Flagler Health; Vancouver (WA); On-site; USD 80,000 - 120,000; Full time

Job summary

A healthcare company located in Vancouver, Washington, is seeking a data engineer with strong expertise in Databricks and MongoDB. The role involves developing and optimizing data pipelines, debugging Spark applications, and writing efficient Python code. Proven experience in large-scale data processing and strong problem-solving skills are essential. Candidates should also be familiar with best practices in data architecture. This position offers opportunities for personal and professional growth within a dynamic team environment.

Qualifications

• Proven experience working with Databricks and Spark compute.
• Proficient in Python, including object-oriented programming and API development.
• Familiarity with NoSQL (MongoDB preferred), including querying, data modeling, and optimization.
• Strong problem-solving skills and ability to debug and optimize data processing tasks.
• Experience with large-scale data processing and distributed systems.

Responsibilities

• Develop, manage, and optimize data pipelines on the Databricks platform.
• Debug and troubleshoot Spark applications to ensure reliability and performance.
• Implement best practices for Spark compute and optimize workloads.
• Design and build APIs to support data integration and application needs.
• Develop scripts and tools to automate data processing and workflows.

Skills

Databricks Platform Expertise

Python Development

MongoDB Management

Problem-solving skills

Experience with distributed systems

Tools

Databricks

MongoDB

AWS

Azure

Git

Job description

A healthcare company located in Vancouver, Washington, is seeking a data engineer with strong expertise in Databricks and MongoDB. The role involves developing and optimizing data pipelines, debugging Spark applications, and writing efficient Python code. Proven experience in large-scale data processing and strong problem-solving skills are essential. Candidates should also be familiar with best practices in data architecture. This position offers opportunities for personal and professional growth within a dynamic team environment.