Python Developer

On-Demand Group; Minneapolis (MN); Remote; Full time

Job summary

On-Demand Group is looking for a Senior Python Engineer specializing in data ingestion and Databricks. You will develop scalable systems and libraries, mentor junior engineers, and collaborate closely with technical leads. This full-time position offers flexible work environments with excellent benefits, focusing on clean, reusable code and a collaborative culture.

Benefits

Healthcare Insurance

Dental Insurance

Vision Insurance

401(k)

Qualifications

• Experience with Databricks and Delta Lake in an Azure environment.
• Familiarity with CI/CD practices, automated testing, and linting.
• Experience with managing Databricks infrastructure-as-code.

Responsibilities

• Design, develop, and maintain reusable Python libraries.
• Implement and maintain CI/CD pipelines with testing frameworks.
• Mentor junior engineers and enforce coding standards.

Skills

Python

Metadata-driven architecture

CI/CD practices

Databricks

Delta Lake

Data pipeline orchestration

Containers (Docker, Kubernetes)

Job description

This range is provided by On-Demand Group. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$70.00/hr - $95.00/hr

Job Title: Senior Python Engineer - Data Ingestion & Databricks

Location: Remote / Hybrid

• About the Role

o We are seeking a strong Python engineer with a passion for clean, scalable code and a mindset rooted in metadata-driven architecture. This role is ideal for someone who thrives in a collaborative environment, enjoys setting engineering standards, and has hands-on experience with Databricks and Delta Lake, preferably in an Azure ecosystem.

o You’ll work closely with technical leads to shape the development culture, contribute to architectural decisions, and help build robust, reusable Python libraries that power our data platform.

o Design, develop, and maintain Python libraries with a focus on packaging, distribution, and reusability.

o Champion metadata-driven development practices to build flexible and scalable systems.

o Collaborate with team leads to define and enforce coding standards, including code reviews and documentation.

o Implement and maintain CI/CD pipelines with tools like linters, type checkers (e.g., mypy), and automated testing frameworks (e.g., pytest).

o Develop and optimize data workflows on Databricks, leveraging Delta Lake and best practices for performance and scalability.

o Communicate technical decisions clearly and confidently to both technical and non-technical stakeholders.

o Mentor junior engineers and contribute to a culture of continuous improvement.

o Proven experience in packaging and distributing Python libraries (e.g., setuptools, poetry, pip, uv).

o Strong understanding of metadata-driven architecture and its application in software or data systems.

o Familiarity with CI/CD practices in Python projects, including automated testing, linting, and type checking.

o Experience with Github and Github Actions for CI/CD.

o Hands-on experience with Databricks and Delta Lake, ideally within an Azure environment.

o Excellent communication skills with the ability to explain and justify technical decisions.

o A collaborative, opinionated mindset with a drive to lead by example.

o Understanding of Scrum and Agile methodologies.

o Experience with data ingestion frameworks or data pipeline orchestration tools (e.g. Airflow).

o Familiarity with containers (Docker, Kubernetes, Helm)

o CI/CD build and deploy architecture (Tekton/Argo)

o Familiarity with infrastructure-as-code (e.g. Terraform).

o Experience with managing Databricks infrastructure-as-code (clusters, policies, etc.)

o Contributions to open-source Python projects or internal tooling libraries.

o Work with a forward-thinking team that values technical excellence and collaborative leadership.

o Help shape the future of our data platform and engineering culture.

o Flexible work environment with opportunities for growth and innovation.

The projected hourly range for this position is $70 to $95.

On-Demand Group (ODG) provides employee benefits which includes healthcare, dental, and vision insurance. ODG is an equal opportunity employer that does not discriminate on the basis of race, color, religion, gender, sexual orientation, age, national origin, disability, or any other characteristic protected by law.

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Job function

  Information Technology

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at On-Demand Group by 2x

Inferred from the description for this job

Medical insurance

Vision insurance

401(k)

Get notified about new Python Developer jobs in Minneapolis, MN.

Greater Minneapolis-St. Paul Area 2 months ago

Software Engineer (Python/Linux/Packaging)

Python and Kubernetes Software Engineer - Data, Workflows, AI/ML & Analytics

Python and Kubernetes Software Engineer - Data, AI/ML & Analytics

Senior Software Developer (Full Stack & AI Focus)

Python Software Engineer - Ubuntu Hardware Certification Team

Software Engineer - Solutions Engineering

IT Software Engineer - HighTouchRx - Full Stack Java Developer/Angular Framework Remote

Minneapolis, MN $74,000.00-$118,000.00 1 week ago

Lead Front-End Engineer/Full Stack Engineer

Greater Minneapolis-St. Paul Area 4 weeks ago

Senior Software Engineer, Backend (ML Platform)

Greater Minneapolis-St. Paul Area 2 months ago

Staff Software Engineer - SRE, Backend (Reliability Engineering)

Senior Staff Software Engineer, Backend (Search & Discovery)

Senior Staff Software Engineer, Backend (Load Testing)

Minneapolis, MN $170,000.00-$220,000.00 14 hours ago

Lead Site Reliability Engineer - 2281972

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.