Senior Data Engineer: AI-Driven Pipelines on Databricks

Schupan; Wixom (MI); On-site; USD 111,000 - 167,000; Full time

Benefits offered by this job

PTO 16 days

401(k) match

Health insurance

Vision/Dental

Life insurance

Job summary

Schupan in Kalamazoo, MI is hiring a Senior Data Engineer to design, build, and maintain data pipelines and models in Databricks. You’ll connect operational systems (SQL Server) to Databricks, monitor performance, cost, and reliability, and enable AI tooling with Claude and Replit across the business.

You’ll work with a small team of about 600 employees, set data standards, influence integration strategies, and deliver practical data solutions for trading, recycling, and operations teams.

Qualifications

• Bachelor’s degree in computer science, information systems, data engineering, applied mathematics, or similar field (preferred).
• Minimum of 5 years of experience as a Data Engineer, API Developer, or similar role.
• Hands-on experience building and operating data pipelines in Databricks (Spark, SQL, Delta Lake).
• Strong SQL skills, including T-SQL and Microsoft SQL Server.
• Intermediate or expert proficiency in Python.
• Experience designing and consuming APIs (REST; GraphQL a plus) and working with integration platforms.
• Demonstrated hands-on use of Claude and Replit, or comparable AI coding and app-building tools, in your own work. Be ready to show us something you built.
• Experience integrating cloud services with on-premises systems; Azure Data Factory and SSIS experience a plus.
• A track record of teaching yourself new tools and putting them to work quickly.

Responsibilities

• Data Platform: Design, build, and maintain pipelines and data models in Databricks. Monitor performance, reliability, and cost.
• Systems Integration: Connect operationals systems (SQL Server–based systems) to Databricks and to each other through APIs and integration tools.
• Build with AI: Use Claude and Replit to build tools, automations, and internal apps quickly, and help colleagues do the same.
• Solve Business Problems: Work with trading, recycling, and operations teams to deliver data solutions used to make decisions.
• Data Quality: Implement validation and monitoring so data stays accurate and trusted across sources.
• Security Compliance: Follow security practices and comply with regulatory standards and company policies.
• Communication: Translate business needs into technical requirements and explain technical choices to leadership.
• Interact in person with coworkers.
• Perform other duties as assigned.

Skills

Databricks

SQL (T-SQL)

Python

APIs

Claude AI

Replit

Azure Data Factory

SSIS

Education

Bachelor’s degree in CS or related field

Tools

Azure Data Factory

SSIS

SQL Server

Job description

Schupan in Kalamazoo, MI is hiring a Senior Data Engineer to design, build, and maintain data pipelines and models in Databricks. You’ll connect operational systems (SQL Server) to Databricks, monitor performance, cost, and reliability, and enable AI tooling with Claude and Replit across the business.

You’ll work with a small team of about 600 employees, set data standards, influence integration strategies, and deliver practical data solutions for trading, recycling, and operations teams.