Data Platform Engineer: AI-Driven Pipelines (Databricks)

Paycom; Kalamazoo, Wixom, Grand Rapids, Elkhart (MI, MI, MI, IN); On-site; USD 111,000 - 167,000; Full time

Benefits offered by this job

PTO: 16 days first year

401(k) with match

Medical, dental, vision

HSA with company contributions

Company-paid life insurance

Pet insurance

Employee Assistance Program (EAP)

Job summary

Schupan is seeking a Senior Data Engineer to design and maintain data pipelines and models that support trading, recycling, and operations. You’ll work in a small team of about 600, with direct impact and visible results, using Databricks and emerging AI tools to accelerate decision making.

You’ll collaborate with cross-functional teams, implement data quality and security standards, and help shape our data platform and integration standards as we grow.

Qualifications

• Bachelor's degree in CS, IS, data engineering, or related field.
• 5+ years as a Data Engineer or API developer.
• Hands-on experience building data pipelines in Databricks (Spark, SQL, Delta Lake).
• Strong SQL and Python proficiency.
• Experience designing and consuming APIs (REST; GraphQL a plus) and integrating cloud services with on-premises systems.

Responsibilities

• Design, build, and maintain pipelines and data models in Databricks.
• Connect operational systems to Databricks via APIs and integration tools.
• Build and ship AI-enabled tools using Claude and Replit.
• Collaborate with trading, recycling, and operations teams to deliver data solutions.
• Ensure data quality, validation, and monitoring across sources.
• Follow security practices and regulatory standards.
• Translate business needs into technical requirements for leadership.
• Interact in person with coworkers.

Skills

Databricks pipelines

SQL (T-SQL, SQL Server)

Python

APIs design & consumption

Claude AI tools

Azure Data Factory / SSIS

Education

Bachelor's degree in computer science / information systems / data engineering

Tools

Databricks

SQL Server

Azure Data Factory

REST/GraphQL APIs

Job description

Schupan is seeking a Senior Data Engineer to design and maintain data pipelines and models that support trading, recycling, and operations. You’ll work in a small team of about 600, with direct impact and visible results, using Databricks and emerging AI tools to accelerate decision making.

You’ll collaborate with cross-functional teams, implement data quality and security standards, and help shape our data platform and integration standards as we grow.