Senior Data Engineer: Databricks Pipelines & AI Tools

Talentify; Elkhart (IN); On-site; USD 111,000 - 167,000; Full time

Benefits offered by this job

Weekly pay

PTO 16 days first year

401(k) with match

Health, dental, and vision insurance

HSA with company contributions

Life insurance and disability

Tuition reimbursement

Pet insurance

EAP

Job summary

Schupan is seeking a Senior Data Engineer in Kalamazoo, MI to design and maintain data pipelines, integrate systems, and leverage AI tools to accelerate data-driven decisions. You will collaborate with trading, recycling, and operations teams and help set data standards for the organization.

Responsibilities include building data models in Databricks, connecting SQL Server with APIs, and using Claude/Replit to create internal tools while ensuring data quality and security compliance.

Qualifications

• Bachelor’s degree in computer science, information systems, data engineering, applied mathematics, or a similar field (preferred)
• Minimum of 5 years of experience as a Data Engineer, API Developer, or similar role
• Hands-on experience building and operating data pipelines in Databricks (Spark, SQL, Delta Lake)
• Strong SQL skills, including T-SQL and Microsoft SQL Server
• Intermediate or expert proficiency in Python
• Experience designing and consuming APIs (REST; GraphQL a plus) and working with integration platforms
• Demonstrated, hands-on use of Claude and Replit, or comparable AI coding and app-building tools, in your own work.
• Experience integrating cloud services with on-premises systems; Azure Data Factory and SSIS experience a plus
• A track record of teaching yourself new tools and putting them to work quickly

Responsibilities

• Data Platform: Design, build, and maintain pipelines and data models in Databricks, our primary data platform. Monitor their performance, reliability, and cost.
• Systems Integration: Connect our operational systems, including SQL Server–based systems of record, to Databricks and to each other through APIs and integration tools. Monitor, troubleshoot, and improve existing integrations.
• Build with AI: Use Claude and Replit to build and ship tools, automations, and internal apps quickly, and help colleagues across the business do the same.
• Solve Business Problems: Work directly with our trading, recycling, and operations teams. Go see the work, define the real question, and deliver data solutions people use to make decisions.
• Data Quality: Implement validation and monitoring so data stays accurate, consistent, and trusted across relational, column-oriented, and unstructured sources.
• Security Compliance: Follow security practices and comply with regulatory standards and company policies, including access and permissions standards.
• Communication: Translate business needs into technical requirements, and explain technical choices clearly to senior leadership and non-technical colleagues.
• Interact in person with coworkers
• Perform other duties as assigned

Skills

Databricks

SQL

Python

APIs

AI tools

Education

Bachelor’s degree in Computer Science / Data Engineering

Tools

Databricks

Azure Data Factory

SSIS

Job description

Schupan is seeking a Senior Data Engineer in Kalamazoo, MI to design and maintain data pipelines, integrate systems, and leverage AI tools to accelerate data-driven decisions. You will collaborate with trading, recycling, and operations teams and help set data standards for the organization.

Responsibilities include building data models in Databricks, connecting SQL Server with APIs, and using Claude/Replit to create internal tools while ensuring data quality and security compliance.