Sr Data Integration Engineer

compeerfinancial; Mankato (MN); Hybrid; USD 95,000 - 135,000; Full time

Benefits offered by this job

Hybrid work model 50% remote

401k with company match

Professional development

Job summary

Compeer Financial seeks a Data Engineer to design, build, and optimize complex data movement across systems using ETL methodologies. You will lead database development and collaborate with business users, consultants, vendors and internal teams to maximize the value of company data assets. Experience with data integration and Microsoft Fabric is preferred.

The role emphasizes a hybrid work environment with up to 50% remote, strong benefits, and growth opportunities within the cooperative.

Qualifications

• Bachelor's degree in computer science, engineering, MIS or related field or an equivalent combination of education and experience

Responsibilities

• Designs, builds, deploys, and maintains data integration solutions using Microsoft Fabric.
• Develops, maintains, and administers data platform databases, Lakehouses, Warehouses, and related data integration components.
• Functions as a primary contributor in designing, coding, testing, and debugging ETL/ELT pipelines.
• Supports strategy for Fabric, data warehouse, Lakehouse, and database development.
• Monitors and troubleshoots pipeline failures and data integrity issues.
• Creates automated, repeatable data ingestion and transformation processes.

Skills

ETL design

Data integration

SQL

PySpark

Education

Bachelor's degree in computer science or related field

Tools

Microsoft Fabric

SSIS

Data Factory

SQL

PySpark

Job description

Empowered to live. Inspired to work.Compeer Financial is a member-owned cooperative located in Illinois, Minnesota and Wisconsin. We bring together team members with a variety of backgrounds and experiences to help provide financial services to support agriculture and rural communities. Join us in a culture that not only promotes meaningful work and professional development, but provides a flexible, hybrid work environment and excellent benefits, which empower you to thrive both personally and professionally.

How we support you:

• Hybrid model - up to 50% work from home
• Flexible schedules including ample flexibility in the summer months
• Up to 9% towards 401k (3% fixed Compeer contribution plus up to 6% match)
• Benefits: medical, dental, vision, HSA/FSA, life & AD&D insurance, short-term and long-term disability, wellness program & EAP
• Vacation, sick leave, holidays/floating holidays, parental leave, and volunteer paid time off
• Learning and development programs
• Mentorship programs
• Cross-functional committee opportunities (i.e. Inclusion Council, emerging professional groups, etc.)
• Professional membership/certification reimbursement and more!
• Casual/seasonal & intern team members are not eligible for benefits except for state-mandated programs.

This position offers a hybrid work option up to 50% remote and is open to any Compeer office location in Illinois, Minnesota and Wisconsin.

The contributions you will make:

This position is responsible for the development, enhancement and effective operations of complex data movement between various systems using ETL methodologies. Responsible for leading company database development efforts and coordinating with business users, consultants/contractors, vendors and internal team members to maximize the usage and value of company data assets. In many cases ETL processes are used to extract data from source systems, transform and enrich the data, and load it into the Data Warehouse.

A typical day:

• Designs, builds, deploys, and maintains data integration solutions using Microsoft Fabric, including Data Factory pipelines, Dataflows Gen2, notebooks, Lakehouses, Warehouses, and SQL Server Integration Services (SSIS) where applicable.
• Develops, maintains, and administers data platform databases, Lakehouses, Warehouses, and related data integration components.
• Functions as a primary contributor in designing, coding, testing, and debugging ETL/ELT pipelines and processes to create reliable, seamless data flows across source systems and the enterprise data platform.
• Supports the overall strategy for Microsoft Fabric, data warehouse, Lakehouse, and database development, including adoption of scalable and reusable data integration patterns.
• Monitors, troubleshoots, and analyzes pipeline failures, data anomalies, inconsistencies, and other data integration issues identified through monitoring, technical team members, and end users.
• Creates automated, repeatable, and stable processes for data ingestion, transformation, validation, synchronization, and publishing across the data platform.
• Develops database and data integration requirements for data migrations, business-unit initiatives, and SQL Server/Fabric projects using SQL, PySpark, notebooks, pipelines, and other appropriate technologies.
• Identifies and resolves data integrity, quality, and reconciliation issues between source systems, Lakehouses, data warehouses, and downstream reporting or application consumers.
• Applies data engineering best practices for security, performance, documentation, source control, testing, and deployment across Microsoft Fabric environments.

Consumption Views

• Supports reporting, analytics, and application users by designing and creating secure, performant consumption views and curated data products in Microsoft Fabric Lakehouses and Warehouses.
• Creates logical relationships across source systems, Lakehouses, Warehouses, and enterprise data models to provide consistent, trusted data for reporting and analytics.
• Develops and maintains SQL views, semantic-model-ready datasets, and reusable data structures using SQL and Microsoft Fabric tools.
• Partners with reporting, analytics, and business teams to define common calculations, data definitions, and access requirements.

Database Administration

• Supports overall strategy related to database and data warehouse development.
• Actively participates with the Business Technology department in preparing and implementing backup and disaster recovery procedures and processes for mission critical databases.
• Contributes to data dictionaries and database diagrams for complex in-house databases.
• Provides on-call support for problem resolution of database related issues.

The skills and experience we prefer you have:

Bachelor's degree in computer science, engineering, MIS or related field or an equivalent combination of education and experience s