Senior Data Engineer (Remote - Option for Hybrid in MN)

ZipRecruiter; Minneapolis (MN); Hybrid; USD 94,000 - 118,000; Full time

Job summary

Join a forward-thinking organization dedicated to making a difference in education. As a Senior Data Engineer, you'll play a vital role in transforming data into actionable insights, empowering stakeholders to make informed decisions. This position offers the flexibility of remote work or a hybrid model, fostering a dynamic work environment where innovation thrives. Collaborate with a passionate team, leverage cutting-edge technologies, and contribute to meaningful projects that enhance educational opportunities for students in need. If you're driven by impact and eager to grow, this is the perfect opportunity for you.

Benefits

Flexible Schedule

Professional Growth Opportunities

Remote Work Options

Inclusive Work Environment

Qualifications

• 5+ years of experience in data engineering with strong SQL and Python skills.
• Experience with data ingestion, transformation, and cleansing pipelines.

Responsibilities

• Develop and maintain data architecture and pipelines for analytics.
• Coordinate data quality standards and governance across teams.

Skills

SQL

Python

Data Engineering

Data Quality Analysis

Collaboration Skills

Agile Methodology

Education

Bachelor's Degree in a relevant field

Tools

Azure Data Factory

Databricks

Apache Spark

AWS

Microsoft Azure

Power BI

Tableau

MongoDB

Job description

Job Description

Are you passionate about making a difference? Would you like to spend your working hours changing lives and leaving the world better than it was? Do you want to help eliminate barriers to higher education for students in need? Consider joining the amazing team at Scholarship America, where we’re hard at work creating brighter futures for students—and building the plans that will help us grow to do even more.

Senior Data Engineer

• Full time
• Remote or Option for Hybrid in Bloomington or St Peter, MN
• Internal/External Position Opening

The Senior Data Engineer develops and maintains the technical data architecture, pipelines, and infrastructure to enable business stakeholders to access and analyze the data they need. This role collects, transforms, and prepares data from a variety of sources then models that data into a data analytics and insights platform and helps drive organizational data standards and governance.

ESSENTIAL JOB FUNCTIONS:

• Assemble large, complex data sets that meet functional / non-functional business requirements.
• Accountable for the design, development, and administration of data analytics and insight tools, processes, and governance.
• Creates, maintains and documents the data ingestion, transformation, and cleansing pipelines that can process data on demand, on a schedule, or in real time.
• Collaborates with the business functions and analytics teams to design data models in the gold layer, incorporate new and modified data sources into the analytics platform, and define processes for managing these changes.
• Creates data artifacts as needed to meet the functional and non-functional requirements of stakeholders.
• Coordinates and enforces data standards among various business stakeholders, data stewards, implementation specialists, and software engineers.
• Provides leadership in delivering data analytics and insights services to the organization.
• Assists with maintaining an enterprise data catalog allowing users to browse and access data based on their permissions.
• Manages the enforcement of data quality standards, data security, privacy, and data governance policies.
• Manages, administers, and maintains the Master Data Management systems.
• Assists in creating and maintaining technical documentation, including design specifications, data models, and user guides to facilitate knowledge sharing and maintainability of developed solutions.
• Stays updated on the latest trends and advancements in business intelligence, data technologies, and actively seeks opportunities to expand skills and knowledge in the field.
• Leverages new technologies to drive innovation.
• Recommends internal improvements including redesigning infrastructure for greater scalability, cost optimization, and automating manual processes.
• Assists in the administration of on-premises and cloud-based database systems.
• Participates in SQL code reviews to enforce coding standards.
• Guides software engineers on performance tuning, query optimization, and indexing.
• Works with data from various database and data source types across on-premises infrastructure and cloud environments such as AWS, Microsoft Azure, and Atlassian.
• Monitors pipeline operations and remediates failures.
• After-hours support required occasionally.
• Travel may be required occasionally.

REQUIRED SKILLS AND EXPERIENCE:

• Experience with analytics services such as Azure Data Factory, Databricks Notebooks, Apache Spark, Synapse Analytics, or Redshift Spectrum.
• Experience creating data ingestion, transformation, and cleansing pipelines using Data Bricks.
• Strong understanding of the Star and Snowflake schema models.
• Able to collaborate effectively with technical and non-technical staff.
• Bachelor's degree and 5+ years of technical/analytical experience or equivalent in a data engineering role.
• Strong SQL, T-SQL, Python, PySpark, Scala, Java, or other relevant coding skills.
• Experience with data quality analysis and validation.
• Experience with relational, document/NoSQL databases such as Microsoft SQL Server, PostGres SQL, MySQL, MongoDB, Azure Cosmos DB, and AWS RDS.
• Experience optimizing complex queries and large datasets.
• Experience with lake house and medallion architectures.
• Implementing compliance measures for GDPR and CCPA.
• Effective communication and collaboration skills.
• Experience working in an Agile environment.
• Commitment to continuous learning.

Skills and Certifications:

• Certified Data Engineer from Databricks, Microsoft, or equivalent.
• Experience with Power BI, AWS QuickSight, Tableau, Microsoft Purview, and Profisee.
• Experience with Machine Learning and AI deployment.

Pay range – Exempt ($94,400 - $118,000 - $141,600)

Application deadline: May 11th, 2025 (by 11:00 pm CT) or until filled

At Scholarship America, our team members are motivated by our core values: Student Impact, Teamwork, and Curiosity. Our vision is to empower an America where those with the most need have the opportunity to thrive through equitable pathways to education and training, and we are seeking talented team members to make that happen.

Remote work within the continental US or hybrid from our offices in Bloomington or Saint Peter, MN, is supported. Our flexible schedule and commitment to professional growth foster a balanced, inclusive, and dynamic work environment.