Senior Data Engineer- MSI

MSI; United States; On-site; USD 120,000 - 160,000; Full time

Job summary

MSI is seeking a Sr Data Engineer to design and manage data systems, pipelines, and governance tools. You will lead projects, oversee junior engineers, and deploy scalable data models across diverse platforms, integrating large data sources for insightful analytics.

You will collaborate with stakeholders to automate pipelines, maintain data quality, and ensure security. Strong SQL, Python, Spark, and Power BI experience are essential for success.

Qualifications

• 5-7 years of relevant experience required.
• BA/BS in relevant discipline required.
• Experience building large data pipelines across platforms, data sources, data structures.
• Experience with relational databases such as SQL Server, Oracle, etc., and SQL scripting.
• Experience with Power BI.
• Experience with cloud platforms (AWS, Azure, GCP) and ETL tools/techniques.

Responsibilities

• Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation.
• Design, build, document, test, and maintain data pipelines using industry best practices.
• Performs ETL, ELT operations in accordance with enterprise data governance and security standards.
• Develop data quality and governance process to ensure data accuracy and quality through inspection, validation, processing, anomaly detection.

Skills

Data pipelines

ETL/ELT design

SQL scripting

Python

Spark

Data governance

Documentation

Mentoring

Communication

Power BI

Education

BA/BS in relevant discipline

Tools

Power BI

Cloud platforms (AWS/Azure/GCP)

Job description

Why MSI? We thrive on solving challenges. As a leading MGA, MSI combines deep underwriting expertise with insurer risk capacity to create specialized insurance solutions that empower distribution partners to meet customers’ unique needs. We have a passion for crafting solutions for the important risks facing individuals and businesses. We offer an expanding suite of products – from fully-digital embedded renters coverage to high-value homeowners insurance to sophisticated commercial coverages, such as cyber liability and habitational property – delivered through agents, brokers, wholesalers and other brand partners.
Our partners and customers count on us to deliver exceptional service through a dedicated team that makes rapid resolutions a priority. We simplify the insurance experience through our advanced technology platform that supports every phase of the policy lifecycle. Bring on your challenges and let us show you how we build insurance better.
The Sr Data Engineer will design and manage data systems, pipelines, and management tools. They will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems. This role will design, build, document, test, and maintain critical data pipelines from large volumes of data from internal and external data sources cross different platforms.

Primary Responsibilities

• Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation
• Design, build, document, test, and maintain data pipelines using industry best practices
• Performs ETL, ELT operations in accordance with enterprise data governance and security standards
• Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection
  

Knowledge, Skills & Abilities

• Detail oriented and proactive in taking measures to avoid or mitigate issues.
• Excellent understanding of computer systems, integrations, databases, and data storage systems.
• Understanding of agile data engineering concepts and processes
• Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
• Ability to work with clients to translate business needs to technical solutions
• Ability to provide guidance, mentoring, and training for peers
• Exceptional interpersonal skills and ability to effectively communicate with teams across the entire organization.
• Demonstrates the organization’s core values, exuding behavior that is aligned with the firm’s culture
• Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook)
• Ability to learn any other appropriate program or software system used by the firm as necessary.
  

Education & Experience

• 5-7 years of relevant experience required
• BA/BS in relevant discipline required
• Vast experience with multiple development methodologies
• Experience of building large, complicated data pipelines cross different platforms, data sources, data structures
• Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting
• Experience with Power BI
• Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc.
• Programming experience in Python, Spark, and other similar languages
• Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools.
• Travel to a nearby office for onboarding, training, and team collaboration as needed may be required.