Senior Data Engineer, AI/ML Platforms

The Baldwin Group; Northern (KY); Hybrid; USD 110,000 - 160,000; Full time

Job summary

The Baldwin Group seeks a Senior Data Engineer to design and manage data systems, pipelines, and management tools. You will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems.

You will build, document, test, and maintain critical pipelines from large internal and external data sources across multiple platforms, ensuring governance and security standards are met.

Qualifications

• 5-7 years of relevant experience required.
• Experience building large, complex pipelines across multiple platforms.
• Experience with relational databases (SQL Server, Oracle) and SQL scripting.
• Hands-on with cloud ETL tools and data warehousing techniques.

Responsibilities

• Collaborate with data architect, analysts, and stakeholders to identify and document needs for data pipelines and process automation.
• Design, build, document, test, and maintain data pipelines using industry best practices.
• Perform ETL/ELT operations in line with data governance and security standards.
• Develop data quality and governance processes to ensure data accuracy and integrity.

Skills

Data pipelines

ETL/ELT

Python

Spark

SQL

Cloud platforms

Databases

Data governance

Documentation

Mentoring

Communication

Education

BA/BS in relevant discipline

Tools

SQL scripting

Microsoft Office Suite

Job description

The Sr Data Engineer will design and manage data systems, pipelines, and management tools. They will oversee junior data engineers, recommend and deploy data models, and lead projects involving data collection and storage systems. This role will design, build, document, test, and maintain critical data pipelines from large volumes of data from internal and external data sources cross different platforms.

PRIMARY RESPONSIBILITIES

• Collaborate with data architect, analysts, and stakeholders to identify and document needs/requirements for data pipelines and process automation
• Design, build, document, test, and maintain data pipelines using industry best practices
• Performs ETL, ELT operations in accordance with enterprise data governance and security standards
• Develop data quality and governance process to ensure the accuracy and quality of the data through inspection, validation, processing, anomaly detection

KNOWLEDGE, SKILLS & ABILITIES

• Detail oriented and proactive in taking measures to avoid or mitigate issues.
• Excellent understanding of computer systems, integrations, databases, and data storage systems.
• Understanding of agile data engineering concepts and processes.
• Ability to capture and document business processes and requirements and work with colleagues to create functional requirements.
• Ability to work with clients to translate business needs to technical solutions.
• Ability to provide guidance, mentoring, and training for peers.
• Exceptional interpersonal skills and ability to effectively communicate with teams across the entire organization.
• Demonstrates the organization’s core values, exuding behavior that is aligned with the firm’s culture.
• Proficiency in Microsoft Office Suite (Word, Excel, PowerPoint, Outlook).
• Ability to learn any other appropriate program or software system used by the firm as necessary.

EDUCATION & EXPERIENCE

• 5-7 years of relevant experience required
• BA/BS in relevant discipline required
• Vast experience with multiple development methodologies
• Experience of building large, complicated data pipelines cross different platforms, data sources, data structures
• Experience of working with relational databases such as SQL Server, Oracle, etc., and SQL scripting
• Experience of cloud platforms (like AWS, Azure, GCP) and its ETL tools and techniques of sourcing, maintaining, and updating data, data warehousing, data cleansing & transformation, etc.
• Programming experience in Python, Spark, and other similar languages
• Advanced programming knowledge and experience with large-scale processing engines are required, as well as a deeper understanding of database security and compliance tools.

IMPORTANT NOTICE

This position description is intended to describe the level of work required of the person performing in the role and is not a contract. The essential responsibilities are outlined; other duties may be assigned as needs arise or as required to support the organization. All requirements may be subject to reasonable accommodation to applicants and colleagues who need them for medical or religious reasons.

The Baldwin Group is a cohesive group of experts in business insurance, employee benefits, retirement planning, and all areas of private and personal insurance. Since 2011, we’ve evolved from a local business into a national firm with a vast network of specializations serving two million clients across the country. At The Baldwin Group, we provide solutions so our clients can pursue what’s possible for themselves, their families, and their businesses. Whether renting a first apartment, opening a small business or taking a company public, we offer solutions to support clients at every step of their journey giving them peace of mind to pursue their purpose, passion, and dreams. We Protect the Possible.

The Baldwin Group is an equal employment opportunity firm and strives to comply with all laws prohibiting discrimination based on race, color, religion, age, sex (including sexual orientation and gender identity), national origin or ancestry, disability, military status, marital status, and any other category protected by federal, state, or local laws. All such discrimination is unlawful, and all persons involved in the operations of the firm are prohibited from engaging in this conduct.