Manager, Data Engineering

32bjfunds; New York (NY); On-site; USD 140,000 - 180,000; Full time

Job summary

32BJ Benefit Funds in New York seeks a Data Engineering Manager to lead a small technical team and drive development of a health-oriented data warehouse. You will own the data warehouse architecture, pipelines, governance, and QA, working with data engineers, operations, analytics, IT, and external data vendors.

The role requires strong collaboration, project management, and translating business needs into robust, compliant technical solutions, delivering high-quality data platforms for decision

Qualifications

• Bachelor's degree in computer science, mathematics, or related field.
• Proficiency in SQL and Python with hands-on industry experience.
• Experience in conducting code review and testing practices.
• Strong project management skills with familiarity with Agile.
• Experience with GitHub and Azure DevOps.
• Experience overseeing multi-disciplinary data teams.
• Experience in building and maintaining data pipelines and data stores.
• Strong communication and client-facing skills.

Responsibilities

• Oversee the data engineering team through leadership and supervision.
• Technical ownership of data warehouse, including system and data architecture, engineering and data pipelines.
• Lead collaboration for deployment and implementation of tools to integrate data across information systems.
• Understand business requirements and translate into application features.
• Develop and implement methods to improve data reliability and quality
• Maintain data governance and documentation practices from various data inputs.
• Participate in evaluating new technologies and how they support business needs.
• Manage data platform stakeholders balancing business needs with technology capabilities.
• Develop testing protocols to ensure robust processes and bug fixes.
• Conduct functional and non-functional testing.
• Evaluate existing data models and pipelines to add features.
• Develop technical documentation to represent data models.
• Ensure integration testing and issue documentation.
• Collaborate with partners to deliver data solutions and contribute to data strategy.
• Document and prioritize new datasets and features for the data warehouse.
• Align with agency IT for deployment of integration systems.
• Partner with QA and Infra teams to ensure security and regulatory compliance.
• Collaborate with Data Warehouse Architect on overall architecture guidance.
• Ensure governing principles and privacy standards are followed.

Skills

SQL

Python

Agile

GitHub

Azure DevOps

Data pipelines

Data governance

Stakeholder management

Education

Bachelor's degree in computer science, mathematics, or related field

MBA or equivalent work experience desired

Tools

GitHub

Azure DevOps

Job description

Job Code: 911

Department Name: Health Fund Admin

Reports To:

FLSA Status: Exempt

Union Code: N/A

Management: Yes

About Us

Building Services 32BJ Benefit Funds (“the Funds”) is the umbrella organization responsible for administering Health, Pension, Retirement Savings, Training, and Legal Services benefits to over 185,000 SEIU 32BJ members. Our mission is to make significant contributions to the lives of our members by providing high quality benefits and services. Through our commitment, we embody five core values: Flexibility, Initiative, Respect, Sustainability, and Teamwork (FIRST). By following our core values, employees are open to different and new ways of doing things, take active steps to improve the organization, create an environment of trust and respect, approach their work with the intent of a positive outcome, and work collaboratively with colleagues.

The Funds oversees and manages $11 billion of dollars in assets, which are made up of many, varied and complex funds. The dollars come from a number of sources, including the property owners who pay into the funds on behalf of their employees, and as such, requires those who oversee and manage the money to be highly skilled financial management people.

32BJ Benefit Funds will continue to drive innovation, equity, and technology insights to further help the lives of our hard-working members and their families. We use cutting edge technology such as: M365, Dynamics 365 CRM, Dynamics 365 F&O, Azure, AWS, SQL, Snowflake, QlikView, and more.

Please take a moment to watch our video to learn more about our culture and contributions to our members: youtu.be/hYNdMGLn19A

Job Summary

We are looking for a Data Engineering Manager to oversee a small technical team to drive forward development of a Health oriented data warehouse. The role will oversee numerous projects and initiatives across the complete data lifecycle, including: data governance, ETL processes, data validation, standardization and normalization, data integrity/QA/QC, integrations between datasets, and reporting and dashboards. This person will need to operate at both a technical and a business level, helping to delineate roles and responsibilities across the data team, with a focus on minimizing frictions while creating high quality, reliable technical products in line with business needs and expectations. This role relies on strong collaboration between internal teams including data engineering, operations, analytics, IT, and other stakeholders, as well as external data vendors and content producers. Proactive communication and strong project management skills will be a must in this role.

Essential Duties and Responsibilities

1. Oversee the data engineering team through leadership and supervision. Staff will include data engineers and ETL specialists
2. Technical ownership of data warehouse, including system and data architecture, engineering and data pipelines
3. Lead collaboration for deployment and implementation of tools necessary to integrate data within and across information systems and their use for decision making
4. Understand business requirements and how they translate in application features.
5. Develop and implement methods to improve data reliability and quality
6. Maintain data governance and documentation practices for a variety of data inputs from a number of sources, including flat files and spreadsheet-like files transmitted through SFTP, as well as JSON/XML style objects from API interfaces, among others
7. Participate in the evaluation/pilot of new technologies and provide recommendations on how they support business need
8. Manage and communicate with data platform stakeholders balancing business needs with technology capabilities
9. Develop testing protocols to ensure processes are robust and bugs are identified and corrected
10. Conduct functional and non-functional testing
11. Evaluate existing data models and pipelines to update and add new features
12. Develop technical documentation to accurately represent data models
13. Ensure that integration processes are fully tested and any issues/limitations in integrations are well defined and documented
14. Work with cross functional technology and business partners to lead the technical delivery of integration solutions approved within the portfolio and contribute to the development of the Funds' data strategy
15. Collaborate with business partners and internal teams to understand, document and prioritize new datasets and features to be added to the data warehouse.
16. Align closely with agency IT teams to support the deployment of integration systems.
17. Partner with the QA and Infrastructure teams to ensure compliance with regulatory and security requirements.
18. Collaborate with Data Warehouse Architect in the design for the overall architecture of the data platforms and provide guidance and oversight
19. Ensure that guiding principles and technology and privacy standards are followed.

Qualifications (Competencies)

• Bachelor's degree in computer science, mathematics, or related field; MBA or equivalent work experience desired
• Proficiency in SQL and Python, with hands-on industry experience is a must
• Experience in conducting code review a must; familiarity with unit, integration, and functional testing best practices and procedures a strong plus
• Strong project management skills a must; familiarity with Agile methodology a strong plus
• Experience with GitHub is a must; experience with Azure DevOps a strong plus
• Experience in overseeing multi-disciplinary teams in a data-oriented capacity a must
• Experience in building and maintaining data pipelines and data stores
• Experience in extracting maximum value from low quality and/or error ridden input data a strong plus
• Strong communication and client-facing skills with the ability to work in a centralized technology environment

Education

Bachelor's degree in computer science, mathematics, or related field; MBA or equivalent work experience desired.

Physical Demands

The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals to perform the essential functions.

• Under 1/3 of the time: Standing, Walking, Climbing or Balancing, Stooping, Kneeling, Crouching, or Crawling
• Over 2/3 of the time: Talking or Hearing
• 100% of the time: Using Hands

Work Environment

The work environment characteristics described here are representative of those an employee encounters while performing the essential functions of this job. Reasonable accommodation may be made to enable individuals with disabilities to perform the essential functions.

• 1/3 to 2/3 of the time: Work near moving or mechanical parts, exposure to radiation, moderate noise.