Associate - Data Engineer

New York Life Insurance Co; New York (NY); On-site; USD 60,000 - 86,000; Full time

Job summary

New York Life Insurance Co in New York City is seeking an Associate - Data Engineer to help build and maintain dbt data pipelines that deliver clean, reliable data for analytics and AI use cases.

You will implement real-time data ingestion with PySpark and AWS Glue, apply software engineering best practices, and collaborate with data scientists across enterprise to enable advanced analytics and data governance.

Qualifications

• 2-5+ years of hands-on experience building and maintaining dbt data models and transformation pipelines.
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration.
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
• Experience with Kafka and streaming data pipelines for real-time ingestion and processing.
• Familiarity with Google Cloud Platform (GCP) is a plus.
• Strong analytical thinking and problem-solving skills, with the ability to troubleshoot complex data issues.
• Ability to work collaboratively in cross-functional teams and communicate technical concepts to non-technical stakeholders.
• Experience in the insurance industry or other regulated industries (preferred)

Responsibilities

• Build and maintain dbt data pipelines to deliver clean, reliable, and well‑structured data for data science and analytics use cases.
• Implement real‑time data ingestion and processing using PySpark and AWS Glue.
• Apply software engineering best practices—including version control, testing, and integration—to all analytics and data development work.
• Review code changes and approve pull requests (PRs) in Git to ensure quality and consistency.
• Partner with stakeholders to explore, analyze, and source data from strategic enterprise data assets.
• Collaborate closely with data scientists on data quality, availability, and business value to support model development and analysis.
• Translate business and technical requirements into Jira stories, define milestones, and manage progress.
• Work with data stewards across New York Life to ensure alignment on data governance and standards.
• Build strong relationships with Technology (IT) teams to support tooling, data strategy, system integrations, and deployment processes.
• Communicate information and ideas effectively to diverse audiences across the organization.

Skills

dbt pipelines

AWS Glue

Databricks

Kafka

Jira

Tools

Git

Jira

Job description

Associate - Data Engineer

New York, New York, United States

As part of Technology, you'll have the opportunity to contribute to groundbreaking initiatives that shape New York Life's digital landscape. Leverage cutting‑edge technologies like Generative AI to increase productivity, streamline processes, and create seamless experiences for clients, agents, and employees. Your expertise fuels innovation, agility, and growth — driving the company's success.

At New York Life you will join a team of data engineers focused on delivering clean, well‑structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help define and uphold data and engineering standards, ensuring consistency, quality, and scalability. You will be an instrumental member of the Data Engineering team, enabling enterprise‑wide data activation and supporting advanced analytics initiatives.

What You’ll Do:

• Build and maintain dbt data pipelines to deliver clean, reliable, and well‑structured data for data science and analytics use cases.
• Implement real‑time data ingestion and processing using PySpark and AWS Glue.
• Apply software engineering best practices—including version control, testing, and integration—to all analytics and data development work.
• Review code changes and approve pull requests (PRs) in Git to ensure quality and consistency.
• Partner with stakeholders to explore, analyze, and source data from strategic enterprise data assets.
• Collaborate closely with data scientists on data quality, availability, and business value to support model development and analysis.
• Translate business and technical requirements into Jira stories, define milestones, and manage progress.
• Work with data stewards across New York Life to ensure alignment on data governance and standards.
• Build strong relationships with Technology (IT) teams to support tooling, data strategy, system integrations, and deployment processes.
• Communicate information and ideas effectively to diverse audiences across the organization.

What You’ll Bring:

• 2-5+ years of experience with hands‑on experience building and maintaining dbt data models and transformation pipelines.
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration.
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
• Experience with Kafka and streaming data pipelines for real‑time ingestion and processing.
• Familiarity with Google Cloud Platform (GCP) is a plus.
• Strong analytical thinking and problem‑solving skills, with the ability to troubleshoot complex data issues.
• Ability to work collaboratively in cross‑functional teams and communicate technical concepts to non-technical stakeholders.
• Experience in the insurance industry or other regulated industries (preferred)

Pay Transparency

Salary Range:$60,000-$85,500

Discretionary bonus eligible:Yes

Actual base salary will be determined based on several factors but not limited to individual’s experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.

Company Overview

At New York Life, our 180-year legacy of purpose and integrity fuels our future. As we evolve into a more technology-, data-, and AI-enabled organization, we remain grounded in the values that drive lasting impact.

Our diverse business portfolio creates opportunities to make a difference across industries and communities—inviting bold thinking, collaborative problem‑solving, and purpose‑driven innovation. Here, you’ll find the rare balance of long‑standing stability and forward momentum, supported by an inclusive team that honors tradition while embracing progress.

As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what’s next, and your growth powers it.

We provide a full package of benefits for employees – and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work. Click here to discover more about our comprehensive benefit options or visit our NYL Benefits Site.

Our Commitment to Inclusion

At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities. Click here to learn more about New York Life’s leadership in this space.

Recognized as one of Fortune’s World's Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation .We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.

Visit our LinkedIn to see how our employees and agents are leading the industry and impacting communities.

Visit our Newsroom to learn more about how our company is constantly evolving to meet our clients' and employees’ needs.

Disclaimer 1 : Eligibility for, and benefits under, the Pension Plan and 401(k) Savings Plan (“Plans”) are determined in accordance with the terms of the applicable plan document. Employees of certain subsidiaries, including but not limited to Group Benefit Solutions, employees of Life Insurance Company of North America and New York Life Group Insurance Company of NY, are not eligible to participate in the Pension Plan. In the event of a conflict between this information and the applicable plan document, the applicable plan document governs. The Company reserves the right to amend or terminate the Plans at any time.