Senior Associate: Data Engineer

New York Life Insurance Company; New York (NY); On-site; USD 100,000 - 143,000; Full time

Benefits offered by this job

Discretionary bonus

Leave programs

Adoption assistance

Student loan repayment programs

Job summary

A leading insurance provider in New York is looking for a Data Engineer to enhance its analytics capabilities. This position involves building and maintaining data pipelines, ensuring high data quality, and collaborating with data scientists on analytics initiatives. Ideal candidates will have 3-7 years of experience with dbt, AWS Glue, and a strong analytical skill set. Compensation ranges from $100,000 to $143,000, with a hybrid work model offering flexibility.

Qualifications

• 3-7+ years of experience in data engineering and analytics.
• Experience with AWS Glue and ETL processes.
• Strong knowledge of dbt data transformation tools.

Responsibilities

• Build and maintain dbt data pipelines.
• Implement real-time data ingestion using PySpark and AWS Glue.
• Collaborate on data quality and availability with data scientists.

Skills

Building and maintaining dbt data models

AWS Glue proficiency

Databricks knowledge

Kafka and streaming data pipelines

Analytical thinking

Problem-solving skills

Team collaboration

Communication skills

Tools

PySpark

SQL

Git

Job description

Location Designation: Hybrid - 3 days per week

As part of Technology, you'll have the opportunity to contribute to groundbreaking initiatives that shape New York Life's digital landscape. Leverage cutting‑edge technologies like Generative AI to increase productivity, streamline processes, and create seamless experiences for clients, agents, and employees. Your expertise fuels innovation, agility, and growth — driving the company's success.

At New York Life, you will join a team of analytics engineers focused on delivering clean, well‑structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help define and uphold data and engineering standards, ensuring consistency, quality, and scalability. You will be an instrumental member of the Data and Analytics Engineering team, enabling enterprise‑wide data activation and supporting advanced analytics initiatives.

What You’ll Do

• Build and maintain dbt data pipelines to deliver clean, reliable, and well‑structured data for data science and analytics use cases.
• Implement real‑time data ingestion and processing using PySpark and AWS Glue.
• Apply software engineering best practices—including version control, testing, and integration—to all analytics and data development work.
• Review code changes and approve pull requests (PRs) in Git to ensure quality and consistency.
• Partner with stakeholders to explore, analyze, and source data from strategic enterprise data assets.
• Collaborate closely with data scientists on data quality, availability, and business value to support model development and analysis.
• Translate business and technical requirements into Jira stories, define milestones, and manage progress.
• Work with data stewards across New York Life to ensure alignment on data governance and standards.
• Build strong relationships with Technology (IT) teams to support tooling, data strategy, system integrations, and deployment processes.
• Communicate information and ideas effectively to diverse audiences across the organization.

What You’ll Bring

• 3-7+ years of experience building and maintaining dbt data models and transformation pipelines.
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration.
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
• Experience with Kafka and streaming data pipelines for real‑time ingestion and processing.
• Strong analytical thinking and problem‑solving skills, with the ability to troubleshoot complex data issues.
• Ability to work collaboratively in cross‑functional teams and communicate technical concepts to non‑technical stakeholders.
• Experience in the insurance industry or other regulated industries (preferred).

Pay Transparency

• Salary Range: $100,000–$143,000
• Overtime eligible: Exempt
• Discretionary bonus eligible: Yes
• Sales bonus eligible: No
• Actual base salary will be determined based on factors such as individual experience, skills, qualifications, and job location.
• Employees may also be eligible to participate in an incentive program.

Company Overview

At New York Life, our 180‑year legacy of purpose and integrity fuels our future. As we evolve into a more technology‑, data‑, and AI‑enabled organization, we remain grounded in the values that drive lasting impact.

Our diverse business portfolio creates opportunities to make a difference across industries and communities—inviting bold thinking, collaborative problem‑solving, and purpose‑driven innovation. Here, you’ll find the rare balance of long‑standing stability and forward momentum, supported by an inclusive team that honors tradition while embracing progress.

As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what’s next, and your growth powers it.

Our Benefits

We provide a full package of benefits for employees – and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work.

Our Commitment to Inclusion

At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities.

Recognized as one of Fortune’s World’s Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We’re proud that due to our mutuality, we operate in the best interests of our policy owners.

To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.