Associate - Data Engineer

New York Life; New York (NY); Hybrid; USD 60,000 - 86,000; Full time

Benefits offered by this job

Hybrid work arrangement

Comprehensive benefits

Job summary

New York Life is seeking a data engineer to join our Technology data team, focusing on building robust dbt data pipelines and real-time processing with PySpark and AWS Glue. You'll collaborate with data scientists and stakeholders to source data, ensure quality, and translate requirements into actionable Jira stories, while upholding governance and standards across the enterprise.

Hybrid work arrangement (3 days per week) and competitive compensation accompany our focus on scalable data

Qualifications

• 2–5+ years of hands-on experience building and maintaining dbt data models and pipelines.
• Proficiency with AWS Glue ETL development, orchestration, and catalog integration.
• Strong knowledge of Databricks (SQL/notebooks) and distributed data processing.
• Experience with Kafka for real-time ingestion and processing.
• Familiarity with Google Cloud Platform (GCP) is a plus.
• Strong analytical thinking, problem-solving, and cross-functional collaboration.
• Experience in the insurance industry or regulated domains preferred.

Responsibilities

• Build and maintain dbt data pipelines delivering clean, reliable data for analytics.
• Implement real-time data ingestion using PySpark and AWS Glue.
• Apply software engineering practices across analytics and data development work.
• Review code changes and approve PRs in Git to ensure quality.
• Partner with stakeholders to source data from strategic enterprise assets.
• Collaborate with data scientists on data quality, availability, and value.
• Translate requirements into Jira stories, set milestones, manage progress.
• Work with data stewards to align on governance and standards.
• Build relationships with Technology teams to support tooling and integrations.
• Communicate effectively with diverse audiences across the organization.

Skills

dbt pipelines

AWS Glue

Databricks

Kafka

GCP

Data governance

Tools

Git

Jira

PySpark

Job description

Location Designation: Hybrid - 3 days per week

As part of Technology, you'll have the opportunity to contribute to groundbreaking initiatives that shape New York Life's digital landscape. Leverage cutting-edge technologies like Generative AI to increase productivity, streamline processes, and create seamless experiences for clients, agents, and employees. Your expertise fuels innovation, agility, and growth — driving the company's success.

At New York Life you will join a team of data engineers focused on delivering clean, well-structured, and reliable data to power various business and AI solutions across the enterprise. In this role, you will help define and uphold data and engineering standards, ensuring consistency, quality, and scalability. You will be an instrumental member of the Data Engineering team, enabling enterprise-wide data activation and supporting advanced analytics initiatives.

What You’ll Do

• Build and maintain dbt data pipelines to deliver clean, reliable, and well-structured data for data science and analytics use cases.
• Implement real-time data ingestion and processing using PySpark and AWS Glue.
• Apply software engineering best practices—including version control, testing, and integration—to all analytics and data development work.
• Review code changes and approve pull requests (PRs) in Git to ensure quality and consistency.
• Partner with stakeholders to explore, analyze, and source data from strategic enterprise data assets.
• Collaborate closely with data scientists on data quality, availability, and business value to support model development and analysis.
• Translate business and technical requirements into Jira stories, define milestones, and manage progress.
• Work with data stewards across New York Life to ensure alignment on data governance and standards.
• Build strong relationships with Technology (IT) teams to support tooling, data strategy, system integrations, and deployment processes.
• Communicate information and ideas effectively to diverse audiences across the organization.

What You’ll Bring

• 2-5+ years of experience with hands‑on experience building and maintaining dbt data models and transformation pipelines.
• Proficiency with AWS Glue, including ETL development, job orchestration, and catalog integration.
• Strong working knowledge of Databricks, including SQL, notebooks, and distributed data processing.
• Experience with Kafka and streaming data pipelines for real‑time ingestion and processing.
• Familiarity with Google Cloud Platform (GCP) is a plus.
• Strong analytical thinking and problem‑solving skills, with the ability to troubleshoot complex data issues.
• Ability to work collaboratively in cross‑functional teams and communicate technical concepts to non‑technical stakeholders.
• Experience in the insurance industry or other regulated industries (preferred)

Pay Transparency

Salary Range: $60,000-$85,500

Overtime eligible: Nonexempt

Discretionary bonus eligible: Yes

Sales bonus eligible: No

Actual base salary will be determined based on several factors but not limited to individual’s experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.

Company Overview

At New York Life, our 180-year legacy of purpose and integrity fuels our future. As we evolve into a more technology‑, data‑, and AI‑enabled organization, we remain grounded in the values that drive lasting impact.

Our diverse business portfolio creates opportunities to make a difference across industries and communities—inviting bold thinking, collaborative problem‑solving, and purpose‑driven innovation. Here, you’ll find the rare balance of long‑standing stability and forward momentum, supported by an inclusive team that honors tradition while embracing progress.

As a Fortune 100 mutual company, we offer a place to grow your skills, contribute to meaningful work, and deliver solutions that matter. Your ideas drive what’s next, and your growth powers it.

Our Benefits

We provide a full package of benefits for employees – and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work. Click here to discover more about our comprehensive benefit options or visit our NYL Benefits Site.

Our Commitment to Inclusion

At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities. Click here to learn more about New York Life’s leadership in this space.

Recognized as one of Fortune’s World’s Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by the Foundation. We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.

Visit our LinkedIn to see how our employees and agents are leading the industry and impacting communities.

Visit our Newsroom to learn more about how our company is constantly evolving to meet our clients' and employees’ needs.