Senior Associate - Data Engineer

New York Life Insurance Company; New York (NY); Hybrid; USD 95,000 - 163,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to enhance their data capabilities. In this hybrid role, you'll leverage AWS technologies to build and optimize data pipelines, ensuring seamless data flow and integration across various systems. You'll collaborate with cross-functional teams, utilizing your expertise in Python, SQL, and data engineering to support machine learning and analytics initiatives. Join a company that values inclusion and invests in your growth, providing a supportive environment where you can thrive and make a meaningful impact on the lives of others.

Benefits

Comprehensive benefits package

Leave programs

Adoption assistance

Student loan repayment programs

Qualifications

• 3+ years as a Cloud Data Engineer or similar role.
• Experience with AWS services in hybrid environments.
• Ability to lead a team of developers.

Responsibilities

• Design and develop data engineering infrastructure and platforms.
• Create methods to transition data to AWS Cloud.
• Build optimal ETL/ELT processes for data integration.

Skills

AWS Cloud Technologies

Python

PySpark

SQL

Data Engineering

ETL/ELT Processes

Data Lake/Warehouse

Education

Bachelor's degree in Data Science or Computer Engineering

Tools

AWS RDS

AWS Glue

AWS Lambda

Postgres

Job description

Location Designation:Hybrid - 3 days per month

Our New York Life culture has laid the foundation for over 175 years of commitment to our employees, agents, policy owners, and the communities where we live and work. Here you become a valued part of a welcoming, inclusive, and caring organization with a long-standing legacy in stability and growth. The strength revolves around our diversified, multi-dimensional business portfolio that goes beyond life insurance.

As a Fortune 100 company and industry leader, we provide an environment where you can explore your career ambitions, offering opportunities to tackle meaningful challenges and stretch your skills while balancing work and life priorities. You willbe part ofan inclusive teamguided by our belief to always be there for each other-providing the support and flexibilityto grow and reach new heights while making an impact in the lives of others.

You are our future, and we commit to investing in you accordingly.

Visit our LinkedIn to see how our employees and agents are leading the industry and impacting communities.

Visit our Newsroom to learn more about how our company is constantly evolving to meet our clients' and employees' needs.

The Enterprise Data Management team provides transformative data capabilities and solutions that serve as the core data, reporting, and analytics platform for the Insurance & Agency Group at New York Life (NYL). The Enterprise Data Management team is looking for a Data Engineer with the skills listed below.

Job Overview:

Build, expand, and optimize data pipeline architecture using Amazon Web Services cloud, Python and Pyspark. Utilize tools like Amazon Relational Database Service (AWS DMS), AWS Database Migration Service (AWS DMS), AWS Glue, Amazon Simple Storage Service (AWS S3), AWS Lambda triggers & functions, etc. Leverage Data Engineering strategies, Data Lake/Lakehouse/Data Warehouse technologies, and streaming/real-time data to bring data into the ecosystem for consumption. Use SQL for data analysis.

What You'll Do:

• Design and develop enterprise infrastructure and platforms required for data engineering.
• Use AWS Cloud technologies to support data needs for expansion of Machine Learning/Data Science capabilities, applications/mobile apps/systems, BI/analytics, and cross-functional teams.
• Create methods and routines to transition data from on-premise systems to the AWS Cloud.
• Store data in AWS Cloud platform and develop transformational logic based on business rules.
• Create and maintain optimal data pipeline architecture. Test and implement data environments.
• Assemble large, complex data sets to meet functional/non-functional business requirements.
• Build the infrastructure required for optimal ETL/ELT (extraction, transformation, and loading) of data from a wide variety of data sources using SQL and AWS big data technologies.
• Utilize AWS Cloud tools like Amazon Relational Database Service (AWS DMS), AWS Database Migration Service (AWS DMS, AWS Glue, Amazon Simple Storage Service (AWS S3), AWS Lambda triggers & functions, to ingest data sets and create pipelines.
• Develop and debug code in PySpark/Spark/Python. Use SQL and/or Postgres.
• Use Data Pipeline, workflow management, and orchestration service tools.
• Comfortable with SQL for data analysis.
• Collaborate with Cloud Data Architects, Data Engineers, DBAs, Analytics & Software Engineers.
• Interact with stakeholders, Product Management, and Design teams to understand data pipeline requirements, design solutions, and resolve issues.

What You'll Bring:

• 3+ years as a Cloud Data Engineer, Data Engineer, Data Architect, AWS Engineer, etc.
• 3+ years with Amazon Relational Database Service (RDS), AWS Database Migration Service (AWS DMS), Amazon Simple Storage Service (S3) Data Lake, AWS Lambda, etc. in shared service, hybrid environments.
• Highly scalable Data stores, Data Lake, Data Warehouse, Lakehouse, and unstructured datasets.
• Data integration, data processing, data streaming, message queuing, and/or ETL/ELT.
• Ability to lead a team of developers.
• Bachelor's degree in Data Science, Computer Engineering, or related field preferred.

Pay Transparency

Salary Range:$95,000-$162,500

Overtime eligible:Exempt

Discretionary bonus eligible:Yes

Sales bonus eligible:No

Actual base salary will be determined based on several factors but not limited to individual's experience, skills, qualifications, and job location. Additionally, employees are eligible for an annual discretionary bonus. In addition to base salary, employees may also be eligible to participate in an incentive program.

Our Benefits

We provide a full package of benefits for employees - and have unique offerings for a modern workforce, including leave programs, adoption assistance, and student loan repayment programs. Based on feedback from our employees, we continue to refine and add benefits to our offering, so that you can flourish both inside and outside of work.Click hereto discover more about our comprehensive benefit options or visit our NYL Benefits Site.

Our Commitment to Inclusion
At New York Life, fostering an inclusive workplace is fundamental to who we are and how we serve our communities. We have a longstanding commitment to creating an environment where individuals can contribute their best and succeed together. This foundation is rooted in our core values of humanity and integrity, ensuring that every employee feels valued and supported. By embracing a broad range of perspectives and experiences, we achieve greater success and fulfill our promise of providing financial security and peace of mind to families across all communities. Click here to learn more about New York Life's leadership in this space.

Recognized as one of Fortune's World's Most Admired Companies, New York Life is committed to improving local communities through a culture of employee giving and volunteerism, supported by theFoundation.We're proud that due to our mutuality, we operate in the best interests of our policy owners. To learn more about career opportunities at New York Life, please visit the Careers page of www.NewYorkLife.com.

Job Requisition ID:91532