Senior Data Engineer: Data Pipelines & Lakes Expert

Prudential Financial; Newark (NJ); On-site; USD 104,000 - 172,000; Full time

Benefits offered by this job

Bonus potential

401(k) match

Wellness program

Paid time off

Employee stock purchase plan

Job summary

Prudential Financial is seeking a Senior Data Engineer to join the FM Management Reporting team. You will design, build and maintain data pipelines to support financial data lakes, collaborating with architects, data scientists and analysts to deliver high quality data products.

You will work with Python, SQL, Java, Scala and Spark in a fast paced, agile environment, ensuring data reliability and enabling prescriptive and predictive insights for Finance.

Qualifications

• Bachelor's degree in Computer Science or Engineering or related field.
• Experience with DevOps automation tools and SDLC.
• Ability to learn quickly and work in a collaborative environment.
• Strong problem solving, communication and teamwork skills.

Responsibilities

• Build and optimize data pipelines, logic and storage systems adhering to Prudential standards.
• Develop high quality, well documented code and participate in testing.
• Collaborate with analysts, scientists, and architects on data projects to improve data reliability and quality.
• Write unit, integration and functional tests and address issues from QA or product support.
• Apply knowledge of emerging technologies and coach others.

Skills

Python

R

SQL

Java

Scala

Pyspark/Apache Spark

Shell scripting

Problem solving

Communication

Collaboration

Education

Bachelor's degree in Computer Science or Engineering

Tools

AWS

Airflow

Kinesis

Kafka

Spark

Tableau

Job description

Prudential Financial is seeking a Senior Data Engineer to join the FM Management Reporting team. You will design, build and maintain data pipelines to support financial data lakes, collaborating with architects, data scientists and analysts to deliver high quality data products.

You will work with Python, SQL, Java, Scala and Spark in a fast paced, agile environment, ensuring data reliability and enabling prescriptive and predictive insights for Finance.