Lead Data Engineer - Spark & AI-Driven Pipelines

慨正橡扯; Jersey City (NJ); On-site; USD 120,000 - 150,000; Full time

Benefits offered by this job

Comprehensive health care coverage

Retirement savings plan

Tuition reimbursement

Backup childcare

Job summary

慨正橡扯 is seeking a Lead Software Engineer in Jersey City, New Jersey, to enhance and deliver technology products within our Commercial & Investment Bank team. You will leverage your 5+ years of experience to develop innovative solutions in a collaborative and diverse environment.

The ideal candidate possesses advanced skills in Python, Spark SQL, and data engineering practices. This role offers a comprehensive benefits package and an inclusive workplace culture.

Qualifications

• 5+ years of experience in software engineering and data engineering.
• Advanced proficiency in Python and Spark SQL with hands-on experience.
• Experience delivering operational stability for large-scale data pipelines.

Responsibilities

• Execute creative software solutions for data engineering.
• Develop secure high-quality production code in Python/PySpark.
• Lead evaluation sessions with vendors and internal teams.

Skills

Data Engineering

Python

PySpark

Spark SQL

AWS

AI-assisted Engineering

Education

Formal training in software engineering

Tools

Spark

Kafka

Databricks

Job description

慨正橡扯 is seeking a Lead Software Engineer in Jersey City, New Jersey, to enhance and deliver technology products within our Commercial & Investment Bank team. You will leverage your 5+ years of experience to develop innovative solutions in a collaborative and diverse environment.

The ideal candidate possesses advanced skills in Python, Spark SQL, and data engineering practices. This role offers a comprehensive benefits package and an inclusive workplace culture.