Lead Software Engineer - Data Engineer

hackajob; Jersey City (NJ); On-site; USD 140,000 - 210,000; Full time

Benefits offered by this job

Health Care Coverage

On-Site Health and Wellness Centers

Retirement Savings Plan

Backup Childcare

Tuition Reimbursement

Mental Health Support

Financial Coaching

Job summary

hackajob is looking for a Lead Software Engineer to drive creative software solutions and critical technology initiatives across multiple technical areas in Jersey City. You will lead engineering efforts and champion AI-assisted practices to enhance code quality and operational outcomes.

The position requires 5+ years in software and data engineering with Python and Spark expertise, plus experience with AWS data management and a strong commitment to responsible AI in engineering workflows.

Qualifications

• 5+ years of experience in software engineering and data engineering.
• Advanced proficiency in Python and Spark technologies.
• Experience with AWS data management patterns.
• Strong understanding of responsible AI use in engineering workflows.

Responsibilities

• Lead software engineering initiatives across multiple technical areas.
• Drive team adoption of AI-assisted engineering practices to improve code quality and outcomes.
• Deliver scalable, robust data pipelines and production-grade software.

Skills

Python

PySpark

Spark SQL

Data Engineering

Software Engineering

AI-Assisted Development

Java

SQL

Tools

AWS

Data Pipeline

Apache Iceberg

Delta Lake

Kafka

Spark Structured Streaming

Job description

As a Lead Software Engineer, you will execute creative software solutions and conduct critical technology solutions across multiple technical areas. You will also drive team adoption of AI-assisted engineering practices to improve code quality and operational outcomes.

Requirements

The role requires 5+ years of experience in software engineering and data engineering, with advanced proficiency in Python and Spark technologies. Candidates should also have experience with AWS data management patterns and a strong understanding of responsible AI use in engineering workflows.

Key Skills

Python, PySpark, Spark SQL, Data Engineering, Software Engineering, AI-Assisted Development, AWS, Data Pipeline, Apache Iceberg, Automation, Continuous Delivery, Kafka, Delta Lake, Spark Structured Streaming, Java, SQL

Benefits

• Health Care Coverage
• On-Site Health and Wellness Centers
• Retirement Savings Plan
• Backup Childcare
• Tuition Reimbursement
• Mental Health Support
• Financial Coaching