Senior Python & Databricks Data Engineer

hackajob; Jersey City (NJ); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health care coverage

On-site health and wellness centers

Retirement savings plan

Backup childcare

Tuition reimbursement

Mental health support

Financial coaching

Job summary

hackajob is seeking a data engineer to build a CIB-wide Marketing and Events Data Platform and enable large-scale processing on internal and public clouds.

You will focus on data acquisition and ETL transformations on AWS or Databricks, ensuring data quality and consistency across systems.

This on-site Jersey City role leverages Python, Java, Spark, Kafka, SQL, and NoSQL technologies in a fast-paced environment.

Qualifications

• 3+ years of Python experience required.
• 2+ years of Java experience required.
• Experience with Spark, Kafka and Big Data tech required; SQL & Unix shell scripting necessary.

Responsibilities

• Build a CIB-wide Marketing and Events Data Platform.
• Implement large-scale processing on internal and public clouds.
• Acquire data and transform ETL logic on AWS or Databricks.
• Ensure data quality and consistency across datasets.

Skills

Python

Java

Databricks

AWS

Spark

Kafka

SQL

Unix Shell Scripting

ETL

Big Data

Agile

Object Oriented Programming

Data Quality Testing

Oracle

SQL Server

NoSQL

Job description

hackajob is seeking a data engineer to build a CIB-wide Marketing and Events Data Platform and enable large-scale processing on internal and public clouds.

You will focus on data acquisition and ETL transformations on AWS or Databricks, ensuring data quality and consistency across systems.

This on-site Jersey City role leverages Python, Java, Spark, Kafka, SQL, and NoSQL technologies in a fast-paced environment.