Software Engineer III- Python, Databricks

hackajob; Jersey City (NJ); On-site; USD 120,000 - 160,000; Full time

Benefits offered by this job

Health care coverage

On-site health and wellness centers

Retirement savings plan

Backup childcare

Tuition reimbursement

Mental health support

Financial coaching

Job summary

hackajob is seeking a data engineer to build a CIB-wide Marketing and Events Data Platform and enable large-scale processing on internal and public clouds.

You will focus on data acquisition and ETL transformations on AWS or Databricks, ensuring data quality and consistency across systems.

This on-site Jersey City role leverages Python, Java, Spark, Kafka, SQL, and NoSQL technologies in a fast-paced environment.

Qualifications

• 3+ years of Python experience required.
• 2+ years of Java experience required.
• Experience with Spark, Kafka and Big Data tech required; SQL & Unix shell scripting necessary.

Responsibilities

• Build a CIB-wide Marketing and Events Data Platform.
• Implement large-scale processing on internal and public clouds.
• Acquire data and transform ETL logic on AWS or Databricks.
• Ensure data quality and consistency across datasets.

Skills

Python

Java

Databricks

AWS

Spark

Kafka

SQL

Unix Shell Scripting

ETL

Big Data

Agile

Object Oriented Programming

Data Quality Testing

Oracle

SQL Server

NoSQL

Job description

The role involves building a CIB wide Marketing and Events Data Platform and implementing large-scale processing on internal and public clouds. Key tasks include acquiring data, transforming ETL logic on AWS or Databricks, and ensuring data quality and consistency.

Requirements:

Candidates should have 3+ years of Python experience, 2+ years of Java, and experience with Big Data technologies like Spark and Kafka. Strong skills in SQL, Unix shell scripting, and relational databases are required.

Key Skills:

Python, Java, Databricks, AWS, Spark, Kafka, SQL, Unix Shell Scripting, ETL, Big Data, Agile, Object Oriented Programming, Data Quality Testing, Oracle, SQL Server, NoSQL

Benefits:

• Health care coverage
• On-site health and wellness centers
• Retirement savings plan
• Backup childcare
• Tuition reimbursement
• Mental health support
• Financial coaching