Senior Python & Big Data Engineer (Databricks + Cloud)

Next Frontier Capital; Jersey City (NJ); On-site; USD 120,000 - 180,000; Full time

Job summary

JPMorgan Chase & Co. in New Jersey seeks a Big Data Software Engineer to build and enhance a large-scale data platform for Client 360 and Marketing & Events in the Commercial Banking IT group.

You will implement ETL processes, collaborate with stakeholders, and apply modern engineering practices across the full software lifecycle. The role emphasizes solving business problems with innovative data solutions, learning cutting-edge technologies, and delivering high-quality results in a

Qualifications

• 3+ years of experience with Python is preferred.
• 2+ years of Experience in Java Development.
• 2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks).
• Experience in writing efficient SQLs.
• Experience in implementing complex ETL transformations on big data platform.
• Strong Experience with UNIX shell scripting to automate file preparation and database loads.
• Experience in data quality testing; adept at writing test cases and scripts.
• Familiarity with relational database environment (Oracle, SQL Server, etc.).
• Strong analytical skills with attention to detail and accuracy.
• Ability to manage multiple priorities and projects.
• Demonstrated independent problem solving skills.

Responsibilities

• Acquire data from primary or secondary data sources.
• Identify, analyze, and interpret trends or patterns in complex data sets.
• Transforming existing ETL logic on AWS Platform or Data Bricks.
• Innovate new ways of managing, transforming and validating data.
• Implement new or enhanced services/scripts.
• Establish and enforce guidelines to ensure data assets quality and completeness.
• Apply quality assurance best practices to all work products.
• Analyze, design and code solutions using Agile practices.
• Collaborate with development teams and stakeholders across locations.

Skills

Python

Java

Big Data

SQL

ETL

Unix Shell Scripting

Data Quality Testing

Relational Databases

Analytical Skills

Development Discipline

Agile Methodologies

NoSQL

Tools

AWS

Apache Spark

Kafka

Databricks

Job description

JPMorgan Chase & Co. in New Jersey seeks a Big Data Software Engineer to build and enhance a large-scale data platform for Client 360 and Marketing & Events in the Commercial Banking IT group.

You will implement ETL processes, collaborate with stakeholders, and apply modern engineering practices across the full software lifecycle. The role emphasizes solving business problems with innovative data solutions, learning cutting-edge technologies, and delivering high-quality results in a