Senior Python & Databricks Engineer for Data Platform

JPMorgan Chase; Jersey City (NJ); On-site; USD 133,000 - 185,000; Full time

Job summary

JPMorgan Chase in Jersey City, NJ is seeking a Software Engineer III to design and deliver trusted, scalable technology products for Commercial Banking Technology. You will work on Client 360 and a Marketing and Events Data Platform, leveraging Big Data on AWS and Databricks to support large-scale data processing.

The role requires 3+ years Python, 2+ years Java, and strong SQL and ETL skills, with experience in Unix scripting and data quality testing.

Qualifications

• 3+ years of Experience with Python
• 2+ years of Experience in Java Development
• 2+ Experience in a Big Data technologies (e.g. AWS, Spark, Kafka, Data Bricks etc.)
• Experience in writing efficient SQLs
• Experience in implementing complex ETL transformations on big data platform
• Strong Experience with UNIX shell scripting to automate file preparation and database loads
• Experience in data quality testing; adept at writing test cases and scripts
• Familiarity with relational database environment (Oracle, SQL Server, etc.) leveraging databases, tables/views, stored procedures, agent jobs, etc.
• Strong analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
• Strong development discipline and adherence to best practices and standards.

Responsibilities

• Acquire data from primary or secondary data sources
• Identify, analyze, and interpret trends or patterns in complex data sets
• Transforming existing ETL logic on AWS Platform or Data Bricks
• Innovate new ways of managing, transforming and validating data
• Implement new or enhance services/scripts
• Establish and enforce guidelines to ensure consistency, quality and completeness of data assets
• Apply quality assurance best practices to all work products
• Analyze, design and code business-related solutions, as well as core architectural changes, using an Agile programming approach resulting in software delivered on time and in budget;
• Experience of working in a development teams, using agile techniques and Object Oriented development and scripting languages, is preferred
• Comfortable learning cutting edge technologies and applications to greenfield project

Skills

Python

Java

Big Data

SQL

ETL

UNIX shell

Data quality testing

Relational databases

Agile development

Tools

AWS

Data Bricks

Spark

Kafka

Job description

JPMorgan Chase in Jersey City, NJ is seeking a Software Engineer III to design and deliver trusted, scalable technology products for Commercial Banking Technology. You will work on Client 360 and a Marketing and Events Data Platform, leveraging Big Data on AWS and Databricks to support large-scale data processing.

The role requires 3+ years Python, 2+ years Java, and strong SQL and ETL skills, with experience in Unix scripting and data quality testing.