Senior Data Engineer - PySpark, Databricks & AWS

J.P. MORGAN; Scotland; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading financial services firm in Scotland is seeking a skilled PySpark/AWS Data Engineer III to join their Payments Technology Regulatory Reporting team. This role requires over 3 years of hands-on experience and proficiency in Python, PySpark, and Databricks among other skills. The successful candidate will be responsible for developing secure cloud technology products and contributing to an agile team environment. This position values diversity and inclusion and offers opportunities for growth.

Qualifications

• 3+ years hands-on experience in system design and application development.
• Proficient in Python / PySpark / Databricks or similar.
• Solid understanding of software development life cycle.

Responsibilities

• Execute software solutions, design, and development.
• Produce architecture and design artifacts for applications.
• Identify problems in data to improve system architecture.

Skills

Data engineering languages/platforms (Python, PySpark, Databricks)

Relational and NoSQL databases

Agile methodologies (CI/CD, Application Resiliency, Security)

Tools

Databricks

AWS EC2

AWS S3

Job description

A leading financial services firm in Scotland is seeking a skilled PySpark/AWS Data Engineer III to join their Payments Technology Regulatory Reporting team. This role requires over 3 years of hands-on experience and proficiency in Python, PySpark, and Databricks among other skills. The successful candidate will be responsible for developing secure cloud technology products and contributing to an agile team environment. This position values diversity and inclusion and offers opportunities for growth.