Senior Cloud Data Engineer: AWS Glue, PySpark & Redshift

Raymond James; Memphis (TN); Hybrid; USD 120,000 - 180,000; Full time

Benefits offered by this job

Medical, Dental, Vision

Life Insurance

Retirement Savings

PTO & Holidays

Parental Leave

Job summary

Raymond James is seeking a Lead Cloud Data Engineer to design, implement, and optimize data pipelines using AWS Glue, PySpark, and Amazon Redshift. This hybrid role requires coordinating with cross-functional teams in various locations to meet business needs.

The ideal candidate will mentor junior engineers, ensure data quality, and continuously explore AWS services to improve solutions. Bachelor’s in CS and 6–10 years of experience are preferred.

Qualifications

• Bachelor’s degree in Computer Science or related field is required.
• 6–10 years of general experience in data engineering or related roles.
• Experience designing, implementing, and optimizing data pipelines using AWS services.

Responsibilities

• Design and develop scalable ETL pipelines using AWS Glue and PySpark.
• Integrate data from multiple sources into Amazon Redshift with quality control.
• Optimize performance of data processing jobs and Redshift queries.
• Deploy infrastructure as code (IaC) with Terraform.
• Monitor, troubleshoot, and ensure reliability of data pipelines.
• Collaborate with data scientists and analysts to meet data requirements.
• Document data workflows and best practices.
• Mentor junior engineers on the team.

Skills

AWS Glue

PySpark

Amazon Redshift

AWS Cloud Services

Python

Terraform

Data Warehousing

ETL Pipelines

Education

Bachelor’s in Computer Science or related field

Tools

Terraform

AirFlow

SageMaker

Kafka

DynamoDB

Job description

Raymond James is seeking a Lead Cloud Data Engineer to design, implement, and optimize data pipelines using AWS Glue, PySpark, and Amazon Redshift. This hybrid role requires coordinating with cross-functional teams in various locations to meet business needs.

The ideal candidate will mentor junior engineers, ensure data quality, and continuously explore AWS services to improve solutions. Bachelor’s in CS and 6–10 years of experience are preferred.