Lead Cloud Data Engineer - AWS Glue & Redshift Expert

Raymond James; Saint Petersburg (FL); Hybrid; USD 140,000 - 180,000; Full time

Job summary

Raymond James is seeking a Lead Cloud Data Engineer to design, implement, and optimize data pipelines using AWS Glue, PySpark, and Amazon Redshift. You will collaborate with cross-functional teams to ensure data quality and align solutions with business needs.

The role requires strong Python experience, IaC with Terraform, and a solid grasp of data warehousing, streaming patterns, and cloud architecture. Hybrid work model with in-office days in St. Petersburg, FL.

Qualifications

• Design and develop scalable ETL pipelines using AWS Glue and PySpark.
• Integrate data from multiple sources into Amazon Redshift with quality checks.
• Deploy IaC using Terraform and monitor data pipelines for reliability.
• Collaborate with data scientists and analysts to meet data requirements.
• Ensure compliance with security policies and regulations.

Responsibilities

• Mentor and guide junior engineers on the team.
• Monitor and troubleshoot data pipelines for reliability and efficiency.
• Document data workflows and best practices.
• Continuously explore new AWS services and technologies.

Skills

Python

PySpark

ETL design

Data modeling

SQL

Cloud architecture

Communication

Education

Bachelors in Computer and Information Science

Tools

Terraform

AWS

Amazon Redshift

S3

AirFlow

Kafka

DynamoDB

VPC

IAM

Job description

Raymond James is seeking a Lead Cloud Data Engineer to design, implement, and optimize data pipelines using AWS Glue, PySpark, and Amazon Redshift. You will collaborate with cross-functional teams to ensure data quality and align solutions with business needs.

The role requires strong Python experience, IaC with Terraform, and a solid grasp of data warehousing, streaming patterns, and cloud architecture. Hybrid work model with in-office days in St. Petersburg, FL.