Lead Cloud Data Engineer

Raymond James Financial, Inc.; Saint Petersburg (FL); Hybrid; USD 140,000 - 190,000; Full time

Job summary

Raymond James Financial, Inc. seeks a Lead Cloud Data Engineer to design, implement, and optimize scalable ETL pipelines using AWS Glue, PySpark, and Amazon Redshift. You will mentor juniors and collaborate with data scientists and analysts to meet business needs in a hybrid work model (St.

Petersburg, FL core, 2–3 days onsite). You will deploy IaC with Terraform, ensure data quality, and explore new AWS services to improve solutions.

Qualifications

• Lead Cloud Data Engineer with strong design and implementation of ETL pipelines.
• Experience with AWS Glue, PySpark, and Redshift architecture.
• IaC (Terraform) and data quality across data platforms.
• Collaborate with data scientists, analysts, and stakeholders.
• Mentor junior engineers and promote best practices.

Responsibilities

• Design and develop scalable ETL pipelines using AWS Glue and PySpark.
• Integrate data from multiple sources into Amazon Redshift with quality checks.
• Optimize performance of data processing jobs and Redshift queries.
• Deploy infrastructure as code (Terraform) and monitor pipelines.
• Mentor teammates and document data workflows and standards.
• Explore new AWS services to improve existing solutions.

Skills

Python programming

ETL design

Data pipelines

Mentoring

Analytical thinking

Education

Bachelor's: Computer and Information Science

Tools

AWS Glue

PySpark

Amazon Redshift

Terraform

Python

Java

S3

Kafka

AirFlow

SageMaker

EMR

Athena

Lake Formation

DynamoDB

Aurora

VPC

IAM

Job description

Job Description SummaryWe are seeking a highly skilled Lead Cloud Data Engineer to join our team. The ideal candidate will have extensive experience with AWS Glue, PySpark, and Amazon Redshift. You will be responsible for designing, implementing, and optimizing data pipelines, ensuring data quality, and collaborating with cross-functional teams to meet business needs.Job DescriptionThis position will follow our hybrid work model, we expect the selected candidate to be in office 2-3 days a week(10-12 days a month ) at the following office location: St. Petersburg, FL/ Memphis, TN/ Denver, CO/Southfield, MIResponsibilities:Design and develop scalable ETL pipelines using AWS Glue and PySpark.Integrate data from various sources into Amazon Redshift, ensuring data quality and consistency.Optimize the performance of data processing jobs and Redshift queries.Deploy infrastructure as code (IaC) with TerraformMonitor and troubleshoot data pipelines to ensure reliability and efficiency.Collaborate with data scientists, analysts, and other stakeholders to understand data requirements.Ensure compliance with security policies and regulations.Document data workflows and best practices.Mentor and guide junior engineers on the team.Continuously explore new AWS services and technologies to improve existing solutions.Skills:Expert level experience with AWS Cloud Services is preferred, knowledge of other Cloud Providers is a plusExperience and understanding of AWS Cloud Services components like Redshift, S3, Kafka, Glue, AirFlow, SageMaker, EMR, Athena, Lake Formation, DynamoDB, Aurora, VPC, IAM and many other Cloud Service modules.Working experience in Python is preferred, Java and other languages are a plusNice to have Terraform or other Infrastructure as Code experienceKnowledge and experience with Analytics, Data Warehouse and Big Data concepts across both batch and streaming patternsSolid understanding of networking, infrastructure, cost management, SRE conceptsCreating patterns for adoption from scratch and being able to document and articulate coding and architecture standards for others to follow.Performance tuning and optimization of code and infrastructureCreating a culture of continuous improvement, performs code reviews and makes recommendations for improvement or streamlining patternsRelevant experience in various database platforms, ETL solutions/products, Infrastructure, ETL architecture and On-Prem or Cloud Services.Financial Services Industry knowledge is a plus.Ability to:Identify and understand issues, problems and opportunities for automation.Good communication and organization skills that clearly convey information and ideas through a variety of media to individuals or groups in a manner that engages the audience and helps them understand and retain the message.Use effective approaches for choosing a course of action or developing appropriate solutions; recommend or take action that is consistent with available facts, constraints and probable consequences.Demonstrate a satisfactory level of technical and professional skill or knowledge in position-related areas; remains current with developments and trends in areas of expertise.Develop and use collaborative relationships to facilitate the accomplishment of work goals.Make internal and external clients and their needs a primary focus of actions; develop and sustain productive client relationships.CertificationsPreferred , not required• AWS Certified Solutions Architect• AWS Certified Big Data• AWS Certified Data Analytics• AWS Certified Developer• AWS Certified Machine LearningEducationBachelor’s: Computer and Information Science (Required)Work ExperienceGeneral Experience - 6 to 10 yearsCertificationsTravelLess than 25%WorkstyleHybridThe total compensation for this position includes base salary or wages, and may include components such as additional compensation (cash or equity), discretionary bonuses, or commissions. This position is eligible for a benefits package that may include medical, dental, and vision; life insurance; critical illness insurance and accident insurance; disability benefits; retirement savings; paid time off (including vacation, holidays, and sick leave); and parental leave. Eligibility for benefits and specific offerings may vary based on position and employment status. To view more details of the benefits offered, visit Myrjbenefits.com.At Raymond James our associates use five guiding behaviors (Develop, Collaborate, Decide, Deliver, Improve) to deliver on the firm's core values of client-first, integrity, independence and a conservative, long-term view.We expect our associates at all levels to:• Grow professionally and inspire others to do the same• Work with and through others to achieve desired outcomes• Make prompt, pragmatic choices and act with the client in mind• Take ownership and hold themselves and others accountable for delivering results that matter• Contribute to the continuous evolution of the firmAt Raymond James – as part of our people-first culture, we honor, value, and respect the uniqueness, experiences, and backgrounds of all of our Associates. When associates bring their best authentic selves, our organization, clients, and communities thrive. The Company is an equal opportunity employer and makes all employment decisions on the basis of merit and business needs.#LI-SA1