Data Engineer III

Talentify; Memphis (TN); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401k

Wellness program

Job summary

Stifel seeks a Data Engineer III to design, develop, and maintain data pipelines and infrastructure on the AWS platform to enable data-driven decision-making. You will work with large data volumes, ensure quality and accessibility, and implement security measures across data workflows.

You will partner with stakeholders to define data requirements, build scalable ETL solutions, and optimize performance while maintaining data governance and compliance with policies.

Qualifications

• Bachelor's degree in CS or related field, or equivalent experience.
• 7+ years of post-bachelor data engineering experience.
• Proficiency in Python and SQL.
• Strong knowledge of AWS data services (S3, Redshift, Aurora Postgres, Glue, Lambda, Step Functions, Lake Formation, DataZone, Kinesis, MSK, EMR).
• Experience with relational DBs and distributed storage (SQL Server, PostgreSQL, PySpark).
• Experience with ETL tools like AWS Glue and SSIS.
• Ability to integrate disparate data sources and ensure data quality.
• Familiarity with orchestration tools (Airflow, AWS Glue Workflows, Step Functions).
• Familiarity with IaC (Terraform), Git, and DevOps pipelines.
• Knowledge of data governance, privacy, and security.

Responsibilities

• Build and maintain scalable data pipelines in AWS to ensure smooth data flow from sources to destinations.
• Collaborate with stakeholders to understand data requirements and design solutions.
• Implement ETL processes to transform raw data into usable formats.
• Monitor, troubleshoot, and optimize data pipelines, ensuring quality and integrity.

Skills

Python

SQL

ETL

Education

Bachelor's Degree in Computer Science or related field

7+ years of post-bachelor data engineering experience

Tools

AWS Glue

Amazon S3

Amazon Redshift

Amazon Aurora Postgres

AWS Lambda

AWS Step Functions

AWS Lake Formation

Amazon DataZone

Amazon Kinesis

Amazon MSK

Amazon EMR

Apache Airflow

Terraform

Git

SQL Server

PostgreSQL

PySpark

Job description

The Data Engineer III is responsible for designing, developing, and maintaining data pipelines and infrastructure on the AWS platform. The Data Engineer III works with large volumes of data, ensuring its quality, reliability, and accessibility. Tasks may include data ingestion, transformation, storage, data sharing and consumption, and implementing data security and privacy measures. This role is crucial in enabling efficient and effective data-driven decision-making.

What We're Looking For

• Build and maintain scalable and reliable data pipelines, ensuring the smooth flow of data from various sources to the desired destinations in the AWS cloud environment.
• Work closely with stakeholders to understand their data requirements and design data solutions that meet their needs.
• Understand data models/schemas and implement ETL (Extract, Transform, and Load) processes to transform raw data into a usable format in the destination.
• Responsible for monitoring and optimizing the performance of data pipelines, troubleshooting any issues that arise, and ensuring data quality and integrity.

What You'll Bring

• Proficient in programming languages such as Python and SQL for database querying and manipulation.
• Strong understanding of AWS services related to data engineering, such as Amazon S3, Amazon Redshift, Amazon Aurora Postgres, AWS Glue, AWS Lambda, AWS Step Function, AWS Lake Formation, Amazon Data Zone, Amazon Kinesis, MSK, and Amazon EMR.
• Knowledge of database design principles and experience with database management systems.
• Experience with data storage technologies, such as relational databases (e.g., SQL Server, PostgreSQL) and distributed storage systems (e.g., PySpark).
• Understanding of Extract, Transform, Load (ETL) processes and experience with ETL tools like AWS Glue and SQL Server Integration Services is essential.
• Skilled at integrating disparate data sources and ensuring data quality and consistency.
• Understanding and experience with orchestration tools like Apache Airflow, AWS Glue Workflows, AWS Step Functions, and notification services.
• Familiarity with IAC, such as Terraform, git, and DevOps pipelines.
• Strong analytical thinking and problem-solving abilities are essential to effectively identify and resolve data-related issues.
• Ability to analyze complex data sets, identify patterns, and derive actionable insights.
• Awareness of data governance practices, data privacy regulations, and security protocols is crucial.
• Experience implementing data security measures and ensuring compliance with relevant standards is desirable.

Education & Experience

• Minimum Required: Bachelor's Degree in Computer Science, related field, or equivalent experience.
• Minimum Required: 7+ years of post-bachelor progressive experience in data engineering.

Licenses & Credentials

• Minimum Required: None.

Systems & Technology

• Proficient in the following computer languages:
  • Python
  • SQL
• AWS technologies to include:
  • Glue
  • S3
  • Redshift
  • Lambda
  • Lake Formation
  • DataZone

#LI-LL1

About Stifel

Stifel is more than 130 years old and still thinking like a start-up. We are a global wealth management and investment banking firm serious about innovation and fresh ideas. Built on a simple premise of safeguarding our clients' money as if it were our own, coined by our namesake, Herman Stifel, our success is intimately tied to our commitment to helping families, companies, and municipalities find their own success.

While our headquarters is in St. Louis, we have offices in New York, San Francisco, Baltimore, London, Frankfurt, Toronto, and more than 400 other locations. Stifel is home to approximately 9,000 individuals who are currently building their careers as financial advisors, research analysts, project managers, marketing specialists, developers, bankers, operations associates, among hundreds more. Let's talk about how you can find your place here at Stifel, where success meets success.

At Stifel we offer an entrepreneurial environment, comprehensive benefits package to include health, dental and vision care, 401k, wellness initiatives, life insurance, and paid time off.

Stifel is an Equal Opportunity Employer.