Senior Data Engineer, AWS Data Pipelines & Analytics

Talentify; Memphis (TN); On-site; USD 110,000 - 150,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Vision insurance

401k

Wellness program

Job summary

Stifel seeks a Data Engineer III to design, develop, and maintain data pipelines and infrastructure on the AWS platform to enable data-driven decision-making. You will work with large data volumes, ensure quality and accessibility, and implement security measures across data workflows.

You will partner with stakeholders to define data requirements, build scalable ETL solutions, and optimize performance while maintaining data governance and compliance with policies.

Qualifications

• Bachelor's degree in CS or related field, or equivalent experience.
• 7+ years of post-bachelor data engineering experience.
• Proficiency in Python and SQL.
• Strong knowledge of AWS data services (S3, Redshift, Aurora Postgres, Glue, Lambda, Step Functions, Lake Formation, DataZone, Kinesis, MSK, EMR).
• Experience with relational DBs and distributed storage (SQL Server, PostgreSQL, PySpark).
• Experience with ETL tools like AWS Glue and SSIS.
• Ability to integrate disparate data sources and ensure data quality.
• Familiarity with orchestration tools (Airflow, AWS Glue Workflows, Step Functions).
• Familiarity with IaC (Terraform), Git, and DevOps pipelines.
• Knowledge of data governance, privacy, and security.

Responsibilities

• Build and maintain scalable data pipelines in AWS to ensure smooth data flow from sources to destinations.
• Collaborate with stakeholders to understand data requirements and design solutions.
• Implement ETL processes to transform raw data into usable formats.
• Monitor, troubleshoot, and optimize data pipelines, ensuring quality and integrity.

Skills

Python

SQL

ETL

Education

Bachelor's Degree in Computer Science or related field

7+ years of post-bachelor data engineering experience

Tools

AWS Glue

Amazon S3

Amazon Redshift

Amazon Aurora Postgres

AWS Lambda

AWS Step Functions

AWS Lake Formation

Amazon DataZone

Amazon Kinesis

Amazon MSK

Amazon EMR

Apache Airflow

Terraform

Git

SQL Server

PostgreSQL

PySpark

Job description

Stifel seeks a Data Engineer III to design, develop, and maintain data pipelines and infrastructure on the AWS platform to enable data-driven decision-making. You will work with large data volumes, ensure quality and accessibility, and implement security measures across data workflows.

You will partner with stakeholders to define data requirements, build scalable ETL solutions, and optimize performance while maintaining data governance and compliance with policies.