Data Engineer - AWS, Snowflake & Big Data Pipelines

Regions Bank; Atlanta (GA); On-site; USD 115,000 - 146,000; Full time

Benefits offered by this job

Paid Vacation/Sick Time

401K with Company Match

Medical, Dental and Vision Benefits

Disability Benefits

Health Savings Account

Flexible Spending Account

Life Insurance

Parental Leave

Employee Assistance Program

Associate Volunteer Program

Job summary

Regions is seeking a Data Engineer to design, build, and optimize data structures and pipelines that power enterprise data assets. You will partner with Analytics and Data Product teams to create scalable data stores and robust data movement processes, leveraging Spark, Hadoop, Hive, Impala, and Kafka.

A strong emphasis on data quality, governance, and collaboration with business stakeholders is expected. The role requires advanced degrees with STEM focus and multiple years of Python/PySpark,

Qualifications

• Ph.D./Master’s/Bachelor’s in STEM with related experience in quantitative fields.
• 3+ years programming in Python/PySpark, Scala, SQL.
• 3+ years with Big Data tech: Hadoop, Hive, Impala, Spark, or Kafka.

Responsibilities

• Design, build, and maintain data structures and systems for Data & Analytics.
• Build data pipelines to collect, organize, and store data in a big data environment.
• Develop robust programs to move, transform, and load data using Spark and related tools.
• Collaborate with Data Products partners and data scientists to deploy data stores.
• Ensure data is prepared and ready for business use cases and visualizations.

Skills

Python/PySpark

Scala

SQL

No-SQL databases

DevOps CI/CD

Data modeling

Data pipelines

Education

Ph.D. in quantitative/analytical/STEM

Master’s in STEM

Bachelor’s in STEM

Tools

Hadoop

Hive

Impala

Spark

Kafka

Job description

Regions is seeking a Data Engineer to design, build, and optimize data structures and pipelines that power enterprise data assets. You will partner with Analytics and Data Product teams to create scalable data stores and robust data movement processes, leveraging Spark, Hadoop, Hive, Impala, and Kafka.

A strong emphasis on data quality, governance, and collaboration with business stakeholders is expected. The role requires advanced degrees with STEM focus and multiple years of Python/PySpark,