AWS Cloud and Spark Architect

Globalchannelmanagement; Bloomington (IN); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading tech solution provider in Indiana is looking for an experienced AWS Cloud and Spark Architect to design and implement cloud-based applications. The ideal candidate must have over 7 years of expertise in AWS Cloud Computing and Spark, strong skills in Python and SQL, and past experience in DevOps and Agile methodologies. This role includes responsibilities like maintaining source code management practices and leading innovation within the project team.

Qualifications

• 7+ years of experience in Amazon Web Services (AWS) Cloud Computing.
• 10+ years of experience in development, design, and architecture.
• Strong knowledge in Python and PySpark.
• Healthcare knowledge is required.

Responsibilities

• Architect, design, code, and implement cloud-based Spark applications.
• Support existing code through enhancement, troubleshooting, and maintenance.
• Comply with CI/CD practices, participating in the creation of new methods.
• Lead innovation by exploring data-centric technologies.

Skills

AWS Cloud Computing

Python

PySpark

Spark Architecture

SQL

DevOps

Data Warehousing

Agile Methodology

Tools

Jenkins

Git

Jira

Job description

About the job

AWS Cloud and Spark Architect requires 7+ years of experience in Amazon Web Services (AWS) Cloud Computing. 7+ years of experience in AWS Cloud Computing is required; 10+ years of experience in development, design, architecture implementation, and analytics solutions. Hands-on development, design, setup, and development of applications using AWS, Python, PySpark, and Cloud. Very strong Spark architecture and development knowledge. 510 years of experience in Python and PySpark. At least 8+ years of experience on AWS (Glue, S3, Lambda at minimum). Skilled in Python core programming and Spark. Experience in DevOps building pipelines. Ability to design and demonstrate system architecture with different environments. Hands-on experience in Data Warehousing and SQL. Experience with Pandas. Strong expertise in SQL is required. Solid experience with Git software version control and good understanding of code branching strategies and organization for code reuse. Experience with DevOps & CI/CD tools Jenkins, CloudBees, Please Build, etc. Proficiency working with large data stores and data sets. Healthcare knowledge is a must. Agile methodology (Jira preferable).

AWS Cloud and Spark Architect duties

Must have capability to understand the current architecture. Architect, design, code, and implement cloud-based Spark applications. Support existing code through enhancement, troubleshooting, and maintenance as per requirements. Maintain consistent practices for source code management in GitHub. Comply with established CI/CD practices, and participate in the creation of new CI/CD methods. Attend daily scrum calls and actively participate in updating/creating user stories and tasks in Jira. Work closely with business analysts. Lead innovation by exploring, investigating, recommending, benchmarking, and implementing data-centric technologies for the platform. Collaborate within a project team to solve complex problems. Lead by example, coaching and mentoring peers, and guiding less experienced team members. Operate as part of the extended management team.