AWS Data Engineer

Navisoft; Des Moines (IA); Hybrid; USD 110,000 - 150,000; Full time

Job summary

Navisoft is seeking an AWS Data Engineer to design, code, test, debug, document, and implement changes to new and existing software applications. You will ensure quality, manage escalations, develop solutions, execute unit tests, and participate in Agile/Scrum ceremonies.

The role requires ETL and data warehousing experience, Python 3.x, handling data from diverse sources, and AWS expertise with boto3 and CloudFormation.

Qualifications

• Experience with ETL and Data Warehousing concepts.
• Strong hands-on experience in Python 3.x.
• Experience handling and transforming data from various sources (flat files, databases, APIs, XMLs) using Python.
• Knowledge of OOP concepts, inheritance, classes, and functions.
• Experience in data analysis, engineering, and solutioning.
• Strong experience with AWS services and architecture development using boto3 and CloudFormation.
• Experience with scheduling tools (Control-M preferred), databases (PostgreSQL preferred), and SQL.
• Proficiency with Git.
• Experience with AWS services (CloudFormation, IAM, S3, EC2, Lambda, Athena, DynamoDB, Step Functions, Event Bridge, Fargate).
• Experience with CI/CD pipelines and DevOps tools (Jenkins, GitHub/BitBucket, Artifactory).
• Experience with containerization (Docker/Kubernetes).

Responsibilities

• Design, code, test, debug, document, and implement changes to new and existing software applications.
• Ensure quality and controls are in place, manage escalations, and develop solutions.
• Execute unit/string testing and potentially create development unit/string test plans.
• Partner with QA to ensure software applications meet IT standards and business requirements.
• Participate in design and coding of software applications as part of a team.
• Coordinate code deployments with Change Management, resolve complex software issues, and address production issues.
• Participate in Agile/Scrum meetings.

Skills

Python

ETL

Data Warehousing

AWS Cloud Computing

OOP concepts

CI/CD

DevOps

Tools

Docker

Kubernetes

Git

Jenkins

GitHub/Bitbucket

Artifactory

CloudFormation

boto3

PostgreSQL

SQL

Control-M

Job description

Design, code, test, debug, document, and implement changes to new and existing software applications. Ensure quality and controls are in place, manage escalations, and develop solutions. Execute unit/string testing and potentially create development unit/string test plans. Partner with QA to ensure software applications meet IT standards and business requirements. Participate in design and coding of software applications as part of a team. Coordinate code deployments with Change Management, resolve complex software issues, generate reports for business use, address critical production issues, and participate in Agile/Scrum meetings.

• Experience with ETL and Data Warehousing concepts.
• Strong hands-on experience in Python 3.x.
• Experience handling and transforming data from various sources (flat files, databases, APIs, XMLs) using Python.
• Knowledge of OOP concepts, inheritance, classes, and functions.
• Experience in data analysis, engineering, and solutioning.
• Strong experience with AWS services and architecture development using boto3 and CloudFormation.
• Experience with scheduling tools (Control-M preferred), databases (PostgreSQL preferred), and SQL.
• Proficiency with Git.
• Experience with AWS services (CloudFormation, IAM, S3, EC2, Lambda, Athena, DynamoDB, Step Functions, Event Bridge, Fargate).
• Experience with CI/CD pipelines and DevOps tools (Jenkins, GitHub/BitBucket, Artifactory).
• Experience with containerization (Docker/Kubernetes).

Competencies: Python, Amazon Web Service (AWS) Cloud Computing, Actuarial - Life & Pensions

AWS Data Engineer

Design, code, test, debug, document, and implement changes to new and existing software applications. Ensure quality and controls are in place, manage escalations, and develop solutions. Execute unit/string testing and potentially create development unit/string test plans. Partner with QA to ensure software applications meet IT standards and business requirements. Participate in design and coding of software applications as part of a team. Coordinate code deployments with Change Management, resolve complex software issues, generate reports for business use, address critical production issues, and participate in Agile/Scrum meetings.

Essential Skills:

• Experience with ETL and Data Warehousing concepts.
• Strong hands-on experience in Python 3.x.
• Experience handling and transforming data from various sources (flat files, databases, APIs, XMLs) using Python.
• Knowledge of OOP concepts, inheritance, classes, and functions.
• Experience in data analysis, engineering, and solutioning.
• Strong experience with AWS services and architecture development using boto3 and CloudFormation.
• Experience with scheduling tools (Control-M preferred), databases (PostgreSQL preferred), and SQL.
• Proficiency with Git.
• Experience with AWS services (CloudFormation, IAM, S3, EC2, Lambda, Athena, DynamoDB, Step Functions, Event Bridge, Fargate).
• Experience with CI/CD pipelines and DevOps tools (Jenkins, GitHub/BitBucket, Artifactory).
• Experience with containerization (Docker/Kubernetes).

Competencies: Python, Amazon Web Service (AWS) Cloud Computing, Actuarial - Life & Pensions

Please note: F1 OPT candidates are not eligible for this role

Required Skills

ETL Data Warehousing Python AWS boto3 CloudFormation Control-M PostgreSQL SQL Git Jenkins GitHub BitBucket Artifactory Docker Kubernetes