AWS Native Developer

TechDigital Group; New Jersey; Hybrid; USD 80,000 - 130,000; Full time

Job summary

An innovative firm is seeking a skilled data engineer to design and maintain scalable data pipelines in AWS. This role involves developing Python applications to handle large datasets and collaborating with data scientists to deploy machine learning models. You will also manage cloud infrastructure using Terraform and ensure the smooth operation of data workflows. If you are passionate about cloud technologies and data engineering, this is a fantastic opportunity to make a significant impact in a forward-thinking environment.

Qualifications

• Strong expertise in Python and AWS services for data management.
• Experience with Terraform for cloud infrastructure management.

Responsibilities

• Design and maintain scalable data pipelines for AWS cloud environments.
• Collaborate with data scientists to manage ML models and data workflows.

Skills

Python

AWS (DMS, Glue, Lambda, Athena, Opensearch, DynamoDB, DocumentDB)

Git

SQL and NoSQL

Docker

Kubernetes

Terraform

Job description

Primary Skill: Python, AWS (DMS, Glue, Lambda, Athena, Opensearch, DynamoDB, DocumentDB)
Secondary Skill: Git, SQL and NoSQL, Docker, Kubernetes, Terraform

Location: US – Remote

Job Description:

• Design, implement, and maintain scalable data pipelines that integrate both on-prem and AWS cloud environments.
• Develop efficient Python scripts and applications using libraries like pandas, NumPy, etc., to handle and process large datasets.
• Collaborate with data scientists to build, deploy, and manage machine learning models and data classification systems.
• Ensure smooth integration of ML models into production by setting up and managing MLOps pipelines and practices.
• Write and maintain Terraform code to provision and manage cloud infrastructure, ensuring a consistent and reliable environment.
• Work with various NoSQL databases (e.g., MongoDB, Cassandra, DynamoDB) to support high-performance data storage and retrieval.
• Develop and deploy applications in a cloud-native architecture, leveraging modern cloud technologies for scalability and resilience.
• Continuously monitor data workflows and systems, troubleshoot issues, and optimize performance for reliability and scalability.