Senior Python Data Engineer — Remote (AWS/Kubernetes)

Smart Working; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Smart Working is seeking an experienced Data Engineer to design, build, and maintain robust data pipelines in Python on AWS. You will model and optimise data across PostgreSQL and NoSQL databases such as OpenSearch, Elasticsearch, and DynamoDB, and deploy services on Kubernetes with a DevOps/SRE colleague.

The role requires 6+ years in software engineering, with 5+ years in Python and at least 3 years in data pipelines, AWS, and Kubernetes.

Qualifications

• 6+ years of software engineering experience, including 5+ years of commercial Python development.
• 3+ years of experience in data pipelines and data engineering, including ETL/ELT and batch processing.
• 3+ years of AWS experience and 2+ years of Kubernetes experience.

Responsibilities

• Design, build and maintain reliable data pipelines in Python on AWS.
• Model, query and optimise data across PostgreSQL and search/NoSQL databases including OpenSearch, Elasticsearch, and DynamoDB.
• Deploy and run services on Kubernetes, working alongside the DevOps engineer.

Skills

Python development

AWS

Data pipelines

PostgreSQL

OpenSearch/Elasticsearch/DynamoDB

Kubernetes

ETL/ELT

Testing/Data quality

Tools

OpenSearch

Elasticsearch

DynamoDB

PostgreSQL

Kubernetes

Job description

Smart Working is seeking an experienced Data Engineer to design, build, and maintain robust data pipelines in Python on AWS. You will model and optimise data across PostgreSQL and NoSQL databases such as OpenSearch, Elasticsearch, and DynamoDB, and deploy services on Kubernetes with a DevOps/SRE colleague.

The role requires 6+ years in software engineering, with 5+ years in Python and at least 3 years in data pipelines, AWS, and Kubernetes.