Remote Senior Python & Kafka Reliability Engineer

Envision Technology Solutions; Boston (MA); On-site; USD 140,000 - 190,000; Full time

Job summary

Envision Technology Solutions seeks an experienced Senior Software Engineer to enhance an event-driven digital repository platform. The role focuses on observability, event lineage, and Kafka delivery reliability across a distributed microservices ecosystem built primarily on Python and Kafka.

You will collaborate with the client’s internal engineering team to implement solutions in a live production environment.

Qualifications

• 8 years of software engineering experience preferred.
• 3 years working with Kafka-based distributed systems.
• Experience in Kubernetes environments.
• Experience with observability and monitoring implementations.

Responsibilities

• Implement structured logging standards across Python-based services.
• Enhance Kafka consumer and producer reliability.
• Improve retry, recovery and dead-letter handling mechanisms.
• Design end-to-end event lineage and tracing capabilities.
• Develop reconciliation and completion tracking for workflows.
• Troubleshoot production issues related to event processing.
• Collaborate to improve observability and operational excellence.
• Contribute to distributed systems architecture decisions.

Skills

Python

Kafka

Concurrency & multithreading

API integrations

Testing (PyTest)

PostgreSQL

JSON/JSONB

Observability & logging

Distributed systems

Event-driven design

Tools

Kafka

PostgreSQL

Kubernetes

OpenTelemetry

Grafana

Job description

Envision Technology Solutions seeks an experienced Senior Software Engineer to enhance an event-driven digital repository platform. The role focuses on observability, event lineage, and Kafka delivery reliability across a distributed microservices ecosystem built primarily on Python and Kafka.

You will collaborate with the client’s internal engineering team to implement solutions in a live production environment.