Senior Software Engineer - Event-Driven, Scalable Pipelines

VT Group (VTG); Herndon (VA); On-site; USD 120,000 - 170,000; Full time

Job summary

VT Group (VTG) is seeking an experienced Software Development Engineer to design, develop, and enhance scalable event-driven and distributed software systems supporting complex data pipelines. The role focuses on building modular architectures with robust observability, fault tolerance, and real-time alerting across multiple data domains.

You will design backend services in Python, implement Kafka-based messaging, and build dashboards with Grafana and ELK Stack to monitor system health.

Qualifications

• Bachelor's degree in a technical field or equivalent practical experience.
• Strong Python development experience.
• Experience with asynchronous programming and concurrency in Python.
• Hands-on experience with Kafka or similar distributed messaging technologies.
• Knowledge of distributed systems and event-driven architectures.
• Experience with JSON and structured data.
• Experience implementing observability and monitoring solutions.
• Hands-on experience with Grafana and the ELK Stack.
• Experience developing scalable data-processing pipelines.

Responsibilities

• Design and develop scalable event-driven architectures supporting high-volume data pipelines and distributed systems.
• Develop backend services and applications using Python, including asynchronous and concurrent programming techniques.
• Design and implement distributed messaging and event-processing solutions using Kafka.
• Build modular software architectures that can easily integrate new data formats, sources, and domains.
• Develop frameworks that provide granular tracking and monitoring of events throughout data pipelines.
• Design and implement fault-tolerant systems that maintain reliability and availability across distributed environments.
• Implement access control and access management capabilities within event-driven architectures.
• Develop solutions for real-time alerting, event tracking, and digital record keeping.
• Implement observability capabilities using Grafana and the ELK Stack.
• Build dashboards and monitoring solutions that provide visibility into application and system health.
• Develop and maintain interfaces utilizing JSON for structured data interchange.
• Troubleshoot distributed application and data-pipeline issues and identify opportunities to improve performance and reliability.
• Apply modular software design principles to improve system maintainability, scalability, and extensibility.
• Collaborate with engineering and data teams to expand architectures to support additional data domains and formats.

Skills

Python development

Asynchronous programming

Concurrency

Distributed systems

Event-driven architecture

Observability/Monitoring

JSON data interchange

Troubleshooting distributed systems

Education

Bachelor's degree in Computer Science or related field

Tools

Kafka

Grafana

ELK Stack

Job description

VT Group (VTG) is seeking an experienced Software Development Engineer to design, develop, and enhance scalable event-driven and distributed software systems supporting complex data pipelines. The role focuses on building modular architectures with robust observability, fault tolerance, and real-time alerting across multiple data domains.

You will design backend services in Python, implement Kafka-based messaging, and build dashboards with Grafana and ELK Stack to monitor system health.