Senior Python & Kafka Engineer - Observability & Lineage

Fujitsu; Dallas (TX); On-site; USD 132,000 - 141,000; Full time

Benefits offered by this job

Medical, Vision, and Dental Insurance

401k

Paid Time Off

Job summary

Fujitsu in Dallas seeks a hands-on Senior Python and Kafka Engineer to support a correctness-critical, event-driven digital repository processing platform. The role focuses on enhancing logging, event visibility, and delivery reliability within a live system.

You will implement OpenTelemetry-based telemetry and OpenLineage-inspired lineage concepts while integrating with PostgreSQL, MongoDB, object storage, and external APIs. Collaboration spans teams and Kubernetes-based deployments.

Qualifications

• Significant hands-on experience with Kafka-based production applications.
• Deep understanding of producer/consumer delivery semantics and offsets.
• Experience with retries, dead-letter processing and message reliability.
• Strong Python engineering skills, with maintainable, testable code.

Responsibilities

• Implement a structured JSON logging standard across Python services.
• Improve Kafka producer/consumer reliability and offset handling.
• Develop event lineage capabilities documenting processing stages and outcomes.
• Create reconciliation and completion-tracking to verify workflow progress.

Skills

Kafka

Python

Observability

PostgreSQL

OpenTelemetry

OpenLineage

Kubernetes

Grafana

Idempotent processing

Tools

MongoDB

AWS S3

Solr

Istio

PgBouncer

Airflow

Job description

Fujitsu in Dallas seeks a hands-on Senior Python and Kafka Engineer to support a correctness-critical, event-driven digital repository processing platform. The role focuses on enhancing logging, event visibility, and delivery reliability within a live system.

You will implement OpenTelemetry-based telemetry and OpenLineage-inspired lineage concepts while integrating with PostgreSQL, MongoDB, object storage, and external APIs. Collaboration spans teams and Kubernetes-based deployments.