Senior Backend Developer – Python, PostgreSQL, Kafka

Agriness

United States

Remote

USD 110,000 - 180,000

Full time

7 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Agriness is seeking an experienced engineer to develop and maintain a Python service that processes Kafka events and stores data in PostgreSQL. You will optimize SQL, ensure reliable event processing, and investigate incidents with a test-driven approach.

You will review code, collaborate with the Data Tech Lead, and help deliver end-to-end data solutions in a remote-friendly environment. The role requires strong production experience with Python, advanced PostgreSQL SQL, Kafka,

Qualifications

  • Proven experience with Python services in production environments.
  • Advanced PostgreSQL SQL development including CTEs and window functions.
  • Experience with Kafka or similar messaging systems (RabbitMQ, SQS, Pub/Sub).
  • Docker and Kubernetes in modern data pipelines.
  • Automated testing with pytest, including integration tests with real databases.
  • Strong observability using Grafana, Loki, and Prometheus.
  • Ability to review AI-assisted code and provide critical feedback.
  • English reading proficiency for technical material.
  • Interest in agribusiness and remote-work capability.

Responsibilities

  • Develop and maintain a Python service that consumes Kafka events and writes/transforms data in PostgreSQL.
  • Write, review, and optimize complex SQL queries with performance considerations.
  • Ensure event-flow consistency: offset management, idempotency, duplicates, ordering, and reprocessing.
  • Investigate production incidents using logs, metrics, and alerts; drive fixes with regression tests.
  • Perform reprocessing and historical data migrations with care for production environments.
  • Review team code, including AI-assisted code, and participate in peer reviews.

Skills

Python development
Kafka
Advanced SQL
Automated testing (pytest)
Code review
Observability
Docker
Kubernetes
Git
AI-assisted development review
English reading
Event-driven architecture
Production incident investigation

Tools

PostgreSQL
Kafka
MongoDB
Grafana
Loki
Prometheus
ArgoCD
Vault
Docker
Git
pytest

Job description

  • Develop and maintain a Python service that consumes Kafka events and writes and transforms data in PostgreSQL
  • Write, review, and optimize calculation and aggregation SQL, assessing performance and impact on large tables
  • Ensure event-flow consistency, including offset management, idempotency, duplicates, ordering, and reprocessing
  • Investigate production incidents and inconsistencies using logs, metrics, and alerts; identify root causes and fix them with regression tests
  • Conduct reprocessing, recalculations, and historical data migrations using the service's tools, with care for the production environment
  • Review the team's code, including code written with AI assistance, and have your own code reviewed
  • Document workflows, decisions, and diagnostic procedures
  • Work with the Data Tech Lead and the team to deliver end-to-end solutions, from investigation through production fixes, always supported by testing
  • Strong production experience with Python in services, workers, or long-term maintained pipelines
  • Advanced SQL in PostgreSQL: complex queries with CTEs, window functions, and aggregations; upserts; and execution-plan analysis
  • Knowledge of database transactions and concurrency: isolation levels, locks, and what happens when two processes write at the same time
  • Experience with Kafka or another messaging platform (RabbitMQ, SQS, Pub/Sub), including an understanding of offsets, duplicates, and reprocessing
  • Automated testing with pytest, including tests using real databases and messaging systems
  • Experience investigating and resolving production issues
  • Docker and Git as part of your workflow
  • English proficiency for technical reading
  • Clear communication of decisions, risks, and outcomes
  • Production experience with Kafka
  • MongoDB
  • Property-based testing (Hypothesis or similar)
  • Kubernetes, GitOps (ArgoCD), and secrets management (Vault)
  • Observability with Grafana, Loki, and Prometheus
  • Event-driven architecture
  • Use of AI assistants in development, with critical review of generated output
  • Interest in or experience with agribusiness
  • Remote work
  • Open to people with disabilities
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Python Backend Engineer — Kafka, PostgreSQL, Remote
Senior Python Backend Engineer — Kafka, PostgreSQL, Remote

Agriness • United States

Remote
USD 110,000 - 180,000
Senior Python Developer
Senior Python Developer

Veriipro • Charlotte (NC)

On-site
USD 120,000 - 170,000
Sr. Backend Engineer – Python/Java & Kafka C2C contract
Sr. Backend Engineer – Python/Java & Kafka C2C contract

Tech Mirrors • Bellevue (WA)

On-site
USD 140,000 - 180,000
Senior Python Engineer - Data ( Remote, Full-Time) [AS340]
Senior Python Engineer - Data ( Remote, Full-Time) [AS340]

Smart Working Solutions • United States

Remote
USD 140,000 - 190,000
Senior Backend Engineer (Go/Python)
Senior Backend Engineer (Go/Python)

BearPlex • United States

Remote
USD 180,000 - 240,000
Fully remote work
Learning budget
Path toward technical leadership
Senior Backend Software Engineer
Senior Backend Software Engineer

Confero • New York (NY)

On-site
USD 120,000 - 180,000
Kafka DevOps Engineer
Kafka DevOps Engineer

EITACIES Inc. • San Francisco (CA)

On-site
USD 120,000 - 150,000
Company parties
Health insurance
Opportunity for advancement
Backend Developer, GraphQL, Kafka
Backend Developer, GraphQL, Kafka

Bitovi • United States

Remote
USD 140,000 - 190,000
Remote work
Annual bonus opportunity
401(k) matching
+1
Senior Data Software Engineer with Kafka
Senior Data Software Engineer with Kafka

EPAM Systems • United States

Remote
USD 140,000 - 200,000
Senior Engineer II, Python
Senior Engineer II, Python

Robotic Technologies Automation • Seattle (WA)

On-site
USD 150,000 - 190,000