System Engineer-Platform/Kafka/Messaging (Onsite Role)

O'Reilly Technology Services, Inc.

United States

On-site

USD 120,000 - 160,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Stock Purchase Plan
401k with Employer Contributions
Medical/Dental/Vision Insurance
FSA (Flexible Spending Account)
Wellbeing Programs
Tuition Assistance
Career Growth Opportunities

Job summary

O’Reilly Auto Parts seeks a senior Messaging Platform Engineer to design, operate, and modernize scalable messaging platforms like Kafka and Pub/Sub. You will govern topics, schemas, connectors, and streams, while building secure, compliant, and observable infrastructure.

The role emphasizes CI/CD, GitOps, multi-region replication, and strong collaboration across engineering teams. A focus on security, PCI/HIPAA alignment, and developer enablement is essential.

Qualifications

  • 3+ years with enterprise messaging platforms (Kafka, Pub/Sub).
  • Experience designing high-throughput, low-latency event-driven systems with governance, topic management, and access control.
  • Hands-on experience with GCP messaging services (Pub/Sub, Eventarc) and hybrid architectures, including secure connectivity, IAM, and multi-region designs.
  • Proficiency in Infrastructure as Code and automation using Terraform, Kubernetes/Helm, and CI/CD tools, with GitOps-based configuration management.
  • Solid background in security and compliance, including encryption (TLS/mTLS), authentication (SASL, IAM), and regulatory standards (PCI, SOC2, HIPAA).
  • Experience implementing observability with Prometheus, Grafana, ELK, and GCP tools, including monitoring lag, throughput, and distributed tracing.
  • Strong performance tuning and reliability practices, including scaling, backpressure handling, DLQs, retries, and cross-region replication.
  • Focus on developer enablement through reusable tools, self-service platforms, schema governance, and event-driven best practices.
  • Ability to evaluate and prototype messaging technologies (e.g., Pulsar, RabbitMQ), lead POCs, and drive adoption of modern streaming and data integration patterns.

Responsibilities

  • Design and operate scalable messaging platforms (Kafka, Pub/Sub) for high-throughput, low-latency streaming.
  • Manage topics, schemas, connectors, and stream processing with Kafka Streams/KSQLDB.
  • Enforce governance for naming, retention, access control, and multi-tenancy with reliable delivery.
  • Automate messaging infra using Terraform, Helm, Kubernetes, with Git-based config management.
  • Build CI/CD pipelines for deployments, upgrades, and topic provisioning with drift detection.
  • Implement secure messaging with IAM integration (GCP, LDAP), TLS/mTLS, ACLs and compliance controls.
  • Establish observability via Prometheus, Grafana, ELK, and GCP tooling; monitor SLAs, consumer lag, and broker health.
  • Lead incident response, RCA, and disaster recovery planning; drive cross-region replication strategies.
  • Enable developers with reusable connectors, SDKs, and self-service tools; guide schema evolution and idempotency.

Skills

Enterprise messaging platforms
Kafka architecture
GCP Pub/Sub experience
Terraform & Kubernetes
Security & compliance
Observability tooling
Event-driven patterns

Tools

Kafka
Pub/Sub
Strimzi
Kubernetes
Terraform
Helm
Prometheus
Grafana
ELK
Dataflow

Job description

Responsibilities and Duties
  • Messaging Platform Engineering Design and operate scalable messaging platforms (Kafka, Pub/Sub, legacy MQ) supporting high-throughput, low-latency event streaming.
  • Manage topics, schemas (Avro/JSON/Protobuf), connectors, and stream processing (Kafka Streams/KSQLDB).
  • Enforce governance for naming, retention, access control, and multi-tenancy, while ensuring reliable delivery (retries, DLQs, idempotency, exactly-once).
  • Infrastructure as Code & Automation Automate messaging infrastructure using Terraform, Helm, and Kubernetes (e.g., Strimzi), with Git-based configuration management.
  • Build CI/CD pipelines for deployments, upgrades, and topic provisioning, including drift detection and self-healing workflows.
  • Security & Governance Implement secure messaging with IAM integration (GCP, LDAP, Kerberos), TLS/mTLS, and ACLs.
  • Align with compliance standards (PCI, HIPAA) and Zero Trust principles, including data classification, logging, and anomaly detection.
  • Monitoring & Reliability Establish observability using Prometheus, Grafana, ELK, or GCP tools.
  • Monitor SLAs/SLOs, consumer lag, broker health, and replication.
  • Lead incident response, RCA, and disaster recovery planning.
  • Integration & Developer Enablement Enable teams with reusable connectors, SDKs, and event-driven patterns.
  • Provide guidance on schema evolution, idempotency, and domain-driven event design, supported by self-service tools and documentation.
  • Platform Modernization & Migration Drive migration from legacy systems to modern streaming platforms, evaluating new technologies (e.g., Pulsar, Redpanda).
  • Lead migration strategies, dual-write patterns, and multi-region replication.
  • Collaboration & Leadership Collaborate with cross-functional teams on architecture and governance, contribute to event-driven and data mesh strategies, and mentor engineers while promoting best practices.
Skills:
Required:
  • 3+ years with enterprise messaging platforms (Kafka, Pub/Sub), including deep knowledge of Kafka architecture (brokers, partitions, replication, schema management, streams, and connectors).
  • Strong experience designing high-throughput, low-latency event-driven systems with governance, topic management, and access control.
  • Hands-on experience with GCP messaging services (Pub/Sub, Eventarc) and hybrid architectures, including secure connectivity, IAM, and multi-region designs.
  • Proficiency in Infrastructure as Code and automation using Terraform, Kubernetes/Helm, and CI/CD tools, with GitOps-based configuration management.
  • Solid background in security and compliance, including encryption (TLS/mTLS), authentication (SASL, IAM), and regulatory standards (PCI, SOC2, HIPAA).
  • Experience implementing observability with Prometheus, Grafana, ELK, and GCP tools, including monitoring lag, throughput, and distributed tracing.
  • Strong performance tuning and reliability practices, including scaling, backpressure handling, DLQs, retries, and cross-region replication.
  • Focus on developer enablement through reusable tools, self-service platforms, schema governance, and event-driven best practices.
  • Ability to evaluate and prototype messaging technologies (e.g., Pulsar, RabbitMQ), lead POCs, and drive adoption of modern streaming and data integration patterns.
Desired:
  • Experience running Kafka on Kubernetes (Strimzi/Confluent Operator), including scaling, configuration, and multi-tenant architectures.
  • Strong foundation in event-driven architecture, microservices communication, and asynchronous messaging patterns.
  • Hands-on experience with real-time processing tools (Kafka Streams, Flink, Spark) and Kafka Connect integrations (Debezium, JDBC, Elasticsearch).
  • Proficiency in schema management (Avro, Protobuf) and schema registries (Confluent, Apicurio).
  • Familiarity with Docker, Kubernetes (GKE), and service mesh technologies (Istio, Linkerd) for secure, cloud-native deployments.
  • Experience with cloud messaging and analytics tools (GCP Pub/Sub, Dataflow) and migrating from legacy systems (e.g., IBM MQ, RabbitMQ).
  • Strong knowledge of security and access control (ACLs, SASL/SCRAM, Kerberos, IAM) and message delivery semantics (at-least-once, exactly-once).
  • Experience with observability (Prometheus, Grafana, GCP Monitoring), CI/CD automation for Kafka resources, and data governance tools (Dataplex, Collibra).
  • Industry experience, certifications, and ability to lead design discussions, mentor teams, and work within agile environments.
Total Compensation Package:
  • Competitive Wages & Paid Time Off
  • Stock Purchase Plan & 401k with Employer Contributions
  • Starting Day One Medical, Dental, & Vision Insurance with Optional Flexible Spending Account (FSA)
  • Team Member Health/Wellbeing Programs
  • Tuition Educational Assistance Programs
  • Opportunities for Career Growth

O’Reilly Auto Parts has a proven track record of growth and stability. O’Reilly is full of successful career stories and believes in a strong promote-from-within philosophy, encouraging you to grow your career along with the organization.

O’Reilly Auto Parts is an equal opportunity employer. The Company does not discriminate on the basis of race, religion, color, national origin or ancestry (including immigration status or citizenship), sex, sexual orientation, gender identity, pregnancy (including childbirth, lactation, and related medical conditions,) age (40 and over), veteran status, uniformed service member status, physical or mental disability, genetic information (including testing or characteristics) or another protected status as defined by local, state, or federal law, as applicable. Qualified individuals with a disability may be entitled to reasonable accommodation under the Americans with Disabilities Act. If you require a reasonable accommodation during the application or employment process, please send an email to: rar@oreillyauto.com or call 417-862-2674, ext. 68901, and provide your requested accommodation, and position details. Consistent with internal policy and applicable law, the Company electronically monitors the use of Company-provided systems, including telephone conversations and transmissions, Internet access and usage, and electronic mail and transmissions. The Company additionally employs video cameras in common internal and external areas.

Your first job at O’Reilly Auto Parts is just the beginning! From a comprehensive benefits and compensation package to a rewarding and positive work environment, your leaders will support you and foster your development so you can grow with the company. Our promote-from-within philosophy means our top leaders worked their way up – and you can, too. Learn more about our culture, benefits, and history at oreillyauto.com/careers.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal Software Engineer - E-commerce (Onsite Position)
Principal Software Engineer - E-commerce (Onsite Position)

O'Reilly Technology Services, Inc. • United States

On-site
USD 180,000 - 240,000
Competitive wages
Stock purchase plan
Health benefits
+3
System Engineer-Platform/Kafka/Messaging (Onsite Role)
System Engineer-Platform/Kafka/Messaging (Onsite Role)

oreillyauto • Headquarters (ID)

On-site
USD 120,000 - 170,000
Medical, Dental, & Vision Insurance
401k with employer contributions
Stock Purchase Plan
+2
Sr Product Analyst (Retail Systems) (Onsite Role)
Sr Product Analyst (Retail Systems) (Onsite Role)

O'Reilly Auto Parts • United States

On-site
USD 90,000 - 120,000
Sr Business Systems Analyst (Onsite Role)
Sr Business Systems Analyst (Onsite Role)

O'Reilly Technology Services, Inc. • United States

On-site
USD 90,000 - 130,000
Competitive wages
Paid Time Off
401k with employer contributions
+3
Supervisor - Transportation
Supervisor - Transportation

O'Reilly Auto Parts • Oklahoma City (OK)

On-site
USD 60,000 - 85,000
Stock Purchase Plan
401k with Employer Contributions
Starting Day One Medical, Dental, &amp
+3
Customer Data Enablement Specialist
Customer Data Enablement Specialist

O'Reilly Auto Parts • United States

On-site
USD 90,000 - 130,000
Competitive Wages
Paid Time Off
Stock Purchase Plan & 401k
+4
Senior Site Reliability Engineer (Onsite Role)
Senior Site Reliability Engineer (Onsite Role)

O'Reilly Auto Parts • United States

On-site
USD 120,000 - 190,000
Competitive wages
401k with employer contributions
Medical, dental, and vision insurance
+3
Customer Data Enablement Specialist
Customer Data Enablement Specialist

O'Reilly Auto Parts • Springfield (MO)

On-site
USD 75,000 - 105,000
Competitive wages
401k with employer contributions
Medical, Dental, & Vision Insurance
+2
Security Operations Center Lead (Onsite Role)
Security Operations Center Lead (Onsite Role)

O'Reilly Technology Services, Inc. • United States

On-site
USD 100,000 - 140,000
Paid time off
401k with employer contributions
Medical, dental and vision insurance
+3
Information Security Administrator II (Onsite Role)
Information Security Administrator II (Onsite Role)

O'Reilly Auto Parts • United States

On-site
USD 60,000 - 80,000
Competitive wages
401k with employer contributions
Day One medical, dental & vision
+2