Senior DevOps Engineer - Kafka & Data Infra

PayPal; San Jose (CA); On-site; USD 144,000 - 213,000; Full time

Job summary

PayPal's Venmo Data Infrastructure team seeks a skilled engineer to design, implement, and operate scalable data platforms. You will automate provisioning, monitoring, and data pipelines to enable analytics and product teams with reliable, secure infrastructure.

Role requires hands-on experience with AWS, SQS, Kafka, and big data tools, plus scripting in Python/Java and IaC across cloud and on‑prem environments. Join a team driving global-scale services at PayPal.

Qualifications

• Bachelor's or master's in computer science or related field.
• 3+ years' experience in software development or a related field.
• 3+ years' experience operating on-prem/cloud databases/data-warehouses and/or distributed systems 24x7x365.
• Experience with operating/maintaining message streaming solutions like AWS SQS, Apache Kafka.
• Ability to troubleshoot problems.
• Hands-on experience with designing and implementing infrastructure to support global-scale services.
• Hands-on experience with IaaS and PaaS solutions from AWS.
• Infrastructure as code (AWS CLI, AWS CloudFormation, Terraform, Ansible, Puppet).
• Hands-on programming and scripting (Lambda, API GW, Python, Java, Bash).
• Hands-on experience with big data operations including, but not limited-to- AWS S3, AWS DMS, AWS SQS, Luigi, AWS EKS, Apache Spark, AWS Glue.

Responsibilities

• Design, implement and operate data infrastructure initiatives to provide secure, scalable, reliable and performant platform to Venmo product, analytics and the other infrastructure teams.
• Automate provisioning, management and monitoring solutions for the supported data infrastructure.
• Build and implement scalable and reliable data pipeline architecture to optimize overall performance.
• Build tools that help users leverage our data into actionable insights to improve our customers’ experiences, operational efficiency, and business performance.
• Build and implement message streaming solutions for Venmo applications with AWS SQS, Apache Kafka etc
• Collaborate with stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-related technical issues and support their data infrastructure need.
• Collaborate with teammates on planning and execution of initiatives.
• Process, extract and manage relational databases and systems such as query authoring (SQL) and NoSQL databases.
• Create large, complex data sets that meet functional and non-functional business requirements.
• Demonstrable ability to learn new technologies and process practices.

Skills

Python

Java

Bash

Lambda

API Gateway

AWS SQS

Apache Kafka

SQL

NoSQL

Terraform

CloudFormation

Ansible

Puppet

AWS CLI

Big data

EKS

Spark

Glue

Troubleshooting

Infrastructure as code

Education

Bachelor's or Master's in Computer Science or related field

Tools

AWS CLI

AWS CloudFormation

Terraform

Ansible

Puppet

Job description

PayPal's Venmo Data Infrastructure team seeks a skilled engineer to design, implement, and operate scalable data platforms. You will automate provisioning, monitoring, and data pipelines to enable analytics and product teams with reliable, secure infrastructure.

Role requires hands-on experience with AWS, SQS, Kafka, and big data tools, plus scripting in Python/Java and IaC across cloud and on‑prem environments. Join a team driving global-scale services at PayPal.