Data Infrastructure Engineer — Scale, Streaming & AWS

Engg; San Jose (CA); On-site; USD 140,000 - 190,000; Full time

Job summary

PayPal's Venmo Data Infrastructure team hires a data engineer to advance streaming and data movement across platforms. You will work with Kafka-based architecture and AWS services to build secure, scalable pipelines supporting Venmo product and analytics teams.

Responsibilities include automating provisioning, monitoring, and building tools to derive insights. Strong communication and problem-solving skills are essential for global-scale systems.

Qualifications

• Bachelors and/or master's in computer science or related field.
• 3+ years' experience in software development or a related field.
• 3+ years' experience operating global scale high throughput AWS native data pipelines.

Responsibilities

• Design, implement and operate data infrastructure initiatives to provide secure, scalable, reliable and performant platform to Venmo product, analytics and the other infrastructure teams.
• Automate provisioning, management and monitoring solutions for the supported data infrastructure.
• Build and implement scalable and reliable data pipeline architecture to optimize overall performance.
• Build tools that help users leverage our data into actionable insights to improve our customers' experiences, operational efficiency, and business performance.
• Build and implement message streaming solutions for Venmo applications with AWS SQS, Apache Kafka etc
• Collaborate with stakeholders including the Executive, Product, Engineering and Analytics teams to assist with data-related technical issues and support their data infrastructure need.
• Collaborate with teammates on planning and execution of initiatives.
• Process, extract and manage relational databases and systems such as query authoring (SQL) and NoSQL databases.
• Create large, complex data sets that meet functional and non-functional business requirements.
• Demonstrable ability to learn new technologies and process practices.

Skills

Strong communication

Troubleshooting

Team collaboration

Education

Bachelor's/Master's in CS or related

Tools

Terraform

AWS CloudFormation

Python

Java

Lambda

AWS S3

AWS DMS

AWS EKS

Apache Spark

AWS Glue

AWS SQS

Apache Kafka

Job description

PayPal's Venmo Data Infrastructure team hires a data engineer to advance streaming and data movement across platforms. You will work with Kafka-based architecture and AWS services to build secure, scalable pipelines supporting Venmo product and analytics teams.

Responsibilities include automating provisioning, monitoring, and building tools to derive insights. Strong communication and problem-solving skills are essential for global-scale systems.