Senior Software Engineer, Platform - System Optimization & Cost Reduction

ZipRecruiter; Palo Alto (CA); On-site; USD 149,000 - 208,000; Full time

Job summary

Obsidian Security is seeking a Senior Software Engineer to optimize data pipelines and enhance performance across several platforms. This role will play a vital part in driving cost reduction and stability, ensuring alignment with business goals. Candidates should have 3+ years of experience, proficient in several technologies including ElasticSearch and Kubernetes, and demonstrate strong collaboration skills.

Benefits

Competitive compensation with equity and 401k

Comprehensive healthcare with dental and vision coverage

Flexible paid time off and paid holiday time off

12 weeks of new parent or family leave

Personal and professional development resources

Qualifications

• 3+ years in data platform engineering focused on data pipeline optimization.
• Proven expertise in ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes.
• Strong analytical skills and expertise in Python and Golang.

Responsibilities

• Analyze and enhance data pipeline stability and cost efficiency.
• Work on performance tuning and cost reduction for data platforms.
• Collaborate with engineering and product teams for optimization efforts.

Skills

ElasticSearch

Databricks

Cassandra

Kafka

Kubernetes

Python

Golang

AWS cost optimization

Data-driven problem-solving

Tools

GitLab CI/CD

Argo CD

Job description

Job DescriptionJob Description

Obsidian Security was founded in 2017 to solve the unaddressed blindspot of SaaS Security. SaaS applications provide the tools employees need to succeed and hold the business' most critical information. If those tools become unavailable or that data is jeopardized, there is a detrimental impact on the organization.

Obsidian proudly offers the industry's most comprehensive and powerful SaaS defense solution. We are committed to solving the challenge of SaaS Security for our customers as efficiently and effectively as possible.

We're a passionate team optimizing for impact by solving some of the biggest challenges in cybersecurity today. We listen closely to our customers, iterate quickly, and (over) deliver to delight them. Working at Obsidian means contributing to an industry-leading cybersecurity product in an environment where customer satisfaction, privacy, and data ethics are paramount.

Senior Software Engineer (Platform - System Optimization & Cost Reduction):

We are looking for a highly skilled Staff Software Engineer to optimize our data pipelines for improved stability, scalability, and cost efficiency. You will play a critical role in tuning ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes while collaborating closely with Engineering, DevOps and product teams. Your work will directly impact the performance and efficiency of our infrastructure, ensuring that optimizations align with a superior user experience.

Responsibilities:

• Analyze and enhance data pipeline stability, scalability, and cost efficiency.
• Work on performance tuning and cost reduction of ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes.
• Collaborate with engineering and product leaders to align optimization efforts with business goals, ensuring no adverse impact on user experience.

Requirements:

• 3+ years of experience in data platform engineering, with a focus on data pipeline optimization.
• Proven expertise in ElasticSearch, Databricks, Cassandra, Kafka, and Kubernetes.
• Experience with AWS cost optimization.Solid understanding of distributed systems, databases, and performance tuning.
• Strong analytical skills and a data-driven approach to problem-solving.
• Strong proficiency in Python and Golang and their respective libraries.
• Experience with GitLab CI/CD and Argo CD.
• Excellent collaboration and communication skills.

Employee Benefits

Our competitive benefits packages are designed to support our employees' well-being, both at work and at home. Our US based employees enjoy:

• Competitive compensation with equity and 401k
• Comprehensive healthcare with dental and vision coverage
• Flexible paid time off and paid holiday time off
• 12 weeks of new parent or family leave
• Personal and professional development resources

For more details on our US benefits, or for information on our international benefits, please see here.

Pay Transparancy

Please note that the base pay range is a guideline and for candidates who receive an offer, the base pay will vary based on factors such as work location, as well as the knowledge, skills and experience of the candidate. In addition to a competitive base salary, this position is eligible for equity awards and may be eligible for incentive compensation based on factors such as experience, skills, and location.

At Obsidian, we are proud to be an equal-opportunity employer. We value and hire for talent, passion, and compassion. In compliance with federal law, all persons hired will be required to submit satisfactory proof of and legal authorization. If you have a need that requires accommodation, please contact [e-mail]

Information collected and processed as part of any job applications you choose to submit is subject to Obsidian's Applicant Privacy Policy.

Base Salary Range$149,000—$208,000 USD