Software Engineer II - Back End (Data Platform)

Abnormal Security; United States; Remote; USD 80,000 - 100,000; Full time

Job summary

An innovative firm is seeking a Software Engineer to join their Data Platform team, focusing on building and scaling data-intensive applications. This role offers a unique opportunity to work with a world-class engineering team, optimizing offline data processing systems using technologies like PySpark and Databricks. As part of a forward-thinking organization, you will contribute to enhancing data reliability and security while growing your career in a dynamic environment. If you are passionate about technology and eager to make an impact, this position is perfect for you.

Qualifications

• 4+ years of experience in data-intensive applications and distributed systems.
• Strong programming skills in Python or Golang.

Responsibilities

• Build, scale, and maintain batch data platform offerings.
• Optimize performance of offline data processing systems.

Skills

Python

Golang

Data-intensive applications

Distributed systems

Batch processing

Streaming systems

Data orchestration

Data infrastructure

Tools

AWS

Databricks

PySpark

Job description

About the Role

Enterprises of all sizes trust Abnormal Security’s cloud products to stop cybercrime. These products are data intensive SaaS applications that depend on reliable, scalable, and secure access to data. This is where our Data Platform team fits in, enabling efficient, reliable and scalable data processing across both realtime and offline processing systems. Come empower the rest of engineering to stop cybercrime as we expand our offerings across both clouds and regions.

The Data Platform team is looking to add a Software Engineer. The individual in this role will have the opportunity to partner closely with our existing world class team of engineers as we define and build the next generation data platform.

There are a lot of opportunities for growth and career advancement – it’s up to you to own your career here. Some potential career paths for this role include:

1. Solving zero-to-one or one-to-million problems
2. Growing into a senior / technical leadership role
3. Positioning yourself as one of the founding engineers for a new team.

What you will do:

• Build, scale and maintain our batch data platform offerings used by our internal stakeholders (engineering and data science teams).
• Optimize the performance of offline data processing systems (we use PySpark and Databricks) to increase their efficiency.
• Improve the reliability and security posture of offline data storage systems.

Must Haves:

• 4+ years of experience working on data-intensive applications and distributed systems. This is not a Data Engineering role.
• Strong programming skills in Python, Golang, or similar languages.
• Strong foundations as a software engineer, able to write clean, efficient and testable code.
• Depth in at least one key area of the data platform tech stack - batch processing, streaming systems, data orchestration, data infrastructure.
• Experience in working with AWS (or a similar public commercial cloud such as Azure / GCP).

Nice to Haves:

• Prior experience in up-leveling the use of Spark (or similar frameworks) in a tech startup to support their growth and scale.
• Prior experience with Databricks.
• Experience working in platform or similar teams serving global stakeholders.