Senior Software Engineer (Apache Spark)

TechBrains; New York (NY); On-site; USD 120,000 - 160,000; Full time

Job summary

A leading tech company is seeking a Senior Platform Engineer to enhance their Apache Spark pipeline, focusing on data services and machine learning infrastructure. The role involves writing performant code, collaborating across teams, and leveraging extensive engineering expertise. This position is perfect for someone with significant experience in platform engineering, looking to contribute to innovative solutions in the SaaS domain.

Benefits

Competitive salary

Company Equity

Exceptional benefits package

Flexible Vacation & Paid Time Off

Employer-matched 401(k) plan

Qualifications

• 5+ years of professional Software Engineering experience preferred.
• Experience building software with Scala and/or Java required.
• Familiarity with Machine Learning techniques is a plus.

Responsibilities

• Write clean and maintainable code for microservices.
• Collaborate with cross-functional teams including Data Scientists and Product Managers.
• Manage competing priorities while enhancing company culture.

Skills

Concurrency

Distributed Systems

Communication Skills

Critical Thinking

Problem Solving

Education

BS or MS in Computer Science

Tools

Apache Spark

HDFS

Postgres

Memcached

Redis

Job description

Quantifind is seeking a Senior Platform Engineer to enhance our Apache Spark pipeline, which generates risk signal results from diverse data sources. You will define and deliver data services and machine learning infrastructure, contributing to the backend that powers our SaaS products. You will process terabytes of data daily on our dedicated Apache Spark clusters.

Responsibilities:
* Write clean, performant, and maintainable code for microservices and our distributed data platform.
* Collaborate with cross-functional teams including Data Scientists, DevOps Engineers, Front-end Engineers, and Product Managers.
* Proactively improve software design, performance, and testing.
* Manage competing priorities while contributing to company and culture growth.
* Explore client-facing roles in software and consulting, focusing on delighting clients at Financial Institutions by helping them identify financial crimes.
* Apply critical thinking and problem-solving skills.
* Communicate complex concepts effectively in verbal and written presentations.
* Work closely with Sales, Product, and Technology teams to promote a Customer Centric culture.
* Demonstrate an entrepreneurial spirit with personal accountability for work quality.
* Maintain a positive attitude in a deadline-driven environment.

Requirements:
* BS or MS in Computer Science.
* 5+ years of professional Software Engineering experience with a focus on platform engineering.
* Experience at a software startup is strongly preferred.
* Great communication skills for collaborating with Data Scientists, DevOps Engineers, and Product Managers.
* Solid understanding of concurrency and distributed systems.
* Experience building software with Scala and/or Java.
* Ability to design and prototype scalable algorithms.
* Ability to create efficient data structures and algorithms.
* Deep understanding of algorithm complexity and performance implications.
* Experience with Apache Spark, HDFS, and/or general MapReduce technologies.
* Experience writing unit tests and automated integration tests.
* Experience working with code that runs in a JVM.
* Familiarity with storage and caching solutions (Memcached, Redis, Postgres, etc.).
* Ability to build microservices with REST APIs for real-time query engines and web crawlers.
* Knowledge of setting up ETL pipelines for data streams.
* Familiarity with Machine Learning techniques.
* Must be legally authorized to work in the United States without sponsorship.

Benefits:
* Competitive salary
* Company Equity
* Exceptional benefits package
* Flexible Vacation & Paid Time Off
* Employer-matched 401(k) plan
* A fun environment where work-life balance is valued

How to Apply

Interested in this position? Please submit your resume and cover letter through the application portal.

Greenhouse Software London, United Kingdom

HyperScience New York City - NY, US Remote

Get the latest tech news, tutorials, and updates delivered to your inbox.