Platform Engineer

Vortexa; New York (NY); On-site; USD 100,000 - 200,000; Full time

Job summary

Vortexa, a leader in the energy data landscape, seeks a skilled engineer to develop a robust infrastructure for their innovative platform. The role focuses on ensuring system reliability and performance while supporting a talented, globally distributed team in pursuing impactful engineering work. Candidates should have extensive experience with AWS, Kubernetes, and modern data processing frameworks, and a passion for enhancing developer experience.

Benefits

Stock-options in a fast-growing business

Private Health Insurance via Blue Cross Shield

Dental and Vision cover via Guardian

Global Volunteering Policy

Qualifications

• Excellent at troubleshooting unfamiliar code.
• Familiar with cloud-native application design and deployment.
• Not afraid of challenges and infrastructure troubleshooting.

Responsibilities

• Develop and maintain a fault-tolerant infrastructure for real-time data processing.
• Optimize AWS costs while ensuring system availability and performance.
• Provide a great developer experience for users of the platform.

Skills

Kubernetes

AWS

Apache Kafka

Terraform

ElasticSearch

Go

Job description

This range is provided by Vortexa. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.

Base pay range

$100,000.00/yr - $200,000.00/yr

Vortexa was founded to solve the immense information gap that exists in the energy industry. By using massive amounts of new satellite data and pioneering work in artificial intelligence, Vortexa creates an unprecedented view on the global seaborne energy flows in real-time, bringing transparency and efficiency to the energy markets and society as a whole.

The Challenge

Ingesting data from multiple external vastly different sources at hundreds of rich data points per second, moving terabytes of data while processing it in real-time, running complex and complicated prediction and forecasting AI models while coupling their output into a hybrid human-machine data refinement process and presenting the result through a nimble low-latency SaaS solution used by customers around the globe is no small feat of science and engineering. This processing requires a highly reliable, stable, fault-tolerant infrastructure that can withstand multiple and varied uses and abuses by data analysts, data scientists, industry experts, and the end-users. Fast product iteration cycles necessitate a platform that allows engineers to deploy frequently, independently, and without in-depth knowledge of infrastructure complexities.

The Data Services Team is responsible for the developer platform, and the impressive Amazon AWS estate Vortexa uses to achieve its purpose. This includes two major areas of concern: infrastructure availability, security and costs, as well as developer experience. We use a wide variety of technologies like Kubernetes, Kubevela, Golang, Kafka, Opensearch, Airflow, Athena, and others.

You will be a key member of the small, globally distributed team, instrumental in assessing current technologies, delivering the best possible engineering experience with the shortest development iterations, helping crystallise, converge and standardise technology stacks and implementing the infrastructure roadmap, ensuring 100% uptime, availability, and fault-tolerance of every component of the platform, while optimising AWS costs. You will provide your customers such as data analysts, data scientists, and other engineers with a delightful developer experience tooling boosting their productivity, and allowing them to concentrate on business logic. You will codify and automate any operational knowledge gathered so that R&D can focus purely on creating value for our customers.

You Are

• Determined to create infrastructure that gets out of the way with a great developer experience
• Excellent at troubleshooting unfamiliar code.
• Striving to be more skilled than Google with Kubernetes
• An AWS power user and evangelist
• Familiar with Apache Kafka and Kafka Streams - deployment, monitoring, resiliency, fault-tolerance, cluster planning and operations, applications debugging
• Experienced with ElasticSearch operations and usage
• Fluent in Terraform, and Go
• Familiar with cloud-native application design and deployment
• Not afraid of challenges and infrastructure troubleshooting
• A "can-do" person - "I've done my bit" has no place at Vortexa

Awesome If You

• Are familiar with Airflow or other workflow orchestration tools
• Understand data lakes like Parquet, Orc, Athena
• Stock-options in a fast-growing, high-potential business
• A vibrant and diverse workplace
• An open, collaborative, and supportive working culture built on merit, which celebrates creative thinking and "getting things done."
• The opportunity to work with AI-driven technology in a scale-up environment with commodity trading experts
• 401k with up to 2% contributions matched by Vortexa
• Private Health Insurance offered via Blue Cross Shield
• Dental and Vision cover offered via Guardian
• Global Volunteering Policy to help you ‘do good' and feel better

Salary of $120,000-$190,000

Seniority level

• Seniority level

  Mid-Senior level

Employment type

• Employment type

  Full-time

Job function

• Industries

  IT Services and IT Consulting

Referrals increase your chances of interviewing at Vortexa by 2x

Get notified about new Platform Engineer jobs in New York, NY.

New York, NY $141,000.00-$202,000.00 1 week ago

New York, NY $130,000.00-$250,000.00 1 week ago

AI Engineer – Azure AI Foundry & LLM Solutions

New York City Metropolitan Area $119,015.00-$170,000.00 3 days ago

New York, NY $140,000.00-$180,000.00 1 month ago

New York, NY $72,500.00-$155,000.00 1 month ago

New York, NY $100,000.00-$150,000.00 2 weeks ago

New York, NY $172,500.00-$201,500.00 8 months ago

New York, NY $115,005.00-$150,000.00 1 day ago

New York, NY $150,000.00-$180,000.00 12 hours ago

New York, NY $140,000.00-$200,000.00 1 month ago

New York, NY $135,000.00-$200,000.00 3 months ago

Software Engineer, Site Reliability Engineering, Campus

New York, NY $140,000.00-$170,000.00 2 months ago

New York, NY $130,000.00-$170,000.00 1 month ago

New York, NY $170,000.00-$200,000.00 1 week ago

New York, NY $150,000.00-$180,000.00 14 hours ago

New York, NY $139,500.00-$271,566.94 1 week ago

New York, NY $162,000.00-$210,000.00 12 hours ago

New York, NY $145,000.00-$155,000.00 4 months ago

New York, NY $141,000.00-$202,000.00 4 days ago

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.