Senior Data Engineer

VORKIS; New York (NY); Remote; USD 66,960 - 78,120; Full time

Benefits offered by this job

Profit sharing

Food provided

Job summary

A dynamic tech company is looking for a Senior Software Engineer with Data Engineering expertise. The successful candidate will build scalable, maintainable data pipelines in cloud environments. Responsibilities include developing microservices, managing data workflows, and improving data governance. The company values independence and accountability. The position offers a salary of $6,000 - $7,000 per month, with flexible options for full-time or part-time work and a remote working environment.

Qualifications

• At least 2+ years experience with Java programming.
• 8+ years in data engineering and pipeline development.
• 2+ years experience with monitoring systems like Prometheus and Grafana.
• Experience in object-oriented development and SQL optimizations.

Responsibilities

• Design and develop microservices for the data team.
• Maintain end-to-end ETL workflows for data ingestion.
• Develop and maintain Java-based data pipelines running on K8S.
• Improve storage and serving methods of data.

Skills

ETL

Database Management

Java

SQL

Communication Skills

Data Pipelines

Performance Tuning

Microservices

Education

BSc. in Computer Sciences

Tools

AWS

Prometheus

Grafana

Apache Airflow

Kubernetes

ClickHouse

Snowflake

Job description

Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.

As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

Salary

$6,000 - $7,000 per month

Location

New York, USA

Employment option

Remote

Job type

Full time, Part time

Job Summary

Were looking for a strong Senior Software Engineer with Data Engineering experience. Someone who is proficient in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.

As a young and ambitious company in an extremely dynamic space, we pride ourselves on being independent, accountable, and organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

Skills

Must Have

Hard skills:

• novice in: AWS, Database Design
• beginner in: MS SQL Server, Linux
• competent in: Databases, Performance Tuning, SQL, Microservices
• proficient in: ETL, Prometheus, Database Management, Service Level Agreement SLA, Snowflake, Data Pipelines, JAVA, Grafana

Nice-to-have

Hard skills:

• novice in: Automation
• beginner in: Oracle
• proficient in: ClickHouse

Soft skills:

• proficient in: Communication Skills

Job Description

Additional Requirements

Required skills

• Education - BSc. in Computer Sciences from a top university, or equivalent.
• Java - Strong background as a software engineer with at least 2+ years experience with Java.
• DB - 8+ years in data engineering, and data pipeline development on high-volume production environments.
• Tools - 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Experience in object-oriented development. Should have strong software engineering foundations.
• Experience with data-engineering cloud technologies as Apache Airflow, K8S, Clickhouse, Snowflake, Redis, cache technologies and Kafka.
• Experience with relational and non-relational DBs. Proficient in SQL and query optimizations.
• Experience with designing infrastructure to maintain high availability SLAs.
• Experience with monitoring and managing production environments.
• Strong communication skills.

Nice to have - Experience working in fintech or trading industries.

Responsibilities

• Design and develop the data's team micro services - Java services running on K8S.
• Tackle data duplication, velocity, schema adherence (and schema versioning), high availability, data governance, and more.
• Develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.
• Enrich financial data through third-party data integrations.
• Develop and maintain our data pipeline written mostly in Java and running on K8S in a micro-service architecture.
• Plan and communicate integrations with other teams that consume the data and use it for insights creation.
• Ongoing improvement of the way data is stored and served. Improve queries and data formats to make sure the data is optimized for consumption by a variety of clients.

Benefits

• Profit sharing
• Food provided

About Company

Company Overview

Enabling Safer Crypto Markets

Our mission is to enable safer crypto trading throughout the investment journey across all centralized and DeFi markets. As the founder of industry leading initiatives like the Crypto Market Integrity Coalition and DACOM Summit, and in everything we do, Solidus is deeply committed to ushering the financial markets of tomorrow.