Senior Data Engineer

SPD Technology; Mission (TX); Remote; USD 80,000 - 130,000; Full time

Job summary

Join a forward-thinking company as a Senior Data Engineer, where your expertise will enhance fraud detection and market manipulation prevention in the dynamic world of crypto trading. This role offers the chance to work with high-volume data and cutting-edge technologies in a flexible, fully remote environment. Collaborate with a decentralized team of experts, tackle challenging projects, and contribute to the development of innovative solutions that ensure market safety and accessibility. With a strong focus on personal and professional growth, you will have access to development plans, performance reviews, and a supportive culture that values your contributions. If you're ready to make an impact and grow in your career, this opportunity is for you.

Benefits

Flexible working hours

Remote work

Provided laptops

Licensed software

Performance reviews

Personal development plans

Corporate library access

Public speaking support

CSR initiatives

Referral bonus program

Qualifications

• 5+ years in data engineering with high-volume production environments.
• 2+ years experience with Java and monitoring systems.

Responsibilities

• Build robust, scalable, maintainable data pipelines on cloud environments.
• Tackle data quality issues like duplication, velocity, and governance.

Skills

Data Engineering

Java

SQL

Kafka

Microservices

ETL Workflows

Monitoring Systems

Cloud Technologies

Data Governance

Education

BSc in Computer Sciences

Tools

Apache Airflow

Prometheus

Grafana

Zabbix

Datadog

Snowflake

ClickHouse

Redis

Job description

At SPD Technology, we bring together a team of like-minded people who are driven by the desire to bring value through their work, united in their commitment to high performance and delivering custom, cutting-edge tech solutions that drive clients’ growth. We empower our people with a culture of excellence and enable them with the opportunity to uphold their accountability to contribute on each level. We value humanity and collaboration, encourage professional and personal growth, and foster a supportive and flexible work environment where everyone’s contribution is welcomed.

We are seeking a Senior Data Engineer.

About the role

The Data Engineer will directly contribute to the accuracy and effectiveness of fraud detection and market manipulation prevention. Their expertise in handling high-volume data (10k events per second) will allow the company to scale its services.

About the project

Founded 6 years ago by 3 partners from Goldman Sachs. Goal: Make crypto trading safer and more accessible. Focus on market regulation and monitoring market manipulations.

Monitoring areas: Centralized exchanges, decentralized exchanges, and traditional markets.

Project Specifics: Focus on market surveillance and compliance. Developing and optimizing existing algorithms. Incorporation of machine learning/AI in surveillance strategies.

Business Challenges: Understanding finance and trading language. Grasping trading mechanics and business flows. Balancing new development with technical debt management.

Team:

Distributed team— Ukraine, Israel, US. Decentralized team structure.

Work schedule:

Flexible working hours (Israeli/Ukraine time zone).

You’ll work with the following stack:

Java, Microservice architecture, SQL, Kafka, Spring Boot, Snowflake, ClickHouse, Redis.

We’re looking for you if you have:

• BSc in Computer Sciences from a top university, or equivalent.
• 5+ years in data engineering, and data pipeline development on high-volume production environments.
• 2+ years experience with Java.
• 2+ years experience with monitoring systems (Prometheus, Grafana, Zabbix, Datadog).
• Ability to develop, design, and maintain end-to-end ETL workflows, including data ingestion and transformation logic, involving different data sources.
• Experience with data-engineering cloud technologies such as Apache Airflow, K8S, Clickhouse, Snowflake, Redis and cache technologies.
• Experience with relational and non-relational DBs. Proficient in SQL and queries optimization.
• Experience with designing infrastructure to maintain high availability SLAs.
• Experience with monitoring and managing production environments.

Sounds like you? Here are some of what you’ll be doing:

• We’re looking for a strong Data Engineer who is a fast learner, can take responsibilities, with experience in building robust, scalable, maintainable and thoroughly monitored data pipelines on cloud environments.
• The quality of our data-related products is heavily dependent on the quality of incoming data, and we’re looking for someone who can help us tackle issues such as data-duplication, velocity, schema adherence (and schema versioning), high availability, data governance and more.
• As a young and ambitious company in an extremely dynamic space, any candidate must be independent, accountable, organized, have a self-starter attitude, and be willing to get their hands dirty with day-to-day work that might be out of their official scope, while keeping an eye on their goals and the big picture.

What’s in it for You

Reveal great tech solutions

Join the team of experts who create custom, cutting-edge tech solutions for world-renowned businesses, fueling client growth. Unleash your potential, tackle new challenges, and be part of a team that values your skills and contributions. Focus on long-term impact and building tailored, long-lasting partnerships with our clients.

Experience an agile and flexible working environment

Enjoy the freedom of fully remote work with a flexible working schedule. Empower yourself with a stable workload and a stable income, supported by provided laptops and licensed software. We focus on lasting cooperation and unite result-oriented individuals who stand on a high-performance approach to work.

Embrace the opportunity for personal and professional growth

Benefit from performance and merit reviews, elevate your skills with personal development plans, and individual learning through the corporate library, public speaking support, and more.

Be among like-minded people

Work with a team of one mind who cares about what they do and how they do. Collaborate with top-notch experts who are always ready to help and support you through any challenges. Join company-wide tech and cultural events, and contribute to meaningful CSR initiatives that resonate with your values. Feel supported by your HR, and take advantage of our referral bonus program.

Interview steps

1. Pre-screen with the recruiter;
2. Technical interview;
3. Client Interview (will be 2 meetings).