Senior Data Platform Engineer — Spark, Kafka & Delta Lake

SOFTSWISS; United States; Remote; USD 130.000 - 180.000; Vollzeit

Benefits dieser Stelle

Private health insurance

Sports benefits

Mental Health Program

Free English lessons

Local language courses

Paid time off

Maternity leave support

Referral program rewards

Upskilling and internal workshops

Zusammenfassung

SOFTSWISS invites you to join our Data Platform team, building the data infrastructure for analytics and insights across the company. You will work with modern data stacks and AI tools to deliver complex solutions and robust, self-service data products.

Design and optimize pipelines, collaborate with teams to meet evolving data needs, and help advance platform architecture for enterprise-scale data processing. Fluent English and Russian are valuable in this role.

Qualifikationen

• 5+ years of software engineering with deployment and integration.
• Proficiency in at least one language (Scala, Java, Python).
• Experience with data lakes, data warehouses, and large data volumes.
• ETL pipelines using Spark and Delta Lake.
• Sourcing and modeling data from APIs.
• Stream processing with Spark Streaming or Kafka Streams.
• Monitoring/observability with Prometheus/Grafana/Alertmanager.
• Strong analytical and problem-solving skills.
• Upper-intermediate English and strong Russian.
• Airflow experience.
• Kubernetes and containerization.
• Cloud platform familiarity (AWS, GCP, Azure, OCI).
• CDC/Debezium familiarity.
• Clickhouse familiarity.
• Data quality and data lineage familiarity.
• NoSQL and SQL databases and search systems familiarity.

Aufgaben

• Build and evolve data infrastructure powering analytics across SOFTSWISS.
• Design platform architecture and tackle technical challenges.
• Develop and integrate new data processing tools and technologies.
• Create robust, self-service data products with big data tech.
• Ensure pipeline performance and data quality through scalable design.

Kenntnisse

Software engineering

Analytical skills

English/Russian proficiency

Ausbildung

Masters/PhD in Software Engineering or CS

Tools

Apache Spark

Kafka

Delta Lake

Prometheus

Grafana

Alertmanager

Apache Airflow

Kubernetes

Cloud platforms (AWS, GCP, Azure, OCI)

Clickhouse

Elasticsearch/Solr

Data Lineage tools

CDC & Debezium

NoSQL & RDBMS (HBase, Cassandra, MongoDB, MySQL, Postgres)

Data quality validation frameworks

Jobbeschreibung

SOFTSWISS invites you to join our Data Platform team, building the data infrastructure for analytics and insights across the company. You will work with modern data stacks and AI tools to deliver complex solutions and robust, self-service data products.

Design and optimize pipelines, collaborate with teams to meet evolving data needs, and help advance platform architecture for enterprise-scale data processing. Fluent English and Russian are valuable in this role.