Data Engineer

SOFTSWISS; United States; Remote; USD 130,000 - 180,000; Full time

Benefits offered by this job

Private health insurance

Sports benefits

Mental Health Program

Free English lessons

Local language courses

Paid time off

Maternity leave support

Referral program rewards

Upskilling and internal workshops

Job summary

SOFTSWISS invites you to join our Data Platform team, building the data infrastructure for analytics and insights across the company. You will work with modern data stacks and AI tools to deliver complex solutions and robust, self-service data products.

Design and optimize pipelines, collaborate with teams to meet evolving data needs, and help advance platform architecture for enterprise-scale data processing. Fluent English and Russian are valuable in this role.

Qualifications

• 5+ years of software engineering with deployment and integration.
• Proficiency in at least one language (Scala, Java, Python).
• Experience with data lakes, data warehouses, and large data volumes.
• ETL pipelines using Spark and Delta Lake.
• Sourcing and modeling data from APIs.
• Stream processing with Spark Streaming or Kafka Streams.
• Monitoring/observability with Prometheus/Grafana/Alertmanager.
• Strong analytical and problem-solving skills.
• Upper-intermediate English and strong Russian.
• Airflow experience.
• Kubernetes and containerization.
• Cloud platform familiarity (AWS, GCP, Azure, OCI).
• CDC/Debezium familiarity.
• Clickhouse familiarity.
• Data quality and data lineage familiarity.
• NoSQL and SQL databases and search systems familiarity.

Responsibilities

• Build and evolve data infrastructure powering analytics across SOFTSWISS.
• Design platform architecture and tackle technical challenges.
• Develop and integrate new data processing tools and technologies.
• Create robust, self-service data products with big data tech.
• Ensure pipeline performance and data quality through scalable design.

Skills

Software engineering

Analytical skills

English/Russian proficiency

Education

Masters/PhD in Software Engineering or CS

Tools

Apache Spark

Kafka

Delta Lake

Prometheus

Grafana

Alertmanager

Apache Airflow

Kubernetes

Cloud platforms (AWS, GCP, Azure, OCI)

Clickhouse

Elasticsearch/Solr

Data Lineage tools

CDC & Debezium

NoSQL & RDBMS (HBase, Cassandra, MongoDB, MySQL, Postgres)

Data quality validation frameworks

Job description

Описание

We invite you to join our Data Platform team — building the data infrastructure that powers analytics and insights for SOFTSWISS. We process enterprise-scale data and serve multiple internal teams across the company.

Задачи

• Work with modern data stack and AI tools to build complex solutions
• Design solutions to technical challenges and influence platform architecture
• Research, develop and integrate new data processing tools and technologies
• Build business-critical, robust and self-service data products using Apache Spark, Kafka, Delta Lake and other big data technologies
• Ensure pipeline performance and data quality through scalable architecture and optimization
• Refine data solutions as business requirements and technical constraints evolve
• Collaborate with teams to understand data needs and support adoption of data products across the company

Требования

• 5+ years of software engineering experience with expertise in development, deployment, and integration
• Proficiency in at least one high-level programming language (Scala, Java, Python or equivalent)
• Experience in data environments, such as Data Lakes, Data Warehouses, Data Marts, Data transformation concepts and working with large data volumes
• Experience in building ETL pipelines to perform feature engineering on large-scale datasets using Apache Spark and Delta Lake
• Experience with sourcing and modelling data from application APIs
• Experience with building stream-processing applications using Spark-Streaming, Kafka Streams or others
• Experience designing and implementing monitoring, alerting, and observability solutions for data pipelines using Prometheus, Grafana, Alertmanager or others
• Strong analytical and problem-solving skills
• Upper-intermediate proficiency in English and strong command of Russian
• Experience with workflow orchestration tools such as Apache Airflow
• Experience with Kubernetes and containerization
• Familiarity with cloud platforms (AWS, GCP, Azure, OCI)
• Familiarity with CDC and Debezium
• Familiarity with Clickhouse
• Familiarity with data quality validation frameworks for data pipelines
• Familiarity with Data Lineage
• Familiarity with low-latency NoSQL datastores (such as HBase, Cassandra, MongoDB), Relational databases (such as MySQL, Postgres) and Search systems (such as ElasticSearch, Solr)
• Masters, PhD, or equivalent experience in Software Engineering, Mathematics or Computer Science

Условия

• Private health insurance
• Sports benefits
• Comprehensive Mental Health Program
• Free English lessons (online)
• Local language courses
• Paid time off
• Maternity leave support
• Referral program rewards
• Upskilling, internal workshops, and participation in professional conferences and corporate events