Senior Big Data Engineer — Spark/Databricks on AWS

Softserve; United States; Remote; USD 120,000 - 180,000; Full time

Benefits offered by this job

SoftServe University

Medical insurance

Food vouchers

Extra days off

Dare to Care

Anniversary Program

Job summary

Ulvior is seeking a senior data engineer to design and maintain scalable batch and streaming data pipelines. You will work with Python, SQL, Spark, Databricks, and AWS services to deliver reliable data solutions across teams.

You will collaborate with engineering, AI, and product teams to support analytics and AI-enabled use cases, while ensuring performance, reliability, and cost efficiency of data platforms.

Qualifications

• 5+ years of professional experience in Big Data, Data Engineering, or related fields.
• Strong Python and SQL; Java is a plus.
• Hands-on with Spark, distributed processing, and Databricks.
• Experience building data solutions on AWS (Glue, Athena, Aurora).
• Experience with PostgreSQL and MySQL.
• Familiar with Airflow and Kafka.
• CI/CD, version control, and Terraform IaC.
• Knowledge of GenAI, MLOps, or AI platform integrations is a plus.
• English at upper-intermediate level or higher.

Responsibilities

• Design, develop, and maintain scalable batch and distributed data pipelines.
• Build and optimize data processing solutions for performance, reliability, and cost.
• Collaborate with engineering, AI, and product teams on analytics and AI use cases.
• Develop data solutions using Python, SQL, Spark, Databricks, and AWS services (Glue, Athena, Aurora).
• Work with PostgreSQL and MySQL to support data workflows.
• Develop and maintain Airflow workflows and reliable data pipelines.
• Contribute to CI/CD and IaC using Terraform; assist testing and production support.
• Engage in architecture discussions to improve data platforms.

Skills

Big Data

Data Engineering

Python

SQL

Java

Apache Spark

Databricks

AWS Glue

Amazon Athena

Amazon Aurora

PostgreSQL

MySQL

Airflow

Kafka

CI/CD

Terraform

GenAI

MLOps

AI Platform

English

Tools

Apache Airflow

Terraform

PostgreSQL

MySQL

Job description

Ulvior is seeking a senior data engineer to design and maintain scalable batch and streaming data pipelines. You will work with Python, SQL, Spark, Databricks, and AWS services to deliver reliable data solutions across teams.

You will collaborate with engineering, AI, and product teams to support analytics and AI-enabled use cases, while ensuring performance, reliability, and cost efficiency of data platforms.