Senior Big Data Engineer - AWS & Databricks Expert

SoftServe; Chile; On-site; CLP 9,000,000 - 14,000,000; Full time

Job summary

SoftServe in Chile is seeking an experienced Data Engineer to design and implement scalable data pipelines in AWS, leveraging Spark, Databricks, and modern data tools. You will own end-to-end data workflows, optimize performance and costs, and collaborate with AI, product, and engineering teams.

The role requires 5+ years of experience in Big Data/Data Engineering, strong Python and SQL skills, and hands-on AWS data services expertise.

Qualifications

• 5+ years of professional experience in Big Data / Data Engineering.
• Proficient in Python and SQL; Java a plus.
• Hands-on experience with Spark, Databricks, and AWS data services.
• Experience with CI/CD, IaC, and Terraform.
• Strong English communication skills for cross-team collaboration.

Responsibilities

• Design, develop, and maintain scalable batch and distributed data pipelines.
• Build and optimize data processing solutions focusing on performance and cost efficiency.
• Collaborate with engineering, AI, and product teams to support analytics and AI use cases.
• Develop data solutions using Python, SQL, Spark, Databricks and AWS services.
• Work with PostgreSQL and MySQL for data processing workflows.
• Develop and maintain workflow orchestration with Airflow and data pipelines.
• Support CI/CD, IaC, testing, and production support using Terraform and related tools.

Skills

Python

SQL

Big Data / Data Eng

English proficiency

Tools

Apache Spark

Databricks

AWS Glue

Amazon Athena

Amazon Aurora

PostgreSQL

MySQL

Apache Airflow

Terraform

Apache Kafka

Job description

SoftServe in Chile is seeking an experienced Data Engineer to design and implement scalable data pipelines in AWS, leveraging Spark, Databricks, and modern data tools. You will own end-to-end data workflows, optimize performance and costs, and collaborate with AI, product, and engineering teams.

The role requires 5+ years of experience in Big Data/Data Engineering, strong Python and SQL skills, and hands-on AWS data services expertise.