Remote Databricks Spark Specialist - Python/Java/Scala

OpenTrain AI; Philippines; On-site; PHP 839,000 - 1,195,000; Part time

Job summary

OpenTrain AI is seeking a part-time Databricks Specialist with hands-on Databricks and Apache Spark expertise to design and optimize data pipelines and large-scale processing systems.

You will work remotely for 20+ hours/week, evaluating data workflows, and performing advanced data analysis while coordinating with a global remote team. Strong English communication and the ability to solve complex technical problems are required.

Qualifications

• Minimum five years of Databricks experience.
• Deep expertise building, optimizing, and troubleshooting Apache Spark systems.
• At least five years with Python, Java, SQL, Scala, or Spark.
• Strong experience building and optimizing data pipelines and ETL processes.
• Hands-on Databricks experience with data processing, analysis, and performance optimization.
• Experience analyzing, debugging, and testing large codebases.
• Familiarity with Azure or AWS is preferred.
• Ability to work independently and solve complex technical problems.
• Excellent communication and remote collaboration skills.
• B1 or B2 English proficiency.

Responsibilities

• Design data pipelines, ETL processes, and data solutions using Databricks.
• Build, optimize, and troubleshoot Spark-based data processing systems.
• Develop efficient data workflows and perform advanced data analysis.
• Analyze, debug, and test large codebases.
• Optimize large-scale data processing systems and Databricks workloads.
• Navigate complex technical documentation.
• Collaborate effectively in a remote team environment while solving complex technical problems independently.

Skills

Databricks

Apache Spark

Python

Java

SQL

Scala

Tools

Azure

AWS

Job description

OpenTrain AI is seeking a part-time Databricks Specialist with hands-on Databricks and Apache Spark expertise to design and optimize data pipelines and large-scale processing systems.

You will work remotely for 20+ hours/week, evaluating data workflows, and performing advanced data analysis while coordinating with a global remote team. Strong English communication and the ability to solve complex technical problems are required.