Python Developer: Spark, Airflow, AWS Cloud

Robotics Technologies LLC; Wilmington (DE); Presencial; USD 110.000 - 150.000; Jornada completa

Descripción de la vacante

Robotics Technologies LLC is seeking a proficient Python data engineer to design and optimize scalable data pipelines. You will leverage PySpark and Spark SQL to process large datasets, implement robust testing, and collaborate with teams on API services using Flask or Django.

The role requires hands-on experience with Airflow, AWS services, and modern CI/CD practices. Familiarity with Snowflake/Databricks and ML-related tooling is a plus.

Formación

• Proven Python software development experience with emphasis on data engineering.
• Strong experience with PySpark and Spark SQL for large-scale processing.
• Hands-on testing experience using PyTest, PyUnit or similar frameworks.
• Familiarity with Pandas/Numpy for data manipulation and analysis.
• Experience with web frameworks (Flask or Django) and REST APIs.
• Proficient with Airflow for data pipelines and orchestration; exposure to Kafka/Jenkins/Spinnaker is a plus.
• Hands-on experience with AWS cloud services (S3, EC2, Lambda, ECS, EventBridge).
• Knowledge of data warehousing platforms like Snowflake or Databricks is desirable.

Conocimientos

Python programming

PySpark

Spark SQL

Distributed data processing

Testing (PyTest/PyUnit)

Pandas/Numpy

Flask/Django

Airflow

Kafka/Jenkins/Spinnaker

AWS (S3, EC2, Lambda, ECS, EventBridge

Herramientas

PySpark

Spark SQL

Airflow

Kafka

Jenkins

Spinnaker

AWS services (S3, EC2, Lambda, ECS, EventBridge)

Snowflake

Databricks

GitHub Copilot

LLMs

Descripción del empleo

Robotics Technologies LLC is seeking a proficient Python data engineer to design and optimize scalable data pipelines. You will leverage PySpark and Spark SQL to process large datasets, implement robust testing, and collaborate with teams on API services using Flask or Django.

The role requires hands-on experience with Airflow, AWS services, and modern CI/CD practices. Familiarity with Snowflake/Databricks and ML-related tooling is a plus.