Onsite Python Data Engineer — Spark & Databricks, 18+Mo Contract

COVETIT INC.; Dallas (TX); On-site; USD 90,000 - 130,000; Full time

Job summary

COVETIT INC. is seeking a Python Data Engineer for an onsite role in Plano, TX. The contract spans 18+ months and requires 3-5 years of data engineering experience with Python and distributed data processing.

Responsibilities include building scalable batch and real-time pipelines using PySpark, Spark, and Databricks, plus writing optimized SQL and developing RESTful APIs with Python when needed. OPT consultants are eligible to apply.

Qualifications

• 3-5 years of experience in data engineering or similar role.
• Strong Python development skills and experience building data pipelines.

Responsibilities

• Develop and optimize data pipelines using Python and PySpark.
• Implement batch and real-time processing using Spark and Structured Streaming.
• Write and optimize complex SQL queries.
• Work with Databricks for development, deployment, and performance tuning.
• Develop RESTful APIs using Python where applicable.
• Ensure data quality, reliability, and performance.

Skills

Python

Spark & PySpark

Structured Streaming

SQL

Databricks

API development with Python

Tools

Databricks

Job description

COVETIT INC. is seeking a Python Data Engineer for an onsite role in Plano, TX. The contract spans 18+ months and requires 3-5 years of data engineering experience with Python and distributed data processing.

Responsibilities include building scalable batch and real-time pipelines using PySpark, Spark, and Databricks, plus writing optimized SQL and developing RESTful APIs with Python when needed. OPT consultants are eligible to apply.