Python Data Engineer

COVETIT INC.; Dallas (TX); On-site; USD 90,000 - 130,000; Full time

Job summary

COVETIT INC. is seeking a Python Data Engineer for an onsite role in Plano, TX. The contract spans 18+ months and requires 3-5 years of data engineering experience with Python and distributed data processing.

Responsibilities include building scalable batch and real-time pipelines using PySpark, Spark, and Databricks, plus writing optimized SQL and developing RESTful APIs with Python when needed. OPT consultants are eligible to apply.

Qualifications

• 3-5 years of experience in data engineering or similar role.
• Strong Python development skills and experience building data pipelines.

Responsibilities

• Develop and optimize data pipelines using Python and PySpark.
• Implement batch and real-time processing using Spark and Structured Streaming.
• Write and optimize complex SQL queries.
• Work with Databricks for development, deployment, and performance tuning.
• Develop RESTful APIs using Python where applicable.
• Ensure data quality, reliability, and performance.

Skills

Python

Spark & PySpark

Structured Streaming

SQL

Databricks

API development with Python

Tools

Databricks

Job description

Title- Python Data Engineer

Location- Plano, TX- Fully Onsite

Type- Contract- 18+ Months

3-5 years of experience

OPT Consultants are eligible to apply.

Job Description

We are seeking 3-5 years’ experience Data Engineer with strong expertise in Python and distributed data processing to build and maintain scalable batch and real-time data pipelines.

Key Responsibilities

• Develop and optimize data pipelines using Python and PySpark
• Implement batch and real-time processing using Spark and Structured Streaming
• Write and optimize complex SQL queries
• Work with Databricks for development, deployment, and performance tuning
• Develop RESTful APIs using Python (for applicable roles)
• Ensure data quality, reliability, and performance

Required Skills

• Python
• Spark & PySpark
• Structured Streaming
• SQL
• Databricks
• API development with Python