Data Engineer - Python, PySpark & Pytest Pipelines

Synechron; Dallas (TX); On-site; USD 105,000 - 110,000; Full time

Benefits offered by this job

Competitive compensation

Global offices

Paid annual leave

Insurance plan

Training opportunities

Udemy access

Job summary

Synechron is seeking a Python Data Engineer in Dallas to design, develop, test, and maintain scalable data pipelines. You will leverage PySpark and Pytest, work with large datasets, and apply ETL/ELT patterns along with automated testing.

Your responsibilities include building data pipelines, REST APIs with Django/Flask, MongoDB schema design, and Kafka streaming. Cloud and CI/CD familiarity are a plus.

Qualifications

• Experience with Python development and data engineering.
• Strong knowledge of PySpark, Django, Flask, MongoDB and Kafka.
• Experience with REST APIs, ETL/ELT pipelines, and Pytest.

Responsibilities

• Develop data pipelines and applications using Python and PySpark.
• Build REST APIs and backend services using Django and Flask.
• Design and manage MongoDB databases, schemas, indexes, and queries.
• Develop Kafka producers and consumers for real-time data processing.
• Implement data transformation, validation, cleansing, and integration workflows.
• Write unit and integration tests using Pytest.
• Collaborate with data scientists, software engineers, QA, and DevOps teams.
• Participate in code reviews, Agile ceremonies, and CI/CD activities.

Skills

Python

PySpark

Django

Flask

SQL

JSON/Parquet

Tools

MongoDB

Kafka

Pytest

Job description

Synechron is seeking a Python Data Engineer in Dallas to design, develop, test, and maintain scalable data pipelines. You will leverage PySpark and Pytest, work with large datasets, and apply ETL/ELT patterns along with automated testing.

Your responsibilities include building data pipelines, REST APIs with Django/Flask, MongoDB schema design, and Kafka streaming. Cloud and CI/CD familiarity are a plus.