AI-Driven Python & PySpark Data Engineer

Synechron; Dallas (TX); On-site; USD 95,000 - 100,000; Full time

Benefits offered by this job

Competitive compensation

Global opportunities

Paid leave

Medical insurance

Retirement savings plan

Udemy for Business access

Job summary

Synechron is seeking a highly skilled Python/PySpark Data Engineer with AI experience to design, build, and maintain scalable data platforms for enterprise-grade analytics in Dallas, TX. You will work across batch and streaming pipelines, applying best practices in data quality and performance.

The role focuses on integrating AI/ML capabilities, building lakehouse patterns, and delivering reliable ETL/ELT workloads using PySpark, Spark SQL, and Python within a collaborative, globally connected

Qualifications

• Bachelor’s degree in CS/Engineering/IT or related field.
• Experience in data engineering, ETL/ELT pipelines.
• Strong Python, PySpark, Spark SQL, and SQL skills.

Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines using Python, PySpark, and SQL.
• Build reliable ETL/ELT workflows for structured, semi-structured, and unstructured data.
• Develop data processing solutions using Apache Spark, Spark SQL, and DataFrames.
• Integrate data from APIs, databases, files, streaming platforms, and cloud services.
• Implement data quality, validation, monitoring, logging, and error-handling frameworks.
• Optimize Spark jobs, SQL queries, storage formats, partitioning, and cluster performance.
• Develop and manage data lakehouse solutions using Delta Lake, Iceberg, or Hudi.
• Integrate AI and machine learning capabilities into data platforms and workflows.

Skills

Python

PySpark

Spark SQL

SQL

Education

Bachelor's degree in Computer Science, Engineering, Information Technology, or related field

Job description

Synechron is seeking a highly skilled Python/PySpark Data Engineer with AI experience to design, build, and maintain scalable data platforms for enterprise-grade analytics in Dallas, TX. You will work across batch and streaming pipelines, applying best practices in data quality and performance.

The role focuses on integrating AI/ML capabilities, building lakehouse patterns, and delivering reliable ETL/ELT workloads using PySpark, Spark SQL, and Python within a collaborative, globally connected