Pyspark Developer

Tieto; Irving (TX); On-site; USD 140,000 - 190,000; Full time

Job summary

Tieto in Irving, Texas, is seeking an accomplished Data Engineer with 10+ years of IT experience and at least 6 years in data engineering and big data development to design, implement, and optimize scalable data pipelines.

You will work hands-on with PySpark and Spark-based data processing, Apache Iceberg table architecture, and data lake concepts, design and manage workflows in Apache Airflow, and collaborate across teams using SQL, data modeling, Git, and CI/CD to deliver reliable data

Qualifications

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
• Strong hands-on experience with PySpark and Spark-based data processing.
• Strong knowledge of Apache Iceberg table architecture and data lake concepts.
• Experience designing and managing workflows using Apache Airflow.
• Experience with SQL and data modeling techniques.
• Strong understanding of ETL/ELT development and data transformation frameworks.
• Experience working with large-scale structured and unstructured datasets.
• Knowledge of Git, CI/CD pipelines, and DevOps practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Skills

Data engineering

Big data development

PySpark

Spark data processing

SQL

ETL/ELT development

Data modeling

Git

CI/CD

DevOps practices

Communication

Collaboration

Education

Bachelor's degree in CS/IS/Engineering

Tools

Apache Iceberg

Apache Airflow

AWS (S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, CloudWatch)

Kafka

Java

Python

Job description

• Bachelor's degree in Computer Science, Information Systems, Engineering, or related field.
• 10+ years of IT experience with 6+ years in Data Engineering and Big Data development.
• Strong hands-on experience with PySpark and Spark-based data processing.
• Strong knowledge of Apache Iceberg table architecture and data lake concepts.
• Experience designing and managing workflows using Apache Airflow.
• Experience with SQL and data modeling techniques.
• Strong understanding of ETL/ELT development and data transformation frameworks.
• Experience working with large-scale structured and unstructured datasets.
• Knowledge of Git, CI/CD pipelines, and DevOps practices.
• Strong analytical, troubleshooting, and problem-solving skills.
• Excellent communication and collaboration skills.

Preferred Qualifications

• Experience with AWS services including S3, Glue, Lambda, ECS/EKS, EMR, RDS, IAM, and CloudWatch.
• Experience building cloud-native data lake and Lakehouse solutions.
• Strong knowledge of data partitioning, performance tuning, and query optimization.
• Experience with Kafka or event-driven data processing frameworks.
• Experience with Java or Python application development.
• Experience implementing data quality, metadata, and data governance solutions.
• Healthcare, Medicaid, Claims Processing, or Insurance industry experience.
• Experience working in Agile development environments.
• AWS Certification and/or Cloudera Certification preferred.
• Experience supporting large-scale cloud migration and modernization initiatives.