Senior Data Engineer

Zuven technologies Inc; Malvern (Chester County); On-site; USD 120,000 - 180,000; Full time

Job summary

Zuven technologies Inc is seeking a senior Data Engineer to orchestrate data extraction from diverse sources and engineer scalable pipelines. The role includes providing expert production support to ensure reliability in a large-scale cloud environment.

The ideal candidate brings 5-7+ years of Data Engineering experience with Python, Spark, and AWS data services, and collaborates within Agile teams to deliver robust ETL/ELT solutions.

Qualifications

• Bachelor's degree in Computer Science or related field.
• 5-7+ years of enterprise Data Engineering experience.
• Strong Python development experience.
• Advanced SQL programming skills.
• Extensive experience with Apache Spark and PySpark.
• Strong experience with Databricks application.
• Hands-on experience with AWS data services including: S3, AWS Glue, Athena, Lambda, Step Functions, EventBridge.
• Experience building enterprise ETL and ELT pipelines.
• Strong understanding of distributed data processing.
• Experience working with large-scale cloud data platforms.
• Strong knowledge of dimensional data modeling.
• Experience implementing CI/CD pipelines.
• Familiarity with Agile/Scrum methodologies.
• Excellent communication and stakeholder management skills.

Responsibilities

• Orchestrate data extraction from diverse legacy and modern sources.
• Engineer high-performance scalable data pipelines.
• Provide expert-level production support to ensure system reliability.

Skills

Python

Apache Spark (PySpark)

AWS Glue ETL

Data Lake concepts

Databricks

Sagemaker

Git

GitHub Actions

CloudFormation

Terraform

CI/CD

Education

Bachelor's degree in Computer Science or related field

Tools

Airflow

Kafka

Kinesis

Iceberg

Delta Lake

Hudi

Job description

Technical Stack & Requirements:
Core Competencies: Python, Apache Spark (PySpark), AWS Glue ETL, Data Lake concepts (Medallion Architecture), Databricks, Sagemaker.
Infrastructure: CloudFormation/Terraform, CI/CD with GitHub Actions.
Core Responsibilities: Orchestrate data extraction from diverse legacy and modern sources, engineer high-performance scalable pipelines, and provide expert-level production support to ensure system reliability.

Qualifications:
Bachelor's degree in Computer Science or related field.
Strong hands-on experience with Apache Spark and Glue.
Proven ability to work with Python-based data pipelines.
Experience with Git and GitHub Actions is mandatory.

Required Qualifications
Bachelor's degree in Computer Science, Engineering, Information Systems, or related discipline.
5-7+ years of enterprise Data Engineering experience.
Strong Python development experience.
Advanced SQL programming skills.
Extensive experience with Apache Spark and PySpark.
Strong experience with Databricks application.
Hands-on experience with AWS data services including: o S3 o AWS Glue o Athena o Lambda o Step Functions o EventBridge
Experience building enterprise ETL and ELT pipelines.
Strong understanding of distributed data processing.
Experience working with large-scale cloud data platforms.
Strong knowledge of dimensional data modeling.
Experience implementing CI/CD pipelines.
Familiarity with Agile/Scrum methodologies.
Excellent communication and stakeholder management skills. Preferred Qualifications
Financial Services or Asset Management industry experience.
Knowledge of Apache Iceberg, Delta Lake, or Hudi.
Experience with Airflow.
Knowledge of Kafka or Kinesis streaming.
Experience supporting AI/ML and advanced analytics platforms.
AWS Professional or Specialty Certifications.

Required Skills :

Basic Qualification :

Additional Skills :

Background Check : No

Drug Screen : No