Senior Data Engineer - Spark, Kafka & Cloud Data Pipelines

American Cybersystems, Inc.; Phoenix (AZ); On-site; USD 96,000 - 110,000; Full time

Benefits offered by this job

Medical & Pharmacy coverage

Dental & Vision insurance

401(k)

HSA/FSA

Life Insurance

Pet Insurance

Disability Insurance

Accident & Critical Illness Coverage

Pre-paid Legal & ID Theft Protection

Sick Time & Paid Leaves

Employee Assistance Program (EAP)

Referral Bonus

Job summary

Innova Solutions is seeking a Lead Data Engineer to drive large-scale data processing using Spark, Kafka, Flink, and cloud data services. You will design, build, and govern scalable data pipelines across environments, ensuring robust governance and performance at scale.

The role requires expertise in Python, PySpark, SQL, Airflow, and cloud tools, with a bias toward data lakehouse architectures and modern data platforms. This is a contract-length, full-time opportunity with multiple U.S.

Qualifications

• 10+ years in data engineering with Hadoop and Google Cloud data solutions.
• Experience building data flows with Kafka, Flink, and Spark streaming.
• Data Lakehouse architecture experience.
• Proficient in Python, PySpark, Kafka, Airflow, SQL, BigQuery, Data Proc, Cloud Composer.
• Experience with NoSQL databases and formats.

Responsibilities

• Create/support Spark-based processing and Kafka streaming.
• Develop data flows using Kafka, Flink, and Spark streaming.
• Design scalable data pipelines with built-in data governance controls.

Skills

Spark streaming

Kafka

Flink

Python

PySpark

Airflow

SQL

BigQuery

Data Proc

Cloud Storage

Hadoop

Data Lakehouse

NoSQL databases

Tools

Git

Jenkins

Docker

Kubernetes

React

Node JS

Job description

Innova Solutions is seeking a Lead Data Engineer to drive large-scale data processing using Spark, Kafka, Flink, and cloud data services. You will design, build, and govern scalable data pipelines across environments, ensuring robust governance and performance at scale.

The role requires expertise in Python, PySpark, SQL, Airflow, and cloud tools, with a bias toward data lakehouse architectures and modern data platforms. This is a contract-length, full-time opportunity with multiple U.S.