Cloud Data Engineer: Spark, Kafka & Pipelines

Innova Solutions Inc; Phoenix (AZ); On-site; USD 55,000 - 58,000; Full time

Benefits offered by this job

Medical & pharmacy coverage

Dental/vision insurance

401(k)

Health saving account (HSA)

Flexible spending account (FSA)

Life Insurance

Pet Insurance

Disability insurance

Pre‑paid legal & ID protection

Sick time

Paid leaves as required by law

Employee Assistance Program (EAP)

Job summary

Innova Solutions Inc seeks a Data Engineer to join a client project on a full-time contract based in Phoenix, AZ, with work across Charlotte, Irving, Minneapolis as well. You will design scalable data pipelines, implement streaming data using Kafka, Flink, and Spark, and ensure data governance.

You should have 5+ years in data engineering, with Hadoop and Google Cloud expertise, Python, PySpark, SQL, and modern data tooling. Competitive pay and comprehensive benefits offered.

Qualifications

• 5 years of experience in data engineering with Hadoop and Google Cloud data solutions.
• Hands-on experience developing data flows using Kafka, Flink, and Spark streaming.
• Experience with Data Lakehouse architecture and design.
• Proficiency in Python, PySpark, Apache Kafka, Airflow, and SQL, GCP Cloud Storage, BigQuery, Data Proc, Cloud Composer.
• NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats.

Responsibilities

• Creating/supporting Spark based processing, Kafka streaming.
• Developing data flows using Kafka, Flink, and Spark streaming.
• Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance

Skills

Spark

Kafka

Flink

PySpark

Python

Airflow

SQL

Hadoop

BigQuery

Cloud Storage

Data Lakehouse

Data Proc

Cloud Composer

NoSQL

Tools

Hive

HDFS

Parquet

Iceberg

Delta Tables

Job description

Innova Solutions Inc seeks a Data Engineer to join a client project on a full-time contract based in Phoenix, AZ, with work across Charlotte, Irving, Minneapolis as well. You will design scalable data pipelines, implement streaming data using Kafka, Flink, and Spark, and ensure data governance.

You should have 5+ years in data engineering, with Hadoop and Google Cloud expertise, Python, PySpark, SQL, and modern data tooling. Competitive pay and comprehensive benefits offered.