Data Engineer — Spark, Kafka & Cloud Data Pipelines

American Cybersystems, Inc.

Phoenix (AZ)

On-site

USD 55,000 - 58,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical & pharmacy coverage

Dental/vision insurance

401(k)

HSA and FSA

Life Insurance

Pet Insurance

Short term and Long term Disability

Pre-paid legal & ID theft protection

Sick time and other paid leaves

Employee Assistance Program

Job summary

Innova Solutions is seeking a Data Engineer for a client project in multiple US locations including Charlotte, NC; Irving, TX; Phoenix, AZ; and Minneapolis, MN. You will build and optimize data pipelines, leverage Spark, Kafka, Flink, and cloud data services to enable real-time analytics and governance across large datasets.

The ideal candidate has 5+ years in data engineering, hands-on experience with Hadoop and Google Cloud data solutions, and strong Python/SQL skills.

Qualifications

5 years of experience in data engineering, including Hadoop and Google Cloud data solutions.
Hands-on data flows using Kafka, Flink, and Spark streaming.
Experience with Data Lakehouse architecture and design.
Experience with Python, PySpark, Apache Kafka, Airflow, and SQL, GCP Cloud Storage, BigQuery, Data Proc, Cloud Composer.
NoSQL databases such as columnar databases, graph databases, document databases, KV stores, and associated data formats.

Responsibilities

Creating/supporting Spark based processing, Kafka streaming.
Developing data flows using Kafka, Flink, and Spark streaming.
Design and implementation of highly scalable and modular data pipelines with built-in data controls for automating data governance.