Software Engineer

Motion Recruitment; Phoenix (AZ); On-site; USD 120,000 - 180,000; Full time

Job summary

Motion Recruitment seeks a Software Engineer focused on data engineering to support a large-scale cloud data platform in Phoenix. You will work with GCP, Hadoop, Spark, Kafka, Flink, PySpark, Airflow, BigQuery, and related technologies to build scalable pipelines and lakehouse architectures.

The role emphasizes real-time data processing, cloud modernization, and collaboration with an experienced engineering team, with a 12-month contract and W2 terms in the United States.

Qualifications

• 2+ years Software Engineering experience.
• 5+ years data engineering with Hadoop and Google Cloud data solutions.
• Experience creating and supporting Spark-based processing and Kafka streaming solutions.
• 2+ years developing data flows using Kafka, Flink, and Spark Streaming.
• 3+ years experience with data lakehouse architecture and design.
• Hands-on experience with Python, PySpark, Apache Kafka, Airflow, and SQL.
• Experience with GCP Cloud Storage, BigQuery, Dataproc, Cloud Composer.
• 2+ years experience with NoSQL databases (columnar, graph, document, key-value).
• Public cloud certification such as GCP Professional Data Engineer, Azure Data Engineer, AWS Specialty Data Analytics.

Responsibilities

• GCP and cloud-native data engineering tasks.
• Hadoop and data lakehouse technologies support.
• Spark, Kafka, and Flink streaming and processing work.
• Python, PySpark, Airflow, and SQL development.
• BigQuery, Dataproc, Cloud Composer, and Cloud Storage usage.
• NoSQL databases and modern data formats management.
• CI/CD, containerization, and DevOps tooling involvement.
• GenAI frameworks and agent-based data capabilities exploration.

Skills

Software Engineering

Data engineering

Spark

Kafka

Flink

Python

PySpark

Airflow

SQL

GCP

BigQuery

Dataproc

Cloud Composer

NoSQL

GCP Certification

Tools

Hadoop

Hive

HDFS

Parquet

Iceberg

Delta Tables

Jenkins

Docker

Kubernetes

Job description

This Software Engineer opportunity is based in Phoenix, Arizona, supporting a large-scale data engineering environment focused on modern cloud and streaming technologies. You’ll work extensively with Google Cloud Platform (GCP), Hadoop, Spark, Kafka, Flink, Python, PySpark, Airflow, BigQuery, and related data technologies. This is a 12-month W2 contract opportunity.

This role is a great fit for a data engineer who wants to work at the intersection of cloud modernization, real-time data processing, and scalable data architecture. You’ll have the opportunity to help build and support modern data pipelines, work with lakehouse technologies, and gain exposure to emerging GenAI capabilities while collaborating with an experienced engineering team.

Contract Duration: 12 Months

Required Skills & Experience

• 2+ years of Software Engineering experience, or equivalent experience through work, consulting, training, military experience, or education
• 5+ years of data engineering experience, including hands-on experience with Hadoop and Google Cloud data solutions
• Experience creating and supporting Spark-based processing and Kafka streaming solutions in a highly collaborative environment
• 2+ years of hands-on experience developing data flows using Kafka, Flink, and Spark Streaming
• 3+ years of experience with data lakehouse architecture and design
• Hands-on experience with Python, PySpark, Apache Kafka, Airflow, and SQL
• Experience with GCP Cloud Storage, BigQuery, Dataproc, and Cloud Composer
• 2+ years of experience with NoSQL databases, including columnar, graph, document, and key-value databases and associated data formats
• Public cloud certification such as GCP Professional Data Engineer, Azure Data Engineer, or AWS Specialty Data Analytics

Desired Skills & Experience

• Proven experience migrating data from on-premises environments to cloud-native platforms
• Experience with the Hadoop ecosystem, including Hive, HDFS, Parquet, Iceberg, and Delta Tables
• Deep understanding of data warehouses, cloud data architecture, data pipeline development, and orchestration
• Experience designing and implementing highly scalable, modular data pipelines with built-in data controls and automated data governance
• Familiarity with GenAI frameworks such as LangChain and LangGraph for developing agent-based data capabilities
• DevOps and CI/CD experience with Git, Jenkins, Docker, and Kubernetes
• Web-based UI development experience with React and Node.js is a plus

What You Will Be Doing

• GCP and cloud-native data engineering
• Hadoop and data lakehouse technologies
• Spark, Kafka, and Flink streaming and processing
• Python, PySpark, Airflow, and SQL
• BigQuery, Dataproc, Cloud Composer, and Cloud Storage
• NoSQL databases and modern data formats
• CI/CD, containerization, and DevOps tooling
• GenAI frameworks and agent-based data capabilities

Daily Responsibilities

• Participate in low to moderately complex Software Engineering initiatives and identify opportunities for process improvement
• Review and analyze tactical engineering assignments and challenges requiring research, evaluation, and selection of technical alternatives
• Develop and support scalable data processing, streaming, and cloud data solutions
• Present recommendations for resolving engineering challenges while exercising independent judgment
• Develop an understanding of applicable functions, policies, procedures, and compliance requirements
• Provide technical information and support to client personnel within Software Engineering
• Collaborate with engineering team members on data architecture, pipelines, processing, and cloud modernization initiatives