Senior Data Pipeline Engineer - Real-Time Telemetry & AWS

Kforce Inc; Redmond (WA); On-site; AUD 243,000 - 300,000; Full time

Job summary

Kforce Inc. seeks a Software Development Engineer IV for an enterprise client in Redmond, WA. You will design, build, and operate batch and streaming data pipelines ingesting telemetry and manufacturing data.

Responsibilities include building AWS infrastructure as code, optimizing databases, developing backend services and APIs, and ensuring reliability in a mission-critical environment.

Qualifications

• Bachelor's degree in Computer Science, Engineering, or related technical field.
• 10+ years of professional software development experience in production environments.
• 5+ years building and operating production data pipelines, both batch and streaming.
• Fluent in Python and Java, with production code written in each.
• Strong understanding of software design patterns, data structures, and algorithms.
• Experience with version control systems and CI/CD pipelines.
• Knowledge of distributed systems and cloud computing platforms.
• Understanding of IAM and least-privilege access patterns.
• Experience with Docker and AWS.
• Experience designing ETL/ELT processes, including incremental loads, backfills, and late/out-of-order data.
• Experience with Spark or Flink for distributed batch/stream processing.
• Experience running pipelines in production: monitoring, data quality checks, and recovery.
• Hands-on experience with AWS storage, compute, and data processing services.
• Experience defining and deploying cloud infrastructure as code.
• Proficiency with SQL; NoSQL useful.
• Experience with data modeling, schema design, and data warehousing concepts.

Responsibilities

• Design, build, and operate batch and streaming data pipelines ingesting telemetry and manufacturing data.
• Build and maintain AWS infrastructure behind pipelines, deployed as code.
• Optimize high-performance databases to handle massive telemetry and operational data.
• Develop backend services and APIs to serve data to internal users and tools.
• Handle day-to-day data operations: backfills, data checks, and publishing datasets.
• Monitor pipeline health and data quality; troubleshoot production issues.
• Collaborate with hardware engineers, network architects, and scientists.
• Ensure system reliability, scalability, and performance in a mission-critical environment.

Skills

Python

Java

Distributed systems

CI/CD pipelines

AWS

Docker

SQL

NoSQL databases

ETL/ELT

Data pipelines

Batch processing

Streaming processing

Education

Bachelor's degree in Computer Science, Engineering, or related technical field

Tools

Apache Spark

Apache Flink

CI/CD tools

Git

AWS infrastructure as code

Job description

Kforce Inc. seeks a Software Development Engineer IV for an enterprise client in Redmond, WA. You will design, build, and operate batch and streaming data pipelines ingesting telemetry and manufacturing data.

Responsibilities include building AWS infrastructure as code, optimizing databases, developing backend services and APIs, and ensuring reliability in a mission-critical environment.