Senior Big Data & AI Pipeline Engineer

PlanIT Group, LLC; Fort Worth (TX); On-site; USD 110,000 - 190,000; Full time

Job summary

PlanIT Group, LLC is seeking an experienced engineer to design and implement automated system capabilities and big-data processing architectures from concept through deployment. The role involves developing data pipelines, integrating AI/ML models, and collaborating with cross-functional teams to meet stakeholder requirements.

The ideal candidate holds a STEM degree with 5+ years in C#/C++ or 2+ years in Rust, and has exposure to distributed systems and big-data tools, plus familiarity with

Qualifications

• STEM degree and 5+ years of experience with C#/C++ or 2+ years with Rust.
• Experience with distributed system architectures, big-data tools.
• Familiarity with airborne sensing systems.

Responsibilities

• Design and implement automated system capabilities and big-data processing architectures from concept through deployment.
• Develop data pipelines and integrate AI/ML models.
• Collaborate with multi-disciplinary teams to meet stakeholder requirements.

Skills

C#

C++

Rust

Python

Big Data Architecture

Distributed Systems

Hadoop

Iceberg

Impala

Trino

S3 Protocol

SeaweedFS

Minio

Object Oriented Programming

Test Driven Development

AI/ML Integration

Education

STEM degree

Job description

PlanIT Group, LLC is seeking an experienced engineer to design and implement automated system capabilities and big-data processing architectures from concept through deployment. The role involves developing data pipelines, integrating AI/ML models, and collaborating with cross-functional teams to meet stakeholder requirements.

The ideal candidate holds a STEM degree with 5+ years in C#/C++ or 2+ years in Rust, and has exposure to distributed systems and big-data tools, plus familiarity with