GenAI Data Engineer: Cloud Pipelines for AI Platform

RedBeard Solutions; Boston (MA); On-site; USD 120,000 - 170,000; Full time

Benefits offered by this job

Healthcare benefits

Job summary

RedBeard Solutions is seeking a Data Engineer to contribute to an AI-powered platform supporting data-driven solutions, including GenAI. You will partner with engineers, data scientists, and stakeholders to design scalable data infrastructure tailored for government and defense environments.

The role emphasizes cloud-native architectures, Python-based workflows, and robust data pipelines, with opportunities to work across AWS, Azure, and GCP in multi-cloud deployments.

Qualifications

• 5+ years of professional experience in data engineering with a focus on cloud-based solutions.
• Experience supporting defense or government environments, including handling sensitive data.

Responsibilities

• Design and build robust data ingestion and processing pipelines to support AI and GenAI applications.
• Develop and maintain Python-based data workflows, including testing and validation.
• Collaborate with cross-functional teams including software engineers, data scientists, and UI/UX designers.
• Implement and enhance CI/CD pipelines (GitHub Actions) to streamline deployment and integration.
• Work across multi-cloud environments (AWS primarily; exposure to Azure and GCP is beneficial).
• Utilize Docker and containerized workflows to support scalable deployments.
• Contribute to the development and optimization of data systems used by generative AI applications.
• Ensure performance, reliability, and scalability of data pipelines through monitoring and diagnostics.

Skills

Python

Cloud data engineering

Data pipelines

CI/CD

Docker

Knowledge graphs

Neo4j

Data modeling

Testing & validation

Communication

Tools

AWS

GitHub Actions

Docker

Azure

GCP

Job description

RedBeard Solutions is seeking a Data Engineer to contribute to an AI-powered platform supporting data-driven solutions, including GenAI. You will partner with engineers, data scientists, and stakeholders to design scalable data infrastructure tailored for government and defense environments.

The role emphasizes cloud-native architectures, Python-based workflows, and robust data pipelines, with opportunities to work across AWS, Azure, and GCP in multi-cloud deployments.