Remote Data Engineer – AI/ML & Cloud Data Pipelines

IntraEdge Technology; United States; Remote; USD 120,000 - 170,000; Full time

Job summary

IntraEdge Technology is seeking a Data Engineer - AI/ML Engineer to design and maintain scalable data pipelines for analytics, ML, and operations. You will work with Python, SQL, and modern data engineering frameworks, collaborating with Data Scientists to productionize NLP models.

The role includes building batch and streaming pipelines with Kafka, using GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage) and deploying data APIs.

Qualifications

• 5+ years building data pipelines or backend data workflows.
• 2+ years designing REST/GraphQL data services or APIs.
• Hands-on ML/AI model integration in production.
• Experience with healthcare data, NLP, and structured/unstructured datasets.
• 2+ years cloud platforms (GCP preferred).
• 2+ years with Kafka or similar streaming platforms.
• 2+ years databases (Postgres or equivalent).
• 2+ years CI/CD tools and IaC (Terraform preferred).
• 2+ years Kubernetes (GKE/EKS/AKS).
• Knowledge of cloud networking and IAM workflows.
• Familiarity with monitoring tools.

Responsibilities

• Design, build and maintain scalable data pipelines for analytics, ML, and reporting.
• Develop robust data ingestion, transformation, and integration workflows with Python/SQL.
• Build batch and streaming pipelines using Kafka and modern frameworks.
• Leverage GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage, Cloud Functions).
• Develop data APIs (REST/GraphQL) for high-performance access across microservices.
• Implement CI/CD automation for data pipelines (GitHub Actions, Argo CD).
• Collaborate with Data Scientists to integrate ML/NLP models into pipelines.
• Operationalize NLP data pipelines for structured/unstructured data (Rx claims, clinical docs).
• Enable model retraining workflows using Vertex AI, Kubeflow, or similar tooling.
• Establish observability/data quality with logs, metrics, and data lake integration.
• Support reliability, performance, and scalability of data infrastructure.

Skills

Python

SQL

Data pipelines

REST API

GraphQL

Kafka

GCP

Kubernetes

CI/CD

IAM

Monitoring

NLP

MLOps

Vertex AI

Education

Bachelor's degree in Computer Science or related field

Tools

Terraform

GitHub Actions

Argo CD

Jenkins

Pulumi

Job description

IntraEdge Technology is seeking a Data Engineer - AI/ML Engineer to design and maintain scalable data pipelines for analytics, ML, and operations. You will work with Python, SQL, and modern data engineering frameworks, collaborating with Data Scientists to productionize NLP models.

The role includes building batch and streaming pipelines with Kafka, using GCP services (BigQuery, Dataflow, Pub/Sub, Cloud Storage) and deploying data APIs.