Hands-on AI Engineer: Kafka, R & Databricks Expert

CloudFirst Corp; Hartford (CT); On-site; USD 85,000 - 117,000; Full time

Benefits offered by this job

Wellness perks

Databricks training

Flexible hours

Job summary

CloudFirst Corp seeks an AI Engineer in Hartford, CT to design, own, and optimize data pipelines using Kafka and Databricks. You will document decisions, trace data through Databricks, and ensure data integrity across RAG stores while shipping incremental platform improvements.

You will thrive with precise problem solving, owning projects, and collaborating with a Hartford-based client-focused team that values tangible ownership and timely delivery.

Qualifications

• Experience with distributed data systems and streaming pipelines.
• Ability to document architecture, decisions and APIs.
• Familiarity with memory profiling and performance tuning in data apps.

Responsibilities

• Document decisions, architecture, and APIs for the broader org.
• Diagnose and decode undocumented R service implementations.
• Trace data lineage through Databricks to validate calculations.
• Profile R memory use and diagnose leaks in Hartford nodes.
• Translate vague tickets into crisp Kafka acceptance criteria.
• Own data integrity across RAG stores for accurate Hartford metrics.
• Deliver incremental platform improvements on a regular cadence.
• Lead postmortems to prevent Hartford outages from recurring.

Skills

Kafka design

R memory profiling

Databricks

Data integrity

Tools

Databricks

Job description

CloudFirst Corp seeks an AI Engineer in Hartford, CT to design, own, and optimize data pipelines using Kafka and Databricks. You will document decisions, trace data through Databricks, and ensure data integrity across RAG stores while shipping incremental platform improvements.

You will thrive with precise problem solving, owning projects, and collaborating with a Hartford-based client-focused team that values tangible ownership and timely delivery.