AI Data Engineer

Artifintech; Georgia; On-site; USD 120,000 - 180,000; Full time

Job summary

Artifintech is seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure supporting AI/ML, RAG, and LLM applications. The role requires strong SQL, Python/Scala, and cloud data platforms, with experience handling structured and unstructured data.

You will design ingestion pipelines, build embedding workflows, and ensure data quality, governance, and security while enabling ML model training and deployment. This position is based in Georgia, USA.

Qualifications

• Experience designing and maintaining scalable data pipelines.
• Knowledge of data governance, lineage, and access controls.
• Experience supporting ML model training and MLOps workflows.

Responsibilities

• Design and develop data ingestion, transformation, and processing pipelines.
• Build embedding pipelines and integrate vector databases.
• Develop data pipelines supporting RAG, chunking, and vector search.
• Process structured and unstructured data (PDFs, documents, logs, transcripts).
• Implement data quality, governance, lineage, and access controls.
• Support ML model training, inference, MLOps, and LLMOps workflows.
• Optimize data pipelines for performance, scalability, and cost.

Skills

SQL

Python

Scala

RAG

Vector Databases

Embeddings

Vector Search

Unstructured Data Processing

ML Lifecycle Knowledge

Tools

Airflow

dbt

Snowflake Cortex

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization:US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other

Job Summary

Seeking an experienced AI Data Engineer to build and maintain scalable data pipelines and infrastructure supporting AI/ML, RAG, and LLM applications. The candidate should have strong SQL, Python/Scala, cloud data platforms, and experience processing structured and unstructured data.

Key Responsibilities

• Design and develop data ingestion, transformation, and processing pipelines.
• Build embedding pipelines and integrate vector databases.
• Develop data pipelines supporting RAG, chunking, and vector search.
• Process structured and unstructured data (PDFs, documents, logs, transcripts).
• Implement data quality, governance, lineage, and access controls.
• Support ML model training, inference, MLOps, and LLMOps workflows.
• Optimize data pipelines for performance, scalability, and cost.

Mandatory Skills

• Strong SQL and Python/Scala.
• Apache Airflow / dbt.
• RAG, Vector Databases, Embeddings, and Vector Search.
• Unstructured Data Processing.
• ML Lifecycle Knowledge.

Nice to Have

• Snowflake Cortex / Cortex Search.
• Financial Services / Regulated Industry Experience.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.