AI Data Engineer - AI Training data

Blueprint Technologies; Seattle (WA); On-site; USD 150,000 - 160,000; Full time

Benefits offered by this job

Medical, dental, and vision coverage

401k program

PTO offerings

Parental Leave

Job summary

Blueprint Technologies in Seattle, WA is seeking an AI Data Engineer to turn raw data into training-ready datasets. You will design Python-based pipelines, implement OCR and text workflows, and ensure data quality and traceability while managing datasets in Azure.

You will collaborate with applied scientists and engineers to translate AI training needs into scalable workflows and operate large-scale batch jobs that produce standardized outputs. The role is onsite five days a week.

Qualifications

• 5+ years of professional experience in data engineering or data science.
• Proficiency in Python with modular coding practices.
• Experience building datasets from raw data.
• Azure storage and data lake familiarity.
• Ability to process large-scale structured and unstructured data.

Responsibilities

• Design, develop, maintain, and optimize Python data pipelines for ingestion, processing, and transformation.
• Create datasets from raw data by collecting, organizing, cleaning, validating, and preparing.
• Develop OCR and text-processing workflows including extraction, normalization, filtering, segmentation, and deduplication.
• Run and monitor large-scale batch processing jobs, troubleshoot failures, and implement retries.
• Build automated data quality checks for data integrity and completeness.
• Prepare high-quality training datasets and manage data versioning and traceability.
• Collaborate with scientists and engineers to translate AI training needs into scalable workflows.

Skills

Python

Data pipelines

Azure

SQL

Data quality

Linux

Tools

Azure Databricks

Hugging Face Datasets

PySpark

Git

CI/CD

Job description

Blueprint Technologies is seeking an AI Data Engineer to help turn raw structured and unstructured data into training-ready datasets. This role focuses on building Python-based data processing pipelines, including OCR and text workflows, and ensuring data quality and traceability while managing datasets in Azure.

Working with applied scientists and engineering teams, you will translate AI training needs into scalable, repeatable workflows, then operate large-scale batch jobs that produce consistent, standardized outputs. The position is based in Seattle, WA with a five-day onsite schedule.

What you’ll do

• Design, develop, maintain, and optimize Python data pipelines for large-scale ingestion, processing, and transformation.
• Create datasets from scratch by collecting, organizing, cleaning, validating, and preparing raw structured and unstructured data.
• Develop OCR and text-processing workflows including text extraction, normalization, filtering, segmentation, and deduplication.
• Run and monitor large-scale batch processing jobs, troubleshoot failures, and implement automated retry and recovery mechanisms.
• Build automated data quality checks to detect missing or corrupted files, incomplete outputs, duplicate records, formatting issues, and metadata inconsistencies.
• Prepare high-quality training datasets using filtering, tokenization, text segmentation, and conversion into standardized formats.
• Manage bulk data uploads, downloads, and synchronization between local processing environments and Azure storage.
• Maintain organized datasets with consistent naming conventions, metadata, version control, and source traceability.
• Optimize performance, including memory utilization, storage efficiency, and cloud resource consumption.
• Monitor dataset statistics, processing coverage, quality metrics, and exceptions, and generate operational reports.
• Collaborate with applied scientists and engineering teams to convert AI training requirements into scalable data workflows.
• Maintain documented, tested, version-controlled code while following established data security and governance requirements.

What you bring

• 5+ years of professional experience in data engineering, pipeline development, or data science with substantial hands-on programming responsibilities.
• Strong proficiency in Python, including reusable modules, debugging, testing, logging, and error handling.
• Proven experience building and developing datasets from scratch, covering ingestion, cleaning, transformation, validation, and preparation.
• Hands-on experience processing large-scale structured and unstructured datasets using memory-efficient, parallel, or distributed approaches.
• Practical experience with Azure Blob Storage or Azure Data Lake Storage, including bulk transfers and access troubleshooting.
• Experience with Python data-processing libraries and formats: pandas, NumPy, JSON/JSONL, CSV, and Parquet.
• Working knowledge of SQL, Git, Linux, and command-line tools.
• Strong troubleshooting and analytical skills with a focus on data quality and integrity.
• Ability to communicate technical challenges and collaborate across engineering and data science teams.

Technologies

Python, Azure Blob Storage, Azure Data Lake Storage, pandas, NumPy, JSON, JSONL, CSV, Parquet, SQL, Git, Linux, OCR, tokenization, Azure Databricks, Azure Machine Learning, Azure Data Factory, Hugging Face Datasets, PySpark, CI/CD

Preferred qualifications

• Experience building OCR pipelines for scanned documents, multilingual text, or document-layout data.
• Experience with Azure Databricks, Azure Machine Learning, Azure Data Factory, or similar workflow orchestration platforms.
• Familiarity with Hugging Face Datasets, AI/ML tokenization, near-duplicate detection, and separating training and evaluation data.
• Experience with large-scale dataset curation and preparation for AI or machine learning training.
• Knowledge of distributed processing frameworks such as PySpark.
• Experience with dataset lineage, reproducibility, containerized environments, and CI/CD practices.
• Track record optimizing pipelines for performance, reliability, scalability, and cost efficiency.

Salary and location

• Salary range: USD 150,000 to 160,000 per year.
• Location: Seattle, WA (onsite), 5 days onsite.

Benefits

• Medical, dental, and vision coverage
• Flexible Spending Account
• 401k program
• Competitive PTO offerings
• Parental Leave
• Opportunities for professional growth and development

Applicant accommodations

If you need a reasonable accommodation to participate in any part of the application or interview process, please contact [e-mail].