Design and operate next-generation data infrastructure that powers applied AI solutions for both human analysis and machine consumption.
Key Responsibilities
- Design, build, and maintain next-generation data infrastructure that serves both human analysts and AI systems.
- Partner across organizational boundaries with data scientists, engineers, analytics teams, and business stakeholders to deliver innovative, scalable solutions using data assets.
- Maintain dataset accuracy, consistency, and observability by implementing monitoring, lineage tracking, and self-healing mechanisms for data quality at scale.
- Deliver infrastructure interfaces, documentation, and metadata for analysts/scientists and autonomous AI agents.
- Drive a forward-looking infrastructure strategy that accounts for evolving AI system needs while meeting reliability and performance expectations for business operations.
- Contribute to a technical roadmap for data systems supporting the organization’s AI transformation.
- Build and operate production pipelines and warehouses (5+ years).
- Build AI-serving data infrastructure, including machine-consumable interfaces, metadata, and documentation for autonomous agents.
- Implement GenAI data patterns end to end: chunking, embeddings, and vector stores for retrieval-augmented generation.
- Build and maintain datasets and feature pipelines for ML/GenAI training, fine-tuning, and inference (Amazon SageMaker, Bedrock, or equivalent).
- Implement data quality, lineage, and observability for AI workloads, including validation, freshness/anomaly monitoring, and alerting at scale.
- Use advanced SQL and a production mindset to deliver performance-tuned data systems.
- Operate batch and streaming ETL/ELT on AWS (Glue, EMR/Spark, S3, Athena) and a production cloud data warehouse (Amazon Redshift or equivalent).
- Design data models and schemas for analytical, operational, and AI/retrieval workloads.
- Use workflow orchestration such as Step Functions, Airflow, or Glue Workflows.
Requirements
- 3+ years of data engineering experience.
- 1+ years developing and operating large-scale data structures for business intelligence analytics, including data modeling experience.
- Bachelor’s degree or foreign equivalent in Computer Science, Engineering, Information Systems, Mathematics, or a related field.
- Experience with data modeling, warehousing, and building ETL pipelines.
- Experience building data infrastructure that serves AI systems and autonomous agents, including machine-consumable interfaces, metadata, and documentation.
Technologies
- Python, Scala, Java, SQL
- Amazon SageMaker, Amazon Bedrock
- Amazon Glue, EMR, Spark, S3, Athena
- Amazon Redshift
- Step Functions, Airflow, Glue Workflows
- Kinesis, FireHose, Lambda
- IAM roles and permissions
- Vector stores, retrieval-augmented generation
- Chunking, embeddings
Benefits
- Sign-on payments
- Restricted stock units (RSUs)
- Health insurance (medical, dental, vision, prescription)
- Basic Life & AD&D insurance and option for Supplemental life plans
- EAP
- Mental Health Support
- Medical Advice Line
- Flexible Spending Accounts
- Adoption and Surrogacy Reimbursement coverage
- 401(k) matching
- Paid time off
- Parental leave
Location: Seattle, WA (onsite)
Salary: USD 132,100 - 178,800 per year