Senior Data Scientist

Ampcus Inc; Chantilly (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

Ampcus Inc in Chantilly, VA is seeking a Data Scientist to own the full lifecycle of AI metrics and the AI Metrics Hub. The role blends data science, analytics engineering, and software development to define, implement, and continuously improve enterprise metrics and dashboards.

You will architect data models, pipelines, and NLP/RAG capabilities, collaborate in Agile/SAFe settings, and partner with business stakeholders to deliver self-service insights at scale.

Qualifications

• Bachelor’s or Master’s degree in Data Science, Computer Science, Analytics, or related field.
• 6–10+ years of experience in data science, analytics engineering, or related field.
• Proven experience owning the full lifecycle of metrics/KPI frameworks (definition through implementation).
• Experience building data products, analytics platforms, or metrics systems.
• Experience working in Agile and/or SAFe environments.

Responsibilities

• Own the full lifecycle of AI metrics, including definition, implementation, and operational monitoring.
• Define and maintain a comprehensive AI metrics framework, including ROI, performance, risk, and cost.
• Translate business questions into well-defined metrics and models.
• Architect scalable metric models with KPI definitions and aggregation strategies.
• Develop and maintain SQL and Python logic for KPI calculation; integrate data from multiple sources.
• Design and build the AI Metrics Hub with dashboards and self-service views.

Skills

SQL

Python

Data modeling

KPI design

Stakeholder communication

Education

Bachelor’s or Master’s degree in Data Science/CS/Analytics

Tools

Databricks

APIs (FastAPI)

Job description

The Data Scientist, AI Metrics & Portal is a technical role responsible for owning the full lifecycle of AI Program metrics, including defining, architecting, implementing, operationalizing, and continuously improving a standardized AI metrics capability. This role combines data science, analytics engineering, artificial intelligence, and software development to: (1) Establish AI Program metrics—from conceptual definition through technical implementation and ongoing optimization, and (2) Design, build, and operate a modern, lightweight AI Metrics Hub, leveraging Claude Code and other tech stack tools to rapidly develop and maintain an extensible analytics platform.

The Data Scientist will define and operationalize standardized AI metrics, architect the supporting data and application layers, implement dynamic visualization and AI-driven querying capabilities, and ensure continuous evolution of the platform to meet business needs.

The role will orchestrate metrics design, platform engineering, and Agile delivery practices to:

• Define, standardize, and govern AI metrics across adoption, utilization, performance, value, cost, risk, and other categories.
• Architect scalable data models and metrics frameworks to ensure consistency and reuse.
• Implement and operationalize metrics pipelines, logic, and computation layers.
• Design and build an analytics platform with AI metrics catalog, standard/pre-configured AI dashboards, and self-service AI dashboards and exploration.
• Implement AI-powered natural language querying and discovery capabilities.
• Maintain and evolve metrics definitions, lineage, and supporting documentation.
• Deliver iteratively using Agile and SAFe methodologies.
• Enable continuous improvement and future integration with enterprise platforms (e.g., Databricks, Collibra).

This role requires a balance of hands-on implementation, architecture ownership, and delivery leadership, with accountability for the end-to-end lifecycle of AI metrics and insights capabilities.

Key Responsibilities

• Own the full lifecycle of AI metrics, including:
  • Definition and standardization
  • Technical implementation
  • Operational monitoring
• Define and maintain a comprehensive AI metrics framework, including:
  • Business value and ROI
  • Performance and quality
  • Risk, compliance, and cost
• Translate business questions into well-defined, implementable metrics and models
• Architect scalable, reusable metric models, including:
  • KPI definitions and calculation logic
  • Dimensional structures and aggregation strategies
• Establish and enforce standards for consistency, governance, and reuse
• Ensure metrics are designed for extensibility and enterprise integration
• Design and implement metrics computation pipelines and transformations
• Develop and maintain SQL and Python logic for KPI calculation
• Integrate and normalize data from multiple sources (logs, APIs, databases, surveys, risk reviews, and more)
• Ensure data accuracy, consistency, and performance optimization
• Implement data quality validation and monitoring processes

4. AI Metrics Portal Development

• Architect, build, and maintain the AI Metrics Hub application
• Develop platform components, including:
  • Metrics registry (definitions, metadata, ownership)
  • Dynamic dashboard and visualization engine
• Leverage AI-assisted development tools (e.g., Claude Code) to:
  • Improve maintainability
• Ensure platform supports rapid iteration and long-term scalability

5. AI / NLP / RAG Integration

• Design and implement natural language interfaces for interacting with metrics
• Build and maintain RAG pipelines leveraging:
  • Metric definitions
  • Metadata and contextual information
• Develop prompt engineering strategies and query translation logic
• Enable workflows such as:
  • Continuously improve AI output accuracy, usability, and relevance

6. Visualization & Self-Service Enablement

• Design and implement dynamic, user-configurable dashboards and visualizations
  • Filtering, slicing, and drill-down analysis
  • Customizable chart configurations
  • Saved and shareable views
• Ensure intuitive and scalable self-service user experience
• Develop and maintain:
  • Data models and lineage documentation
  • AI workflow and prompt design documentation
• Ensure documentation supports transparency, governance, and reuse

8. Agile / SAFe Delivery Execution

• Lead quarterly SAFe Program Increment (PI) planning participation and execution
• Define and manage:
  • Epics, features, and user stories
• Partner with Scrum Master to:
  • Plan and execute sprints
  • Maintain and prioritize backlog
• Ensure continuous delivery aligned to program priorities and timelines

9. Cross-Functional Collaboration

• Collaborate with:
  • AI Program leadership
  • Business stakeholders
  • Data and platform engineering teams
• Translate requirements into metrics, architecture, and implemented solutions
• Communicate outputs clearly to technical and non-technical audiences

10. Platform Evolution & Integration

• Design and evolve the platform to integrate with:
  • Databricks
  • Collibra
• Identify opportunities to:
  • Improve usability
  • Increase performance and scalability
• Continuously evaluate and adopt emerging AI and analytics capabilities

11. Governance, Quality & Performance

• Establish and enforce metrics governance processes
• Implement quality controls and validation rules for data and KPIs
• Monitor system usage and platform performance
• Ensure compliance with enterprise data, security, and governance standards

Required Qualifications

Education & Experience

• Bachelor’s or Master’s degree in Data Science, Computer Science, Analytics, or related field
• 6–10+ years of experience in data science, analytics engineering, or related field
• Proven experience owning the full lifecycle of metrics/KPI frameworks (definition through implementation)
• Experience building data products, analytics platforms, or metrics systems
• Experience working in Agile and/or SAFe environments

Technical Skills

Data & Analytics

• Advanced SQL (complex queries, performance optimization)
• Strong Python for data processing and analytics
• Deep experience in data modeling and KPI design
• Experience with:
  • Retrieval-augmented generation (RAG)
  • Vector search

Software Development

• Experience building data-driven applications and APIs
• Backend frameworks (Node.js, FastAPI, or similar)
• Experience with front-end frameworks (React preferred)
• Experience with charting libraries (ECharts, Recharts, D3) or BI tools
• Strong data visualization and UX principles

Data Platforms (Preferred)

• Exposure to Databricks
• Experience with ETL/data pipeline frameworks
• Strong systems thinking and architecture mindset
• Ability to own and execute across the full lifecycle of solutions
• Capability to translate business needs into scalable metrics and data solutions
• Balance between rapid prototyping and maintainable design
• Strong communication and stakeholder engagement skills
• Ownership mindset and comfort operating in ambiguity
• Continuous learning in AI, analytics, and emerging technologies

Summary: A hands-on data scientist responsible for the full lifecycle of AI metrics—defining, architecting, implementing, and evolving a modern, AI-powered analytics platform and metrics that enables self-service insights across the enterprise.