Data Engineer/Lead Developer

Capio Group; Sacramento (CA); On-site; USD 135,000 - 145,000; Full time

Job summary

Capio Group is seeking an experienced Data Engineer/Lead Developer to join our Sacramento team. This role focuses on building and advancing an Investment Data Warehouse with GenBI, AI/ML capabilities, and scalable analytics across Snowflake and AWS environments.

You will lead a multidisciplinary team, drive data architecture, model delivery, and governance while delivering enterprise BI solutions and AI-powered insights for our clients.

Qualifications

• At least 10 years in data/BI engineering or analytics.
• At least 5 years leading a team (3+ members) to implement enterprise BI/data warehouse solutions.
• At least 5 years working with AI/ML or GenAI technologies.
• At least two proven deliveries of production-grade BI or data products (dashboards, data models, APIs).
• At least two years experience with ETL/ELT pipelines and warehouses (Snowflake, Redshift) and orchestration tools (Airflow, dbt).
• At least two years using OpenAI APIs or similar LLMs, building NL to SQL/query systems.

Responsibilities

• Design analytics dashboards using UI/UX principles with tools like Streamlit, React.
• Leverage SNOWFLAKE.CORTEX and AWS Bedrock to accelerate use cases.
• Develop automated tests to ensure Text-to-SQL accuracy.
• Perform prompt engineering to guide AI platform behavior.
• Lead AI/ML model prototyping with TensorFlow, PyTorch, scikit-learn.
• Oversee CI/CD for ML/data workflows and ETL/ELT pipelines.
• Provide technical leadership and liaise with stakeholders and vendors.

Skills

Data engineering

Leadership

AI/ML knowledge

SQL expertise

Prompt engineering

Communication

Education

Bachelor's degree in CS/CE or related field

Certifications in AWS/Snowflake/BI/AI (desirable)

Tools

Snowflake

Redshift

BigQuery

Power BI

Tableau

Looker

dbt

Airflow

Docker

Kubernetes

Terraform

AWS SageMaker

Azure ML

Vertex AI

Job description

Capio Group is looking for an experienced Data Engineer/Lead Developer!
Full-time employee - Sacramento
Salary: $135,000 - $145,000

About Us:

Capio Group is a California-based Information Technology Consulting firm serving the public sector since 2010. We assist the Government in delivering large, complex systems and solutions. Capio Group is a small, but quickly growing firm that mixes good ideas, with great people, to achieve extraordinary results for our clients. We offer the salary and benefits of the bigger companies, with the added bonus of a flexible workplace and a great work-life balance.

Scope of Work:

Capio Group is looking for an experienced Data Engineer/Lead Developerwith a detailed knowledge and expertise to work as part of a team in assisting with maintaining, enhancing, and advancing client Investment Data Warehouse (IDW) architecture/platform, which is capable of Generative Business Intelligence (GenBI), and Artificial Intelligence, Machine Learning (AI/ML) for providing deeper insights, predictive analytics, and automated decision-making capabilities. Furthermore, it is expected to drastically accelerate the development and deployment of Investment-related BI or GenBI, AI/ML, or agentic AI use cases that are to be deployed onto the IDW residing within the AWS and Snowflake ecosystems. All work must adhere to client AI policies, technology governance, standards, and guidelines.

The scope of key responsibilities and activities for the Data Engineer/Lead Developer includes, but is not limited to, the following:

• Effectively apply User Interface (UI)/ User Experience (UX) design principles for designing and building analytics dashboards with technologies such as Chainlit, Streamlit, and React.
  Create interactive reporting and storytelling based on data visualization best practices, and human- centered design.
• Leverage Out-of-Box (OOB) services/functions/APIs (e.g., calling SNOWFLAKE.CORTEX functions via SQL or configuring AWS Bedrock Knowledge Bases) to accelerate the design and
  implementation of use cases.
• Build automated tests to ensure the platform's Text-to-SQL engine isn't hallucinating incorrect numbers.
• Perform continuous prompt engineering to guide and finetune the platform's system behavior.
• Execute statistical analysis, predictive analytics, optimization; conduct AI/ML model prototyping with ML frameworks such as TensorFlow, PyTorch, scikit-learn.
• Apply expertise in platform-specific semantic layers or dbt (Data Build Tool), advanced SQL and dimensional modeling (Star Schema), and cloud ML platforms (e.g., AWS SageMaker, Azure ML, GCP Vertex AI).
• Implement containerization and orchestration (Docker, Kubernetes).
  Operate CI/CD pipelines for ML and data workflows, data integration, cleaning, and transformation processes.
• Responsible for monitoring, tuning, and logging for AI/ML and GenBI solutions, Extract, Transform, Load (ETL)/ Extract, Load, Transform, (ELT) pipelines (e.g., Airflow, Matillion), cloud data warehouses & lakes (e.g., Snowflake, Redshift, BigQuery, Azure Synapse), and cloud infrastructure automation (e.g., Terraform, Ansible).
• Continuously enhance and verify that the entire IDW ecosystem/solution is cost-effective, secure, and scalable.
• Provide technical leadership, solution guidance to project teams in support of solution design and development, and act as a technical liaison among Investment stakeholders, technical developers, 3rd party vendor teams and tech support.
• Apply vast experience and multidisciplinary expertise in AI Infrastructure & Agentic Workflows/Orchestration, Generative AI Design Patterns, Cloud Strategy & FinOps, and Security & Compliance (AI Governance) to support key Investment’s initiatives.
• Analyze solutions and technologies and make recommendations based on knowledge of client Investment Branch's current and future needs.
• Proactively monitor and assess strategic direction of solution vendors, technology and market trends, and determine their potential impact and value to the IDW; prepare presentations, documents, diagrams, models, and other artifacts as required to communicate analysis, recommendations, or designs
• Transfer of knowledge to appropriate client staff is required, along with any requested materials and content for transfer of knowledge.

Mandatory Experience:

1. At least ten (10) years of experience in data/BI engineering or analytics.
2. At least five (5) years of experience in leading a team (at least 3 members) to implement enterprise-level BI and/or large data warehouse solutions.
3. At least five (5) years of experience working with AI/ML or GenAI technologies.
4. At least two (2) proven deliveries of production-grade BI or data products (dashboards, data models, APIs).
5. At least two (2) years of experience with ETL/ELT pipelines, data warehousing platforms such as Snowflake, Amazon Redshift, and orchestration tools (Airflow, dbt, etc.).
6. At least two (2) years of experience using OpenAI APIs or similar LLM platforms, building natural language to SQL/query systems, designing prompt strategies for business insights and analytics, and prompt engineering to guide the platform's system behavior.
7. At least two (2) years of experience in SQL (advanced joins, window functions, performance tuning), data modeling (star/snowflake schemas, semantic layers), and hands-on experience with at least one major BI tool such as Power BI, Tableau, Looker.
8. At least two (2) years of experience leading a team of analysts and developers, as well as collaborating with stakeholders, to discover, document, and implement requirements and stakeholder requests for data warehouse or business intelligence projects.
9. For each applicable project meeting the requirements, you must provide client/user reference contact information in the qualification form (a minimum of three(3) references total). Additionally, you must be prepared to submit completed reference forms upon request. Each reference must be a representative of the company for which the project was developed and must have served in a management or supervisory role.

Desirable Experience:

1. Holding technical certifications in the areas of: A copy of the certification must be provided upon request. Certification is required and cannot be substituted with an experience.
   AWS certifications
   Snowflake certifications
   BI certifications (Power BI, Tableau)
   AI/ML or GenAI-related coursework or credentials
2. Have a bachelor’s degree in computer science, computer engineering, or related fields from an accredited or government sanctioned college/university. A copy of the certification must be provided upon request and cannot be substituted with an experience.
3. Must be able to adhere to the hybrid working model by working on-site 2 to 3 business days per week at the client headquarters in West Sacramento, CA.

Equal Opportunity Employer:

At Capio Group, our employees are our greatest asset and diversity, equity, and inclusion are at the core of who we are. Our commitment to these values is unyielding and is central to our mission and to our impact. We know that having diverse perspectives helps to generate better ideas to solve the complex problems of our diverse clients and the communities they serve.