Data Engineer/Lead Developer

Capio Group; Sacramento (CA); Hybrid; USD 135,000 - 145,000; Full time

Benefits offered by this job

Flexible workplace

Work-life balance

Competitive salary

Health benefits

Job summary

Capio Group in Sacramento seeks an experienced Data Engineer/Lead Developer to design, build, and lead investment data warehouse solutions within AWS and Snowflake ecosystems. This full-time role blends BI/GenBI, AI/ML, and data engineering to deliver predictive analytics and automated decision support.

You will mentor a small team, drive UI/UX dashboards with Streamlit/React, and ensure scalable, cost-efficient, secure pipelines, ETL/ELT, and CI/CD for ML workflows.

Qualifications

• Ten years in data/BI engineering or analytics.
• Five+ years leading a team (≥3) on BI or large data warehouse projects.
• Five+ years working with AI/ML or GenAI tech.
• Two+ production-grade BI or data products.
• Two+ years ETL/ELT, Snowflake/Redshift, and orchestration tools.
• Two+ years OpenAI APIs or similar LLM platforms for NL to SQL.
• Two+ years SQL, data modeling (star/snowflake), and BI tools (Power BI/Tableau/Looker).
• Provide client references for projects per requirements.

Responsibilities

• Lead analytics platform design and development for IDW with GenBI/AI/ML.
• Build dashboards using UI/UX principles (Streamlit, React).
• Leverage Snowflake/AWS to accelerate use cases and BI deployment.
• Develop robust tests for Text-to-SQL accuracy and model prototyping.
• Mentor engineers and coordinate with stakeholders and vendors.
• Ensure cost, security, and scalability of the IDW ecosystem.

Skills

Data engineering

Team leadership

AI/ML

Prompt engineering

Statistical analysis

Cloud platforms

Education

Bachelor's degree in Computer Science or related field

AWS/Snowflake/BI certifications

Tools

Snowflake

Redshift

Airflow

dbt

Terraform

Kubernetes

AWS SageMaker/Azure ML/GCP Vertex AI

Job description

Capio Group is looking for an experienced Data Engineer/Lead Developer!

Full-time employee - Sacramento

Salary: $135,000 - $145,000

About Us:

Capio Group is a California-based Information Technology Consulting firm serving the public sector since 2010. We assist the Government in delivering large, complex systems and solutions. Capio Group is a small, but quickly growing firm that mixes good ideas, with great people, to achieve extraordinary results for our clients. We offer the salary and benefits of the bigger companies, with the added bonus of a flexible workplace and a great work-life balance.

Scope of Work:

Capio Group is looking for an experienced Data Engineer/Lead Developerwith a detailed knowledge and expertise to work as part of a team in assisting with maintaining, enhancing, and advancing client Investment Data Warehouse (IDW) architecture/platform, which is capable of Generative Business Intelligence (GenBI), and Artificial Intelligence, Machine Learning (AI/ML) for providing deeper insights, predictive analytics, and automated decision-making capabilities. Furthermore, it is expected to drastically accelerate the development and deployment of Investment-related BI or GenBI, AI/ML, or agentic AI use cases that are to be deployed onto the IDW residing within the AWS and Snowflake ecosystems. All work must adhere to client AI policies, technology governance, standards, and guidelines.

The scope of key responsibilities and activities for the Data Engineer/Lead Developer includes, but is not limited to, the following:

• Effectively apply User Interface (UI)/ User Experience (UX) design principles for designing and building analytics dashboards with technologies such as Chainlit, Streamlit, and React.
  Create interactive reporting and storytelling based on data visualization best practices, and human- centered design.
• Leverage Out-of-Box (OOB) services/functions/APIs (e.g., calling SNOWFLAKE.CORTEX functions via SQL or configuring AWS Bedrock Knowledge Bases) to accelerate the design and
  implementation of use cases.
• Build automated tests to ensure the platform's Text-to-SQL engine isn't hallucinating incorrect numbers.
• Perform continuous prompt engineering to guide and finetune the platform's system behavior.
• Execute statistical analysis, predictive analytics, optimization; conduct AI/ML model prototyping with ML frameworks such as TensorFlow, PyTorch, scikit-learn.
• Apply expertise in platform-specific semantic layers or dbt (Data Build Tool), advanced SQL and dimensional modeling (Star Schema), and cloud ML platforms (e.g., AWS SageMaker, Azure ML, GCP Vertex AI).
• Implement containerization and orchestration (Docker, Kubernetes).
  Operate CI/CD pipelines for ML and data workflows, data integration, cleaning, and transformation processes.
• Responsible for monitoring, tuning, and logging for AI/ML and GenBI solutions, Extract, Transform, Load (ETL)/ Extract, Load, Transform, (ELT) pipelines (e.g., Airflow, Matillion), cloud data warehouses & lakes (e.g., Snowflake, Redshift, BigQuery, Azure Synapse), and cloud infrastructure automation (e.g., Terraform, Ansible).
• Continuously enhance and verify that the entire IDW ecosystem/solution is cost-effective, secure, and scalable.
• Provide technical leadership, solution guidance to project teams in support of solution design and development, and act as a technical liaison among Investment stakeholders, technical developers, 3rd party vendor teams and tech support.
• Apply vast experience and multidisciplinary expertise in AI Infrastructure & Agentic Workflows/Orchestration, Generative AI Design Patterns, Cloud Strategy & FinOps, and Security & Compliance (AI Governance) to support key Investment’s initiatives.
• Analyze solutions and technologies and make recommendations based on knowledge of client Investment Branch's current and future needs.
• Proactively monitor and assess strategic direction of solution vendors, technology and market trends, and determine their potential impact and value to the IDW; prepare presentations, documents, diagrams, models, and other artifacts as required to communicate analysis, recommendations, or designs
• Transfer of knowledge to appropriate client staff is required, along with any requested materials and content for transfer of knowledge.

Mandatory Experience:

1. At least ten (10) years of experience in data/BI engineering or analytics.
2. At least five (5) years of experience in leading a team (at least 3 members) to implement enterprise-level BI and/or large data warehouse solutions.
3. At least five (5) years of experience working with AI/ML or GenAI technologies.
4. At least two (2) proven deliveries of production-grade BI or data products (dashboards, data models, APIs).
5. At least two (2) years of experience with ETL/ELT pipelines, data warehousing platforms such as Snowflake, Amazon Redshift, and orchestration tools (Airflow, dbt, etc.).
6. At least two (2) years of experience using OpenAI APIs or similar LLM platforms, building natural language to SQL/query systems, designing prompt strategies for business insights and analytics, and prompt engineering to guide the platform's system behavior.
7. At least two (2) years of experience in SQL (advanced joins, window functions, performance tuning), data modeling (star/snowflake schemas, semantic layers), and hands-on experience with at least one major BI tool such as Power BI, Tableau, Looker.
8. At least two (2) years of experience leading a team of analysts and developers, as well as collaborating with stakeholders, to discover, document, and implement requirements and stakeholder requests for data warehouse or business intelligence projects.
9. For each applicable project meeting the requirements, you must provide client/user reference contact information in the qualification form (a minimum of three(3) references total). Additionally, you must be prepared to submit completed reference forms upon request. Each reference must be a representative of the company for which the project was developed and must have served in a management or supervisory role.

Desirable Experience:

1. Holding technical certifications in the areas of: A copy of the certification must be provided upon request. Certification is required and cannot be substituted with an experience.
   AWS certifications
   Snowflake certifications
   BI certifications (Power BI, Tableau)
   AI/ML or GenAI-related coursework or credentials
2. Have a bachelor’s degree in computer science, computer engineering, or related fields from an accredited or government sanctioned college/university. A copy of the certification must be provided upon request and cannot be substituted with an experience.
3. Must be able to adhere to the hybrid working model by working on-site 2 to 3 business days per week at the client headquarters in West Sacramento, CA.

Equal Opportunity Employer:

At Capio Group, our employees are our greatest asset and diversity, equity, and inclusion are at the core of who we are. Our commitment to these values is unyielding and is central to our mission and to our impact. We know that having diverse perspectives helps to generate better ideas to solve the complex problems of our diverse clients and the communities they serve.