Data Engineer

V Group Inc.; West Sacramento (CA); Hybrid; USD 83,000 - 124,000; Full time

Job summary

CalSTRS seeks experienced Back-End Developer – Data Engineering, Snowflake & GenBI for a 12-month contract with potential extension. Hybrid model requires on-site presence 2–3 days weekly at CalSTRS HQ. Role spans data engineering, AI/GenBI analytics, APIs, and cloud data platforms.

The team focuses on IDW platform development, GenBI/AI-powered analytics, and knowledge transfer to CalSTRS staff. Strong Snowflake, SQL, Airflow, dbt, and AWS experience is essential.

Qualifications

• 7+ years in IT with data analysis or DB querying.
• 5+ years in data engineering, data warehousing, or BI analytics.
• 2+ years ETL/ELT pipelines experience.
• 2+ years Snowflake/Redshift/Azure Synapse and orchestration tools (Airflow, dbt).
• 2+ years SQL, including window functions and performance tuning.
• 2+ years data modeling incl. semantic layers and BI tools (Power BI/Tableau/Looker).

Responsibilities

• Build, maintain, and optimize ETL/ELT pipelines.
• Design cloud data warehouse solutions and Snowflake data models.
• Develop advanced SQL queries and stored procedures.
• Develop APIs and backend services for analytics applications.
• Collaborate with teams using React/Chainlit/Streamlit and AWS/Snowflake.
• Monitor pipelines, logging, and performance; ensure data quality.

Skills

Data engineering

SQL

ETL/ELT

Snowflake

Airflow

dbt

Python

OpenAI APIs

GenBI

AI/ML

AWS

Kubernetes

Education

Bachelor's degree in CS / related field

Tools

Docker

Kubernetes

Terraform

Ansible

Airflow

dbt

Job description

Direct End Client: California State Teachers' Retirement System (CalSTRS)

Job Title: Back-End Developer – Data Engineering, Snowflake & GenBI

Duration: 12 Months + Possible 36-Month Extension

Work Model: Hybrid – On-site 2–3 business days per week at CalSTRS Headquarters

Ceipal ID: SCA_DEV980_PT

Job Code: RFO #5805147980

Scope of Project

CalSTRS is seeking experienced technical resources to support the Investment Data Warehouse (IDW) platform. The project will focus on the design, development, implementation, maintenance, and support of technical solutions across the IDW platform.

The team will enhance the IDW architecture and accelerate investment-related use cases involving:

• Generative Business Intelligence (GenBI)
• Artificial Intelligence (AI)
• Agentic AI
• AWS
• Snowflake
• Enterprise data and analytics

The selected resources will collectively provide full-stack development coverage across data engineering, analytics, AI/ML, application development, APIs, semantic modeling, and cloud technologies.

A mandatory project objective is knowledge transfer to CalSTRS employees, including providing documentation, technical materials, and other requested content necessary for CalSTRS staff to maintain and operate the solutions.

Responsibilities

1. Data Engineering & Data Warehouse

• Build, maintain, and optimize ETL/ELT pipelines.
• Design and develop cloud data warehouse solutions.
• Develop and optimize Snowflake data solutions.
• Work with Amazon Redshift and Azure Synapse or similar cloud data platforms.
• Integrate source systems and data feeds into the Investment Data Warehouse (IDW).
• Develop data warehouse objects, transformations, and integrations.
• Ensure data quality, reliability, and performance.

2. SQL & Data Modeling

• Develop advanced SQL queries and stored procedures.
• Perform advanced joins, window functions, and query performance tuning.
• Design and implement star and snowflake schemas.
• Develop enterprise data models and semantic layers.
• Support semantic models for business intelligence and AI-driven analytics.

3. ETL/ELT & Orchestration

• Develop and maintain ETL/ELT pipelines.
• Work with orchestration tools such as Apache Airflow and dbt.
• Automate data processing and transformation workflows.
• Monitor pipeline execution, failures, and performance.
• Implement appropriate logging and error-handling mechanisms.

4. GenBI, AI/ML & GenAI

• Support development of GenBI and AI-powered analytics solutions.
• Develop solutions using AI/ML and Generative AI technologies.
• Work with OpenAI APIs or comparable LLM platforms.
• Develop natural-language-to-SQL/query solutions.
• Design prompt strategies for business insights and analytics.
• Apply prompt engineering techniques to control LLM behavior.
• Support AI-assisted business intelligence and analytics use cases.
• Develop automated tests to help prevent Text-to-SQL engine hallucinations.

5. API & Application Development

• Develop APIs supporting GenBI and AI-powered solutions.
• Support backend services for analytics applications.
• Work with application teams to integrate data, AI, and analytics services.
• Support interactive analytics applications and dashboards.
• Collaborate with front-end developers working with React, Chainlit, and Streamlit.
• Work within AWS and Snowflake ecosystems.
• Support AWS services including Bedrock and SageMaker.
• Implement infrastructure automation using Terraform and Ansible.
• Support containerized applications using Docker and Kubernetes.
• Support CI/CD pipelines and automated deployments.
• Monitor cloud infrastructure and application performance.

7. Monitoring, Operations & Support

• Monitor data pipelines and platform performance.
• Implement monitoring and logging for ML, BI, and data systems.
• Troubleshoot data, application, and infrastructure issues.
• Support ongoing maintenance and operations of the IDW platform.
• Optimize query performance, pipeline reliability, and platform availability.

8. Collaboration & Knowledge Transfer

• Collaborate with developers, data engineers, architects, analysts, and business stakeholders.
• Participate in requirements analysis and technical solution design.
• Follow applicable SDLC and Agile Development practices.
• Adhere to CalSTRS Minimum Information Security Requirements (MISR) and AI governance processes.
• Prepare technical documentation and project materials.
• Provide knowledge transfer to CalSTRS employees.

Required/Preferred Skills

Required Qualifications

• 7+ years of experience in the Information Technology field with extensive experience in report writing, data analysis, or database querying.
• 5+ years of experience in data engineering, data warehousing, or BI analytics.
• 2+ years of experience with ETL/ELT pipelines.
• 2+ years of experience with cloud data warehouses such as Snowflake, Amazon Redshift, Azure Synapse, and orchestration tools such as Airflow and dbt.
• 2+ years of experience with SQL, including:
• Window functions
• Performance tuning
• 2+ years of experience with data modeling, including:
• Semantic layers
• Hands-on experience with at least one major BI tool:
• Power BI
• Tableau
• Looker
• 2+ years of hands-on experience with:
• Docker
• Monitoring and logging
• Terraform
• Ansible

AI/ML & GenAI Skills

• Experience with AI/ML or Generative AI technologies.
• Experience with OpenAI APIs or similar LLM platforms preferred.
• Experience building natural-language-to-SQL/query systems preferred.
• Experience with prompt engineering and prompt strategy development.
• Experience with GenBI or AI-driven analytics preferred.
• Experience with semantic models supporting natural-language querying.
• Experience with statistical analysis, predictive analytics, or optimization preferred.
• AWS AI services experience, including Bedrock and SageMaker, preferred.

Front-End / AI Application Skills – Preferred

• Highly interactive reporting applications.
• Complex application state and data handling.
• Real-time updates.
• Loading, retry, error, and partial-response handling.
• Latency handling and asynchronous UX patterns.
• Explainable AI interfaces, including confidence indicators, sources, and dispensers.
• AI chat interfaces with streaming responses and token handling.
• AI-assisted workflows such as:
• Autocomplete
• Summarization
• Recommendations

Certifications – Preferred

• AWS certifications.
• Snowflake certifications.
• BI certifications such as Power BI or Tableau.
• AI/ML or GenAI-related coursework, certifications, or credentials.

Education – Preferred

• Bachelor's degree in Computer Science, Computer Engineering, or a related field from an accredited or government-sanctioned college/university.
• Snowflake data warehouse objects
• APIs
• Data integrations
• GenBI solutions
• AI/ML and GenAI solutions
• Monitoring and logging dashboards
• Technical documentation
• Knowledge-transfer materials

Project Success Metrics

• Query performance
• Platform uptime
• Successful delivery of investment-related GenBI/AI use cases
• Effective knowledge transfer to CalSTRS staff

Work Location Requirement

The selected candidate must be able to work in a hybrid environment, reporting onsite 2–3 business days per week at:

Contract Information

• Initial Contract: Up to 12 months
• Extension Option: Additional 36 months
• Hours: Approximately 160 hours per month per person
• Payment: Hourly rate negotiated at contract execution
• Staffing: CalSTRS may select up to six technical resources
• Back-End Developers: Up to three positions
• Background Check: Required, including criminal, civil, and credit checks
• Candidate must be able to work 2–3 days onsite per week in West Sacramento, CA.
• Candidate should have strong Data Engineering, Snowflake, SQL, ETL/ELT, and BI experience.
• Experience with AWS, GenAI, OpenAI APIs, semantic modeling, and GenBI is highly desirable.
• Experience with Airflow, dbt, Docker, Kubernetes, Terraform, and Ansible is required.
• Candidates with React, Chainlit, and Streamlit experience will be strongly preferred.
• Candidate must meet the required experience and education/certification requirements applicable to the position.
• Selected personnel must successfully complete the required CalSTRS background investigation.
• Candidate must be prepared to support knowledge transfer and documentation activities.