Business Intelligence Analyst Senior (AI Evaluation & Monitoring)

GSS Geisinger System Services

Pennsylvania

Hybrid

USD 110,000 - 140,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Geisinger is seeking a Senior BI Analyst to partner with the AI Evaluation & Monitoring area. You will apply analytics knowledge, data wrangling, and statistics to help the organization make data-driven decisions.

The role emphasizes communicating insights to non-technical stakeholders, mentoring junior team members, and contributing to AI/ML project evaluation and governance. The position supports work-from-home in Pennsylvania with a 40-hour work week, requiring strong initiative and

Qualifications

  • Minimum of 8 years of relevant experience.
  • Education: High School Diploma or GED required.
  • Strong problem solving and teamwork skills.

Responsibilities

  • Consult AI stakeholders to gather evaluation and data requirements.
  • Run evaluation work to keep AI portfolio safe, performant, and accountable.
  • Collaborate on reporting solutions and analytic studies to support business needs.
  • Plan projects and provide time estimates.
  • Mentor junior BI developers and share knowledge.

Skills

Group Problem Solving
Teamwork

Education

High School Diploma or GED

Job description

Location:

Work from home (Pennsylvania) Shift: Days (United States of America) Scheduled Weekly Hours: 40 Worker Type: Regular Exemption Status: Yes

Job Summary:

The Senior BI Analyst serves as a partner to the business or clinical area supported (AI Evaluation & Monitoring) and will use analytic expertise including knowledge of data structures, programming, and statistics with critical thinking and an understanding of their assigned subject area/business to help the organization make data-driven decisions. The Senior BI Analyst makes contributions to the organization by collecting, cleaning, and interpreting data sets to answer a question or solve a problem including identifying and effectively communicating improvement opportunities and supporting the evaluation of existing AI/ML projects. Senior BI Analysts consistently act as the analytics expert in meetings and discussions with their stakeholders and can operate independently. Must be articulate in both oral and written communications, including presentations with the ability to translate analyses and opportunity insights to non-technical stakeholders. Senior BI Analysts must exhibit initiative and organizational skills, as well as possess the ability to inspire trust and confidence to maintain outstanding customer relationships. Senior BI Analysts mentor junior BI developers by offering project feedback, participating in code reviews, and providing training in areas of expertise.

Job Duties:
  • Independently consults with AI stakeholders to gather evaluation and data requirements and define scope on projects of all sizes.
  • Execute the evaluation work that keeps Geisinger's AI portfolio safe, performant, and accountable — running validation studies, instrumenting production monitoring, analyzing results, and turning findings into clear written work product that governance and program teams can act on.
  • Collaborates with internal partners and organizations in the design and development of reporting solutions and analytic studies to support business needs.
  • Plans projects and request completion tasks.
  • Provides time and effort estimates based on requirements gathering.
  • Strong experience independently managing multiple projects is also required.
  • Demonstrates working knowledge of relevant source systems needed to support primary stakeholders and proficiency with related databases/data marts within first year in role.
  • Must stay abreast of current industry trends and become familiar with the various business intelligence software systems used at Geisinger.
  • Recommends analysis approach and additional analyses or reporting needed based on business questions, requirements, and initial analysis findings.
  • Develops, validates, and executes complex queries.
  • Develops complex reports and performs complex data analysis that answers business questions for internal customers.
  • Interprets results and makes recommendations to business areas based on findings.
  • Presents analysis and reports to internal customers and stakeholders.
  • Routinely uses statistical methods during analyses and considers how best to visualize data that accurately reflects the intended message including the limitations.
  • Reports and helps troubleshoot data quality issues when performing data profiling, testing, or validation.
  • Collaborative and eager to share knowledge with team members.
  • Responsible for participating in strategic departmental initiatives.
  • Acts as a mentor to other analysts.
  • May participate in industry advisory and/or user groups.
  • Strong attention to detail and the ability to be precise and clear when describing results of data analyses.
  • Shares important and relevant information with the team.
  • Proactively offers suggestions, provides resources, volunteers for assignments, and removes barriers to help the team accomplish its goals.
  • Follows all department's policies and procedures including request intake/fulfillment, change management, and data governance practices.
  • Work is typically performed in an office or remote environment.
  • Accountable for satisfying all job specific obligations and complying with all organization policies and procedures.
  • The specific statements in this profile are not intended to be all-inclusive.
  • They represent typical elements considered necessary to successfully perform the job.
  • *Relevant experience may be a combination of related work experience and degree obtained (Associate’s Degree = 2 years; Bachelor’s Degree = 4 years, Master's Degree = 6 years).
Position Details:
Preferred Skills:

Healthcare, clinical, or regulated-industry data experience strongly preferred Applied statistics: hypothesis testing, confidence intervals, power and sample size, regression, and non-parametric methods. SQL with large, messy clinical data warehouses, including window functions, CTEs, debugging query plans, and performance tuning Python for analysis: pandas, numpy, scikit-learn, statsmodels, common evaluation libraries Production monitoring design and execution: drift detection, performance decay tracking, adoption and outcome metrics LLM and generative AI evaluation execution: golden sets, judge-based scoring, hallucination and grounding checks

Education:

High School Diploma or Equivalent (GED)- (Required)

Experience:

Minimum of 8 years-Relevant experience* (Required)

Skills:

Group Problem Solving, Teamwork

OUR PURPOSE & VALUES:

Everything we do is about caring for our patients, our members, our students, our Geisinger family and our communities.

KINDNESS: We strive to treat everyone as we would hope to be treated ourselves.

EXCELLENCE: We treasure colleagues who humbly strive for excellence.

LEARNING: We share our knowledge with the best and brightest to better prepare the caregivers for tomorrow.

INNOVATION: We constantly seek new and better ways to care for our patients, our members, our community, and the nation.

SAFETY: We provide a safe environment for our patients and members and the Geisinger family.

We offer healthcare benefits for full time and part time positions from day one, including vision, dental and domestic partners.

Perhaps just as important, we encourage an atmosphere of collaboration, cooperation and collegiality.

We know that a diverse workforce with unique experiences and backgrounds makes our team stronger.

Our patients, members and community come from a wide variety of backgrounds, and it takes a diverse workforce to make better health easier for all.

We are proud to be an affirmative action, equal opportunity employer and all qualified applicants will receive consideration for employment regardless to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or status as a protected veteran.

Geisinger is committed to making better health easier for the more than 1 million people it serves.

Founded more than 100 years ago by Abigail Geisinger, the system now includes nine hospital campuses, a 550,000-member health plan, two research centers and the Geisinger Commonwealth School of Medicine.

With nearly 24,000 employees and more than 1,600 employed physicians, Geisinger boosts its hometown economies in Pennsylvania by billions of dollars annually.

We offer healthcare benefits for full time and part time positions from day one, including vision, dental and benefits for domestic partners.

Perhaps just as important, we encourage an atmosphere of collaboration, cooperation and collegiality.

For more information, visit www.geisinger.org, or connect with us on Facebook, Instagram, LinkedIn and Twitter.

* Does not qualify for J-1 waiver.

We are an Affiliation Action, Equal Opportunity Employer.

Women and Minorities are Encouraged to Apply.

All qualified applicants will receive consideration for employment and will not be discriminated against on the basis of disability or their protected veteran status.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior BI Analyst: AI Evaluation & Monitoring (Remote)
Senior BI Analyst: AI Evaluation & Monitoring (Remote)

Geisinger • Danville (PA)

Hybrid
USD 85,000 - 110,000
AI Data Scientist Senior
AI Data Scientist Senior

GSS Geisinger System Services • Pennsylvania

Hybrid
USD 140,000 - 180,000
Healthcare benefits from day one
Vision and dental coverage
Domestic partners benefits
Senior AI BI Analyst — Healthcare Analytics & Production
Senior AI BI Analyst — Healthcare Analytics & Production

Geisinger • Danville (PA)

On-site
USD 110,000 - 140,000
Business Intelligence Analyst Senior, AI
Business Intelligence Analyst Senior, AI

Geisinger • Danville (PA)

On-site
USD 110,000 - 140,000
Business Intelligence Analyst Associate
Business Intelligence Analyst Associate

Geisinger • Danville (PA)

On-site
USD 65,000 - 90,000
Medicare 5-Star BI Lead & Analytics Partner
Medicare 5-Star BI Lead & Analytics Partner

Geisinger • Danville (PA)

On-site
USD 90,000 - 120,000
Associate BI Analyst: Data Insights & Impact
Associate BI Analyst: Data Insights & Impact

Geisinger • Danville (PA)

On-site
USD 65,000 - 90,000
Telehealth Analyst Senior
Telehealth Analyst Senior

GC Geisinger Clinic • Pennsylvania

Hybrid
USD 90,000 - 120,000
Health insurance
Dental coverage
Vision coverage
+5
Business Intelligence Analyst Lead (Medicare)
Business Intelligence Analyst Lead (Medicare)

Geisinger • Danville (PA)

On-site
USD 90,000 - 120,000
Application Developer II
Application Developer II

GSS Geisinger System Services • Pennsylvania

Hybrid
USD 95,000 - 130,000