Data Production Analyst (AI & QA Analyst) (Information Technology Analyst 3)

New Jersey Courts; Trenton (NJ); Híbrido; USD 95.000 - 133.000; Jornada completa

Ventajas ofrecidas por este puesto de trabajo

Hybrid work schedule

Remote work up to 3 days

Descripción de la vacante

New Jersey Judiciary in Trenton, NJ seeks an Information Technology Analyst 3 focused on AI solution testing, QA, and use case analysis. Bridge between business and tech, leading discovery and documentation of enterprise AI use cases within an AWS cloud infrastructure.

Responsibilities include designing test plans for AI models, validating data pipelines with AWS Redshift, and collaborating with data scientists and engineers.

Formación

• Experience in AI/ML testing and QA methodologies.
• Ability to elicit requirements and translate to FRDs.
• Solid understanding of AWS data architectures and Redshift.
• Strong SQL and Python for data validation and automation.
• Excellent cross-functional collaboration and communication.

Responsabilidades

• Design and execute AI testing plans and evaluation frameworks.
• Lead discovery sessions to define high-value AI use cases.
• Validate data lakehouse pipelines and AWS Redshift structures.
• Collaborate with data scientists and engineers to ensure quality.
• Provide first-line production support for AI solutions.

Conocimientos

AI/ML testing

QA methodologies

SQL queries

Python scripting

Communication

Project coordination

Educación

Bachelor's degree in CS or related field

Herramientas

AWS infrastructure

Redshift

Data Lakehouse

Vector databases

Descripción del empleo

If another position becomes available within five months of this recruitment's closing date, the applicant pool from this posting may be used to fill additional vacancies.

When you come to work for New Jersey Judiciary you will join an 8500-member strong TEAM that operates with the highest standards of independence, integrity, fairness and quality service. You will be engaged with work that has purpose, meaning and makes a difference in lives of the public we serve. We work hard every day to build the public’s trust and confidence in our court system, which includes issues such as bail reform, marijuana decriminalization and recovery court. Whether it be in a courtroom, an administrative office, a courthouse training room, an IT office or in the field, our Judiciary workforce is improving the lives of countless individuals and families every day. We honor the dignity and individualism of each member of our organization while fostering professionalism and continuous improvement in our work.

SALARY: The salary range for this position is $94,668.29 to $133,073.24 for Schedule A, and $94,668.29 to $126,419.57 for Schedule B. For newly hired individuals, the starting salary will normally be at the minimum of the salary range. For current Judiciary employees, salary upon promotion or advancement will be an increase of 5% of base salary, not to exceed the maximum of the range, or the minimum salary of the band/level, whichever is greater. Judiciary employees hired prior to June 3, 2014, are considered Schedule A. Newly hired individuals, and Judiciary employees hired on or after June 3, 2014, are considered Schedule B.

The Judiciary offers a strong opportunity for growth.

The organization is seeking an Information Technology Analyst 3 (ITA3) with a primary focus on AI Solution Testing, Quality Assurance, and Use Case Analysis. This role bridges the gap between business stakeholders and technical development by leading the discovery, elicitation, and documentation of enterprise AI use cases, while spearheading comprehensive testing frameworks for artificial intelligence models, machine learning pipelines, and data architectures within an AWS cloud infrastructure, while spearheading comprehensive testing frameworks for artificial intelligence models, data warehouse models, and modern data pipelines within an AWS cloud infrastructure.

REMOTE WORK

The Judiciary currently offers a hybrid work schedule, and this position may qualify for up to 3 days of remote work outside of Judiciary buildings. To participate in this program, in addition to installing a multifactor authentication app on your phone or tablet, you will be required to have high speed home internet access.

• AI Testing & Quality Assurance (Primary Focus): Design, develop, and execute specialized test plans, automated scripts, and evaluation frameworks for emerging AI solutions, Large Language Models (LLMs), and retrieval pipelines. Validate model output accuracy, retrieval relevance, data lineage, and traceability against authoritative source data prior to production deployment.
• Use Case Analysis & Requirements Elicitation: Lead discovery sessions with business SMEs and application teams to identify, gather, and formalize high-value AI and data use cases. Translate complex business challenges into precise Functional Requirement Documents (FRDs), user stories, and acceptance criteria for engineering teams.
• Data Lakehouse & Pipeline Validation: Verify underlying data ingestion, transformation layers, and data warehouse structures (e.g., AWS Redshift) to ensure clean, reliable, and high-integrity data feeds for AI models and reporting KPIs.
• Collaboration & Governance: Partner closely with data scientists, ML engineers, and cross-functional units to define testing benchmarks, mitigate model drift or hallucination risks, and enforce rigorous quality standards across the AI lifecycle.
• First-Line Production Support: Monitor and maintain the stability of deployed AI and data solutions, serving as the technical point of contact for resolving analytical and pipeline anomalies.

Qualifications & Requirements

• Proven professional experience in AI/ML testing, QA methodologies, and software or data verification.
• Demonstrated expertise in business analysis, use case gathering, requirements engineering, and translating strategic business goals into technical specifications.
• Solid understanding of cloud-based data and AI architectures (AWS infrastructure, vector databases, or modern data lakehouses).
• Proficiency in writing complex SQL queries and scripting languages (such as Python) for data validation and test automation.
• Strong communication, project coordination, and multidisciplinary collaboration skills.

Regular and predictable physical presence at the worksite is an essential function of this position.

Graduation from an accredited college or university with a bachelor’s degree in a field related to computer science, information technology or the area to which the applicant is applying, such as information systems, human‑computer interaction, interactive media, software engineering, computer networking, business analytics, data analytics and/or cybersecurity and three years of professional experience in: analyzing, designing, programming, troubleshooting, resolving technical problems, testing, defining business requirements, training and/or installing computer systems applications OR planning, acquiring, installing and implementing telecommunications facilities and services, wide area networks, or local area networks OR generating and maintaining system software ORbusiness analysis which may include defining and gathering business and functional requirements, analyzing and validating data and/or documenting test plans OR business analytics OR data analytics.

Substitution

Applicants who do not possess the required education may substitute additional paraprofessional and/or professional IT technical experienceor experience related to the area to which the applicant is applyingon a year for year basis with one year of such experience being equal to 30 semester hour credits.

A bachelor’s degree in any field from an accredited college or university and one year of additional paraprofessional and/or professional IT technical experienceor experience related to the area to which the applicant is applyingmay be substituted for the required education.

An associate degree from an accredited college or university, in a field related to computer science, information technology or the area to which the applicant is applying, such as information systems, human‑computer interaction, interactive media, software engineering, computer networking, business analytics, data analytics and/or cybersecurity and two years of additional paraprofessional and/or professional IT technical experienceor experience related to the area to which the applicant is applyingmay be substituted for the required education.

An associate degree in any field from an accredited college or university and three years of additional paraprofessional and/or professional IT technical experienceor experience related to the area to which the applicant is applying may be substituted for the required education.

A master’s degree from an accredited college or university in a field related to computer science, information technology or the area to which the applicant is applying, such as information systems, human‑computer interaction, interactive media, software engineering, computer networking, business analytics, data analytics and/or cybersecurity may be substituted for the required educationORone year of experience.

Individuals who have successfully completed internships within the Central Office Information Technology Office; ATCSU; Data Analytics, Research and Statistics Office; and/or the Information Security Unit may substitute their experience as interns for the required professional experience with one such year of intern experience being equivalent to six months of professional experience.

Education Note

Degrees conferred outside of the United States must be evaluated by a recognized evaluation service. (See https://naces.org/members/)

Physical Ability

For some positions, applicants must have the ability to perform work which requires climbing and prolonged standing, stretching, bending and reaching. The selected candidate must be able to frequently lift and carry supplies weighing from 30 to 50 pounds and, occasionally, materials weighing up to 75 pounds.

Driver's License

Appointees will be required to possess a driver’s license valid in New Jersey only if the operation of a vehicle, rather than employee mobility, is necessary to perform essential duties of the position.

Authorization to Work

US citizenship is not required. Selected candidate must be authorized to work in the US according to Department of Homeland Security, US Citizenship and Immigration Services regulations.

Special Note

Newly hired employees must agree to a thorough background check that will include fingerprinting. All data received will be kept in strict confidence except to inform the individual of the findings and what action will be taken as a result of this information.

Residency Law

In accordance with N.J.S.A. 52:14-7 (L. 2011, Chapter 70), the "New Jersey First Act," all persons newly hired by the Judiciary within one year must establish, and then maintain, principal residence in the State of New Jersey. Any person may request an exemption from that requirement from the Employee Residency Review Committee in the Department of Labor & Workforce Development on the basis of either hardship or employer critical need.

The Judiciary of New Jersey is an Equal Opportunity/Affirmative Action

Employer Committed to Ensuring an Open Door to Justice