AI-Assisted Report Reliability Lab | ShieldPST.ai
DAY ONE INTERACTIVE TRAINING TOOL

AI-Assisted ReportReliability Lab

Follow a fictional DUI investigation from source capture through officer and supervisor review. Identify how inaccuracies, omissions, attribution mistakes, and unsupported language can enter an AI-assisted report.

Instructional and neutral. This fictional exercise illustrates report-production and review issues. It does not evaluate, endorse, or criticize any specific vendor or platform.

Before You Begin

You are the reporting officer in a fictional DUI investigation. The AI system can use only the source materials you select. You will evaluate the draft, correct identified problems, complete an officer attestation, and then perform a supervisor review.

1. Review the incident
Understand the timeline and known facts.
2. Inspect and select sources
Decide what information is available to the system.
3. Generate the draft
See how input selection affects output.
4. Review sentence by sentence
Classify and correct reliability issues.
5. Complete officer attestation
Document review and unresolved conflicts.
6. Conduct supervisor review
Evaluate the corrected report and edit history.

Estimated time: 12–15 minutes

Step 1 of 7Review the incident

Step 1: Review the Incident

Read the timeline carefully. You will use it later to evaluate chronology and factual support.

Your task: Identify the sequence of events and note which facts come from direct observation, electronic records, or later statements.
22:14CAD event created for a vehicle partially in a traffic lane.
22:19Unit 214 marked on scene.
22:22Primary officer BWC begins recording.
22:28Field sobriety tests begin.
22:36Driver arrested.
22:43Vehicle searched.
23:08Evidence booked.

What to Look For

  • CAD arrival time is not necessarily contact time.
  • BWC begins three minutes after arrival.
  • Some officer observations may never be spoken aloud.
  • Different sources may describe the same event differently.
Why it matters: An AI narrative can reflect only the sources available to it.

Step 2: Inspect and Select Sources

Open each source, review its limitation, and decide whether to include it in the AI input.

Your task: Review each source. Then choose which sources the AI may use. The resulting draft depends on these selections.

Step 3: Generate the AI-Assisted Draft

The system uses only the selected sources. Information outside those sources may be absent, misstated, or inferred.

Step 4: Officer Review

Select any sentence that appears inaccurate, unsupported, incomplete, overstated, or inconsistent with the source material.

Your task: Select a sentence, compare it with the source record, classify the issue, and choose an officer action. Use hints only when needed.

Problematic sentences are not marked in advance.

Sentence Review

Select a sentence in the report.

Source Comparison

No sentence selectedSelect a sentence to inspect support.

Step 5: Officer Attestation

Document what was reviewed, what was added from personal knowledge, and whether any conflict remains unresolved.

Your task: Complete each item. The officer remains responsible for the final report.

Step 6: Supervisor Review

Review the initial draft, officer changes, and remaining reliability questions. This is a substantive review, not merely proofreading.

Your task: Decide whether the report should be approved, returned, or supported by additional documentation.

Initial AI Draft

The driver aggressively reached toward the center console despite repeated commands to stop.

Officer Revision

The driver moved his right hand toward the center console. I instructed him to keep his hands visible.

Edit History

The driver aggressively reached moved his right hand toward the center console despite repeated commands to stop. I instructed him to keep his hands visible.

Supervisor Questions

  • Are statements supported?
  • Were conflicts resolved?
  • Are officer-added facts based on personal knowledge?
  • Does the report establish the factual basis?

Step 7: Completion Review and Agency Application

Review the issues addressed and identify questions to take back to your agency.

0Sentences reviewed
0Issues correctly identified
0Sources used

Questions to Take Back to My Agency

Day One takeaway: An AI-generated draft is not the event. It is a system-produced account derived from selected source material and subject to officer and supervisor verification.
ShieldPST.ai
© 2026 Shield Public Safety Training. All rights reserved. This instructional scenario, page structure, text, graphics, and interactive features may not be reproduced or distributed without written permission, except as permitted by law.
Review date: July 26, 2026.