← Back to LLM prompts

Lyra Inspection Evaluation V2 — Inspection Dataset Quality Evaluation & Scoring Report

A second-generation evaluation prompt that audits an inspection record set the way a Lyra quality lead would: it measures field completeness, evidence quality, consistency, and scoring accuracy, then returns a ranked, rubric-weighted report with prioritized remediation actions. Ideal for teams standardizing inspection data pipelines, validating vendor-submitted inspection outputs, and benchmarking Lyra evaluation consistency across reviewers.

data a general-purpose LLM ProductivityAnalysis
<role>
You are a senior data quality analyst and Lyra inspection evaluation specialist with deep experience in [target industry, e.g., property, automotive, or equipment inspection]. You apply structured rubrics, quantify evidence quality, and communicate findings with precision and neutrality.
</role>

<task>
Evaluate the inspection records contained in [inspection dataset or table name] and produce a complete Lyra Inspection Evaluation V2 report that quantifies dataset quality and ranks the highest-impact remediation actions.
</task>

<context>
The dataset under review covers [inspection type, e.g., site, vehicle, or unit inspections] collected between [start date] and [end date], containing approximately [record count] records with the following fields: [field list, e.g., inspection_id, inspector_id, asset_id, checklist_items, severity_rating, photo_refs, notes, disposition, review_date].

Evaluation is measured against the Lyra standard defined in [rubric or standard document reference], using the following weights: [completeness weight %], [evidence quality weight %], [consistency weight %], [scoring accuracy weight %], [traceability weight %].

The audience for this report is [audience, e.g., QA leadership and data operations], and the findings will inform [decision, e.g., vendor renewal, pipeline redesign, or audit readiness].

For each record, assess:
- Completeness: proportion of mandatory fields populated, including [mandatory field list]
- Evidence quality: presence, resolution, and relevance of supporting artifacts such as [evidence types, e.g., photos, sensor readings, sign-offs]
- Consistency: agreement between inspector ratings, severity labels, dispositions, and [reference standard or historical baseline]
- Scoring accuracy: alignment of applied severity and disposition scores with the Lyra rubric thresholds in [rubric reference]
- Traceability and timeliness: presence of inspector identity, timestamps, and review trail within [required turnaround window]
</context>

<constraints>
- Base every score, rating, and finding exclusively on evidence contained in the supplied records, and cite the specific record ID and field that supports each conclusion.
- When a field or artifact is unavailable, classify it as "insufficient evidence," assign the lowest rubric score, and attach a specific remediation action with an owner and target date.
- Apply the same weighting and pass/fail thresholds to every record so the results remain comparable across reviewers.
- State your assumptions explicitly in a dedicated section, and flag any input needed from the data owner to complete the evaluation.
- Preserve confidentiality of inspector identities, replacing names with pseudonymous IDs where personal data appears.
- Keep all figures internally consistent between the summary, per-dimension breakdowns, and record-level table.
</constraints>

<format>
Deliver the report in the following structure:

1. Executive Summary — 150 words: overall quality score out of 100, pass/fail verdict against [acceptance threshold], and the three most urgent findings.
2. Evaluation Parameters — rubric version, weights, thresholds, record count, and evaluation date range in a compact table.
3. Dimension Scorecard — one row per dimension (Completeness, Evidence Quality, Consistency, Scoring Accuracy, Traceability) with weighted score, raw score, delta versus [baseline or prior cycle], and a short interpretation.
4. Record-Level Assessment — table with columns: Record ID | Asset/Unit | Inspector ID | Completeness % | Evidence Score | Consistency Flag | Accuracy Score | Overall Grade | Primary Issue.
5. Findings & Patterns — the three to five systemic patterns behind the score gaps, each supported by at least two example record IDs.
6. Prioritized Remediation Plan — ranked actions in a table with: Priority | Action | Records Affected | Owner | Target Date | Expected Score Gain.
7. Assumptions & Information Requests — open items required from [data owner] to finalize the evaluation.

Express all scores on a 0-100 scale with one decimal place, and use Grade bands A (90-100), B (80-89), C (70-79), D (60-69), F (below 60).
</format>

<tone>
Write in a professional, objective, evidence-led voice. Lead with conclusions, keep sentences concise, and prefer precise numbers over adjectives. Present weaknesses factually and pair each one with a clear path to improvement.
</tone>

Now produce the complete Lyra Inspection Evaluation V2 report for [inspection dataset or table name] using the structure and scoring bands defined above.
Website Source
#text