Taazaa designed and built a solution utilizing AI-powered reasoning and transparent decision logic to accomplish all of Safeguard’s goals.
The application interprets images and text, classifies work codes, detects damage, and evaluates bid proposals using Google’s Gemini 2.5 model via LangChain.
To ensure traceability and auditability, the team used a normalized schema built with SQLModel to store tasks, images, prompts, allowable limits, and AI results.
Background jobs fetch work orders from Safeguard’s Service Bus, process each inspection stage in parallel threads, generate reports, and raise success events.
Custom prompts encode vendor guidelines, allowable categories, and decision thresholds. This keeps scoring consistent across work orders.
The audit workflow progresses through six stages. Each stage feeds into the next, ultimately producing a consolidated inspection report and AI decision.
Stage 1: Input Data
Work order information and images arrive via Safeguard’s Service Bus. A data‑fetching job loads tasks, images, and metadata into the database.
Stage 2: Work Completion
The LLM classifies images and vendor notes to verify that work aligns with allowed codes and quantities. It validates the attributes against allowable limits and generates an initial inspection report.
Stage 3: Damage Assessment
The AI analyzes damage images and descriptions. The system estimates the severity, flags missing items, and updates the AI decision for each repair task.
Stage 4: Bid Evaluation
The system fetches vendor bid proposals and compares them against predefined bid categories and punch‑code allowables. The AI determines whether to approve, adjust, or reject each bid.
Stage 5: Delta Analysis
To ensure consistency, the system compares new inspection results against previous inspection data, identifying unmatched stations and significant changes. The findings are updated accordingly.
Stage 6: Report and Decision
The system consolidates all inspection results into a report. It saves the final AI decision and raises a success event via the Service Bus to notify downstream systems.