Intel® Order Accuracy Reference Package
Overview
Order Accuracy is an enterprise AI vision platform that validates food orders in real-time using Vision Language Models (VLM). The platform automatically detects items in food trays, bags, or containers, compares them against expected order data, and identifies discrepancies before orders reach customers.
As computer vision technology becomes more mainstream in industrial and retail settings, using it for order accuracy in quick service restaurants is becoming increasingly complex. These vision workloads are substantial and require multiple stages of processing. The Intel® Order Accuracy Reference Package provides the essential components needed to develop and deploy order accuracy solutions using Intel® hardware, software, and open-source tools.
Platform Applications
The platform provides two specialized applications optimized for different restaurant scenarios:
| Application | Use Case | Input Type |
|---|---|---|
| Dine-In | Restaurant table service validation | Static images |
| Take-Away | Drive-through and counter service | Video streams (RTSP) |
Dine-In Order Accuracy
Image-based order validation for restaurant dining applications
Optimized for validating food trays at serving stations before delivery to tables. Uses single image capture and VLM analysis for fast, accurate item detection.
Key Features
- Single image capture and analysis
- Food tray/plate item detection
- REST API for POS integration
- Gradio web interface for manual validation
- Hybrid semantic matching
- Zero-training deployment with pre-trained Qwen2.5-VL-7B model
Use Case
In a full-service restaurant: 1. Kitchen prepares a dish for Table 12 2. Expo staff places the plate in the validation station 3. Staff triggers validation via Gradio UI or API 4. System analyzes plate contents using VLM 5. System compares detected items against the order manifest 6. Staff receives immediate feedback on order accuracy
Take-Away Order Accuracy
Real-time video stream validation for drive-through and counter service
Optimized for high-throughput drive-through environments with multiple camera stations. Processes RTSP video streams in parallel using intelligent frame selection and VLM batching.
Key Features
- Real-time RTSP video stream processing
- Multi-station parallel processing (up to 8 workers)
- GStreamer-based video pipeline
- YOLO-powered frame selection
- VLM request batching for throughput
- Circuit breaker and auto-recovery
Service Modes
| Mode | Description | Use Case |
|---|---|---|
| Single | Single worker, Gradio UI | Development, testing |
| Parallel | Multi-worker, VLM scheduler | Production deployment |
Choosing the Right Application
| Criteria | Dine-In | Take-Away |
|---|---|---|
| Input Type | Static images | Video streams (RTSP) |
| Throughput | Low-medium | High (parallel) |
| Latency Priority | Accuracy over speed | Speed and accuracy |
| Camera Setup | Fixed position | Multi-station |
| Typical Use | Table service | Drive-through, counter |
| Processing | Single request | Batch processing |
Recommendation
- Choose Dine-In if you need to validate orders from captured images at serving stations
- Choose Take-Away if you need real-time validation from continuous video streams
Shared Platform Components
VLM Backend (OVMS)
Both applications use OpenVINO Model Server with Qwen2.5-VL for vision-language inference.
Semantic Comparison Service
AI-powered semantic matching microservice for intelligent item comparison:
- Matching Strategies: Exact → Semantic → Hybrid
- Example: Matches "green apple" ↔ "apple" using semantic reasoning
- Fallback: Automatic fallback to local matching if service unavailable
What You Want to Do
🚀 I'm New to Order Accuracy Solutions
Quick Start (25 minutes): Getting Started Guide - Set up your development environment - Run your first order validation demo - Understand the platform workflow
⚙️ I Want to Customize the Solution
Advanced Configuration (45-90 minutes): Advanced Guide - Configure custom settings and workloads - Tune performance parameters - Set up benchmarking
📐 I Want to Understand the Architecture
System Design: Architecture Guide - Understand system components - Review data flow diagrams - Learn about service interactions
📊 I Need Performance Analysis
Benchmark & Optimize: Performance Guide - Compare CPU/GPU performance - Run stream density tests - Optimize for your hardware