From 287b0ef98f4564d5231dc849de93cfb2ee7df03d Mon Sep 17 00:00:00 2001
From: Rachit
Date: Thu, 5 Nov 2026 00:56:02 +0100
Subject: [PATCH 1/7] docs: the film on YouTube uses Peaceful Corporate
Co-Authored-By: Claude Opus 5.5
---
THIRD_PARTY.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/THIRD_PARTY.md b/THIRD_PARTY.md
index 2ad1259..0d4b85c 100644
--- a/THIRD_PARTY.md
+++ b/THIRD_PARTY.md
@@ -105,7 +105,7 @@ Speech input is Muse Voice Transcribe (above).
| What | Where | Terms |
|---|---|---|
| Sound of our own screen recording of a walk | `apps/web/public/demo-video/watch.mp4` | Ours, Apache-2.0 |
-| Music: [Soft Technology Music](https://pixabay.com/music/ambient-soft-technology-music-629712/) by MiroMaxMusic | Background of the demo video only; the file is not in this repo | [Pixabay Content License](https://pixabay.com/service/license-summary/): free, commercial use allowed, no attribution required. |
+| Music: [Peaceful Corporate](https://www.youtube.com/watch?v=I34bTKW8ud0) by Stock-Waves | Background of the demo video on YouTube only; the file is not in this repo | Free in YouTube videos, per the artist's terms in the track's video description, provided the artist is credited in the video description (done). |
| Sound effects in the demo video | The demo video only; not in this repo | Ours: generated from noise and sine waves by our own script, no samples |
## Images
From c6c8cc2caf636b8269b1992eff8b0f04ad073711 Mon Sep 17 00:00:00 2001
From: Rachit
Date: Thu, 5 Nov 2026 01:29:06 +0100
Subject: [PATCH 2/7] docs: the film's music is an original track made with
Claude
Co-Authored-By: Claude Opus 5.5
---
THIRD_PARTY.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/THIRD_PARTY.md b/THIRD_PARTY.md
index 0d4b85c..0d0b702 100644
--- a/THIRD_PARTY.md
+++ b/THIRD_PARTY.md
@@ -105,7 +105,7 @@ Speech input is Muse Voice Transcribe (above).
| What | Where | Terms |
|---|---|---|
| Sound of our own screen recording of a walk | `apps/web/public/demo-video/watch.mp4` | Ours, Apache-2.0 |
-| Music: [Peaceful Corporate](https://www.youtube.com/watch?v=I34bTKW8ud0) by Stock-Waves | Background of the demo video on YouTube only; the file is not in this repo | Free in YouTube videos, per the artist's terms in the track's video description, provided the artist is credited in the video description (done). |
+| Music: original track made for this film with Claude | Background of the demo video only; the file is not in this repo | Ours: Anthropic's terms assign the output to the user, and no attribution is required |
| Sound effects in the demo video | The demo video only; not in this repo | Ours: generated from noise and sine waves by our own script, no samples |
## Images
From 0e494fa2a405995bfef6c845cfa3d5d17082b397 Mon Sep 17 00:00:00 2001
From: Rachit
Date: Thu, 5 Nov 2026 01:33:05 +0100
Subject: [PATCH 3/7] docs(readme): link the 3-minute demo video
Co-Authored-By: Claude Opus 5.5
---
README.md | 4 +++-
1 file changed, 3 insertions(+), 1 deletion(-)
diff --git a/README.md b/README.md
index f483e6b..7c4cc90 100644
--- a/README.md
+++ b/README.md
@@ -20,6 +20,8 @@ SAM 3.1 finds your things in it, and Muse Voice Transcribe + Muse Spark Open hea
…then tap Take me there, and the camera checks it's really there when you arrive.
+Watch the 3-minute demo · Try the sample home
+
Built during the Meta Global AI Developer Hackathon, Oct 26 to Nov 4, 2026. Pre-existing work: none.
Indie track · Theme: Build for Your World
@@ -204,7 +206,7 @@ recording and one frame of it, which the author reviewed and chose to publish (`
| Architecture, decisions, privacy note, measurements | [`docs/`](docs) | [architecture](docs/architecture.md) · [decisions](docs/decisions.md) · [privacy](docs/privacy.md) · [verification](docs/verification.md) |
| Tests and CI: API, pipeline, website, iPhone (unit, integration, accessibility, usability) | `services/*/tests`, `apps/web/e2e`, `apps/ios/RecallUITests`, `.github/workflows` | Green |
| A usability session plan for a blind or low-vision tester | `evals/usability/` | Ready |
-| The 3-minute demo video | | Coming |
+| The 3-minute demo video | [youtu.be/vRAR3FHNSks](https://youtu.be/vRAR3FHNSks) | Ready |
## How the code is laid out
From 3d69fc071f51f31682638c1eaabddb2a5523152c Mon Sep 17 00:00:00 2001
From: Rachit
Date: Thu, 5 Nov 2026 01:37:45 +0100
Subject: [PATCH 4/7] docs(readme): give judges the video, the numbers and the
tester
Align the screenshots at one height, keep each caption with its image,
and fill the last cell with the published AR frame.
Co-Authored-By: Claude Opus 5.5
---
README.md | 51 +++++++++++++++++--------------------
docs/media/app-devices.png | Bin 316214 -> 316617 bytes
docs/media/app-found.png | Bin 203213 -> 203999 bytes
docs/media/app-rooms.png | Bin 266022 -> 266608 bytes
docs/media/app-scans.png | Bin 326209 -> 326840 bytes
docs/media/app-things.png | Bin 210561 -> 211232 bytes
6 files changed, 23 insertions(+), 28 deletions(-)
diff --git a/README.md b/README.md
index 7c4cc90..f1b1ec4 100644
--- a/README.md
+++ b/README.md
@@ -80,7 +80,7 @@ Indie track · Theme: Build for Your World
### For judges, in one minute
-**Start with the demo.** Nothing to install: open
+**Start with the [3-minute video](https://youtu.be/vRAR3FHNSks): a blindfolded walk to a watch, one take.** Then try it, with nothing to install: open
**[recall-ten-khaki.vercel.app/demo](https://recall-ten-khaki.vercel.app/demo)**, pick "Where are my keys?", and
follow the walk to them in the author's real scanned living room. To run the same thing from this repo, with no keys,
no GPU and no account:
@@ -95,11 +95,20 @@ come from the planner the phone uses, on the scan's floor.
| Criterion | Where to look |
|---|---|
-| **Impact** (30 %) | [Why I built it](#why-i-built-it): a true story · [What it is](#what-it-is): built first for blind and low-vision people, for anyone who misplaces things, voice first · [Privacy](docs/privacy.md): the home stays on your own computer · the [tester session plan](evals/usability/) |
+| **Impact** (30 %) | [Why I built it](#why-i-built-it): a true story · [What it is](#what-it-is): built first for blind and low-vision people, for anyone who misplaces things, voice first · [Privacy](docs/privacy.md): the home stays on your own computer · a [first real tester](#results-so-far) with low vision, and the [fuller session plan](evals/usability/) |
| **Use of Meta AI tooling** (25 %) | [Only Meta models, each with one job](#how-it-works-the-meta-models): MapAnything, SAM 3.1, Muse Spark Open (Muse Glimmer on your own Mac), Muse Voice Transcribe, Muse Spark 1.1 · [Recall's three agents](#recalls-three-agents) · [Sharing with robots](#sharing-with-robots) over A2A |
-| **Demo** (25 %) | [The demo page](https://recall-ten-khaki.vercel.app/demo) and `make demo`: a real run, no keys · the screenshots below are real output · [How to run it](#how-to-run-it) |
+| **Demo** (25 %) | [The 3-minute video](https://youtu.be/vRAR3FHNSks) · [The demo page](https://recall-ten-khaki.vercel.app/demo) and `make demo`: a real run, recorded and labelled, no keys · the screenshots below are real output · [How to run it](#how-to-run-it) |
| **Technical depth** (20 %) | [Architecture](docs/architecture.md) · [28 decisions](docs/decisions.md) · [Guardrails](#guardrails): geometry decides the facts, the model only phrases them · [Algorithms](#algorithms) · tests on every part ([Results so far](#results-so-far)) |
+**Real use, from the app's own logs** (31 Oct to 4 Nov 2026, one flat, one iPhone; not a study, [details](evals/results.md)):
+
+| Measure | Result |
+|---|---|
+| Answers grounded in what Recall really saw | **49 of 49** |
+| Gap between camera and memory, confirmed arrivals | **2 cm** median (n = 22) |
+| Arrival checks where the camera saw the thing | **26 of 31** |
+| Guide, question to answer | **2.3 s** median (n = 46) |
+
---
## Contents
@@ -131,38 +140,23 @@ come from the planner the phone uses, on the scan's floor.
**Real output, from the author's own living room:** one walk with an iPhone, rebuilt on a Mac. The room map shows
floor, furniture and walls as cells, and the things as dots. The scan holds no photos of the home; the only footage in this repo is one short screen
-recording and one frame of it, which the author reviewed and chose to publish (`apps/web/public/demo-video/`).
+recording and one frame of it (the AR shot below), which the author reviewed and chose to publish (`apps/web/public/demo-video/`).
-  |
-  |
-  |
-
-
- | Ask. Muse Spark Open picks the tools; the place comes from the 3D memory. Take me there walks you to it. |
- Your rooms. The map MapAnything and SAM 3.1 built from one walk. Swipe between rooms; tap one to see only its things, or see them through the camera in AR. |
- Why? The sighting behind the answer, and which model worded it, in how long. |
-
-
-  |
-  |
-  |
-
-
- | Your things. By room, then the furniture they're on or near. Go on every row. |
- Found. Check what the scan found; fix a name, colour or height; the unsure ones are marked. |
- Robot Access. Off by default. A robot gets the map and where things are, never photos or anyone's position. |
+ 
Ask. Muse Spark Open picks the tools; the place comes from the 3D memory. Take me there walks you to it.
|
+ 
Your rooms. The map MapAnything and SAM 3.1 built from one walk. Swipe between rooms; tap one to see only its things, or see them through the camera in AR.
|
+ 
Why? The sighting behind the answer, and which model worded it, in how long.
|
-  |
-  |
- |
+ 
Your things. By room, then the furniture they're on or near. Go on every row.
|
+ 
Found. Check what the scan found; fix a name, colour or height; the unsure ones are marked.
|
+ 
Robot Access. Off by default. A robot gets the map and where things are, never photos or anyone's position.
|
- | Scans. Every walk gets a quality report. When a walk doesn't line up with the last one, Recall says so rather than guessing what moved. |
- Devices. iPhone is available now; Apple Watch and home robots are previews; Meta AI glasses are planned. |
- |
+ 
Scans. Every walk gets a quality report. When a walk doesn't line up with the last one, Recall says so rather than guessing what moved.
|
+ 
Devices. iPhone is available now; Apple Watch and home robots are previews; Meta AI glasses are planned.
|
+ 
See it in AR. What Recall remembers, labelled on the real room through the camera, each with how sure it is.
|
@@ -626,6 +620,7 @@ erDiagram
Measured, dated, and recorded in `docs/verification.md`. Nothing below is estimated.
+- **First real tester:** a 65-year-old with low vision used the app on the author's iPhone and said that after a couple of runs he could guide himself through the rooms and find his wallet. One person's account, not a measured study.
- **Reconstruction speed (M5 Pro, Apple GPU):** one room, 63 frames from a 21-second phone video, MapAnything with the Apache-2.0 weights: **19.6 s** of inference, **14.8 GB** peak memory, 11.3 s to load the model.
- **Scale, images only:** two tape-measured desks (78 cm and 61 cm) came out about **23 % too large**, both by the same factor, so the shape is right and the absolute scale is not. This is why the pipeline feeds the phone's depth and poses into MapAnything. The tape-measured 20 cm check with the phone's inputs is still open.
- **Room processing:** **60 s** per room with the warm model server (143 s before it), on the M5 Pro.
diff --git a/docs/media/app-devices.png b/docs/media/app-devices.png
index 9f9d72c5c056f2be25f79b965e4deffa5be9a0ce..d0cf7aa01c21e866e86fbda2a66f997cc202bded 100644
GIT binary patch
literal 316617
zcmeFY^LM1r7d4t>qDdyUGqG*k#>BQJnb_vUwmLRDHYO9>wr$^@&-Z=*g}c^W>;BN|
zsjgbxPgR{$r%vs?D?&*@5&;eu4h#$oL0U>o1q=*A2Mi2~2o~aB&2a4u=<(G-O3MlK
z1pn`&NItLtDnOb@iz