Robie Sr. — Public User Manual v9.5.0

Operating Modes

AI Mode

Command Mode

Walkabout

Keep Watch

Owner/Memory Mode

Robie operates across five practical contexts. AI Mode is the default conversational state and now includes bounded conversational curiosity plus command-only Interview Mode. Command Mode gives direct motor control and allows the active direction to be sped up or slowed down while Robie keeps listening for STOP. Walkabout is explicit, command-only roaming with sensor redirects, no timed session cap, and a wake-word-free stop listener. Keep Watch is silent PIR-only monitoring. Owner/Memory Mode protects personal memory, speaker identity actions, and owner-only idle curiosity.

Quick Reference

The most-used commands at a glance. Best tab to keep open during testing.

Say	Robie does	Mode / sensitivity
hello	Local greeting	AI
goodbye	Goodbye sequence / sleep	CMD AI
shutdown	Goodbye/spin sequence, then halts Linux	⚠ SAFETY AI
command mode	Enters movement command mode	AI
exit	Leaves command mode	CMD
how are you	Short casual reply	AI
what are you doing	Short activity reply	AI
how are you feeling	Short status-style reply	AI
status report	Long detailed status report	AI
battery status	Reports Robie's main battery and the Bluetooth microphone battery or connection state	AI
Bluetooth microphone battery	Reports both battery systems, including the Razer percentage when connected	AI
environment check	Quick environmental snapshot	AI
air analysis	Runs deeper air analysis	⚠ SAFETY AI
what do you see	Captures a fresh the current visual reference, describes it with grounded visual awareness, and stores it as current visual reference	◎ CAM May ask one visual question
what did you see last	Describes the most recent scene photo without taking a new one	◎ CAM
look at the last image again	Re-analyzes the current visual reference without capturing a new image	◎ CAM
tell me more about the last image	Uses stored detailed visual context from the latest scene photo	◎ CAM
take a photo	Saves timestamped photo locally	AI
record a video	Records short video locally	AI
send it to me	Emails newest saved camera media	AI
email that / send that / transcribe that	Emails the most recent completed AI answer as text with its exact spoken WAV attached	✓ OWNER AI
draw a picture and send it	Takes a fresh photo, redraws it in a childlike pencil/crayon style, and emails the drawing	◎ CAM AI
interview me / interview me about [topic]	Starts command-only Interview Mode and asks one question at a time	AI Every speaker
stop the interview / end interview mode	Ends Interview Mode	AI
curiosity mode on / off	Temporarily enables or disables conversational and idle curiosity	AI
erase media	Deletes saved camera media	⚠ SAFETY AI
stop	Immediate stop	⚠ SAFETY CMD
go forward / back / left / right	Manual movement in command mode	⚠ SAFETY CMD
faster / go faster / slower / go slower	Adjusts the active Command Mode movement by one bounded speed step	⚠ SAFETY CMD Moving only
override	Disables/re-enables command-mode collision sensors	⚠ SAFETY CMD
walkabout	Starts commanded Walkabout Mode	⚠ SAFETY AI
stop	Stops Walkabout without wake word	⚠ SAFETY WALK
attention mode on/off	Toggles attention scanning/centering	◎ CAM AI
keep watch	Starts PIR-only silent Watch Mode	◎ CAM WATCH
stop watching	Stops Watch Mode or cancels pending alert	◎ CAM WATCH
look at this	Takes a temporary object image, analyzes why it may be notable, and may ask one grounded question	◎ CAM Visual curiosity
examine / analyze this	Records a 3-second object video, analyzes key frames, and may ask one grounded question	◎ CAM Visual curiosity
tell me more	Uses recent object-inspection context	AI
describe yourself	Fuller Robie description	AI

New / Updated Commands v9.5.0

Changes and additions highlighted in the latest build and command reference.

Command	Update	Note
Razer Seiren BT microphone	Automatically becomes Robie's only active voice-input path when connected; the internal lavalier resumes automatically when it disconnects	Supported Razer Seiren BT microphone using the HFP mSBC capture profile
Bluetooth microphone connected	Robie announces a confirmed connection and the current microphone battery percentage	Queued only in a safe speech slot so it does not overwrite a user turn or pending reply
Bluetooth microphone off / disconnected	Robie announces the loss and confirms that he is using his internal microphone	Audio input changes automatically without changing the selected speaker output
Bluetooth microphone battery	Battery questions and status reports now include the Razer connection state and battery percentage	The microphone may report battery level in coarse steps
low Bluetooth microphone battery	Robie warns once when the reported microphone battery reaches 20% or lower	Warning re-arms only after recovery to 30% or higher
USB speaker routing	Robie's speaker remains on its configured USB audio adapter during every microphone transition	Bluetooth audio output is never selected as Robie's production speaker
faster / go faster / slower / go slower	Adjusts an active forward, backward, left, or right Command Mode movement in 0.05 steps without stopping or restarting it	Local control only; bounded per direction, ignored while stationary, and each new direction resets to its normal starting speed
visual curiosity	Scene View, Object Inspect, and Object Examine now add one grounded significance observation when supported and may ask one visible-evidence follow-up question	No second AI request; questions remain occasional and are spaced to avoid interruptions
conversational curiosity	Robie may ask one relevant question, then one deeper question if the speaker gives a meaningful answer	Normally enabled for every active speaker; two-question ceiling outside Interview Mode
interview me / interview me about [topic]	Starts command-only Interview Mode for the current speaker	Available to everyone; asks exactly one question per turn and never starts spontaneously
stop interview / end interview mode / stop asking me questions	Ends an active Interview Mode session	Does not disable ordinary curiosity when it is ending an active interview
idle curiosity	After a recent the owner conversation and a quiet lull, Robie may first ask permission to pose one question	the owner only; may draw safely from open loops, episodic context, or a general question
curiosity mode on / off	Temporarily enables or disables conversational and idle curiosity	Turning it off clears an active interview, but a new explicit interview command remains available
email that / send that / transcribe that	Emails the last completed owner AI response as a dated text transcript with the exact Piper WAV attached	Owner-only; applies to the most recent completed AI answer
draw a picture and send it	Asks the subject to hold still, captures and redraws the scene, adds Robie's signature, then emails a borderless 3000×2000 JPEG and asks for feedback	Randomized opening and success lines; exact 3:2 ratio at 300 DPI
Robie name variants	Direct-address variants such as Ruby, Rubi, Roby, Robby, Robbie, and Rudy are interpreted as Robie in safe contexts	Does not rewrite ordinary conversation about a real person with that name
automatic episodic memory	Maintains bounded owner-only conversational continuity	Owner-only private context; protected controls are documented separately
resident streaming Piper	Keeps the voice loaded and begins playback as synthesized audio arrives	Internal speech-performance behavior, not a spoken command
latest visual reference	Robie keeps the current visual reference as his current visual reference until a new scene photo replaces it	v5.4.9 visual-reference persistence
what did you see last	Uses the last captured scene image or stored detailed observation	Does not take a new photo
look at the last image again	Re-analyzes the existing the current visual reference	Useful when the first spoken summary was too short
tell me more about the last image	Gives a fuller answer from detailed visual context	Short spoken view plus deeper follow-up detail
state watchdog wake guard	Protects active wake sequence from false stale-state resets caused by wall-clock jumps	v5.4.8
right / left / forward / backward	No longer trigger AI-mode movement when heard as standalone words	v5.4.7; command mode remains direct-control
AI-mode movement phrases	Now require short, direct movement wording before Robie moves	v5.4.5 safety hardening
go back	No longer acts as a bare AI-mode backward trigger	Use `back up`, `go backward`, or `go back a bit` for AI-mode movement
go back outside / go back to...	Stays conversational and does not trigger motors	Prevents accidental backward movement
walkabout	Starts command-only Walkabout Mode	v5.4.0
Walkabout duration	The former 120-second automatic stop has been removed	Walkabout now continues until stopped through its wake-word-free stop listener
go for a walk	Starts command-only Walkabout Mode	No automatic boredom trigger
stop	Stops Walkabout without wake word while Walkabout is active	Safety-sensitive
what are you doing	Short activity reply	v5.3.1 identity-routing fix
describe yourself	Fuller Robie identity/self-description reply	Separate from activity questions
how are you feeling	Short system-status style reply	Not the full status report
status report	Long detailed status report	Use for full diagnostic report
environment check	Environmental quick snapshot	Temperature/humidity/pressure/air-quality
air analysis	Deep air-quality analysis with VOC trend detection	Longer on-demand sampling
internal air analysis	Deep air-quality analysis with VOC trend detection	New accepted phrase
erase media	Deletes saved camera media	Now accepted by cleanup detector
facts memory status	Checks facts-memory file health	Direct local status check

Core Modes

Wake, sleep, shutdown, command mode entry/exit, time, and Robie identity Shutdown halts Linux after goodbye/spin sequence

⚠ Shutdown noteThe shutdown command triggers a goodbye/spin sequence and then halts the Linux OS. Keep physical access nearby when testing this command.

helloLocal greeting

▶

Accepted phrases / pattern

hellohi

What Robie does

Local greeting

Mode / context

AI mode

Note AI mode special command

goodbyeGoodbye sequence / sleep

AI + CMD

▶

Accepted phrases / pattern

goodbyebyethe byethe by

What Robie does

Goodbye sequence / sleep

Mode / context

AI / command mode

Note Works in AI mode and command mode

shutdownGoodbye/spin sequence, then halts Linux

⚠ Safety AI

▶

Accepted phrases / pattern

shutdownshut downpower downturn yourself off

What Robie does

Goodbye/spin sequence, then halts Linux

Mode / context

AI / local handler

Note Higher-risk command; keep physical access nearby

Any phrase containing command/control modeEnters movement command mode

▶

Accepted phrases / pattern

Any phrase containing control mode, command mode, or man mode

What Robie does

Enters movement command mode

Mode / context

AI / local handler

Note Normalizer also maps enter commando and commando mode to command mode

exitLeaves command mode

CMD

▶

Accepted phrases / pattern

exitconversation modeexit control modeexit command modeexit mode

What Robie does

Leaves command mode

Mode / context

Command mode

Note Command mode only

what time is itSpeaks clock-style time response

▶

Accepted phrases / pattern

what time is ittell me the timewhat's the timetime

What Robie does

Speaks clock-style time response

Mode / context

AI mode

Note Current reply refers to clock on Robie's chest

describe yourselfGives fuller Robie identity/personality description

▶

Accepted phrases / pattern

describe yourselftell me about yourselftell me who you arewho are youwhat are youwhat can you dowhat do you dowhat kind/sort of robot are youtell me what you areexplain what you are

What Robie does

Gives fuller Robie identity/personality description

Mode / context

AI / local handler

Note v5.3/v5.3.1 exact/anchored matching prevents what are you doing misroute

Conversation & Curiosity

Occasional conversational and visual follow-ups, explicit Interview Mode, and permission-based idle questions Conversational, visual, and interview features work for everyone; idle curiosity is owner-only

Four deliberately different behavioursConversational curiosity may add one relevant question to a normal answer and, after a meaningful reply, one deeper probe. Visual curiosity makes Robie notice why a visible scene or object may be meaningful and may add one grounded question. Interview Mode asks one question at a time but begins only after an explicit command. Idle curiosity may approach only the owner during a quiet conversational lull and must ask permission before posing its actual question.

🔒 Speaker privacyGuests may receive conversational and grounded visual follow-ups and may use Interview Mode, but their current-session conversation does not gain access to the owner’s private facts, open loops, or episodic memory. Idle curiosity never activates for a guest speaker.

conversational curiosityMay ask one relevant question and one deeper probe

▶

Accepted phrases / pattern

No activation phrase. This is normally enabled for every active speaker during ordinary AI conversation.

What Robie does

After fully answering, Robie may end with exactly one short question relevant to what the speaker just said. If the speaker gives a clear, meaningful answer, Robie may acknowledge it and ask exactly one more specific question about a detail in that answer.

Mode / context

AI conversation / every speaker

Note A 25% chance gate and a three-turn cooldown keep the opening question occasional. The deeper probe is available only on the immediate meaningful answer, expires after 120 seconds, and never rearms itself. Vague or garbled replies, reluctance, refusals, questions back to Robie, commands, subject changes, and sensitive topics receive no deeper probe. Ordinary curiosity therefore has a hard ceiling of two related questions; sustained questioning still requires explicit Interview Mode. Both questions use their normal AI response requests, so curiosity adds no separate API call.

visual curiosityShows grounded awareness of what Robie just saw and may ask one visual question

◎ Camera AI

▶

Activation phrases / paths

what do you seewhat is in front of youlook at thisinspect thisexamine thisanalyze thisanalyse this

What Robie does

Describes visible facts and, when clearly supported, adds one cautious observation about what appears notable, useful, unusual, or relevant. He may then ask exactly one short question grounded in visible evidence.

Mode / context

Scene View, Object Inspect, and Object Examine / every speaker

Note The significance observation is requested on every clear visual result; the question remains occasional. Visual questions remain occasional and are spaced to avoid interruptions. Visual curiosity uses the existing vision request and therefore adds no second API request. Robie must omit the observation or question when it would require guessing, and must not infer identity, private circumstances, health, emotion, relationships, ownership, value, or intent from appearance.

interview meStarts command-only Interview Mode

▶

Accepted phrases / pattern

interview meinterview me about [topic]ask me questionsask me some questionsask me questions about [topic]start interviewstart an interviewstart interview modestart interview mode about [topic]

What Robie does

Begins interviewing the current speaker, briefly acknowledges each response when appropriate, and asks exactly one concise next question per turn.

Mode / context

AI conversation / every speaker

Note Interview Mode never begins spontaneously. If no topic is supplied, the interview develops naturally from the person's answers. Robie avoids invasive medical, financial, sexual, and authentication questions.

stop the interviewEnds Interview Mode

▶

Accepted phrases / pattern

stop interviewstop the interviewend interviewend the interviewend interview modeexit interview modethat's enough questionsno more questionsstop asking questionsstop asking me questions

What Robie does

Ends the current interview and returns to ordinary AI conversation.

Mode / context

Active Interview Mode

Note When an interview is active, stop asking me questions ends that interview without turning off the normally enabled conversational-curiosity preference.

curiosity mode on / offControls conversational, visual, and idle curiosity for the current service session

▶

Accepted on phrases

curiosity mode oncuriosity onturn curiosity onbe more curiousyou can ask me questions

Accepted off phrases

curiosity mode offcuriosity offturn curiosity offstop being curiousstop asking me questionsdon't ask me questionsdo not ask me questions

What Robie does

Temporarily enables or disables conversational follow-ups, visual questions/awareness, and owner-only idle offers.

Mode / context

AI / runtime preference

Note Turning curiosity off also clears a current interview or pending idle offer, but it does not disable the separate Interview Mode command; a new explicit interview me command can still start one.

owner idle curiosityMay politely ask the authorized owner for permission to pose one question

✓ Owner only AI

▶

How it works

During an appropriate quiet conversational moment, Robie may ask permission before posing one bounded curiosity question. Guests do not receive owner-memory-based idle questions.

What Robie does

Accepts a clear yes or no and continues normally.

Mode / context

AI / authorized owner only

Note Exact identity, eligibility, timing, and recovery behavior is documented only in the private owner/service manual.

automatic curiosity cancellationPrevents question modes from leaking into incompatible states

⚠ State safety

▶

Trigger

Speaker change, sleep, shutdown, Command Mode entry, Keep Watch start, or Walkabout start.

What Robie does

Clears Interview Mode, any pending deeper conversational probe, and any pending idle-curiosity permission request.

Mode / context

Automatic state protection

Note This does not erase memory or permanently change the curiosity preference. It only clears active question state so the next operating mode begins cleanly.

Status & Battery

Casual status, short status, full reports, facts memory status, environment, air analysis, main battery, and Bluetooth microphone battery Use how are you feeling for short status; status report for full report

Status routing notehow are you is casual. how are you feeling is a short status-style reply. status report or system report produces the long detailed report.

Bluetooth microphone operationWhen the paired Razer Seiren BT connects, Robie automatically uses it as the active microphone and stops using the internal lavalier. When the Razer powers off or disconnects, Robie automatically returns to the internal lavalier. The configured USB audio output remains Robie's speaker throughout.

Battery warningRobie warns when the reported microphone battery reaches 20% or lower. The warning resets after the microphone has been recharged sufficiently. Battery readings may appear in coarse steps.

how are youGives short casual banter/status reply

▶

Accepted phrases / pattern

how are youhow are you doingare you okayare you okare you alrightyou okayyou okyou alright

What Robie does

Gives short casual banter/status reply

Mode / context

AI / local handler

Note Separate from how are you feeling

what are you doingGives short activity reply

▶

Accepted phrases / pattern

what are you doingwhat are you up towhat you doingwhat are you working on

What Robie does

Gives short activity reply

Mode / context

AI / local handler

Note v5.3.1 fix: should not trigger identity/self-description

how are you feelingGives short status-style health/environment summary

▶

Accepted phrases / pattern

how are you feelinghow do you feelare you feelingyou feelinghow are your systemshow do your systems feelhow are your systems feelinghow do you feel todayhow are you holding up

What Robie does

Gives short status-style health/environment summary

Mode / context

AI / local handler

Note Kept separate from full report by design

status reportReports detailed system/camera/memory/audio/main-battery/Bluetooth-microphone/environment status

▶

Accepted phrases / pattern

status reportsystem reportsystem statusrobot statusdiagnostic reportdiagnostic statusdiagnostic checkfull status reportfull system reportdetailed status reportdetailed system reportcheck yourselfrun diagnostics

What Robie does

Reports detailed system, camera, memory, USB audio, main battery, Bluetooth microphone connection and battery, and environment status

Mode / context

AI / local handler

Note Longer report remains available only through explicit report wording

memory statusReports facts-memory file health

🔒 Privacy AI

▶

Accepted phrases / pattern

memory statusfacts memory statusfact memory statusfacts statusare your memory files okayare your facts memory files okayis your facts memory okayis facts memory okaycheck facts memorycheck memory files

What Robie does

Reports facts-memory file health

Mode / context

AI / local handler

Note Direct local status check

battery statusReports Robie's main battery plus Bluetooth microphone state and battery

▶

Accepted phrases / pattern

battery statusbattery levelbattery percentagehow much batteryhow much powerhow much chargepower remainingcharge remainingare you chargedare you low on batterydo you need chargingBluetooth microphone batteryBluetooth mic batterymicrophone batteryRazer batterySeiren battery

What Robie does

Reports Robie's main battery and the Razer battery percentage when connected; otherwise reports that the Bluetooth microphone is off or disconnected

Mode / context

AI / local handler

Note Reports the installed main-battery monitor and the connected microphone battery

environment checkQuick environmental-sensor snapshot

▶

Accepted phrases / pattern

environment checkenvironmental check

What Robie does

Quick environmental-sensor snapshot

Mode / context

AI / local handler

Note Temperature, humidity, pressure, and air-quality status

air analysisRuns deeper on-demand air/VOC trend analysis

⚠ Safety AI

▶

Accepted phrases / pattern

air analysisrun air analysisanalyze airanalyse airdeep air analysisinternal air analysisrun internal air analysis

What Robie does

Runs deeper on-demand air/VOC trend analysis

Mode / context

AI / local handler

Note Takes a longer sampling window; not passive conversation

Camera, Media & Sharing

Vision description, current visual reference, transcript sharing, child-style drawing, photo/video capture, email sending, cleanup Scene View stays separate from Object Inspect/Examine

◎ Camera privacy noteScene View, Object Inspect, Object Examine, and Keep Watch are separate camera paths. Scene View describes the room and stores the most recent scene photo as Robie's current visual reference. Object modes focus on what is being shown. Keep Watch captures evidence after PIR motion.

◎ Current visual referenceAfter what do you see?, Robie keeps the current visual reference file as his current visual reference until a new scene image replaces it, the service restarts, or the file is deleted. Follow-up questions can use the stored detailed observation or re-analyze the same image.

Exact sharing phrases matteremail that, send that, email me that, send me that, and transcribe that refer to Robie's most recent completed AI answer. Phrases such as send that to me, email that to me, or send it to me remain camera-media commands.

email that / send that / transcribe thatEmails the most recent completed AI answer as text with its exact spoken WAV

🔒 Privacy ✓ Owner-only AI

▶

Accepted phrases / pattern

email thatemail me thate mail me thatmail me thatsend thatsend me thattranscribe thatemail me that answersend me that answeremail me the last answersend me the last answeremail me your answersend me your answeremail the last answer to mesend the last answer to me

What Robie does

Emails a dated transcript containing the owner’s question and Robie's answer, with the exact completed Piper speech WAV attached

Mode / context

AI / owner-only local handler

Note Only the latest completed AI-generated answer is available. A newer completed answer replaces it. If email fails, the transcript and WAV are retained for another try.

draw a picture and send itTakes a fresh photo, redraws it like a child's pencil/crayon picture, and emails the JPEG

◎ Camera AI

▶

Accepted phrases / pattern

draw a picture and send itdraw a picture and send it to medraw me a picture and send itdraw me a picture and send it to medraw a picture and email itdraw a picture and email it to medraw me a picture and email itdraw me a picture and email it to me

What Robie does

First speaks one of several hold-still messages explaining that the task may take a minute or two. After that message finishes, he captures one new camera photo, submits it to GPT Image 2 with the installed child-drawing style reference, crops the result to an exact 3:2 frame that removes Robie's lower shell, adds Robie's transparent signature at bottom-right, and saves a borderless 3000×2000 JPEG tagged at 300 DPI. Following confirmed email delivery, he speaks one of several completion messages and asks what the recipient thinks.

Mode / context

AI / camera and image-generation task

Note Opening and successful-completion lines are randomized without deliberately repeating the immediately previous personality line. The feedback invitation is spoken only after successful email delivery. The generated image is natively 1536×1024; print preparation crops it to the approved framing and upscales it, so it does not create additional native detail. The file itself contains no added white borders. At 300 DPI its native print size is 10×6.67 inches. Because 3:2 and 8×10 paper have different shapes, filling an entire 8×10 sheet requires printer-side cropping; fitting the whole image on that sheet produces paper margins. This billable generative request may take about a minute, during which Robie pauses normal listening and can appear idle. If the style file is unavailable, prompt-only styling is used. If the signature file is unavailable, the drawing continues without it and records the issue in the journal. A failed redraw or print-preparation step preserves the source photo; a failed email preserves the finished drawing; successful delivery deletes the local drawing.

what do you seeCaptures fresh `latest_view.jpg`, describes it, and stores it as current visual reference

◎ Camera

▶

Accepted phrases / pattern

what do you seewhat can you seewhat are you seeingwhat do you see Robiewhat can you see Robiedescribe what you seedescribe the roomdescribe your viewtell me what you seelook aroundtake a lookuse your cameralook with your camera

What Robie does

Captures a fresh the current visual reference, describes it, and stores it as current visual reference

Mode / context

Scene View

Note No identity guessing; wide room/view camera path. Also updates Robie's current visual reference.

last image referenceUses or re-analyzes the most recent scene photo

◎ Camera

▶

Accepted phrases / pattern

what did you see lastwhat was in the last imagedescribe the last phototell me more about the last imagewhat else did you seelook at the last image againanalyze the last photo

What Robie does

Uses stored detailed visual context or re-analyzes the current visual reference file without taking a new photo

Mode / context

Scene View / current visual reference

Note The current visual reference remains available until a new scene photo replaces it, Robie restarts, or the image file is deleted.

what do you see in front of youDescribes front camera view

◎ Camera

▶

Accepted phrases / pattern

what do you see in front of youwhat can you see in front of youtell me what is in front of youtell me what's in front of youdescribe what is in front of youdescribe what's in front of you

What Robie does

Describes front camera view

Mode / context

Scene View

Note Updates Robie's current visual reference for later follow-up questions.

take a photoSaves timestamped photo locally

▶

Accepted phrases / pattern

take a phototake phototake a picturetake picturesnap a photosnap a pictureshoot a photocapture a photocapture photo

What Robie does

Saves timestamped photo locally

Mode / context

AI / local handler

Note Stored in camera photo directory

send/email + photo requestTakes photo, emails it, then deletes local copy if send succeeds

▶

Accepted phrases / pattern

Any send, email, or mail request that also includes photo, picture, image, or pic, such as take a photo and send it

What Robie does

Takes photo, emails it, then deletes local copy if send succeeds

Mode / context

AI / local handler

Note Uses the configured email service

record a videoRecords short video locally

▶

Accepted phrases / pattern

record a videorecord videotake a videotake videorecord a short videotake a short videocapture a videocapture video

What Robie does

Records short video locally

Mode / context

AI / local handler

Note Stored in camera video directory

send/email + video requestRecords video, emails it, then deletes local copy if send succeeds

▶

Accepted phrases / pattern

Any send, email, or mail request that also includes video or clip, such as record a short video and send it

What Robie does

Records video, emails it, then deletes local copy if send succeeds

Mode / context

AI / local handler

Note Uses the configured email service

send latest mediaSends newest saved photo/video

▶

Accepted phrases / pattern

sendemailmailcamera medialast medialatest media

What Robie does

Sends newest saved photo/video

Mode / context

AI / local handler

Note Sends newest camera media file

send latest photoSends newest saved photo

▶

Accepted phrases / pattern

sendemailmailphotopictureimagepiclast photolatest photo

What Robie does

Sends newest saved photo

Mode / context

AI / local handler

Note Photo-specific latest-media send

send latest videoSends newest saved video

▶

Accepted phrases / pattern

sendemailmailvideocliplast videolatest video

What Robie does

Sends newest saved video

Mode / context

AI / local handler

Note Video-specific latest-media send

send it to meSends newest camera media file

▶

Accepted phrases / pattern

send it to meemail it to mesend that to meemail that to mesend the fileemail the file

What Robie does

Sends newest camera media file

Mode / context

AI / local handler

Note Works after recent photo/video capture

erase mediaDeletes saved camera photos/videos

⚠ Safety AI

▶

Accepted phrases / pattern

Delete words delete, erase, clear, remove, clean, cleanup, purge, wipe, or trash plus camera/photo/video/media wording; examples: erase media, delete all photos, delete camera files, clear camera media, delete photos and videos, delete videos

What Robie does

Deletes saved camera photos/videos

Mode / context

AI / local handler

Note Conservative: only camera photo/video directories; does not touch the current visual reference or object temp files

Scene ViewGeneral wide-angle view and regular camera media functions

◎ Camera

▶

Accepted phrases / pattern

what do you see

What Robie does

General wide-angle view and regular camera media functions

Mode / context

Scene View

Note This is the normal room/view camera path; not object-specific

look at thisCaptures temporary object image and answers about the presented object

◎ Camera

▶

Accepted phrases / pattern

look at thislook at this objectinspect thisinspect this objectcheck thischeck this outwhat is thiswhat's thiswhat am I holdingwhat is in my handwhat's in my handread thisread this labelread the labellook at this labellook at this recordlook at this albumlook at this coverlook at this capacitorlook at this resistorlook at this transistorlook at this tubelook at this partlook at this componentcan you see this

What Robie does

Captures temporary object image and answers about the presented object

Mode / context

Object Inspect

Note Object-focused prompt; no permanent image storage; no identity certainty

examine thisRecords temporary 3-second video, extracts frames, analyzes object across angles

◎ Camera

▶

Accepted phrases / pattern

examine thisexamine this objectexamine this partexamine this recordexamine this capacitorexamine this labelanalyze thisanalyze this objecttake a closer looktake a close looklook at this closelyinspect this videovideo inspect thisvideo examine this

What Robie does

Records temporary 3-second video, extracts frames, analyzes object across angles

Mode / context

Object Examine

Note Robie says: Alright. Hold it steady and rotate it slowly.

tell me moreContinues discussion using recent object context

◎ Camera

▶

Accepted phrases / pattern

tell me morewhat does it sayis it damagedwhat should I checkwhat value is itcan you read it

What Robie does

Continues discussion using recent object context

Mode / context

Object Inspect / Object Examine

Note Temporary only; separate from Scene View visual context

keep watchStarts silent PIR-only room-monitoring mode

◎ Camera Watch

▶

Accepted phrases / pattern

keep watchstart watchstart watchingstart keep watchstart watch modewatch modewatch the roomwatch this roomkeep an eye on thingskeep an eye on the room

What Robie does

Starts silent PIR-only room-monitoring mode

Mode / context

Keep Watch

Note Suspends Attention Mode/idle sleep; LEDs off; no normal AI chat

stop watchingStops Watch Mode or cancels pending alert

◎ Camera Watch

▶

Accepted phrases / pattern

stop watchingstop watchend watchend watchingstop keep watchend keep watchstop watch modeend watch modewatch mode offkeep watch offturn off watchturn off watchingturn off keep watchcancel watchcancel watchingcancel watch modecancel keep watchdisable watchdisable keep watchdisarmdisarm watchdisarm keep watchstand down

What Robie does

Stops Watch Mode or cancels pending alert

Mode / context

Keep Watch

Note Restores previous Attention Mode state; uses an owner-authorized alert-cancellation control

PIR motion detectedEmails one event photo plus one 10-second event video

◎ Camera Watch

▶

Accepted phrases / pattern

PIR-only trigger while Keep Watch is armed

What Robie does

Emails one event photo plus one 10-second event video

Mode / context

Keep Watch

Note AI summarizes already-captured alert photo for email when enabled; no face recognition

Object Inspection

Look at this / Examine this / Analyze this object-helper commands Object Examine is now 3 seconds

◎ Object mode noteObject Inspect uses a still photo. Object Examine now records a temporary 3-second video and extracts key frames. Neither mode is for identity certainty.

look at thisTakes a temporary still image and analyzes the presented object

◎ Camera

▶

Accepted phrases / pattern

What Robie does

Takes a temporary still image and analyzes the presented object

Mode / context

Object Inspect

Note Robie says: Hold it steady.

examine thisRecords 3-second temporary video, extracts key frames, analyzes the object from multiple angles

◎ Camera

▶

Accepted phrases / pattern

What Robie does

Records 3-second temporary video, extracts key frames, analyzes the object from multiple angles

Mode / context

Object Examine

Note Robie says: Alright. Hold it steady and rotate it slowly.

tell me moreUses recent object-inspection/examination context for follow-up answers

▶

Accepted phrases / pattern

tell me morewhat does it sayis it damagedwhat should I checkwhat value is itcan you read it

What Robie does

Uses recent object-inspection/examination context for follow-up answers

Mode / context

AI mode

Note Temporary context only; no permanent image/video storage

look at this capacitorUses camera plus audio context to help inspect parts/markings

⚠ Safety ◎ Camera

▶

Accepted phrases / pattern

look at this capacitorlook at this resistorlook at this transistorlook at this tubelook at this partlook at this componentread this partwhat value is thiscan you see this transistor number

What Robie does

Uses camera plus audio context to help inspect parts/markings

Mode / context

Object Inspect / Object Examine

Note Double-check values with a meter/schematic when stakes matter

look at this recordUses camera to identify/describe record sleeves, labels, or condition clues

◎ Camera

▶

Accepted phrases / pattern

look at this recordlook at this albumlook at this album coverlook at this coverwhat record is thisexamine this record

What Robie does

Uses camera to identify/describe record sleeves, labels, or condition clues

Mode / context

Object Inspect / Object Examine

Note Pressing details may require label/runout close-up

object/person shownAvoids identity claims

◎ Camera 🔒 Privacy

▶

Accepted phrases / pattern

If a person is shown, describe only visible non-sensitive details

What Robie does

Avoids identity claims

Mode / context

Object Inspect / Object Examine

Note No face recognition, no identity certainty

Command Movement

Manual forward/back/left/right, dynamic speed adjustment, stop, sensors, override Physical motor kill switch remains the real-world safety layer

⚠ Physical safetyAlways place Robie on the floor before issuing movement commands. Keep the physical motor kill switch within reach. Re-entering Command Mode resets sensors back ON.

Any command-mode phrase containing stopImmediate stop

⚠ Safety CMD

▶

Accepted phrases / pattern

Any command-mode phrase containing stop, halt, freeze, enough, or cancel; grammar also includes stop stop, please stop, stop it

What Robie does

Immediate stop

Mode / context

Command mode

Note Broad by design for safety

go forward...Drives forward

⚠ Safety CMD

▶

Accepted phrases / pattern

go forwardgo straightforwardstraightcome herego forwardsforwardsstreet

What Robie does

Drives forward

Mode / context

Command mode

Note Sensors active unless override

go backward...Drives backward

⚠ Safety CMD

▶

Accepted phrases / pattern

go backwardgo backwardsbackwardbackwardsgo backback up

What Robie does

Drives backward

Mode / context

Command mode

Note Rear sensor active

go left...Turns left

CMD

▶

Accepted phrases / pattern

go leftturn leftmove leftleft

What Robie does

Turns left

Mode / context

Command mode

Note Command mode

go right...Turns right

CMD

▶

Accepted phrases / pattern

go rightturn rightmove rightright

What Robie does

Turns right

Mode / context

Command mode

Note Command mode

faster / go faster · slower / go slowerAdjusts the active movement speed

⚠ Safety CMD

▶

Accepted phrases / pattern

fastergo fasterslowergo slower

What Robie does

Raises or lowers the currently active forward, backward, left, or right speed by 0.05 through a smooth motor ramp

Mode / context

Command Mode while moving

Note Commands are ignored while stationary. Forward is bounded from 0.25 to 0.80, backward from 0.20 to 0.70, and turns from 0.15 to 0.45. Each new direction resets to its normal speed. Robie gives no spoken acknowledgement so he remains ready to hear an urgent STOP command.

overrideDisables command-mode collision sensors until cancelled or mode exit

⚠ Safety CMD

▶

Accepted phrases / pattern

overrideover rideover rightoverridedsensor overridesensors overrideoverride sensorsforce overrideignore sensorsignore sensorsensor offsensors off

What Robie does

Disables command-mode collision sensors until cancelled or mode exit

Mode / context

Command mode

Note Re-entering command mode resets sensors ON

sensors onRe-enables command-mode collision sensors

⚠ Safety CMD

▶

Accepted phrases / pattern

sensors onsensor onenable sensorsactivate sensorsactivate sensorarm sensorsarm sensorsensors activecancel overridecancel sensor override

What Robie does

Re-enables command-mode collision sensors

Mode / context

Command mode

Note Command mode

AI Movement & Gestures

AI movement, dance, show-off, spin, look-both-ways, duration modifiers Gestures are not navigation; AI movement now requires direct command wording

⚠ Gesture noteAI movement and gestures are short timed actions, not navigation. In this build, AI movement ignores collision sensors by design.

⚠ v5.4.5 AI movement safetyAI-mode movement should only fire from short, direct commands such as back up, go backward, go back a bit, move forward, turn left, or turn right. Conversational phrases such as I want to go back outside, go back to the old version, or move forward with the idea should remain conversation and should not move Robie.

Any AI-mode phrase containing stopStops motion

⚠ Safety AI

▶

Accepted phrases / pattern

Any AI-mode phrase containing stop, halt, or freeze

What Robie does

Stops motion

Mode / context

AI mode

Note AI mode

danceDance/show-off gesture

⚠ Safety AI

▶

Accepted phrases / pattern

dancedance for medo a danceshow me your dance movesshow your dance movesdo a little dancegive me a little dancedo a wiggledo a little wiggleboogiebust a move

What Robie does

Dance/show-off gesture

Mode / context

AI mode

Note No navigation intent

spin aroundSpin/show-off gesture

⚠ Safety AI

▶

Accepted phrases / pattern

spin aroundturn arounddo a spinspinshow offshow off for me

What Robie does

Spin/show-off gesture

Mode / context

AI mode

Note Uses tuned dance/spin settings

look both waysLook-both-ways gesture

◎ Camera AI

▶

Accepted phrases / pattern

look both wayslook left and rightcheck both wayscheck left and rightlook aroundhave a look around

What Robie does

Look-both-ways gesture

Mode / context

AI mode

Note Note: look around is checked as camera vision before AI motion in special parsing

come hereShort timed forward motion

⚠ Safety AI

▶

Accepted phrases / pattern

come herecome over herecome closermove closerget closercome to mecome toward mecome towards memove forwardgo forwardgo straightmove straightforwardstraightstreet

What Robie does

Short timed forward motion

Mode / context

AI mode

Note v5.4.5 direct-command hardening suppresses conversational uses such as move forward with the idea or other non-physical wording.

back upShort timed backward motion

⚠ Safety AI

▶

Accepted phrases / pattern

back upbackupback a bitmove backmove back a bitgo back a bitgo backwardgo backwardsmove backwardmove backwardsback awaymove awayreversegive me some spacegive me spacebackwardbackwards

What Robie does

Short timed backward motion

Mode / context

AI mode

Note v5.4.5 removes bare go back as an AI-mode trigger. Use go back a bit, go backward, or back up for intentional AI-mode backward movement. AI movement ignores collision sensors by design in this build.

go leftShort timed left turn

⚠ Safety AI

▶

Accepted phrases / pattern

go leftturn leftmove leftleft

What Robie does

Short timed left turn

Mode / context

AI mode

Note AI mode

go rightShort timed right turn

⚠ Safety AI

▶

Accepted phrases / pattern

go rightturn rightmove rightright

What Robie does

Short timed right turn

Mode / context

AI mode

Note AI mode

Phrases containing tiny/short/longAdjusts AI movement duration

⚠ Safety AI

▶

Accepted phrases / pattern

Phrases containing tiny, small, little, short, quick, slightly, bit, long, far, etc.

What Robie does

Adjusts AI movement duration

Mode / context

AI / local handler

Note Parsed by _motion_duration()

User response after Robie asks for dance feedbackClassifies feedback positive/negative/neutral

⚠ Safety AI

▶

Accepted phrases / pattern

User response after Robie asks for dance feedback

What Robie does

Classifies feedback positive/negative/neutral

Mode / context

AI / local handler

Note Only inside short feedback window

Walkabout Modev5.4.0

Command-only roaming mode, obstacle redirect, wake-word-free stop Never starts automatically; say stop to end

⚠ Walkabout test-build noteWalkabout is command-only. It never starts from boredom or idle behaviour. While active, say stop without the wake word to end the session. The former 120-second automatic session cap has been removed.

walkaboutStarts commanded Walkabout Mode

⚠ Safety AI

▶

Accepted phrases / pattern

walkaboutwalk aboutwalk a boutwalkabout modestart walkaboutstart walk aboutstart walkabout modego walkaboutgo walk aboutgo for a walkgo for a little walktake a walktake a little walkgo on a walktake yourself for a walkgo for a strolltake a strollgo for a wanderhave a wanderwander aroundroam aroundgo roaminggo roam around

What Robie does

Starts commanded Walkabout Mode

Mode / context

AI / local handler

Note No idle/boredom auto-trigger; refuses if busy, speaking, moving, in Keep Watch, command mode, shutdown, or not fully awake

stopStops Walkabout Mode

⚠ Safety Walkabout

▶

Accepted phrases / pattern

Wake-word-free stop listener accepts command-mode stop phrases: stop, halt, freeze, enough, cancel; grammar also includes please stop, stop it, stop stop

What Robie does

Stops Walkabout Mode

Mode / context

Walkabout Mode

Note Does not require saying Robie first. With the timed session cap removed, this is the normal way to end Walkabout.

obstacle detectedStops, backs up if safe, turns gently, and tries another path

⚠ Safety Walkabout

▶

Accepted phrases / pattern

Front sensors trigger redirect; rear sensor protects backup

What Robie does

Stops, backs up if safe, turns gently, and tries another path

Mode / context

Walkabout Mode

Note Softer v5.4.0 tuning: forward 0.35, turn 0.30, turn window 0.30–0.65s; current forward direction-change interval is WALKABOUT_MAX_FORWARD_SECONDS = 6.0

start/redirect/complete linesKeeps Walkabout mostly quiet

Walkabout

▶

Accepted phrases / pattern

Start confirmation; low-chance redirect comments; stop/complete line

What Robie does

Keeps Walkabout mostly quiet

Mode / context

Walkabout Mode

Note Quiet by design so speech does not fight STOP recognition

Attention & Watch

Attention Mode and PIR-only Keep Watch start/stop/disarm behaviour Keep Watch and Walkabout suspend Attention Mode while active

◎ Watch/attention noteKeep Watch and Walkabout suspend Attention Mode while active. Keep Watch is PIR-only, quiet by design, and suppresses normal AI chat until stopped or disarmed.

attention mode onEnables quiet-gap camera centering/attention behaviour

◎ Camera AI

▶

Accepted phrases / pattern

attention mode ontension mode onattention onturn attention onenable attention modeenable attentionattention mode start

What Robie does

Enables quiet-gap camera centering/attention behaviour

Mode / context

AI / local handler

Note Tiny corrections only; no chasing, no hard turns, no follow mode

attention mode offDisables attention scanning/centering

▶

Accepted phrases / pattern

attention mode offtension mode offattention offturn attention offdisable attention modedisable attentionattention mode stop

What Robie does

Disables attention scanning/centering

Mode / context

AI / local handler

Note Use if you want Robie completely still during tests

keep watchStarts silent PIR-only Watch Mode after arming settle window

◎ Camera Watch

▶

Accepted phrases / pattern

keep watchstart watchstart watchingstart keep watchstart watch modewatch modewatch the roomwatch this roomkeep an eye on thingskeep an eye on the room

What Robie does

Starts silent PIR-only Watch Mode after arming settle window

Mode / context

Keep Watch

Note Robie says only the explicit start confirmation; LEDs stay off afterward

stop watchingStops Watch Mode

◎ Camera Watch

▶

Accepted phrases / pattern

What Robie does

Stops Watch Mode

Mode / context

Keep Watch

Note Reliable escape hatch; can be checked during Keep Watch suppression

PIR motion detectedCaptures event photo + 10-second event video, emails both

◎ Camera Watch

▶

Accepted phrases / pattern

No spoken command; PIR-only trigger while Watch Mode is armed

What Robie does

Captures event photo + 10-second event video, emails both

Mode / context

Keep Watch

Note AI summary can be added to email from already-captured photo; no identity recognition

continued/new PIR motionSends repeat alert packages only after cooldown if PIR motion continues or recurs

◎ Camera Watch

▶

Accepted phrases / pattern

No spoken command; automatic while Watch Mode remains active

What Robie does

Sends repeat alert packages only after cooldown if PIR motion continues or recurs

Mode / context

Keep Watch

Note Phase 2 PIR-only; retired baseline/FOV comparison constants remain harmlessly present

Owner Memory & Privacy

Robie can maintain owner-authorized conversational continuity and personal preferences.

🔒 Privacy Personal and project memory is restricted to the authorized owner. Protected recovery, disclosure, modification, and deletion phrases are documented only in the private owner/service manual.

Guest separation Guest conversations do not receive access to the owner’s private facts, project notes, or episodic history.

Speaker Identity

Guest speaker switching and Robie spoken-name variants. Protected owner recovery and unit identity controls are omitted from this public edition.

Robie spoken-name variantsTreats likely speech-recognition variants as “Robie” when clearly used to address or identify the robot

▶

Accepted names in safe context

RubyRubiRobyRobbyRobbieRudy

What Robie does

Normalizes the variant to Robie in greetings, direct address, robot-name questions, and common courtesy phrases

Mode / context

AI / speech normalization

Note Context-bound for safety: “Rudy, turn left” can address Robie, while “Rudy is my friend” and “you are talking to Rudy” retain the real person's name and speaker meaning.

you are talking to [name]Sets non-owner speaker mode

🔒 Privacy AI

▶

Accepted phrases / pattern

you are talking to [name]you are speaking to [name]this is [name] speakingswitch speaker to [name]change speaker to [name]

What Robie does

Sets non-owner speaker mode

Mode / context

AI / local handler

Note Strict to avoid accidental identity changes

describe yourselfGives fuller Robie description

▶

Accepted phrases / pattern

describe yourselftell me about yourselftell me who you arewho are youwhat are youwhat can you dowhat do you dowhat kind/sort of robot are youtell me what you areexplain what you are

What Robie does

Gives fuller Robie description

Mode / context

AI / local handler

Note Separate from what are you doing activity reply

Math & Feedback

Simple arithmetic and dance feedback handling Feedback only inside short dance-response window

what is X plus YAnswers simple spoken arithmetic

▶

Accepted phrases / pattern

what is X plus YX plus Ywhat is X minus YX minus Ywhat is X times YX times YX multiplied by YX divided by YX over Y

What Robie does

Answers simple spoken arithmetic

Mode / context

AI / local handler

Note Supports number words and digits

Aliases & Safety Notes

Vosk mishears, overlapping phrases, safety caveats Read before testing Walkabout, Watch, and camera modes

⚠ Read before testingThese mappings document Vosk mishears, overlapping phrases, and safety caveats for movement, Walkabout, Watch, and camera modes.

Alias / Phrase	Maps to / Means	Notes
street	Movement	Safety-sensitive
enter commando, commando mode	Mode switch
Ruby / Rubi / Roby / Robby / Robbie / Rudy	Robie spoken-name variant when used in direct-address or robot-identity context	Context-bound; ordinary references to real people remain unchanged
email that / send that / transcribe that	Email last AI answer transcript + WAV	Owner-only; distinct from `send that to me` camera-media routing
look around	AI mode	Camera/media-sensitive
erase media	Camera cleanup	Camera/media-sensitive
go for a walk / walkabout	Walkabout Mode	Safety-sensitive
motor kill switch	Hardware	Safety-sensitive
pause/restore attention	Attention mode	Camera/media-sensitive
no AI chat while watching	Keep Watch	Camera/media-sensitive
PIR-only	Keep Watch	Camera/media-sensitive
Scene View vs Object Inspect vs Object Examine vs Keep Watch	Camera modes	Camera/media-sensitive
hold steady and rotate slowly	Object Examine	Camera/media-sensitive
go back outside / go back to...	Conversation only in AI mode	v5.4.5: should not trigger backward movement
go back	Command-mode backward phrase; not a bare AI-mode trigger	In AI mode use `go back a bit`, `go backward`, or `back up`
latest_view.jpg	Current visual reference	Replaced by each fresh Scene View capture; not durable memory