Reachy Mini gains tools that run beyond the robot

Public Spaces can add useful capabilities to a conversation without moving their code onto the device.

Source artwork for Adding MCP Tools to Reachy Mini
Source artwork · Hugging Face / credited contributors ↗
THE SHORT VERSION

Extend the robot’s knowledge without confusing remote services with its local controls.

The Reachy Mini conversation app gained a path for calling tools hosted in public Hugging Face Spaces over MCP. The source describes adding abilities such as information lookups while keeping their implementation on the remote service.

The distinction between body controls and remote information tools is useful. Head movement belongs near the hardware, while a web lookup may not need local installation. Profiles decide which tools are available, keeping the conversation’s capabilities explicit rather than enabling everything by default.

Review the profile configuration and remote-tool limitations before adding a Space. Start with a harmless lookup and inspect its response during a conversation. Remote execution also means availability and response time depend on the service, so plan for a tool that is slow or unavailable.

A conversation tool can have physical consequences

Giving a robot access to additional tools expands what a conversation can accomplish. A request might retrieve information, change a setting or trigger an action elsewhere. These are different levels of authority, even when they are all exposed through a similar tool-calling interface.

A useful design separates conversational understanding from permission to act. The model can propose an action, but a surrounding controller should decide whether that action is available, whether its arguments are valid and whether the user needs to confirm it. This is especially important when the robot’s response is visible in the physical world.

Begin with a read-only tool

A weather lookup or a local information query is a simpler first integration than a tool that sends messages or controls equipment. Define a small input schema and return a concise result. Avoid making the tool’s output so broad that the model has to search through unrelated data to answer a simple question.

Test requests with missing details and ambiguous wording. If the user asks for “the latest one,” the system should not silently invent which item was intended. Clarification is part of a reliable interaction, not a failure of the robot’s personality.

Keep tool latency out of motion control

A remote request can be slow or unavailable. The robot should remain responsive and behave predictably while waiting. A conversational tool call should not be the mechanism that guarantees a motion stops on time or keeps a hardware limit enforced.

Use explicit timeouts and a clear verbal or visual state for pending work. If a tool fails, the system should report the failure rather than narrate a result it did not receive. Repeating an action after a timeout requires particular care when the first request may already have completed.

Review what crosses the connection

Only send the data a tool needs. A complete conversation transcript, camera image or microphone recording should not be forwarded simply because it is available in the application. The user’s request and the tool’s purpose should determine the payload.

Tool descriptions and responses are also external inputs. They should not be allowed to redefine the robot’s higher-level instructions or grant themselves additional permissions.

The promising part of this pattern is composability: a small robot can participate in a broader software environment without every capability being built into its conversational model. The responsible implementation is equally modular, with permissions, validation and failure handling remaining explicit around each connection.

Source: Adding MCP Tools to Reachy Mini · alozowski. How we write

← Back to all articles