​
Integration with Toolhouse

Toolhouse is an tool management platform that provides a range of pre built tools for use by LLMs.

Inferable provides a native integration which allows Runs to invoke Toolhouse tools as functions.

​
Configuration

1

Get Toolhouse API Key

Get your Toolhouse API key from the Toolhouse dashboard

2

Configure Toolhouse Integration

Once you have a Toolhouse account and API key, you can configure the Toolhouse integration for a cluster by navigating to the Cluster’s “Integrations” tab in the Playground UI and providing the API key.

3

Install Tools

Tools are installed via the Toolhouse UI. Once a tool is installed it may take up to 10 minutes for the tool to be available in your cluster.

​
Attaching tools

By default, Runs have access to all tools in a cluster, with the Toolhouse integration enabled this is extended to include the tools installed in the Toolhouse account.

Toolhouse tools can be explicitly attached to a Run using the attachedFunctions property.

Tool names from Toolhouse are transformed from snake case (search_x) to camel case (searchX) when attached to the Cluster and made available within the Toolhouse service.

"attachedFunctions": [
  {
    "service": "Toolhouse",
    "function": "searchX"
  }
]

​
Tool Sync

After connecting to Toolhouse, your installed tools will be periodically synced to the cluster. It may take as long as 10 minutes for new tools to be available within Inferable.

​
Metadata

Toolhouse has the concept of metadata, which can be used to pass key value pairs to a Tool outside of the parameters provided by the model.

Inferable will pass any Run Context and Auth Context values to Toolhouse as metadata for calls.

Was this page helpful?

Private NetworkingLangfuse