Claude 3
Introducing same day support for the Claude 3 - Anthropics new industry leading models. Read more about the release here.
New Tool creation flow
You can now create Tools in the same way as you create Prompts and Directories. This is helpful as it makes it easier to discover Tools and easier to quickly create new ones.
Tool editor and deployments
You can now manage and edit your Tools in our new Tool Editor. This is found in each Tool file and lets you create and iterate on your tools. As well, we have introduced deployments to Tools, so you can better control which versions of a tool are used within your Prompts.
Prompt labels and hover cards
We've rolled out a unified label for our Prompt Versions to allow you to quickly identify your Prompt Versions throughout our UI. As we're rolling out these labels across the app, you'll have a consistent way of interacting with and identifying your Prompt Versions.
Committing Prompt Versions
Building on our terminology improvements from Project -> Prompt, we've now updated Model Configs -> Prompt Versions to improve consistency in our UI.
Online evaluators for monitoring Tools
You can now use your online evaluators for monitoring the logs sent to your Tools. The results of this can be seen in the graphs on the Tool dashboard as well as on the Logs tab of the Tool.
Filterable and sortable evaluations overview
We've made improvements to the evaluations runs overview page to make it easier for your team to find interesting or important runs.
Projects rename and file creation flow
We've renamed Projects
to Prompts
and Tools
as part of our move towards managing Prompts
, Tools
, Evaluators
and Datasets
as special-cased and strictly versioned files in your Humanloop directories.
Logging token usage
We're now computing and storing the number of tokens used in both the requests to and responses from the model.