Claude 3

Introducing same day support for the Claude 3 - Anthropics new industry leading models. Read more about the release here.

New Tool creation flow

You can now create Tools in the same way as you create Prompts and Directories. This is helpful as it makes it easier to discover Tools and easier to quickly create new ones.

Tool editor and deployments

You can now manage and edit your Tools in our new Tool Editor. This is found in each Tool file and lets you create and iterate on your tools. As well, we have introduced deployments to Tools, so you can better control which versions of a tool are used within your Prompts.

Prompt labels and hover cards

We've rolled out a unified label for our Prompt Versions to allow you to quickly identify your Prompt Versions throughout our UI. As we're rolling out these labels across the app, you'll have a consistent way of interacting with and identifying your Prompt Versions.

Committing Prompt Versions

Building on our terminology improvements from Project -> Prompt, we've now updated Model Configs -> Prompt Versions to improve consistency in our UI.

Online evaluators for monitoring Tools

You can now use your online evaluators for monitoring the logs sent to your Tools. The results of this can be seen in the graphs on the Tool dashboard as well as on the Logs tab of the Tool.

Prompt Version authorship

You can now view who authored a Prompt Version.

Filterable and sortable evaluations overview

We've made improvements to the evaluations runs overview page to make it easier for your team to find interesting or important runs.

Projects rename and file creation flow

We've renamed Projects to Prompts and Tools as part of our move towards managing Prompts, Tools, Evaluators and Datasets as special-cased and strictly versioned files in your Humanloop directories.

Logging token usage

We're now computing and storing the number of tokens used in both the requests to and responses from the model.