llm-huggingface

LLM plugin for models hosted by NousResearch. This plugin is built following the llm-openrouter as a template.

Installation

First, install the LLM command-line utility.

At some point you should be able to install this plugin in the same environment as LLM by running

llm install llm-nousresearch

But for now, you have to install it from sources in the the same environment as LLM. See below.

Configuration

You will need an API key from Nous' portal. You can obtain one here after registering.

You can set that as an environment variable called NOUSRESEARCH_KEY, or add it to the llm set of saved keys using:

llm keys set nousresearch

Enter key: <paste key here>

Usage

To list available models, run:

llm models list

You should see a list that looks something like this:

NousResearch: Hermes-3-Llama-3.1-70B
NousResearch: DeepHermes-3-Mistral-24B-Preview
NousResearch: DeepHermes-3-Llama-3-8B-Preview

To run a prompt against a model, pass its full model ID to the -m option, like this:

llm -m Hermes-3-Llama-3.1-70B "Five spooky names for a pet tarantula"

To enable the reasoning model you can pass -o reasoning true

llm -m DeepHermes-3-Llama-3-8B-Preview "Five spooky names for a pet tarantula" -o reasoning true

Note: not yet properly implemented

Development

To set up this plugin locally, first checkout the code. Then create a new virtual environment:

cd llm-nousresearch
python3 -m venv venv
source venv/bin/activate
pip install llm

Now install the dependencies:

llm install -e '.'

Now the plugin should be available for you to try it out.