cortex run
This CLI command is a shortcut to run models easily. It executes this sequence of commands:
cortex pull
: This command pulls the specified model if the model is not yet downloaded, or finds a local model.cortex engines install
: This command installs the specified engines if not yet downloaded.cortex models start
: This command starts the specified model, making it active and ready for interactions.
Usage
info
You can use the --verbose
flag to display more detailed output of the internal processes. To apply this flag, use the following format: cortex --verbose [subcommand]
.
- MacOs/Linux
- Windows
cortex [options] <model_id>
cortex.exe [options] <model_id>
Options
Option | Description | Required | Default value | Example |
---|---|---|---|---|
model_id | The identifier of the model you want to chat with. | Yes | - | mistral |
--gpus | List of GPUs to use. | No | - | [0,1] |
-h , --help | Display help information for the command. | No | - | -h |