Skip to main content

cortex run

This CLI command is a shortcut to run models easily. It executes this sequence of commands:

  1. cortex pull: This command pulls the specified model if the model is not yet downloaded, or finds a local model.
  2. cortex engines install: This command installs the specified engines if not yet downloaded.
  3. cortex models start: This command starts the specified model, making it active and ready for interactions.

Usage

info

You can use the --verbose flag to display more detailed output of the internal processes. To apply this flag, use the following format: cortex --verbose [subcommand].


cortex [options] <model_id>

Options

OptionDescriptionRequiredDefault valueExample
model_idThe identifier of the model you want to chat with.Yes-mistral
--gpusList of GPUs to use.No-[0,1]
-h, --helpDisplay help information for the command.No--h