Cortex Models Start

cortex models start

This command starts a model defined by a model_id.

Usage

# Start a model
cortex models start [model_id]

# Start with a specified engine
cortex models start [model_id]:[engine] [options]

• This command uses a model_id from the model that you have downloaded or available in your file system.

Options

Option	Description	Required	Default value	Example
model_id	The identifier of the model you want to start.	No	Prompt to select from the available models	mistral
--gpus	List of GPUs to use.	No	-	[0,1]
--ctx_len	Maximum context length for inference.	No	min(8192, max_model_context_length)	1024
-h, --help	Display help information for the command.	No	-	-h