Skip to content

Quantize Models

This section explains how to quantize a model.

model screen 1. Open the “Model” screen.

2. Select the model you want to quantize from the model list, open the Action menu, and click “Quantize”.
model screen 3. Select the number of bits and click “Quantize”.
model screen 4. While the model is being quantized, “Quantized” status is displayed as processing.
model screen 5. When the quantization process is completed successfully, the screen will appear as shown on the left.

You can create a thread using a model that has completed the quantization process.