Fine-Tuning Method in Generative AI
When you create a custom model from meta.llama-3.3-70b-instruct, OCI
Generative AI fine-tunes the model using the LoRA method.
Important
Some OCI Generative AI foundational pretrained base models supported for the dedicated serving mode are now deprecated and will retire no sooner than 6 months after the release of the 1st replacement model. You can host a base model, or fine-tune a base model and host the fine-tuned model on a dedicated AI cluster (dedicated serving mode) until the base model is retired. For dedicated serving mode retirement dates, see Retiring the Models.
Some OCI Generative AI foundational pretrained base models supported for the dedicated serving mode are now deprecated and will retire no sooner than 6 months after the release of the 1st replacement model. You can host a base model, or fine-tune a base model and host the fine-tuned model on a dedicated AI cluster (dedicated serving mode) until the base model is retired. For dedicated serving mode retirement dates, see Retiring the Models.
The following table lists the method that Generative AI uses to fine-tune the supported base model:
| Pretrained Base Model | Fine-Tuning Method |
|---|---|
meta.llama-3.3-70b-instruct |
LoRA |