Skip to main content

How to use eizen SDK with Example

  1. Upload the Video
  2. Obtain the list of Foundation Models in the eizen-VIP
  3. Eizen Admin would add two different categories of the models:
    1. Hugging Face Models:
      1. LLAVA 1.5
      2. Flemingo
      3. DinoV2
      4. Magma
    2. In-build Models
    3. LLAVA 1.5 -
    4. Flemingo
    5. DinoV2
    6. Magma
  4. Model Inference using the LLAVA 1.5 with the following options:
    1. Zero-Shot
    2. One-Shot
    3. Few-Shot
    4. Fine-Tuning
  5. For Fine-Tuning:
    1. We have to use Retraining Module with the following:
      1. Fine Tuning using the PEFT, LORA and NAS
      2. Fine Tuning without freezing the weights
  6. Deployment