hugging face o colab

High-level overview of how to run LLM models

Prerequisite:

1. Transformers
2. NLP
3. Python 
4. Huggingface

Suppose you have a problem statement related to text generation to proceed with it we want to search for a text generation model that would suffice our needs.

Step 1: Search for open-source LLM models on platforms like: HuggingFace

Step 2: Select for your specific task model you want to fetch

Step 3: Select any model for testing

Step 4: Suppose we chose phi-2 model by microsoft

Step 5: There is a sample code provided for the usage of the model copy in colab and use it

Notebook link