Awesome

Task: TextGeneration Tags:

• TextGeneration
• Codellama-7b

Model-Codellama-7b-dvc

🔥🔥🔥 Deploy Codellama-7b model on VDP.

This repository contains the Llama2-7b Text Completion Generation Model in the vLLM and Transformers format, managed using DVC. For information about available extra parameters, please refer to the documentation on SamplingParams in the vLLM library.

Following is an example of query parameters:

{
    "task_inputs": [
        {
            "text_generation": {
                "prompt": "The capital city of Franch is ",
                "max_new_tokens": "300",
                "stop_words": "['city']",
                "temperature": "0.8",
                "top_k": "50",
                "random_seed": "42",
                "extra_params": "{\"top_p\": 0.8, \"repetition_penalty\": 2.0}"
            }
        }
    ]
}```