8.4 C
New York
Thursday, November 28, 2024

Run Mistral 7B Instruct with an API


Run Mistral 7B with an API

Mistral 7B is a 7.3B parameter mannequin from Mistral AI that outperformed Llama 2 13B on all Benchmarks and Llama 34B on many benchmarks and approaches CodeLlama 7B efficiency on code.

Contents

  • Mistral 7B Instruct
  • Working Mistral 7B Instruct with Python
  • Mistral 7B Instruct Mannequin Demo
  • Mistral 7B vs Llama 2

Mistral 7B Instruct: Wonderful-Tuning for Chat

Mistral 7B is finetuned on publicly obtainable instruction datasets leading to Mistral 7B Instruct Mannequin. It achieves outstanding efficiency, outperforming all different 7B fashions on MT-Bench and is similar to 13B chat fashions.

Working Mistral 7B Instruct with Python

You’ll be able to run Mistral 7B Instruct with our Python SDK with just some traces of code.

To get began, Signup to Clarifai right here and get your Private Entry Token(PAT) beneath safety part in settings. 

Try the Code Under:

You may as well run the Mistral 7B Instruct mannequin with the Clarifai Python API Consumer

Try the Code Under:

You may as well run Mistral 7B Instruct Mannequin utilizing the opposite Clarifai Consumer Libraries like Javascript, Java, cURL, NodeJS, PHP, and so on right here

Mannequin Demo within the Clarifai Platform:

Check out the Mistral 7B Instruct mannequin right here: clarifai.com/mistralai/completion/fashions/mistral-7B-Instruct

Screenshot 2023-09-29 at 8.19.49 AM

Mistral 7B vs Llama 2

Mistral 7B was evaluated with the efficiency of assorted Llama fashions throughout a variety of benchmarks.

  1. Mistral 7B Dominance: Mistral 7B stands out by considerably outperforming Llama 2 13B throughout all metrics.

  2. Similar to Llama 34B: Since there isn’t a Llama 2 34B model obtainable Mistral 7B’s efficiency is in contrast with Llama 34B and it is on par.

  3. Code and Reasoning: Mistral 7B additionally excels in code-related and reasoning benchmarks and it is approaches CodeLlama 7B efficiency on code.

Preserve up to the mark with AI



Related Articles

Latest Articles