Cohere (Command-R) model lineage (mlx_lm.models.cohere2)

[uogbuji]

Working on the absorb-llm-structured-output branch. Needed an update to model_flags. Seems pretty decent, though with a few tokenization quirks.

❯ python test/quick_check.py mlx-community/c4ai-command-r7b-12-2024-8bit
Model type: cohere2
Hello! I'm a chatbot,package, and a tool for you. How can I assist you today?<|END_RESPONSE|>

 ======================================== Country extraction
[
    {
        "name": "Nigeria",
        "continent": "Africa"
    }
]

 ======================================== Square root of 256, pt 1
The square root of 256 is 16.0.<|END_RESPONSE|>

 ======================================== Square root of 256, pt 2
The square root of 256 is 16.0.

 ======================================== Square root of 256, pt 3
The square root of 256 is 16.0.<|END_RESPONSE|>

 ======================================== Usain bolt
Usain Bolt's average velocity was 0.0958 m/s.

 ======================================== END CHECK