Feature Request: Add Ollama Support

[techteam-pro-discount]

I like the vision of the project but to have it running fully locally i would love to see an ollama support in the future.
Just a field or ENV to put the ollama url would be cool :D

[github-actions]

👋 Welcome! Thanks for opening your first issue. If you'd like to take a crack at fixing it, feel free to open a pull request — otherwise, we'll take a look as soon as we can!

[mandalsouvik3333]

@techteam-pro-discount Have you looked into unsloth inference? Unsloth supports lots of vision language models compared to ollama. Will integrate one of these two.

[mandalsouvik3333]

Just a field or ENV to put the ollama url would be cool :D

This I can add for ollama also. But you will need to host the ollama model.

[techteam-pro-discount]

@techteam-pro-discount Have you looked into unsloth inference? Unsloth supports lots of vision language models compared to ollama. Will integrate one of these two.

never heard of that, ill take a look later.

Just a field or ENV to put the ollama url would be cool :D

This I can add for ollama also. But you will need to host the ollama model.

im havin ollama running for some other services already, so i would love to have your project join the "circle" :D

[mandalsouvik3333]

@techteam-pro-discount This is added. You can use your existing ollama server https://github.com/NanoNets/docext?tab=readme-ov-file#models-with-ollama-linux-and-macos

Feel free to reopen the issue if you face any problem