Skip to content

[v1.14] Add composite embedders and pooling for huggingface embedders (experimental) #473

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
2 tasks
Strift opened this issue Apr 17, 2025 · 0 comments
Open
2 tasks
Labels
enhancement New feature or request good first issue Good for newcomers

Comments

@Strift
Copy link
Contributor

Strift commented Apr 17, 2025

This issue follows the changes related to Meilisearch v1.14.0 mega issue.

Description

Update embedders API to be compatible with Meilisearch v1.14.0

For more context, see the related issue in Meilisearch: meilisearch/meilisearch#5343

Tasks

  • Add new pooling parameter for huggingFace embedders
  • Add new composite source for embedders

For reference, here's how this works using Meilisearch JS SDK:

client
  .index('index_name')
  .updateEmbedders({
    embedder_name: {
      source: "composite",
      searchEmbedder: {
        source: "huggingFace",
        model:
          "sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2",
        pooling: "useModel",
      },
      indexingEmbedder: {
        source: "huggingFace",
        model:
          "sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2",
        documentTemplate: "{{doc.title}}",
        pooling: "useModel",
        documentTemplateMaxBytes: 500,
      },
    },
  });
@Strift Strift added enhancement New feature or request good first issue Good for newcomers labels Apr 17, 2025
@Strift Strift changed the title [v1.14] Add composite embedders and pooling for huggingface embedders [v1.14] Add composite embedders and pooling for huggingface embedders (experimental) Apr 23, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request good first issue Good for newcomers
Projects
None yet
Development

No branches or pull requests

1 participant