Skip to content

[Feature Request]: OpenSearch Byte Vector Support #17271

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Closed
christopher-learningpool opened this issue Dec 13, 2024 · 1 comment · May be fixed by #17476
Closed

[Feature Request]: OpenSearch Byte Vector Support #17271

christopher-learningpool opened this issue Dec 13, 2024 · 1 comment · May be fixed by #17476
Labels
enhancement New feature or request triage Issue needs to be triaged/prioritized

Comments

@christopher-learningpool

Feature Description

Add support for byte vector storage in the OpenSearch vector store integration, leveraging OpenSearch 2.17's new byte vector capabilities with the Faiss engine. This would allow users to store vectors more efficiently by using 8-bit integers (-128 to 127) instead of floats, significantly reducing storage requirements while maintaining search quality.

Reason

Currently, the OpenSearch integration in LlamaIndex only supports float vectors. Adding byte vector support would require:

  • Adding a new data_type parameter to OpensearchVectorClient
  • Updating the index creation and query logic to handle byte vectors

Value of Feature

Storage Efficiency

  • Byte vectors require 1/4 the storage space of 32-bit float vectors
  • Reduced storage costs for large-scale deployments
  • Faster network transfer for distributed systems

Performance Benefits

  • Potentially faster similarity search due to reduced memory bandwidth requirements
  • More efficient cache utilisation
  • Better scalability for large vector databases
@christopher-learningpool christopher-learningpool added enhancement New feature or request triage Issue needs to be triaged/prioritized labels Dec 13, 2024
Copy link

dosubot bot commented Apr 13, 2025

Hi, @christopher-learningpool. I'm Dosu, and I'm helping the LlamaIndex team manage their backlog. I'm marking this issue as stale.

Issue Summary

  • Proposal to enhance OpenSearch vector store integration with byte vector support.
  • Utilizes OpenSearch 2.17's Faiss engine for improved storage efficiency and performance.
  • Suggests updating OpensearchVectorClient for byte vectors.
  • No comments or further activity since the issue was opened.

Next Steps

  • Please confirm if this issue is still relevant to the latest version of the LlamaIndex repository by commenting here.
  • If no updates are provided, the issue will be automatically closed in 7 days.

Thank you for your understanding and contribution!

@dosubot dosubot bot added the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Apr 13, 2025
@dosubot dosubot bot closed this as not planned Won't fix, can't repro, duplicate, stale Apr 20, 2025
@dosubot dosubot bot removed the stale Issue has not had recent activity or appears to be solved. Stale issues will be automatically closed label Apr 20, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request triage Issue needs to be triaged/prioritized
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant