Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use field mapping to simplify field names for reducing storage volume? #1694

Open
jsonchou opened this issue Apr 30, 2024 · 3 comments
Open

Comments

@jsonchou
Copy link

Is there a strategy of renaming field keys?

By mapping originally lengthy field keys (such as product_name, product_id, product_url) to shorter identifiers (e.g., a, b, c) during storage, which will reduce data storage overhead.

When reading data, restore the simplified identifiers to their original field names according to the mapping relationship.

Great always start from small details.

@jsonchou
Copy link
Author

Explicit mapping or implicit automatic mapping

@kishorenc
Copy link
Member

Is there a benefit to doing this within Typesense rather than managing it within your app?

@jsonchou
Copy link
Author

jsonchou commented May 1, 2024

Is there a benefit to doing this within Typesense rather than managing it within your app?

So, is it worth actively helping clients reduce their memory usage by 3-5%? From the perspective of software solutions, this is also a question worthy of long-term consideration.

Based on my personal experience, I often employ this approach for data optimization, such as data reduction and network transmission. So, can similar optimization strategies be applied to Typesense data storage? (i really dont know how the typesense data be storaged.)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants