Repository navigation
Data storage and usage in Multimodal data scenarios #4529
littleDrew
started this conversation in
General
Replies: 1 comment
|
Hi, thank you for the insightful discussion context! This topic is discussed in #3996, you might want to chime in there! |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Uh oh!
There was an error while loading. Please reload this page.
Here in Multimodal data scenarios, like involve image, audio, vedio case, i am thinking whether users will store these kinds of multimodal data into Lance, or just storage directly in disk like S3?
Hoping have a disscuss for this to enhance understanding in multimodal data scenarios.
Possible Usages of Multimodal data
Before consider how Multimodal data will be stored, here we should consider how will these kinds of data will be used later, here i thought may exist this kinds of usage:
How will or should Multimodal data be stored ?
Currently, here in mind, it seems save metadata and path of Multimodal data is more common, like following table data:
And more: will lance consider support specific datatype for Multimodal data ?
imagedatatype, andSequence(nested_type)to store image and video(stored as sequence of image)https://docs.deeplake.ai/4.0/api/types/#deeplake.types.Image
Hoping you share you ideas and insight @westonpace @jackye1995 @Xuanwo @eddyxu @wjones127
All reactions