Repository navigation
Replies: 2 comments
|
To clarify, the objective is to implement a Spark DataSource that scans Lance files, i.e., not necessarily use Spark out-of-the-box and read through intermediate Pandas dataframes -- the latter is not the objective of this discussion. |
0 replies
|
Hi @wmoustafa, we have a Java reader for Lance files under https://github.com/lancedb/lance/tree/main/java |
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
Are there native Java readers for Lance files (e.g., readers that would load Lance files to Arrow objects purely in the JVM)? Looks like there is not from my preliminary research. If they do not exist, what is the best practice to read Lance files from JVM-based engines (e.g., Spark)?
All reactions