Skip to content

Enable a TextSplitter in TikaDocumentReader to allow for files with large content to be read. #168

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
wants to merge 1 commit into from
Closed

Enable a TextSplitter in TikaDocumentReader to allow for files with large content to be read. #168

wants to merge 1 commit into from

Conversation

@habuma
Copy link
Member

@habuma habuma commented Dec 14, 2023

This is a variation of #166, based on my last comment in that PR.
@markpollack markpollack added this to the 0.9.0 milestone Dec 19, 2023
@markpollack
Copy link
Member

markpollack commented Dec 20, 2023

See my comments in the other PR
@markpollack markpollack removed this from the 0.9.0 milestone Jan 25, 2024
@markpollack
Copy link
Member

markpollack commented Jan 25, 2024

See comments here #166
@markpollack
Copy link
Member

markpollack commented Feb 29, 2024

closing as adding a text splitter to the functional composition chain in the ETL framework solves this problem.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants

@habuma @markpollack