Skip to content

[Store] Load, split and normalize documents #24

@chr-hertel

Description

@chr-hertel

A common use-case for populating a vector store is to load the content as documents from a source and manipulate them while doing so, e.g. splitting into multiple chunks, normalizing the language, or summarizing.

I'd guess that In the end the LoaderInterface should spit out a iterable<TextDocument> that is then handed over to the Embedder (rename to Indexer?)

Metadata

Metadata

Assignees

No one assigned

    Labels

    FeatureNew featureGood first issueIdeal for your first contribution! (some Symfony experience may be required)Hackathon 2025This issue or pull request was part of the Symfony AI Hackathon 2025Help wantedExtra attention is neededStoreIssues & PRs about the AI Store component

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions