Skip to content

why use the list after split as chunck? #6

Description

@Victoriaheiheihei

https://github.com/webpilot-ai/ChatLongDoc/blob/main/utils.py#L86

why len(text) =len(text.replace("\n", " ").split())?

The chunk is splited by str length in langchain. the chunk is splited by " " in your repositories. does this have any special meannings?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions