- Notifications
You must be signed in to change notification settings - Fork 290
Open
Description
Came here from https://youtu.be/EJ8okcxL2Iw?t=426
The talk says there are token vectors and path vectors.
I know what an AST is, but I am not that proficient in AI to answer what is the token vector? Is it a list of all tokens encountered? Or a list of all possible combinations of token pair?
It also not clear what a path vector is. If I understand it right, then vector should contains numbers, not symbols from AST path. So how does AST path is converted to path vector? Does the path vector include leaves, which are tokens/symbols?
Metadata
Metadata
Assignees
Labels
No labels