- Notifications
You must be signed in to change notification settings - Fork 47
Closed
Labels
bugSomething isn't workingSomething isn't working
Description
Describe the bug
The scoreddocs of msmarco-passage/dev only appear to contain records for queries found in msmarco-passage/dev/small. Is there a more complete version of the scoreddocs for the full dev set, or do scoreddocs only apply to the small version?
Affected dataset(s)
msmarco-passage/dev(shouldn't provide scoreddocs---unless larger set of scoreddocs are available somewhere)msmarco-passage/dev/judged(shouldn't provide scoreddocs---unless larger set of scoreddocs are available somewhere)msmarco-passage/dev/small(should provide the current scoreddocs)
Expected behavior
If the scoreddocs only apply to msmarco-passage/dev/small, they should only be present for this subset. If there's a larger version available, they should be available instead via msmarco-passage/dev (and msmarco-passage/dev/judged).
Metadata
Metadata
Assignees
Labels
bugSomething isn't workingSomething isn't working