Skip to content

msmarco-passage/dev scoreddocs #141

@seanmacavaney

Description

@seanmacavaney

Describe the bug

The scoreddocs of msmarco-passage/dev only appear to contain records for queries found in msmarco-passage/dev/small. Is there a more complete version of the scoreddocs for the full dev set, or do scoreddocs only apply to the small version?

Affected dataset(s)

  • msmarco-passage/dev (shouldn't provide scoreddocs---unless larger set of scoreddocs are available somewhere)
  • msmarco-passage/dev/judged (shouldn't provide scoreddocs---unless larger set of scoreddocs are available somewhere)
  • msmarco-passage/dev/small (should provide the current scoreddocs)

Expected behavior

If the scoreddocs only apply to msmarco-passage/dev/small, they should only be present for this subset. If there's a larger version available, they should be available instead via msmarco-passage/dev (and msmarco-passage/dev/judged).

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions