?
Import eval queries
Bulk-adds queries to a set from a JSONL file.
admin.dataSourceEvals.addQueries(setId, queries)
Loads many queries into a set at once from a JSONL file, one query and its expected documents per line. It is how a curated question bank, kept in the repo, becomes an eval set.
Parameters
--set
id
RequiredEval set to import into.
file.jsonl
path
RequiredA JSONL file, one query with its expectations per line (positional).
CLI
remy-admin datasources eval import --set set_abc123 queries.jsonl