AISI ChemBio - LLM Benchmarking (Chem)
AISI requires a Supplier to help develop it evaluations related to chemistry and biology (CB). The Supplier will help deploy and expand its automated benchmarking suite and support its human uplift studies related to biological capabilities. Supplier(s) will develop questions or tasks, develop grading rubrics, and provide expert human baselines and expert human grading. For each deliverable, AISI will provide detailed guidance.
Buyer
DESNZ & DSIT Group Commercial
Value
£950,000
Published
17 Feb 2025
Closes
13 Sept 2024
Procurement details
Source
Find a Tender
Region
United Kingdom
Procurement method
Open
Category
Services
Contract starts
Not provided
Contract ends
Not provided
CPV classifications
73000000
Research and development services and related consultancy services
Lots
Lot 1 AISI ChemBio - LLM Benchmarking (Chem)
£950,000
AISI requires a Supplier to help develop it evaluations related to chemistry and biology (CB). The Supplier will help deploy and expand its automated benchmarking suite and support its human uplift studies related to biological capabilities. Supplier(s) will develop questions or tasks, develop grading rubrics, and provide expert human baselines and expert hu...
Delivery: United Kingdom
Documents
No document metadata is available for this public record.
Contains public sector information licensed under the Open Government Licence v3.0.