Skip to main content

Standards used in this guide

The recipes use published formats and tools wherever one exists. Where the program's workstreams provide measurements or tools, the guide uses them.

Model formats, cards, and licences​

StandardUseIn this guide
Hugging Face model cards and Mitchell et al. (2019)The card format and sections a model needs before the organization considers itChapter 2
Apache 2.0, MIT, and Responsible AI LicensesThe licence families the classification distinguishesChapter 2
safetensors and GGUFWeight formats that load without executing codeChapters 3 and 6
Sigstore model transparencySigning and verifying model filesChapter 6

Serving and adaptation​

ToolUseIn this guide
vLLM, llama.cpp, OllamaServing stacks from workstation to shared serviceChapter 3
Sentence Transformers and the PI-FT toolkitEmbedding models and their fine-tuning on metadataChapter 4
Hugging Face PEFTParameter-efficient fine-tuning of small generatorsChapter 4

Evaluation and governance​

ResourceUseIn this guide
Evaluation suites cookbookSuites, required scores, gates, report cardsChapters 1, 4, 5, and 6
lm-evaluation-harness, Open LLM Leaderboard, MTEBPublic benchmarks for shortlistingChapters 2 and 5
Efficient and Inclusive AI ApplicationsThe program's measurements of model size against task accuracy and its deployment guidanceChapters 1, 3, 5, and 7
OWASP Top 10 for LLM applicationsSupply chain and deployment risksChapter 6
AI component registerWhere choices, versions, and shared assets are recordedAll chapters

Corrections​

Standards change versions and URLs. If a reference here is wrong or out of date, open an issue with the row and the corrected source.