| <!DOCTYPE html> |
| <html> |
| <head> |
| <meta charset="utf-8" /> |
| <meta name="viewport" content="width=device-width" /> |
| <title>WebLLM Structured Generation Playground</title> |
| <link |
| rel="stylesheet" |
| href="https://cdnjs.cloudflare.com/ajax/libs/highlight.js/11.9.0/styles/default.min.css" |
| /> |
| <link rel="stylesheet" href="./style/style.css" /> |
| <link rel="stylesheet" href="./style/ace.css" /> |
| <link rel="stylesheet" href="./style/hljs.css" /> |
| </head> |
| <body> |
| <h1>WebLLM Structured Generation Playground</h1> |
| <h4> |
| Generate structured output from LLMs using |
| <a |
| referrerpolicy="no-referrer" |
| href="https://webllm.mlc.ai/" |
| target="_blank" |
| >WebLLM</a |
| > and <a |
| referrerpolicy="no-referrer" |
| href="https://xgrammar.mlc.ai/" |
| target="_blank" |
| >XGrammar</a>. |
| </h4> |
| <main> |
| <div id="left-col" class="container"> |
| <div class="card"> |
| <form> |
| <label for="model-selection" class="container" |
| ><span><b>Model</b></span> |
| <select id="model-selection"></select |
| ></label> |
| </form> |
| </div> |
| <div class="card"> |
| <form> |
| <label for="grammar-selection" class="container" |
| ><span><b>Grammar</b></span> |
| <select id="grammar-selection" value="json"> |
| <option value="json">JSON Schema (Default)</option> |
| <option value="custom">Custom Grammar</option> |
| </select></label |
| > |
| </form> |
| </div> |
| <div id="ebnf-grammar-container" class="card hidden"> |
| <form> |
| <label for="ebnf-grammar" class="container" |
| ><span><b>Custom Grammar</b></span> |
| <span> |
| The custom grammar is described in the |
| <a |
| href="https://en.wikipedia.org/wiki/Extended_Backus%E2%80%93Naur_form" |
| referrerpolicy="no-referrer" |
| target="_blank" |
| >extended Backus-Naur form (EBNF)</a |
| >. Below is an example of JSON grammar in EBNF. Please follow |
| this example when writing new grammars. |
| </span> |
| <div id="ebnf-grammar"></div> |
| </label> |
| </form> |
| </div> |
| <div id="schema-container" class="card"> |
| <form> |
| <label class="container" |
| ><span><b>Schema</b></span> |
| <span |
| >Check |
| <a |
| href="https://github.com/sinclairzx81/typebox" |
| referrerpolicy="no-referrer" |
| target="_blank" |
| >TypeBox</a |
| > |
| for JSON schema type syntax and documentation.</span |
| > |
| <div id="schema"></div> |
| </label> |
| </form> |
| </div> |
| </div> |
| <div id="right-col" class="container"> |
| <div class="card"> |
| <form> |
| <label for="prompt" class="container" |
| ><span><b>Prompt</b></span> |
| <textarea |
| id="prompt" |
| dir="ltr" |
| placeholder="" |
| rows="1" |
| ></textarea> |
| </label> |
| </form> |
| </div> |
| <button id="generate">Generate</button> |
| <div class="card"> |
| <form> |
| <label class="output" |
| ><span><b>Output</b></span> |
| <div id="output"></div> |
| </label> |
| <p class="info hidden" id="stats"></p> |
| </form> |
| </div> |
| </div> |
| </main> |
| <script src="./dist/index.js" type="module"></script> |
| </body> |
| </html> |
|
|
