vole

Clone

Read only, no credentials:

https://rodent.software/vole.git

Write over SSH with a registered key:

git clone ssh://git@rodent.software:2222/vole.git

A free and open-source forge that lives in your Git repo.

Load a Prism grammar only when a blob names it

1b8675b19e70346d6d02d5fc0c10538f50bf94b2 · Keenan Nemetz · 9d ago · parent 11720250

Load a Prism grammar only when a blob names it

The worker imported prism-languages.min.js — every grammar Prism ships — on
every code page. That is 546 KB to evaluate before the first token, and a page
showing one Go file paid it for all 293 components.

Each component is now vendored as its own file, and prism-manifest.js maps a
language name to the files that define it in dependency order. The worker
starts with Prism's core and the manifest and imports a language's files the
first time a job names it, remembering what it has run so a file is never
imported twice. A Go blob loads 30 KB instead of 564 KB; a .tsx blob, the
widest common entry at 8 files, loads 49 KB.

The manifest also carries the components that register no language of their
own but change one: css-extras, js-extras, js-templates, php-extras, xml-doc.
Each is placed after the grammar it rewrites and included in the entries that
inherit it, so a language that extends javascript now gets js-extras' arrow
and maybe-class-name tokens too. The old bundle's order handed those to some
inheriting languages and not others; nothing loses a token.

scripts/vendor-prism.py writes the grammars and the manifest, and --check
compares them byte for byte with cdnjs. TestPrismLanguagesAreVendored,
TestPrismGrammarsMatchTheManifest and TestPrismWorkerLoadsGrammarsOnDemand
hold the server's extension table, the vendored set and the worker's lazy
import together.

server/web/static/prism-languages/wasm.js +1

@@ -0,0 +1 @@
		1	Prism.languages.wasm={comment:[/$;[\s\S]?;$/,{pattern:/;;./,greedy:!0}],string:{pattern:/"(?:\\[\s\S]\|[^"\\])"/,greedy:!0},keyword:[{pattern:/\b(?:align\|offset)=/,inside:{operator:/=/}},{pattern:/\b(?:(?:f32\|f64\|i32\|i64)(?:\.(?:abs\|add\|and\|ceil\|clz\|const\|convert_[su]\/i(?:32\|64)\|copysign\|ctz\|demote\/f64\|div(?:_[su])?\|eqz?\|extend_[su]\/i32\|floor\|ge(?:_[su])?\|gt(?:_[su])?\|le(?:_[su])?\|load(?:(?:8\|16\|32)_[su])?\|lt(?:_[su])?\|max\|min\|mul\|neg?\|nearest\|or\|popcnt\|promote\/f32\|reinterpret\/[fi](?:32\|64)\|rem_[su]\|rot[lr]\|shl\|shr_[su]\|sqrt\|store(?:8\|16\|32)?\|sub\|trunc(?:_[su]\/f(?:32\|64))?\|wrap\/i64\|xor))?\|memory\.(?:grow\|size))\b/,inside:{punctuation:/\./}},/\b(?:anyfunc\|block\|br(?:_if\|_table)?\|call(?:_indirect)?\|data\|drop\|elem\|else\|end\|export\|func\|get_(?:global\|local)\|global\|if\|import\|local\|loop\|memory\|module\|mut\|nop\|offset\|param\|result\|return\|select\|set_(?:global\|local)\|start\|table\|tee_local\|then\|type\|unreachable)\b/],variable:/\$[\w!#$%&'+\-./:<=>?@\\^`\|~]+/,number:/[+-]?\b(?:\d(?:_?\d)(?:\.\d(?:_?\d))?(?:[eE][+-]?\d(?:_?\d))?\|0x[\da-fA-F](?:_?[\da-fA-F])(?:\.[\da-fA-F](?:_?[\da-fA-D]))?(?:[pP][+-]?\d(?:_?\d))?)\b\|\binf\b\|\bnan(?::0x[\da-fA-F](?:_?[\da-fA-D])*)?\b/,punctuation:/[()]/};

@@ -0,0 +1 @@
		1	Prism.languages.wasm={comment:[/\(;[\s\S]?;\)/,{pattern:/;;./,greedy:!0}],string:{pattern:/"(?:\\[\s\S]\|[^"\\])"/,greedy:!0},keyword:[{pattern:/\b(?:align\|offset)=/,inside:{operator:/=/}},{pattern:/\b(?:(?:f32\|f64\|i32\|i64)(?:\.(?:abs\|add\|and\|ceil\|clz\|const\|convert_[su]\/i(?:32\|64)\|copysign\|ctz\|demote\/f64\|div(?:_[su])?\|eqz?\|extend_[su]\/i32\|floor\|ge(?:_[su])?\|gt(?:_[su])?\|le(?:_[su])?\|load(?:(?:8\|16\|32)_[su])?\|lt(?:_[su])?\|max\|min\|mul\|neg?\|nearest\|or\|popcnt\|promote\/f32\|reinterpret\/[fi](?:32\|64)\|rem_[su]\|rot[lr]\|shl\|shr_[su]\|sqrt\|store(?:8\|16\|32)?\|sub\|trunc(?:_[su]\/f(?:32\|64))?\|wrap\/i64\|xor))?\|memory\.(?:grow\|size))\b/,inside:{punctuation:/\./}},/\b(?:anyfunc\|block\|br(?:_if\|_table)?\|call(?:_indirect)?\|data\|drop\|elem\|else\|end\|export\|func\|get_(?:global\|local)\|global\|if\|import\|local\|loop\|memory\|module\|mut\|nop\|offset\|param\|result\|return\|select\|set_(?:global\|local)\|start\|table\|tee_local\|then\|type\|unreachable)\b/],variable:/\$[\w!#$%&'+\-./:<=>?@\\^`\|~]+/,number:/[+-]?\b(?:\d(?:_?\d)(?:\.\d(?:_?\d))?(?:[eE][+-]?\d(?:_?\d))?\|0x[\da-fA-F](?:_?[\da-fA-F])(?:\.[\da-fA-F](?:_?[\da-fA-D]))?(?:[pP][+-]?\d(?:_?\d))?)\b\|\binf\b\|\bnan(?::0x[\da-fA-F](?:_?[\da-fA-D])*)?\b/,punctuation:/[()]/};