vole

Clone

Read only, no credentials:

https://rodent.software/vole.git

Write over SSH with a registered key:

git clone ssh://git@rodent.software:2222/vole.git

A free and open-source forge that lives in your Git repo.

Load a Prism grammar only when a blob names it

1b8675b19e70346d6d02d5fc0c10538f50bf94b2 · Keenan Nemetz · 9d ago · parent 11720250

Load a Prism grammar only when a blob names it

The worker imported prism-languages.min.js — every grammar Prism ships — on
every code page. That is 546 KB to evaluate before the first token, and a page
showing one Go file paid it for all 293 components.

Each component is now vendored as its own file, and prism-manifest.js maps a
language name to the files that define it in dependency order. The worker
starts with Prism's core and the manifest and imports a language's files the
first time a job names it, remembering what it has run so a file is never
imported twice. A Go blob loads 30 KB instead of 564 KB; a .tsx blob, the
widest common entry at 8 files, loads 49 KB.

The manifest also carries the components that register no language of their
own but change one: css-extras, js-extras, js-templates, php-extras, xml-doc.
Each is placed after the grammar it rewrites and included in the entries that
inherit it, so a language that extends javascript now gets js-extras' arrow
and maybe-class-name tokens too. The old bundle's order handed those to some
inheriting languages and not others; nothing loses a token.

scripts/vendor-prism.py writes the grammars and the manifest, and --check
compares them byte for byte with cdnjs. TestPrismLanguagesAreVendored,
TestPrismGrammarsMatchTheManifest and TestPrismWorkerLoadsGrammarsOnDemand
hold the server's extension table, the vendored set and the worker's lazy
import together.

server/web/static/prism-languages/ocaml.js +1

@@ -0,0 +1 @@
		1	Prism.languages.ocaml={comment:{pattern:/$\[\s\S]?\$/,greedy:!0},char:{pattern:/'(?:[^\\\r\n']\|\\(?:.\|[ox]?[0-9a-f]{1,3}))'/i,greedy:!0},string:[{pattern:/"(?:\\(?:[\s\S]\|\r\n)\|[^\\\r\n"])"/,greedy:!0},{pattern:/\{([a-z_])\\|[\s\S]?\\|\1\}/,greedy:!0}],number:[/\b(?:0b[01][01_]\|0o[0-7][0-7_])\b/i,/\b0x[a-f0-9][a-f0-9_](?:\.[a-f0-9_])?(?:p[+-]?\d[\d_])?(?!\w)/i,/\b\d[\d_](?:\.[\d_])?(?:e[+-]?\d[\d_])?(?!\w)/i],directive:{pattern:/\B#\w+/,alias:"property"},label:{pattern:/\B~\w+/,alias:"property"},"type-variable":{pattern:/\B'\w+/,alias:"function"},variant:{pattern:/`\w+/,alias:"symbol"},keyword:/\b(?:as\|assert\|begin\|class\|constraint\|do\|done\|downto\|else\|end\|exception\|external\|for\|fun\|function\|functor\|if\|in\|include\|inherit\|initializer\|lazy\|let\|match\|method\|module\|mutable\|new\|nonrec\|object\|of\|open\|private\|rec\|sig\|struct\|then\|to\|try\|type\|val\|value\|virtual\|when\|where\|while\|with)\b/,boolean:/\b(?:false\|true)\b/,"operator-like-punctuation":{pattern:/\[[<>\|]\|[>\|]\]\|\{<\|>\}/,alias:"punctuation"},operator:/\.[.~]\|:[=>]\|[=<>@^\|&+\-\/$%!?~][!$%&+\-.\/:<=>?@^\|~]*\|\b(?:and\|asr\|land\|lor\|lsl\|lsr\|lxor\|mod\|or)\b/,punctuation:/;;\|::\|[(){}\[\].,:;#]\|\b_\b/};

@@ -0,0 +1 @@
		1	Prism.languages.ocaml={comment:{pattern:/\(\[\s\S]?\\)/,greedy:!0},char:{pattern:/'(?:[^\\\r\n']\|\\(?:.\|[ox]?[0-9a-f]{1,3}))'/i,greedy:!0},string:[{pattern:/"(?:\\(?:[\s\S]\|\r\n)\|[^\\\r\n"])"/,greedy:!0},{pattern:/\{([a-z_])\\|[\s\S]?\\|\1\}/,greedy:!0}],number:[/\b(?:0b[01][01_]\|0o[0-7][0-7_])\b/i,/\b0x[a-f0-9][a-f0-9_](?:\.[a-f0-9_])?(?:p[+-]?\d[\d_])?(?!\w)/i,/\b\d[\d_](?:\.[\d_])?(?:e[+-]?\d[\d_])?(?!\w)/i],directive:{pattern:/\B#\w+/,alias:"property"},label:{pattern:/\B~\w+/,alias:"property"},"type-variable":{pattern:/\B'\w+/,alias:"function"},variant:{pattern:/`\w+/,alias:"symbol"},keyword:/\b(?:as\|assert\|begin\|class\|constraint\|do\|done\|downto\|else\|end\|exception\|external\|for\|fun\|function\|functor\|if\|in\|include\|inherit\|initializer\|lazy\|let\|match\|method\|module\|mutable\|new\|nonrec\|object\|of\|open\|private\|rec\|sig\|struct\|then\|to\|try\|type\|val\|value\|virtual\|when\|where\|while\|with)\b/,boolean:/\b(?:false\|true)\b/,"operator-like-punctuation":{pattern:/\[[<>\|]\|[>\|]\]\|\{<\|>\}/,alias:"punctuation"},operator:/\.[.~]\|:[=>]\|[=<>@^\|&+\-\/$%!?~][!$%&+\-.\/:<=>?@^\|~]*\|\b(?:and\|asr\|land\|lor\|lsl\|lsr\|lxor\|mod\|or)\b/,punctuation:/;;\|::\|[(){}\[\].,:;#]\|\b_\b/};