vole

Clone

Read only, no credentials:

https://rodent.software/vole.git

Write over SSH with a registered key:

git clone ssh://git@rodent.software:2222/vole.git

A free and open-source forge that lives in your Git repo.

Load a Prism grammar only when a blob names it

1b8675b19e70346d6d02d5fc0c10538f50bf94b2 · Keenan Nemetz · 9d ago · parent 11720250

Load a Prism grammar only when a blob names it

The worker imported prism-languages.min.js — every grammar Prism ships — on
every code page. That is 546 KB to evaluate before the first token, and a page
showing one Go file paid it for all 293 components.

Each component is now vendored as its own file, and prism-manifest.js maps a
language name to the files that define it in dependency order. The worker
starts with Prism's core and the manifest and imports a language's files the
first time a job names it, remembering what it has run so a file is never
imported twice. A Go blob loads 30 KB instead of 564 KB; a .tsx blob, the
widest common entry at 8 files, loads 49 KB.

The manifest also carries the components that register no language of their
own but change one: css-extras, js-extras, js-templates, php-extras, xml-doc.
Each is placed after the grammar it rewrites and included in the entries that
inherit it, so a language that extends javascript now gets js-extras' arrow
and maybe-class-name tokens too. The old bundle's order handed those to some
inheriting languages and not others; nothing loses a token.

scripts/vendor-prism.py writes the grammars and the manifest, and --check
compares them byte for byte with cdnjs. TestPrismLanguagesAreVendored,
TestPrismGrammarsMatchTheManifest and TestPrismWorkerLoadsGrammarsOnDemand
hold the server's extension table, the vendored set and the worker's lazy
import together.

server/web/static/prism-languages/d.js +1

@@ -0,0 +1 @@
		1	Prism.languages.d=Prism.languages.extend("clike",{comment:[{pattern:/^\s#!.+/,greedy:!0},{pattern:RegExp("(^\|[^\\\\])(?:"+["/\\+(?:/\\+(?:[^+]\|\\+(?!/))\\+/\|(?!/\\+)[^])?\\+/","//.","/\\[^]?\\/"].join("\|")+")"),lookbehind:!0,greedy:!0}],string:[{pattern:RegExp(['\\b[rx]"(?:\\\\[^]\|[^\\\\"])"[cwd]?','\\bq"(?:\\[[^]?\\]\|\$[^]?\$\|<[^]?>\|\\{[^]?\\})"','\\bq"((?!\\d)\\w+)$[^]?^\\1"','\\bq"(.)[^]?\\2"','(["`])(?:\\\\[^]\|(?!\\3)[^\\\\])\\3[cwd]?'].join("\|"),"m"),greedy:!0},{pattern:/\bq\{(?:\{[^{}]\}\|[^{}])\}/,greedy:!0,alias:"token-string"}],keyword:/\$\|\b(?:__(?:(?:DATE\|EOF\|FILE\|FUNCTION\|LINE\|MODULE\|PRETTY_FUNCTION\|TIMESTAMP\|TIME\|VENDOR\|VERSION)__\|gshared\|parameters\|traits\|vector)\|abstract\|alias\|align\|asm\|assert\|auto\|body\|bool\|break\|byte\|case\|cast\|catch\|cdouble\|cent\|cfloat\|char\|class\|const\|continue\|creal\|dchar\|debug\|default\|delegate\|delete\|deprecated\|do\|double\|dstring\|else\|enum\|export\|extern\|false\|final\|finally\|float\|for\|foreach\|foreach_reverse\|function\|goto\|idouble\|if\|ifloat\|immutable\|import\|inout\|int\|interface\|invariant\|ireal\|lazy\|long\|macro\|mixin\|module\|new\|nothrow\|null\|out\|override\|package\|pragma\|private\|protected\|ptrdiff_t\|public\|pure\|real\|ref\|return\|scope\|shared\|short\|size_t\|static\|string\|struct\|super\|switch\|synchronized\|template\|this\|throw\|true\|try\|typedef\|typeid\|typeof\|ubyte\|ucent\|uint\|ulong\|union\|unittest\|ushort\|version\|void\|volatile\|wchar\|while\|with\|wstring)\b/,number:[/\b0x\.?[a-f\d_]+(?:(?!\.\.)\.[a-f\d_])?(?:p[+-]?[a-f\d_]+)?[ulfi]{0,4}/i,{pattern:/((?:\.\.)?)(?:\b0b\.?\|\b\|\.)\d[\d_](?:(?!\.\.)\.[\d_])?(?:e[+-]?\d[\d_])?[ulfi]{0,4}/i,lookbehind:!0}],operator:/\\|[\|=]?\|&[&=]?\|\+[+=]?\|-[-=]?\|\.?\.\.\|=[>=]?\|!(?:i[ns]\b\|<>?=?\|>=?\|=)?\|\bi[ns]\b\|(?:<[<>]?\|>>?>?\|\^\^\|[\/%^~])=?/}),Prism.languages.insertBefore("d","string",{char:/'(?:\$?:\W\|\w+)\|[^\\])'/}),Prism.languages.insertBefore("d","keyword",{property:/\B@\w*/}),Prism.languages.insertBefore("d","function",{register:{pattern:/\b(?:[ABCD][LHX]\|E?(?:BP\|DI\|SI\|SP)\|[BS]PL\|[ECSDGF]S\|CR[0234]\|[DS]IL\|DR[012367]\|E[ABCD]X\|X?MM[0-7]\|R(?:1[0-5]\|[89])[BWD]?\|R[ABCD]X\|R[BS]P\|R[DS]I\|TR[3-7]\|XMM(?:1[0-5]\|[89])\|YMM(?:1[0-5]\|\d))\b\|\bST(?:\([0-7]$\|\b)/,alias:"variable"}});

@@ -0,0 +1 @@
		1	Prism.languages.d=Prism.languages.extend("clike",{comment:[{pattern:/^\s#!.+/,greedy:!0},{pattern:RegExp("(^\|[^\\\\])(?:"+["/\\+(?:/\\+(?:[^+]\|\\+(?!/))\\+/\|(?!/\\+)[^])?\\+/","//.","/\\[^]?\\/"].join("\|")+")"),lookbehind:!0,greedy:!0}],string:[{pattern:RegExp(['\\b[rx]"(?:\\\\[^]\|[^\\\\"])"[cwd]?','\\bq"(?:\\[[^]?\\]\|\\([^]?\\)\|<[^]?>\|\\{[^]?\\})"','\\bq"((?!\\d)\\w+)$[^]?^\\1"','\\bq"(.)[^]?\\2"','(["`])(?:\\\\[^]\|(?!\\3)[^\\\\])\\3[cwd]?'].join("\|"),"m"),greedy:!0},{pattern:/\bq\{(?:\{[^{}]\}\|[^{}])\}/,greedy:!0,alias:"token-string"}],keyword:/\$\|\b(?:__(?:(?:DATE\|EOF\|FILE\|FUNCTION\|LINE\|MODULE\|PRETTY_FUNCTION\|TIMESTAMP\|TIME\|VENDOR\|VERSION)__\|gshared\|parameters\|traits\|vector)\|abstract\|alias\|align\|asm\|assert\|auto\|body\|bool\|break\|byte\|case\|cast\|catch\|cdouble\|cent\|cfloat\|char\|class\|const\|continue\|creal\|dchar\|debug\|default\|delegate\|delete\|deprecated\|do\|double\|dstring\|else\|enum\|export\|extern\|false\|final\|finally\|float\|for\|foreach\|foreach_reverse\|function\|goto\|idouble\|if\|ifloat\|immutable\|import\|inout\|int\|interface\|invariant\|ireal\|lazy\|long\|macro\|mixin\|module\|new\|nothrow\|null\|out\|override\|package\|pragma\|private\|protected\|ptrdiff_t\|public\|pure\|real\|ref\|return\|scope\|shared\|short\|size_t\|static\|string\|struct\|super\|switch\|synchronized\|template\|this\|throw\|true\|try\|typedef\|typeid\|typeof\|ubyte\|ucent\|uint\|ulong\|union\|unittest\|ushort\|version\|void\|volatile\|wchar\|while\|with\|wstring)\b/,number:[/\b0x\.?[a-f\d_]+(?:(?!\.\.)\.[a-f\d_])?(?:p[+-]?[a-f\d_]+)?[ulfi]{0,4}/i,{pattern:/((?:\.\.)?)(?:\b0b\.?\|\b\|\.)\d[\d_](?:(?!\.\.)\.[\d_])?(?:e[+-]?\d[\d_])?[ulfi]{0,4}/i,lookbehind:!0}],operator:/\\|[\|=]?\|&[&=]?\|\+[+=]?\|-[-=]?\|\.?\.\.\|=[>=]?\|!(?:i[ns]\b\|<>?=?\|>=?\|=)?\|\bi[ns]\b\|(?:<[<>]?\|>>?>?\|\^\^\|[\/%^~])=?/}),Prism.languages.insertBefore("d","string",{char:/'(?:\\(?:\W\|\w+)\|[^\\])'/}),Prism.languages.insertBefore("d","keyword",{property:/\B@\w*/}),Prism.languages.insertBefore("d","function",{register:{pattern:/\b(?:[ABCD][LHX]\|E?(?:BP\|DI\|SI\|SP)\|[BS]PL\|[ECSDGF]S\|CR[0234]\|[DS]IL\|DR[012367]\|E[ABCD]X\|X?MM[0-7]\|R(?:1[0-5]\|[89])[BWD]?\|R[ABCD]X\|R[BS]P\|R[DS]I\|TR[3-7]\|XMM(?:1[0-5]\|[89])\|YMM(?:1[0-5]\|\d))\b\|\bST(?:\([0-7]\)\|\b)/,alias:"variable"}});