vole

Clone

Read only, no credentials:

https://rodent.software/vole.git

Write over SSH with a registered key:

git clone ssh://git@rodent.software:2222/vole.git

A free and open-source forge that lives in your Git repo.

Load a Prism grammar only when a blob names it

1b8675b19e70346d6d02d5fc0c10538f50bf94b2 · Keenan Nemetz · 9d ago · parent 11720250

Load a Prism grammar only when a blob names it

The worker imported prism-languages.min.js — every grammar Prism ships — on
every code page. That is 546 KB to evaluate before the first token, and a page
showing one Go file paid it for all 293 components.

Each component is now vendored as its own file, and prism-manifest.js maps a
language name to the files that define it in dependency order. The worker
starts with Prism's core and the manifest and imports a language's files the
first time a job names it, remembering what it has run so a file is never
imported twice. A Go blob loads 30 KB instead of 564 KB; a .tsx blob, the
widest common entry at 8 files, loads 49 KB.

The manifest also carries the components that register no language of their
own but change one: css-extras, js-extras, js-templates, php-extras, xml-doc.
Each is placed after the grammar it rewrites and included in the entries that
inherit it, so a language that extends javascript now gets js-extras' arrow
and maybe-class-name tokens too. The old bundle's order handed those to some
inheriting languages and not others; nothing loses a token.

scripts/vendor-prism.py writes the grammars and the manifest, and --check
compares them byte for byte with cdnjs. TestPrismLanguagesAreVendored,
TestPrismGrammarsMatchTheManifest and TestPrismWorkerLoadsGrammarsOnDemand
hold the server's extension table, the vendored set and the worker's lazy
import together.

server/web/static/prism-languages/iecst.js +1

@@ -0,0 +1 @@
		1	Prism.languages.iecst={comment:[{pattern:/(^\|[^\\])(?:\/\[\s\S]?(?:\\/\|$)\|$\[\s\S]?(?:\$\|$)\|\{[\s\S]?(?:\}\|$))/,lookbehind:!0,greedy:!0},{pattern:/(^\|[^\\:])\/\/./,lookbehind:!0,greedy:!0}],string:{pattern:/(["'])(?:\\(?:\r\n\|[\s\S])\|(?!\1)[^\\\r\n])\1/,greedy:!0},keyword:[/\b(?:END_)?(?:PROGRAM\|CONFIGURATION\|INTERFACE\|FUNCTION_BLOCK\|FUNCTION\|ACTION\|TRANSITION\|TYPE\|STRUCT\|(?:INITIAL_)?STEP\|NAMESPACE\|LIBRARY\|CHANNEL\|FOLDER\|RESOURCE\|VAR_(?:ACCESS\|CONFIG\|EXTERNAL\|GLOBAL\|INPUT\|IN_OUT\|OUTPUT\|TEMP)\|VAR\|METHOD\|PROPERTY)\b/i,/\b(?:AT\|BY\|(?:END_)?(?:CASE\|FOR\|IF\|REPEAT\|WHILE)\|CONSTANT\|CONTINUE\|DO\|ELSE\|ELSIF\|EXIT\|EXTENDS\|FROM\|GET\|GOTO\|IMPLEMENTS\|JMP\|NON_RETAIN\|OF\|PRIVATE\|PROTECTED\|PUBLIC\|RETAIN\|RETURN\|SET\|TASK\|THEN\|TO\|UNTIL\|USING\|WITH\|__CATCH\|__ENDTRY\|__FINALLY\|__TRY)\b/],"class-name":/\b(?:ANY\|ARRAY\|BOOL\|BYTE\|U?(?:D\|L\|S)?INT\|(?:D\|L)?WORD\|DATE(?:_AND_TIME)?\|DT\|L?REAL\|POINTER\|STRING\|TIME(?:_OF_DAY)?\|TOD)\b/,address:{pattern:/%[IQM][XBWDL][\d.]\|%[IQ][\d.]/,alias:"symbol"},number:/\b(?:16#[\da-f]+\|2#[01_]+\|0x[\da-f]+)\b\|\b(?:D\|DT\|T\|TOD)#[\d_shmd:]\|\b[A-Z]#[\d.,_]\|(?:\b\d+(?:\.\d)?\|\B\.\d+)(?:e[+-]?\d+)?/i,boolean:/\b(?:FALSE\|NULL\|TRUE)\b/,operator:/S?R?:?=>?\|&&?\|\\?\|<[=>]?\|>=?\|[-:^/+#]\|\b(?:AND\|EQ\|EXPT\|GE\|GT\|LE\|LT\|MOD\|NE\|NOT\|OR\|XOR)\b/,function:/\b[a-z_]\w(?=\s*\()/i,punctuation:/[()[\].,;]/};

@@ -0,0 +1 @@
		1	Prism.languages.iecst={comment:[{pattern:/(^\|[^\\])(?:\/\[\s\S]?(?:\\/\|$)\|\(\[\s\S]?(?:\\)\|$)\|\{[\s\S]?(?:\}\|$))/,lookbehind:!0,greedy:!0},{pattern:/(^\|[^\\:])\/\/./,lookbehind:!0,greedy:!0}],string:{pattern:/(["'])(?:\\(?:\r\n\|[\s\S])\|(?!\1)[^\\\r\n])\1/,greedy:!0},keyword:[/\b(?:END_)?(?:PROGRAM\|CONFIGURATION\|INTERFACE\|FUNCTION_BLOCK\|FUNCTION\|ACTION\|TRANSITION\|TYPE\|STRUCT\|(?:INITIAL_)?STEP\|NAMESPACE\|LIBRARY\|CHANNEL\|FOLDER\|RESOURCE\|VAR_(?:ACCESS\|CONFIG\|EXTERNAL\|GLOBAL\|INPUT\|IN_OUT\|OUTPUT\|TEMP)\|VAR\|METHOD\|PROPERTY)\b/i,/\b(?:AT\|BY\|(?:END_)?(?:CASE\|FOR\|IF\|REPEAT\|WHILE)\|CONSTANT\|CONTINUE\|DO\|ELSE\|ELSIF\|EXIT\|EXTENDS\|FROM\|GET\|GOTO\|IMPLEMENTS\|JMP\|NON_RETAIN\|OF\|PRIVATE\|PROTECTED\|PUBLIC\|RETAIN\|RETURN\|SET\|TASK\|THEN\|TO\|UNTIL\|USING\|WITH\|__CATCH\|__ENDTRY\|__FINALLY\|__TRY)\b/],"class-name":/\b(?:ANY\|ARRAY\|BOOL\|BYTE\|U?(?:D\|L\|S)?INT\|(?:D\|L)?WORD\|DATE(?:_AND_TIME)?\|DT\|L?REAL\|POINTER\|STRING\|TIME(?:_OF_DAY)?\|TOD)\b/,address:{pattern:/%[IQM][XBWDL][\d.]\|%[IQ][\d.]/,alias:"symbol"},number:/\b(?:16#[\da-f]+\|2#[01_]+\|0x[\da-f]+)\b\|\b(?:D\|DT\|T\|TOD)#[\d_shmd:]\|\b[A-Z]#[\d.,_]\|(?:\b\d+(?:\.\d)?\|\B\.\d+)(?:e[+-]?\d+)?/i,boolean:/\b(?:FALSE\|NULL\|TRUE)\b/,operator:/S?R?:?=>?\|&&?\|\\?\|<[=>]?\|>=?\|[-:^/+#]\|\b(?:AND\|EQ\|EXPT\|GE\|GT\|LE\|LT\|MOD\|NE\|NOT\|OR\|XOR)\b/,function:/\b[a-z_]\w(?=\s*\()/i,punctuation:/[()[\].,;]/};