vole

Clone

Read only, no credentials:

https://rodent.software/git/vole.git

Write over SSH with a registered key:

git clone ssh://git@0.0.0.0:2222/vole.git

A free and open-source forge that lives in your Git repo.

Load a Prism grammar only when a blob names it

1b8675b19e70346d6d02d5fc0c10538f50bf94b2 · Keenan Nemetz · 9d ago · parent 11720250

Load a Prism grammar only when a blob names it

The worker imported prism-languages.min.js — every grammar Prism ships — on
every code page. That is 546 KB to evaluate before the first token, and a page
showing one Go file paid it for all 293 components.

Each component is now vendored as its own file, and prism-manifest.js maps a
language name to the files that define it in dependency order. The worker
starts with Prism's core and the manifest and imports a language's files the
first time a job names it, remembering what it has run so a file is never
imported twice. A Go blob loads 30 KB instead of 564 KB; a .tsx blob, the
widest common entry at 8 files, loads 49 KB.

The manifest also carries the components that register no language of their
own but change one: css-extras, js-extras, js-templates, php-extras, xml-doc.
Each is placed after the grammar it rewrites and included in the entries that
inherit it, so a language that extends javascript now gets js-extras' arrow
and maybe-class-name tokens too. The old bundle's order handed those to some
inheriting languages and not others; nothing loses a token.

scripts/vendor-prism.py writes the grammars and the manifest, and --check
compares them byte for byte with cdnjs. TestPrismLanguagesAreVendored,
TestPrismGrammarsMatchTheManifest and TestPrismWorkerLoadsGrammarsOnDemand
hold the server's extension table, the vendored set and the worker's lazy
import together.

server/web/static/prism-languages/basic.js +1

@@ -0,0 +1 @@
		1	Prism.languages.basic={comment:{pattern:/(?:!\|REM\b).+/i,inside:{keyword:/^REM/i}},string:{pattern:/"(?:""\|[!#$%&'(),\/:;<=>?^\w +\-.])"/,greedy:!0},number:/(?:\b\d+(?:\.\d)?\|\B\.\d+)(?:E[+-]?\d+)?/i,keyword:/\b(?:AS\|BEEP\|BLOAD\|BSAVE\|CALL(?: ABSOLUTE)?\|CASE\|CHAIN\|CHDIR\|CLEAR\|CLOSE\|CLS\|COM\|COMMON\|CONST\|DATA\|DECLARE\|DEF(?: FN\| SEG\|DBL\|INT\|LNG\|SNG\|STR)\|DIM\|DO\|DOUBLE\|ELSE\|ELSEIF\|END\|ENVIRON\|ERASE\|ERROR\|EXIT\|FIELD\|FILES\|FOR\|FUNCTION\|GET\|GOSUB\|GOTO\|IF\|INPUT\|INTEGER\|IOCTL\|KEY\|KILL\|LINE INPUT\|LOCATE\|LOCK\|LONG\|LOOP\|LSET\|MKDIR\|NAME\|NEXT\|OFF\|ON(?: COM\| ERROR\| KEY\| TIMER)?\|OPEN\|OPTION BASE\|OUT\|POKE\|PUT\|READ\|REDIM\|REM\|RESTORE\|RESUME\|RETURN\|RMDIR\|RSET\|RUN\|SELECT CASE\|SHARED\|SHELL\|SINGLE\|SLEEP\|STATIC\|STEP\|STOP\|STRING\|SUB\|SWAP\|SYSTEM\|THEN\|TIMER\|TO\|TROFF\|TRON\|TYPE\|UNLOCK\|UNTIL\|USING\|VIEW PRINT\|WAIT\|WEND\|WHILE\|WRITE)(?:\$\|\b)/i,function:/\b(?:ABS\|ACCESS\|ACOS\|ANGLE\|AREA\|ARITHMETIC\|ARRAY\|ASIN\|ASK\|AT\|ATN\|BASE\|BEGIN\|BREAK\|CAUSE\|CEIL\|CHR\|CLIP\|COLLATE\|COLOR\|CON\|COS\|COSH\|COT\|CSC\|DATE\|DATUM\|DEBUG\|DECIMAL\|DEF\|DEG\|DEGREES\|DELETE\|DET\|DEVICE\|DISPLAY\|DOT\|ELAPSED\|EPS\|ERASABLE\|EXLINE\|EXP\|EXTERNAL\|EXTYPE\|FILETYPE\|FIXED\|FP\|GO\|GRAPH\|HANDLER\|IDN\|IMAGE\|IN\|INT\|INTERNAL\|IP\|IS\|KEYED\|LBOUND\|LCASE\|LEFT\|LEN\|LENGTH\|LET\|LINE\|LINES\|LOG\|LOG10\|LOG2\|LTRIM\|MARGIN\|MAT\|MAX\|MAXNUM\|MID\|MIN\|MISSING\|MOD\|NATIVE\|NUL\|NUMERIC\|OF\|OPTION\|ORD\|ORGANIZATION\|OUTIN\|OUTPUT\|PI\|POINT\|POINTER\|POINTS\|POS\|PRINT\|PROGRAM\|PROMPT\|RAD\|RADIANS\|RANDOMIZE\|RECORD\|RECSIZE\|RECTYPE\|RELATIVE\|REMAINDER\|REPEAT\|REST\|RETRY\|REWRITE\|RIGHT\|RND\|ROUND\|RTRIM\|SAME\|SEC\|SELECT\|SEQUENTIAL\|SET\|SETTER\|SGN\|SIN\|SINH\|SIZE\|SKIP\|SQR\|STANDARD\|STATUS\|STR\|STREAM\|STYLE\|TAB\|TAN\|TANH\|TEMPLATE\|TEXT\|THERE\|TIME\|TIMEOUT\|TRACE\|TRANSFORM\|TRUNCATE\|UBOUND\|UCASE\|USE\|VAL\|VARIABLE\|VIEWPORT\|WHEN\|WINDOW\|WITH\|ZER\|ZONEWIDTH)(?:\$\|\b)/i,operator:/<[=>]?\|>=?\|[+\-\/^=&]\|\b(?:AND\|EQV\|IMP\|NOT\|OR\|XOR)\b/i,punctuation:/[,;:()]/};