Commit Graph

12 Commits

Author SHA1 Message Date
85644457d0 Tokenize whitespace as well, skip it in next 2026-04-12 00:49:59 +03:00
96e4d6232f Fix tokenization of long words 2026-04-11 22:06:15 +03:00
bd76e8676f Add literal strings 2026-04-11 22:03:38 +03:00
6a315711cf Make metadata actually have start and end separately 2026-04-11 00:01:14 +03:00
a035d07505 Add metadata to AST 2026-04-10 23:58:06 +03:00
d902569f7b Add metadata to tokens 2026-04-10 23:40:59 +03:00
07b691ba7a Fix all warnings 2026-04-10 21:45:05 +03:00
97745ffbb0 Parse if-statements 2026-04-10 17:39:38 +03:00
8520404fb1 Parse function somewhat correctly 2026-04-02 15:36:48 +03:00
856709e46a Rename name to formatted 2026-04-01 22:44:31 +03:00
e5f7430586 Add TokenStream 2026-04-01 22:42:27 +03:00
ad04da8218 Move tokens to it's own file 2026-04-01 22:13:23 +03:00