Commit Graph

4 Commits

Author SHA1 Message Date
d418404918 Fix segfault in tokenizevarkw
Also added debug flags to CFLAGS and added little testing thing in main.c.
2022-04-02 12:33:43 +08:00
e1b1a52921 refactor tokenize function 2022-04-01 23:42:22 +08:00
efca2f5483 add tokenizer 2022-04-01 22:12:28 +08:00
fbf7a1e7d3 initial commit 2022-03-31 17:28:52 +08:00