4 Commits

Author	SHA1	Message	Date
matt	29166c8bff	Fix EOF bug and add token printing to main.c test()	2022-04-02 16:09:37 +08:00
matt	d418404918	Fix segfault in tokenizevarkw ... Also added debug flags to CFLAGS and added little testing thing in main.c.	2022-04-02 12:33:43 +08:00
matt	e1b1a52921	refactor tokenize function	2022-04-01 23:42:22 +08:00
matt	efca2f5483	add tokenizer	2022-04-01 22:12:28 +08:00