|
21444c2654
|
Add newline as token type and add skeleton for parser
|
2022-04-02 18:10:01 +08:00 |
|
|
29166c8bff
|
Fix EOF bug and add token printing to main.c test()
|
2022-04-02 16:09:37 +08:00 |
|
|
d418404918
|
Fix segfault in tokenizevarkw
Also added debug flags to CFLAGS and added little testing thing in main.c.
|
2022-04-02 12:33:43 +08:00 |
|
|
e1b1a52921
|
refactor tokenize function
|
2022-04-01 23:42:22 +08:00 |
|
|
efca2f5483
|
add tokenizer
|
2022-04-01 22:12:28 +08:00 |
|
|
fbf7a1e7d3
|
initial commit
|
2022-03-31 17:28:52 +08:00 |
|