mirrors
/
janet
mirror of https://github.com/janet-lang/janet
1
0
Fork 0
Code Issues 1 Releases Wiki Activity
4,238 Commits 54 Branches 72 Tags 16 MiB
Commit Graph

544 Commits

Author SHA1 Message Date
Calvin Rose 742469a8bc Address #640. 
Allow for a zero length match at the end of a string when using the
to or thru combinators.
 2021-02-19 16:10:03 -06:00
Leah Neukirchen c16a9d8463 Fix or with zero arguments. 
The value is nil to be consistent for and/or and all/some.
Also add some tests for and/or.
 2021-02-16 19:59:03 +01:00
Calvin Rose 7e2c433abc Fix #636 2021-02-14 14:34:52 -06:00
Calvin Rose 10dcbc639a Immediate instuctions will now call :compare method. 2021-02-08 11:53:25 -06:00
Calvin Rose dd8de1e9ac
Merge pull request #609 from yumaikas/master 
Change tracev to upscope instead of using let
 2021-01-22 19:02:27 -06:00
Andrew Owen 1fcaffe6b0 Change tracev to upscope, add test 2021-01-21 23:40:28 -07:00
Calvin Rose 49dcc816ae Update os/shell to be non-blocking as well. 2021-01-18 16:44:22 -06:00
Calvin Rose 462e74ef87 Add os/proc-close to close all pipes associated with a subprocess. 
This will not leak handles until the GC runs in most use cases.
 2021-01-16 15:11:07 -06:00
Calvin Rose a1cc5ca045 Fix #593. 
Also add ev/give-supervisor to the core.
 2021-01-16 07:18:07 -06:00
Calvin Rose 4f2d1cdc00 Go back to a single supervisor channel per fiber. 
We now also use the fiber mask to figure out which flags to wait for.
 2021-01-12 21:35:28 -06:00
Calvin Rose 9078d3bd37 Update CHANGELOG.md 2021-01-11 18:54:50 -06:00
Calvin Rose 5e1a8c86f9 Add more network and subprocess testing with redirection. 2021-01-11 18:32:56 -06:00
Calvin Rose bf01bf631d More work on windows networking code. 
Remove use of WSARecv and WSASend since for whatever reason
they seem suspect. We may want to revisit this later.
 2021-01-11 18:00:31 -06:00
Calvin Rose 80c5ba32b5 Remove wait from CI testing for networking tests. 
We want to expose any existing race conditions.
 2021-01-11 15:55:12 -06:00
Calvin Rose f0dbc2e404 Fix subprocess spawning on windows. 
Also fix (:read stream :all)
 2021-01-11 11:10:23 -06:00
Calvin Rose 4df1ac5b23 Fix some issues in os.c to diagnose improve windows subprocess code. 2021-01-11 09:06:39 -06:00
Calvin Rose 11067d7a56 Update module and rem operator for int types. 2021-01-09 14:47:43 -06:00
Calvin Rose bcba0c0279 Fix #548 - string/split bug. 
Also update docstrings for string/find. The 'skipping'
behavior that was documented only applies to to string/replace-all.
 2021-01-05 18:54:51 -06:00
Calvin Rose 2ca9300bf7 Add sort tests. 2021-01-03 16:45:37 -06:00
Calvin Rose 87badc71d2 Remove :generate verb from loop. 
Instead, one case use `:in` as with otehr data structures.
 2021-01-03 16:38:38 -06:00
Calvin Rose 115556fcf2 Merge branch 'ev_execute' 2021-01-03 11:48:00 -06:00
Calvin Rose 62f783f1dc Merge branch 'master' of github.com:janet-lang/janet 2021-01-03 09:26:31 -06:00
Calvin Rose 9e42ee153c Merge branch 'master' into HEAD 2020-12-30 12:19:13 -06:00
Calvin Rose 2357b6162f Update test-install target. 2020-12-26 15:42:13 -06:00
Calvin Rose 25ded775ad Add array/clear. 
Also improve map, find-index, and find to work on data structures
which do not defined length.
 2020-12-18 12:37:58 -06:00
Michael Camilleri 77b79e9899
Update (parser/where) to support optional line and column 2020-12-15 14:12:33 +09:00
Calvin Rose eab5f67c5c Fix buffer with NULL data pointer issue. 
Simply prevent buffers from ever having a NULL data pointer.
 2020-12-13 09:33:57 -06:00
Calvin Rose 6020106000 Address #529 2020-12-11 19:21:54 -06:00
Calvin Rose 811a5d93f4 Prevent some potential bad characters in test out. 2020-12-06 17:10:18 -06:00
Calvin Rose 0f16f21677 Make builds deterministic again. 
Also prevent marshal from creating multiple copies of
a function - (marshal function pointer before function def pointer).
 2020-12-06 16:32:23 -06:00
Calvin Rose cbdea8f331 Make os/execute cooperate with ev module. 
os/execute, os/proc-wait do not block (currently posix only).
This uses the self-pipe trick to turn signals into a pollable entity.
 2020-11-29 15:36:21 -06:00
Calvin Rose 7aa4241662 Add testing for the new reindent behavior. 
This also provides a reference function to reimplement
the behavior in Janet.
 2020-11-28 12:18:36 -06:00
Calvin Rose 776ce586bc Add line and column combinators to peg. 
These capture the line and column number of the current position
in the matched text. This is useful for error reporting as well
as indentation checking.

This works by lazily creating an index on first use that stores all
newline character indices in order. We can then do a binary search on
this to get both line number and column number in log(n) time.
This is good enough for most use cases and doesn't slow down the common case at all
- these will not be commonly used patterns in a hot loop so it is not worth to try and
optimize this at all. Constant time look up should be possible but at
the cost of complicating code and slowing down all matching to check for
new lines.
 2020-11-26 18:32:56 -06:00
Calvin Rose a3e812b86d Fix #505 - bat int64 parsing. 
Fixes an off-by-1 error.

Also makes windows testing hopefully a bit less flaky.
 2020-11-25 09:45:46 -06:00
Calvin Rose a3f98091c4 Fix #509 
janet_fiber returns NULL if there is a bad arity, check that before
continuing.
 2020-11-23 15:28:28 -06:00
Calvin Rose cff52ded58 Add JANET_ASYNC_EVENT_CANCEL 
also fix bug that could cause event loop to hang.
 2020-11-16 18:46:59 -06:00
Calvin Rose 1759151875 Change suite 9 test a bit. 2020-11-15 10:12:10 -06:00
Calvin Rose cdcb774dc8 Add os/pipe and os/open. 
ev/pipe -> os/pipe, and os/open is a wrapper
around the open system call.
 2020-11-15 09:57:29 -06:00
Calvin Rose dc51bd09f7 Make sure all test logs go to the same stream. 2020-11-14 15:56:48 -06:00
Calvin Rose 12f09ad2d7 Add ev/pipe and move stream code into ev.c 
Also adds a lot to the C API and changes things up.
 2020-11-14 14:29:11 -06:00
Calvin Rose d6391f2d70 Get windows IOCP working for accept. 
This also changes the api of servers slightly -
in light of having support for ev tasks, it is probably better
to remove the "simple" server code and replace it with some Janet
or remove it all together. While convenient, it has issues with error
handling and rigidity.
 2020-11-08 18:56:13 -06:00
Calvin Rose 307c7e00e2 Merge branch 'master' into ev 2020-10-03 11:09:21 -05:00
Calvin Rose 45feb55483 Add integer parsing to pegs. 2020-09-27 12:19:00 -05:00
Calvin Rose 0a1d902f46 Fix #477 
Make the walk function preserve bracket type, which should fix
threading macro behavior when threading into bracketed expressions.
 2020-09-26 13:28:29 -05:00
Calvin Rose 959a577b5f Merge branch 'master' into ev 2020-09-26 11:50:13 -05:00
Calvin Rose d1f0a13ddc janet_try macro and janet_restore function. 
This allows catching panics without using pcall.
 2020-09-19 18:47:47 -05:00
Calvin Rose babfe50550 Merge branch 'master' into ev 
Also add poll implementation for ev.
 2020-09-07 12:52:50 -05:00
Calvin Rose 1837e89fe4 Address #470 - hyphen's in native module names. 2020-09-06 15:23:24 -05:00
Calvin Rose 25156eb83e For #469 - Add support for C++ and mixed C/C++ 
WIP and for native modules. Required a few changes to headers and
some changes to JPM.
 2020-09-04 17:41:36 -05:00
Calvin Rose a31e079f93 Fix import macro to not coerce everything to string. 2020-08-27 08:19:41 -05:00
Calvin Rose 17d0b7a985 Improve import's handling of non constant args. 
Be much more conservative about which arguments are cast to strings.
 2020-08-27 07:40:51 -05:00
Calvin Rose 86e00e865e Merge branch 'master' into ev 2020-08-23 11:25:04 -05:00
Calvin Rose 28439d822a Add cancel function. 
This should allow better stack unwinding on a fiber that
no longer needs to complete.
 2020-08-22 15:35:37 -05:00
Calvin Rose 30522bbf7d Merge branch 'master' into ev 2020-08-16 17:52:36 -05:00
Calvin Rose 7e7498350f Fix #463 
Fix outdated code in macex1, such as checking for unquote-splicing,
    which no longer exists. Also fix macex1 for quasiquoted tables and
    structs. macex1 is not the macro expander used by the compiler, so
    these bugs only affected code which called macex manually, such as
    the short-fn macro.
 2020-08-12 06:10:42 -05:00
Calvin Rose 1213990b7d Merge branch 'master' into ev 2020-08-07 19:51:37 -05:00
Calvin Rose 2598123140 Rename test suites such that it is easier to add more of them. 2020-08-07 15:34:13 -05:00
Calvin Rose d393fbf360 Merge branch 'master' into ev 2020-07-25 14:07:47 -05:00
Calvin Rose 4cc680965c Prepare for 1.11.1 release. 2020-07-25 13:48:43 -05:00
Calvin Rose ba08e487cb Disable PRF by default. 
Since it is not any better by default without initializing the key, we
disable it by default. It can be turned on with JANET_PRF in
janetconf.h.
 2020-07-25 13:34:40 -05:00
Calvin Rose 553b4d9428 Add timeouts to net functions. 
Further debugging of the general timeout system, as well
as having a single fiber wait on multiple state machines (select).
 2020-07-19 19:41:12 -05:00
Calvin Rose 7478ad115f Add `any?` predicate to core. 
This is the contrapositive to `every?`, and is analagous to `or` as
`every?` is to `and`.
 2020-07-06 09:19:10 -05:00
Calvin Rose a45509d28e Add list-pkgs and list-installed to jpm. 2020-07-05 17:43:39 -05:00
Calvin Rose e548e1f6e0 Add peg/replace and peg/replace-all 2020-07-01 21:29:24 -05:00
Josef Pospíšil c26f573620 Add tests for peg/find and peg/find-all 2020-06-30 17:03:13 +02:00
Josef Pospíšil e9911fee4d Add keyword/slice and symbol/slice tests 2020-06-29 09:18:26 +02:00
Calvin Rose a1ea62a923 Fix optimization of do_get. 
When the target slot (register) is the same as the default
register, do not clobber it.
 2020-06-28 15:52:59 -05:00
Calvin Rose ac5de1f96e Change compare-primitive to cmp. 
cmp is implemented as a VM instruction rather than
a function.
 2020-06-24 16:00:00 -05:00
Calvin Rose 08a3687eb5 Fix #428 
Add binding check for generate verb in loops. The check is present
in other loop verbs.
 2020-06-21 15:57:55 -05:00
Calvin Rose 5c364e0f7c Better roundtrip jdn. 
Use the most precise format specifier, such that output jdn numbers
are more accurate.
 2020-06-18 21:54:34 -05:00
Calvin Rose 86e12369b6 Add alias for PEG repeat. 
A tuple where the first element is an integer is
a shortand for this.
 2020-06-11 11:23:43 -05:00
Calvin Rose 6d096551f0 Add Peg combinators 'to' and 'thru'. 
Inpsired by the REBOL operators of the same name, these
combinators match bytes up to or inculding a given pattern.
(to patt) is (almost) equalivalent to (any (if-not patt 1)), and
(thru patt) is equivalent to (* (to patt) patt). The one difference
is that if the end of the input is reached and patt is not
matched, the entire pattern does not match.
 2020-06-10 21:18:50 -05:00
Mike Beller 9824a34d76 Remove dead code. 2020-06-06 08:55:20 -04:00
Mike Beller a4178d4b3c All tests pass for compare. 2020-06-05 10:51:35 -04:00
Mike Beller 3e423722c6 Actually got the comparisons working for s64 (still need to fix u64) 2020-06-04 18:27:48 -04:00
Mike Beller 01837f2bb6 All tests pass. 2020-06-04 15:27:36 -04:00
Mike Beller 411c5da6d3 compare functions now work for built ins and 'objects' 2020-06-04 13:49:09 -04:00
Mike Beller 7658ea8335 primitive tests working. issues remain with polymorphic. 2020-06-04 12:46:58 -04:00
Mike Beller 81d301a42b Initial commit of base functionality for compare 2020-06-04 12:23:54 -04:00
Calvin Rose 677737d345 Fixes #412 Lookahead does not move cursor. 2020-05-21 01:22:08 -05:00
Mike Beller 8263789602 Fix issue #408 -- make "next" work for typed arrays, and also fix 
bug where tarray/new failed to fully check the type of it's last
argument.
 2020-05-20 13:30:48 -04:00
Calvin Rose 617338457d More windows shenanigans with jpm. 
Cannot remove open file, get rid of double rm.
 2020-05-19 20:03:49 -04:00
Calvin Rose e623690295 Use keywords in the assembly interface. 
This is simply more idiomatic, removes some unused and undocumented
features of the assembly interface, and simplifies it somewhat.
 2020-05-19 13:51:39 -05:00
Calvin Rose 7a84fc4742 Fix infinite loop in some cases. 
Problem - reusing a tainted variable without reinitializing.
 2020-05-16 08:28:50 -05:00
Calvin Rose 1add0c7d43 make test-install should be easier to clean. 2020-05-09 10:30:09 -05:00
Calvin Rose 8b5bcaee3c Add lenprefix combinator to pegs. 
This lets peg match n repeitions of a pattern, where
n is supplied from other parsed input and is not a constant.
 2020-05-02 10:39:35 -05:00
Calvin Rose d2ebf4b52d Merge branch 'net' 2020-04-26 12:27:37 -05:00
Calvin Rose da438a93e0 Restore lexicographic comparison of tuples. 2020-04-24 16:51:04 -05:00
Calvin Rose a87015598c Make janet_equals and janet_compare non recursive 
This makes these operatios use constant stack space rather
than linear stackspace given the size of the inputs. This is important
to prevent certain parser input from causing a stack overflow - in
general, we try to avoid unbounded recursion.
 2020-04-24 16:18:31 -05:00
Calvin Rose c876e63010 Fix overflow in exponent estimation in strtod.c. 
Found by OSS-Fuzz.
 2020-04-21 18:32:59 -05:00
David Korczynski 676a0afe4c Fixed up very wrong fuzzer to go more for the parser. 2020-04-19 20:36:38 +01:00
David Korczynski 82e052f2ec Updated the libfuzzer to target marshalling. 2020-04-18 22:04:26 +01:00
Calvin Rose 2904c19ed9 Switch to poll from select. 
Simpler and more flexible interface, and also lets
us use epoll more easily on linux, which is the most important
plantform to optimize for network performance.
 2020-04-18 15:22:20 -05:00
Calvin Rose e202d30835 Use make format. 2020-04-17 13:39:23 -05:00
davkor 4faa129b8e Added a first fuzzer. 2020-04-13 17:33:58 +01:00
Calvin Rose ea2811f14f Merge branch 'master' of github.com:janet-lang/janet 2020-04-11 13:42:34 -05:00
Calvin Rose 8bc2987a71 (struct ...) with duped keys will use last value. 2020-04-11 13:42:25 -05:00
Calvin Rose 1d13095d19
Merge pull request #340 from pepe/get-vs-in-last 
Fix last for empty collection, add tests
 2020-04-10 19:03:21 -05:00
Calvin Rose 02f17bd4e4 Add sort-by and sorted-by. 2020-04-09 20:43:51 -05:00
Josef Pospíšil b63a0796fd Fix last for empty collection, add tests 2020-04-09 14:35:57 +02:00
Calvin Rose e6d4e729fb Keep reference alive so unmarshalled object not collected. 2020-04-06 17:24:52 -05:00
Calvin Rose b75a22b753 Make JANET_FRAME_SIZE consistent across architectures. 
This means unmarshalling fibers should work across arches.
 2020-04-06 12:41:56 -05:00
Calvin Rose 72beeeeaaa Move funcenv verification to runtime. 
Lazy verification makes it easier to not leave funcenvs
in an invalid state, as well as be more precise with the validation.
We needed to verify the FuncEnvs actually pointed to a stack frame if
they were of the "on-stack" variant. There was some minor checking
before, but it was not enough to prevent func envs from pointing to
memory that was off of the fiber stack, overlapping stack frames, etc.
 2020-04-06 10:58:47 -05:00
Calvin Rose c3c42ef56f Fix case for #336. 
Also consider ascii 127 (delete) non-printable for string escapes.
 2020-04-06 00:11:22 -05:00
Calvin Rose a3c55681b2 Address #336 case 6 2020-04-05 21:39:39 -05:00
Calvin Rose fcc610f539 Address #336 case 4 
Set funcenv fields to NULL before any possible panics.
 2020-04-05 19:18:59 -05:00
Calvin Rose 5bbd507858 Address #336 case 3 
Fix error condition for bad abstract types - don't return NULL, panic.
 2020-04-05 17:38:14 -05:00
Calvin Rose b145d47863 Address cases 1 and 2 of #336. 
Mainly related to not checking ints < 0.
 2020-04-05 08:01:18 -05:00
Calvin Rose 87ecdb8112 Change \UXXXXXXXX -> \UXXXXXX and check codepoint max. 
No need to add two extra leading zeros, as the max unicode
codepoint is 0x10FFFF.
 2020-04-05 07:09:53 -05:00
Calvin Rose ae70a03383 Address #306 - Add unicode escapes. 
Unicode escapes have the same syntax as go - \uXXXX or \UXXXXXXXX.
 2020-04-04 21:46:08 -05:00
Calvin Rose a0d61e45d5 Change os/perm-str to os/perm-string. 2020-04-03 15:23:29 -05:00
Calvin Rose ff163a5ae4 Use modulo instead of remainder for even?/odd?. 
Works better for negative and fractional numbers.
 2020-03-28 10:23:28 -05:00
Calvin Rose 65379741f7 Address edge case of reduce2 when ind is empty. 
Same for accumulate 2.
 2020-03-27 12:45:40 -05:00
Calvin Rose 3eb0927a2b Add accumulate(2) and reduce2 
These functions are variations on reduce and can be quite useful.
Improve error message for jpm as well.
 2020-03-26 21:35:11 -05:00
Leah Neukirchen 3ee43c3abb add os/mktime, an inverse to os/date. 2020-03-18 23:45:02 +01:00
Calvin Rose b0d8369534 Increase reference accuracy of on-stack close envs. 
Using a bitset to indicate which stack values are upvalues, we
can more accurately track when a reference to a stack value
persists after the stack frame exits.
 2020-03-18 09:30:10 -05:00
Andrew Chambers 7c4ffe9b9a Add test cases for closure edge cases. 2020-03-18 15:40:41 +13:00
Calvin Rose 77343e02e9 Fixes #304 
Add chr macro.
 2020-03-10 22:46:50 -05:00
Calvin Rose a3d4ecddba Address #301 
Incorrect bounds checking and offset calculation in buffer/blit.
 2020-03-08 20:44:03 -05:00
Calvin Rose d3b9b8d452 For #293, correct wildcards in dictinoaries. 2020-03-07 10:13:10 -06:00
Calvin Rose e0c9910d85 Add :range-to and :down-to to loop. 
Fully inclusive ranges are generally useful and
do not complicate implementation much.
 2020-03-07 09:34:11 -06:00
Calvin Rose 714bd61d56 Address #300 
Check for empty capture stack in replace rule.
 2020-03-06 10:05:20 -06:00
Calvin Rose 6123c41f13 Harden semantics for and and or macros. 
There was perviously a bit of fuzziness on returning false/nil
from these macros that has been removed.
 2020-03-06 08:37:59 -06:00
Calvin Rose 47e8f669f5 Fix match behavior for lone nil. 2020-03-05 09:35:00 -06:00
Calvin Rose 734c85d7ef Properly handle recursion with labels. 
Use an empty buffer, which has pointer equality semantics, for
tag from a label.
 2020-02-23 17:35:01 -06:00
Calvin Rose 59d288c429 Add `prompt` and `return`. 
User friendly delimited continuations. While this was doable with
signals before, this does not require C and will play nicely with
existing error handling, defers, and with statements.
 2020-02-23 16:46:54 -06:00
Calvin Rose 20d5d560f3 Add bf to main test suite. 2020-02-22 19:18:08 -06:00
Calvin Rose 4fe005e3c3 Add righthand operator overloading. 
This is like python. Now, we just need to readd fuzzy
comparisons to have what python needs. Overloading
math functions would be neat, too.
 2020-01-22 18:59:41 -06:00
Calvin Rose 7c92c64730 Remove mutable operators on inttypes. 
Mutations break hash table invariants, are a rather
silly performance optimization for a language like Janet.
 2020-01-21 17:47:34 -06:00
Calvin Rose 962cd7e5f5 Add when-with and if-with 
This is useful for reading from files.
 2020-01-15 22:56:40 -06:00
Calvin Rose 65be9ae095 Add defer and assert to the core. 2020-01-15 22:39:14 -06:00
Calvin Rose a68ee7aac6 Update Copyright 2020. 2020-01-12 10:50:37 -06:00
Calvin Rose f0e04e734c Test for regressions in #249 
Use two separate natives in compiled executable.
 2020-01-12 10:45:59 -06:00
Calvin Rose 3d40c95e80 Add ability to Janet signal from C functions. 
While C functions are not re-entrant, signaling from a C function
can be used to implement async returns. When resuming a fiber that
signalled from within a C function, the fiber is started after the
instruction that emitted the signal. The resume argument is used
as the return result from the c function.
 2020-01-10 20:44:16 -06:00
Calvin Rose c6b639b939 Add comptime error test. 2019-12-31 12:16:19 -05:00
Calvin Rose b872ee024f Add test for issue #232 2019-12-31 11:36:21 -05:00
Andrew Chambers c2f8441572 Add file/temp. 2019-12-30 12:00:35 +13:00
Calvin Rose 022be217a2 Remove ==, not==, and order[<,<=,>,>=]. 
This unifies equality and comparison checking. Before, we had
separate functions and vm opcodes for comparing general values vs.
for comparing numbers, where the numberic functions were polymorphic and
had special cases for handling NaNs. By unfiying them, abstract types
can now better integrate with other number types and behave as keys.

For now, the old functions are aliased but will eventually be removed.
 2019-12-28 16:04:15 -05:00
Calvin Rose f1afc5b0b4 Address #214 
This adds several common patterns, which are defined in
boot.janet. This essentially gives more primitive patterns
to work with out of the box.

Fix build when JANET_REDUCED_OS is defined.
 2019-12-14 20:39:14 -06:00
Calvin Rose 49954c7a30 Remove top-level unquote for comptime macro 
True top level unquote currently requires basically double compilation
as it currently stands. Also, implementing such double compilation
looses all source mapping information. This is a compromise
implementation that makes it clear that this works differently than
a true top-level unquote.
 2019-12-04 19:53:13 -06:00
Calvin Rose 2487162ccf Add top level unquote and macro envs. 
This improves macros that eval their arguments and
makes them easier to write.
 2019-12-04 18:39:13 -06:00
Calvin Rose 4199c42fe2 Add support for nested quasiquotation. 
This brings Janet more in line with Scheme,
Common Lisp, and Clojure.
 2019-12-04 16:40:53 -06:00
Calvin Rose 70328437f1 Add math/rng-buffer. 
Allow math/seedrandom to use buffer as seed.
 2019-12-03 20:33:21 -06:00
Calvin Rose 600bed9f6d
Merge pull request #209 from andrewchambers/cryptorand2 
Add os/cryptorand.
 2019-12-03 19:12:32 -06:00
Andrew Chambers 0ac5b243c7 Add os/cryptorand. 2019-12-04 14:02:37 +13:00
Andrew Chambers 9911c90b1d Handle missing get case. 2019-12-04 13:58:21 +13:00
Andrew Chambers 5ae520a2c9 Integers convert to plain number strings. 
A user can use (type n) to find the true type, the old behavior did not
seem useful for most uses of the string function.
 2019-12-01 23:10:52 +13:00
Andrew Chambers ded08b6e1e Add truthy? to core. 2019-12-01 14:34:41 +13:00
Calvin Rose 688d297a18 Address Issue #184. 
Fix strtod.c with better range checking to prevent DOS.
 2019-11-28 23:23:37 -05:00
Andrew Chambers 07db4c530e Add os/environ. 2019-11-28 19:00:52 +13:00
Calvin Rose 74d51ab08b Address issue #180 - string/check-set 
Fix the function and add test to further clarify that
implementation is correct. Also fix empty string case.
 2019-11-25 20:33:16 -06:00
Andrew Chambers 976dfc7195 Minor fixes for parser 
Check length before dereferencing buffer in tokenchar.
Check keywords are valid utf-8.
Fix minor typos.
 2019-11-24 08:19:04 +13:00
Calvin Rose 16f6261b44 Improve randomness of numbers from new rng. 
First few numbers are very biased.
 2019-11-10 17:44:59 -06:00
Calvin Rose 6b76ac3d18 Fix bug when appending buffer to self. 
janet_to_string_b had a bug when printing buffers.
 2019-11-10 14:57:09 -06:00
Calvin Rose 719f7ba0c4 Default to UTC for date. 2019-11-09 16:57:21 -06:00
Calvin Rose 8911daaf6c Add --test flag to jpm. 
Also test some select packages when testing installation.
This is used in CI to make sure that versions of Janet work with
the most libraries.
 2019-11-09 10:03:56 -06:00
Calvin Rose aee1687215 Add RNG functionality to the math/ module. 
The new RNG wraps up state for random number generation, so
one can have many rngs and even marshal and unmarshal them.
Adds math/rng, math/rng-uniform, and math/rng-int.

Also introduce `in` and change semantics for
indexing out of range. This commit enforces stricter
invariants on keys when indexing via a function call
on the data structure, or the new `in` function.

The `get` function is now more lax about keys, and will
not throw an error when a bad key is used for a data structure, instead
returning the default value.
 2019-11-08 17:40:04 -06:00
Calvin Rose 9b605b27bd Address #174 - fix string/trim 2019-11-08 08:47:37 -06:00
Calvin Rose 6ceaf9d28d Add with-vars 
This helps for temporarily setting vars in a safe
manner that is guaranteed not to leave vars in a bad state
(assuming that a fiber does not emit debug or use signal and
 is never resumed).
 2019-10-31 21:58:43 -05:00
Calvin Rose 2541806dc1 Fix suite7 failing when run with no docstrings. 2019-10-29 18:28:41 -05:00
Calvin Rose d28925fdab Relax type checking when fuction position is nil 
This lets the flychecker work as expected.
 2019-10-24 15:17:19 -05:00
Calvin Rose d47804d222 Add prin, eprint, and eprin functions. 
The print family of functions now writes output
to an optional buffer instead of a file bound to :out.
This means output can be more easily captured an redirected.
 2019-10-19 09:44:27 -05:00
Calvin Rose 655d4b3aad Fix test. 2019-10-13 08:00:43 -05:00
Calvin Rose 5f51476526 Remove a git attribute for linguist. 2019-10-12 22:03:34 -05:00
Calvin Rose 7910a5feef Add compile time arity checking. 
This should help catch a number of errors, but it
is a very shallow implementation of type checking. It will
catch some common misuses of functions at compile time
rather than runtime.
 2019-09-30 19:50:42 -05:00
Calvin Rose b26a7bb22a Disallow the empty string for some string fns. 
This will prevent these functions from being run
with empty strings, which usually produces useless
output, as the internal string search algorithm will
never "find" empty strings. This is by design, as it is
not always obvious which empty strings should be found in
the search text.
 2019-09-24 13:23:18 -05:00
Calvin Rose 8cda06b995 GCC seemed to not fill array of computed gotos. 
This is expected as per the C standard, but segfaulted
unless all 255 labels were added.
 2019-09-22 17:56:33 -05:00
Calvin Rose a8afc5b81f Sourcemapping uses line, column instead of offsets. 
This should be friendlier to most users. It does, however, mean
we lose range information. However, range information could be
recovered by re-parsing, as janet's grammar is simple enough to do this.
 2019-09-22 17:18:28 -05:00
Calvin Rose 39f1d81fd4 Use :length method for (length abstract) 
Also adds the janet_lengthv API call. This is
needed because janet_length returns a 32 bit integer, where
as lengthv lets us return larger values (useful for typed arrays).

janet_mcall is an api function that should make it easier to call
a janet method from C code. It shares a similar signature with
janet_call.
 2019-09-08 19:26:16 -05:00
Calvin Rose 54a04b5894 Fix some more recursion issues with pegs. 
A keyword reference only counts as visited if we have
it as cached in the memoized->table, and we know it was
originally referenced from the same grammar table. If these
two conditions are true, then compilation must work correctly.

Also add janet_table_get_ex.
 2019-08-29 19:56:04 -05:00
Calvin Rose 8bc8709d0e Try to address memoization problem in pegs. 2019-08-29 19:09:43 -05:00
Calvin Rose 05695a35c7 Fix test-install after removing cook. 2019-08-28 21:05:34 -05:00
Calvin Rose 133ad0d355 Add test for longstring matcher using backmatches. 2019-08-24 19:02:55 -04:00
Calvin Rose 711fe64a51 Add backmatch operator to pegs. 
(backmatch [tag?]) is similar to a back reference in regular expressions
(NOT to backwards capture in a peg). It only matches a pattern if
it exactly matches the text of the last capture. It does not consume
or push any captures to the capture stack.
 2019-08-24 18:57:01 -04:00
curist 5802155882 Update take/drop - while/until. 
to be more consistent with take/drop
 2019-08-06 15:33:55 +08:00
curist 18da183ef7 Add take/drop. 2019-08-06 14:00:05 +08:00
Calvin Rose 44e752d737 Add shorthand function literals to janet. 
These are similar to the function literals from Clojure
(also Fennel), and should make short functions for maps, filters, etc.
easier to write.
 2019-08-04 12:25:52 -05:00
Calvin Rose 5c83ebd75d Update test suites. 2019-08-03 14:56:02 -05:00
Calvin Rose 8bbe518696 Executables linking to natives working on linux. 
This involves a bunch of machinery in cook.janet
and even a little bit in the janet C API.
 2019-07-28 13:27:20 -05:00
Calvin Rose cc07ff987d Fix normal native building and make test-install. 
Add executable generation testing to make test-install.
 2019-07-27 09:53:28 -05:00
Calvin Rose 0d3986abbb Update cook and add an install test. 2019-07-19 19:40:51 -05:00
Calvin Rose e0fe8476aa Address issue #143 
Fix some logic in module/expand-path.
 2019-07-15 17:39:50 -05:00
Calvin Rose e528b86a2a Ensure no carriage returns end up in doc strings. 2019-07-12 09:14:37 -04:00
Calvin Rose 894877a0e3 Address issue #142 
Also add janet_wrap_number_safe to API.
 2019-07-12 07:23:24 -05:00
Calvin Rose 3928136670 Begin update to 1.1.0. 2019-07-08 18:16:17 -05:00
Calvin Rose 0dcae6c3d6 Update regression test. 2019-07-07 23:23:45 -05:00
Calvin Rose affcb5b459 Address #137 
Fix compiler bug when compiling desturctured bindings in a top-level
def or var. Also introduce janet_table_clone API call to make this
easier.
 2019-07-07 23:18:39 -05:00
Calvin Rose b8032ec61d Add propagate function and opcode 
This allows better stacktraces when manually intercepting
signals to clean up resources. Also allows functionality
from Common Lisp's unwind-protect, such as calling cleanup code
while unwindinding the stack, restarting on certain signals, and
just in general having more control over signal and signal propagation.

Also fix a bug encountered while implementing with-resource in the
compiler. Desturcturing arguments that were not the last argument
would often result in bad code generation, as slots used to destructure
the earlier arguments would invalidate the later parameters. This is
fixed by allocating all named parameters before doing any destructuring.
 2019-06-24 12:44:13 -04:00
Calvin Rose 4b4fe80404 Be more complete with JANET_NO_SOURCEMAPS 
This actually removed sourcemaps, not just
the top level annotation in bindings.
 2019-06-20 11:55:52 -04:00
Calvin Rose cf05ff610f Add some fixes for serializing complex grammars. 2019-06-19 23:23:27 -04:00
Calvin Rose fc46030e7d Add options to not include docstrings in binary. 
This lets us build a smaller binary. The minimal tested
binary on x86-64 (with -Os, -s, and all options that shrink binary size
        turned on) is about 240 kB.
 2019-06-19 19:43:38 -04:00
Calvin Rose ff3bb66272 Add some test cases for module/expand-path 2019-06-19 12:48:29 -04:00
Calvin Rose 9ba8728176 Update module system. 
Add relative imports and path normalization. This should
help towards a more composable build/dependency system.
 2019-06-18 22:10:13 -04:00
Calvin Rose e88a9af2f6 Add bytecode verification for peg unmarshaling. 2019-06-18 13:01:49 -04:00
Calvin Rose 446ab037b0 Allow marshaling pegs. 2019-06-17 23:40:02 -04:00
Calvin Rose b4e25e5597 Add some string/check-set tests. 2019-06-10 14:11:07 -04:00
Calvin Rose 43520ac67d Add parser/clone. (#120) 2019-06-08 17:16:36 -04:00
Calvin Rose f12f896020 Change test-install 2019-05-28 12:59:21 -04:00
Calvin Rose 698e89aba4 Fix comment macro arity #110 2019-05-25 22:50:15 -04:00
Calvin Rose 3f137ed0b1 Add keyword argument tests 2019-05-24 17:53:34 -04:00
Calvin Rose a303704a7d Add some tests for the amalgamated source/ 
Adds tests to Makefile and CI on Poisx platforms.
 2019-05-23 10:34:01 -04:00
Calvin Rose 0378ba78cc Add regression test. 2019-05-20 09:20:50 -04:00
Calvin Rose 232ea22dc5 Add string/triml, string/trimr, and string/trim. 2019-05-10 16:09:49 -04:00
Calvin Rose bbcfaf1289 Fix use after free bug in buffer/format when printing self. 2019-05-08 15:25:25 -04:00
Andrew Chambers 1759252071 Fix use after free in buffer/push-string. 2019-05-08 10:49:25 -04:00
Calvin Rose 65ac17986a Address similar issue to #86 
buffer/blit could trigger a use after free if a buffer is
blitted with itself and modifies its length.
 2019-05-08 08:55:43 -04:00
Andrew Chambers c70d59edee Add string/has-prefix? and string/has-suffix?. 2019-05-04 10:05:58 -04:00
Calvin Rose 7918add47d Allow dynamically setting output for printers 
Some functions like print and debug/stacktrace print
to a file, usually stdout. This file can now be optionally set
via a dynamic variable.
 2019-04-16 21:44:19 -04:00
Calvin Rose 2d7df6b78e Many changes for adding dynamic (fiber-level) scope. 
- Allow passing a table to fibers, which make fiber level scope easier.
- Add fiber/getenv, fiber/setenv, dyn, and setdyn
- Remove meta, *env*, and *doc-width*
- Some functions changed dignatures, and no longer take an env
 2019-04-16 15:41:45 -04:00
Calvin Rose 1596511175 Fix undefined behavior bug with errors. 
janet_vm_return_reg should only be set when janet_continue
is called. Otherwise, a panic may dump it's error message in
the wrong place, resulting in undefined behavior (often showing
the last return value or worse, segfaulting).
 2019-04-10 23:29:40 -04:00
Calvin Rose d514eab627 Add regression test for #78 2019-04-09 09:14:40 -04:00
Calvin Rose e239980da7 Quasiquoting bracketed tuples. 2019-03-31 14:15:26 -04:00
Calvin Rose 2c9195b507 More updates to meson 
Redo amalg script so we can more easily run
it from Meson.
 2019-03-23 13:50:50 -04:00
Calvin Rose bad040665f Renamed bigint -> inttypes / int 
A lot of refactoring larger integer types. Fix a number
of casting errors, but mostly rename things. Also try to
limit use of template-like macros as they bloat the binary
if not used in moderation. We were able to reduce the size of
typed array code as well by using a single view types.
 2019-03-18 18:36:53 -07:00
J.-F. Cap a07d76b264 use custom string to bigint reader in place of strtol 
for better compatibility with default janet number reader
 2019-03-18 18:36:53 -07:00
J.-F. Cap 1db6d0e0bc Trap INT64_MIN / -1 exception 2019-03-18 18:36:53 -07:00
J.-F. Cap 319575c864 bigint operators and some tests 2019-03-18 18:36:53 -07:00
Quan Nguyen 75dc08ff21 Fix nil error on drop-until fn 2019-03-10 12:39:55 -04:00
Calvin Rose 8ba1121161 Add early returns via break. 
Inside a while loop, the argument to
break does nothing as while loops always
return nil.
 2019-03-09 22:01:10 -05:00
Calvin Rose 4a111b38b1 Add break special. 
The break special form can break out of both loops
and functions with an early (nil) return. Mainly useful
for generated code in macros, and should probably be discouraged
in user written code.
 2019-03-09 17:15:50 -05:00
Calvin Rose 687a3c91f5 Add array/remove and update CHANGELOG. 2019-03-08 10:24:21 -05:00
Calvin Rose 0382dc976b More code to better integrate with size_t 
Typed arrays use proper size_t support in more
places now.
 2019-03-08 00:44:26 -05:00
Calvin Rose 69dcab2b55 Silence some casting size_t to double errors. 2019-03-07 22:44:17 -05:00
Calvin Rose 624be87c97 Add test for :down verb. 2019-03-03 23:55:38 -05:00
Calvin Rose 172261b89f Add a test-install target to the Makefile 
This target will be used to check if an installation
of Janet is on the PATH, if native modules can be built
and used via the cook module, etc.
 2019-03-03 14:48:17 -05:00
J.-F. Cap fb5119bf43 Added some tests (suite 5) 2019-02-25 18:49:04 +01:00
Calvin Rose 340a6c4d8d Update marsh.c to use janet_panic for errors. 
Before, we used a local setjmp/longjmp for error handling.
Using janet_panic means errors can be more easily expressive and
code can be smaller.

However, we still need to make vector memory get gc collected, as
panics can cause the runtime to skip janet_v_frees.
 2019-02-22 10:12:25 -05:00
Calvin Rose f4908ebc41 Update issue 53 regression test. 
Some tests did not call assert so did not show up on report.
 2019-02-21 19:19:47 -05:00
Calvin Rose 1147482e62 Address #53 - marshalling fiber strangeness 
The unmarshaller was not tracking fibers in references.
 2019-02-21 19:11:28 -05:00
Calvin Rose 811b1825cb Remove tuple/append and tuple/prepend. 
Use the splice special instead.
 2019-02-20 21:08:54 -05:00
Calvin Rose a982f351d7 Address #50 
Issues with range when called with 3 arguments.
 2019-02-20 12:07:20 -05:00
Calvin Rose 029394db31 Add buffer/format as well as string/format. 
buffer/format uses the old string/format behavior. `string/format` no
longer requires a buffer, and returns a string.
 2019-02-16 13:59:38 -05:00
J.-F. Cap 0f0c415bcf Adde some tests for string/format 2019-02-16 16:28:10 +01:00
Calvin Rose bdf03b4706 Fix unmarshalling integers directly, not through readint. 2019-02-15 14:01:32 -05:00
Calvin Rose c6edf03ae8 Fix some code style, add tuple/type function. 
We need to be able to detect tuple type from janet code, otherwise
tuples will contain hidden state. The tuple/type function is able
to detect the flags in the tuple so the programmer can access them
if needed.
 2019-02-09 12:21:11 -05:00
Calvin Rose f284776490 Address #24 2019-01-28 20:30:45 -05:00
Calvin Rose 38a7e4faf1 Disallow NaN as table/struct key. 
Fix bugs and add tests for denormalized tables
and structs.
 2019-01-28 11:50:33 -05:00
Calvin Rose e755f98300 Address #23 2019-01-25 20:31:08 -05:00
Calvin Rose b84b0e4828 Expose more of the module system. 
The system path can more easily modified at runtime,
and the module/cache and module/loading tables are now exposed.
Properly cache native modules as well.
 2019-01-18 12:04:34 -05:00
Calvin Rose b4934ceddc Make parser errors a bit better for files with no closing 
delimiters.
 2019-01-17 23:43:46 -05:00
Calvin Rose 2c1b506213 Add tagged captures for a better (more correct) form of look behind. 2019-01-16 22:38:11 -05:00
Calvin Rose 612a245961 More work on peg. Disable indexed backrefs and replace substitution 
with accumulation.
 2019-01-16 21:11:55 -05:00
Calvin Rose 4eeadd7463 Add optional form to peg (shorthand for (between 0 1 patt)). 2019-01-15 14:08:03 -05:00
Calvin Rose 3a9b50ea4a Update peg doc and remame some peg specials. 2019-01-14 22:17:13 -05:00
Calvin Rose 90313afd40 Update PEG documentation and peg syntax. 
Disable tail calls in the root scope for better
stacktraces, as the root scope may contain a single call
to a failing function, as in the case of the test suite.
 2019-01-14 20:41:32 -05:00
Calvin Rose d0ec89c7c1 Update Matchtime captures to not include all of the 
matched text automatically, and fix pattern recursion
in grammars.
 2019-01-14 17:44:21 -05:00
Calvin Rose 170e785b72 Fix recursion in grammars. 2019-01-14 15:06:35 -05:00
Calvin Rose 192705113e Add Matchtime captures to peg (Equivalent to LPegs lpeg.Cmt). 
This allows that pattern to call an external function to
check if some text should match or not. This allows for
matching any possible language a computer can recognize.
 2019-01-14 11:45:45 -05:00
Calvin Rose ff0d3a0081 Compile pegs to bytecode with (peg/compile). Peg 
performance is improved, and peg syntax has been expanded with a few
more keywords.
 2019-01-13 23:54:41 -05:00
Calvin Rose 798c88b4c8 Update peg to allow functions over captures. Update C API 
to make janet function calls easier and faster from C (still
needs an object pool for fibers, though). Fix bug in scan-number
and add many more peg tests.
 2019-01-12 17:31:15 -05:00