mirrors/janet
1
0
Fork 0
mirror of https://github.com/janet-lang/janet synced 2024-06-26 07:03:16 +00:00
Code Issues 1 Releases Wiki Activity
3,824 Commits 56 Branches 75 Tags 15 MiB
bytecode_opt
Commit Graph

479 Commits

Author SHA1 Message Date
Calvin Rose
2aa1ccdd76 Update test helper to be even les noisy. 2021-11-06 11:20:09 -05:00
Calvin Rose
0284df503f Make test output less verbose 2021-11-06 11:01:21 -05:00
Calvin Rose
39c6be7cb7 Fix #861 - parser/produce caused state to be invalid for parser/state. 
parser/produce was leaving a counter in the root state undecremented.
 2021-11-04 19:38:37 -05:00
Calvin Rose
9cc4e48124 Update changelog and allow evaluating streams with dofile. 2021-10-30 14:43:06 -05:00
Calvin Rose
34c7f15d6d Always return port in peername and localname 2021-10-30 10:56:40 -05:00
Calvin Rose
03f99752a7 Merge branch 'master' into struct-proto 2021-10-29 16:42:34 -05:00
Calvin Rose
6e38bf1578 Use more inclusive check for the %j formatter for valid symbols. 
We did not allow arbitrary utf8 to be printed with %j, even though the parser
allows. Thos changes uses the existing built in utf8 detectiotion to
exclude only unprintable symbols from the docstring.
 2021-10-29 11:08:53 -05:00
Calvin Rose
06aa0a124d Add math/gcd and math/lcm to the core. 2021-10-24 11:43:07 -05:00
bakpakin
504411eade Update suite 009 to do read and write in parallel. 2021-09-28 12:05:28 -05:00
Calvin Rose
cccbdc164c Add (number combinator to peg). 
This allows using Janet's number parser without creating
intermediate strings.
 2021-09-19 13:02:16 -05:00
bakpakin
40ef224a95 Update test code. 2021-09-11 10:34:08 -05:00
llmII
21b3e4052c
Don't print stuff in tests, CI looks wacky 2021-09-07 17:21:10 -05:00
llmII
077bf5ebae
Create test case for localname/peername 2021-09-07 07:12:43 -05:00
Calvin Rose
a78cbd91da Address #753 - fix gensym regression. 2021-08-06 16:25:53 -05:00
Calvin Rose
bb5c3773f1 Fix fiber aware combinators to use general iteration instead of fiber 
specifics.
 2021-08-06 16:17:47 -05:00
Calvin Rose
2e641a266d
Merge pull request #752 from sogaiu/get-in-tweak 
Tweak get-in behavior
 2021-08-06 15:14:33 -05:00
Zach Smith
34019222c2 Make take/take-while/take-until fiber-aware 2021-08-06 15:40:29 -04:00
sogaiu
547fda6a40 Add tests 2021-08-06 10:05:34 +09:00
Calvin Rose
e76b8da269 Add semantics for closing channels. 
This makes certain algorithms simpler as channels
now have an explicit lifetime - multiple readers can coordinate
closing without needing to ensure the same number of reads as writes.
 2021-07-30 19:26:42 -05:00
Calvin Rose
f11b2c5a0d
Merge pull request #717 from yumaikas/fix-os-open-write-windows 
Fix os open write windows, and add TerminateProcess calls
 2021-07-24 07:52:40 -05:00
Andrew Owen
e8a86013da Add fixes for :write on filestreams that come from os/open 2021-07-24 02:30:00 -06:00
Calvin Rose
230b734663 Delete jpm and related testing from this repository. 
JPM and related functionality has been moved to it's own repository
and will be versioned separately from Janet. The distribution process
could later be modified to bundle a version of jpm with Janet but this
is perhaps not needed.
 2021-07-15 20:49:41 -05:00
Andrew Owen
12cfda1f58 Add TerminateProcess to janet_proc_gc and os_proc_kill on Windows 2021-07-11 04:05:11 -06:00
Andrew Owen
96b4e71704 Add TerminateProcess to janet_proc_gc and os_proc_kill on Windows 2021-07-11 03:56:08 -06:00
Calvin Rose
da5328bae5 Merge branch 'master' of git.sr.ht:~bakpakin/janet 2021-05-31 15:14:39 -05:00
Calvin Rose
bbae43f259 Update copyright dates. 2021-05-31 13:46:02 -05:00
bakpakin
14fedbf063 Update copyright. 2021-05-31 09:53:52 -05:00
Calvin Rose
4d983e54b5 Initial struct prototype code. 
Also add a number of cfunctions for manipulating structs
with prototypes.
 2021-05-29 11:43:18 -05:00
Calvin Rose
1baab5eb61 Remove typed arrays from the core. 
Typed arrays will instead live in an external jpm nodule.
Also, changes have been made to `jpm` to allow other natives to use the
typedarray headers.
 2021-04-29 12:33:49 -05:00
Lue
64ec9f9cb6
Allow .cc file extension in jpm declare-native 2021-03-25 13:19:05 -04:00
Michael Camilleri
ec2d7bf349
Support adding arbitrary metadata to bindings 2021-03-24 09:38:12 +09:00
Calvin Rose
4fcc8075d4 Release 1.15.3 2021-02-28 13:04:24 -06:00
Calvin Rose
96513665d6 Address #641 - add undef combinator. 
The (undef rule :tag) combinator lets a user "scope" tagged captures.
After the rule has matched, all captures with tag :tag can no longer be
refered to by their tag. However, such captures from outside
rule are kept as is. If no tag is given, all tagged captures from rule
are unreferenced. Note that this doesn't `drop` the captures, merely
removes their association with the tag. This means subsequent calls to
`backref` and `backmatch` will no longer "see" these tagged captures.
 2021-02-26 17:25:09 -06:00
Calvin Rose
a5f237993d Don't fail testing when ev disabled. 2021-02-20 10:56:54 -06:00
Calvin Rose
c68264802a Fix #638 - update fiber status in certain cases. 
This fixes a regression from changes to janet_try. In some cases, we
would not update the status of a fiber when signaling, which left the
fiber's status as whatever it had previously. This could lead to strange
control flow issues.
 2021-02-20 10:55:16 -06:00
Calvin Rose
742469a8bc Address #640. 
Allow for a zero length match at the end of a string when using the
to or thru combinators.
 2021-02-19 16:10:03 -06:00
Leah Neukirchen
c16a9d8463 Fix or with zero arguments. 
The value is nil to be consistent for and/or and all/some.
Also add some tests for and/or.
 2021-02-16 19:59:03 +01:00
Calvin Rose
7e2c433abc Fix #636 2021-02-14 14:34:52 -06:00
Calvin Rose
10dcbc639a Immediate instuctions will now call :compare method. 2021-02-08 11:53:25 -06:00
Calvin Rose
dd8de1e9ac
Merge pull request #609 from yumaikas/master 
Change tracev to upscope instead of using let
 2021-01-22 19:02:27 -06:00
Andrew Owen
1fcaffe6b0 Change tracev to upscope, add test 2021-01-21 23:40:28 -07:00
Calvin Rose
49dcc816ae Update os/shell to be non-blocking as well. 2021-01-18 16:44:22 -06:00
Calvin Rose
462e74ef87 Add os/proc-close to close all pipes associated with a subprocess. 
This will not leak handles until the GC runs in most use cases.
 2021-01-16 15:11:07 -06:00
Calvin Rose
a1cc5ca045 Fix #593. 
Also add ev/give-supervisor to the core.
 2021-01-16 07:18:07 -06:00
Calvin Rose
4f2d1cdc00 Go back to a single supervisor channel per fiber. 
We now also use the fiber mask to figure out which flags to wait for.
 2021-01-12 21:35:28 -06:00
Calvin Rose
9078d3bd37 Update CHANGELOG.md 2021-01-11 18:54:50 -06:00
Calvin Rose
5e1a8c86f9 Add more network and subprocess testing with redirection. 2021-01-11 18:32:56 -06:00
Calvin Rose
bf01bf631d More work on windows networking code. 
Remove use of WSARecv and WSASend since for whatever reason
they seem suspect. We may want to revisit this later.
 2021-01-11 18:00:31 -06:00
Calvin Rose
80c5ba32b5 Remove wait from CI testing for networking tests. 
We want to expose any existing race conditions.
 2021-01-11 15:55:12 -06:00
Calvin Rose
f0dbc2e404 Fix subprocess spawning on windows. 
Also fix (:read stream :all)
 2021-01-11 11:10:23 -06:00
Calvin Rose
4df1ac5b23 Fix some issues in os.c to diagnose improve windows subprocess code. 2021-01-11 09:06:39 -06:00
Calvin Rose
11067d7a56 Update module and rem operator for int types. 2021-01-09 14:47:43 -06:00
Calvin Rose
bcba0c0279 Fix #548 - string/split bug. 
Also update docstrings for string/find. The 'skipping'
behavior that was documented only applies to to string/replace-all.
 2021-01-05 18:54:51 -06:00
Calvin Rose
2ca9300bf7 Add sort tests. 2021-01-03 16:45:37 -06:00
Calvin Rose
87badc71d2 Remove :generate verb from loop. 
Instead, one case use `:in` as with otehr data structures.
 2021-01-03 16:38:38 -06:00
Calvin Rose
115556fcf2 Merge branch 'ev_execute' 2021-01-03 11:48:00 -06:00
Calvin Rose
62f783f1dc Merge branch 'master' of github.com:janet-lang/janet 2021-01-03 09:26:31 -06:00
Calvin Rose
9e42ee153c Merge branch 'master' into HEAD 2020-12-30 12:19:13 -06:00
Calvin Rose
2357b6162f Update test-install target. 2020-12-26 15:42:13 -06:00
Calvin Rose
25ded775ad Add array/clear. 
Also improve map, find-index, and find to work on data structures
which do not defined length.
 2020-12-18 12:37:58 -06:00
Michael Camilleri
77b79e9899
Update (parser/where) to support optional line and column 2020-12-15 14:12:33 +09:00
Calvin Rose
eab5f67c5c Fix buffer with NULL data pointer issue. 
Simply prevent buffers from ever having a NULL data pointer.
 2020-12-13 09:33:57 -06:00
Calvin Rose
6020106000 Address #529 2020-12-11 19:21:54 -06:00
Calvin Rose
811a5d93f4 Prevent some potential bad characters in test out. 2020-12-06 17:10:18 -06:00
Calvin Rose
0f16f21677 Make builds deterministic again. 
Also prevent marshal from creating multiple copies of
a function - (marshal function pointer before function def pointer).
 2020-12-06 16:32:23 -06:00
Calvin Rose
cbdea8f331 Make os/execute cooperate with ev module. 
os/execute, os/proc-wait do not block (currently posix only).
This uses the self-pipe trick to turn signals into a pollable entity.
 2020-11-29 15:36:21 -06:00
Calvin Rose
7aa4241662 Add testing for the new reindent behavior. 
This also provides a reference function to reimplement
the behavior in Janet.
 2020-11-28 12:18:36 -06:00
Calvin Rose
776ce586bc Add line and column combinators to peg. 
These capture the line and column number of the current position
in the matched text. This is useful for error reporting as well
as indentation checking.

This works by lazily creating an index on first use that stores all
newline character indices in order. We can then do a binary search on
this to get both line number and column number in log(n) time.
This is good enough for most use cases and doesn't slow down the common case at all
- these will not be commonly used patterns in a hot loop so it is not worth to try and
optimize this at all. Constant time look up should be possible but at
the cost of complicating code and slowing down all matching to check for
new lines.
 2020-11-26 18:32:56 -06:00
Calvin Rose
a3e812b86d Fix #505 - bat int64 parsing. 
Fixes an off-by-1 error.

Also makes windows testing hopefully a bit less flaky.
 2020-11-25 09:45:46 -06:00
Calvin Rose
a3f98091c4 Fix #509 
janet_fiber returns NULL if there is a bad arity, check that before
continuing.
 2020-11-23 15:28:28 -06:00
Calvin Rose
cff52ded58 Add JANET_ASYNC_EVENT_CANCEL 
also fix bug that could cause event loop to hang.
 2020-11-16 18:46:59 -06:00
Calvin Rose
1759151875 Change suite 9 test a bit. 2020-11-15 10:12:10 -06:00
Calvin Rose
cdcb774dc8 Add os/pipe and os/open. 
ev/pipe -> os/pipe, and os/open is a wrapper
around the open system call.
 2020-11-15 09:57:29 -06:00
Calvin Rose
dc51bd09f7 Make sure all test logs go to the same stream. 2020-11-14 15:56:48 -06:00
Calvin Rose
12f09ad2d7 Add ev/pipe and move stream code into ev.c 
Also adds a lot to the C API and changes things up.
 2020-11-14 14:29:11 -06:00
Calvin Rose
d6391f2d70 Get windows IOCP working for accept. 
This also changes the api of servers slightly -
in light of having support for ev tasks, it is probably better
to remove the "simple" server code and replace it with some Janet
or remove it all together. While convenient, it has issues with error
handling and rigidity.
 2020-11-08 18:56:13 -06:00
Calvin Rose
307c7e00e2 Merge branch 'master' into ev 2020-10-03 11:09:21 -05:00
Calvin Rose
45feb55483 Add integer parsing to pegs. 2020-09-27 12:19:00 -05:00
Calvin Rose
0a1d902f46 Fix #477 
Make the walk function preserve bracket type, which should fix
threading macro behavior when threading into bracketed expressions.
 2020-09-26 13:28:29 -05:00
Calvin Rose
959a577b5f Merge branch 'master' into ev 2020-09-26 11:50:13 -05:00
Calvin Rose
d1f0a13ddc janet_try macro and janet_restore function. 
This allows catching panics without using pcall.
 2020-09-19 18:47:47 -05:00
Calvin Rose
babfe50550 Merge branch 'master' into ev 
Also add poll implementation for ev.
 2020-09-07 12:52:50 -05:00
Calvin Rose
1837e89fe4 Address #470 - hyphen's in native module names. 2020-09-06 15:23:24 -05:00
Calvin Rose
25156eb83e For #469 - Add support for C++ and mixed C/C++ 
WIP and for native modules. Required a few changes to headers and
some changes to JPM.
 2020-09-04 17:41:36 -05:00
Calvin Rose
a31e079f93 Fix import macro to not coerce everything to string. 2020-08-27 08:19:41 -05:00
Calvin Rose
17d0b7a985 Improve import's handling of non constant args. 
Be much more conservative about which arguments are cast to strings.
 2020-08-27 07:40:51 -05:00
Calvin Rose
86e00e865e Merge branch 'master' into ev 2020-08-23 11:25:04 -05:00
Calvin Rose
28439d822a Add cancel function. 
This should allow better stack unwinding on a fiber that
no longer needs to complete.
 2020-08-22 15:35:37 -05:00
Calvin Rose
30522bbf7d Merge branch 'master' into ev 2020-08-16 17:52:36 -05:00
Calvin Rose
7e7498350f Fix #463 
Fix outdated code in macex1, such as checking for unquote-splicing,
    which no longer exists. Also fix macex1 for quasiquoted tables and
    structs. macex1 is not the macro expander used by the compiler, so
    these bugs only affected code which called macex manually, such as
    the short-fn macro.
 2020-08-12 06:10:42 -05:00
Calvin Rose
1213990b7d Merge branch 'master' into ev 2020-08-07 19:51:37 -05:00
Calvin Rose
2598123140 Rename test suites such that it is easier to add more of them. 2020-08-07 15:34:13 -05:00
Calvin Rose
d393fbf360 Merge branch 'master' into ev 2020-07-25 14:07:47 -05:00
Calvin Rose
4cc680965c Prepare for 1.11.1 release. 2020-07-25 13:48:43 -05:00
Calvin Rose
ba08e487cb Disable PRF by default. 
Since it is not any better by default without initializing the key, we
disable it by default. It can be turned on with JANET_PRF in
janetconf.h.
 2020-07-25 13:34:40 -05:00
Calvin Rose
553b4d9428 Add timeouts to net functions. 
Further debugging of the general timeout system, as well
as having a single fiber wait on multiple state machines (select).
 2020-07-19 19:41:12 -05:00
Calvin Rose
7478ad115f Add any? predicate to core. 
This is the contrapositive to `every?`, and is analagous to `or` as
`every?` is to `and`.
 2020-07-06 09:19:10 -05:00
Calvin Rose
a45509d28e Add list-pkgs and list-installed to jpm. 2020-07-05 17:43:39 -05:00
Calvin Rose
e548e1f6e0 Add peg/replace and peg/replace-all 2020-07-01 21:29:24 -05:00
Josef Pospíšil
c26f573620 Add tests for peg/find and peg/find-all 2020-06-30 17:03:13 +02:00
Josef Pospíšil
e9911fee4d Add keyword/slice and symbol/slice tests 2020-06-29 09:18:26 +02:00
Calvin Rose
a1ea62a923 Fix optimization of do_get. 
When the target slot (register) is the same as the default
register, do not clobber it.
 2020-06-28 15:52:59 -05:00
Calvin Rose
ac5de1f96e Change compare-primitive to cmp. 
cmp is implemented as a VM instruction rather than
a function.
 2020-06-24 16:00:00 -05:00
Calvin Rose
08a3687eb5 Fix #428 
Add binding check for generate verb in loops. The check is present
in other loop verbs.
 2020-06-21 15:57:55 -05:00
Calvin Rose
5c364e0f7c Better roundtrip jdn. 
Use the most precise format specifier, such that output jdn numbers
are more accurate.
 2020-06-18 21:54:34 -05:00
Calvin Rose
86e12369b6 Add alias for PEG repeat. 
A tuple where the first element is an integer is
a shortand for this.
 2020-06-11 11:23:43 -05:00
Calvin Rose
6d096551f0 Add Peg combinators 'to' and 'thru'. 
Inpsired by the REBOL operators of the same name, these
combinators match bytes up to or inculding a given pattern.
(to patt) is (almost) equalivalent to (any (if-not patt 1)), and
(thru patt) is equivalent to (* (to patt) patt). The one difference
is that if the end of the input is reached and patt is not
matched, the entire pattern does not match.
 2020-06-10 21:18:50 -05:00
Mike Beller
9824a34d76 Remove dead code. 2020-06-06 08:55:20 -04:00
Mike Beller
a4178d4b3c All tests pass for compare. 2020-06-05 10:51:35 -04:00
Mike Beller
3e423722c6 Actually got the comparisons working for s64 (still need to fix u64) 2020-06-04 18:27:48 -04:00
Mike Beller
01837f2bb6 All tests pass. 2020-06-04 15:27:36 -04:00
Mike Beller
411c5da6d3 compare functions now work for built ins and 'objects' 2020-06-04 13:49:09 -04:00
Mike Beller
7658ea8335 primitive tests working. issues remain with polymorphic. 2020-06-04 12:46:58 -04:00
Mike Beller
81d301a42b Initial commit of base functionality for compare 2020-06-04 12:23:54 -04:00
Calvin Rose
677737d345 Fixes #412 Lookahead does not move cursor. 2020-05-21 01:22:08 -05:00
Mike Beller
8263789602 Fix issue #408 -- make "next" work for typed arrays, and also fix 
bug where tarray/new failed to fully check the type of it's last
argument.
 2020-05-20 13:30:48 -04:00
Calvin Rose
617338457d More windows shenanigans with jpm. 
Cannot remove open file, get rid of double rm.
 2020-05-19 20:03:49 -04:00
Calvin Rose
e623690295 Use keywords in the assembly interface. 
This is simply more idiomatic, removes some unused and undocumented
features of the assembly interface, and simplifies it somewhat.
 2020-05-19 13:51:39 -05:00
Calvin Rose
7a84fc4742 Fix infinite loop in some cases. 
Problem - reusing a tainted variable without reinitializing.
 2020-05-16 08:28:50 -05:00
Calvin Rose
1add0c7d43 make test-install should be easier to clean. 2020-05-09 10:30:09 -05:00
Calvin Rose
8b5bcaee3c Add lenprefix combinator to pegs. 
This lets peg match n repeitions of a pattern, where
n is supplied from other parsed input and is not a constant.
 2020-05-02 10:39:35 -05:00
Calvin Rose
d2ebf4b52d Merge branch 'net' 2020-04-26 12:27:37 -05:00
Calvin Rose
da438a93e0 Restore lexicographic comparison of tuples. 2020-04-24 16:51:04 -05:00
Calvin Rose
a87015598c Make janet_equals and janet_compare non recursive 
This makes these operatios use constant stack space rather
than linear stackspace given the size of the inputs. This is important
to prevent certain parser input from causing a stack overflow - in
general, we try to avoid unbounded recursion.
 2020-04-24 16:18:31 -05:00
Calvin Rose
c876e63010 Fix overflow in exponent estimation in strtod.c. 
Found by OSS-Fuzz.
 2020-04-21 18:32:59 -05:00
David Korczynski
676a0afe4c Fixed up very wrong fuzzer to go more for the parser. 2020-04-19 20:36:38 +01:00
David Korczynski
82e052f2ec Updated the libfuzzer to target marshalling. 2020-04-18 22:04:26 +01:00
Calvin Rose
2904c19ed9 Switch to poll from select. 
Simpler and more flexible interface, and also lets
us use epoll more easily on linux, which is the most important
plantform to optimize for network performance.
 2020-04-18 15:22:20 -05:00
Calvin Rose
e202d30835 Use make format. 2020-04-17 13:39:23 -05:00
davkor
4faa129b8e Added a first fuzzer. 2020-04-13 17:33:58 +01:00
Calvin Rose
ea2811f14f Merge branch 'master' of github.com:janet-lang/janet 2020-04-11 13:42:34 -05:00
Calvin Rose
8bc2987a71 (struct ...) with duped keys will use last value. 2020-04-11 13:42:25 -05:00
Calvin Rose
1d13095d19
Merge pull request #340 from pepe/get-vs-in-last 
Fix last for empty collection, add tests
 2020-04-10 19:03:21 -05:00
Calvin Rose
02f17bd4e4 Add sort-by and sorted-by. 2020-04-09 20:43:51 -05:00
Josef Pospíšil
b63a0796fd Fix last for empty collection, add tests 2020-04-09 14:35:57 +02:00
Calvin Rose
e6d4e729fb Keep reference alive so unmarshalled object not collected. 2020-04-06 17:24:52 -05:00
Calvin Rose
b75a22b753 Make JANET_FRAME_SIZE consistent across architectures. 
This means unmarshalling fibers should work across arches.
 2020-04-06 12:41:56 -05:00
Calvin Rose
72beeeeaaa Move funcenv verification to runtime. 
Lazy verification makes it easier to not leave funcenvs
in an invalid state, as well as be more precise with the validation.
We needed to verify the FuncEnvs actually pointed to a stack frame if
they were of the "on-stack" variant. There was some minor checking
before, but it was not enough to prevent func envs from pointing to
memory that was off of the fiber stack, overlapping stack frames, etc.
 2020-04-06 10:58:47 -05:00
Calvin Rose
c3c42ef56f Fix case for #336. 
Also consider ascii 127 (delete) non-printable for string escapes.
 2020-04-06 00:11:22 -05:00
Calvin Rose
a3c55681b2 Address #336 case 6 2020-04-05 21:39:39 -05:00
Calvin Rose
fcc610f539 Address #336 case 4 
Set funcenv fields to NULL before any possible panics.
 2020-04-05 19:18:59 -05:00
Calvin Rose
5bbd507858 Address #336 case 3 
Fix error condition for bad abstract types - don't return NULL, panic.
 2020-04-05 17:38:14 -05:00
Calvin Rose
b145d47863 Address cases 1 and 2 of #336. 
Mainly related to not checking ints < 0.
 2020-04-05 08:01:18 -05:00
Calvin Rose
87ecdb8112 Change \UXXXXXXXX -> \UXXXXXX and check codepoint max. 
No need to add two extra leading zeros, as the max unicode
codepoint is 0x10FFFF.
 2020-04-05 07:09:53 -05:00
Calvin Rose
ae70a03383 Address #306 - Add unicode escapes. 
Unicode escapes have the same syntax as go - \uXXXX or \UXXXXXXXX.
 2020-04-04 21:46:08 -05:00
Calvin Rose
a0d61e45d5 Change os/perm-str to os/perm-string. 2020-04-03 15:23:29 -05:00
Calvin Rose
ff163a5ae4 Use modulo instead of remainder for even?/odd?. 
Works better for negative and fractional numbers.
 2020-03-28 10:23:28 -05:00
Calvin Rose
65379741f7 Address edge case of reduce2 when ind is empty. 
Same for accumulate 2.
 2020-03-27 12:45:40 -05:00
Calvin Rose
3eb0927a2b Add accumulate(2) and reduce2 
These functions are variations on reduce and can be quite useful.
Improve error message for jpm as well.
 2020-03-26 21:35:11 -05:00
Leah Neukirchen
3ee43c3abb add os/mktime, an inverse to os/date. 2020-03-18 23:45:02 +01:00