aboutsummaryrefslogtreecommitdiff
path: root/core/testing
Commit message (Collapse)AuthorAgeFilesLines
* Fix ad hoc `printf` in test runner signal handlerFeoramund2024-06-021-1/+1
|
* Use `Warning` log level for reporting memory leaksFeoramund2024-06-021-2/+4
| | | | Works well with `-define:ODIN_TEST_LOG_LEVEL=warning`.
* Prevent test runner deadlock on NetBSDFeoramund2024-06-021-0/+13
| | | | Add `pthread_testcancel` to `core:sys/unix`
* Be pedantic about not overwriting Odin errorsFeoramund2024-06-021-4/+5
| | | | | | | | | | | | | | | | | | | I was encountering bounds-check error messages being overwritten during a test, if the test failed for another reason and sent a log message. The original intent of having this check inside of the above `if` block was that if a test sent an error message, then it was assumed an overwrite would be safe, but it's completely possible for a test to fail for a legitimate reason, then do an unrelated bounds check somewhere else that would be buried under the animation. This change will make sure that, no matter what, the progress display will not trigger a clear if a signal was raised. There's still no guarantee that bounds-check messages will be printed properly, and it's best to redirect STDERR. The only way that can be fixed is if they get a similar hook to `context.assertion_failure_proc`.
* Tell user about `ODIN_TEST_RANDOM_SEED` optionFeoramund2024-06-021-1/+5
|
* Keep test runner main thread from using 100% of a CPU coreFeoramund2024-06-021-0/+17
|
* Add `-define:ODIN_TEST_LOG_LEVEL` to set lowest log levelFeoramund2024-06-021-2/+17
|
* Log thread count at test run startFeoramund2024-06-021-0/+10
| | | | | Provides a helpful info message about the option to change how many threads are used per run.
* Make it easier to learn about `ODIN_TEST_CLIPBOARD`Feoramund2024-06-021-0/+1
|
* Add note about `SIGSEGV` edge case on UNIX-likesFeoramund2024-06-021-0/+7
|
* Remove Windows test runner in favor of `libc` implementationFeoramund2024-06-023-251/+1
|
* Expand documentation comment for `ODIN_TEST_NAMES`Feoramund2024-06-021-0/+3
|
* Use more concise way of satisfying `-vet`Feoramund2024-06-021-9/+4
|
* Be specific about platforms not implementing test runner signal handlerFeoramund2024-06-021-1/+1
|
* Catch `SIGILL`, `SIGFPE`, `SIGSEGV` in the test runnerFeoramund2024-06-024-11/+223
|
* Rename `signal_handler.odin` to `signal_handler_libc.odin`Feoramund2024-06-021-0/+0
|
* Remove unneeded importFeoramund2024-06-021-1/+0
|
* Support deterministic random seeding of testsFeoramund2024-06-022-0/+24
| | | | | | | | Add a new option `ODIN_TEST_RANDOM_SEED` which is picked from the cycle counter at startup, if it's not specified by the user. This number is sent to every test in the `T` struct and reset every test (just in case).
* Support `ODIN_TEST_PROGRESS_WIDTH=0`Feoramund2024-06-021-7/+20
| | | | | | | This will automatically calculate how wide the progress bars should be based on the package with the greatest number of tests. The progress width is now capped to 100.
* Report test memory usage only if there's an issueFeoramund2024-06-021-11/+27
| | | | | Adds new option `ODIN_TEST_ALWAYS_REPORT_MEMORY`, for when you always want to see the memory usage report.
* Track memory in the test runner by defaultFeoramund2024-06-021-1/+1
|
* Change test runner options to `SCREAMING_SNAKE_CASE`Feoramund2024-06-021-11/+11
| | | | | This commit also changes the name of `test_select` to `ODIN_TEST_NAMES`, to better conform with the already-existing `-test-name:<name>` option.
* Send terminal control code to `STDOUT` insteadFeoramund2024-06-021-1/+1
| | | | | `STDERR` might be redirected, and this code signals to the terminal to show the cursor again. Otherwise, the cursor will be invisible.
* Fix ANSI redraw eating last log lineFeoramund2024-06-022-2/+12
|
* Remove `safe_heap_allocator` from test runnerFeoramund2024-06-021-9/+3
| | | | | I was under the impression that the default `context.allocator` was not thread-safe, but I've been told that this is not the case.
* Use plain sort for `internal_tests`Feoramund2024-06-021-1/+1
|
* Temporarily disable Windows-specific test runnerFeoramund2024-06-021-0/+7
| | | | | | I do not have a Windows machine to test the refactored test runner, and I am unsure if it would even run correctly on Windows without this disabled.
* Remove unneeded codeFeoramund2024-06-021-6/+0
|
* Refactor the test runnerFeoramund2024-06-027-64/+1134
| | | | | | | | | | | | | | | | | | | | | | | | | | | | Changes - Support multi-threaded testing. - Support `set_fail_timeout` on all platforms. - Display an animated progress report. - Setup all tests with a context logger. - Give all tests their own separate custom allocators. - Support tracking test memory usage. - Display a summary of the failed tests at the end. - Let users select only specific tests to run. - Support copying failed tests to the clipboard to run again. - Support catching SIGINT (CTRL-C) to cancel early. - Record context in cleanup procs. - Write all log messages to STDERR for easy redirection. - Possibly more I've forgotten. New Options - `-define:test_threads=N`: Specify thread count. - `-define:test_thread_memory=B`: Specify initial memory block size in bytes to each thread. - `-define:test_track_memory=true`: Track the memory usage of individual tests. - `-define:test_fancy=false`: Disable animated progress report. - `-define:test_select=package.test_name,...`: Run only select tests. - `-define:test_clipboard=true`: Copy names of failed tests to the clipboard. - `-define:test_progress_width=24`: Change the width of the animated progress bars.
* Merge pull request #3138 from FourteenBrush/mastergingerBill2024-01-291-2/+9
|\ | | | | Add a testing.expectf proc as a way to avoid a tprintf call.
| * Fix typoFourteenBrush2024-01-251-1/+1
| |
| * Need to unpack argsFourteenBrush2024-01-251-1/+1
| |
| * Forgot to include loc paramFourteenBrush2024-01-251-2/+1
| |
| * Merge branch 'master' of https://github.com/FourteenBrush/OdinFourteenBrush2024-01-251-2/+2
| |\
| * | Add testing.expectfFourteenBrush2024-01-251-0/+8
| | |
* | | Replace `core:*` to `base:*` where appropriategingerBill2024-01-282-3/+3
| |/ |/|
* | stdcall -> systemgingerBill2024-01-171-2/+2
|/
* fix: make -vet not complainramn2023-07-091-0/+2
|
* Fix #2637ramn2023-07-081-2/+3
| | | | where testing.expect_value can't compare nils
* Use positional and named arguments within the core librarygingerBill2023-06-212-6/+6
|
* [core:testing] add global_fail_timeout_thread nil checkTotoki Kei2022-06-041-1/+1
| | | Fixed an issue where test would always fail unless set_fail_timeout was called.
* Update core to use new atomic intrinsicsgingerBill2022-03-311-2/+2
|
* Enforce `-strict-style` in CIgingerBill2022-01-311-1/+1
|
* Make many `package time` procedures use `"contextless"` calling conventiongingerBill2021-10-111-3/+0
|
* Move assert to implementation filegingerBill2021-10-112-1/+2
|
* Add `testing.expect_value`; Improve `testing.set_fail_timeout`gingerBill2021-10-112-19/+54
|
* Keep -vet happygingerBill2021-10-111-1/+0
|
* Add `testing.set_fail_timeout`gingerBill2021-10-113-8/+51
|
* Make the io/conv.odin utilities be `#optional_ok`gingerBill2021-09-291-1/+1
|
* testing: Strip ; from test runner.Jeroen van Rijn2021-09-073-114/+114
|