Commit graph

9 commits

Author SHA1 Message Date
42d885c553 Try to better handle exceptions in the web server 2025-01-23 09:34:54 +01:00
d572f591a3 Rename worker threads to thread pool
I think this needs more work, maybe the thread pool should be more
similar to the resource pool, but I think the name change is still
helpful.

Maybe there's a need for a variable size thread pool and that can
better integrate with the work queue.
2025-01-14 10:05:06 +00:00
dcb56ee2c5 Tweak the resource pool
Mostly to no longer sleep in the main fiber. Now the main fiber just
spawns other fibers when it would previously block on put-operation
and these other fibers communicate back to the main resource pool
fiber when necessary.

This should mean that the resource pool is more responsive.
2025-01-09 09:34:11 +00:00
97a3116b81 Support getting the pool from the timeout error 2025-01-06 19:06:28 +00:00
7e55db0de7 Consistently use non-blocking 2024-12-29 10:45:31 +00:00
4e564b4814 Allow nesting worker thread calls
Incorporating changes from the nar-herder.
2024-12-28 10:44:12 +00:00
4e791aff68 Fix a bug in fibers-batch-map (and related procedures)
And add more tests.
2024-12-27 22:14:51 +00:00
dc2fe732ea Make the parallel operations more continuous
Instead of batching the list items, change the batch size to a
parallelism limit and run up to that many fibers. When the processing
of one list item finishes, another will then start immediately after,
rather than when the whole batch is finished.

These changes also make the fibers-map and fibers-for-each operations
work with vectors as well as lists.
2024-12-22 12:24:49 +00:00
2f39c58d6c Initial commit 2024-12-16 09:18:12 +00:00