Commit graph

1644 commits

Author SHA1 Message Date
2e91f31559 Replace documentation on dumps with some example configuration
Since the machine running data.qa.guix.gnu.org doesn't currently have the disk
space to generate dumps.
2025-07-11 10:54:58 +01:00
2b6bdcac08 Fix eq? in recording failures 2025-07-10 23:48:52 +01:00
0e11540fe3 Fix exception message 2025-07-10 23:48:46 +01:00
a3d0e72e48 Fix issue with handling failure to build system channel instance
That resulted in empty revisions. Raise an exception rather than returning #f.
2025-07-10 18:06:30 +01:00
683b375d56 Tweak inserting sources
To try and make it faster.
2025-07-10 09:49:35 +01:00
a4480ac357 Change fixed-size-thread-pool to a thread-pool
To avoid the queueing fiber.
2025-07-10 09:49:35 +01:00
3f837481fd Use fibers-batch-map
As the parallelism should probably be customised.
2025-07-10 09:49:35 +01:00
8dcc89df50 Avoid choice-operation for the gc watcher
In case this causes a memory leak.
2025-07-10 09:49:35 +01:00
42ac51212f Use bulk-insert for inserting derivation_sources 2025-07-10 09:49:35 +01:00
2fc20fa37e Tweak and export bulk-insert 2025-07-10 09:49:35 +01:00
2073e446b7 Tweak the job script
Don't use with-fluids (I forget why), and enable core dumps.
2025-07-09 12:50:24 +01:00
90ecbdea70 Update Guile Knots 2025-07-09 12:50:07 +01:00
1728494363 Try to better chunk derivations for insertion 2025-07-08 20:41:16 +01:00
734ee541be Update Guile Knots 2025-07-08 20:41:16 +01:00
f279aa0071 Destroy the utility thread pool 2025-07-08 20:41:04 +01:00
401f916517 Tweak gc logging 2025-07-08 10:25:43 +01:00
8eb5c047b9 Avoid raising an unhandled exception 2025-07-08 07:24:32 +01:00
4d04a7f47b Stop sharing the derivation-ids-hash-table
Since the derivations are independent between systems, and this is just a
cache of the database ids.
2025-07-08 07:24:32 +01:00
0184f10942 Limit the parallelism when running derivation-file-names->derivation-ids
To focus on finishing some systems before starting the next.
2025-07-06 15:01:03 +01:00
02947cc9c4 Replace more instances of system->system-id with lookup-system-id
To avoid systems being inserted from queries.
2025-07-04 14:16:03 +01:00
98e1b6b3c7 Pass systems and targets to find-broken-derivations-in-revision 2025-07-04 13:39:32 +01:00
5701c5ca55 Raise an exception on missing level counts 2025-07-04 13:15:03 +01:00
7e910be46e Allow specifying the systems and targets for compute and fix 2025-07-04 12:49:12 +01:00
28d762b568 Re-indent fibers-let bits 2025-07-04 10:38:37 +01:00
a5e9e2f6a5 Stream the /compare.json response
Since this could be quite large.
2025-07-04 10:36:26 +01:00
62cf3ff7cb Add list->json-array 2025-07-04 10:29:59 +01:00
df79bc198e Include the full URI when logging slow responses 2025-07-01 19:10:21 +01:00
c6366605a5 Allow starting multiple database connections at once 2025-07-01 19:03:14 +01:00
8640958af7 Retry processing background queue jobs on exception 2025-07-01 13:33:22 +01:00
f1e444babe Process queued build events in parallel 2025-07-01 13:07:44 +01:00
61780fe7ea Warn about long running requests 2025-07-01 12:55:56 +01:00
2bb5f4ccc4 Update Guile Knots 2025-07-01 12:55:50 +01:00
6b100c6904 Increase the number of background connections 2025-07-01 11:55:13 +01:00
d452c56bf2 Try to speed up a couple of endpoints by streaming JSON 2025-06-30 19:23:42 +02:00
5a6d8d7261 Update Guile Knots 2025-06-30 19:23:20 +02:00
4210699949 Don't use the after-gc-hook for monitoring garbage collection
This seems to be happening not in the thread I expect, so avoid using the
hook.
2025-06-29 23:22:31 +02:00
90cec0d8ac Add more debugging inputs 2025-06-29 21:30:29 +02:00
fc6f78ca9a Move the gc watcher to start earlier
This means it doesn't use the fibers sleep, don't know if this makes a
difference.
2025-06-29 21:30:29 +02:00
ae6d7621d1 Try even more things to address fetching narinfo slowness 2025-06-29 16:50:30 +02:00
610cbc2a53 Set %file-port-name-canonicalization to none
To reduce system calls.
2025-06-29 10:31:10 +02:00
2ef31ef35b Fetch narinfos in bulk less frequently 2025-06-29 10:31:01 +02:00
f2d7369359 Try to reduce memory usage for querying narinfos 2025-06-29 09:46:17 +02:00
26d2b6377b Add the gc watcher from the build coordinator 2025-06-29 09:19:30 +02:00
d2b3e75198 Tweak the connection buffer size 2025-06-29 08:37:50 +02:00
cdf034cd9f Enable core dumps 2025-06-29 08:12:41 +02:00
aa3d98324d Try dropping the parallelism to 1 2025-06-29 08:03:51 +02:00
31f226cd46 Remove the priority scheudler
As I'm not sure it's helping.
2025-06-28 21:46:10 +02:00
8a08c725b3 Set default max waiters for the web resource pool 2025-06-28 21:45:14 +02:00
00a5a0a404 Don't timeout when trying to get stats for resource pools 2025-06-28 19:42:31 +02:00
53437cff14 Fix argument 2025-06-28 18:55:08 +02:00