bf3fdfd8d3
Add fix-derivation
...
To the load data module, since this is where most of the useful code is.
2025-03-11 17:15:00 +00:00
35281c8a49
Extract out derivations-insert-sources
...
As there are derivations missing sources, and this code will be useful to try
and fix things.
2025-03-11 17:15:00 +00:00
001805a2c9
Avoid a vector->list
...
As the knots fibers utils accept vectors.
2025-03-11 17:15:00 +00:00
f56cae63fc
Fix the --repl option
2025-03-10 08:27:42 +00:00
8635a5561b
Add mechanism to fix derivation inputs
...
Some derivations are missing inputs, I don't know why, but this should allow
for manually fixing the affected derivations.
2025-03-10 08:20:43 +00:00
61d49cedb3
Remove compatability with old guix derivation-inputs
2025-03-10 06:30:43 +00:00
59f1a04f4e
Use vector-fold rather than map to construct input-derivations
...
This avoids append-map and vector->list so might be faster and use less
memory.
2025-03-10 06:30:43 +00:00
edeb89e0cf
Revert "Optimise inserting derivation inputs"
...
I'm concerned that this approach is more error prone and won't error if there
are issues with the data in the database.
This reverts commit 3081887b90
2025-03-10 06:30:43 +00:00
5684add77e
Improve package deduplication
...
Handle cases where there are up to 4 packages with the same name and version
plus some having replacements. This is currently the case with glibc.
2025-02-25 11:23:23 +00:00
e591346684
Use with-exception-handler in place of with-throw-handler
2025-02-25 10:38:10 +00:00
1da2a09cfb
Update the package derivations table in a transaction
2025-02-20 09:58:31 +00:00
53700c9188
Change url in test
...
To avoid a conflict when running tests in parallel.
2025-02-20 09:58:07 +00:00
c3e42e93a5
Make knots update changes
2025-02-11 10:31:21 +00:00
522c7cd9a2
Remove unmaintainable tests
...
This needs rethinking, it's not feasible to maintain tests if you have to
struggle to get backtraces when they fail and they rely on fragile and broken
mocking.
2025-02-11 10:29:45 +00:00
37b7c568ed
Make the job timeout configurable
2025-02-10 11:05:07 +00:00
131967dc39
Tweak streaming json
...
Don't set the encoding, this should be handled by knots, and drop the block
size as the previous value seemed excessive.
2025-02-06 17:15:33 +00:00
9e3cfabe77
Fix some nulls
2025-02-06 17:14:47 +00:00
258ee0468b
Update use of resource pools
2025-02-06 17:14:47 +00:00
9bf4eea2fd
Name the temporary threads
2025-02-04 10:45:52 +00:00
6deeccc22f
Remove some knots workarounds
2025-02-03 22:59:34 +00:00
3646de6097
Update exception handling in load-new-guix-revision
2025-02-03 22:59:34 +00:00
931b7bc593
Add a slightly crude method to ignore systems and targets
...
While processing a revision. It would be good to also record what systems and
targets are in the platforms so it's clear what data is missing, but that can
be added later.
2025-02-03 22:59:34 +00:00
acdedb075d
Ensure COLUMNS is set
2025-02-03 13:06:45 +01:00
f9e6daad99
Use the default knots web server exception handler
2025-02-03 12:18:54 +01:00
49f9aa4822
Force add resources parallelism to 1 for some resource pools
...
This'll be the default in coming revisions of knots, and is neccessary for
pools being used to share a single object.
2025-02-02 01:23:49 +01:00
8bce47dc69
Remove use of call-with-utility-thread
...
As I think it's no longer necessary, and the PostgreSQL connection is being
handled here incorrectly.
2025-01-31 13:01:37 +01:00
5cca88ca2a
Work around the resource pool needing a destructor
2025-01-31 08:56:04 +01:00
8f3968af1e
Configure the knots web server connection buffer size
...
Rather than changing the buffer size when processing each request.
2025-01-29 18:34:20 +01:00
98c4fae76f
Move the exception handling to the knots web server
...
Rather than adding another layer. This commit also removes the extra fibers
layer when processing requests. I forget exactly why this was added, but if
the reason resurfaces then it should be addressed in knots.
2025-01-29 18:34:20 +01:00
7dd6be1c3b
Update Knots
2025-01-29 18:34:20 +01:00
83f2981c64
Fix branch package version page if no data is found
2025-01-27 12:25:11 +00:00
9a1c1b30cb
Fix matching NULL
2025-01-27 12:25:04 +00:00
ad30746fab
Fix null handling in result-serializer-simple-list-with-null-handling
2025-01-26 10:10:50 +00:00
25bf45fe77
Handle NULL values for included_branches
2025-01-17 12:23:46 +00:00
c886685e92
Update Guile Knots
2025-01-14 13:49:28 +00:00
d6cfd780e8
Log resource pool stats on errors
2025-01-06 19:31:54 +00:00
52a307612f
Fix log message
2025-01-06 18:53:19 +00:00
d3c87fb1dc
Attempt to reduce memory churn when processing package metadata
2024-12-29 12:23:56 +00:00
cdffef2397
Report on the GC when processing revisions
2024-12-29 12:22:38 +00:00
50127de12a
Parallelise inserting derivation counts
2024-12-29 12:22:38 +00:00
6ce51e8880
Remove random x
2024-12-29 12:22:38 +00:00
ed5419866f
Avoid null characters in package descriptions
2024-12-29 12:12:28 +00:00
93eac06fd6
Update Guile Knots
2024-12-29 11:05:07 +00:00
62d6b59013
Make build_servers.id just generated by default
...
As to make it easier to set explicitly.
2024-12-15 20:54:11 +00:00
73b53f46a3
Add utility functions for configuring the database
2024-12-15 20:17:10 +00:00
8b49884816
Use knots
...
A library of extracted Guile Fibers patterns and utilities.
2024-12-15 20:17:10 +00:00
a33e32275e
Add a comment
2024-12-09 10:53:06 +00:00
d7c7f74ff1
Log differently when using the load-new-guix-revision-inserts lock
2024-12-09 10:53:06 +00:00
859b0093f8
Avoid getting the load-new-guix-revision-inserts lock twice
2024-12-09 10:53:06 +00:00
62fc9b7225
Fix hash display for formatted derivations
2024-12-09 10:53:06 +00:00
