ce01df5211
Tweak some post extract-information-from actions
...
Move update-package-derivations-table further on since it locks a table, and
use let for the guix-revision-id.
2025-04-19 13:05:16 +01:00
1c0b216067
Revert "Update the package derivations table in a transaction"
...
This is already in a transaction.
This reverts commit 1da2a09cfb
2025-04-19 12:52:00 +01:00
818bd54cc6
Remove argument in incorrect position
2025-04-19 09:26:02 +01:00
d4cd94f185
Workaround fibers getting stuck handling exceptions
2025-04-18 13:20:20 +01:00
fd2a3ad6c1
Clear the derivation-ids-hash-table when holding the db connection
2025-04-18 11:01:44 +01:00
273a2127ed
Improve logging for error when computing derivation
2025-04-18 11:01:20 +01:00
af377a96b2
Fix copy/paste error in retry-on-missing-derivation-output
2025-04-18 11:01:04 +01:00
f5614dd75d
Remove redundant branch from retry-on-missing-store-item
...
I think #:unwind-for-type prevents this condition.
2025-04-18 11:00:35 +01:00
97a01853b8
Unwind the stack when handling transaction errors
...
As this avoids trying to suspend while the stack is in a unpredictable state.
2025-04-01 22:56:34 +03:00
14de1667b1
Update exception handling for build events
2025-04-01 22:43:15 +03:00
d60a8a44cb
Make update-derivation-ids-hash-table! more flexible
...
To work with both derivations and names.
2025-03-25 10:22:00 +00:00
3150f50672
Revert hardcoding the channel systems
2025-03-24 09:31:19 +00:00
1f9626d058
Just log duplicates once, to avoid the duplicate logging
2025-03-19 14:36:01 +00:00
de476a8b40
Reapply "Optimise inserting derivation inputs"
...
Reverting this change entirely was too slow, so change the joins in the query
from inner joins to left joins, as this should mean that NULL values get
inserted if there are missing derivations or derivation outputs, which should
cause an error rather than silently skipping inserting the derivation inputs.
This reverts commit edeb89e0cf
2025-03-19 14:36:01 +00:00
f456f73ba4
Fix null? when used with a vector
2025-03-18 16:06:23 +00:00
7fe042498f
Tweak using vectors in insert-derivation-outputs
2025-03-17 14:59:42 +00:00
b904fdb161
Try to address the issue of missing derivation outputs
2025-03-17 10:26:21 +00:00
1181b13ffe
Add a procedure to fix derivation source files
...
I don't know how, but there are a couple in the data.guix.gnu.org database
that are placeholders.
2025-03-11 19:47:14 +00:00
167b7d029e
Extract out code for updating derivation source file nars
...
So that this can be used to fix some which have crept in to the database as
placeholders.
2025-03-11 19:38:56 +00:00
1ac9f8072e
Avoid URL conflicts in tests
2025-03-11 17:15:00 +00:00
241d49136f
Get set-thread-name from knots
2025-03-11 17:15:00 +00:00
73e1c0318b
Stop using the knots web-server exception handler
...
As I want to remove this.
2025-03-11 17:15:00 +00:00
c602c6b533
Remove call-with-sigint
...
This comes from guile-knots now.
2025-03-11 17:15:00 +00:00
9fa059af61
Use chunk-for-each!
...
As this might use less memory than chunk!
2025-03-11 17:15:00 +00:00
2eb5714829
Use = when comparing numbers
2025-03-11 17:15:00 +00:00
8c79536fa4
Improve the chunking procedures
...
Remove the empty chunk and use = for numeric equality.
2025-03-11 17:15:00 +00:00
bf3fdfd8d3
Add fix-derivation
...
To the load data module, since this is where most of the useful code is.
2025-03-11 17:15:00 +00:00
35281c8a49
Extract out derivations-insert-sources
...
As there are derivations missing sources, and this code will be useful to try
and fix things.
2025-03-11 17:15:00 +00:00
001805a2c9
Avoid a vector->list
...
As the knots fibers utils accept vectors.
2025-03-11 17:15:00 +00:00
f56cae63fc
Fix the --repl option
2025-03-10 08:27:42 +00:00
8635a5561b
Add mechanism to fix derivation inputs
...
Some derivations are missing inputs, I don't know why, but this should allow
for manually fixing the affected derivations.
2025-03-10 08:20:43 +00:00
61d49cedb3
Remove compatability with old guix derivation-inputs
2025-03-10 06:30:43 +00:00
59f1a04f4e
Use vector-fold rather than map to construct input-derivations
...
This avoids append-map and vector->list so might be faster and use less
memory.
2025-03-10 06:30:43 +00:00
edeb89e0cf
Revert "Optimise inserting derivation inputs"
...
I'm concerned that this approach is more error prone and won't error if there
are issues with the data in the database.
This reverts commit 3081887b90
2025-03-10 06:30:43 +00:00
5684add77e
Improve package deduplication
...
Handle cases where there are up to 4 packages with the same name and version
plus some having replacements. This is currently the case with glibc.
2025-02-25 11:23:23 +00:00
e591346684
Use with-exception-handler in place of with-throw-handler
2025-02-25 10:38:10 +00:00
1da2a09cfb
Update the package derivations table in a transaction
2025-02-20 09:58:31 +00:00
53700c9188
Change url in test
...
To avoid a conflict when running tests in parallel.
2025-02-20 09:58:07 +00:00
c3e42e93a5
Make knots update changes
2025-02-11 10:31:21 +00:00
522c7cd9a2
Remove unmaintainable tests
...
This needs rethinking, it's not feasible to maintain tests if you have to
struggle to get backtraces when they fail and they rely on fragile and broken
mocking.
2025-02-11 10:29:45 +00:00
37b7c568ed
Make the job timeout configurable
2025-02-10 11:05:07 +00:00
131967dc39
Tweak streaming json
...
Don't set the encoding, this should be handled by knots, and drop the block
size as the previous value seemed excessive.
2025-02-06 17:15:33 +00:00
9e3cfabe77
Fix some nulls
2025-02-06 17:14:47 +00:00
258ee0468b
Update use of resource pools
2025-02-06 17:14:47 +00:00
9bf4eea2fd
Name the temporary threads
2025-02-04 10:45:52 +00:00
6deeccc22f
Remove some knots workarounds
2025-02-03 22:59:34 +00:00
3646de6097
Update exception handling in load-new-guix-revision
2025-02-03 22:59:34 +00:00
931b7bc593
Add a slightly crude method to ignore systems and targets
...
While processing a revision. It would be good to also record what systems and
targets are in the platforms so it's clear what data is missing, but that can
be added later.
2025-02-03 22:59:34 +00:00
acdedb075d
Ensure COLUMNS is set
2025-02-03 13:06:45 +01:00
f9e6daad99
Use the default knots web server exception handler
2025-02-03 12:18:54 +01:00
