Commit graph

1560 commits

Author SHA1 Message Date
36f30551cb Update .dir-locals.el 2025-05-25 13:08:27 +01:00
d8ae6062b1 Retry computing channel instance manifests
On readlink errors.
2025-05-25 13:08:27 +01:00
961441cab0 Reliably perform the background processing for build events
Insert the build ids to a table and remove the ids once processed. If the data
service is restarted and the in memory queue is lost, process all the items
from the database queue.
2025-05-25 13:08:27 +01:00
04f427bcab Update the Makefile for the README name change 2025-05-25 13:08:27 +01:00
6c56b8354f Set Git timeouts
In an attempt to avoid Git operations hanging.
2025-05-25 13:08:27 +01:00
Zheng Junjie
79099bd34e
Update repo url. 2025-05-13 17:33:33 +08:00
14437d295e Rename the README
So it shows up better on Codeberg.
2025-05-09 12:22:57 +01:00
ca80a051ff Guard against too many pool waiters
As I think this is happening when there are an excessive number of requests,
and that in turn causes issues with file descriptor limits.
2025-04-27 11:40:44 +01:00
cde34344f8 Update knots 2025-04-27 11:19:45 +01:00
36d34e03fc Encode unicode in JSON responses
To guard against package definitions and other things including unicode or
other characters.
2025-04-27 11:11:31 +01:00
d00b539483 Increase the open file limit 2025-04-24 09:36:54 +01:00
2430bc4307 Guard against nested transactions
Not sure how to do this in PostgreSQL, so use a parameter.
2025-04-19 15:52:44 +01:00
982121c308 Remove some commented out code 2025-04-19 13:18:15 +01:00
ce01df5211 Tweak some post extract-information-from actions
Move update-package-derivations-table further on since it locks a table, and
use let for the guix-revision-id.
2025-04-19 13:05:16 +01:00
1c0b216067 Revert "Update the package derivations table in a transaction"
This is already in a transaction.

This reverts commit 1da2a09cfb.
2025-04-19 12:52:00 +01:00
818bd54cc6 Remove argument in incorrect position 2025-04-19 09:26:02 +01:00
d4cd94f185 Workaround fibers getting stuck handling exceptions 2025-04-18 13:20:20 +01:00
fd2a3ad6c1 Clear the derivation-ids-hash-table when holding the db connection 2025-04-18 11:01:44 +01:00
273a2127ed Improve logging for error when computing derivation 2025-04-18 11:01:20 +01:00
af377a96b2 Fix copy/paste error in retry-on-missing-derivation-output 2025-04-18 11:01:04 +01:00
f5614dd75d Remove redundant branch from retry-on-missing-store-item
I think #:unwind-for-type prevents this condition.
2025-04-18 11:00:35 +01:00
97a01853b8 Unwind the stack when handling transaction errors
As this avoids trying to suspend while the stack is in a unpredictable state.
2025-04-01 22:56:34 +03:00
14de1667b1 Update exception handling for build events 2025-04-01 22:43:15 +03:00
d60a8a44cb Make update-derivation-ids-hash-table! more flexible
To work with both derivations and names.
2025-03-25 10:22:00 +00:00
3150f50672 Revert hardcoding the channel systems 2025-03-24 09:31:19 +00:00
1f9626d058 Just log duplicates once, to avoid the duplicate logging 2025-03-19 14:36:01 +00:00
de476a8b40 Reapply "Optimise inserting derivation inputs"
Reverting this change entirely was too slow, so change the joins in the query
from inner joins to left joins, as this should mean that NULL values get
inserted if there are missing derivations or derivation outputs, which should
cause an error rather than silently skipping inserting the derivation inputs.

This reverts commit edeb89e0cf.
2025-03-19 14:36:01 +00:00
f456f73ba4 Fix null? when used with a vector 2025-03-18 16:06:23 +00:00
7fe042498f Tweak using vectors in insert-derivation-outputs 2025-03-17 14:59:42 +00:00
b904fdb161 Try to address the issue of missing derivation outputs 2025-03-17 10:26:21 +00:00
1181b13ffe Add a procedure to fix derivation source files
I don't know how, but there are a couple in the data.guix.gnu.org database
that are placeholders.
2025-03-11 19:47:14 +00:00
167b7d029e Extract out code for updating derivation source file nars
So that this can be used to fix some which have crept in to the database as
placeholders.
2025-03-11 19:38:56 +00:00
1ac9f8072e Avoid URL conflicts in tests 2025-03-11 17:15:00 +00:00
241d49136f Get set-thread-name from knots 2025-03-11 17:15:00 +00:00
73e1c0318b Stop using the knots web-server exception handler
As I want to remove this.
2025-03-11 17:15:00 +00:00
c602c6b533 Remove call-with-sigint
This comes from guile-knots now.
2025-03-11 17:15:00 +00:00
9fa059af61 Use chunk-for-each!
As this might use less memory than chunk!
2025-03-11 17:15:00 +00:00
2eb5714829 Use = when comparing numbers 2025-03-11 17:15:00 +00:00
8c79536fa4 Improve the chunking procedures
Remove the empty chunk and use = for numeric equality.
2025-03-11 17:15:00 +00:00
bf3fdfd8d3 Add fix-derivation
To the load data module, since this is where most of the useful code is.
2025-03-11 17:15:00 +00:00
35281c8a49 Extract out derivations-insert-sources
As there are derivations missing sources, and this code will be useful to try
and fix things.
2025-03-11 17:15:00 +00:00
001805a2c9 Avoid a vector->list
As the knots fibers utils accept vectors.
2025-03-11 17:15:00 +00:00
f56cae63fc Fix the --repl option 2025-03-10 08:27:42 +00:00
8635a5561b Add mechanism to fix derivation inputs
Some derivations are missing inputs, I don't know why, but this should allow
for manually fixing the affected derivations.
2025-03-10 08:20:43 +00:00
61d49cedb3 Remove compatability with old guix derivation-inputs 2025-03-10 06:30:43 +00:00
59f1a04f4e Use vector-fold rather than map to construct input-derivations
This avoids append-map and vector->list so might be faster and use less
memory.
2025-03-10 06:30:43 +00:00
edeb89e0cf Revert "Optimise inserting derivation inputs"
I'm concerned that this approach is more error prone and won't error if there
are issues with the data in the database.

This reverts commit 3081887b90.
2025-03-10 06:30:43 +00:00
5684add77e Improve package deduplication
Handle cases where there are up to 4 packages with the same name and version
plus some having replacements. This is currently the case with glibc.
2025-02-25 11:23:23 +00:00
e591346684 Use with-exception-handler in place of with-throw-handler 2025-02-25 10:38:10 +00:00
1da2a09cfb Update the package derivations table in a transaction 2025-02-20 09:58:31 +00:00