Commit graph

606 commits

Author SHA1 Message Date
0ef3349ed8 Use a more long lived store connection for loading data
As this will enable registering temporary roots, to avoid store items being
garbage collected.
2020-02-13 23:11:36 +00:00
32052c45b3 Remove the target query parameter from some links
As the system is no longer a valid value.
2020-02-12 09:00:21 +00:00
1c34e07e84 Query for builds for channel instance derivations 2020-02-12 08:38:05 +00:00
5cf186e5b1 Add a page for channel instance derivations 2020-02-12 08:37:57 +00:00
7306df0a0f Add a function to select channel instances for a revision 2020-02-12 08:37:38 +00:00
7326e8b3bb Remove the restriction on cross build derivation querying
As some build servers do build cross derivations.
2020-02-11 22:48:12 +00:00
f5899a5762 Update the cross build filter for the package reproducibility page 2020-02-11 22:48:06 +00:00
c8dec34f33 Switch to using more correct targets on the build page 2020-02-11 22:47:30 +00:00
9be7dbac0b Start storing channel instance derivations
These are the ones that relate to Guix pull.
2020-02-11 08:56:24 +00:00
406aa5e160 Switch using set-current-system to parameterize
As this is neater.
2020-02-11 08:55:34 +00:00
876bae182d Update the load-new-revision-job tests 2020-02-11 08:55:16 +00:00
e0ee3d224b Refactor how channel derivations are handled
Yet again...

This makes the channel-derivations for each system accessible within the
load-new-guix-revision procedure, in preparation for storing them in the
database.
2020-02-09 21:40:56 +00:00
60d53f898f Collpase store-item-for-channel in to channel->guix-store-item 2020-02-09 21:06:12 +00:00
13b0ebe561 Start computing channel instance derivations for multiple systems
These aren't stored yet, but this is a start.
2020-02-09 21:03:05 +00:00
beab4babac Further refactor channel->derivation-file-name
To reduce the line length.
2020-02-09 16:44:18 +00:00
9c38115c3d Refactor channel->derivation-file-name to reduce line length 2020-02-09 16:39:46 +00:00
3ee481110e Shift extracting channel news to later on
To avoid race conditions between jobs, have it happen after the call to
extract-information-from.
2020-02-09 10:20:36 +00:00
82b1ae6b75 Improve the branch-updated-emails module line length 2020-02-08 12:05:42 +00:00
c31c9575e0 Support excluding and including branches from a repository
So that you can have the Guix Data Service only pay attention to some of the
branches.
2020-02-08 12:03:41 +00:00
bb271c366b Tweak the sort order for derivation counts
So that the non-cross derivations appear first.
2020-02-08 11:42:24 +00:00
f9871faa88 Remove peek call 2020-02-08 11:18:58 +00:00
f1989e8758 Rework cross derivations support
Stop using the system values as targets, and remove package derivation entries
where this is the case.

Switch the non-cross derivation case to have a target of "", rather than
matching the system, as this makes more sense, and is more consistent now that
the target values no longer match the system values.

Hardcode some more correct target values, and use these instead. Hopefully
this can be better integrated with Guix in the future.

This commit also includes a migration attempting to shrink some indexes.
2020-02-08 11:16:08 +00:00
77beb59495 Use a temporary table when inserting package metadata entries
To speed up this step, as there is a lot of data.
2020-02-04 00:11:47 +00:00
a3c5f53fcd Support using a temp table in insert-missing-data-and-return-all-ids
This is more performant when there is a lot of data.
2020-02-04 00:08:49 +00:00
a3d84b1aec Add missing migration 2020-02-03 22:57:57 +00:00
19630014a3 Add a page to show system tests for a revision 2020-02-03 09:58:02 +01:00
00d9664714 Query builds for system test derivations 2020-02-03 09:57:35 +01:00
8f0d5b51b1 Store information about system tests 2020-02-03 09:57:02 +01:00
65850669a0 Log the time to lock package_versions_by_guix_revision_range 2020-02-02 11:14:35 +01:00
908f6d3eee Log the time to lock load-new-guix-revision-inserts 2020-02-02 11:14:35 +01:00
956aa9ecb0 Log the time taken to acquire advisory session locks 2020-02-02 10:10:25 +01:00
f59354ed23 Call add-temp-root for the derivation file names
In an attempt to stop the derivations from being garbage collected between the
time they're generated, and when they're potentially read by the Guix Data
Service.
2020-02-02 08:30:02 +01:00
381acf312e Warn if process-branch-updated-mbox won't match any emails 2020-02-01 14:03:26 +01:00
671a85f798 Add a function to check how many repositories have x_git_repo_header 2020-02-01 13:59:41 +01:00
744ab9366b Add a very basic repositories page 2020-02-01 13:33:14 +01:00
6bc753dd0e Add a build servers page 2020-02-01 13:12:01 +01:00
e5e9442b44 Add an Overview section to the README
To try and provide some information about the motivation for the Guix Data
Service.
2020-02-01 10:40:11 +01:00
ee82c2c71d Refactor processing lint warnings
Extract out a function to make the code slightly easier to read.
2020-02-01 10:32:49 +01:00
91249f5ee0 Fix indentation 2020-02-01 10:31:19 +01:00
9754a274b4 Add ephemeralpg to the guix-dev.scm file
This is used for running the tests.
2020-01-31 12:46:21 +01:00
1ab6ecd64f Use the line numbers to make the package deduplication more stable
Previously this would just compare on the version if the name was the same,
but there are package definitions that share the name and version (itstool is
one example).

To try and make this more stable, to avoid weird errors, and unstable
comparisons between revisions, use the line number when deduplicating
packages.
2020-01-21 23:55:36 +00:00
a66cbd41f9 Fail early if a package lookup fails when loading a revision
I think this might be happening when packages are filtered out as
duplicates (by name and version), but then a reference to a duplicate occurs
somewhere, like in a lint warning.
2020-01-21 23:53:52 +00:00
bf25a8db02 Add a job events page 2020-01-20 19:46:00 +00:00
f3ebe83532 Tweak the recent events table on the jobs page 2020-01-20 19:33:45 +00:00
704f149645 Improve the compare-invalid-parameters messages 2020-01-18 10:18:17 +00:00
cf407fe830 Switch to querying builds by output, rather than derivation
This is better, as Cuirass will return a build for the derivation it built to
generate that output. This avoids having to query for multiple derivations
that generate a single output, until the one that Cuirass used is found.
2020-01-16 20:42:56 +00:00
bd52629674 Fix insert-build when derivation_output_details_set_id is NULL
I can't figure out how to insert NULL through a param, so just construct a
query to insert the values directly.
2020-01-16 20:37:02 +00:00
54baf32be6 Fix select-build-id-by-build-server-and-derivation-file-name
The id will be wrapped in a list.
2020-01-16 20:34:44 +00:00
b43fe39ab8 Fix setting GUIX_LOCPATH when using open-inferior/container 2020-01-13 22:24:18 +00:00
2062badf51 Add a small table of recent job events
To make it easier to see what recently happened.
2020-01-12 17:30:52 +00:00