Commit graph

1501 commits

Author SHA1 Message Date
3ad100bedc Log the manifest derivation when loading new revisions
As this is useful to know.
2019-09-01 17:40:16 +01:00
609c5cf4f0 Add a page to show the lint warnings for a revision 2019-09-01 17:40:16 +01:00
3544f9300f Add lint-warnings-for-guix-revision to the lint-warning module 2019-09-01 13:12:10 +01:00
07f368a54b Include glibc-locales from the inferior guix in the environment
When loading data from an inferior Guix, first build it's latest version of
glibc-locales, and include that in the environment from the inferior.

This improves locale support, which is currently relevant for extracting lint
warnings.

Without this change, you'd only be able to switch to locales supported by the
glibc-utf8-locales package, assuming that the right version is available.
2019-09-01 13:12:10 +01:00
af581784b2 Log the guix store path being used
In the load-new-guix-revision module.
2019-09-01 13:12:10 +01:00
f118ed0bf9 Improve handling of errors when changing locale
In the load-new-guix-revision module.
2019-09-01 13:12:10 +01:00
3a79449974 Display counts of lint warnings on the revision page 2019-09-01 13:12:10 +01:00
75f2c19fc8 Add lint-warning-count-by-lint-checker-for-revision
To return counts of lint warnings, grouped by lint checker for a specific
revision.
2019-09-01 13:12:10 +01:00
6b9977f62e Store lint warnings in the database
This commit adds the relevant tables and code to store lint warnings in the
database.

Currently, only lint checkers which don't require access to the network will
be run, as this allows the processing to happen without network access. Also,
this functionality won't work in older versions of Guix which don't expose the
lint warnings in a compatible way.
2019-09-01 13:12:10 +01:00
bf469504eb Add buffering to the log handling for jobs
To increase the log output speed, avoiding inserting one character at a time
in to the database.
2019-08-31 12:10:54 +01:00
8c741c569b Add insert-missing-data-and-return-all-ids to the model utils module
This should help greatly with populating the database with new entries, and
greatly reduce code duplication.
2019-08-31 12:09:54 +01:00
657c72c203 Use $STR$ for better quoting in quote-string 2019-08-31 12:09:31 +01:00
c7baf53c3f Add value->sql-boolean to (guix-data-service model utils) 2019-08-31 12:07:58 +01:00
66df42ae4f Fix insert-guix-revision to return an id
Rather than an id wrapped in a list.
2019-08-31 12:07:22 +01:00
d35cc85d52 Improve error handling for processing emails 2019-08-31 12:06:36 +01:00
84ad3656df Alphabetically order the derivation comparison page 2019-08-06 10:33:00 +01:00
89b498aad0 Remove the build status filter from the compare derivations page
As there isn't sufficient data to make this work yet.
2019-08-06 10:24:19 +01:00
3849bb79c5 Support filtering by systems and targets when comparing derivations 2019-08-06 10:22:57 +01:00
36a16d356f Improve derivation comparison to show more changes
In cases where the version is changed for example, the relevant derivations
will now show up, whereas previously they did not.
2019-08-06 09:55:03 +01:00
82c3e8942b Only show the Compare button when it'll work
On the branch page.
2019-08-05 21:24:07 +01:00
9e80bda4f9 Avoid erroring when processing emails again
These changes allow processing emails again, and just creating job and branch
entries where data is missing.
2019-08-05 20:59:48 +01:00
712dd377a1 Remove test data after the tests have ran
The load-new-guix-revision tests aren't transactional, so truncate some tables
after running the tests.
2019-08-05 20:45:40 +01:00
f553a7490d Change the git_branches table primary key
To allow for having branches in multiple git repositories.
2019-08-05 20:02:06 +01:00
4b59108fdd Properly handle not finding a matching derivation 2019-08-05 19:45:10 +01:00
70126f7ed0 Set the Vary header to a sensible default value
As most pages vary based on the Accept header.
2019-08-05 19:43:50 +01:00
8f7398b814 Tweak the branch table layout 2019-08-05 11:36:57 +01:00
002ae7685c Clear the previous log entry when starting a job 2019-08-04 09:42:21 +01:00
84197686ce Fix some duplicated values in tables
The licenses table, along with the package_metadata table had duplicate
values. This could happen as the unique constraints on those tables didn't
properly account for the nullable fields.

The duplicates in those tables also affected the license_sets, packages,
package_derivations tables in a similar way. Finally, the
guix_revision_package_derivations table was also affected.

This commit adds a migration to fix the data, as well as the constraints. THe
code to populate the licenses and package_metadata tables is also updated.
2019-08-04 09:39:40 +01:00
1724bc485f Link to the comparison page from the branch page
To allow easily comparing revisions.
2019-07-29 21:11:45 +01:00
ef123dcded Link to the package pages from the comparison page 2019-07-29 21:10:41 +01:00
91e0527b4d Link to cgit on the comparison page 2019-07-29 20:40:56 +01:00
b075a71d1e Add a function to get the cgit URL bases for revisions
To enable adding a link to cgit to the comparison page.
2019-07-29 20:39:57 +01:00
f2c7cc83ed Fix the JSON compare output 2019-07-29 19:48:57 +01:00
08d9cbbfe3 Neaten up how branches in Git repositories are linked to 2019-07-27 09:38:50 +01:00
a2caa3ea30 Link to the Statistics and Jobs pages from the index page 2019-07-27 09:38:36 +01:00
75226a1499 Fix the latest-processed-revision pages 2019-07-27 09:12:25 +01:00
7f8ffb4bea Show links to the cgit pages for repositories on the index page 2019-07-22 21:11:09 +01:00
05db0a87f9 Switch the index page to show branches for a repository
As that's probably more useful than recent revisions and jobs.
2019-07-22 20:51:54 +01:00
c23822e14d Extract out the branches with most recent commits table
As I'm thinking about using this on the index page.
2019-07-22 20:36:40 +01:00
219b1fd4ad Extract out view-revision/jobs-and-events
This is common to both view-revision and unknown-revision.
2019-07-22 20:29:38 +01:00
7a70e9ca6f Extract out view-revision/git-repositories
As this was duplicated in the functions for viewing known and unknown
revisions.
2019-07-22 20:29:29 +01:00
91be72df03 Display the jobs related to a revision on the revision page 2019-07-22 20:00:11 +01:00
1f1deac296 Link from a revision to the git repository page 2019-07-19 21:29:56 +01:00
1f977f6c12 Improve how repositories and branches are handled
Make the link between repositories and branches clearer, replacing the
/branches and /branch pages by /repository/ and /repository/*/branch/* pages.
2019-07-19 21:22:15 +01:00
6dd52f08ed Remove restrictions in select-job-for-update
This allows running jobs manually that have failed.
2019-07-19 20:25:53 +01:00
71607eff66 Close the logging port once it's been used 2019-07-19 20:25:13 +01:00
dab984b1d5 Fix match expression
Specify 'GET rather than GET, to actually match the method, rather than
binding it to GET.
2019-07-19 20:20:52 +01:00
fac3db2d14 Remove localhost from the Sqitch config
This means it'll connect over the socket, like the application.
2019-07-16 18:20:56 +01:00
413ef9ea6e Prioritise processing the latest revisions for branches
Reserve some capacity to process revisions which are the tip of a branch. This
should reduce the time between new revisions appearing, and then being
processed.
2019-07-16 18:20:02 +01:00
6904547bf2 Record jobs as failed when they are killed
So that they aren't retried again and again.
2019-07-14 14:43:47 +01:00