3544f9300f
Add lint-warnings-for-guix-revision to the lint-warning module
2019-09-01 13:12:10 +01:00
07f368a54b
Include glibc-locales from the inferior guix in the environment
...
When loading data from an inferior Guix, first build it's latest version of
glibc-locales, and include that in the environment from the inferior.
This improves locale support, which is currently relevant for extracting lint
warnings.
Without this change, you'd only be able to switch to locales supported by the
glibc-utf8-locales package, assuming that the right version is available.
2019-09-01 13:12:10 +01:00
af581784b2
Log the guix store path being used
...
In the load-new-guix-revision module.
2019-09-01 13:12:10 +01:00
f118ed0bf9
Improve handling of errors when changing locale
...
In the load-new-guix-revision module.
2019-09-01 13:12:10 +01:00
3a79449974
Display counts of lint warnings on the revision page
2019-09-01 13:12:10 +01:00
75f2c19fc8
Add lint-warning-count-by-lint-checker-for-revision
...
To return counts of lint warnings, grouped by lint checker for a specific
revision.
2019-09-01 13:12:10 +01:00
6b9977f62e
Store lint warnings in the database
...
This commit adds the relevant tables and code to store lint warnings in the
database.
Currently, only lint checkers which don't require access to the network will
be run, as this allows the processing to happen without network access. Also,
this functionality won't work in older versions of Guix which don't expose the
lint warnings in a compatible way.
2019-09-01 13:12:10 +01:00
bf469504eb
Add buffering to the log handling for jobs
...
To increase the log output speed, avoiding inserting one character at a time
in to the database.
2019-08-31 12:10:54 +01:00
8c741c569b
Add insert-missing-data-and-return-all-ids to the model utils module
...
This should help greatly with populating the database with new entries, and
greatly reduce code duplication.
2019-08-31 12:09:54 +01:00
657c72c203
Use $STR$ for better quoting in quote-string
2019-08-31 12:09:31 +01:00
c7baf53c3f
Add value->sql-boolean to (guix-data-service model utils)
2019-08-31 12:07:58 +01:00
66df42ae4f
Fix insert-guix-revision to return an id
...
Rather than an id wrapped in a list.
2019-08-31 12:07:22 +01:00
d35cc85d52
Improve error handling for processing emails
2019-08-31 12:06:36 +01:00
84ad3656df
Alphabetically order the derivation comparison page
2019-08-06 10:33:00 +01:00
89b498aad0
Remove the build status filter from the compare derivations page
...
As there isn't sufficient data to make this work yet.
2019-08-06 10:24:19 +01:00
3849bb79c5
Support filtering by systems and targets when comparing derivations
2019-08-06 10:22:57 +01:00
36a16d356f
Improve derivation comparison to show more changes
...
In cases where the version is changed for example, the relevant derivations
will now show up, whereas previously they did not.
2019-08-06 09:55:03 +01:00
82c3e8942b
Only show the Compare button when it'll work
...
On the branch page.
2019-08-05 21:24:07 +01:00
9e80bda4f9
Avoid erroring when processing emails again
...
These changes allow processing emails again, and just creating job and branch
entries where data is missing.
2019-08-05 20:59:48 +01:00
712dd377a1
Remove test data after the tests have ran
...
The load-new-guix-revision tests aren't transactional, so truncate some tables
after running the tests.
2019-08-05 20:45:40 +01:00
f553a7490d
Change the git_branches table primary key
...
To allow for having branches in multiple git repositories.
2019-08-05 20:02:06 +01:00
4b59108fdd
Properly handle not finding a matching derivation
2019-08-05 19:45:10 +01:00
70126f7ed0
Set the Vary header to a sensible default value
...
As most pages vary based on the Accept header.
2019-08-05 19:43:50 +01:00
8f7398b814
Tweak the branch table layout
2019-08-05 11:36:57 +01:00
002ae7685c
Clear the previous log entry when starting a job
2019-08-04 09:42:21 +01:00
84197686ce
Fix some duplicated values in tables
...
The licenses table, along with the package_metadata table had duplicate
values. This could happen as the unique constraints on those tables didn't
properly account for the nullable fields.
The duplicates in those tables also affected the license_sets, packages,
package_derivations tables in a similar way. Finally, the
guix_revision_package_derivations table was also affected.
This commit adds a migration to fix the data, as well as the constraints. THe
code to populate the licenses and package_metadata tables is also updated.
2019-08-04 09:39:40 +01:00
1724bc485f
Link to the comparison page from the branch page
...
To allow easily comparing revisions.
2019-07-29 21:11:45 +01:00
ef123dcded
Link to the package pages from the comparison page
2019-07-29 21:10:41 +01:00
91e0527b4d
Link to cgit on the comparison page
2019-07-29 20:40:56 +01:00
b075a71d1e
Add a function to get the cgit URL bases for revisions
...
To enable adding a link to cgit to the comparison page.
2019-07-29 20:39:57 +01:00
f2c7cc83ed
Fix the JSON compare output
2019-07-29 19:48:57 +01:00
08d9cbbfe3
Neaten up how branches in Git repositories are linked to
2019-07-27 09:38:50 +01:00
a2caa3ea30
Link to the Statistics and Jobs pages from the index page
2019-07-27 09:38:36 +01:00
75226a1499
Fix the latest-processed-revision pages
2019-07-27 09:12:25 +01:00
7f8ffb4bea
Show links to the cgit pages for repositories on the index page
2019-07-22 21:11:09 +01:00
05db0a87f9
Switch the index page to show branches for a repository
...
As that's probably more useful than recent revisions and jobs.
2019-07-22 20:51:54 +01:00
c23822e14d
Extract out the branches with most recent commits table
...
As I'm thinking about using this on the index page.
2019-07-22 20:36:40 +01:00
219b1fd4ad
Extract out view-revision/jobs-and-events
...
This is common to both view-revision and unknown-revision.
2019-07-22 20:29:38 +01:00
7a70e9ca6f
Extract out view-revision/git-repositories
...
As this was duplicated in the functions for viewing known and unknown
revisions.
2019-07-22 20:29:29 +01:00
91be72df03
Display the jobs related to a revision on the revision page
2019-07-22 20:00:11 +01:00
1f1deac296
Link from a revision to the git repository page
2019-07-19 21:29:56 +01:00
1f977f6c12
Improve how repositories and branches are handled
...
Make the link between repositories and branches clearer, replacing the
/branches and /branch pages by /repository/ and /repository/*/branch/* pages.
2019-07-19 21:22:15 +01:00
6dd52f08ed
Remove restrictions in select-job-for-update
...
This allows running jobs manually that have failed.
2019-07-19 20:25:53 +01:00
71607eff66
Close the logging port once it's been used
2019-07-19 20:25:13 +01:00
dab984b1d5
Fix match expression
...
Specify 'GET rather than GET, to actually match the method, rather than
binding it to GET.
2019-07-19 20:20:52 +01:00
fac3db2d14
Remove localhost from the Sqitch config
...
This means it'll connect over the socket, like the application.
2019-07-16 18:20:56 +01:00
413ef9ea6e
Prioritise processing the latest revisions for branches
...
Reserve some capacity to process revisions which are the tip of a branch. This
should reduce the time between new revisions appearing, and then being
processed.
2019-07-16 18:20:02 +01:00
6904547bf2
Record jobs as failed when they are killed
...
So that they aren't retried again and again.
2019-07-14 14:43:47 +01:00
3dfa9212f1
Kill long running load new revision jobs
...
There are some revisions of Guix which take forever to process (or days at
least). To avoid jobs being processed forever, kill them after they've been
running for a while (default 24 hours).
2019-07-12 23:00:44 +01:00
83ef624b97
Switch to processing jobs in parallel
...
This should speed up processing new revisions, reduce latency between finding
out about new revisions and processing them, as well as help manage memory
usage, by processing each job in a process that then exits.
2019-07-12 23:00:44 +01:00
