e07b3291e8
Vacuum the package derivations table after each job
...
As each job deletes lots of rows in the table, vacuum it to free up space for
the next job.
I don't think this is something to do widely, but I wanted to try it out for
the tables which have a lot of churn.
2020-11-17 20:47:16 +00:00
5124f3be3e
Update insert-new-latest-status-entries
...
To use the status first for ordering, then the timestamp. This ensures
sensible behaviour regardless of what timestamps are present.
2020-10-21 20:25:59 +01:00
fa6e4ac842
Use the status for ordering, as well as timestamp
...
As this will handle cases where the timestamps from Cuirass don't make sense,
like a build being canceled with a timestamp of 0 (1970).
2020-10-21 19:47:11 +01:00
efb26a616d
Add a view build link on the build page
2020-10-21 19:26:18 +01:00
7936ca2e54
Remove unnecessary join in select-outputs-without-known-nar-entries
2020-10-13 19:45:41 +01:00
e273e22042
Switch queries across to use latest_build_status
2020-10-13 19:35:40 +01:00
83884ed2ea
Add a latest_build_status table
...
This will avoid many queries trying to figure out what the latest build status
is, which will hopefuly simplify queries as well as improving performance.
2020-10-13 19:31:43 +01:00
f15dc5ab0b
Include package details for the package derivation outputs JSON
...
So it's easier to match the output back to the package.
2020-10-13 18:51:21 +01:00
f1eb2d3bd2
Change table-schema to detect when there are no results
...
This might give more insight to the [1] errors occuring for some builds.
1: error: couldn't find data for locale in ()
2020-10-08 17:36:21 +01:00
9f9c23010e
Support storing whether to authenticate commits by git repository
...
To allow using the Guix Data Service when commits aren't authenticated.
2020-10-07 18:50:13 +01:00
125a35fce5
Reformat lint warning related query
2020-10-02 17:52:07 +01:00
af40c1ac13
Speed up a query for derivation builds
...
This change removes a sequential scan from the query plan, making it much
faster.
2020-10-02 17:51:55 +01:00
992a0af63e
Split off delete-revisions-from-branch from delete-data-for-branch
...
To support not deleting all of the revisions.
2020-09-26 18:23:21 +01:00
faf46565ce
Fix some package search issues
...
Previously, the name wasn't taken in to account when filtering results, so a
search like "git-annex" wouldn't find the git-annex package, since it's
synopsis or description doesn't include the name.
Filtering on the name made the queries much slower, so to address that, the
filtering by revision is moved to a separate part of the CTE, which means
PostgreSQL filters down the rows by quite a lot before it begins filtering by
name.
Also, add in a variant of the query without dashes (-) because that helps with
searches like ruby-engine.
2020-09-26 16:05:06 +01:00
53341c70fc
Change the locale codeset representation
...
From the normalized one, to the one actually contained within glibc. Recent
versions of glibc also contain symlinks linking the normalized codeset to the
locales with the .UTF-8 ending, but older ones do not.
Maybe handling codeset normalisation for queries would be good, but the locale
values ending in .UTF-8 are more compatible and allow the code to be
simplified. For querying, maybe there should be a locales table which handles
different representations.
2020-09-26 11:45:57 +01:00
857ac36711
Return a number from count-guix-revisions
2020-09-20 18:38:39 +01:00
Ludovic Courtès
773fe2a19f
Add dependency on Guile-lzlib.
...
Guix no longer provides the (guix lzlib) module. This commit arranges
to use Guile-lzlib instead.
2020-08-26 11:27:54 +02:00
Danjela Lura
086cb9c9d0
Modify the search-packages-in-revision query to make it faster
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-08-12 08:53:59 +01:00
Danjela Lura
5b3e5d9441
Update the package_metadata_tsvectors with new entries
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-08-12 08:53:49 +01:00
a1af644310
Change select-required-builds-that-failed to exclude succeeded builds
...
Only include a failed build if that build server hasn't had any success
building that output. The Guix Build Coordinator can build one output with
many different builds, so this helps avoid showing lots of spurious failures.
2020-07-13 18:55:50 +01:00
e9d4e74e56
Add builds to the store item page
2020-07-04 09:31:12 +01:00
69d3c83986
Improve select-builds-with-context
...
Support specifying the limit, and improve the ordering.
2020-07-03 20:32:45 +01:00
dc8b442e12
Improve the linking to build servers
...
Add a build-url function that returns the URL to use, and use this where
appropriate.
2020-07-01 19:51:21 +01:00
1e2fefa7cf
Change select-build procedures to avoid join issues
...
The number of build_status rows coming back was being amplified by the INNER
JOIN, using a subquery guards against this.
2020-07-01 19:42:42 +01:00
5ee8207565
Avoid duplicate build status entries
...
This effectively makes adding build status entries idempotent to some degree.
2020-07-01 09:35:29 +01:00
9192550331
Implement more support for builds from the Guix Build Coordinator
...
Builds from the Guix Build Coordinator might not have timestamps, and the id
from the build server is more important, as one build server can build the
same derivation many times.
2020-07-01 09:35:29 +01:00
911d0779ed
Fix compute-token
...
For some reason the string-filter arguments were the wrong way around.
2020-06-28 21:42:05 +01:00
1d48885e6a
Make build_status.timestamp nullable
...
The Guix Build Coordinator doesn't record timestamps for events
currently. This is something to fix, but allow for build statuses without
timestamps as they're not necessary.
2020-06-27 14:05:51 +01:00
d687928a04
Implement insert-build-status using insert-build-statues
...
To reduce the number of code paths.
2020-06-27 14:05:51 +01:00
Danjela Lura
f60c2eabce
Add the packages-translation-availability page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
bd3aa98620
Add indications for no translations available in the lint warnings page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
d442d408ee
Add locale values in the JSON response for the lint warnings page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
89aaf984ec
Include locale in search-packages-in-revision
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
f16fdb44f1
Add indications for no translations available in the packages page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
5708b81002
Include locale in the JSON response for the packages page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-26 17:54:19 +01:00
Danjela Lura
365bf27838
Fix the test-model-package test
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-19 16:03:32 +01:00
Danjela Lura
a3ac33c0e1
Provide the packages page with translations
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-19 16:03:32 +01:00
Danjela Lura
8d9a4d105c
Get the translated package synopsis and descriptions into the database
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-19 16:03:32 +01:00
308e553b11
Guard against some changes in how guile-json represents null values
2020-06-19 14:12:56 +01:00
Danjela Lura
480d718fa8
Fix lint checker tests
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
533bf91ab1
Fall back to en_US.utf8 in the package page
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
d10c6f5aa9
Fall back to en_US.utf8 for the lint warnings page for a revision
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
ecd460867b
Make the query that provides locale options look nicer
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
d3096de655
Use lint checker related translations on some pages
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
b8abe38352
Add checks to guard against null data
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
Danjela Lura
f67bea719d
Get the translated lint checker descriptions into the database
...
Signed-off-by: Christopher Baines <mail@cbaines.net>
2020-06-07 20:17:03 +01:00
ae6541af1e
Fix select-build-servers with respect to the lookup-builds field
2020-06-06 14:40:36 +01:00
916b594473
Make nar_urls file sizes optional
2020-06-03 06:56:59 +01:00
b6754c8a4c
Add a lookup_builds field to the build_servers table
...
This is to allow for build servers where only the substitutes should be
queried, and it shouldn't be assumed that they're running Cuirass.
2020-05-24 17:02:53 +01:00
2e3276e803
Tweak select-output-consistency-for-revision
...
I don't think this actually changes the result, but I think the query is a bit
better formed.
2020-05-03 21:27:55 +01:00
