Commit graph

1059 commits

Author SHA1 Message Date
6a7f6b5a0e Fix create small backup issue with latest_build_status 2020-10-23 20:01:43 +01:00
6c47212c4d Improve the failed comparison page 2020-10-23 16:23:16 +01:00
faa32234d8 Fix compare package derivations JSON link 2020-10-23 12:47:43 +01:00
63fc1917f8 Sort the pending builds by timestamp
So that builds that have been pending for a longer time are fetched first.
2020-10-21 20:49:58 +01:00
5124f3be3e Update insert-new-latest-status-entries
To use the status first for ordering, then the timestamp. This ensures
sensible behaviour regardless of what timestamps are present.
2020-10-21 20:25:59 +01:00
2e859ed981 Increase the limit on pending builds to query
As there are quite a lot of pending builds.
2020-10-21 20:08:02 +01:00
553f00d4cf Fix rendering of the /builds page 2020-10-21 20:05:37 +01:00
266a2d867c Limit the builds displayed on the /builds page
Otherwise it can't render if there are lots of builds.
2020-10-21 19:58:27 +01:00
fa6e4ac842 Use the status for ordering, as well as timestamp
As this will handle cases where the timestamps from Cuirass don't make sense,
like a build being canceled with a timestamp of 0 (1970).
2020-10-21 19:47:11 +01:00
6a04d474c0 Regenerate the latest_build_status table
As it doesn't handle wierdness for statuses, like builds being canceled with a
timestamp of 0.
2020-10-21 19:46:27 +01:00
efb26a616d Add a view build link on the build page 2020-10-21 19:26:18 +01:00
41a7f38f44 Cleanup scheduled and started builds with "0" timestamps
Not sure how these appeared, but deleting them seems to be sensible.
2020-10-21 19:25:30 +01:00
b5b89b3645 Fix broken links to builds 2020-10-21 18:38:29 +01:00
971a474f65 Update delete-unreferenced-derivations
To delete from latest_build_status as well.
2020-10-13 20:33:07 +01:00
7936ca2e54 Remove unnecessary join in select-outputs-without-known-nar-entries 2020-10-13 19:45:41 +01:00
83f68a8afa Display backtraces when exceptions occur for fetching builds 2020-10-13 19:35:45 +01:00
e273e22042 Switch queries across to use latest_build_status 2020-10-13 19:35:40 +01:00
83884ed2ea Add a latest_build_status table
This will avoid many queries trying to figure out what the latest build status
is, which will hopefuly simplify queries as well as improving performance.
2020-10-13 19:31:43 +01:00
941d1af556 Include the revision in the package derivation outputs JSON 2020-10-13 18:52:08 +01:00
f15dc5ab0b Include package details for the package derivation outputs JSON
So it's easier to match the output back to the package.
2020-10-13 18:51:21 +01:00
4231f11cb8 Tweak linking to build servers
Move the logic from different places in the view code, and also start
supporting linking to guix.cbaines.net builds. I'm unsure quite how to
generalise this, but just starting doing it is probably the way forward.
2020-10-11 21:19:00 +01:00
d05a7397fb Improve latest processed revision pages for reproducibility stuff
Support the package-derivation-outputs page, and switch the
package-reproducibility page across to use it.
2020-10-11 17:05:38 +01:00
efbbac5099 Add a very rough JSON output for the package derivation outputs page 2020-10-11 16:53:29 +01:00
3225766207 Make it easier to get to a repl 2020-10-10 13:44:37 +01:00
f02c245652 Add another guard clause in to the data deletion code
I've see this error [1] which may relate to the derivation-output-details-id
not being a number, so this check should confirm if there is a issue.

1: Throw to key `psql-query-error' with args `(fatal-error "PGRES_FATAL_ERROR" "ERROR:  invalid input syntax for integer: \"\"\n")'.
2020-10-10 13:34:54 +01:00
4f3be14c16 Split the jobs metric in to succeede, queued and failed
Rather than just completed or not.
2020-10-09 20:19:28 +01:00
5267bde603 Add Prometheus metrics for indexes specifically 2020-10-09 19:42:14 +01:00
2fa9f151f6 Include the base commit and target commit in the compare output
This makes it easier to make other requests with the response body.
2020-10-09 19:35:38 +01:00
3cb8ce51fc Include tablespace as a label for table metrics
As this will make it easier to tell where space is going.
2020-10-09 19:35:31 +01:00
6023aa8caf Improve select-job-for-commit
It now returns #f or a list, rather than the empty list or a nested list.
2020-10-09 19:31:51 +01:00
51204aefca Clarify that the derivations comparison only is for packages
As it excludes the channel instances and system tests.
2020-10-09 19:31:21 +01:00
853aaa6a7c Use letpar& for systems and targets in render-compare/derivations 2020-10-09 19:30:48 +01:00
8daf35e2df Change the derivation comparison targets
To be targets, rather than systems.
2020-10-09 19:29:58 +01:00
1f55718d75 Link to the revisions in the comparison header 2020-10-09 19:29:38 +01:00
da8586f62d Guard against errors when recording job stderr output
This might help at least handle errors when inserting data in to PostgreSQL.
2020-10-09 19:28:06 +01:00
2c463fcdab Guard against derivation IDs that aren't numbers
I saw an error suggesting that something came back that wasn't a number, and
this should give a more informative error.
2020-10-09 19:27:04 +01:00
f1eb2d3bd2 Change table-schema to detect when there are no results
This might give more insight to the [1] errors occuring for some builds.

1: error: couldn't find data for locale in ()
2020-10-08 17:36:21 +01:00
062397e82b Just use map rather than par-map& for deleting derivations
As I think par-map& is probably no faster.
2020-10-08 08:20:03 +01:00
936fda57c5 Make the derivation deletion batch size configurable 2020-10-08 07:52:03 +01:00
b540abaeba Reduce the derivation deletion batch size 2020-10-08 07:49:28 +01:00
03ea66cf33 Use the git repository fetch with authentication value 2020-10-07 18:51:30 +01:00
9f9c23010e Support storing whether to authenticate commits by git repository
To allow using the Guix Data Service when commits aren't authenticated.
2020-10-07 18:50:13 +01:00
888d9fcb98 Avoid locking up the thread pool channel on letpar& exceptions
Previously, if an exception occurred during the processing of any but the last
letpar& expression, the replies for the other expressions would never be
fetched, resulting in that thread in the pool just waiting for a receiver for
the message.

To avoid this, make sure to read all the replies before raising any
exceptions.
2020-10-04 15:38:31 +01:00
a8d5ea4654 Fix the no latest revision behaviour for the latest revision links
Previously the render-unknown-revision procedure would error, as it wasn't
meant for this purpose.
2020-10-04 15:12:26 +01:00
f68166514f Actually delete more of the data for a revision
Previously the package_derivations table wasn't considered, which would mean
derivations would still be referenced. This commit fixes that, along with also
deleting unreferenced entries in some linter related tables.
2020-10-04 15:11:21 +01:00
48673b32cb Fix delete-unreferenced-derivations 2020-10-04 13:23:15 +01:00
93c9813546 Fix the implementation of par-map&
It was pretty wrong...
2020-10-04 13:22:35 +01:00
d2646e7110 Remove some non-existent imports 2020-10-04 13:22:24 +01:00
a24d3e934d Extract out the ability to delete a range of commits
Some revisions have got disassociated from branches, probably because they
were associated with multiple branches in the first place. This should allow
deleting them.
2020-10-04 12:18:57 +01:00
fe7da1ba57 Remove some unnecessary parallel-via-thread-pool-channel calls
As these were causing errors because they were nested in letpar&.
2020-10-04 11:29:51 +01:00