Commit Graph

180 Commits

Author SHA1 Message Date
Giovanni Harting 352ce97b88 removed status page code, provided by api now 2023-12-17 21:04:08 +01:00
Giovanni Harting a834c7fb04 updated deps and downgraded to yaml.v2 2023-12-15 18:54:57 +01:00
Giovanni Harting cbe667cb5d updated yaml dep 2023-12-14 19:02:01 +01:00
Giovanni Harting 9bff418ade read correct config file on reload 2023-12-09 17:06:15 +01:00
Giovanni Harting ff26fb2b8b added config file flag 2023-12-09 17:05:29 +01:00
anonfunc fa902fa68c Git-based package source layout (#193)
Co-authored-by: Giovanni Harting <539@idlegandalf.com>
Reviewed-on: #193
2023-05-21 20:28:23 +02:00
Giovanni Harting ece8c4c7d9 faster SRCINFO parsing + memory-based building
Switched to parsing srcinfo with channels on all available cpus, speeding
up srcinfo-parsing and queue generation by a lot.

New memory-limit based building will max out the available memory while
not building the same packages at the same time for different marchs,
fixing some long-standing bugs like firefox not building at the same time
because the same ports are used for profile-based optimization. This
also drops the artificial delay on build-start, speeding up things even
more. This also means there is no hard-coded limit on how many packages
can be build at once anymore. As long as there is RAM available, builds will be
started.
2023-03-14 00:46:16 +01:00
Giovanni Harting c2dec11aaf some code cleanup, fixed rustflags not being detected 2023-01-20 13:18:34 +01:00
Giovanni Harting ba9636cffd improved logging; updated deps 2022-12-22 19:52:26 +01:00
Giovanni Harting ff21894aac added golangci linter; code cleanup 2022-11-20 19:19:16 +01:00
Giovanni Harting 2d00347edc fixed packages being queued which should not be queued 2022-09-02 15:45:44 +02:00
Giovanni Harting e88567ea93 added go-retry to better handle sync failures 2022-08-25 12:47:45 +02:00
Giovanni Harting f30442d100 added separate hash for srcinfo cache 2022-08-14 15:02:24 +02:00
Giovanni Harting 041e7762f7 added delayed status to better differentiate between queued (skipped) and queued 2022-08-14 14:47:20 +02:00
Giovanni Harting 76152a3410 preventing waiting packages to enter buildqueue 2022-08-14 14:12:23 +02:00
Giovanni Harting 5ed591981b dropped double-checking of packages for the buildQueue 2022-08-14 14:07:24 +02:00
Giovanni Harting c8b31b3275 added more db-based lookups 2022-08-13 22:27:56 +02:00
Giovanni Harting b48c75a177 fixed potential out of bounds 2022-08-13 22:03:16 +02:00
Giovanni Harting 8ff928d7fa added waitgroup 2022-08-13 21:55:17 +02:00
Giovanni Harting 87cf1e5631 reworked queue building to use the db; multi threading for SRCINFO gen 2022-08-13 21:54:07 +02:00
Giovanni Harting 7b28db40ce improved debug logging 2022-08-13 10:56:58 +02:00
Giovanni Harting 47552c88d8 do not purge packages that are just skipped 2022-05-21 20:30:34 +02:00
Giovanni Harting bb16bdcb61 fixed purging with no packages present to purge 2022-05-20 12:46:10 +02:00
Giovanni Harting bcea0e99cb do not clear hash and status to avoid loops on skipped packages 2022-05-20 12:31:19 +02:00
Giovanni Harting f051709c4f fixed purge does not trigger a rechecking of purged package 2022-05-20 12:22:42 +02:00
Giovanni Harting 78666f9899 remove packages skipped or of undefined status 2022-05-18 13:49:41 +02:00
Giovanni Harting f7d2e8ccc7 improved logging 2022-03-09 19:05:25 +01:00
Giovanni Harting ed2a42318e more follow-up fixes for new build-queue 2022-03-07 17:20:24 +01:00
Giovanni Harting 270889bf5c followup fixes for new weighted build-queue 2022-02-19 19:39:48 +01:00
Giovanni Harting ba159e0a72 switched to weighted build-queue 2022-02-19 18:03:55 +01:00
Giovanni Harting 0f98b9d18f fixed wrong error being handled 2022-02-16 10:44:57 +01:00
Giovanni Harting 47f0fb6c66 refactor utils.go, error handling 2022-02-16 08:11:34 +01:00
Giovanni Harting 31cf59e6e9 fixed some problems reported by golint and ineffassign 2022-02-14 13:14:21 +01:00
Giovanni Harting c7ba7340a5 added debuginfod support 2022-02-13 22:33:57 +01:00
Giovanni Harting e9951f5d3b fixed module path, again 2022-02-11 21:33:44 +01:00
Giovanni Harting b92b68f332 fixed package name 2022-02-10 19:18:23 +01:00
Giovanni Harting b484f7d4d7 added split-package check to housekeeping 2022-02-07 17:46:16 +01:00
Giovanni Harting 02928a4d0d fixed packages being removed while db was down; better error handling 2022-02-07 15:55:33 +01:00
Giovanni Harting 79f7690a68 move parseWG.done() after buildWG has been increased 2022-01-21 13:02:22 +01:00
Giovanni Harting b9dec56a31 added delay for builds to start before waiting for builds 2022-01-21 12:56:41 +01:00
Giovanni Harting 761cc47c3a error if svn2git version is not initialized 2022-01-21 12:33:45 +01:00
Giovanni Harting d574252d9b remove from parse WG after build has been issued 2022-01-21 12:16:25 +01:00
Giovanni Harting da6df92ed1 move log housekeeping to separate function 2022-01-21 01:41:17 +01:00
Giovanni Harting 2dfdac8468 compare arch to detect packages switched from/to any/x86-64 2022-01-17 13:34:06 +01:00
Giovanni Harting 5432ea326d changed LTO logic to match per-default enabled LTO in upstream Archlinux 2021-12-21 22:33:42 +01:00
Giovanni Harting 1ccb9be510 fixed some minor problems with new package moving 2021-12-20 18:40:20 +01:00
Giovanni Harting e0e76af757 moved repo-add to end of build/sync-cycle 2021-12-20 17:20:06 +01:00
Giovanni Harting f009e9ff00 use lists for repo-actions 2021-12-20 16:04:13 +01:00
Giovanni Harting 42e95d0b75 added start delay 2021-12-20 01:14:55 +01:00
Giovanni Harting 70d901b113 combined error cases and added more 2021-12-20 00:44:32 +01:00