Commit Graph

108 Commits

Author SHA1 Message Date
Cyril Brulebois 4a31c04b81 make_disc_trees.pl: remove workaround for missing bookworm/non-free-firmware/dep11
This directory appeared in the archive earlier today.
2023-01-26 22:24:51 +01:00
Cyril Brulebois ee40a3bf23 make_disc_trees.pl: add workaround for missing bookworm/non-free-firmware/dep11
There's no dep11 directory for bookworm's non-free-firmware component
for the time being, and we've just decided to be more cautious about
input files, which breaks the bookworm build.

Until the issue is fixed on the appstream.debian.org side, and until dak
can indeed import that directory into the Debian archive, use sid's
non-free-firmware dep11 directory instead of bookworm's.
2023-01-25 01:38:34 +01:00
Cyril Brulebois 214e2dd88c make_disc_trees.pl: use write_file() for .component files as well 2023-01-25 01:38:34 +01:00
Cyril Brulebois 957ee269b4 make_disc_trees.pl: create /firmware/dep11/README.txt and count it
Move the README.txt creation from generate_firmware_patterns to its
caller, so that it's done just once, and so that added blocks are
counted properly.
2023-01-25 01:38:34 +01:00
Cyril Brulebois 14064e08a1 Replace all gzip -9 calls with pigz -9nm ones.
Some gzip calls have --no-name, which disables both the original name
and timestamp; use -n (disables original name) and -m (disables original
timestamp) for pigz, for all calls.
2023-01-23 19:30:35 +01:00
Cyril Brulebois f7925da6cd make_disc_trees.pl: store .component alongside .patterns for firmware packages
This makes it possible for hw-detect's install-firmware hook to enable the
right components if it installs firmware packages based on modalias
information. The components found in Contents-firmware indices are only
useful for firmware packages detected by the check-missing-firmware.sh
script.
2023-01-22 14:50:09 +01:00
Cyril Brulebois 4308e4666c make_disc_trees.pl: add components to Contents-firmware indices
All three columns could be aligned, but I'm not sure how many characters
should be allocated to the package filename. Alternatively, we could
scratch alignment altogether, and let interested users use column -t on
the file when debugging.
2023-01-22 14:49:06 +01:00
Cyril Brulebois bbda95c283 make_disc_trees.pl: fix misnamed $dist variable
$dist would suggest distribution, an alternative name for suite or
codename (!), let's make it clear we mean component here.
2023-01-21 16:40:56 +01:00
Cyril Brulebois a2378ed25d make_disc_trees: create /firmware before adding symlinks there
Otherwise it would only be created after failing to create the first symlink.
See previous commit.
2023-01-20 16:48:55 +01:00
Cyril Brulebois b1cb4c43c2 make_disc_trees: error out if firmware symlink creation fails
Otherwise failures would go unnoticed, logs would pretend firmware-b43-installer
(the first firmware package getting processed) is indeed installed there while
it's not. See next commit.
2023-01-20 16:48:55 +01:00
Cyril Brulebois 5aa89ab269 Add leading / to paths in Contents-firmware indices.
With this change, hw-detect's check-missing-firmware.sh can use grep -f
with a file listing absolute paths to required firmware files.
2023-01-18 22:43:25 +01:00
Steve McIntyre 32291d88a3 Add a Contents-firmware file
to help with looking up firmware packages in d-i
2022-10-09 01:44:37 +01:00
Steve McIntyre e57aa6fa72 Add non-free-firmware support
List the desired non-free sections to use in NONFREE_COMPONENTS in
CONF.sh, default to "non-free non-free-firmware" by default until
things are all migrated.
2022-10-08 17:48:59 +01:00
bauen1 65196d4dcf Avoid embedding timestamps into gzipped Packages and Translations files.
Signed-off-by: Holger Levsen <holger@layer-acht.org>
2022-02-14 11:34:13 +01:00
Steve McIntyre 6b61e01f15 Try to remove dirs when rolling back 2021-12-06 23:50:22 +00:00
Steve McIntyre 4d4399012d Add support for creating firmware patterns at build time
Using the new generate_firmware_patterns script, generate a patterns
file in /firmware/dep11/<package>.patterns as we add a firmware
package onto media.

Deal with size changes as these are added/removed, and add them to the
md5sum.txt file on media too.
2021-07-25 18:26:15 +01:00
Steve McIntyre 047ec2b360 Fix up firmware package rollback
If we removed a firmware package, also remove the link in /firmware
2021-07-25 18:26:08 +01:00
Holger Levsen 9c8fc62807 make_disc_trees: create Packages files for local/debian-installer. Closes: #523017
tools/make_disc_trees.pl: Apply patch by Daniel Dickinson to create Packages
files for local/debian-installer. Closes: #523017

Signed-off-by: Holger Levsen <holger@layer-acht.org>
2021-02-03 17:36:13 +01:00
Steve McIntyre 966016c495 Be more explicit if DISKTYPE is not specified, or unrecognised 2021-01-16 22:32:48 +00:00
Steve McIntyre c7dcd37aec When compressing translations, remove the uncompressed version
It may cause build problems later if we keep it around
2020-12-15 11:44:56 +00:00
Steve McIntyre 0dd4219af4 Add initial support for jigdo v2 format
Add the option to switch to format v2 which uses sha256 everywhere
instead of md5. We can't actually turn this on yet, need to wait for
users to upgrade a bit and get new v2-aware jigdo clients.

But this works as-is for generating v1 until we hit that switch - see
the new JIGOO_CHECKSUM option in CONF.sh
2019-11-21 19:10:19 +00:00
Steve McIntyre 9acb8c5796 More tweaks for Translation files 2019-08-13 07:54:51 +01:00
Steve McIntyre 330c63e67d Tweak recompress code 2019-07-06 11:19:02 +01:00
Steve McIntyre 6ae364773a Tweak logging again 2019-07-06 10:53:40 +01:00
Steve McIntyre a06b008b2f Add more logging around the recompress() step 2019-07-06 10:42:27 +01:00
Steve McIntyre 890ab6645a Add support for USB sticks any integer multiple of 1GB in size.
Factor out the common code, support anything called STICKnnnGB where
nnn is any integer
2019-06-18 23:59:01 +01:00
Steve McIntyre 114e8a3e55 Add explicit support got 16G USB images 2019-06-17 01:40:25 +01:00
Steve McIntyre a7328f65da Merge branch 'system' into 'master'
make_disc_trees: don't use system() for trivial things

See merge request images-team/debian-cd!2
2019-01-23 23:04:57 +00:00
Julien Cristau c68062b624 make_disc_trees: don't use system() for trivial things
Fair warning: completely untested and I don't know perl.
2019-01-23 23:50:36 +01:00
Julien Cristau 97dbce1c22 make_disc_trees: don't reopen the log over and over 2019-01-23 23:34:01 +01:00
David Kalnischkies 270eabfa43 Provide hashes for uncompressed Translation-* again
Implemented in 2f34797490 for bug #767253
released a few months later in v3.1.17, but then broken again a few days
later in 9dd0616b78 by removing the
uncompressed files too early.
2018-02-16 16:14:29 +00:00
Steve McIntyre a3aef842ad Bugfix: fix the remove_Packages_entry() helper function
This was a bug introduced with the backports support. Lots of the
internal helper functions take 4 arguments now: ($dir, $arch,
$in_backports, $package_info). That's fine, but I forgot to update the
code in remove_Packages_entry() to deal with the $in_backports
argument.

This led to the md5sums.txt files in multi-disc sets being broken -
the last file(s) removed on a given disc would still be listed in the
md5sums.txt file, even though the file itself had been removed.
2017-03-27 20:40:19 +01:00
John Paul Adrian Glaubitz ae59c4e92b Declare 'my' instances of '$_' as 'local'
Fixes syntax errors on Perl 5.24 where '$_' may
no longer be declared as 'my'. Being a global symbol,
'$_' has to be declared as 'local' inside functions.
2016-11-22 11:10:35 +01:00
Steve McIntyre 66154bff85 Add initial support for including backports in a build
So far only tested with a single image - targeting a netinst with some
updated packages
2016-09-20 01:46:15 +01:00
Steve McIntyre 9dd0616b78 Remove uncompressed translation files after compressing them 2015-05-02 00:34:38 +01:00
Steve McIntyre 74d62ec35c Remove over-verbose debug 2015-01-11 00:15:58 +00:00
Steve McIntyre 2f34797490 Tweak handling of (un)compressed index files
Provide hashes for uncompressed Translation-* files, and remove the
uncompressed versions from the output disc. Closes: #767253. Initial
patch from Michael Vogt - thanks!
2014-10-30 02:12:12 +00:00
Steve McIntyre fe25734789 List Translation files in dists/$dist/Release too - apt looks there
now instead of in Index, apparently.
2013-06-17 15:35:45 +01:00
Steve McIntyre f7269f8b4f Fix up xdigit regex to cope with new match code 2013-01-22 23:45:23 +00:00
Steve McIntyre 513f8c1191 When building source-only discs, cope with having multiple different
versions of a source package:

+ make_disc_trees.pl now tracks arrays of packages when parsing
  apt-cache output
+ We'll now pull in all the extra packages included in Sources.gz
  because of Built-Using.
2013-01-22 23:32:54 +00:00
Steve McIntyre faf4b2a97c Fix require ordering for read_env 2012-06-05 14:20:06 +00:00
Steve McIntyre 6686e2c66c Clean up handling of environment variable handling in perl tools. 2012-06-05 13:56:51 +00:00
Steve McIntyre 0bb4c00e03 Add more debug when we fail to find Packages data for some reason 2011-11-28 16:20:50 +00:00
Steve McIntyre 24373c514f Don't process translated descriptions for source-only discs 2011-11-28 16:19:38 +00:00
Steve McIntyre 047c3d8455 Change the code for translated description files to use gzip instead
of bzip2; apt can't cope with bzipped files on CD!?!
2011-11-21 00:12:39 +00:00
Steve McIntyre d6ad2ed8e7 Add support for translated package description files. Closes: #495102
+ Add needed dependency on bzip2
+ Other minor cleanups in tools/make_disc_trees.pl
2011-11-14 00:14:30 +00:00
cd-builder user 8a8d4545a2 log genisoimage / xorriso versions used for build 2011-03-30 15:33:39 +00:00
Steve McIntyre 30ba984b96 daft cut and paste error 2011-03-28 16:29:16 +00:00
Steve McIntyre f3bcdaabe8 When adding packages outside of the normal path, add them to the list
of packages on the CD too. There's always a small chance we'll have to
remove them *again* (e.g. large source packages that don't fit), so
let's make that possible.
2011-03-28 12:36:58 +00:00
Steve McIntyre 32b3a4d4cb * Update make_disc_trees.pl and which_deb to cope with different
types of source file, and clean up the code in that area.
2011-03-23 17:23:50 +00:00