Commit Graph

122 Commits

Author SHA1 Message Date
Steve McIntyre 2f34797490 Tweak handling of (un)compressed index files
Provide hashes for uncompressed Translation-* files, and remove the
uncompressed versions from the output disc. Closes: #767253. Initial
patch from Michael Vogt - thanks!
2014-10-30 02:12:12 +00:00
Steve McIntyre fe25734789 List Translation files in dists/$dist/Release too - apt looks there
now instead of in Index, apparently.
2013-06-17 15:35:45 +01:00
Steve McIntyre f7269f8b4f Fix up xdigit regex to cope with new match code 2013-01-22 23:45:23 +00:00
Steve McIntyre 513f8c1191 When building source-only discs, cope with having multiple different
versions of a source package:

+ make_disc_trees.pl now tracks arrays of packages when parsing
  apt-cache output
+ We'll now pull in all the extra packages included in Sources.gz
  because of Built-Using.
2013-01-22 23:32:54 +00:00
Steve McIntyre faf4b2a97c Fix require ordering for read_env 2012-06-05 14:20:06 +00:00
Steve McIntyre 6686e2c66c Clean up handling of environment variable handling in perl tools. 2012-06-05 13:56:51 +00:00
Steve McIntyre 0bb4c00e03 Add more debug when we fail to find Packages data for some reason 2011-11-28 16:20:50 +00:00
Steve McIntyre 24373c514f Don't process translated descriptions for source-only discs 2011-11-28 16:19:38 +00:00
Steve McIntyre 047c3d8455 Change the code for translated description files to use gzip instead
of bzip2; apt can't cope with bzipped files on CD!?!
2011-11-21 00:12:39 +00:00
Steve McIntyre d6ad2ed8e7 Add support for translated package description files. Closes: #495102
+ Add needed dependency on bzip2
+ Other minor cleanups in tools/make_disc_trees.pl
2011-11-14 00:14:30 +00:00
cd-builder user 8a8d4545a2 log genisoimage / xorriso versions used for build 2011-03-30 15:33:39 +00:00
Steve McIntyre 30ba984b96 daft cut and paste error 2011-03-28 16:29:16 +00:00
Steve McIntyre f3bcdaabe8 When adding packages outside of the normal path, add them to the list
of packages on the CD too. There's always a small chance we'll have to
remove them *again* (e.g. large source packages that don't fit), so
let's make that possible.
2011-03-28 12:36:58 +00:00
Steve McIntyre 32b3a4d4cb * Update make_disc_trees.pl and which_deb to cope with different
types of source file, and clean up the code in that area.
2011-03-23 17:23:50 +00:00
Steve McIntyre 0369744ff3 try #2 2011-03-04 13:20:56 +00:00
Steve McIntyre 70fe61ff45 try #2 2011-03-04 13:19:34 +00:00
Steve McIntyre 569e188f04 * Add more checksum types to generated Release files; go from md5 only
to md5, sha1, sha256 and sha512.

Initial checkin, untested code yet!
2011-03-04 13:11:16 +00:00
Steve McIntyre e12ab9e518 Special-case builds of source-only discs: if we think we've overflowed
the disc size, try to carry on for a few more packages to get closer
to actually filling the disc. Closes: #613751.
2011-02-23 17:30:27 +00:00
Steve McIntyre 317536973a More tweaks to logging for sizes 2011-02-23 15:24:06 +00:00
Steve McIntyre 877fa688cc daft syntax error 2011-02-23 14:15:35 +00:00
Steve McIntyre cab1964fe1 More tweaks to logging for sizes 2011-02-23 14:11:42 +00:00
Steve McIntyre fb03fc2424 More tweaks to logging for sizes 2011-02-23 14:01:33 +00:00
Steve McIntyre addab9dec9 More tweaks to logging for sizes 2011-02-23 13:57:40 +00:00
Steve McIntyre 2148f6d1d4 make logging clearer for mixed-size builds 2011-02-23 13:51:17 +00:00
Steve McIntyre 3c3aa8d79b * Add disk size definitions for 1/2/4/8 GB USB sticks.
* Extend the size-override code to allow to override an individual disc
  in the set (e.g. to make the first DVD fit on a 4GB USB stick).
2011-02-23 13:41:33 +00:00
Steve McIntyre 7fe446b244 Add support for over-riding disc size on demand, used for some of the squeeze release builds 2011-02-22 21:52:28 +00:00
Steve McIntyre d71a59e14e * Drop the recommended size for BD-ROMs slightly, on the
recommendation of Thomas Schmitt. This will make it more likely that
  we'll fit on all media.
2011-01-07 13:22:11 +00:00
Steve McIntyre f6042461c3 add the jigdo opts when trying to estimate sizes - this matters for xorriso if we want to be accurate 2010-12-28 20:07:29 +00:00
Steve McIntyre e7e5fec52f Pass the base mkisofs options into make_disc_trees too. 2010-11-27 18:28:45 +00:00
Steve McIntyre b9c25ca204 * Add support for forcing firmware packages onto CD#1:
+ Add "FORCE_FIRMWARE=1" to CONF.sh to turn this on
    + Will pick up on packages in the "firmware" task and install them
    + Will also add sym-links to them in CD1/firmware so that new d-i code
      can find them easily.
    + Will add a short sentence into README.html/README.txt
  * Add top-level control of which checksums are desired for output images
    see the CHECKSUMS setting in CONF.sh
  * Fix some bashisms in tools/apt-selection.
2010-05-27 00:52:25 +00:00
Steve McIntyre 27d2d9200f Rename log.add_packages to add_packages.log 2010-04-27 12:27:03 +00:00
Steve McIntyre 599ee0710b * Cope with errors reported from debootstrap better; don't just treat
the text output as package names. Closes: #570474
2010-02-21 22:38:03 +00:00
Steve McIntyre acf3d69328 Extend the code that copes with too-large binary packages to cope with
too-large source packages too.
2009-12-29 01:27:25 +00:00
Steve McIntyre cd5a1d2c90 * Merge patches from Jonathan Hall:
+ Add better support for extra components, improve non-i386 mirror
    support (Closes: 514237)
  + tools/update_tasks no longer assumes i386 for all builds (Closes: #513497)
  + tools/which_deb no longer assumes i386 for all builds (Closes: #513498)
* For source-only builds, don't do any task updates as they're not
  useful anyway.
* Last high-urgency upload, ready for Lenny!
2009-02-12 00:22:17 +00:00
Frans Pop f889a347da Improve indentation consistency 2008-12-28 13:48:10 +00:00
Steve McIntyre eb58e46871 Fix tab damage from last checkin 2008-11-26 23:42:05 +00:00
Steve McIntyre eabbd6d948 Add more info when reading in package data 2008-11-26 23:37:18 +00:00
Steve McIntyre 957b00eeff close the input pipe each time when talking to apt 2008-11-24 01:59:16 +00:00
Steve McIntyre 91b43114ab Close the list input when we're done with it 2008-11-22 08:38:59 +00:00
Frans Pop 1eac5a9d65 Generate tasks dynamically; separate task files per distro release
All tasks files are moved to ./tasks/<codename> subdirectories so they
can be more easily kept up-to-date with specific distro releases.

Always generate the debian-installer and tasksel tasks dynamically:
- all task files for the desired suite are copied to the working
  directory at the beginning of each build, and are used from there;
- the debian-installer and tasksel tasks are no longer included in
  releases but are always created automatically at build time; this
  means users no longer need to run the generate_di_* scripts or the
  update_tasksel script;
- the popcon task file will remain included as a static file, but plan
  is to add an option to update it automatically for each build; reason
  is that updating it requires network access.

Bump version to 3.1.
2008-11-13 23:19:30 +00:00
Frans Pop 7567a51136 Remove last few references to (raw)list.exclude 2008-11-01 23:11:52 +00:00
cd-builder user 7462c548dc * Improve control over production of iso and jigdo files. Replace the
simple DOJIGDO config option with MAXISOS and MAXJIGDOS, allowing
    more flexibility. Allows us to only produce a small number of iso
    images for less-popular architectures but still produce all the jigdo
    files, saving a lot of disk space.
2008-09-10 22:16:18 +00:00
Frans Pop 0ae829d756 Add sanity check for data passed to add_packages 2008-07-13 11:33:14 +00:00
Steve McIntyre 71039d6ead * Add support for dual-layer DVD, Blu-Ray and dual-layer Blu-Ray
discs. Nothing special, just extra sizes recognised.
2008-06-28 14:08:41 +00:00
Steve McIntyre 7c095e5768 Fix code that removes Packages entries - need to be paragraph-oriented rather than line-oriented here 2008-04-20 15:31:48 +00:00
Steve McIntyre f9ca2237ff Re-split link.pl code out; add_files needs it too 2008-03-24 15:08:58 +00:00
Steve McIntyre 2f46e78135 * Pre-cache apt's package information in large lumps rather than walk
through it one package at a time. It's much faster. Closes: #470838
    Needs a small re-arrangement: code from tools/add_packages and
    tools/link.pl now moves into tools/make_disc_trees.pl
2008-03-20 09:43:22 +00:00
Frans Pop eeb3b9abfc Use 'or' instead of '||' when testing result of calls to open (because of precendence rules) 2008-01-05 23:53:27 +00:00
Frans Pop 0db7484988 * During installation debootstrap will complain about an invalid Release file
if there is no Packages file for the local section. Create an empty Packages
  file if one is missing.
2008-01-05 23:50:48 +00:00
Frans Pop 12d15c1a2a At least somewhat more consistent indentation... 2007-09-02 17:24:04 +00:00
Steve McIntyre dd8d42703b * Check if required base packages might also be supplied by a local
repository too, not just the main distribution. Closes: #425600
2007-08-26 15:19:00 +00:00
Steve McIntyre a10d15179c * Recompress the Packages files separately just before generating
Release files. Closes: #423835, thanks to fjp for the patch.
2007-08-26 15:07:52 +00:00
Steve McIntyre 0454b4c917 Merged in patch from Otavio:
* Fix extranonfree support to be backward compatible with previous
  behaviour (default to false)
2007-08-08 09:54:04 +00:00
Steve McIntyre 0d3c11551e * It seems the changes for 3.0.0 completely broke extranonfree
support. Re-add it.
2007-04-19 23:38:29 +00:00
Raphaël Hertzog 46369d0dc5 Disable pattern metacharacters in some regex with included variables.
Closes: #413506
2007-03-05 16:09:46 +00:00
Steve McIntyre 2ca98a7f32 * Cope with rolling back more than one package in case we go well
over the disc size
  * Use a multiplier of 1.2 for HFS space - overkill, but it fixes
    the multi-arch DVD overflowing. Also log if we're doing HFS.
  * Tweak where we look for s390 boot files to make the weeklies work again.
2007-02-27 20:05:32 +00:00
Raphaël Hertzog a2d9587f1a Don't rely on PATH containing the tools directory. 2007-02-21 14:13:35 +00:00
Steve McIntyre 17bb18194f * Re-implemented exclude/unexclude support in make_disc_trees.pl instead
of in list2cds. Slight changes in semantics - the new code supports
    regular expressions for matching package names (to make it easier to
    exclude groups of related packages), and EXCLUDE<m> should be used in
    preference to EXCLUDE for packages that are just being shifted to
    later in the set by using UNEXCLUDE<n>.
2006-12-29 05:56:43 +00:00
Steve McIntyre 4d4bba1b7e Don't list the md5sum.txt file inside itself, it will always fail 2006-12-29 02:50:35 +00:00
Steve McIntyre eb1131b3df Make make_disc_trees.pl and start_new_disc fail better on errors 2006-12-23 03:03:58 +00:00
Steve McIntyre 74e9050525 rearrange to make sure is set before we set 2006-12-20 11:02:59 +00:00
Steve McIntyre b600a32f13 * Update documentation to at least vaguely match how things work.
* Added support for hook scripts in a few places around the CD
 	creation process, to help people customise their CDs. Quite a
	lot of refactoring needed in make_disc_trees.pl needed to do that.
  * Removed more cruft:
    + old defs in CONF.sh
    + old defs and rules in the Makefile
    + tools/add_secured
2006-12-19 01:58:41 +00:00
Steve McIntyre 05905f9e37 Better estimation for HFS media (m68k/ppc) 2006-12-12 02:10:53 +00:00
Steve McIntyre ad1906c27b Even more accurate size estimation; reduce how much we need to run mkisofs 2006-12-11 17:52:25 +00:00
Steve McIntyre 8b318a9693 Tweak the size-checking threshold to make things faster 2006-12-11 15:50:49 +00:00
Steve McIntyre e1116e39e4 typo fix 2006-12-10 22:37:38 +00:00
Steve McIntyre 96608804fc Remove the old shell version of make_disc_trees
Missed changing one of the invocations of add_packages - now fixed
2006-12-10 22:36:08 +00:00
Steve McIntyre 52d0a9f08b Round off the DVD size in blocks 2006-12-10 22:23:51 +00:00
Steve McIntyre 5b26423869 Minor tweaks for businesscard CDs 2006-12-10 20:12:46 +00:00
Steve McIntyre 7780369fd4 * When we've finished making a CD tree in make_disc_trees.pl,
re-compress the gzipped Sources and Packages. Workaround for bug
    #402482 in busybox gunzip code.
2006-12-10 20:00:37 +00:00
Steve McIntyre 50058df56f * Improve performance: rewritten tools/make_disc_trees in perl so we
can call add_packages directly as a perl function rather than via
    fork/exec all the time. Re-arranged tools/add_packages to make
    this work.
  * Improved logging in add_packages.
2006-12-10 18:57:29 +00:00
Steve McIntyre eb73154582 Reimplement make_disc_trees in perl for better performance. More to come... 2006-12-10 15:26:19 +00:00