manuel
/
live-build
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
live-build/scripts/build/chroot_package-lists

98 lines
2.6 KiB
Plaintext
Raw Permalink Normal View History

Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
#!/bin/sh
Updating copyright headers for live-build.
2010-09-02 11:12:37 +00:00
## live-build(7) - System Build Scripts
amend copyright & licensing blocks Current versions of the project files are built upon versions published and licensed by Daniel Baumann, but are modified copies of those files and thus need to be marked as such per licensing requirements (afaik he did not pass along ownership / licensing rights to anyone when he left the project). We should also be careful to not be misrepresenting such modified copies as being attributed to Daniel. Adding a new copyright line referring to "The Debian Live team" should suffice for this. The authorship block in man pages has also similarly been updated. Notes: - tweaked a copy of daniel copyright lines stating 2014 instead of 2015. both of these cases were in files that i had personally introduced in some of my past merged commits that moved some code around. i don't know why they stated 2014. - binary_onie was introduced in 2018, so that has a 2018 date instead of 2016 unlike the rest. - 'efi-image' is a 3rd-party (Canonical Ltd) work that we bundle, but it has been modified by 674794a8f4d61a729d2dbd6d99385d2826138694 and 36a3ba76347ef72df1c316312ed3a26aa4b0c816 so I similarly added a debian live copyright line. - 'grub-cpmodules' is similar. it was only changed by the indentation fix of 36a3ba76347ef72df1c316312ed3a26aa4b0c816 but modification is modification, and this does help cover any possible future changes that might be made.
2020-03-11 09:07:21 -01:00
## Copyright (C) 2016-2020 The Debian Live team
Updating year in copyright notices to 2015.
2015-01-04 18:05:39 -01:00
## Copyright (C) 2006-2015 Daniel Baumann <mail@daniel-baumann.ch>
Updating copyright headers for live-build.
2010-09-02 11:12:37 +00:00
##
Updating GPL standard header in all files.
2012-07-29 23:59:00 +00:00
## This program comes with ABSOLUTELY NO WARRANTY; for details see COPYING.
Updating copyright headers for live-build.
2010-09-02 11:12:37 +00:00
## This is free software, and you are welcome to redistribute it
## under certain conditions; see COPYING for details.
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
set -e
Adding live-helper 1.0~a13-1.
2007-09-23 08:05:11 +00:00
# Including common functions
Making build.sh sourcing more robust (Closes: #684896).
2012-08-27 13:52:29 +00:00
[ -e "${LIVE_BUILD}/scripts/build.sh" ] && . "${LIVE_BUILD}/scripts/build.sh" || . /usr/lib/live/build.sh
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
Adding live-helper 1.0~a13-1.
2007-09-23 08:05:11 +00:00
# Setting static variables
help/usage: fix overly complex script description handling Closes: #952887
2015-02-05 02:30:47 -01:00
DESCRIPTION="Queue install of package lists into chroot"
Allow to optionally run package installation in two passes. Eventually, this allows to have media containing a 'bigger' live system that what they end up installing (Closes: #627439).
2011-06-11 14:36:44 +00:00
USAGE="${PROGRAM} {install|live} [--force]"
_PASS="${1}"
shift
Adding live-helper 1.0~a3-1.
2007-09-23 08:04:48 +00:00
tidy script init (1/4) - arg and config processing Partial fix for #952919 Gbp-Dch: Short
2015-02-05 02:30:47 -01:00
# Processing arguments and configuration files
Init_config_data "${@}"
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
Allow to optionally run package installation in two passes. Eventually, this allows to have media containing a 'bigger' live system that what they end up installing (Closes: #627439).
2011-06-11 14:36:44 +00:00
Echo_message "Begin queueing installation of package lists (${_PASS} pass)..."
Adding live-helper 1.0~a5-1.
2007-09-23 08:04:49 +00:00
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
# Requiring stage file
stagefiles: s/Require_stagefile/Require_stagefiles/ this function takes one or more required stage fileS _plural_, and exits if any are missing (or at least it does now after the refactor). let's rename it to make things more clear Gbp-Dch: Short
2020-03-15 12:05:44 -01:00
Require_stagefiles config bootstrap
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
stagefiles: fix doc mistake missed in final revision of fe9195b59c9647598ecea00900edfe2678bddcac Gbp-Dch: Ignore
2020-03-17 21:09:51 -01:00
# Set non-default stage file name
stagefiles: further robustify with auto filenames as suggested by Raphaël rather than have fixed stagefile filename strings at all in the scripts, use `$(basename $0)` to use the name of the script (which is the same for almost all cases anyway, and the stage files are supposed to be almost exclusively unique per-script). we can thus simplify things by determining the filename for most use cases within the functions themselves. this does change the file used by a couple of scripts, affecting backwards compatibility of executing live-build upon an existing partially or fully completed build: - binary_grub-pc used "binary_grub" - chroot_includes used "includes.chroot" care had to be taken for the following cases: - there are some cases like bootstrap_cache, source_debian and bootstrap_debootstrap which are dealing with more than one file, and/or otherwise a filename that is not specific to the script itself exactly, or should not be based upon its name. - some cases like chroot_cache, bootstrap_cache and chroot_install-packages need to append something to the end of the name depending upon which pass/action mode the script is being executed with. - furthermore in the bootstrap_cache case one of the filenames is used within the bootstrap_debootstrap and thus needs very careful handling to be certain that a change in filename of bootstrap_cache does not break bootstrap_debootstrap. Gbp-Dch: Short
2020-03-13 16:11:53 -01:00
# Setting to default name with appended action name
STAGE_FILE="$(Stagefile_name "${_PASS}")"
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
# Checking stage file
stagefiles: simplify & robustify - avoid all need to pass ".build/" path in stage file names into the functions - add a helper to remove a stage file (required to complete the above properly) - avoid duplicating filenames within scripts which makes them prone to mistakes (some instances of which I've actually encountered and had to fix) Gbp-Dch: Short
2020-03-12 00:21:39 -01:00
Check_stagefile "${STAGE_FILE}"
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
fix comment typo Gbp-Dch: Ignore
2020-03-13 15:19:59 -01:00
# Acquire lock file
locks: tidy lock acquisition Combine the check+create done in each script. (The original functions are still callable as before, but a new combined `Aquire_lockfile` function can be called instead, as now used). Note, a further simplification could be done in removing the passing of the lock filename in as a parameter since every use of the functions is with ".lock". The lock functions already have a fallback to ".build/lock" though. Checking the history, the fallback used to be for a system wide lock, which was then replaced with this config-tree specific one. As long as that is not used implicitly by 3rd-party hooks then surely we are free to change the fallback to ".lock" and further remove passing in a name as a param...? history: db5d2b0dcdae96e712661605e17bc9875e224f9f 0aa8289a3773fd8a3885090b72622c2f95ab099c Gbp-Dch: Short Closes: #952918
2015-02-05 02:30:47 -01:00
Acquire_lockfile
Adding live-helper 1.0~a1-1.
2007-09-23 08:04:46 +00:00
Unifying lb_chroot_packagelists and lb_chroot_local-packagelists.
2011-08-16 18:49:36 +00:00
# Handling local package lists
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
if ! ( ls config/package-lists/*.list > /dev/null 2>&1 || \
Unifying lb_chroot_packagelists and lb_chroot_local-packagelists.
2011-08-16 18:49:36 +00:00
ls config/package-lists/*.list.chroot > /dev/null 2>&1 || \
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
ls config/package-lists/*.list.chroot_${_PASS} > /dev/null 2>&1 )
Unifying lb_chroot_packagelists and lb_chroot_local-packagelists.
2011-08-16 18:49:36 +00:00
then
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
exit 0
fi
Check all dependencies independent of LB_BUILD_WITH_CHROOT Since commit fdc9250bc (Changing package dependency checks within chroot to work outside as well), Check_package automatically checks for LB_BUILD_WITH_CHROOT and works inside as well as outside of the chroot, so no need to check LB_BUILD_WITH_CHROOT before calling them. Install_package and Remove_package are just a no-op when building without chroot, so they can also be called unconditionally. Restore_cache and Save_cache do not check LB_BUILD_WITH_CHROOT but it it should not hurt to call them when not needed (which already happened in some cases). This commit makes all Check_package calls unconditional on LB_BUILD_WITH_CHROOT. For binary_syslinux, this fixes the check (which used outdated paths outside the chroot since 7b6dfd9d1), for binary_grub-efi, binary_package-lists and chroot_package-lists this simplifies the code (but also causes the check to become package-based instead of file-based on apt-based systems), and for binary_loadlin and binary_win32-loader this adds the check outside the chroot which was previously missing.
2017-08-28 09:29:54 +00:00
# Checking depends
Check_package chroot /usr/bin/grep-aptavail dctrl-tools
# Restoring cache
cache: clarify and simplify package cache save/restore These functions are specific to handling packages stored in the cache, not other files. They are also always used with the same `cache/packages.` prefix to the path. Gbp-Dch: Short Closes: #952916
2015-01-06 02:46:37 -01:00
Restore_package_cache chroot
Check all dependencies independent of LB_BUILD_WITH_CHROOT Since commit fdc9250bc (Changing package dependency checks within chroot to work outside as well), Check_package automatically checks for LB_BUILD_WITH_CHROOT and works inside as well as outside of the chroot, so no need to check LB_BUILD_WITH_CHROOT before calling them. Install_package and Remove_package are just a no-op when building without chroot, so they can also be called unconditionally. Restore_cache and Save_cache do not check LB_BUILD_WITH_CHROOT but it it should not hurt to call them when not needed (which already happened in some cases). This commit makes all Check_package calls unconditional on LB_BUILD_WITH_CHROOT. For binary_syslinux, this fixes the check (which used outdated paths outside the chroot since 7b6dfd9d1), for binary_grub-efi, binary_package-lists and chroot_package-lists this simplifies the code (but also causes the check to become package-based instead of file-based on apt-based systems), and for binary_loadlin and binary_win32-loader this adds the check outside the chroot which was previously missing.
2017-08-28 09:29:54 +00:00
# Installing depends
s/Install_package/Install_packages/ it installs one or more, so should be plural for clarity Gbp-Dch: Short
2020-05-05 15:42:44 +00:00
Install_packages
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
if [ -e "${LIVE_BUILD}/share/bin/Packages" ]
then
cp "${LIVE_BUILD}/share/bin/Packages" chroot/bin
else
cp /usr/share/live/build/bin/Packages chroot/bin
fi
for LIST in config/package-lists/*.list \
fix indentation including: - spaces replaced with tabs for consistency - alignment of `;;` in some case statements changed for consistency Gbp-Dch: Short Closes: #952857
2020-02-10 14:48:49 -01:00
config/package-lists/*.list.chroot \
config/package-lists/*.list.chroot_${_PASS}
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
do
if [ -e "${LIST}" ]
Adding shortcut helper for dctrl-tools. This 'Packages' shortcut helper can be used for simplified usage of grep-aptavailable from dctrl-tools. Rather than needing to specify the following explicit command: ! grep-aptavail -n -sPackage -FPriority standard in package lists, the following shortcut can be used: ! Packages Priority standard
2012-07-29 23:53:56 +00:00
then
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
# Generating package list
Expand_packagelist "$(basename ${LIST})" "config/package-lists" \
Don't fail if one of the package lists expands to an empty list When a package lists contains only packages protected by a test that doesn't match for the current run, then Expand_package_list outputs nothing and the following "grep -v" fails because it has not filtered anything. Avoid this by protecting the "grep -v" call with "|| true".
2021-01-12 12:48:27 -01:00
| grep -v '^#' >> chroot/root/packages.chroot || true
Adding shortcut helper for dctrl-tools. This 'Packages' shortcut helper can be used for simplified usage of grep-aptavailable from dctrl-tools. Rather than needing to specify the following explicit command: ! grep-aptavail -n -sPackage -FPriority standard in package lists, the following shortcut can be used: ! Packages Priority standard
2012-07-29 23:53:56 +00:00
fi
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
done
Auto-detect foreign architectures in packagelist. * Add function to output unique list of foreign architectures from an expanded package list. * If foreign architectures are detected, add unique architectures to dpkg and update apt. * This requires users to explicitly list at least _one_ package of a foreign architecture in their package list (e.g. foo:arch) for any other foreign arch dependencies to be handled appropriately.
2013-06-20 15:36:01 +00:00
# Discover unique package architectures in fully-expanded package list
for _PACKAGE_ARCHITECTURE in $(Discover_package_architectures "chroot/root/packages.chroot")
do
# If this is a foreign architecture, append to packages.foreign-architectures
rename LB_ARCHITECTURES to LB_ARCHITECTURE this was previously not done in 8b109ffb96282a6dd1aa5d61aa935bcba69c56f1 to keep the renaming simple, but leaving the variable plural is a cause for confusion. since this property is stored in the INI style config/build config file rather than a shell script based one, at the property there is already singular, there was no need for a backwards compatibility hack. Gbp-Dch: Short
2020-04-01 09:58:47 +00:00
if [ "${_PACKAGE_ARCHITECTURE}" != "${LB_ARCHITECTURE}" ]
Auto-detect foreign architectures in packagelist. * Add function to output unique list of foreign architectures from an expanded package list. * If foreign architectures are detected, add unique architectures to dpkg and update apt. * This requires users to explicitly list at least _one_ package of a foreign architecture in their package list (e.g. foo:arch) for any other foreign arch dependencies to be handled appropriately.
2013-06-20 15:36:01 +00:00
then
rename LB_ARCHITECTURES to LB_ARCHITECTURE this was previously not done in 8b109ffb96282a6dd1aa5d61aa935bcba69c56f1 to keep the renaming simple, but leaving the variable plural is a cause for confusion. since this property is stored in the INI style config/build config file rather than a shell script based one, at the property there is already singular, there was no need for a backwards compatibility hack. Gbp-Dch: Short
2020-04-01 09:58:47 +00:00
Echo_message "Accepting foreign architecture: ${_PACKAGE_ARCHITECTURE}, live image architecture is: ${LB_ARCHITECTURE}"
Auto-detect foreign architectures in packagelist. * Add function to output unique list of foreign architectures from an expanded package list. * If foreign architectures are detected, add unique architectures to dpkg and update apt. * This requires users to explicitly list at least _one_ package of a foreign architecture in their package list (e.g. foo:arch) for any other foreign arch dependencies to be handled appropriately.
2013-06-20 15:36:01 +00:00
echo "${_PACKAGE_ARCHITECTURE}" >> chroot/root/packages.foreign-architectures
fi
done
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
rm -f chroot/bin/Packages
Adding shortcut helper for dctrl-tools. This 'Packages' shortcut helper can be used for simplified usage of grep-aptavailable from dctrl-tools. Rather than needing to specify the following explicit command: ! grep-aptavail -n -sPackage -FPriority standard in package lists, the following shortcut can be used: ! Packages Priority standard
2012-07-29 23:53:56 +00:00
s/Remove_package/Remove_packages/ it removes one or more, so should be plural for clarity Gbp-Dch: Short
2020-05-05 15:45:57 +00:00
Remove_packages
Check all dependencies independent of LB_BUILD_WITH_CHROOT Since commit fdc9250bc (Changing package dependency checks within chroot to work outside as well), Check_package automatically checks for LB_BUILD_WITH_CHROOT and works inside as well as outside of the chroot, so no need to check LB_BUILD_WITH_CHROOT before calling them. Install_package and Remove_package are just a no-op when building without chroot, so they can also be called unconditionally. Restore_cache and Save_cache do not check LB_BUILD_WITH_CHROOT but it it should not hurt to call them when not needed (which already happened in some cases). This commit makes all Check_package calls unconditional on LB_BUILD_WITH_CHROOT. For binary_syslinux, this fixes the check (which used outdated paths outside the chroot since 7b6dfd9d1), for binary_grub-efi, binary_package-lists and chroot_package-lists this simplifies the code (but also causes the check to become package-based instead of file-based on apt-based systems), and for binary_loadlin and binary_win32-loader this adds the check outside the chroot which was previously missing.
2017-08-28 09:29:54 +00:00
# Saving cache
cache: clarify and simplify package cache save/restore These functions are specific to handling packages stored in the cache, not other files. They are also always used with the same `cache/packages.` prefix to the path. Gbp-Dch: Short Closes: #952916
2015-01-06 02:46:37 -01:00
Save_package_cache chroot
Aborting early in chroot_package-lists if no package list is found.
2013-03-27 11:22:58 -01:00
# Creating stage file
stagefiles: simplify & robustify - avoid all need to pass ".build/" path in stage file names into the functions - add a helper to remove a stage file (required to complete the above properly) - avoid duplicating filenames within scripts which makes them prone to mistakes (some instances of which I've actually encountered and had to fix) Gbp-Dch: Short
2020-03-12 00:21:39 -01:00
Create_stagefile "${STAGE_FILE}"