Commit graph

229 commits

Author SHA1 Message Date
Anders Ingemann
65ddee99d7 Fix some links 2015-04-12 15:01:06 +02:00
Anders Ingemann
953987fddf Combine documentation from github wiki with sphinx
This is the first step in the effort of combining all documentation about
bootstrap-vz into sphinx while still being able to access it from github
(github can parse rst as well)
2015-04-11 16:40:44 +02:00
Anders Ingemann
c2b37c7329 Merge pull request #192 from wrigri/disk-resize
Disable resize on disks larger than 2TB
2015-01-31 18:26:15 +00:00
Rick Wright
0d494fb49e Disable resize on disks larger than 2TB
Change-Id: I9764fe2a06cf47e8c0daf38df41c288c280bd6f7
2015-01-29 16:22:30 -08:00
Brian Mattern
4bd71a2dbe Blacklist floppy module to speed up boot by several seconds.
Add UpdateInitramfs task which is needed for this to take effect.
Enable both tasks for GCE.

Console output before
=====================
[    1.877142] sd 0:0:1:0: [sda] Attached SCSI disk
[    1.880163] sd 0:0:1:0: Attached scsi generic sg0 type 0
[    2.684132] tsc: Refined TSC clocksource calibration: 2500.000 MHz
[    4.824081] floppy0: no floppy controllers found
[    5.103671] work still pending
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... done.
[    5.313107] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
...
[    7.751955] alg: No test for crc32 (crc32-pclmul)
[   10.728078] floppy0: no floppy controllers found
[   11.006680] work still pending
[....] Activating swap... done
[   11.258954] EXT4-fs (sda1): re-mounted. Opts: (null)

Console output after
====================
[    1.829785] sd 0:0:1:0: [sda] Attached SCSI disk
[    1.832806] sd 0:0:1:0: Attached scsi generic sg0 type 0
Begin: Loading essential drivers ... done.
Begin: Running /scripts/init-premount ... done.
Begin: Mounting root file system ... Begin: Running /scripts/local-top ... done.
Begin: Running /scripts/local-premount ... done.
[    1.969862] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null)
...
[    2.878920] alg: No test for crc32 (crc32-pclmul)
[....] Activating swap... done
[    2.986642] EXT4-fs (sda1): re-mounted. Opts: (null)

Delint.

Delint
2015-01-24 13:17:42 -08:00
Noah Fontes
4093693c2e Add support for enhanced networking on EC2.
This change adds a provider option, enhanced_networking,
which installs the Intel virtual networking driver for
SR-IOV using DKMS. It also modifies the EC2 AMI registration
to include support for SR-IOV.
2014-11-29 13:46:57 -08:00
Tim Smith
7944db886f Enable auto-rootdisk growth on gce-backports.
This commit adds the cloud-initramfs-growroot package to the
installation list for GCE images with backports enabled, and updates
the gce tasklist to add the /etc/init.d/expand-root script
(with provider-appropriate touch-ups) to the image.
2014-10-13 10:02:15 -07:00
Rick Wright
96a1683c26 Fix task ordering to better support customizations
This ensures that preferences are written before apt update and also ensures
that in GCE the backports are added to the sources before the provider-specific
SetPackageRepositories happens.

Change-Id: I3c85f922c49c2a6fbd3c0f2bad1072eff0d098c8
2014-09-08 11:45:55 -07:00
Tiago Ilieve
89a74a33c8 Fix linux-headers package version detection
The `uname -r` command returns the version of the running kernel running
on the host machine, as the chroot environment doesn't load a new one.
This prevents the proper version of the `linux-headers-*` package from
being added when the target has a different kernel version or
architecure.

This closes #121.
2014-09-02 19:53:10 -03:00
Jimmy Kaplowitz
89e1a701eb Disable SSH password auth on GCE
This change was unintentional but occurred as part of GCE's transition
from build-debian-cloud to bootstrap-vz.

Might be replaced later with a similar change that applies to all
bootstrap-vz providers, based on the opinion of the debian-cloud list.

Change-Id: I72a694c49f32df06252d9cc01b1d5c7cfc015347
2014-08-14 18:10:54 -07:00
Jimmy Kaplowitz
3bfe9dddf9 Reinstate hostname hook for GCE
This DHCP exit hook to shorten the system hostname on GCE was previously
installed by build-debian-cloud and bootstrap-vz, but seems to have been
inadvertently removed in commit c81045cc6e
as part of a broad cross-cloud cleanup. Again, this was caught by our
validation tests, and we might be done with the fixes at this point.

In this commit, I'm reinstating the hook with a name change and an
explanatory comment, to reduce the risk of this vanishing accidentally
in the future.

Change-Id: I4e7268f8b9ab3b2a7fc8b510898c6fbdd685aa53
2014-08-05 17:56:33 -07:00
Anders Ingemann
9f46bdc519 Merge pull request #131 from jkaplowitz/cloudsdk
Install Cloud SDK, which includes gcutil and gsutil.
2014-08-05 17:12:51 -06:00
Jimmy Kaplowitz
a352f4d576 Installing Cloud SDK which includes gcutil and gsutil. We still don't
have a package for it so laying out the tarball for now.

Change-Id: If66f0f1c074e6077e1ca57375cac9c4832bbd7fc
2014-08-01 20:05:23 -07:00
Anders Ingemann
7ad565cbe9 Merge pull request #126 from jkaplowitz/development
Install ca-certificates on GCE
2014-07-28 21:39:56 +02:00
Jimmy Kaplowitz
e8f04d0baf Install ca-certificates on GCE
Needed to fetch GCE startup scripts over HTTPS, among other reasons.

Change-Id: I89e3afb44f786539b5e3275b5f1f3b7201ab44fd
2014-07-25 09:49:52 -07:00
Jimmy Kaplowitz
c412c4cdcf Fix list of tasks and their ordering
- GCE provider wasn't including the GCE SetHostname task, without which
  https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=604883 was
  preventing the hostname from getting set after reboot.
- During the GCE build, one of the GCE cleaning tasks was trying to run
  an apt-get update after the build-time resolv.conf file was removed.
  Fix this ordering by moving the network.Remove* tasks to the
  system_cleaning phase as they should have been all along, and adding
  an appropriate ordering rule for the GCE cleaning task.
- Add the fallback http.debian.net mirror after, not before, our mirror.
- The puppet plugin's ApplyPuppetManifest task specified that it should
  run before the network.Remove* tasks within the system_modification
  phase. Now that those tasks have been moved to a later phase
  (system_cleaning), remove this dependency. I have no puppet manifest
  to test this change, but am including it in hopes of avoiding a
  breakage there. Hopefully someone who uses puppet can test this or at
  least confirm that it's correct.

Change-Id: Ieca97f288f456bab119989f4cbc4c3993a755830
2014-07-24 20:20:54 -07:00
Tiago Ilieve
719a6c31b0 Reverting 210999f, as asked by @jkaplowitz 2014-07-25 00:08:07 -03:00
Anders Ingemann
af3cca2644 Remove unused import 2014-07-12 19:56:30 +02:00
Anders Ingemann
b953cf7757 Merge pull request #120 from rybaktomasz/boto-credentials
Do not crash with KeyError when there is no credentials in manifest.
2014-07-12 19:47:03 +02:00
Tiago Ilieve
8f43ee1dc7 Move AddBackports to common.tasks.apt
The `AddBackports` task is needed by many different plugins, so is
better if it is available as a common task.

This closes #96.
2014-07-12 14:42:52 -03:00
Tomasz Rybak
d6fe85e124 Do not crash with KeyError when there is no credentials in manifest. 2014-07-12 19:40:53 +02:00
Tiago Ilieve
210999ff5d Remove redundant code from GCE's tasks.apt
GCE's `tasks.apt.SetPackageRepositories` was adding duplicated entries
to apt `info.source_lists`, even ignoring the package mirror specified
on manifest.
2014-07-12 13:28:46 -03:00
Anders Ingemann
9d8821235f Clone packages-kernels.yml pattern to other providers
GCE also gets its own file.
For now, this scales - but we might want to refactor when there is more that just the kernel package we need to choose from
2014-07-09 23:17:05 +02:00
Anders Ingemann
e4a9cc837a Differentiate installation of grub 1.99 and grub 2 2014-07-09 23:17:05 +02:00
Anders Ingemann
03a0746299 Convert every JSON file to YAML
Lines removed: over 500. Readiblity gained: A shitload
Now you can actually get an overview of a manifest on a single screen height.
I am sure that it will also save a lot of hassle when modifying schema in the future.
No more "expected property name" etc. because of an extraneous comma
Comments are of course natively support, so there's no need for this minify_json hokey pokey
2014-07-09 23:17:04 +02:00
Anders Ingemann
ebba39f59b Convert "provider" into provider specific section
This is where all provider specific settings belong
like waagent on azure, guest additions iso path on vbox and virtualization type on ec2
2014-07-09 23:17:04 +02:00
Anders Ingemann
5bb0e5428e Merge pull request #117 from zeridon/fix-grub-options
Improvement in grub options for ec2
2014-07-09 23:13:07 +02:00
Tomasz Rybak
62b3e9c255 Jessie has different kernel for i386, fixing name for EC2. 2014-07-08 20:59:16 +02:00
Tomasz Rybak
ebee46b57f Fix wrong condition in dhcpcd configuration in Jessie. 2014-07-06 19:13:46 +02:00
Tomasz Rybak
5433963f4e Jessie contains dhcpcd5 instaed of dhcpcd; fixing configuration. 2014-07-06 19:05:00 +02:00
Anders Ingemann
55c853c348 Fix call to boto get_all_images() 2014-07-05 11:08:21 +02:00
Vladimir Vitkov
94b3e4605a Improvement in grub options
* Be more robust when setting GRUB_CMDLINE_LINUX_DEFAULT
 * Stop console from blanking
 * Switch elevator to noop as disks are not real disks and this yields
   better performance.
2014-07-02 15:04:54 +03:00
Tomasz Rybak
7412ca26d0 Do not require AWS credentials in manifest file
Boto allows for storing credentials in ~/.boto file; user those
if user has not provider one in manifest file.
2014-06-30 20:23:44 +02:00
Vladimir Vitkov
68d9ee1096 Improve ami listing performance
* no need to list all available ami's, just self owned should be enough
2014-06-19 17:55:05 +03:00
Tiago Ilieve
65bdb34d77 Save downloaded gsutil tarball to workspace
`gsutil` tarball was being downloaded to the current working directory
and wasn't removed after its extraction.

This will be useful until #87 is merged.
2014-06-07 13:31:10 -03:00
Tiago Ilieve
80d0dfb939 Add volume.Delete to GCE taskset
This closes #97.
2014-06-07 12:48:46 -03:00
Anders Ingemann
4f45749e13 Check if qemu-img is available 2014-05-22 17:28:17 +02:00
Anders Ingemann
53406e2b35 Merge pull request #88 from proppy/add-gce-init
add InstallInitScript task to gce provider
2014-05-13 01:02:17 +02:00
Anders Ingemann
02c683120a Refactor tasklist for easier integration by taskoverview 2014-05-10 17:28:31 +02:00
Johan Euphrosine
fdf11fcc1a providers/gce: add InstallInitScript task 2014-05-09 00:31:36 -07:00
Anders Ingemann
f50a8e66ce Merge branch 'master' into development
Conflicts:
	.gitignore
	bootstrapvz/common/tasks/apt.py
	bootstrapvz/plugins/cloud_init/__init__.py
	bootstrapvz/plugins/cloud_init/tasks.py
	tox.ini
2014-05-08 23:00:54 +02:00
Anders Ingemann
20eabc8aca Fix #21, check the AWS user-id on S3 manifests 2014-05-04 14:02:38 +02:00
Anders Ingemann
a3b84737f1 HVM AMIs only work when EBS backed right now.
S3 backed AMIs only work when they are unpartitioned.
Remove json schema restriction and add some nicer messages in the validation function
2014-05-04 13:46:40 +02:00
Anders Ingemann
612fe46186 Add restriction on partition type for HVM AMIs 2014-05-04 13:41:16 +02:00
Anders Ingemann
3e4882128e Fix wrong bootloader vs. virtualization check 2014-05-04 13:41:16 +02:00
Anders Ingemann
40f208c151 Fix AdjustExpandRootScript
Also, only add it when it is required
2014-05-04 13:41:16 +02:00
Anders Ingemann
f3d633780f Use string concatenation instead of format()
String concatenation can at times be easier to read that format().
One should choose whichever approach is more readable.
2014-05-04 13:41:15 +02:00
Anders Ingemann
b25e607388 Move "sections" setting into "packages" section.
Rename it to "components", which is the real name for it (see http://manpages.debian.org/cgi-bin/man.cgi?query=sources.list).
2014-05-03 21:57:12 +02:00
Anders Ingemann
e68ed9b66c Fix import errors, again.
(A rebase swallowed a commit somewhere)
2014-05-03 17:04:37 +02:00
Anders Ingemann
7958950d19 Generalize "grub only on partitioned volumes" err
(move it into base manifest validation)
2014-05-03 16:13:49 +02:00