Difference between revisions of "Buildroot:IT Infrastructure"

From eLinux.org
Jump to: navigation, search
(Defconfig testing)
(Update DNS and sources.buildroot.org info)
(10 intermediate revisions by 3 users not shown)
Line 2: Line 2:
  
 
* buildroot.org
 
* buildroot.org
** Owner??
+
** Sponsored by Earl Levine, Owner: Peter Korsgaard
 
* buildroot.net
 
* buildroot.net
** Owner??
+
** Owner: Peter Korsgaard
 +
 
 +
* DNS for both handled through http://gratisdns.dk
  
 
= Web site =
 
= Web site =
Line 10: Line 12:
 
* Source in the main Buildroot Git repository, in docs/website/
 
* Source in the main Buildroot Git repository, in docs/website/
 
* Automatically pulled on the server by ???
 
* Automatically pulled on the server by ???
* Hosted by ???
+
* Hosted by osuosl.org, VM shared with busybox/uclibc
  
 
= Autobuilder =
 
= Autobuilder =
  
* autobuild.buildroot.org points to a machine hosted by ThomasPetazzoni, a dedicated server he is renting
+
* http://autobuild.buildroot.org points to a machine hosted by [[User:ThomasPetazzoni]], a dedicated server he is renting
 
* This infrastructure tests random configurations
 
* This infrastructure tests random configurations
* The site runs the code at https://git.busybox.net/buildroot-test, in the web/ subdirectory. It is made of very ugly PHP, backed by a MySQL database.
+
* The site runs the code at https://git.buildroot.net/buildroot-test, in the <code>web/</code> subdirectory. It is made of very ugly PHP code, backed by a MySQL database.
* The autobuild.buildroot.org doesn't do any builds itself, it only collects build results that are HTTP POSTed by other machines, called build slaves
+
* The autobuild.buildroot.org machine doesn't do any builds itself, it only collects build results that are HTTP POSTed by other machines, called build slaves
* The build slaves run the Python script at https://git.busybox.net/buildroot-test/tree/scripts/autobuild-run
+
* The build slaves run the Python script at https://git.buildroot.net/buildroot-test/tree/scripts/autobuild-run
 
* Currently used build slaves:
 
* Currently used build slaves:
 
** Free Electrons build server, managed by ThomasPetazzoni
 
** Free Electrons build server, managed by ThomasPetazzoni
 +
** gcc10, gcc20 from the GCC compile farm, managed by Peter Korsgaard
 
** ...
 
** ...
 
* People having account to HTTP POST build results:
 
* People having account to HTTP POST build results:
Line 35: Line 38:
 
** ahentschel
 
** ahentschel
  
= Defconfig testing =
+
= Mailing list =
 
 
* A Github project at https://github.com/buildroot/buildroot-defconfig-testing has a .travis.yml file which describes how to build all the defconfigs.
 
* This Github project is registered on Travis-CI.org at https://travis-ci.org/buildroot/buildroot-defconfig-testing.
 
* Every two days, a cronjob that runs on ThomasPetazzoni dedicated server runs the update.sh shell script from the buildroot-defconfig-testing project, which:
 
** Updates .travis.yml to use the latest commit of the Buildroot Git repository
 
** Updates .travis.yml with the latest list of defconfigs
 
** Push the result, which has the effect of triggering the build on Travis-CI.org
 
* Notification of the build results is made on IRC, both on failure and success
 
  
= Mailing list =
+
* https://buildroot.org/lists/buildroot/
 +
* Mailman server, maintained by osuosl.org
  
 
= Bug tracker =
 
= Bug tracker =
 +
* https://bugs.buildroot.net/
 +
* Bugzilla, hosted on buildroot/busybox/uclibc VM (osuosl.org)
 +
* Maintained by Mike Frysinger
 +
* Instance shared with busybox/uclibc
  
 
= Git repository =
 
= Git repository =
  
* The main Git repository is at https://git.busybox.net/buildroot, hosted by ???
+
* The main Git repository is at https://git.buildroot.net/buildroot, hosted by osuosl.org
** E-mail notification messages are sent to the mailing list using ??? hosted by ???
+
** E-mail notification messages are sent to the mailing list using /git/hooks/send-email hosted by osuosl.org
** IRC notification messages are posted using ??? hosted by ???
+
** IRC notification messages are posted using irkerbot (/git/hooks/post-receive) hosted by osuosl.org
 
* A secondary Git repository is on Github at https://github.com/buildroot/buildroot
 
* A secondary Git repository is on Github at https://github.com/buildroot/buildroot
 
** Mainly to have an official Github mirror, rather than only unofficial forks of Buildroot
 
** Mainly to have an official Github mirror, rather than only unofficial forks of Buildroot
 
** Kept in sync with the main Git repository by a cronjob run every 10 minutes on ThomasPetazzoni dedicated server.
 
** Kept in sync with the main Git repository by a cronjob run every 10 minutes on ThomasPetazzoni dedicated server.
 +
* Another mirror on Gitlab at https://gitlab.com/buildroot.org/buildroot - details below
 +
 +
= Gitlab project =
 +
 +
* Gitlab group buildroot.org, with project https://gitlab.com/buildroot.org/buildroot
 +
** Administrators are Peter, Thomas and Arnout
 +
* Main purpose is to run automatic tests
 +
** controlled by .gitlab-ci.yml in the repository itself
 +
** https://gitlab.com/buildroot.org/buildroot/pipelines
 +
** triggered on every push to the repository
 +
** mail is sent to mailing list when pipeline fails
 +
** for convenience, CI runs in a custom docker image, https://hub.docker.com/r/buildroot/base/
 +
*** generated from support/docker/Dockerfile
 +
*** not generated automatically, since this can't be done from Gitlab-CI itself
 +
* Repository is synced from git.buildroot.org
 +
** In principle once per day, but sometimes pull fails
 +
** Better approach: push to the repo from a cron job - TBD
 +
* Irker and commit emails could be run from here as well, but currently aren't.
  
 
= Sources.buildroot.net =
 
= Sources.buildroot.net =
  
 
* Mirror of (nearly?) all Buildroot tarballs/patches.
 
* Mirror of (nearly?) all Buildroot tarballs/patches.
* To be completed by Peter.
+
* Runs on a dedicated VM hosted by osuosl.org
 +
* Cronjob updating mirror every 2 hours doing make randconfig +
 +
  make -k BR2_BACKUP_SITE='' $(find -name \*.mk|sed 's|.*/\([^/]*\)\.mk|\1-source host-\1-source|')
 +
* Also generates nightly documentation for nightly.buildroot.net every 6 hours:
 +
  make manual-html manual-pdf manual-text
 +
 
 +
= Patchwork =
 +
* Available at http://patchwork.ozlabs.org/project/buildroot/ or the alias http://patchwork.buildroot.net (HTTP redirect running on sources.buildroot.net)
 +
* Hosted by Jeremy Kerr, from Ozlabs. He is the point of contact in case of patchwork issues.

Revision as of 07:41, 21 May 2019

Domain names

  • buildroot.org
    • Sponsored by Earl Levine, Owner: Peter Korsgaard
  • buildroot.net
    • Owner: Peter Korsgaard

Web site

  • Source in the main Buildroot Git repository, in docs/website/
  • Automatically pulled on the server by ???
  • Hosted by osuosl.org, VM shared with busybox/uclibc

Autobuilder

  • http://autobuild.buildroot.org points to a machine hosted by User:ThomasPetazzoni, a dedicated server he is renting
  • This infrastructure tests random configurations
  • The site runs the code at https://git.buildroot.net/buildroot-test, in the web/ subdirectory. It is made of very ugly PHP code, backed by a MySQL database.
  • The autobuild.buildroot.org machine doesn't do any builds itself, it only collects build results that are HTTP POSTed by other machines, called build slaves
  • The build slaves run the Python script at https://git.buildroot.net/buildroot-test/tree/scripts/autobuild-run
  • Currently used build slaves:
    • Free Electrons build server, managed by ThomasPetazzoni
    • gcc10, gcc20 from the GCC compile farm, managed by Peter Korsgaard
    • ...
  • People having account to HTTP POST build results:
    • tpetazzoni
    • pkorsgaard
    • rbraun
    • nroach
    • mweber
    • mhadjinlian
    • jboibessot
    • vriera
    • gustavo
    • ymorin
    • ahentschel

Mailing list

Bug tracker

  • https://bugs.buildroot.net/
  • Bugzilla, hosted on buildroot/busybox/uclibc VM (osuosl.org)
  • Maintained by Mike Frysinger
  • Instance shared with busybox/uclibc

Git repository

  • The main Git repository is at https://git.buildroot.net/buildroot, hosted by osuosl.org
    • E-mail notification messages are sent to the mailing list using /git/hooks/send-email hosted by osuosl.org
    • IRC notification messages are posted using irkerbot (/git/hooks/post-receive) hosted by osuosl.org
  • A secondary Git repository is on Github at https://github.com/buildroot/buildroot
    • Mainly to have an official Github mirror, rather than only unofficial forks of Buildroot
    • Kept in sync with the main Git repository by a cronjob run every 10 minutes on ThomasPetazzoni dedicated server.
  • Another mirror on Gitlab at https://gitlab.com/buildroot.org/buildroot - details below

Gitlab project

  • Gitlab group buildroot.org, with project https://gitlab.com/buildroot.org/buildroot
    • Administrators are Peter, Thomas and Arnout
  • Main purpose is to run automatic tests
  • Repository is synced from git.buildroot.org
    • In principle once per day, but sometimes pull fails
    • Better approach: push to the repo from a cron job - TBD
  • Irker and commit emails could be run from here as well, but currently aren't.

Sources.buildroot.net

  • Mirror of (nearly?) all Buildroot tarballs/patches.
  • Runs on a dedicated VM hosted by osuosl.org
  • Cronjob updating mirror every 2 hours doing make randconfig +
 make -k BR2_BACKUP_SITE= $(find -name \*.mk|sed 's|.*/\([^/]*\)\.mk|\1-source host-\1-source|')
  • Also generates nightly documentation for nightly.buildroot.net every 6 hours:
 make manual-html manual-pdf manual-text

Patchwork