Difference between revisions of "Testing Presentations"

From eLinux.org
Jump to: navigation, search
(From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017])
(add syzkaller talk from ELCE 2020)
 
(37 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
='''Kernel CI'''=
 
='''Kernel CI'''=
 +
== Let’s Test with KernelCI [ELCE 2020] ==
 +
'''Presenter:''' Khouloud Touil, Baylibre<br>
 +
'''Summary:'''
 +
This talk gives an introduction to KernelCI, and shows
 +
how to set up the environment, and make and run a test.
 +
 +
* [[Media:Lets_Test_with_KernelCI.pdf | PDF]] | [https://www.youtube.com/watch?v=HgkPqAzq_Kg Video]
  
 
== Bootstraping a Local KernelCI [ELC 2019] ==
 
== Bootstraping a Local KernelCI [ELC 2019] ==
Line 8: Line 15:
 
KernelCI phases of build, boot, test and results collection. <br>
 
KernelCI phases of build, boot, test and results collection. <br>
  
* [https://elinux.org/images/8/86/Bootstraping_Local_KernelCI.pdf PDF] | [https://www.youtube.com/watch?v=ApoTzhc1IY0 VIDEO]
+
* [[Media:Bootstraping_Local_KernelCI.pdf | PDF]] | [https://www.youtube.com/watch?v=ApoTzhc1IY0 VIDEO]
 
 
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2019] ==
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Summary:'''
 
This presentation provides information about build failing, <br>
 
boot failing and display build status. <br>
 
 
 
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://elinux.org/images/f/ff/Kernelci.pdf VIDEO]
 
 
 
== Introducing the "Lab in a Box" Concept [ELC 2018] ==
 
'''Presenter:''' Patrick Titiano & Kevin Hillman, Baylibre <br>
 
'''Summary:'''
 
This presentation provides information about the quality <br>
 
level without the leveraging CI and test automation. <br>
 
 
 
* [https://elinux.org/images/b/b4/Introducing_The_%E2%80%9CLab_in_a_Box%E2%80%9D_Concept_%28ELC-2018-Portland%29.pdf PDF] | [https://www.youtube.com/watch?v=aavoHUpzBGU VIDEO]
 
  
 
== BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]==
 
== BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]==
Line 31: Line 22:
 
This BoF will provide a very brief overview and current status of kernelci<br>
 
This BoF will provide a very brief overview and current status of kernelci<br>
  
* [https://elinux.org/images/f/f6/Hilman.pdf PDF] | [https://youtu.be/37t-U0PGNlw VIDEO]
+
* [[Media:Hilman.pdf | PDF]] | [https://youtu.be/37t-U0PGNlw VIDEO]
  
== Mark Brown, Linaro & Kevin Hilman, BayLibre [ELCE 2016] ==
+
== Kernelci.org Needs YOU!  [ELCE 2016] ==
'''Presenter:''' Kernelci.org Needs YOU! <br>
+
'''Presenters:''' Mark Brown, Linaro & Kevin Hilman, BayLibre<br>
 
'''Summary:'''
 
'''Summary:'''
 
This presentation provides information about kernelci.org, <br>
 
This presentation provides information about kernelci.org, <br>
 
Lab setup, and LAVA v2 installations. <br>
 
Lab setup, and LAVA v2 installations. <br>
  
* [https://elinux.org/images/b/b9/Brown.pdf PDF] | [https://youtu.be/xaQuNM01YNo?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
+
* [[Media:Brown.pdf | PDF]] | [https://youtu.be/xaQuNM01YNo?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
  
 
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
 
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
Line 47: Line 38:
 
part of KernelCI project. <br>
 
part of KernelCI project. <br>
  
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF]
+
* [[Media:Kernelci.pdf | PDF]]
  
== BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]==
+
= '''FUEGO''' =
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Summary:'''
 
This BoF will provide a very brief overview on Kernel upstreaming as <br>
 
part of KernelCI project. <br>
 
 
 
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF]
 
 
 
==BoFs: kernelci.org [ELCE 2015] ==
 
'''Presenter:''' Kevin Hilman, Linaro <br>
 
'''Summary:'''
 
This presentation provides information about the upstream kernel CI <br>
 
and the current state of the upstream tree. <br>
 
  
* [https://elinux.org/images/f/ff/Kernelci.pdf PDF] | [https://www.youtube.com/watch?v=F66Ff93503E VIDEO]
+
Also, see more talks at: http://fuegotest.org/wiki/Presentations
 
 
= '''FUEGO''' =
 
  
 
== Fuego test sytem [ELC 2019] ==
 
== Fuego test sytem [ELC 2019] ==
Line 89: Line 66:
  
 
* [https://elinux.org/images/1/13/OSSJ_Renesas_Fuego_enhancement_KhiemNguyen_20170531_Rev1.0.pdf PDF]
 
* [https://elinux.org/images/1/13/OSSJ_Renesas_Fuego_enhancement_KhiemNguyen_20170531_Rev1.0.pdf PDF]
 +
 +
== Introduction to the Fuego Test System [ELC 2016] ==
 +
'''Presenter:''' Tim Bird, Sony Mobile<br>
 +
'''Summary:'''
 +
Gives a basic introduction to the Fuego test system.  Fuego is geared towards testing
 +
embedded products, with a host-target architecture and many pre-packaged tests.
 +
 +
* [[Media:Introduction-to-Fuego-ELC-2016.pdf|PDF]] | [https://youtu.be/AueBSRN4wLk VIDEO]
 +
 +
= '''LAVA''' =
 +
== From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017] ==
 +
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland
 +
'''Summary:'''
 +
This talk presents an introduction to LAVA - how to set it up and execute tests in
 +
your own lab.
 +
 +
* [[Media:From_zero_to_first_test_in_your_own_LAVA_laboratory.pdf|PDF]] | [https://www.youtube.com/g4Hw5I2sk3A VIDEO]
 +
 +
= '''Syzkaller''' =
 +
== Fuzzing Linux Drivers with Syzkaller [ELCE 2020] ==
 +
'''Presenter:''' Ricardo Canuelo, Collabora<br>
 +
'''Summary:'''
 +
This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing
 +
tool designed for use with the Linux kernel.
 +
 +
* [[Media:ELCE_2020_Syzkaller.pdf | PDF]] | [https://www.youtube.com/watch?v=dRoRJ4B2Nvc Video]
  
 
= '''Automation''' =
 
= '''Automation''' =
Line 123: Line 126:
 
* [https://elinux.org/images/a/af/DistributedCrossPlatformTest.pdf PDF]
 
* [https://elinux.org/images/a/af/DistributedCrossPlatformTest.pdf PDF]
  
= '''Board Farms''' =
+
= '''Automation/Farm Hardware''' =
 +
 
 +
== Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021] ==
 +
'''Presenter:'''Chris Fiege, Pengutronix e.K.<br>
 +
'''Summary:'''
 +
This talk presents the benefits and challenges of managing boards in a board farm.
 +
Using USB for the majority of the hardware connections in a farm presents problems.
 +
A new "Test Automation Controller" is introduced, which connects to the farm
 +
infrastructure via a single network connection, and to the board via various hardware
 +
connections.
 +
 
 +
* [[Media:cfi_Automated-Testing.pdf | PDF]]
 +
 
 +
== Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019] ==
 +
'''Presenter:''' Jerome Neanne, BayLibre & Pascal Mareau, NXP<br>
 +
'''Summary:'''
 +
This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an
 +
automated testing framework to control it, for doing automated testing of embedded board
 +
response to varying thermal conditions.  It also discusses the rationale for thermal response
 +
testing.
 +
 
 +
* [[Media:Thermo-Regulated Power Management Platform_ELC2019.pdf | PDF]] | [https://youtu.be/l-S4ZRslgRY VIDEO]
  
== Testing Laboratory Layers [ELC 2019] ==
+
== Introducing the "Lab in a Box" Concept [ELC 2018] ==
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
+
'''Presenter:''' Patrick Titiano & Kevin Hillman, Baylibre <br>
 
'''Summary:'''
 
'''Summary:'''
These slides cover API design decisions for testing laboratories <br>
+
This presentation provides information about the quality <br>
focusing on the SLAV test lab stack case and shifting to a user-centric <br>
+
level without the leveraging CI and test automation. <br>
perspective and possible outcome of such process. <br>
 
  
* [https://elinux.org/images/3/3c/Test_Lab_API.pdf PDF] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
+
* [[Media:Introducing_The_%E2%80%9CLab_in_a_Box%E2%80%9D_Concept_%28ELC-2018-Portland%29.pdf | PDF]] | [https://www.youtube.com/watch?v=aavoHUpzBGU VIDEO]
  
 
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
 
== Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018] ==
Line 150: Line 173:
 
* [[Media:Kopasiak_grabbing_a_v_on_a_farm.pdf | PDF]] | [https://youtu.be/mw79nfp7ARE  VIDEO]
 
* [[Media:Kopasiak_grabbing_a_v_on_a_farm.pdf | PDF]] | [https://youtu.be/mw79nfp7ARE  VIDEO]
  
== From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017] ==
+
 
'''Presenter:''' Pawel Wieczorek, Samsung R&D Institute Poland <br>
+
= '''Board Farms''' =
 +
 
 +
== Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021] ==
 +
'''Presenters:''' Tim Bird, Sony Electronics & Harish Bansal, Timesys
 +
'''Summary:'''
 +
This talk give an update on a proposed REST API for controlling
 +
boards and resources in an automated testing lab.  A generic
 +
resource model, and data capture APIs are highlighted.
 +
 
 +
* [[Media:ELC-2021-Board-Farm-Update-Bansal-Bird.pdf | PDF]]
 +
 
 +
== Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020] ==
 +
'''Presenters:''' Tim Bird, Sony & Harish Bansal, Timesys
 +
'''Summary:'''
 +
This talk presents an API for abstracting control
 +
of resources in a board farm. A REST API is presented, along
 +
with demos and details of the implementation.
 +
 
 +
* [[Media:ELC-Board-Farm-API-Sony-Timesys-2020-10-27.pdf | PDF]] | [https://www.youtube.com/watch?v=ePYHuWyb0uk Video]
 +
 
 +
== Testing Laboratory Layers [ELC 2019] ==
 +
'''Presenter:''' Paweł Wieczorek, Samsung R&D Institute Poland <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation talks about setting up one's own Test Lab using LAVA <br>
+
These slides cover API design decisions for testing laboratories <br>
 +
focusing on the SLAV test lab stack case and shifting to a user-centric <br>
 +
perspective and possible outcome of such process. <br>
  
* [[Media:From_zero_to_first_test_in_your_own_LAVA_laboratory.pdf | PDF]] | [https://www.youtube.com/g4Hw5I2sk3A VIDEO]
+
* [[Media:Test_Lab_API.pdf | PDF]] | [https://www.youtube.com/watch?v=gWVp9JqVTog VIDEO]
  
 
== Farming together [ELCE 2017] ==
 
== Farming together [ELCE 2017] ==
Line 183: Line 229:
 
power, monitor and automating boards in your farm. <br>
 
power, monitor and automating boards in your farm. <br>
  
* [https://elinux.org/images/b/b5/Herd_Your_Boards.pdf PDF] | [https://youtu.be/kwqmjeqAx-E?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
+
* [https://elinux.org/images/b/b5/Herd_Your_Boards.pdf PDF] | [https://youtu.be/kwqmjeqAx-E VIDEO]
  
 
= '''Test Suites''' =
 
= '''Test Suites''' =
 
+
== FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020] ==
== Linux Kernel Selftest Framework - Quality Control for New Releases [ELC 2015] ==
+
'''Presenter:''' Jan-Simon Moller, The Linux Foundation<br>
'''Presenter:''' Shuah Khan, Samsung <br>
 
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about running the kselftest,kselftest <br>
+
This talk presents a variety of static analysis tools that can be used to
git, installation of the self-test, and run test from the install location. <br>
+
perform static analysis on the source code base for an embedded product.
 
+
Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'.
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
+
The tools and their capabilities for testing are introduced.
  
= '''Others''' =
+
* [[Media:ELCE FOSS Static Analysis Tools for Embedded Systems and How to Use Them.pdf | PDF]] | [https://www.youtube.com/watch?v=aluDoi5p8h8 Video]
  
== Tips for Writing Good Tests for Linux [ELC 2018] ==
+
== Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019] ==
'''Presenter:''' Tim Bird, Sony Corporation <br>
+
'''Presenter:''' Colin Ian King, Canonical<br>
 
'''Summary:'''
 
'''Summary:'''
This talk will review and compare different test writing frameworks, <br>
+
This talk gives a great overview of stress-ng and how it can be used to perform a
including kself-test, LTP and Fuego, and describe each one's strengths <br>
+
variety of tests on a Linux platform.  There are many examples of different sub-tests
and weaknesses. A basic introduction to writing a test in each one will be given.<br>
+
and options (with command line arguments), as well as output and tracing options.
  
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
+
* [[Media:Lyon-stress-ng-presentation-oct-2019.pdf | PDF]] | [https://youtu.be/8QaXStKfq3A Video]
  
== Impact of Platform Firmware on Linux Kernel [ELC 2018] ==
+
== Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018] ==
 
'''Presenter:''' Megha Dey & Sal Praneeth Prakhya, Intel <br>
 
'''Presenter:''' Megha Dey & Sal Praneeth Prakhya, Intel <br>
 
'''Summary:'''
 
'''Summary:'''
Line 216: Line 261:
 
* [https://elinux.org/images/b/b7/Impact_of_platform_firmware_on_linux_kernel.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
 
* [https://elinux.org/images/b/b7/Impact_of_platform_firmware_on_linux_kernel.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
  
== Keynote: The Maintainer's Paradox [ELC 2018] ==
+
== Kselftest ==
'''Presenter:''' Tim Bird, Sr. Software Engineer, Sony <br>
+
=== Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021] ===
 +
'''Presenter:''' Shuah Khan, Linux Foundation
 
'''Summary:'''
 
'''Summary:'''
The overall goal is to improve Linux for use in consumer electronics <br>
+
Presents an overview of kselftest and kernel  testing in general, with details
products, by improving Linux system testing, directing technical initiatives <br>
+
about how to run the included tests.
of the Linux Foundation and encouraging companies to participate in the open <br>
 
source community. <br>
 
  
* [https://elinux.org/images/4/4e/The-Maintainers-Paradox-2018-ELC-Tim-Bird.pdf PDF] | [https://www.youtube.com/watch?v=7aME1lxY71Q VIDEO]
+
* [[Media:Mentorship-Session_-Kernel-Validation-With-Kselftest.pdf|PDF]] | [https://www.youtube.com/watch?v=mpO_iDEMqWQ VIDEO]
  
== Herd Your Boards, Become a Farmer [ELCE 2016] ==
+
=== KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020] ===
'''Presenter:''' Geert Uytterhoeven, Glider bvba <br>
+
'''Presenter:''' Shuah Khan, Linux Foundation
 +
'''Summary:'''
 +
Discusses the current status of kselftest, and in particular how it is being used
 +
with KernelCI, and what additional features are needed for improved KernelCI integration.
 +
 
 +
* [[Media:Kselftest_Running_in_Test_Rings_-_Where_Are_We-ELC-2020.pdf | PDF]] | [https://youtu.be/qvvPSgwyYwg VIDEO]
 +
 
 +
=== Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015] ===
 +
'''Presenter:''' Shuah Khan, Samsung <br>
 +
'''Summary:'''
 +
This presentation provides information about running the kselftest,kselftest <br>
 +
git, installation of the self-test, and run test from the install location.  <br>
 +
 
 +
* [https://elinux.org/images/6/61/Linux_Kernel_Selftest_Framework_-_Quality_Control_for_New_Releases.pdf PDF]
 +
 
 +
= '''Standards''' =
 +
 
 +
== Automated Testing Summmit Industry Standards discussion [ATS 2018] ==
 +
'''Presenters:''' Tim Bird, Sony and Kevin Hilman, Baylibre<br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about organizing development boards in a board farm, and about board farm requirements and challenges.<br>
+
The first Automated Testing Summit held discussions about a number of potential areas
It offers practical solutions for overcoming issues related to controlling, powering, monitoring, and automating boards in your farm.
+
for standardization of automated testing, including test definitions, dependencies,
 +
test execution, test artifacts (storing, presenting, analysis), and farm hardware
 +
standards.
  
* [[Media:Herd Your Boards.pdf|PDF]] | [https://youtu.be/kwqmjeqAx-E?list=PLbzoR-pLrL6pRFP6SOywVJWdEHlmQE51q VIDEO]
+
* [[Media:ATS2018-Intro-and-Discussion-Topics.pdf|PDF]] | [https://www.youtube.com/playlist?list=PLKZSArYQptsPGftWXdlTI7vPCc42FXksD VIDEO playlist]
 +
* Minutes from the discussion: [[ATS_2018_Minutes]]
 +
 
 +
= '''Others''' =
  
== Linux Integrated System Analysis (LISA) & Friends [ELC 2016] ==
+
== Tips for Writing Good Tests for Linux [ELC 2018] ==
'''Presenter:''' Patrick Bellasi, ARM Ltd <br>
+
'''Presenter:''' Tim Bird, Sony Corporation <br>
 
'''Summary:'''
 
'''Summary:'''
This presentation provides information about the new Linux integrated system analysis framework for easier development and ideal <br>
+
This talk will review and compare different test writing frameworks, <br>
for detailed debug scenarios. <br>
+
including kself-test, LTP and Fuego, and describe each one's strengths <br>
 +
and weaknesses. A basic introduction to writing a test in each one will be given.<br>
  
* [https://elinux.org/images/1/12/Bellasi.pdf PDF] | [https://youtu.be/m949uduHHsw VIDEO]
+
* [https://elinux.org/images/6/60/Tips-for-Writing-Good-Tests-for-Linux-2018-03-ELC.pdf PDF] | [https://www.youtube.com/watch?v=NzJFwCUGJtc VIDEO]
  
 
== Kernel Testing Tools and Techniques [ELC 2013] ==
 
== Kernel Testing Tools and Techniques [ELC 2013] ==

Latest revision as of 15:08, 3 November 2021

Contents

Kernel CI

Let’s Test with KernelCI [ELCE 2020]

Presenter: Khouloud Touil, Baylibre
Summary: This talk gives an introduction to KernelCI, and shows how to set up the environment, and make and run a test.

Bootstraping a Local KernelCI [ELC 2019]

Presenter: Michał Gałka, Collabora
Summary: This presentation will go through the process of setting up a minimal
local development/testing environment that's suitable for running the
KernelCI phases of build, boot, test and results collection.

BoF: kernelci.org: A Million Kernel Boots and Counting [ELC 2016]

Presenter: Kevin Hilman, BayLibre
Summary: This BoF will provide a very brief overview and current status of kernelci

Kernelci.org Needs YOU! [ELCE 2016]

Presenters: Mark Brown, Linaro & Kevin Hilman, BayLibre
Summary: This presentation provides information about kernelci.org,
Lab setup, and LAVA v2 installations.

BoFs: Kernel Testing for Upstream with kernelci.org [ELC 2015]

Presenter: Kevin Hilman, Linaro
Summary: This BoF will provide a very brief overview on Kernel upstreaming as
part of KernelCI project.

FUEGO

Also, see more talks at: http://fuegotest.org/wiki/Presentations

Fuego test sytem [ELC 2019]

Presenter: Hirotaka Motai, Mitsubishi Electric Corp.
Summary: This presentation provides information about the run-time logger in Fuego by showing the actual use cases and functional checking.

Testing with Volcanoes - Fuego+LAVA Going Distributed [ELC 2017]

Presenter: Jan-Simon Moeller, The Linux Foundation
Summary: This presentation provides information about the features of the combined infrastructure and highlights the tools and work done
to integrate both tools.

Enhance Fuego Test Efficiency by Applying Additional Software & Hardware Solutions [OSSJ 2017]

Presenter: Khiem Nguyen, Renesas Corporation
Summary: This presentation provides information about integrating more software services and hardware solutions (controller for development boards) to enhance the test automation efficiency.

Introduction to the Fuego Test System [ELC 2016]

Presenter: Tim Bird, Sony Mobile
Summary: Gives a basic introduction to the Fuego test system. Fuego is geared towards testing embedded products, with a host-target architecture and many pre-packaged tests.

LAVA

From Zero to First Test in Your Own LAVA Laboratory in less than 45 minutes [ELC 2017]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland Summary: This talk presents an introduction to LAVA - how to set it up and execute tests in your own lab.

Syzkaller

Fuzzing Linux Drivers with Syzkaller [ELCE 2020]

Presenter: Ricardo Canuelo, Collabora
Summary: This talk provides a basic introduction to the 'Syzkaller' test framework, which is a fuzzing tool designed for use with the Linux kernel.

Automation

Automated Testing Laboratory for Embedded Linux Distributions [ELC 2016]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk provides information about problems faced while building automatic testing infrastructure for Tizen operating
system images.

Automated Flashing and Testing for Continuous Integration [ELC 2015]

Presenter: Igor Stoppa, Intel
Summary: This presentation provides information about verifying a software image on an appropriate target hardware device and
hardware configuration.

Automated Testing with ktest.pl (Embedded Edition) [ELC 2012]

Presenter: Steven Rostedt, Red Hat
Summary: This presentation provides information about write to build, install, boot, and test kernel remotely.

Distributed Cross Platform Test Automation [ELC 2006]

Presenter: William Marone
Summary: This presentation provides information about test AXFS functionality, quickly build, run test, and across multiple architectures
and kernels.

Automation/Farm Hardware

Automated Testing for Embedded Development: Next Generation Board Farming [ELC 2021]

Presenter:Chris Fiege, Pengutronix e.K.
Summary: This talk presents the benefits and challenges of managing boards in a board farm. Using USB for the majority of the hardware connections in a farm presents problems. A new "Test Automation Controller" is introduced, which connects to the farm infrastructure via a single network connection, and to the board via various hardware connections.

Fully Automated Power Measurement Solution Coupled with IC Temperature Control [ELCE 2019]

Presenter: Jerome Neanne, BayLibre & Pascal Mareau, NXP
Summary: This talks describes thermal power testing hardware (based on the Baylibre ACME board), and an automated testing framework to control it, for doing automated testing of embedded board response to varying thermal conditions. It also discusses the rationale for thermal response testing.

Introducing the "Lab in a Box" Concept [ELC 2018]

Presenter: Patrick Titiano & Kevin Hillman, Baylibre
Summary: This presentation provides information about the quality
level without the leveraging CI and test automation.

Testing Remote Embedded Devices Made Easy Using Open-Hardware MuxPi [ELC 2018]

Presenter: Pawel Wieczorek, Samsung R&D Institute Poland
Summary: This talk covers a fresh open hardware approach at providing remote access to embedded devices and the new Tizen GNU/Linux
distribution's testing laboratory.

Grabbing Audio and Video on a Board Farm [ELCE 2018]

Presenter: Krzysztof Opasiak, Samsung R&D Institute Poland
Summary: This presentation provides information about audio and video capture
capabilities and unified remote access to any Single Board Computer.


Board Farms

Board Farm APIs for Automated Testing of Embedded Linux - An Update [ELC 2021]

Presenters: Tim Bird, Sony Electronics & Harish Bansal, Timesys Summary: This talk give an update on a proposed REST API for controlling boards and resources in an automated testing lab. A generic resource model, and data capture APIs are highlighted.

Board FARM APIs for Automated Testing of Embedded Linux [ELCE 2020]

Presenters: Tim Bird, Sony & Harish Bansal, Timesys Summary: This talk presents an API for abstracting control of resources in a board farm. A REST API is presented, along with demos and details of the implementation.

Testing Laboratory Layers [ELC 2019]

Presenter: Paweł Wieczorek, Samsung R&D Institute Poland
Summary: These slides cover API design decisions for testing laboratories
focusing on the SLAV test lab stack case and shifting to a user-centric
perspective and possible outcome of such process.

Farming together [ELCE 2017]

Presenter: Andrew Murray, Witekio
Summary: This presentation will provide an overview of the Witekio farm
highlighting the challenges faced - both in hardware challenges
(connecting boards to farms) and software challenges.

Building a Bards Farm: Continuous Integration and Remote Control [ELCE 2016]

Presenter: Antoine Tenart & Quentin Schulz, Free Electrons
Summary: This talk will describe the Kernel CI goals and infrastructure
and how it communicates with our farm using LAVA. It gives a feedback
on how boards farm designed and present its second use case: remote
control of boards.

Herd Your Boards, Become a Farmer [ELCE 2016]

Presenter: Geert Uytterhoeven, Glider bvba
Summary: This presentation provides information about development boards
on a board farm and overcomes the issues related to control,
power, monitor and automating boards in your farm.

Test Suites

FOSS Static Analysis Tools for Embedded Systems and How to Use Them [ELCE 2020]

Presenter: Jan-Simon Moller, The Linux Foundation
Summary: This talk presents a variety of static analysis tools that can be used to perform static analysis on the source code base for an embedded product. Two tools with lots of sub-tools are 'meta-sca' and 'meta-codechecker'. The tools and their capabilities for testing are introduced.

Stress Testing and Micro Benchmarking Kernels with Stress-ng (Stress-ng) [ELCE 2019]

Presenter: Colin Ian King, Canonical
Summary: This talk gives a great overview of stress-ng and how it can be used to perform a variety of tests on a Linux platform. There are many examples of different sub-tests and options (with command line arguments), as well as output and tracing options.

Impact of Platform Firmware on Linux Kernel (LUV Test Suite) [ELC 2018]

Presenter: Megha Dey & Sal Praneeth Prakhya, Intel
Summary: This presentation introduces LUV (Linux UEFI Validation); a unified
framework of several open-source test-suites packaged into a cohesive
and easy-to-use product that aims to help firmware developers uncover
bugs in the implementation of UEFI firmware at critical levels of the s/w stack.

Kselftest

Kernel Validation with Kselftest (Kselftest) [LF mentorship 2021]

Presenter: Shuah Khan, Linux Foundation Summary: Presents an overview of kselftest and kernel testing in general, with details about how to run the included tests.

KSelftest Running in Test Rings - Where Are We? (Kselftest) [ELCE 2020/OSS 2020]

Presenter: Shuah Khan, Linux Foundation Summary: Discusses the current status of kselftest, and in particular how it is being used with KernelCI, and what additional features are needed for improved KernelCI integration.

Linux Kernel Selftest Framework - Quality Control for New Releases (Kselftest) [ELC 2015]

Presenter: Shuah Khan, Samsung
Summary: This presentation provides information about running the kselftest,kselftest
git, installation of the self-test, and run test from the install location.

Standards

Automated Testing Summmit Industry Standards discussion [ATS 2018]

Presenters: Tim Bird, Sony and Kevin Hilman, Baylibre
Summary: The first Automated Testing Summit held discussions about a number of potential areas for standardization of automated testing, including test definitions, dependencies, test execution, test artifacts (storing, presenting, analysis), and farm hardware standards.

Others

Tips for Writing Good Tests for Linux [ELC 2018]

Presenter: Tim Bird, Sony Corporation
Summary: This talk will review and compare different test writing frameworks,
including kself-test, LTP and Fuego, and describe each one's strengths
and weaknesses. A basic introduction to writing a test in each one will be given.

Kernel Testing Tools and Techniques [ELC 2013]

Presenter: Matt Porter, Texas Instruments, Inc
Summary: This presentation provides information about frameworks, lab tools, techniques of the open test, autotest, Jenkins, ktest.