BeagleBoard/GSoC/Ideas-2016
Welcome!
BeagleBoard.org has been accepted as a mentoring organization in the Google Summer of Code for 2010!! Students will be applying startign March 29 and we still need several more mentors to register before then.
Background
For a quick view of how the BeagleBoard relates to the open source development community, take a listen to Mans and Koen's interview with the Linux Outlaws. The BeagleBoard is a popular open-source hardware project utilizing the first broadly available ARM Cortex-A8 processor. Over 10,000 people are experimenting with the BeagleBoard today to bring their ideas for the future of everywhere-computing to life and you can be one of them.
Because the BeagleBoard:
- utilizes a complex SoC with 3 primary processing cores,
- one for general-purpose activities such as running Linux and applications (ARM Cortex-A8),
- one for running real-time signal processing algorithms (C64x+ VLIW fixed-point DSP), and
- one for rendering 3D graphics (Imagination SGX), and
- is specifically designed for low-power (typically running under 2W at full processing load), and
- has a very small foot-print that includes standard peripheral expansion like USB,
there are many opportunities to explore challenges in computer science in areas of
- optimal execution of applications/algorithms on additional instruction set architectures like ARM or C6000,
- splitting tasks appropriately between processing cores to minimize task execution time and power consumption, and
- integrating computation into new form-factors.
Students and mentors
Student proposals can create projects from the following ideas or propose their own project based on their own ideas. From reading about previous Google Summer of Code projects, the key to success is being passionate about your project, so propose something that is extremely interesting to you, even if it not on the list. We will be glad to help students develop ideas into projects on the BeagleBoard IRC or the BeagleBoard mailing list. There are many more ideas of what can be done and we will match projects to students interest and help scope the proposal to something that can be completed in the Summer of Code time-frame.
There are more than 100 exiting projects list at http://beagleboard.org/project. If you are interested in one of those projects, talk with the project members to see if there are any aspects of their projects with which they can help you contribute. There are also several ideas on the ECE597 class project idea list.
Contents
- 1 Welcome!
- 2 General requirements
- 3 Fundamental infrastructure projects
- 4 Projects for heterogeneous multicore processing
- 5 Multimedia and user experience projects
- 6 Hardware + software projects
- 7 Community infrastructure projects
- 8 To be classified
- 9 Raw ideas that need to be fleshed out
- 10 Mentors
General requirements
All projects have the following basic requirements:
- The project must be registered on http://beagleboard.org/project.
- All newly generated materials must be released under an open source license.
- Individual students shall retain copyright on their works.
- Source code generated during the project must be released on gitorious.org, github.com, repo.or.cz, sourceforge, code.google.com, gforge.ti.com, or omapzoom.org.
- The registration on http://beagleboard.org/project must include an RSS feed with project announcements and updates at every milestone. Sources for the RSS feed should be blogger.com, wordpress.com, or some other established blog hosting service with known reliability.
- To help you to break your project down into manageable chunks and also help the project's mentors to better support your efforts, weekly project status reports should be e-mailed to the project's mentors and the organization administrator (Jason Kridner). Each status report should outline:
- what was accomplished that week,
- any issues that prevented that week's goals from being completed, and
- your goals for the next week.
Fundamental infrastructure projects
These projects fundamentally improve support of existing open source projects for ARM-based devices in general and the BeagleBoard in specific, bringing the broad body of high-level open source applications into smaller, lower-cost, lower-power systems that can go anywhere.
JTAG debugging
Implement, configure and document a complete open source based JTAG debugging development chain for ARM Cortex A8 in OMAP3 used on Beagle Board. This includes final port of open source JTAG software OpenOCD for OMAP3 on Beagle, and then configure and document all software (and hardware) components involved. This could look like:
ARM Cortex A8 <-> OMAP3 <-> BeagleBoard <-> Flyswatter (*) <-> OpenOCD <-> GDB <-> Eclipse (CDT)
(*) Note: Flyswatter is used as example JTAG dongle here. All OpenOCD JTAG dongles able to deal with 1.8V and configure EMUx pins correctly can be used.
Goal: Able to single step kernel code using OpenOCD, GDB, and Eclipse
Existing project: OpenOCD
Hardware skills: Able to monitor logic-level digital signals
Software skills: C, ARMv7 assembly
Possible mentors: Dirk Behme, Ceriand
NOTE: TinCanTools will donate Flyswatter boards for this project
Linux kernel improvements
Several improvements are desired in the Linux kernel to make it more useful for embedded/device applications.
Goal: Improve the capabilities of the Linux kernel, especially for embedded devices including ARM Cortex-A8 and OMAP3-based devices.
Existing project: linux-omap
Software skills: C, ARMv7 assembly (desired), Linux kernel driver development
Possible mentors: Kevin Hilman, Tony Lindgren, Khasim Syed Mohammed, Russell King
More detailed kernel improvement ideas
Power Management
Good power management is crucial to embedded systems. There are many areas that need continued development:
- runtime PM framework for OMAP
- full off-mode support in drivers (SoC is powered off during suspend and idle)
- optimize board-specific inactive power (requires board/hardware/PMIC experience)
- power measurement and analysis tools
Existing project: OMAP Power Management
Software skills: C, Linux kernel driver development
Mentor: Kevin Hilman (english, français)
MUSB enhancements
The MUSB block on the Beagle has a lot of potential but the driver is currently rather buggy. This project will be to fix the driver so the MUSB implementation as paired with the PHY used on the Beagle board can work reliably as a USB OTG device. This means it should be able to at least reliably go back and forth between host and device mode without a reboot by just changing from a A to a B cable AND be able to force host or device mode in software. See the Nokia N8x0 devices for a sample behavior of how software can force this. An initial estimate is code needs to be implemented to force the PHY into host or device mode as requested by SysFS.
Possible mentors: Felipe Balbi, Swami, Hunyue Yau
USB device audio support
The Linux USB gadget infrastructure doesn't have audio device class support (but Linux does have USB host audio support. There is some work on a gadget MIDI audio driver. Some work has been done over at Blackfin, but is reported as not working very well. Getting USB isochronous endpoint, gadget audio driver connected to audio on BeagleBoard would be beneficial to all OMAP3 isochronous USB needs, better isochronous gadget support in Linux (there are no standard gadgets test for isochronous endpoints), and a prove out a real gadget driver that requires isochronous endpoints. Anyone wanting to learn about communication protocols, a well designed layered communication implementation, and a chance to work at the driver level will enjoy this project.
Possible mentors: Swami
SYS/Link support in the mainline kernel
Possible mentors: Mugdha Kamoolkar
Improve bootloader support
There are many bootloaders available for the BeagleBoard and other ARM embedded devices, but all can be given improvements for ease-of-use for new users. Places where many bootloaders fall down is in reliance on a limited set of user inputs (such as only the serial port) or not connecting to every boot device (such as a USB flash drive). They also might rely on commands that are difficult to understand or not familiar to the user.
Goal: Create a bootloader, or a set of bootloaders, that:
- is open source without requiring giving away rights over the operating system or applications,
- can be built using open source tools,
- can be loaded from NAND, SD, USB, or serial port directly by the ROM code and executed,
- provides a user interface to Windows and Linux PCs over both the USB OTG and serial ports,
- provides a user interface to the user via keyboard, mouse, and monitor,
- loads quickly from the ROM and can load an operating system quickly, and
- can load operating systems from and format new SD cards and USB flash drives with bootable copies of itself.
Existing projects: Tianocore, U-boot, u-boot utilities, X-load bootloader-loader, Barebox, APEX, and Qi
Additional references: PuppyBits
Hardware skills: Configure hardware at boot
Software skills: C, ARMv7 assembly
More detailed bootloader improvement ideas
U-boot
This is the bootloader shipped with the BeagleBoard today. We like it, but we don't love it. Because the development is moving to GPLv3, many commercial developers are likely to be frightened away from it at some point. Still, it would be nice to improve some of its fundamental short-comings on the BeagleBoard, such as:
- Add support for the USB host port (to connect a hub, keyboard, and mouse).
- Add USB Ethernet adapter support.
- Add USB OTG port (to connect to a PC to download code). This works on a branch, but isn't in good shape for getting accepted upstream.
- Add DVI-D display.
- Add USB mass-storage class host support (for flash drives).
- Add a boot configuration header to eliminate the need for x-loader.
Possible mentors: Jason Kridner, Khasim Syed Mohammed, Steve Sakoman, Dirk Behme
TianoCore
It is unlikely that any has more standards momentum and flexibility than the TianoCore implementation of the UEFI boot specification. EFI bootloaders are further interesting in their ability to run EFI byte code (EBC) applications. There is already basic support of the BeagleBoard in TianoCore, but the functionality is a bit limited and the build instructions currently rely on non-free tools. At least the following improvements are required:
- Add support for the USB host port (to connect a hub, keyboard, and mouse).
- Add USB Ethernet adapter support.
- Add USB OTG port (to connect to a PC to download code).
- Add DVI-D display.
- Add USB mass-storage class host support for flash drives.
- Add USB device serial adapter emulation.
- Build with GCC.
- Performance optimizations.
All of the desired functionality is already demonstrated in Linux, one of the other boot-loaders, or in one of the additional references above.
Barebox
It has already been shown that the Barebox bootloader can be scaled very reasonably down to something that can fit into the on-chip memory of the OMAP3, without using the DRAM. Maintaining this sort of scalability can be critical to providing the fastest possible boot times.
Possible mentors: Nishanth Menon
boot.kernel.org
There is a new network-based way to boot Linux hosted on kernel.org called boot.kernel.org. How about adding support there for the BeagleBoard (or BeagleBoard-xM, since it includes an Ethernet adapter).
x86 instruction emulation
Development or tuning the an emulator like qemu to emulate the x86 instruction set at a reasonable speed to run legacy x86 apps developed for another non Linux OS. Possibilities include Windows 9x, 2000, etc. An alternative approach to use qemu to emulate an x86 Linux system and run Wine up top of that. Yet another approach might be to add an emulation engine inside wine. The goals is to be able to run x86 applications. The OS is optional. Task could possibly be split between the ARM and DSP.
Goal:
Hardware skills: n/a
Software skills: C, x86 assembly, ARMv7 assembly
Possible mentors: _TBD_
Complexity: High
Minix3 support
Porting Minix3 (www.minix3.org) to beagleboard. Minix3 is a highly reliable operating system. Currently it only runs on x86 hardware, but some work has been done to get it running on ARM.
Goal: Getting Minix3 to run on BeagleBoard; adding drivers for the BeagleBoard peripherals
Hardware skills: n/a
Software skills: C, x86 assembly, ARMv7 assembly
Possible mentors: Frans Meulenbroeks, _TBD_
Complexity: High
Projects for heterogeneous multicore processing
Vala bindings for Codec Engine algorithms
Goal: _TBD_
Existing project: dispTEC
Software skills: C, Vala, _TBD_
Possible mentors: Maria Rodriguez, Cristina Murillo, Todd Fischer, Diego Dompe, _TBD_
Create a micro powered Erlang-based cluster (MiPEC) using BeagleBoards
The LoPEC project has created a map-reduce framework which can be used to distribute computing jobs which use both a machine's CPU and GPU. The target platform is the Mac Mini because of its low power footprint of around 50W. A BeagleBoards has 3 processors which can be used for various computations (CPU, GPU, DSP) and offers an even smaller power footprint of 2W, which makes it an ideal target platform for distributed job execution.
Erlang is a concurrent programming language that can theoretically be used to spread tasks across the processing cores on a BeagleBoard or across BeagleBoards on a network.
Goal: Run LoPEC on a set of beagleboards and create example jobs which can utilize at least two processors. Test the execution of those examples and compare the results to the execution which only uses the BeagleBoards's CPU.
Software skills: Erlang, C
Possible mentors: Tino Breddin, Marcus Taylor
Complexity: Medium
Add DSP support to GNU radio
Goal: GNU Radio is a popular Software Defined Radio package for PC based computers. GNU Radio also runs on the Beagleboard and can make use of the floating point unit on the ARM. However, the DSP on the Beagleboard has tremendous potential for increasing GNU Radio's capability on small hardware. The project difficulty is based on the level of effort desired by the student, it should be fairly easy to create a standalone GNU Radio block that talks to the DSP via dsplink, or very complex to modify the GNU Radio block scheduler to launch block on the DSP directly.
Existing project: GNURadio
Software skills: C++
Mentors: Philip Balister
Multimedia and user experience projects
Speech recognition
TI has released source for a speech recognition library that runs on the ARM processor of the OMAP3 on the BeagleBoard. Currently, it is under a TI license, so it might not qualify as-is for inclusion in GSoC, but that can be explored. There may be other libraries that can be utilized for this project. Using speech recognition library, several tasks could be performed:
- Voice recognition integrated into Ubiquity: Integrate Mozilla Firefox, Mozilla Ubiquity, and voice recognition on the BeagleBoard with a microphone. Use of a Wiimote could provide additional interactive capabilities.
Existing project: http://beagleboard.org/project/tiesr
Possible mentors: Lorin Netsch, Sourabh Ravindran
Android running as a windowed application
Modify Android to work within an embedded system as a windowed application. This has been done under an emulation environment today on PCs, but that might not be fast enough for embedded systems. This should provide minimal overhead and look as close to running only Android as possible to the Android application and core tasks.
Goal: Execute Android .apk-distributed applications within a more full-featured GNU/Linux distribution as a windowed application.
Software skills: Java, C, shell scripting
Possible mentors: Jason Kridner, Katie Roberts-Hoffman, _TBD_
Hardware + software projects
These are "Make"-style projects that advance general knowledge for creating and improving end products for consumers.
Multiple prototype hardware systems should be made to complete these projects. The process should be documented and be something that the mentor reproduces and that anyone else can reproduce at a reasonable expense with only some minimal hardware skills (soldering, using a volt meter, etc.).
Intelligent thermostat that utilizes weather forecasts
- Improve the thermostatic control of a domestic heating system by more intelligent control based on the analysis of forecast weather.
- Enable remote control of the system through IP Internet access.
- Enable local control through touch screen.
Possible mentor: Todd Fischer
Adding Sense to Beagle
Sensory aware applications are becoming more mainstream with the release of the Apple iPhone. This project would combine both HW and SW to add sensory awareness to beagle. First, additional modules such as GPS, 3-axis accelerometers, Gyroscopes, Temperature Sensors, Humidity Sensors, Pressure Sensors, etc, would be added to beagle to compliment the microphone input in order to allow sensing of the real world environment. Then SW APIs would need to be layered on top to allow easy access to the sensory data for use by applications.
The Freespace module is already working with the BeagleBoard as are many other sensors. This project should seek to summarize how to connect as many sensors as possible on one place on the eLinux wiki.
Possible mentor: Mark Yoder
Community infrastructure projects
Updating BeagleBoard.org UI/backend
The BeagleBoard.org website is currently written in JavaScript using Helma and makes use of several Java components through JavaScript. One advantage of this is you can actually run an instance of the BeagleBoard.org web server on the BeagleBoard with a full clone of the website.
- Improve OpenID support
- Create Ubiquity scripts to simplify page editing
- Add tags to project entries and improve the views
- Import RSS feed items into pages for ranking/tagging
- Add microblogging support integrated with the IRC channel
- See http://code.google.com/p/beagleboard/issues/detail?id=46
- Enable users to store http://beagleboard.org/user user profiles
- Have the chat show Twitter and Identica update
- Translate BeagleBoard.org into other languages
- Update the site for the BeagleBoard-xM launch occurring in June
Software skills: JavaScript, XML, HTML/CSS
Mentor: Jason Kridner
To be classified
BeagleChat
Easy Video Chat Client on Beagle Board. Porting Ekiga (www.ekiga.org) - an open source VoIP and video conferencing application for GNOME. The client should be able to talk to ekiga software running on PC as well as another beagle board. Optimizations would involve porting audio and video codecs on Ekiga to DSP plus supporting video streaming over USB for webcam support.
Raw ideas that need to be fleshed out
Some additional ideas can be found on the BeagleBoard contest page and the BeagleBoard project page.
- RTEMS BSP for Beagle board: Medium RTEMS is a free real-time operating system. This project would require developing an RTEMS Board Support Package for the Beagle board. The Beagle board has come up multiple times in our community as a excellent device for students, hobbyists, and a starting point for customized boards. I am the maintainer of RTEMS and would be willing to co-mentor this with someone from the Beagle board community. --JoelSherrill 23:12, 18 March 2010 (UTC)
- Spectrum analyzer using the DSP: Medium Write a program that uses the DSP to take an alsa input and to all the math and a GUI on the arm that display the realtime spectrum. The DSP side needs to use xdais so other DSP programs can run at the same time.
- Port MPlayer or GStreamer with DSP codec support: Medium GStreamer is a multimedia package that handles streaming and file playback for a variety of multimedia files. The port was done for DaVinci, it would be cool to have a simiilar port done for Beagleboard. http://focus.ti.com/dsp/docs/dspsplash.tsp?contentId=3100. There's a lot of work done in the GStreamer arena: BeagleBoard/gst-openmax and there's also the gst-dsp. These projects are targeted for the bridgedriver.
- Ogg Vorbis audio xDM encode and decode codecs: Medium
- Porting open-source codec to DSP (MadPlay, VLC, some of the mplayer codecs …: Medium
- OpenGL DSP acceleration: Hard Research and implement OpenGL ES using the DSP on beagleboard. The DSP side needs to use xdais so other DSP programs can run at the same time. Can take a look at Vincent OpenGL ES open source implementation and add DSP to it
- beagle as DLNA/upnp renderer, server, controller, or media player.
- Wiimote + Pico Projector + 3D art tool
- OpenCL implementation that uses the DSP and/or NEON (could be used as framework for any dsp/neon acceleration)
- Video extender – take in video via usb webcam, compress it using video encoder, stream it over ethernet (could be like a security camera). Could/should be implemented using DLNA protocols (e.g. view on ps3 or tv's).
Mentors
Name | IRC nickname | Native language | Other languages | Timezone | Software help | Hardware help | Focus projects |
---|---|---|---|---|---|---|---|
Jason Kridner | jkridner | English | - | US Central | web development, C, shell/perl scripting | wiring, timing diagrams, basic debug | infrastructure improvements |
Leo Estevez | TBD | Spanish | English, French, German(basic) | US Central | C, mobile operating systems | wiring, timing diagrams, basic debug | computer vision |
Hunyue Yau | ds2 | English | US Pacific | Android, C, Linux, scripting | Yes | ||
Frans Meulenbroeks | eFfeM | Dutch | English, basic understanding of German | CET | C, User Interface, Linux, booting, performance improvement, networking technology | no | |
Kevin Hilman | khilman | English | fluent in French | US Pacific | |||
Luis Gustavo Lira | Spanish | fluent in English and French) | |||||
Koen Kooi | _koen_ | Dutch | Fluent in English | CET | Buildsystem integration, distribution | not really | |
Katie Roberts-Hoffman | katier | English | nope | US Central | Android, DSP integration (Link/CE/etc) | nope | |
Mans Rullgard | mru | English, Swedish | Some German | GMT | C, Assembler | ||
Mike Zucchi | notzed | English | Australia/South | C, Assembly, Java, SIMD. Applications, libraries, GUI, multi-threading. | not much | ||
Philip Balister | Crofton | ||||||
Robert Nelson | rcn-ee | English | - | US Central | C, Shell Scripting, Deb packaging | ||
Soren Steen Christensen | soren.ssc | Danish | Fluent in English and some German | CET | C/C++, ASM, Device Drivers | OMAP chip, HW design, Low level development & debuging | All kind of HW and low level SW stuff |
Mark Yoder | yoder | ||||||
Jeff Osier-Mixon | jefro | English (US) | US Pacific | documentation | |||
Laine Walker-Avina | Ceriand | English | US Pacific | C, Assembly, Buildroot | USB protocol & logic analyzers, Various JTAG probes | OpenOCD, bootloaders, Linux kernel | |
Frank Walzer | franktango | German | English | CET | C++, OOP | Debug, JTAG, Interfaces | Graphics, GUI, Build systems |
Cristina Murillo | cmurillo | Spanish | English | GMT -6.00 | C, C++, Assembly, Linux | JTAG, wiring, debug | |
Khasim Syed Mohammed | khasim | English | Hindi | India | C, C++, Assembly, Linux device drivers, board bring up, bootloaders | Schematic review, board development | |
Siji Sunny | siji | Hindi | English | India | C,Operating Systems(Ubuntu-Arm,Angstrom,Android,Debian),Open Source Application/GUI Development(Clutter, GTK), Language Computing,Text processing,Unicode,Fonts | No | Language Computing, Text Processing, Operating System, Text To speech |
Devaraj Rangasamy | Deva | Hindi, Tamil | English | India | Android, Linux Kernel Base Port | No | Language Computing, Text Processing, Operating System, Text To speech |
Joel Sherrill | DrJoel | English | - | US Central | RTEMS maintainer, real-time, cross tools | No | RTEMS BSP |