Difference between revisions of "Jetson/General debug"

From eLinux.org
Jump to: navigation, search
(9 intermediate revisions by the same user not shown)
Line 1: Line 1:
 
==Get prepared==
 
==Get prepared==
This section is to share some debug tips for users to understand the basic flow of how to use/debug jetson platform.  
+
This section is to share some debug tips for users to understand the basic flow of how to use/debug jetson platform. <br>
 +
Before we start to describe each kind of error, you should check below pages to understand how to dump a serial log from UART.
 +
Tutorials:
 +
  https://www.jetsonhacks.com/2017/03/24/serial-console-nvidia-jetson-tx2/
 +
  https://www.jetsonhacks.com/2019/04/19/jetson-nano-serial-console/
 +
  https://developer.ridgerun.com/wiki/index.php?title=Xavier/In_Board/Getting_in_Board/Serial_Console
  
 
Currently this page is applicable to L4T- rel-32.3 <br>
 
Currently this page is applicable to L4T- rel-32.3 <br>
 
==SDKM==
 
==SDKM==
SDKManager is a GUI tool to replace old Jetpack.  This tool has two basic functions: flash the board(driver package/BSP) and install the SDK(cuda/tensorRT/etc).
+
SDKManager is a GUI tool to replace old Jetpack.  This tool has two basic functions: '''flash the board(driver package/BSP)''' and '''install the SDK(cuda/tensorRT..etc.)'''.
 
<br>
 
<br>
 
https://developer.nvidia.com/nvidia-sdk-manager
 
https://developer.nvidia.com/nvidia-sdk-manager
Line 15: Line 20:
 
   
 
   
 
*How to debug if flashing process is stuck in sdkm?
 
*How to debug if flashing process is stuck in sdkm?
In general, the flahs process would finish in 10 minutes.  If it lasts longer than this, the flash process probably has problem.
+
In general, the flash process would finish in 10 minutes.  If it lasts longer than this, the flash process probably has problem.
 
To debug flash, I would suggest to use flash.sh directly instead of SDKM GUI tool.
 
To debug flash, I would suggest to use flash.sh directly instead of SDKM GUI tool.
 
  '''flash.sh'''
 
  '''flash.sh'''
This is a official tool to flash jetson platform. This tool is also installed and used by SDKM.  
+
  This is a official tool to flash jetson platform. This tool is also installed and used by SDKM.  
 
  After you choose the flash button in sdkm, it would download a package "Linux_for_Tegra" on your host.  The flash.sh is inside this folder.
 
  After you choose the flash button in sdkm, it would download a package "Linux_for_Tegra" on your host.  The flash.sh is inside this folder.
 
  For more detail about how to use flash.sh, please refer to Jetson quick start guide -> https://developer.nvidia.com/embedded/downloads
 
  For more detail about how to use flash.sh, please refer to Jetson quick start guide -> https://developer.nvidia.com/embedded/downloads
Line 25: Line 30:
 
To debug flash problem. You need two parts of log for forum admin to check.
 
To debug flash problem. You need two parts of log for forum admin to check.
 
  '''1. The result of flash.sh '''  
 
  '''1. The result of flash.sh '''  
This log should be seen after you run above flash.sh
+
  This log should be seen after you run above flash.sh
 
  '''2. The result from device'''  
 
  '''2. The result from device'''  
During the flash, the host would send some binary to device and use it to flash. It is a protocol over usb. To dump this log, you need to enable serial console on UART.
+
  During the flash, the host would send some binary to device and use it to flash. It is a protocol over usb. To dump this log, you need to enable serial console on UART as above tutorial.
  https://www.jetsonhacks.com/2017/03/24/serial-console-nvidia-jetson-tx2/  <please search different platform if you are not using TX2>
+
  You shall see the log start to dump in the meantime when flash.sh starts to flash your board.
and you shall see the log start to dump in the meantime when flash.sh starts to flash board.
 
  
 +
*The installation of SDK is stuck, why?
 +
The SDK installation could be done through ethernet/wifi or usb device mode. You could just ping or ssh before sdk installation starts.
 +
USB device mode is a virtual internet interface created when you connect micro usb cable to jetson.  It would use a IP 192.168.55.x as device IP and create another 192.168.55.100 on your host.
 +
However, this method requires your host to have driver support.  Some users' host may not support it.  In this case, please use wired ethernet to install. 
 
==Boot==
 
==Boot==
 +
After your flash process finishes, the system would boot up no matter you install sdk or not.
 +
 +
*My system gets hang and doesn't respond. How to resolve?
 +
There are lots of reason that might cause system hang.  Here are some common cases.
 +
'''1. Need to configure user account'''
 +
  This is a new feature after rel-32.1.  User needs to configure their own ubuntu account with USB keyboard and HDMI monitor.
 +
If you don't have HDMI monitor for it, there is also alternative method- oem config to help.  You could refer the detail in L4T dev guide: https://docs.nvidia.com/jetson/l4t/index.html
 +
'''2. There is bootloader failure or kernel failure'''
 +
  To dump the log, you need to enable the serial console on UART.  This is the only way to debug bootloader log.
 +
  For kernel log, before dumping it, you need to make sure there is no "'''quiet'''" in kernel cmdline. If you see this, it would disable the boot log.
 +
  The way to remove this keyword is check the '''extlinux.conf''' under "'''Linux_for_Tegra/rootfs/boot/extlinux'''"on your host.  If you don't know how to tell whether it is in kernel cmdline. Just see the length of your kernel log.  The full log should have usb/pcie init log which are available on all kinds of jetson platforms.  If you don't see them, then your log is in silent mode.
 +
 +
==Misc==
 +
Some users may get confused by the board ID within Jetpack. Here is the list to check.
 +
  P2180  -> Jetson TX1
 +
  P3310  -> Jetson TX2
 +
  P3489  -> Jetson TX2i
 +
  P3448  -> Jetson Nano devkit
 +
  P3448-0020 -> Jetson Nano production module
 +
  P2888 -> Jetson Xavier
 +
  P2888-0060 -> Jetson Xavier-8GB
 +
When you run "sudo ./flash.sh <BoardID> mmcblk0p1" command to flash your board. It is actually searching the config file <boardID>.conf under Linux_for_Tegra.<br>
 +
For example,
 +
sudo ./flash.sh jetson-tx2i mmcblk0p1
 +
This one would try to check the file in jetson-tx2i.conf.  It means you could also create your own board name and it would work if the format in this config file is correct.

Revision as of 00:09, 21 April 2020

Get prepared

This section is to share some debug tips for users to understand the basic flow of how to use/debug jetson platform.
Before we start to describe each kind of error, you should check below pages to understand how to dump a serial log from UART.

Tutorials:
 https://www.jetsonhacks.com/2017/03/24/serial-console-nvidia-jetson-tx2/ 
 https://www.jetsonhacks.com/2019/04/19/jetson-nano-serial-console/
 https://developer.ridgerun.com/wiki/index.php?title=Xavier/In_Board/Getting_in_Board/Serial_Console

Currently this page is applicable to L4T- rel-32.3

SDKM

SDKManager is a GUI tool to replace old Jetpack. This tool has two basic functions: flash the board(driver package/BSP) and install the SDK(cuda/tensorRT..etc.).
https://developer.nvidia.com/nvidia-sdk-manager
To run sdkm, you have to prepare a x86 host with ubuntu 16.04 or 18.04. Some users asked whehter it supports ARM version so that they can flash jetson by another ARM device.
Currently, it is not supported.
Flash and install SDK could be separate. It means you could flash the board and skip the installation of SDK and vice versa.

  • How to debug if flashing process is stuck in sdkm?

In general, the flash process would finish in 10 minutes. If it lasts longer than this, the flash process probably has problem. To debug flash, I would suggest to use flash.sh directly instead of SDKM GUI tool.

flash.sh
 This is a official tool to flash jetson platform. This tool is also installed and used by SDKM. 
After you choose the flash button in sdkm, it would download a package "Linux_for_Tegra" on your host.   The flash.sh is inside this folder.
For more detail about how to use flash.sh, please refer to Jetson quick start guide -> https://developer.nvidia.com/embedded/downloads
  • What log should I prepare for flash problem?

To debug flash problem. You need two parts of log for forum admin to check.

1. The result of flash.sh  
 This log should be seen after you run above flash.sh
2. The result from device 
 During the flash, the host would send some binary to device and use it to flash. It is a protocol over usb. To dump this log, you need to enable serial console on UART as above tutorial.
You shall see the log start to dump in the meantime when flash.sh starts to flash your board.
  • The installation of SDK is stuck, why?
The SDK installation could be done through ethernet/wifi or usb device mode. You could just ping or ssh before sdk installation starts.
USB device mode is a virtual internet interface created when you connect micro usb cable to jetson.  It would use a IP 192.168.55.x as device IP and create another 192.168.55.100 on your host.
However, this method requires your host to have driver support.  Some users' host may not support it.  In this case, please use wired ethernet to install.  

Boot

After your flash process finishes, the system would boot up no matter you install sdk or not.

  • My system gets hang and doesn't respond. How to resolve?
There are lots of reason that might cause system hang.  Here are some common cases.
1. Need to configure user account
 This is a new feature after rel-32.1.  User needs to configure their own ubuntu account with USB keyboard and HDMI monitor.
If you don't have HDMI monitor for it, there is also alternative method- oem config to help.  You could refer the detail in L4T dev guide: https://docs.nvidia.com/jetson/l4t/index.html
2. There is bootloader failure or kernel failure
 To dump the log, you need to enable the serial console on UART.  This is the only way to debug bootloader log.
 For kernel log, before dumping it, you need to make sure there is no "quiet" in kernel cmdline. If you see this, it would disable the boot log.
 The way to remove this keyword is check the extlinux.conf under "Linux_for_Tegra/rootfs/boot/extlinux"on your host.  If you don't know how to tell whether it is in kernel cmdline. Just see the length of your kernel log.  The full log should have usb/pcie init log which are available on all kinds of jetson platforms.  If you don't see them, then your log is in silent mode.

Misc

Some users may get confused by the board ID within Jetpack. Here is the list to check.

 P2180  -> Jetson TX1
 P3310  -> Jetson TX2
 P3489  -> Jetson TX2i
 P3448  -> Jetson Nano devkit
 P3448-0020 -> Jetson Nano production module
 P2888 -> Jetson Xavier
 P2888-0060 -> Jetson Xavier-8GB

When you run "sudo ./flash.sh <BoardID> mmcblk0p1" command to flash your board. It is actually searching the config file <boardID>.conf under Linux_for_Tegra.
For example,

sudo ./flash.sh jetson-tx2i mmcblk0p1 

This one would try to check the file in jetson-tx2i.conf. It means you could also create your own board name and it would work if the format in this config file is correct.