You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 10:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack2slot7s.osadl.org (updated Sun Apr 26, 2026 00:43:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4193372996832,24cyclictest135966-21munin-run23:15:000
4193372995852,3cyclictest0-21swapper/021:35:010
4193373995647,4cyclictest0-21swapper/122:50:511
419337299544,4cyclictest35391-21diskmemload22:20:480
419337299544,4cyclictest35391-21diskmemload22:20:480
4193373995345,5cyclictest15928-21systemd-run20:05:011
4193372995342,7cyclictest59675-21basename21:40:010
4193372995322,27cyclictest161218-21ssh23:45:460
4193372995322,27cyclictest161218-21ssh23:45:460
4193374995143,5cyclictest33921-21systemd-run21:05:012
4193374995143,5cyclictest33921-21systemd-run21:05:012
4193373995042,5cyclictest171867-21cron00:00:001
4193373995042,5cyclictest171867-21cron00:00:001
4193374994838,6cyclictest75708-21systemctl22:00:012
4193372994618,24cyclictest0-21swapper/022:10:480
4193374994537,5cyclictest175893-21cut00:05:002
419337499453,32cyclictest113350-21ssh22:45:542
4193372994538,4cyclictest1054-21mta-sts-daemon22:55:010
419337299443,32cyclictest97157-21ssh22:25:450
4193372994414,2cyclictest0-21swapper/022:05:500
4193372994414,2cyclictest0-21swapper/020:50:440
419337299441,10cyclictest35899-21ssh21:10:320
4193374994334,6cyclictest421-21dbus-daemon23:30:012
4193373994335,5cyclictest59697-21modprobe21:40:011
419337299433,18cyclictest129215-21ssh23:05:450
419337299433,18cyclictest129215-21ssh23:05:450
419337299432,18cyclictest48925-21ssh21:25:480
4193372994318,22cyclictest2389957-21cups-browsed22:57:380
4193374994235,4cyclictest0-21swapper/221:20:442
4193374994234,4cyclictest0-21swapper/221:15:492
4193374994233,5cyclictest187837-21latency_hist00:20:022
4193374994229,9cyclictest191797-21/usr/sbin/munin00:25:012
4193374994229,10cyclictest160607-21cpu23:45:342
4193374994229,10cyclictest160607-21cpu23:45:342
4193373994232,6cyclictest2389953-21cupsd22:08:031
419337299421,14cyclictest113420-21ps22:45:550
4193373994130,7cyclictest0-21swapper/121:25:021
419337299412,10cyclictest141316-21ssh23:20:450
4193372994119,19cyclictest60314-21aten2.4-expect21:40:320
4193372994119,19cyclictest60314-21aten2.4-expect21:40:320
4193372994114,24cyclictest0-21swapper/023:00:340
419337299411,17cyclictest151ktimers/021:15:430
419337299411,16cyclictest109332-21ssh22:40:500
419337299411,15cyclictest171855-21cups-browsed00:15:460
419337299411,14cyclictest72963-21ssh21:55:440
419337499402,31cyclictest137223-21ssh23:15:442
4193373994029,8cyclictest75702-21/usr/sbin/munin22:00:011
4193373994029,8cyclictest196728-21latency00:30:391
4193373994028,9cyclictest135989-21sh23:15:011
419337299409,8cyclictest0-21swapper/000:00:030
419337299409,8cyclictest0-21swapper/000:00:030
419337299406,11cyclictest155928-21ssh23:40:010
419337299401,14cyclictest193572-21grep00:25:530
4193374993933,3cyclictest0-21swapper/200:00:002
4193374993933,3cyclictest0-21swapper/200:00:002
4193374993926,10cyclictest1056-21mta-sts-daemon00:07:172
4193373993933,4cyclictest1054-21mta-sts-daemon21:19:491
4193373993933,3cyclictest0-21swapper/123:25:351
4193373993931,5cyclictest175909-21ssh00:05:011
4193373993928,8cyclictest87812-21ssh22:15:011
419337299399,7cyclictest34904-21/usr/sbin/munin21:05:490
419337299399,7cyclictest34904-21/usr/sbin/munin21:05:490
419337299397,12cyclictest153939-21kworker/u8:0+xprtiod00:10:560
4193372993930,6cyclictest0-21swapper/000:05:010
4193372993919,17cyclictest0-21swapper/000:40:030
4193372993919,17cyclictest0-21swapper/000:40:030
4193372993915,22cyclictest261-21systemd-journal20:06:030
4193372993910,6cyclictest8898-21/usr/sbin/munin19:40:350
4193374993831,4cyclictest107920-21munin-run22:40:012
4193374993828,7cyclictest93695-21unixbench_multi22:20:562
4193374993828,7cyclictest93695-21unixbench_multi22:20:562
4193374993827,8cyclictest420-21avahi-daemon22:30:492
4193374993826,9cyclictest140705-21cpu23:20:332
4193373993830,5cyclictest156510-21aten_r2power_en23:40:321
4193373993830,5cyclictest140119-21latency_hist23:20:021
4193373993828,8cyclictest12203-21needreboot19:50:411
4193373993828,8cyclictest12203-21needreboot19:50:411
4193373993827,8cyclictest153601-21timerandwakeup23:35:531
4193373993823,3cyclictest171rcu_preempt23:45:431
4193373993823,3cyclictest171rcu_preempt23:45:431
4193373993817,15cyclictest421-21dbus-daemon23:20:441
4193373993814,17cyclictest421-21dbus-daemon19:30:431
419337299383,9cyclictest69000-21ntpq21:50:490
419337299383,9cyclictest3304-21ntpq19:20:420
419337299383,8cyclictest12282-21ntpq19:50:430
419337299383,8cyclictest12282-21ntpq19:50:430
419337299383,25cyclictest76943-21diskmemload22:00:440
4193372993821,9cyclictest151ktimers/022:15:470
4193372993821,9cyclictest151ktimers/022:15:470
419337299382,13cyclictest2389957-21cups-browsed20:10:420
4193372993817,4cyclictest103971-21wc22:35:010
4193372993814,3cyclictest0-21swapper/023:25:470
4193372993813,3cyclictest0-21swapper/000:20:430
419337299381,21cyclictest64481-21df21:45:340
419337299381,15cyclictest33891-21cron21:05:000
419337299381,15cyclictest33891-21cron21:05:000
419337299381,15cyclictest149206-21/usr/sbin/munin23:30:440
419337299381,13cyclictest24005-21awk20:30:370
4193374993730,4cyclictest32402-21sendmail21:00:002
4193374993730,3cyclictest0-21swapper/221:15:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional