You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 02:29

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot5s.osadl.org (updated Thu Apr 30, 2026 12:44:21)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26526995114,1cyclictest0-21swapper/010:12:390
26531993735,1cyclictest20279-21lspci10:12:392
2652799253,21cyclictest22-21ksoftirqd/112:20:531
26526992523,1cyclictest0-21swapper/009:14:140
2652699250,24cyclictest0-21swapper/009:43:020
26533992422,1cyclictest17472-21sh12:15:583
2653399240,23cyclictest19378-21sh10:12:033
2653399240,1cyclictest18186-21diskmemload12:13:393
2653199241,0cyclictest0-21swapper/211:29:502
2653199240,23cyclictest2151-21if_eno112:00:592
26527992422,1cyclictest22-21ksoftirqd/109:28:181
2652799240,24cyclictest0-21swapper/110:13:211
2652799240,23cyclictest7555-21grep10:31:051
2652799240,23cyclictest18186-21diskmemload09:40:531
2652799240,1cyclictest18186-21diskmemload12:37:501
2652799240,0cyclictest18186-21diskmemload11:09:301
2652799240,0cyclictest18186-21diskmemload09:59:511
2652799240,0cyclictest0-21swapper/110:00:271
26526992421,2cyclictest13451-21apt07:50:000
2652699240,24cyclictest0-21swapper/012:21:340
2652699240,23cyclictest0-21swapper/009:29:410
2652699240,1cyclictest30493-21sh10:22:000
2652699240,0cyclictest18186-21diskmemload11:13:230
2652699240,0cyclictest18186-21diskmemload11:01:060
26533992323,0cyclictest3754-1kworker/u9:212:27:443
26533992323,0cyclictest0-21swapper/311:05:113
26533992321,1cyclictest313-21systemd-journal10:55:003
26533992321,1cyclictest15343-21ssh09:36:543
26533992321,1cyclictest0-21swapper/311:54:543
2653399230,23cyclictest0-21swapper/312:23:003
2653399230,23cyclictest0-21swapper/309:57:283
2653399230,22cyclictest8043-21ssh11:35:493
2653399230,22cyclictest4445-21ssh10:28:583
2653399230,22cyclictest24391-21ssh11:20:003
2653399230,22cyclictest18186-21diskmemload09:45:273
2653399230,22cyclictest10058-21runrttasks09:31:443
2653399230,1cyclictest19454-21kworker/u8:210:35:123
2653399230,0cyclictest0-21swapper/311:42:453
2653399230,0cyclictest0-21swapper/311:02:143
26531992323,0cyclictest0-21swapper/212:35:582
26531992323,0cyclictest0-21swapper/211:15:282
26531992323,0cyclictest0-21swapper/210:21:192
26531992323,0cyclictest0-21swapper/209:31:462
26531992320,2cyclictest28800-21sh09:50:582
26531992320,2cyclictest28303-21sh10:51:042
26531992320,2cyclictest19292-21awk11:15:012
26531992319,3cyclictest0-21swapper/212:20:172
2653199230,23cyclictest18186-21diskmemload10:37:542
2653199230,23cyclictest18186-21diskmemload10:34:012
2653199230,23cyclictest0-21swapper/212:31:172
2653199230,23cyclictest0-21swapper/211:35:532
2653199230,23cyclictest0-21swapper/210:45:242
2653199230,23cyclictest0-21swapper/209:47:122
2653199230,22cyclictest6327-21/usr/sbin/munin10:01:172
2653199230,22cyclictest23871-21ssh09:15:312
2653199230,22cyclictest17875-21ssh09:40:372
2653199230,0cyclictest18186-21diskmemload10:09:222
2653199230,0cyclictest0-21swapper/211:58:052
26527992323,0cyclictest18186-21diskmemload11:21:451
26527992323,0cyclictest0-21swapper/112:30:341
26527992323,0cyclictest0-21swapper/112:06:011
26527992323,0cyclictest0-21swapper/109:51:031
26527992322,1cyclictest22-21ksoftirqd/110:47:461
26527992322,1cyclictest15920-21ssh11:42:181
26527992322,1cyclictest0-21swapper/109:23:341
26527992321,1cyclictest0-21swapper/111:31:031
26527992321,1cyclictest0-21swapper/111:11:281
26527992321,1cyclictest0-21swapper/110:52:441
26527992321,1cyclictest0-21swapper/110:21:101
26527992321,1cyclictest0-21swapper/110:18:531
26527992321,1cyclictest0-21swapper/110:05:011
2652799231,21cyclictest10174-21apt-get10:35:021
2652799230,23cyclictest0-21swapper/112:27:101
2652799230,23cyclictest0-21swapper/111:55:421
2652799230,23cyclictest0-21swapper/111:18:411
2652799230,22cyclictest10195-21sh11:36:251
2652799230,0cyclictest0-21swapper/112:12:211
2652799230,0cyclictest0-21swapper/111:26:441
2652799230,0cyclictest0-21swapper/110:58:101
2652799230,0cyclictest0-21swapper/109:31:571
26526992323,0cyclictest62550irq/127-eno111:29:030
26526992323,0cyclictest18186-21diskmemload10:31:340
26526992323,0cyclictest0-21swapper/011:09:240
26526992323,0cyclictest0-21swapper/010:27:050
26526992322,1cyclictest5409-21perf10:00:010
26526992322,1cyclictest28315-21diskmemload11:55:200
26526992322,1cyclictest18454-21kworker/u8:009:22:490
26526992322,1cyclictest18186-21diskmemload10:47:340
26526992321,2cyclictest15763-21sh10:39:590
2652699230,23cyclictest18186-21diskmemload12:11:030
2652699230,23cyclictest0-21swapper/012:32:180
2652699230,23cyclictest0-21swapper/011:41:590
2652699230,23cyclictest0-21swapper/011:17:200
2652699230,22cyclictest3890-21turbostat11:00:000
2652699230,22cyclictest18186-21diskmemload09:16:280
2652699230,22cyclictest16494-21ssh10:40:450
2652699230,22cyclictest0-21swapper/011:36:000
2652699230,22cyclictest0-21swapper/007:55:000
2652699230,1cyclictest313-21systemd-journal08:25:000
2652699230,1cyclictest0-21swapper/012:00:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional