You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 22:32

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Sun Sep 20, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2241699260,25cyclictest20469-21ssh12:10:070
22428992523,1cyclictest15774-21diskmemload09:22:473
2242899250,24cyclictest28858-21ssh09:50:043
2242899250,24cyclictest15774-21diskmemload12:16:563
2242499250,24cyclictest21774-21rm09:14:532
2242499250,1cyclictest25232-21cron11:45:002
2242199250,24cyclictest2243-21ssh09:26:551
2242199250,1cyclictest18218-21sh09:41:091
22416992525,0cyclictest15774-21diskmemload12:06:180
22416992523,1cyclictest0-21swapper/010:25:010
2241699250,24cyclictest0-21swapper/010:44:060
2241699250,24cyclictest0-21swapper/009:14:270
22428992423,1cyclictest15774-21diskmemload11:18:323
22428992423,1cyclictest0-21swapper/309:17:243
22428992422,1cyclictest0-21swapper/311:11:333
22428992422,1cyclictest0-21swapper/309:45:053
22428992421,2cyclictest31235-21diskmemload11:21:053
2242899240,23cyclictest15774-21diskmemload09:12:503
2242899240,0cyclictest15774-21diskmemload10:19:463
2242899240,0cyclictest0-21swapper/311:27:173
2242499241,22cyclictest313-21systemd-journal10:35:012
2242499240,23cyclictest11969-21ssh09:35:022
2242499240,23cyclictest0-21swapper/211:05:542
2242499240,0cyclictest26558-21apt-get11:17:482
2242499240,0cyclictest0-21swapper/212:25:472
22421992424,0cyclictest0-21swapper/111:37:501
22421992424,0cyclictest0-21swapper/111:28:201
22421992423,1cyclictest9184-21ssh10:32:351
22421992422,1cyclictest13908-21apt-get11:05:021
2242199240,23cyclictest28918-21ssh10:49:411
2242199240,23cyclictest0-21swapper/111:10:441
2242199240,0cyclictest0-21swapper/109:22:471
2241699240,24cyclictest15774-21diskmemload11:01:210
2241699240,24cyclictest0-21swapper/011:18:580
2241699240,24cyclictest0-21swapper/007:52:460
2241699240,23cyclictest0-21swapper/011:54:230
2241699240,1cyclictest0-21swapper/009:31:030
22428992323,0cyclictest0-21swapper/311:50:013
22428992323,0cyclictest0-21swapper/311:35:453
22428992323,0cyclictest0-21swapper/311:31:103
22428992323,0cyclictest0-21swapper/309:57:133
22428992321,1cyclictest0-21swapper/310:21:143
22428992321,1cyclictest0-21swapper/309:28:503
22428992320,2cyclictest24137-21ssh11:43:283
2242899230,2cyclictest16724-21ssh10:08:233
2242899230,23cyclictest15774-21diskmemload12:13:443
2242899230,23cyclictest0-21swapper/311:06:523
2242899230,23cyclictest0-21swapper/310:50:023
2242899230,23cyclictest0-21swapper/310:44:553
2242899230,22cyclictest16680-21rm12:07:303
2242899230,1cyclictest0-21swapper/310:31:303
2242899230,0cyclictest15774-21diskmemload12:35:023
2242899230,0cyclictest0-21swapper/310:14:543
22424992323,0cyclictest0-21swapper/212:21:312
22424992323,0cyclictest0-21swapper/212:12:122
22424992323,0cyclictest0-21swapper/212:04:192
22424992323,0cyclictest0-21swapper/210:25:332
22424992323,0cyclictest0-21swapper/210:25:332
2242499230,23cyclictest15774-21diskmemload12:19:042
2242499230,23cyclictest0-21swapper/211:51:032
2242499230,23cyclictest0-21swapper/209:42:592
2242499230,23cyclictest0-21swapper/209:15:512
2242499230,22cyclictest29078-21ssh10:20:172
2242499230,22cyclictest27735-21ssh10:48:082
2242499230,22cyclictest15774-21diskmemload12:31:472
2242499230,22cyclictest0-21swapper/210:37:572
2242499230,0cyclictest15774-21diskmemload11:20:232
2242499230,0cyclictest15774-21diskmemload09:53:322
2242499230,0cyclictest0-21swapper/212:36:372
2242499230,0cyclictest0-21swapper/211:03:272
2242499230,0cyclictest0-21swapper/210:13:092
2242499230,0cyclictest0-21swapper/209:59:182
22421992323,0cyclictest0-21swapper/112:07:131
22421992323,0cyclictest0-21swapper/110:51:291
22421992323,0cyclictest0-21swapper/109:45:251
22421992323,0cyclictest0-21swapper/109:16:461
22421992322,1cyclictest15774-21diskmemload12:17:191
22421992320,2cyclictest29261-21ssh11:48:041
22421992320,2cyclictest20329-21ssh10:42:391
2242199230,2cyclictest11300-21sh12:32:051
2242199230,23cyclictest0-21swapper/112:12:331
2242199230,23cyclictest0-21swapper/111:41:531
2242199230,23cyclictest0-21swapper/110:07:211
2242199230,22cyclictest2945-21sh09:56:401
2242199230,22cyclictest15886-21rm09:38:111
2242199230,22cyclictest11476-21apt-get09:02:471
2242199230,0cyclictest0-21swapper/112:39:051
2242199230,0cyclictest0-21swapper/111:58:401
2242199230,0cyclictest0-21swapper/110:57:191
2242199230,0cyclictest0-21swapper/110:02:251
2242199230,0cyclictest0-21swapper/109:30:391
22416992323,0cyclictest15774-21diskmemload10:55:280
22416992323,0cyclictest0-21swapper/012:00:090
22416992323,0cyclictest0-21swapper/010:37:360
22416992321,1cyclictest0-21swapper/010:50:050
22416992321,1cyclictest0-21swapper/010:47:070
22416992321,1cyclictest0-21swapper/009:26:580
2241699230,2cyclictest32559-21sh12:21:500
2241699230,2cyclictest19737-21munin-plugin-st11:40:000
2241699230,22cyclictest30059-21apt-get07:27:460
2241699230,22cyclictest28610-21kworker/u8:009:22:480
2241699230,22cyclictest19764-21ssh11:10:460
2241699230,22cyclictest0-21swapper/009:39:000
2241699230,1cyclictest0-21swapper/009:53:040
2241699230,0cyclictest15774-21diskmemload10:18:290
2241699230,0cyclictest0-21swapper/011:21:280
2241699230,0cyclictest0-21swapper/010:14:440
22428992222,0cyclictest15774-21diskmemload09:33:193
22428992222,0cyclictest0-21swapper/312:26:233
22428992222,0cyclictest0-21swapper/312:04:543
22428992222,0cyclictest0-21swapper/309:40:073
22428992221,1cyclictest12611-21ssh11:04:133
2242899220,22cyclictest0-21swapper/310:00:103
2242899220,21cyclictest4725-21ssh11:56:103
2242899220,21cyclictest0-21swapper/310:35:163
2242899220,21cyclictest0-21swapper/309:36:283
2242899220,21cyclictest0-21swapper/309:02:473
2242899220,21cyclictest0-21swapper/307:37:463
2242899220,1cyclictest0-21swapper/311:47:513
2242899220,1cyclictest0-21swapper/310:47:033
2242899220,0cyclictest0-21swapper/310:55:013
22424992222,0cyclictest0-21swapper/211:49:162
22424992222,0cyclictest0-21swapper/209:31:152
22424992221,1cyclictest15774-21diskmemload10:43:512
22424992220,2cyclictest27797-21ssh10:18:502
22424992220,2cyclictest17671-21ssh10:09:442
22424992219,2cyclictest20165-21rm12:10:012
2242499220,22cyclictest0-21swapper/211:35:102
2242499220,21cyclictest0-21swapper/211:35:002
2242499220,21cyclictest0-21swapper/211:10:012
2242499220,21cyclictest0-21swapper/209:25:262
2242499220,21cyclictest0-21swapper/207:17:462
2242499220,21cyclictest0-21swapper/207:17:462
22421992222,0cyclictest0-21swapper/112:02:401
22421992220,1cyclictest6501-21sh10:29:081
22421992220,1cyclictest6501-21sh10:29:081
22421992220,1cyclictest0-21swapper/111:15:361
2242199220,2cyclictest18937-21turbostat08:10:011
2242199220,22cyclictest0-21swapper/110:15:211
2242199220,22cyclictest0-21swapper/109:11:001
2242199220,21cyclictest4834-21ssh12:25:411
2242199220,21cyclictest29336-21sh10:20:381
2242199220,21cyclictest1963-21sh07:35:011
2242199220,21cyclictest15774-21diskmemload11:50:281
2242199220,21cyclictest0-21swapper/111:30:211
2242199220,21cyclictest0-21swapper/111:20:321
2242199220,21cyclictest0-21swapper/110:10:221
2242199220,1cyclictest10065-21apt-get11:02:471
22416992222,0cyclictest15774-21diskmemload09:15:540
22416992222,0cyclictest0-21swapper/012:15:150
22416992222,0cyclictest0-21swapper/008:12:470
22416992221,1cyclictest0-21swapper/012:25:090
22416992221,0cyclictest0-21swapper/007:22:460
22416992220,1cyclictest0-21swapper/011:32:080
22416992220,1cyclictest0-21swapper/010:30:250
2241699220,22cyclictest0-21swapper/011:25:020
2241699220,22cyclictest0-21swapper/010:26:250
2241699220,22cyclictest0-21swapper/010:26:250
2241699220,21cyclictest28307-21sh09:49:420
2241699220,21cyclictest22028-21tr11:42:470
2241699220,21cyclictest15774-21diskmemload11:06:050
2241699220,21cyclictest15774-21diskmemload10:00:370
2241699220,21cyclictest0-21swapper/008:42:470
2241699220,1cyclictest27313-21apt-get11:47:470
2241699220,1cyclictest17626-21sh10:09:410
2241699220,1cyclictest0-21swapper/012:36:040
2241699220,1cyclictest0-21swapper/009:57:540
22428992121,0cyclictest0-21swapper/307:12:483
22428992120,1cyclictest10336-21ssh12:30:373
22428992120,1cyclictest0-21swapper/307:42:473
22428992120,0cyclictest14620-21apt-get08:02:473
2242899210,21cyclictest300-21ssh12:22:053
2242899210,21cyclictest0-21swapper/307:22:463
2242899210,20cyclictest11748-21perf07:55:003
2242899210,0cyclictest0-21swapper/310:27:493
2242899210,0cyclictest0-21swapper/310:27:493
22424992121,0cyclictest15774-21diskmemload10:50:182
22424992121,0cyclictest15774-21diskmemload09:20:322
2242499210,21cyclictest0-21swapper/207:57:462
2242499210,20cyclictest3615-21ssh11:25:092
2242499210,20cyclictest0-21swapper/208:12:472
2242499210,0cyclictest0-21swapper/211:55:182
2242499210,0cyclictest0-21swapper/209:45:022
2242499210,0cyclictest0-21swapper/209:00:012
2242199210,21cyclictest0-21swapper/109:51:181
2242199210,20cyclictest26137-21cron08:25:001
22416992120,0cyclictest17013-21apt-get08:07:470
22416992119,1cyclictest0-21swapper/012:30:570
22416992118,2cyclictest8136-21latency_hist08:55:010
22416992118,2cyclictest6881-21awk07:45:000
2241699210,20cyclictest0-21swapper/007:47:450
2241699210,1cyclictest21773-21/usr/sbin/munin08:17:480
2241699210,0cyclictest15774-21diskmemload11:55:080
22428992020,0cyclictest0-21swapper/309:07:473
22428992020,0cyclictest0-21swapper/308:47:483
22428992018,1cyclictest27203-21munin-plugin-st07:20:013
22428992018,1cyclictest27203-21munin-plugin-st07:20:013
22424992020,0cyclictest0-21swapper/208:47:482
22424992020,0cyclictest0-21swapper/208:27:462
22424992020,0cyclictest0-21swapper/207:42:472
22424992018,1cyclictest30958-21munin-run08:35:002
2242499200,20cyclictest0-21swapper/207:12:492
2242499200,0cyclictest0-21swapper/209:02:472
22421992020,0cyclictest9806-21apt-get07:52:461
22421992020,0cyclictest0-21swapper/107:47:451
22421992020,0cyclictest0-21swapper/107:12:491
22421992019,1cyclictest12202-21apt-get07:57:461
22421992019,1cyclictest0-21swapper/108:55:021
22421992018,1cyclictest1411-21apt-get08:42:471
2242199200,0cyclictest0-21swapper/107:27:461
22416992020,0cyclictest0-21swapper/008:27:460
22416992020,0cyclictest0-21swapper/008:02:470
22416992020,0cyclictest0-21swapper/007:12:490
22428991919,0cyclictest0-21swapper/308:07:463
22428991919,0cyclictest0-21swapper/307:57:463
22424991919,0cyclictest27667-21apt-get07:22:462
22424991919,0cyclictest0-21swapper/209:07:472
22421991918,1cyclictest0-21swapper/108:12:471
22428991818,0cyclictest0-21swapper/308:52:463
22428991817,1cyclictest23763-21perf08:20:013
22424991817,0cyclictest0-21swapper/208:02:472
22421991817,1cyclictest4966-21apt-get07:42:471
22416991818,0cyclictest9004-21apt-get08:57:470
22416991817,0cyclictest25249-21apt-get07:17:470
22416991817,0cyclictest25249-21apt-get07:17:470
22428991717,0cyclictest0-21swapper/308:27:463
22428991717,0cyclictest0-21swapper/308:22:473
22428991717,0cyclictest0-21swapper/307:47:453
22428991717,0cyclictest0-21swapper/307:32:463
22424991717,0cyclictest21805-21apt-get08:17:472
22421991717,0cyclictest26620-21apt-get08:27:451
22421991717,0cyclictest0-21swapper/108:17:471
22421991716,0cyclictest0-21swapper/108:02:471
22416991717,0cyclictest0-21swapper/009:02:470
22416991717,0cyclictest0-21swapper/008:37:490
22424991616,0cyclictest2548-21apt-get07:37:462
22424991616,0cyclictest0-21swapper/207:52:462
22424991616,0cyclictest0-21swapper/207:32:462
22424991614,1cyclictest26162-21munin-plugin-st08:25:002
22421991616,0cyclictest0-21swapper/107:22:461
22416991616,0cyclictest0-21swapper/007:57:460
22428991515,0cyclictest0-21swapper/308:37:493
2242499150,0cyclictest0-21swapper/208:42:472
22416991515,0cyclictest32460-21apt-get07:32:460
22416991514,1cyclictest0-21swapper/009:08:230
2242899140,14cyclictest0-21swapper/308:55:133
2242899140,14cyclictest0-21swapper/308:10:123
2242899140,14cyclictest0-21swapper/307:25:363
2242899140,0cyclictest0-21swapper/308:40:043
2242899140,0cyclictest0-21swapper/308:30:323
22424991414,0cyclictest0-21swapper/208:37:492
2242499140,14cyclictest0-21swapper/208:05:162
2242499140,14cyclictest0-21swapper/207:25:282
2242499140,0cyclictest0-21swapper/208:50:092
2242499140,0cyclictest0-21swapper/207:45:472
22421991414,0cyclictest0-21swapper/107:35:021
2242199140,14cyclictest0-21swapper/109:05:161
2242199140,14cyclictest0-21swapper/107:15:011
2242199140,14cyclictest0-21swapper/107:15:011
2242199140,0cyclictest0-21swapper/108:46:491
2242199140,0cyclictest0-21swapper/108:35:201
2242199140,0cyclictest0-21swapper/108:30:281
22416991414,0cyclictest0-21swapper/008:45:350
2241699140,14cyclictest0-21swapper/008:30:060
2241699140,14cyclictest0-21swapper/008:20:540
2241699140,0cyclictest0-21swapper/007:35:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional