You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 21:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Wed Mar 25, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16345992827,1cyclictest24457-21taskset12:02:550
16345992827,1cyclictest24457-21taskset12:02:550
1635599250,24cyclictest9650-21diskmemload12:28:363
1635599250,24cyclictest16093-21sh09:16:423
1635599250,1cyclictest0-21swapper/310:27:203
16353992523,1cyclictest0-21swapper/211:43:012
1635399250,24cyclictest9650-21diskmemload10:08:472
16348992523,1cyclictest7281-21latency_hist09:05:011
1634899250,1cyclictest9650-21diskmemload09:34:151
16345992523,2cyclictest21087-21ssh10:56:420
16345992512,13cyclictest0-21swapper/012:37:550
1634599250,24cyclictest9714-21ssh09:42:450
16355992424,0cyclictest9650-21diskmemload11:21:023
16355992423,1cyclictest0-21swapper/309:48:403
16355992422,1cyclictest0-21swapper/311:12:483
16355992421,2cyclictest1254-21sh12:11:223
1635599240,23cyclictest9650-21diskmemload11:46:253
1635599240,23cyclictest21407-21grep10:25:013
1635599240,1cyclictest9650-21diskmemload09:31:093
1635599240,1cyclictest27170-21sh09:58:213
1635599240,0cyclictest0-21swapper/310:18:343
1635399240,24cyclictest0-21swapper/211:05:482
1635399240,23cyclictest9650-21diskmemload12:00:542
1635399240,23cyclictest9650-21diskmemload12:00:542
1635399240,23cyclictest0-21swapper/210:31:302
1635399240,23cyclictest0-21swapper/209:30:032
1635399240,23cyclictest0-21swapper/209:12:172
16348992423,1cyclictest14900-21ssh11:52:591
16348992423,1cyclictest1322-21grep11:08:041
16348992422,1cyclictest0-21swapper/111:20:481
1634899240,24cyclictest9650-21diskmemload12:23:201
1634899240,24cyclictest0-21swapper/112:29:131
1634899240,23cyclictest7139-21ssh11:13:581
1634899240,23cyclictest27816-21ssh12:37:131
1634899240,23cyclictest18721-21ssh11:57:341
1634899240,23cyclictest13241-21dpkg11:20:011
1634899240,0cyclictest9650-21diskmemload10:39:141
1634899240,0cyclictest0-21swapper/109:22:301
1634599240,24cyclictest9650-21diskmemload11:04:570
1634599240,24cyclictest9650-21diskmemload10:12:260
1634599240,23cyclictest14524-21ssh09:47:190
1634599240,23cyclictest1406-21cron11:40:000
1634599240,23cyclictest10328-21ssh09:10:420
16355992323,0cyclictest0-21swapper/312:34:563
16355992323,0cyclictest0-21swapper/310:32:343
16355992321,1cyclictest0-21swapper/307:50:003
1635599230,2cyclictest27718-21ssh11:33:213
1635599230,23cyclictest0-21swapper/311:36:173
1635599230,23cyclictest0-21swapper/310:50:083
1635599230,22cyclictest9650-21diskmemload10:40:583
1635599230,22cyclictest3722-21rm09:36:233
1635599230,22cyclictest32383-21sh10:35:503
1635599230,22cyclictest0-21swapper/312:36:153
1635599230,22cyclictest0-21swapper/312:15:253
1635599230,22cyclictest0-21swapper/311:52:263
1635599230,22cyclictest0-21swapper/311:05:543
1635599230,22cyclictest0-21swapper/309:21:063
1635599230,0cyclictest0-21swapper/311:16:383
1635599230,0cyclictest0-21swapper/311:01:283
16353992323,0cyclictest0-21swapper/212:13:142
16353992323,0cyclictest0-21swapper/211:35:032
16353992323,0cyclictest0-21swapper/211:21:592
16353992323,0cyclictest0-21swapper/210:15:162
16353992322,1cyclictest9650-21diskmemload11:50:582
16353992321,1cyclictest9650-21diskmemload11:57:542
16353992321,1cyclictest0-21swapper/209:42:562
1635399230,2cyclictest12577-21apt-get12:22:552
1635399230,2cyclictest0-21swapper/211:45:562
1635399230,23cyclictest0-21swapper/211:17:112
1635399230,22cyclictest16751-21rm09:17:502
1635399230,22cyclictest0-21swapper/210:27:012
1635399230,1cyclictest0-21swapper/210:51:022
1635399230,0cyclictest9650-21diskmemload12:17:462
1635399230,0cyclictest0-21swapper/212:29:512
16348992323,0cyclictest0-21swapper/110:22:281
16348992322,1cyclictest1877-21kworker/u8:011:44:001
16348992321,1cyclictest28562-21apt-get10:32:541
16348992321,1cyclictest15261-21ssh09:15:271
16348992321,1cyclictest12199-21hddtemp_smartct10:47:571
16348992321,1cyclictest0-21swapper/111:40:001
16348992321,1cyclictest0-21swapper/109:49:401
1634899230,23cyclictest0-21swapper/109:50:051
1634899230,22cyclictest9650-21diskmemload12:02:191
1634899230,22cyclictest9650-21diskmemload12:02:191
1634899230,22cyclictest9650-21diskmemload10:18:241
1634899230,22cyclictest9641-21sh12:18:531
1634899230,22cyclictest28722-21ssh10:00:261
1634899230,22cyclictest22921-21sh10:27:061
1634899230,22cyclictest12802-21sh09:44:481
1634899230,22cyclictest0-21swapper/112:10:551
1634899230,0cyclictest0-21swapper/110:44:381
1634899230,0cyclictest0-21swapper/109:58:141
16345992323,0cyclictest0-21swapper/010:51:100
16345992323,0cyclictest0-21swapper/010:24:310
16345992323,0cyclictest0-21swapper/009:57:230
16345992322,1cyclictest0-21swapper/011:52:120
16345992321,1cyclictest1137-21ssh10:37:450
16345992320,2cyclictest18748-21sh11:57:360
1634599231,21cyclictest9650-21diskmemload10:30:470
1634599230,2cyclictest31323-21ssh09:31:400
1634599230,23cyclictest0-21swapper/012:10:240
1634599230,23cyclictest0-21swapper/011:40:010
1634599230,23cyclictest0-21swapper/011:34:250
1634599230,22cyclictest4866-21sendmail09:00:010
1634599230,22cyclictest26964-21rm09:27:520
1634599230,22cyclictest21835-21ssh09:22:420
1634599230,21cyclictest22014-21diskmemload12:31:040
1634599230,0cyclictest9650-21diskmemload12:21:330
1634599230,0cyclictest0-21swapper/011:10:210
16355992220,1cyclictest622-21gdbus07:35:003
16355992220,1cyclictest23043-21sh12:00:443
16355992220,1cyclictest23043-21sh12:00:443
16355992220,1cyclictest0-21swapper/311:58:153
16355992220,1cyclictest0-21swapper/310:45:073
16355992220,1cyclictest0-21swapper/310:11:243
16355992220,1cyclictest0-21swapper/310:05:073
16355992220,1cyclictest0-21swapper/309:25:113
1635599220,22cyclictest0-21swapper/312:09:053
1635599220,22cyclictest0-21swapper/311:44:153
1635599220,21cyclictest9650-21diskmemload10:00:183
1635599220,21cyclictest9650-21diskmemload09:50:063
1635599220,21cyclictest31310-21apt-get07:42:553
1635599220,21cyclictest0-21swapper/309:40:103
1635599220,21cyclictest0-21swapper/309:10:083
1635599220,21cyclictest0-21swapper/309:00:013
1635599220,1cyclictest20812-21ssh10:56:183
1635599220,1cyclictest0-21swapper/311:25:083
1635599220,0cyclictest0-21swapper/308:02:543
16353992222,0cyclictest20959-21apt-get08:27:542
16353992222,0cyclictest0-21swapper/210:10:482
16353992222,0cyclictest0-21swapper/210:00:022
16353992222,0cyclictest0-21swapper/209:55:402
16353992221,0cyclictest0-21swapper/209:21:062
16353992220,1cyclictest32483-21apt08:50:012
1635399220,22cyclictest0-21swapper/212:34:222
1635399220,22cyclictest0-21swapper/209:50:362
1635399220,22cyclictest0-21swapper/209:26:002
1635399220,21cyclictest9650-21diskmemload09:35:102
1635399220,21cyclictest313-21systemd-journal10:46:082
1635399220,21cyclictest0-21swapper/212:35:232
1635399220,21cyclictest0-21swapper/211:25:192
1635399220,21cyclictest0-21swapper/211:00:282
1635399220,21cyclictest0-21swapper/210:40:302
1635399220,1cyclictest19185-21apt-get07:17:532
1635399220,1cyclictest0-21swapper/212:06:312
1635399220,1cyclictest0-21swapper/210:55:092
1635399220,0cyclictest0-21swapper/211:30:362
1635399220,0cyclictest0-21swapper/210:35:142
16348992222,0cyclictest0-21swapper/111:46:281
16348992222,0cyclictest0-21swapper/111:30:591
16348992222,0cyclictest0-21swapper/110:50:321
16348992222,0cyclictest0-21swapper/110:05:401
16348992222,0cyclictest0-21swapper/109:39:091
16348992221,1cyclictest0-21swapper/109:26:111
1634899220,21cyclictest9650-21diskmemload11:00:371
1634899220,21cyclictest9650-21diskmemload10:10:331
1634899220,21cyclictest0-21swapper/112:32:551
1634899220,21cyclictest0-21swapper/111:25:121
1634899220,21cyclictest0-21swapper/110:55:231
1634899220,1cyclictest0-21swapper/112:06:371
1634899220,1cyclictest0-21swapper/107:17:531
16345992222,0cyclictest22554-21ssh11:28:190
16345992222,0cyclictest0-21swapper/010:17:250
16345992222,0cyclictest0-21swapper/009:51:160
16345992222,0cyclictest0-21swapper/009:17:390
16345992220,1cyclictest6031-21ssh12:15:480
1634599220,22cyclictest27778-21ssh12:05:050
1634599220,22cyclictest0-21swapper/010:44:010
1634599220,22cyclictest0-21swapper/010:27:450
1634599220,22cyclictest0-21swapper/010:06:470
1634599220,21cyclictest9650-21diskmemload11:05:090
1634599220,21cyclictest28307-21perf07:35:000
1634599220,21cyclictest0-21swapper/009:35:260
1634599220,1cyclictest14167-21ssh11:20:500
1634599220,1cyclictest0-21swapper/011:47:550
1634599220,0cyclictest9650-21diskmemload10:00:480
1634599220,0cyclictest0-21swapper/010:46:260
16355992121,0cyclictest0-21swapper/309:07:543
1635599210,21cyclictest0-21swapper/308:50:013
1635599210,1cyclictest11124-21ssh12:20:373
1635599210,0cyclictest0-21swapper/308:32:543
1635599210,0cyclictest0-21swapper/308:12:563
1635599210,0cyclictest0-21swapper/307:17:533
16353992120,1cyclictest9684-21cut09:10:012
16353992120,1cyclictest791-21apt-get07:45:022
16353992120,1cyclictest4087-21apt-get07:52:542
16353992120,1cyclictest15672-21munin-run08:15:012
1635399210,20cyclictest0-21swapper/210:20:282
1635399210,20cyclictest0-21swapper/207:42:552
16348992120,1cyclictest28789-21apt-get07:37:541
16348992119,1cyclictest9956-21sh09:10:101
1634899210,1cyclictest6485-21apt-get07:57:551
1634899210,0cyclictest0-21swapper/108:17:561
16345992121,0cyclictest18568-21apt-get08:22:550
16345992121,0cyclictest0-21swapper/008:07:540
16345992120,1cyclictest0-21swapper/012:25:550
1634599210,20cyclictest0-21swapper/008:02:550
16355992020,0cyclictest0-21swapper/308:52:553
16355992020,0cyclictest0-21swapper/308:22:543
1635599200,0cyclictest0-21swapper/308:17:563
16353992019,1cyclictest27698-21munin-plugin-st08:40:002
1635399200,20cyclictest0-21swapper/208:42:562
1635399200,0cyclictest0-21swapper/207:37:542
16348992020,0cyclictest0-21swapper/108:47:531
16348992020,0cyclictest0-21swapper/108:07:541
16348992019,1cyclictest30096-21perf08:45:011
16348992019,1cyclictest0-21swapper/108:57:551
16348992017,2cyclictest18688-21awk07:15:011
16348992017,2cyclictest18688-21awk07:15:011
1634899200,0cyclictest0-21swapper/108:32:541
16345992020,0cyclictest0-21swapper/008:17:560
16355991919,0cyclictest0-21swapper/308:07:543
16355991919,0cyclictest0-21swapper/307:37:543
16355991919,0cyclictest0-21swapper/307:27:543
16355991917,1cyclictest6008-21apt07:55:003
16353991919,0cyclictest0-21swapper/207:27:542
16353991918,1cyclictest11349-21apt-get08:07:542
16348991919,0cyclictest23996-21apt-get07:27:541
16348991919,0cyclictest0-21swapper/108:52:551
16348991919,0cyclictest0-21swapper/107:52:541
16348991919,0cyclictest0-21swapper/107:47:541
16345991919,0cyclictest0-21swapper/008:47:530
16345991918,1cyclictest25753-21apt-get08:37:550
1634599190,0cyclictest0-21swapper/007:22:540
16355991818,0cyclictest0-21swapper/308:37:553
16353991818,0cyclictest0-21swapper/209:02:552
16348991818,0cyclictest7757-21apt-get09:07:541
16348991818,0cyclictest0-21swapper/108:27:541
16345991817,0cyclictest0-21swapper/007:12:550
16345991817,0cyclictest0-21swapper/007:12:550
16355991715,1cyclictest16791-21apt-get07:12:553
16355991715,1cyclictest16791-21apt-get07:12:553
1635599170,16cyclictest0-21swapper/307:22:533
16353991717,0cyclictest0-21swapper/208:22:542
16353991716,1cyclictest0-21swapper/208:02:552
1635399170,16cyclictest28173-21chrt07:33:392
16348991716,0cyclictest0-21swapper/107:32:541
16345991717,0cyclictest0-21swapper/009:07:540
16345991717,0cyclictest0-21swapper/009:02:540
16345991717,0cyclictest0-21swapper/008:27:540
16345991717,0cyclictest0-21swapper/007:57:550
16345991717,0cyclictest0-21swapper/007:47:540
1635599160,15cyclictest28002-21taskset08:41:073
16353991615,0cyclictest0-21swapper/207:22:542
16353991613,2cyclictest25250-21cron08:35:002
16348991616,0cyclictest0-21swapper/108:37:551
16345991616,0cyclictest0-21swapper/007:17:520
1635599150,1cyclictest7127-21hddtemp_smartct07:57:583
16353991513,1cyclictest8397-21idleruntime-cro08:00:012
1635599140,14cyclictest0-21swapper/308:25:253
1635599140,0cyclictest0-21swapper/309:00:163
1635399140,14cyclictest0-21swapper/208:50:562
1635399140,14cyclictest0-21swapper/207:12:272
1635399140,14cyclictest0-21swapper/207:12:272
1635399140,0cyclictest0-21swapper/208:55:132
1635399140,0cyclictest0-21swapper/208:15:132
16348991414,0cyclictest0-21swapper/107:40:421
16348991414,0cyclictest0-21swapper/107:20:211
1634899140,14cyclictest0-21swapper/108:10:141
1634899140,14cyclictest0-21swapper/108:00:051
16345991414,0cyclictest0-21swapper/007:40:100
16345991414,0cyclictest0-21swapper/007:35:490
16345991414,0cyclictest0-21swapper/007:25:210
1634599140,14cyclictest0-21swapper/008:50:330
1634599140,14cyclictest0-21swapper/008:40:140
1634599140,14cyclictest0-21swapper/008:30:520
1634599140,14cyclictest0-21swapper/008:10:220
1634599140,14cyclictest0-21swapper/007:51:090
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional