You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-11 - 00:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Mon Aug 10, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13115992723,0cyclictest7261-21diskmemload10:40:030
13124992523,1cyclictest0-21swapper/210:14:172
1312499250,24cyclictest17701-21ssh11:44:082
1312499250,0cyclictest0-21swapper/209:42:432
13119992524,1cyclictest0-21swapper/110:21:111
1311999250,24cyclictest0-21swapper/112:36:391
1311999250,24cyclictest0-21swapper/110:14:241
1311599250,24cyclictest0-21swapper/012:08:510
13129992423,0cyclictest0-21swapper/310:34:563
1312999240,23cyclictest7261-21diskmemload12:13:193
13124992422,1cyclictest31700-21ssh09:32:132
13124992422,1cyclictest17017-21ssh10:16:122
13124992422,1cyclictest0-21swapper/212:06:442
13124992420,2cyclictest3143-21rm10:33:452
13119992424,0cyclictest20314-21kworker/1:110:53:391
13119992422,1cyclictest0-21swapper/110:03:271
1311999240,24cyclictest0-21swapper/109:37:491
1311999240,23cyclictest7261-21diskmemload12:32:551
1311999240,23cyclictest0-21swapper/112:26:091
1311999240,23cyclictest0-21swapper/111:57:101
1311999240,23cyclictest0-21swapper/111:00:151
1311999240,23cyclictest0-21swapper/109:54:171
13115992423,1cyclictest0-21swapper/011:10:120
1311599242,21cyclictest62550irq/127-eno109:30:310
13115992422,1cyclictest0-21swapper/009:21:270
13115992421,2cyclictest17317-21sh10:45:050
13129992323,0cyclictest7261-21diskmemload10:42:203
13129992323,0cyclictest0-21swapper/311:51:203
13129992323,0cyclictest0-21swapper/311:46:483
13129992323,0cyclictest0-21swapper/311:40:523
13129992323,0cyclictest0-21swapper/309:36:293
13129992321,1cyclictest28612-21sh10:26:523
1312999230,23cyclictest0-21swapper/311:35:043
1312999230,23cyclictest0-21swapper/311:24:253
1312999230,23cyclictest0-21swapper/311:24:253
1312999230,23cyclictest0-21swapper/310:46:013
1312999230,23cyclictest0-21swapper/310:10:073
1312999230,22cyclictest7261-21diskmemload09:52:513
1312999230,22cyclictest5282-21ssh11:32:343
1312999230,22cyclictest425-21sh09:33:503
1312999230,22cyclictest23579-21ssh10:22:333
1312999230,22cyclictest23140-21cat07:30:013
1312999230,22cyclictest20673-21ssh09:22:243
1312999230,22cyclictest15209-21ssh09:45:203
1312999230,21cyclictest7261-21diskmemload12:01:143
1312999230,0cyclictest7261-21diskmemload10:07:263
1312999230,0cyclictest7261-21diskmemload09:18:583
1312999230,0cyclictest0-21swapper/312:31:033
13124992323,0cyclictest0-21swapper/212:18:362
13124992323,0cyclictest0-21swapper/211:27:572
13124992323,0cyclictest0-21swapper/211:12:372
13124992323,0cyclictest0-21swapper/211:07:152
13124992323,0cyclictest0-21swapper/210:01:272
13124992323,0cyclictest0-21swapper/209:59:412
13124992323,0cyclictest0-21swapper/209:46:372
13124992323,0cyclictest0-21swapper/208:29:222
13124992322,0cyclictest0-21swapper/212:20:162
13124992321,1cyclictest12805-21sh08:15:012
13124992321,1cyclictest0-21swapper/209:21:392
13124992320,2cyclictest21158-21sh09:50:522
1312499230,23cyclictest0-21swapper/210:43:012
1312499230,23cyclictest0-21swapper/210:23:332
1312499230,22cyclictest7261-21diskmemload09:15:122
1312499230,22cyclictest28799-21taskset10:55:182
1312499230,22cyclictest2445-21idleruntime-cro09:00:012
1312499230,22cyclictest1923-21ssh12:27:022
1312499230,22cyclictest0-21swapper/211:36:362
1312499230,22cyclictest0-21swapper/211:31:562
1312499230,22cyclictest0-21swapper/211:15:252
1312499230,22cyclictest0-21swapper/209:13:022
1312499230,0cyclictest7261-21diskmemload09:29:452
1312499230,0cyclictest0-21swapper/212:03:552
1312499230,0cyclictest0-21swapper/210:54:402
13119992323,0cyclictest7261-21diskmemload10:34:271
13119992323,0cyclictest7261-21diskmemload09:49:491
13119992323,0cyclictest0-21swapper/111:21:521
13119992323,0cyclictest0-21swapper/111:21:521
13119992323,0cyclictest0-21swapper/110:59:041
13119992323,0cyclictest0-21swapper/110:43:491
13119992322,1cyclictest7261-21diskmemload10:36:181
13119992322,0cyclictest0-21swapper/112:20:491
13119992321,1cyclictest0-21swapper/111:39:271
13119992321,1cyclictest0-21swapper/111:33:141
1311999230,23cyclictest0-21swapper/110:28:481
1311999230,22cyclictest9927-21rm12:04:421
1311999230,22cyclictest5368-21diskmemload10:05:451
1311999230,22cyclictest30789-21dump-pmu-power07:45:001
1311999230,22cyclictest27642-21dump-pmu-power08:45:001
1311999230,22cyclictest27382-21diskmemload11:52:041
1311999230,22cyclictest25859-21awk07:35:011
1311999230,22cyclictest23124-21ssh11:19:271
1311999230,22cyclictest23020-21ssh11:48:491
1311999230,22cyclictest21435-21perf10:20:001
1311999230,22cyclictest13517-21sh12:09:201
1311999230,22cyclictest13364-21sh09:15:021
1311999230,22cyclictest1-21systemd09:25:001
1311999230,22cyclictest0-21swapper/111:05:231
1311999230,22cyclictest0-21swapper/109:11:541
1311999230,0cyclictest0-21swapper/112:15:091
1311999230,0cyclictest0-21swapper/109:25:581
13115992323,0cyclictest7261-21diskmemload12:18:310
13115992323,0cyclictest0-21swapper/010:25:090
13115992323,0cyclictest0-21swapper/009:51:030
13115992323,0cyclictest0-21swapper/009:16:190
13115992321,2cyclictest0-21swapper/010:21:310
13115992321,1cyclictest738-21perf07:50:000
13115992321,1cyclictest7261-21diskmemload11:32:100
13115992321,1cyclictest0-21swapper/011:42:260
13115992321,1cyclictest0-21swapper/009:13:340
13115992320,2cyclictest4363-21sh09:36:230
1311599230,2cyclictest3206-21latency_hist11:30:010
1311599230,2cyclictest29615-21sh11:24:380
1311599230,2cyclictest29615-21sh11:24:380
1311599230,23cyclictest7261-21diskmemload12:10:500
1311599230,23cyclictest7261-21diskmemload10:38:530
1311599230,23cyclictest27185-21sh09:56:270
1311599230,23cyclictest0-21swapper/012:28:080
1311599230,23cyclictest0-21swapper/011:47:190
1311599230,23cyclictest0-21swapper/010:14:390
1311599230,22cyclictest7261-21diskmemload12:37:280
1311599230,22cyclictest7261-21diskmemload12:02:320
1311599230,22cyclictest26681-21ssh09:27:550
1311599230,22cyclictest26221-21ssh11:50:260
1311599230,22cyclictest15487-21latency_hist07:15:000
1311599230,22cyclictest0-21swapper/012:23:130
1311599230,22cyclictest0-21swapper/011:35:310
1311599230,1cyclictest29446-21ssh10:56:180
1311599230,0cyclictest0-21swapper/011:15:470
1311599230,0cyclictest0-21swapper/010:34:220
13129992222,0cyclictest0-21swapper/312:15:373
13129992222,0cyclictest0-21swapper/310:17:263
13129992222,0cyclictest0-21swapper/309:57:463
13129992222,0cyclictest0-21swapper/309:25:383
13129992221,1cyclictest23419-21apt-get08:39:233
13129992220,1cyclictest7261-21diskmemload09:11:213
13129992220,1cyclictest31228-21sh10:58:473
13129992220,1cyclictest22425-21cron08:35:003
1312999220,22cyclictest25301-21ssh10:53:163
1312999220,22cyclictest11247-21ssh12:06:083
1312999220,22cyclictest0-21swapper/311:09:443
1312999220,22cyclictest0-21swapper/310:38:533
1312999220,21cyclictest7261-21diskmemload12:20:413
1312999220,21cyclictest1843-21sh11:00:043
1312999220,21cyclictest0-21swapper/312:25:273
1312999220,21cyclictest0-21swapper/310:00:313
1312999220,21cyclictest0-21swapper/308:19:223
1312999220,1cyclictest7261-21diskmemload11:13:113
1312999220,1cyclictest488-21sh11:28:513
1312999220,1cyclictest13257-21rm12:36:303
1312999220,1cyclictest11204-21ssh09:42:303
13124992222,0cyclictest0-21swapper/212:38:532
13124992222,0cyclictest0-21swapper/210:07:482
13124992221,1cyclictest29354-21ssh11:54:242
13124992220,1cyclictest29257-21rm10:27:422
13124992220,1cyclictest0-21swapper/212:10:322
1312499220,22cyclictest7261-21diskmemload12:32:582
1312499220,21cyclictest7261-21diskmemload11:56:052
1312499220,21cyclictest26572-21apt-get07:39:232
1312499220,21cyclictest23148-21munin-plugin-st07:30:012
1312499220,21cyclictest18291-21ssh10:46:202
1312499220,1cyclictest27106-21sh11:23:312
1312499220,1cyclictest27106-21sh11:23:312
1312499220,1cyclictest21494-21ssh11:46:412
1312499220,1cyclictest17880-21apt-get07:20:022
1312499220,1cyclictest0-21swapper/211:00:032
1312499220,0cyclictest0-21swapper/209:36:202
13119992222,0cyclictest0-21swapper/112:11:261
13119992222,0cyclictest0-21swapper/111:10:071
13119992222,0cyclictest0-21swapper/109:55:301
13119992220,1cyclictest16070-21apt-get07:19:221
13119992220,1cyclictest0-21swapper/108:29:221
1311999220,21cyclictest7261-21diskmemload11:41:231
1311999220,21cyclictest0-21swapper/110:45:161
1311999220,21cyclictest0-21swapper/109:40:011
1311999220,1cyclictest31103-21ssh11:26:191
13115992221,1cyclictest0-21swapper/009:41:460
13115992220,1cyclictest7187-21apt-get11:05:020
13115992220,1cyclictest21114-21users10:19:320
13115992220,1cyclictest0-21swapper/012:30:040
1311599220,22cyclictest0-21swapper/010:51:490
1311599220,21cyclictest7261-21diskmemload09:45:340
1311599220,21cyclictest32434-21sh10:00:590
1311599220,21cyclictest24065-21apt-get07:34:210
1311599220,21cyclictest1352-21apt-get07:54:220
1311599220,21cyclictest0-21swapper/011:00:590
13129992121,0cyclictest0-21swapper/307:14:213
13129992120,1cyclictest0-21swapper/307:49:203
13129992119,1cyclictest18882-21apt07:24:233
1312999210,21cyclictest0-21swapper/311:55:243
1312999210,20cyclictest0-21swapper/308:14:233
1312999210,20cyclictest0-21swapper/307:44:223
1312999210,1cyclictest25838-21apt-get08:44:233
1312999210,1cyclictest0-21swapper/311:16:253
1312999210,0cyclictest23072-21apt-get07:30:023
1312999210,0cyclictest0-21swapper/308:59:263
13124992121,0cyclictest0-21swapper/208:24:222
1312499210,20cyclictest30631-21apt-get08:54:242
1312499210,1cyclictest8626-21apt-get08:09:242
1312499210,0cyclictest13672-21apt-get07:14:212
13119992121,0cyclictest0-21swapper/108:14:231
13119992119,1cyclictest28231-21apt-get08:49:221
13119992119,1cyclictest22-21ksoftirqd/108:00:001
1311999210,21cyclictest0-21swapper/108:35:031
13115992119,1cyclictest569-21apt-get08:59:260
13115992119,1cyclictest32446-21awk08:55:000
1311599210,21cyclictest0-21swapper/008:34:230
1311599210,21cyclictest0-21swapper/007:19:220
1311599210,0cyclictest0-21swapper/009:04:240
1311599210,0cyclictest0-21swapper/008:09:240
13129992020,0cyclictest0-21swapper/307:59:223
13129992020,0cyclictest0-21swapper/307:19:223
13129992019,1cyclictest0-21swapper/308:09:243
1312999200,20cyclictest6180-21apt-get08:04:233
1312999200,0cyclictest18229-21apt-get08:29:223
13124992020,0cyclictest0-21swapper/208:34:232
13124992018,1cyclictest313-21systemd-journal07:55:002
1312499200,19cyclictest0-21swapper/208:19:222
13119992020,0cyclictest4830-21perf09:05:011
13115992020,0cyclictest0-21swapper/007:29:240
13115992018,1cyclictest0-21swapper/007:20:020
1311599200,0cyclictest0-21swapper/008:39:230
13129991919,0cyclictest0-21swapper/307:54:223
13129991917,1cyclictest606-21dbus-daemon07:40:003
13124991919,0cyclictest0-21swapper/209:09:222
13124991919,0cyclictest0-21swapper/208:49:222
13124991919,0cyclictest0-21swapper/208:39:232
13124991919,0cyclictest0-21swapper/207:19:222
13119991919,0cyclictest0-21swapper/107:54:221
13119991919,0cyclictest0-21swapper/107:14:211
13124991817,1cyclictest28983-21apt-get07:44:212
13119991816,1cyclictest0-21swapper/108:20:011
1311999180,17cyclictest0-21swapper/108:04:231
13115991818,0cyclictest0-21swapper/008:19:220
13115991816,1cyclictest0-21swapper/008:30:010
13129991717,0cyclictest0-21swapper/308:54:243
13129991717,0cyclictest0-21swapper/308:49:223
13124991717,0cyclictest0-21swapper/208:45:002
13124991717,0cyclictest0-21swapper/207:34:212
13119991717,0cyclictest0-21swapper/108:54:231
13119991717,0cyclictest0-21swapper/107:24:231
13115991717,0cyclictest0-21swapper/009:09:220
13119991616,0cyclictest0-21swapper/107:39:231
13119991614,1cyclictest22-21ksoftirqd/108:24:221
13115991616,0cyclictest0-21swapper/008:14:230
13115991616,0cyclictest0-21swapper/008:04:230
13115991616,0cyclictest0-21swapper/007:44:220
13115991615,0cyclictest0-21swapper/007:39:230
13115991613,2cyclictest30050-21grep08:50:000
1311599160,1cyclictest17785-21pluginstate08:25:010
13129991515,0cyclictest15837-21apt-get08:24:233
13119991515,0cyclictest0-21swapper/107:29:241
1311999150,1cyclictest0-21swapper/108:59:261
13129991414,0cyclictest0-21swapper/309:02:423
1312999140,14cyclictest0-21swapper/309:05:443
1312499140,14cyclictest0-21swapper/209:01:592
1312499140,14cyclictest0-21swapper/207:49:572
1312499140,0cyclictest0-21swapper/208:01:052
1312499140,0cyclictest0-21swapper/207:55:112
1311999140,14cyclictest0-21swapper/109:05:151
1311999140,0cyclictest0-21swapper/108:05:111
1311599140,14cyclictest0-21swapper/008:40:380
1311599140,14cyclictest0-21swapper/007:55:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional