You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-05 - 17:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Fri Jun 05, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1990992624,1cyclictest0-21swapper/111:08:571
199099260,25cyclictest0-21swapper/110:54:071
199999250,24cyclictest27721-21diskmemload10:16:063
199499250,24cyclictest26014-21ssh12:09:422
1990992523,1cyclictest0-21swapper/110:40:011
199099250,24cyclictest15374-21sh12:00:011
199099250,24cyclictest0-21swapper/109:27:211
199099250,1cyclictest8935-21ntp_states12:24:011
198999250,24cyclictest27721-21diskmemload10:56:160
198999250,24cyclictest0-21swapper/011:07:320
198999250,24cyclictest0-21swapper/009:28:510
1999992411,6cyclictest313-21systemd-journal07:15:013
199999240,24cyclictest27721-21diskmemload11:02:533
199999240,24cyclictest0-21swapper/311:48:163
199999240,23cyclictest313-21systemd-journal11:35:003
199999240,23cyclictest27721-21diskmemload10:05:283
199499240,24cyclictest0-21swapper/211:56:402
199499240,23cyclictest27721-21diskmemload10:13:252
199499240,23cyclictest17242-21ssh12:02:272
199499240,23cyclictest0-21swapper/210:04:192
199499240,1cyclictest10041-21ssh11:25:002
1990992424,0cyclictest0-21swapper/112:02:251
1990992422,1cyclictest20158-21grep08:55:011
1990992422,1cyclictest11592-21munin-plugin-st07:30:001
199099240,24cyclictest0-21swapper/109:44:091
199099240,23cyclictest5164-21idleruntime-cro09:50:001
199099240,23cyclictest0-21swapper/111:23:251
199099240,23cyclictest0-21swapper/111:04:541
199099240,23cyclictest0-21swapper/110:59:021
199099240,22cyclictest313-21systemd-journal11:20:011
199099240,0cyclictest0-21swapper/110:42:361
199099240,0cyclictest0-21swapper/110:17:261
1989992424,0cyclictest0-21swapper/010:38:460
1989992423,1cyclictest62550irq/127-eno111:53:340
1989992423,1cyclictest0-21swapper/010:45:570
198999240,23cyclictest27721-21diskmemload10:04:380
198999240,23cyclictest21675-21sh12:35:450
198999240,23cyclictest0-21swapper/011:46:330
198999240,23cyclictest0-21swapper/009:59:250
198999240,23cyclictest0-21swapper/009:43:560
198999240,23cyclictest0-21swapper/009:20:140
198999240,22cyclictest15927-21sh12:00:260
1999992323,0cyclictest27721-21diskmemload12:35:533
1999992323,0cyclictest27721-21diskmemload10:40:463
1999992323,0cyclictest0-21swapper/312:19:053
1999992323,0cyclictest0-21swapper/311:20:253
1999992323,0cyclictest0-21swapper/310:01:323
1999992323,0cyclictest0-21swapper/309:23:383
1999992321,1cyclictest6783-21dump-pmu-power07:20:013
1999992321,1cyclictest31600-1kworker/u9:011:09:213
1999992321,1cyclictest3057-21sh09:18:423
1999992321,1cyclictest24452-21apt-get09:38:553
1999992321,1cyclictest13990-21perf07:35:003
1999992321,1cyclictest0-21swapper/310:38:583
1999992320,2cyclictest26289-21sh11:10:023
1999992320,2cyclictest10499-21latency_hist12:25:013
199999230,23cyclictest0-21swapper/312:08:473
199999230,23cyclictest0-21swapper/309:40:203
199999230,22cyclictest5351-21sh11:50:263
199999230,22cyclictest28519-21ssh11:42:393
199999230,22cyclictest17206-21rm09:30:563
199999230,22cyclictest16893-21ssh12:31:373
199999230,22cyclictest0-21swapper/307:55:013
199999230,0cyclictest27721-21diskmemload11:36:483
199999230,0cyclictest0-21swapper/310:49:003
1994992323,0cyclictest0-21swapper/210:18:262
1994992322,1cyclictest27721-21diskmemload12:25:012
1994992321,1cyclictest20414-21ssh11:34:232
1994992321,1cyclictest0-21swapper/209:32:002
1994992321,1cyclictest0-21swapper/209:14:012
1994992320,2cyclictest27300-21ssh12:11:202
199499230,23cyclictest0-21swapper/211:43:202
199499230,23cyclictest0-21swapper/211:26:182
199499230,23cyclictest0-21swapper/211:09:392
199499230,23cyclictest0-21swapper/210:57:532
199499230,23cyclictest0-21swapper/210:23:322
199499230,23cyclictest0-21swapper/209:37:212
199499230,23cyclictest0-21swapper/209:28:382
199499230,22cyclictest7850-21ssh09:22:512
199499230,22cyclictest7211-21ssh11:53:162
199499230,22cyclictest313-21systemd-journal10:33:142
199499230,22cyclictest27955-21ssh09:41:082
199499230,1cyclictest28699-21ssh10:43:252
199499230,0cyclictest0-21swapper/211:50:002
1990992323,0cyclictest27721-21diskmemload12:05:121
1990992323,0cyclictest27721-21diskmemload11:54:111
1990992323,0cyclictest27721-21diskmemload11:29:131
1990992323,0cyclictest0-21swapper/112:12:361
1990992323,0cyclictest0-21swapper/110:10:211
1990992321,1cyclictest606-21dbus-daemon08:00:011
1990992321,1cyclictest18029-21sh10:02:511
1990992321,1cyclictest0-21swapper/112:37:191
1990992321,1cyclictest0-21swapper/111:12:161
1990992321,1cyclictest0-21swapper/109:24:141
1990992321,1cyclictest0-21swapper/109:11:351
1990992320,2cyclictest22971-21lockfile-remove09:00:011
199099230,23cyclictest0-21swapper/112:16:191
199099230,23cyclictest0-21swapper/110:23:381
199099230,22cyclictest5558-21ssh09:50:161
199099230,22cyclictest4923-21/usr/sbin/munin09:19:051
199099230,22cyclictest21613-21sh10:05:231
199099230,22cyclictest16763-21ssh09:30:201
199099230,22cyclictest11710-21sh09:56:171
199099230,22cyclictest0-21swapper/111:33:501
1989992323,0cyclictest0-21swapper/012:14:230
1989992323,0cyclictest0-21swapper/010:32:500
1989992323,0cyclictest0-21swapper/009:35:220
1989992323,0cyclictest0-21swapper/009:33:300
1989992321,1cyclictest0-21swapper/011:30:340
1989992321,1cyclictest0-21swapper/010:18:570
1989992321,1cyclictest0-21swapper/009:11:220
1989992320,2cyclictest27721-21diskmemload11:04:190
1989992320,2cyclictest26256-21sh12:10:010
198999230,2cyclictest14473-21sh12:29:030
198999230,23cyclictest0-21swapper/010:05:470
198999230,22cyclictest783-21snmpd10:11:150
198999230,22cyclictest75-21kswapd012:20:020
198999230,22cyclictest4948-21sh10:50:260
198999230,22cyclictest0-21swapper/011:40:590
198999230,22cyclictest0-21swapper/011:17:210
198999230,22cyclictest0-21swapper/010:40:320
198999230,1cyclictest0-21swapper/012:15:570
198999230,1cyclictest0-21swapper/011:58:550
198999230,1cyclictest0-21swapper/009:15:330
198999230,0cyclictest27721-21diskmemload11:22:430
1999992222,0cyclictest0-21swapper/312:10:193
1999992221,1cyclictest0-21swapper/309:10:283
1999992219,2cyclictest13168-21/usr/sbin/munin12:29:063
199999220,22cyclictest27721-21diskmemload10:27:053
199999220,22cyclictest1439-21ssh11:18:203
199999220,22cyclictest0-21swapper/312:01:303
199999220,21cyclictest27721-21diskmemload11:25:293
199999220,21cyclictest26082-21perf08:00:013
199999220,21cyclictest12058-21sh10:58:133
199999220,21cyclictest0-21swapper/310:22:003
199999220,21cyclictest0-21swapper/310:13:563
199999220,21cyclictest0-21swapper/309:55:013
199999220,21cyclictest0-21swapper/309:50:573
199999220,21cyclictest0-21swapper/309:47:143
199999220,1cyclictest17057-21apt-get07:43:573
199999220,1cyclictest15383-21cron12:00:013
199999220,1cyclictest0-21swapper/309:26:083
199999220,0cyclictest0-21swapper/310:50:463
199999220,0cyclictest0-21swapper/310:31:303
1994992222,0cyclictest0-21swapper/212:35:022
1994992222,0cyclictest0-21swapper/212:30:112
1994992222,0cyclictest0-21swapper/211:12:402
1994992222,0cyclictest0-21swapper/211:00:022
1994992222,0cyclictest0-21swapper/210:25:062
1994992222,0cyclictest0-21swapper/210:07:552
1994992221,1cyclictest31969-21ssh12:15:132
1994992220,1cyclictest30952-21basename08:10:012
199499220,22cyclictest7051-21ssh12:22:472
199499220,22cyclictest27721-21diskmemload10:49:282
199499220,21cyclictest6777-21dump-pmu-power07:20:012
199499220,21cyclictest27721-21diskmemload11:16:022
199499220,21cyclictest25332-21sh09:05:002
199499220,21cyclictest15909-21apt-get08:48:552
199499220,21cyclictest15875-21apt10:00:002
199499220,21cyclictest0-21swapper/210:50:452
199499220,1cyclictest22233-21sh11:36:492
199499220,1cyclictest11583-21idleruntime-cro07:30:002
199499220,1cyclictest0-21swapper/209:53:222
1990992222,0cyclictest27721-21diskmemload12:29:451
1990992221,1cyclictest11064-21sh10:26:001
1990992220,1cyclictest17051-21ssh12:31:501
1990992220,1cyclictest14640-21apt-get07:38:561
1990992220,1cyclictest0-21swapper/110:45:291
199099220,22cyclictest0-21swapper/109:38:421
199099220,21cyclictest3913-21apt-get08:23:571
199099220,21cyclictest0-21swapper/109:08:541
199099220,21cyclictest0-21swapper/107:13:551
199099220,1cyclictest32711-21ssh11:45:501
199099220,1cyclictest21528-21sh11:35:411
199099220,1cyclictest20771-21ssh10:34:521
199099220,0cyclictest0-21swapper/111:42:061
1989992220,1cyclictest25361-21munin-run09:05:000
1989992220,1cyclictest0-21swapper/009:47:500
198999220,22cyclictest0-21swapper/010:27:450
198999220,22cyclictest0-21swapper/009:51:410
198999220,21cyclictest27721-21diskmemload11:25:030
198999220,21cyclictest17748-21awk08:50:010
198999220,21cyclictest0-21swapper/010:20:440
198999220,21cyclictest0-21swapper/008:08:550
198999220,0cyclictest27721-21diskmemload11:13:460
198999220,0cyclictest0-21swapper/012:31:340
1999992121,0cyclictest0-21swapper/309:00:013
1999992119,1cyclictest0-21swapper/307:25:013
199999210,1cyclictest8136-21apt08:30:003
1994992120,1cyclictest2009-21ssh09:17:032
199499210,20cyclictest19454-21apt-get07:48:572
199499210,0cyclictest20140-21apt-get08:55:022
199499210,0cyclictest0-21swapper/209:48:552
199099210,20cyclictest0-21swapper/107:33:581
199099210,0cyclictest0-21swapper/108:43:571
1989992121,0cyclictest0-21swapper/008:03:570
198999210,0cyclictest0-21swapper/007:33:580
1999992020,0cyclictest0-21swapper/308:33:583
199999200,20cyclictest0-21swapper/308:13:563
1994992020,0cyclictest24240-21apt-get07:58:552
1994992020,0cyclictest0-21swapper/208:18:562
1994992020,0cyclictest0-21swapper/207:43:582
1994992020,0cyclictest0-21swapper/207:38:562
1990992020,0cyclictest0-21swapper/108:38:561
1990992020,0cyclictest0-21swapper/108:18:561
1990992020,0cyclictest0-21swapper/107:48:571
1990992020,0cyclictest0-21swapper/107:43:571
1990992019,0cyclictest0-21swapper/107:53:561
1990992018,1cyclictest17746-21perf08:50:011
199099200,19cyclictest4933-21apt-get07:18:551
1989992020,0cyclictest0-21swapper/008:43:570
1989992019,1cyclictest0-21swapper/007:55:010
1989992018,1cyclictest0-21swapper/009:08:540
1989992018,1cyclictest0-21swapper/008:40:010
1999991919,0cyclictest0-21swapper/308:53:553
1999991919,0cyclictest0-21swapper/308:08:553
1999991918,1cyclictest13517-21apt-get08:43:573
1994991917,1cyclictest5760-21idleruntime-cro08:25:002
1990991919,0cyclictest0-21swapper/109:03:561
1990991918,1cyclictest0-21swapper/108:28:551
1989991919,0cyclictest0-21swapper/008:53:550
1989991919,0cyclictest0-21swapper/008:13:550
1989991919,0cyclictest0-21swapper/007:23:560
199999180,17cyclictest0-21swapper/307:28:553
1994991818,0cyclictest21848-21apt-get07:53:562
1994991818,0cyclictest0-21swapper/208:28:552
1994991817,1cyclictest18305-21apt-get08:53:542
1994991817,0cyclictest11100-21apt-get08:38:562
1990991818,0cyclictest8709-21apt-get08:33:581
1990991818,0cyclictest0-21swapper/108:13:551
1990991818,0cyclictest0-21swapper/108:03:571
1989991818,0cyclictest0-21swapper/007:58:550
1989991818,0cyclictest0-21swapper/007:43:580
1989991818,0cyclictest0-21swapper/007:13:560
1989991817,1cyclictest0-21swapper/008:55:020
1989991817,1cyclictest0-21swapper/008:30:000
198999180,1cyclictest9743-21apt-get07:28:550
1999991715,1cyclictest14640-21apt-get07:38:563
1989991717,0cyclictest0-21swapper/007:38:560
1989991717,0cyclictest0-21swapper/007:18:560
1999991616,0cyclictest0-21swapper/308:03:573
199999160,14cyclictest0-21swapper/309:06:173
1994991614,1cyclictest10544-21perf08:35:002
199499156,6cyclictest619-21polkitd07:25:012
1994991515,0cyclictest0-21swapper/207:13:562
1989991513,1cyclictest10534-21dump-pmu-power08:35:000
199999140,14cyclictest0-21swapper/309:01:013
199999140,14cyclictest0-21swapper/308:46:133
199999140,14cyclictest0-21swapper/308:35:093
199999140,14cyclictest0-21swapper/308:15:253
199999140,0cyclictest0-21swapper/308:20:363
199999140,0cyclictest0-21swapper/307:46:323
1994991414,0cyclictest0-21swapper/208:41:102
199499140,14cyclictest0-21swapper/208:03:012
199499140,0cyclictest0-21swapper/209:05:142
199499140,0cyclictest0-21swapper/208:10:392
199499140,0cyclictest0-21swapper/207:30:042
1989991414,0cyclictest0-21swapper/008:15:060
1989991414,0cyclictest0-21swapper/007:45:080
198999140,14cyclictest0-21swapper/008:20:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional