You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-28 - 01:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot5s.osadl.org (updated Sun Sep 27, 2026 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10105993130,1cyclictest0-21swapper/011:55:310
10109992523,1cyclictest0-21swapper/309:28:213
10109992523,1cyclictest0-21swapper/309:28:213
1010799250,24cyclictest4225-21diskmemload12:17:291
1010799250,24cyclictest0-21swapper/111:24:571
10109992423,1cyclictest4225-21diskmemload11:02:443
10109992421,2cyclictest16992-21sh08:30:003
1010999240,24cyclictest4225-21diskmemload09:11:553
1010999240,23cyclictest22615-21nvmesmart_nvme010:53:283
1010999240,23cyclictest0-21swapper/311:48:223
1010999240,23cyclictest0-21swapper/311:48:223
1010999240,1cyclictest4225-21diskmemload11:06:253
10108992420,3cyclictest4225-21diskmemload10:44:422
1010899240,23cyclictest24014-21ssh11:53:212
1010899240,23cyclictest0-21swapper/211:48:132
1010899240,23cyclictest0-21swapper/211:48:132
1010899240,1cyclictest0-21swapper/209:28:352
1010899240,1cyclictest0-21swapper/209:28:352
10107992421,2cyclictest10766-21ssh12:38:121
1010799240,24cyclictest0-21swapper/110:20:081
1010799240,23cyclictest15534-21apt10:48:201
1010799240,1cyclictest0-21swapper/110:35:191
1010799240,0cyclictest0-21swapper/111:19:191
10105992422,1cyclictest62550irq/127-eno111:01:120
10105992422,1cyclictest29522-21apt-get09:33:200
10105992422,1cyclictest10441-21cron11:40:000
10105992422,1cyclictest0-21swapper/009:45:290
10105992422,1cyclictest0-21swapper/009:13:280
1010599240,23cyclictest4225-21diskmemload10:29:060
1010599240,23cyclictest28518-21ssh10:00:390
1010599240,23cyclictest0-21swapper/012:18:400
1010599240,23cyclictest0-21swapper/010:09:580
1010599240,1cyclictest4225-21diskmemload09:45:000
1010599240,1cyclictest12317-21grep12:38:300
1010599240,0cyclictest0-21swapper/011:22:050
1010599240,0cyclictest0-21swapper/010:51:360
10109992323,0cyclictest4225-21diskmemload10:40:013
10109992323,0cyclictest1765-21kworker/u8:209:40:023
10109992323,0cyclictest0-21swapper/310:10:313
10109992322,1cyclictest0-21swapper/308:50:013
10109992321,1cyclictest0-21swapper/312:22:183
10109992321,1cyclictest0-21swapper/312:01:533
10109992321,1cyclictest0-21swapper/311:57:073
10109992321,1cyclictest0-21swapper/311:52:513
10109992320,2cyclictest5613-21idleruntime-cro09:40:013
10109992320,2cyclictest19428-21ssh10:21:543
1010999230,23cyclictest0-21swapper/309:49:333
1010999230,22cyclictest14276-21ssh10:46:343
1010999230,0cyclictest0-21swapper/311:21:453
1010999230,0cyclictest0-21swapper/310:57:403
10108992323,0cyclictest0-21swapper/212:37:102
10108992323,0cyclictest0-21swapper/212:15:572
10108992323,0cyclictest0-21swapper/211:20:232
10108992323,0cyclictest0-21swapper/209:10:052
10108992321,1cyclictest510-21ssh09:35:212
10108992321,1cyclictest0-21swapper/212:29:232
10108992321,1cyclictest0-21swapper/210:26:532
10108992321,1cyclictest0-21swapper/210:01:222
10108992320,2cyclictest6719-21ssh10:38:502
1010899230,2cyclictest5990-21ssh11:36:172
1010899230,2cyclictest16471-21ssh09:20:222
1010899230,23cyclictest0-21swapper/210:46:342
1010899230,22cyclictest7945-21rm12:06:162
1010899230,22cyclictest4225-21diskmemload12:00:102
1010899230,22cyclictest4064-21ssh11:05:452
1010899230,22cyclictest27129-21ssh09:30:042
1010899230,22cyclictest2186-21sendmail08:00:012
1010899230,22cyclictest1563-21ssh10:05:372
1010899230,22cyclictest15451-21sh11:15:452
1010899230,22cyclictest13552-21sh09:48:072
1010899230,0cyclictest4225-21diskmemload11:12:302
1010899230,0cyclictest0-21swapper/212:14:352
1010899230,0cyclictest0-21swapper/211:00:072
1010899230,0cyclictest0-21swapper/210:22:322
10107992323,0cyclictest0-21swapper/111:29:581
10107992323,0cyclictest0-21swapper/110:51:121
10107992323,0cyclictest0-21swapper/110:29:451
10107992323,0cyclictest0-21swapper/109:41:441
10107992323,0cyclictest0-21swapper/109:03:231
10107992322,1cyclictest4225-21diskmemload11:32:071
10107992321,1cyclictest5860-21rm09:11:411
10107992321,1cyclictest0-21swapper/112:10:091
10107992321,1cyclictest0-21swapper/109:25:231
10107992321,1cyclictest0-21swapper/109:25:231
10107992321,1cyclictest0-21swapper/107:38:211
1010799230,2cyclictest21730-21sh11:50:091
1010799230,22cyclictest8069-21perl11:38:231
1010799230,22cyclictest606-21dbus-daemon09:40:011
1010799230,22cyclictest4225-21diskmemload09:15:061
1010799230,22cyclictest18909-21diskstats11:48:241
1010799230,22cyclictest18909-21diskstats11:48:241
1010799230,22cyclictest16991-21sh08:30:001
1010799230,22cyclictest0-21swapper/111:02:311
1010799230,0cyclictest0-21swapper/112:30:471
1010799230,0cyclictest0-21swapper/112:06:591
1010799230,0cyclictest0-21swapper/110:31:361
1010799230,0cyclictest0-21swapper/110:05:561
10105992323,0cyclictest0-21swapper/012:27:440
10105992323,0cyclictest0-21swapper/010:17:450
10105992321,1cyclictest0-21swapper/011:06:020
10105992321,1cyclictest0-21swapper/009:50:320
1010599231,21cyclictest0-21swapper/011:45:450
1010599231,21cyclictest0-21swapper/011:45:450
1010599230,2cyclictest10785-21sh11:12:290
1010599230,23cyclictest0-21swapper/012:22:270
1010599230,23cyclictest0-21swapper/009:29:410
1010599230,23cyclictest0-21swapper/009:29:410
1010599230,22cyclictest8852-21sh10:41:360
1010599230,22cyclictest7733-21ssh10:10:560
1010599230,22cyclictest62550irq/127-eno108:18:220
1010599230,22cyclictest20097-21ssh10:22:540
1010599230,22cyclictest13836-21diskmemload11:43:260
1010599230,22cyclictest0-21swapper/012:33:290
1010599230,1cyclictest0-21swapper/009:22:060
1010599230,0cyclictest0-21swapper/012:06:100
10109992222,0cyclictest0-21swapper/311:14:083
10109992221,1cyclictest4225-21diskmemload12:30:533
10109992221,1cyclictest0-21swapper/311:32:133
10109992221,1cyclictest0-21swapper/309:56:063
10109992220,1cyclictest23980-21ssh10:25:413
10109992220,1cyclictest0-21swapper/312:16:273
10109992220,1cyclictest0-21swapper/312:09:183
10109992220,1cyclictest0-21swapper/311:36:103
10109992219,2cyclictest5674-21ntp_kernel_pll_10:38:253
1010999220,2cyclictest32482-21dump-pmu-power09:35:013
1010999220,22cyclictest4225-21diskmemload12:26:373
1010999220,21cyclictest4225-21diskmemload12:12:213
1010999220,21cyclictest4225-21diskmemload10:05:013
1010999220,21cyclictest26896-21diskmemload11:26:233
1010999220,21cyclictest17746-21sh09:51:173
1010999220,21cyclictest12689-21ssh10:15:063
1010999220,21cyclictest10426-21sh09:15:103
1010999220,21cyclictest0-21swapper/311:15:273
1010999220,21cyclictest0-21swapper/310:31:523
1010999220,21cyclictest0-21swapper/309:21:363
1010999220,21cyclictest0-21swapper/309:08:213
1010999220,21cyclictest0-21swapper/309:00:003
1010999220,21cyclictest0-21swapper/308:53:203
1010999220,1cyclictest1-21systemd07:40:003
1010999220,1cyclictest11370-21ssh11:41:043
10108992220,1cyclictest17240-21apt-get07:25:002
10108992220,1cyclictest0-21swapper/211:40:482
10108992220,1cyclictest0-21swapper/210:56:392
10108992220,1cyclictest0-21swapper/209:15:142
10108992220,1cyclictest0-21swapper/208:45:012
1010899220,22cyclictest0-21swapper/210:30:152
1010899220,21cyclictest619-21polkitd08:10:002
1010899220,21cyclictest4225-21diskmemload11:33:372
1010899220,21cyclictest4225-21diskmemload09:55:252
1010899220,21cyclictest0-21swapper/208:33:202
1010899220,1cyclictest8421-21ssh10:11:572
1010899220,1cyclictest4225-21diskmemload10:16:182
1010899220,1cyclictest4225-21diskmemload09:50:502
1010899220,1cyclictest0-21swapper/209:40:172
1010899220,0cyclictest0-21swapper/212:31:042
10107992222,0cyclictest0-21swapper/112:25:101
10107992222,0cyclictest0-21swapper/112:04:191
10107992222,0cyclictest0-21swapper/111:10:061
10107992220,1cyclictest8625-21ssh10:41:191
10107992220,1cyclictest0-21swapper/111:06:131
10107992220,1cyclictest0-21swapper/110:14:581
1010799220,22cyclictest30692-1kworker/u9:110:55:531
1010799220,21cyclictest4225-21diskmemload11:40:551
1010799220,21cyclictest4225-21diskmemload10:16:191
1010799220,21cyclictest4225-21diskmemload10:00:171
1010799220,21cyclictest4225-21diskmemload09:30:081
1010799220,21cyclictest12205-21dump-pmu-power08:20:001
1010799220,21cyclictest0-21swapper/112:21:021
1010799220,21cyclictest0-21swapper/109:55:391
1010799220,21cyclictest0-21swapper/109:50:091
1010799220,21cyclictest0-21swapper/108:38:221
10105992222,0cyclictest0-21swapper/011:15:250
10105992221,1cyclictest0-21swapper/010:47:510
10105992220,1cyclictest29562-21ssh10:30:410
10105992220,1cyclictest26494-21sh11:25:410
1010599220,22cyclictest4225-21diskmemload11:33:120
1010599220,22cyclictest0-21swapper/012:02:180
1010599220,22cyclictest0-21swapper/011:52:590
1010599220,21cyclictest4225-21diskmemload12:10:310
1010599220,21cyclictest29516-21apt-get08:58:190
1010599220,21cyclictest17267-21munin-run07:25:000
1010599220,21cyclictest0-21swapper/010:35:300
1010599220,21cyclictest0-21swapper/009:55:020
1010599220,21cyclictest0-21swapper/009:05:000
1010999210,20cyclictest0-21swapper/307:23:213
1010999210,0cyclictest0-21swapper/310:03:223
1010999210,0cyclictest0-21swapper/307:58:203
10108992121,0cyclictest0-21swapper/210:50:232
10108992120,0cyclictest0-21swapper/207:28:192
10108992119,1cyclictest606-21dbus-daemon07:55:012
1010899210,21cyclictest0-21swapper/212:21:372
1010899210,20cyclictest1442-21apt-get09:05:012
1010899210,20cyclictest0-21swapper/207:48:212
1010799210,21cyclictest0-21swapper/107:48:221
1010799210,20cyclictest20560-21apt-get07:33:191
10105992121,0cyclictest25482-21apt-get07:43:210
10105992120,1cyclictest0-21swapper/010:55:140
1010599210,20cyclictest0-21swapper/008:53:200
1010599210,20cyclictest0-21swapper/008:48:220
10109992020,0cyclictest0-21swapper/308:23:213
1010999200,0cyclictest19916-21apt-get08:38:223
1010999200,0cyclictest0-21swapper/307:43:223
10108992020,0cyclictest0-21swapper/207:13:212
10108992019,0cyclictest0-21swapper/208:58:202
10107992020,0cyclictest0-21swapper/108:43:191
10107992020,0cyclictest0-21swapper/108:03:401
10107992020,0cyclictest0-21swapper/107:18:201
10107992018,1cyclictest1-21systemd08:15:001
1010799200,0cyclictest27123-21apt-get08:53:201
1010799200,0cyclictest0-21swapper/108:08:171
1010799200,0cyclictest0-21swapper/107:23:201
10105992020,0cyclictest0-21swapper/009:08:210
10105992020,0cyclictest0-21swapper/007:53:200
1010599200,0cyclictest0-21swapper/008:03:400
10109991919,0cyclictest0-21swapper/308:43:193
10109991919,0cyclictest0-21swapper/307:33:193
10109991919,0cyclictest0-21swapper/307:13:213
10108991919,0cyclictest0-21swapper/208:48:212
10107991919,0cyclictest0-21swapper/109:08:211
10107991919,0cyclictest0-21swapper/108:33:201
10109991818,0cyclictest0-21swapper/307:48:223
10109991816,1cyclictest9786-21ls08:15:003
10108991818,0cyclictest7909-21apt-get08:13:212
10108991818,0cyclictest0-21swapper/208:53:202
10108991818,0cyclictest0-21swapper/208:28:212
10108991816,1cyclictest606-21dbus-daemon07:40:002
10107991818,0cyclictest18164-21apt-get07:28:191
10105991818,0cyclictest0-21swapper/007:18:200
10105991817,1cyclictest0-21swapper/007:33:190
10105991817,1cyclictest0-21swapper/007:13:210
10105991816,1cyclictest17522-21apt-get08:33:200
10105991816,1cyclictest12730-21apt-get08:23:210
10109991717,0cyclictest0-21swapper/308:08:173
10109991717,0cyclictest0-21swapper/308:00:023
10108991716,1cyclictest12956-21apt-get07:18:202
10107991717,0cyclictest0-21swapper/108:23:211
10105991717,0cyclictest0-21swapper/008:38:220
10105991717,0cyclictest0-21swapper/007:28:190
10105991715,1cyclictest2205-21perf08:00:010
1010999160,15cyclictest1430-21cron09:05:003
10108991616,0cyclictest0-21swapper/209:03:232
10108991616,0cyclictest0-21swapper/207:33:192
10107991616,0cyclictest0-21swapper/108:58:201
10107991616,0cyclictest0-21swapper/107:43:221
10107991615,1cyclictest26613-21latency_hist08:50:011
1010799160,10cyclictest0-21swapper/107:13:211
10105991615,1cyclictest0-21swapper/008:13:210
1010599160,2cyclictest5469-21taskset08:08:110
1010599160,13cyclictest313-21systemd-journal07:38:550
10109991515,0cyclictest0-21swapper/307:28:193
10108991515,0cyclictest0-21swapper/208:38:222
10105991513,1cyclictest0-21swapper/007:48:270
1010999140,14cyclictest0-21swapper/308:15:073
1010999140,0cyclictest0-21swapper/308:30:073
1010999140,0cyclictest0-21swapper/307:50:123
1010999140,0cyclictest0-21swapper/307:15:233
10108991414,0cyclictest0-21swapper/208:02:332
1010899140,14cyclictest0-21swapper/208:15:092
1010899140,14cyclictest0-21swapper/207:40:072
1010899140,0cyclictest0-21swapper/208:21:232
1010799140,0cyclictest0-21swapper/107:55:011
10105991414,0cyclictest0-21swapper/008:40:370
1010599140,14cyclictest0-21swapper/008:26:240
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional