You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-11 - 22:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot5s.osadl.org (updated Fri Sep 11, 2026 12:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
20855992713,0cyclictest151rcu_preempt11:56:192
2085599250,24cyclictest0-21swapper/212:14:102
2085599250,24cyclictest0-21swapper/209:41:102
2085599250,24cyclictest0-21swapper/209:27:022
2085099250,24cyclictest14987-21diskmemload11:39:391
2085099250,24cyclictest14987-21diskmemload10:47:441
20860992423,0cyclictest0-21swapper/312:15:253
2086099240,23cyclictest14987-21diskmemload10:10:403
2086099240,23cyclictest14987-21diskmemload09:52:023
2086099240,23cyclictest14987-21diskmemload09:15:353
2085599243,1cyclictest151rcu_preempt12:30:002
20855992422,1cyclictest0-21swapper/209:50:572
20855992422,1cyclictest0-21swapper/209:45:572
20855992420,3cyclictest313-21systemd-journal11:15:012
2085599240,23cyclictest3191-21diskmemload11:24:172
2085599240,23cyclictest14987-21diskmemload10:33:012
2085599240,23cyclictest0-21swapper/211:32:292
2085599240,23cyclictest0-21swapper/210:42:582
2085599240,22cyclictest151rcu_preempt10:18:052
2085599240,20cyclictest151rcu_preempt12:30:402
20850992422,1cyclictest6428-21sh12:25:011
2085099240,23cyclictest75-21kswapd012:30:021
2085099240,23cyclictest503-21latency_hist08:40:001
2085099240,23cyclictest0-21swapper/109:53:351
20847992423,1cyclictest0-21swapper/011:54:070
2084799240,23cyclictest0-21swapper/008:02:020
2084799240,22cyclictest31673-21rm12:17:530
20860992323,0cyclictest0-21swapper/312:37:213
20860992323,0cyclictest0-21swapper/309:55:583
20860992321,1cyclictest0-21swapper/311:22:133
20860992321,1cyclictest0-21swapper/311:07:113
20860992321,1cyclictest0-21swapper/309:36:243
20860992320,2cyclictest5155-21ssh09:29:503
2086099230,23cyclictest0-21swapper/311:15:073
2086099230,23cyclictest0-21swapper/310:34:333
2086099230,23cyclictest0-21swapper/310:07:013
2086099230,23cyclictest0-21swapper/309:10:223
2086099230,22cyclictest6714-21ssh12:25:233
2086099230,22cyclictest5434-21rm10:27:123
2086099230,22cyclictest27546-21ssh09:49:163
2086099230,22cyclictest0-21swapper/311:50:003
2086099230,22cyclictest0-21swapper/311:28:333
2086099230,0cyclictest14987-21diskmemload10:49:353
2086099230,0cyclictest14987-21diskmemload10:36:323
2086099230,0cyclictest0-21swapper/311:53:393
2086099230,0cyclictest0-21swapper/311:43:573
2086099230,0cyclictest0-21swapper/311:14:303
2086099230,0cyclictest0-21swapper/311:00:573
2086099230,0cyclictest0-21swapper/310:50:253
2086099230,0cyclictest0-21swapper/310:19:283
2086099230,0cyclictest0-21swapper/310:03:553
2086099230,0cyclictest0-21swapper/307:30:023
20855992323,0cyclictest14987-21diskmemload11:01:422
20855992323,0cyclictest0-21swapper/212:15:022
20855992323,0cyclictest0-21swapper/211:43:572
20855992323,0cyclictest0-21swapper/210:24:162
20855992323,0cyclictest0-21swapper/209:15:402
20855992322,1cyclictest14987-21diskmemload12:06:032
20855992322,0cyclictest0-21swapper/211:28:132
20855992322,0cyclictest0-21swapper/210:14:382
20855992321,1cyclictest0-21swapper/211:15:162
2085599231,21cyclictest15345-21kworker/2:211:37:082
2085599230,22cyclictest28087-21ssh10:47:522
2085599230,22cyclictest10696-21apt-get12:00:022
2085599230,22cyclictest0-21swapper/211:06:432
2085599230,22cyclictest0-21swapper/210:57:472
2085599230,22cyclictest0-21swapper/209:37:332
2085599230,22cyclictest0-21swapper/207:40:002
2085599230,20cyclictest28-21ksoftirqd/210:07:212
2085599230,1cyclictest22910-21ssh12:40:002
2085599230,1cyclictest14987-21diskmemload12:22:442
2085599230,1cyclictest0-21swapper/209:11:172
2085599230,0cyclictest14987-21diskmemload10:38:382
2085599230,0cyclictest0-21swapper/211:47:162
20850992323,0cyclictest14987-21diskmemload10:25:591
20850992323,0cyclictest14987-21diskmemload09:20:021
20850992323,0cyclictest0-21swapper/111:58:191
20850992323,0cyclictest0-21swapper/109:12:371
20850992322,1cyclictest11245-21ssh10:32:281
20850992322,1cyclictest0-21swapper/112:11:231
20850992321,1cyclictest2404-21apt-get12:22:011
20850992321,1cyclictest17890-21ssh12:06:311
20850992321,1cyclictest0-21swapper/111:31:131
20850992321,1cyclictest0-21swapper/111:10:381
2085099230,23cyclictest0-21swapper/111:43:471
2085099230,23cyclictest0-21swapper/110:37:551
2085099230,22cyclictest9303-21sh11:01:271
2085099230,22cyclictest32651-21sh09:25:271
2085099230,22cyclictest26654-21sh09:47:581
2085099230,22cyclictest0-21swapper/111:50:281
2085099230,22cyclictest0-21swapper/110:50:051
2085099230,0cyclictest14987-21diskmemload11:25:261
2085099230,0cyclictest14987-21diskmemload11:22:141
2085099230,0cyclictest0-21swapper/109:56:421
20847992323,0cyclictest14987-21diskmemload12:02:460
20847992323,0cyclictest0-21swapper/011:04:010
2084799232,21cyclictest62550irq/127-eno109:31:310
20847992322,1cyclictest14987-21diskmemload11:00:000
20847992322,1cyclictest12191-21sh12:30:120
20847992320,2cyclictest21622-21ssh12:09:240
20847992320,2cyclictest0-21swapper/010:23:330
2084799231,0cyclictest62550irq/127-eno110:10:000
2084799230,23cyclictest14987-21diskmemload10:52:490
2084799230,23cyclictest14987-21diskmemload10:40:300
2084799230,23cyclictest0-21swapper/011:16:330
2084799230,23cyclictest0-21swapper/009:25:330
2084799230,22cyclictest27560-21ssh10:47:120
2084799230,22cyclictest20083-21ssh11:11:000
2084799230,22cyclictest17846-21sh12:35:210
2084799230,22cyclictest0-21swapper/011:40:210
2084799230,0cyclictest14987-21diskmemload11:56:500
2084799230,0cyclictest0-21swapper/011:38:040
2084799230,0cyclictest0-21swapper/010:15:400
2084799230,0cyclictest0-21swapper/010:00:220
20860992222,0cyclictest0-21swapper/312:21:443
20860992222,0cyclictest0-21swapper/312:12:143
20860992222,0cyclictest0-21swapper/312:01:193
20860992222,0cyclictest0-21swapper/311:30:083
20860992221,0cyclictest0-21swapper/310:20:183
20860992221,0cyclictest0-21swapper/309:07:023
20860992220,1cyclictest12947-21apt-get08:00:003
2086099220,22cyclictest14987-21diskmemload09:24:263
2086099220,22cyclictest0-21swapper/309:33:523
2086099220,21cyclictest520-21perf08:40:003
2086099220,21cyclictest19465-21ssh10:41:013
2086099220,0cyclictest14987-21diskmemload11:58:483
20855992222,0cyclictest0-21swapper/211:53:332
20855992221,0cyclictest28-21ksoftirqd/209:30:522
20855992220,1cyclictest10205-21latency_hist09:00:012
2085599220,21cyclictest4114-21ntp_states09:57:122
2085599220,21cyclictest20968-21apt-get08:17:012
2085599220,21cyclictest0-21swapper/210:50:592
2085599220,21cyclictest0-21swapper/210:02:052
2085599220,1cyclictest0-21swapper/210:26:022
2085599220,1cyclictest0-21swapper/209:21:552
20850992221,1cyclictest0-21swapper/111:46:331
20850992221,1cyclictest0-21swapper/111:05:521
20850992220,2cyclictest29544-21runrttasks11:18:411
20850992220,2cyclictest11772-21sh12:00:461
20850992220,1cyclictest8567-21apt-get07:52:001
20850992220,1cyclictest6244-21ssh09:30:341
20850992220,1cyclictest23610-21apt-get07:17:011
2085099220,21cyclictest30021-21ssh10:21:191
2085099220,21cyclictest22992-21ssh10:14:361
2085099220,21cyclictest14987-21diskmemload12:15:311
2085099220,21cyclictest12947-21apt-get08:00:021
2085099220,21cyclictest0-21swapper/110:55:151
2085099220,21cyclictest0-21swapper/110:42:041
2085099220,21cyclictest0-21swapper/107:47:011
2085099220,1cyclictest17602-21rm09:41:011
2085099220,1cyclictest12554-21sh10:05:011
2085099220,1cyclictest0-21swapper/112:36:071
2085099220,1cyclictest0-21swapper/110:01:241
2085099220,1cyclictest0-21swapper/108:07:001
2085099220,0cyclictest0-21swapper/109:37:011
20847992222,0cyclictest14987-21diskmemload12:20:170
20847992222,0cyclictest0-21swapper/012:13:570
20847992222,0cyclictest0-21swapper/011:30:520
20847992221,1cyclictest2596-21ssh09:56:370
20847992221,1cyclictest14005-21sh11:05:120
20847992220,2cyclictest0-21swapper/010:35:040
2084799220,22cyclictest25250-21ssh09:17:590
2084799220,22cyclictest14987-21diskmemload11:26:380
2084799220,22cyclictest0-21swapper/011:47:490
2084799220,22cyclictest0-21swapper/010:25:580
2084799220,21cyclictest15327-21sh09:10:080
2084799220,1cyclictest62550irq/127-eno109:20:050
2084799220,1cyclictest31641-21ssh11:21:080
2084799220,1cyclictest23872-21ssh09:46:280
2084799220,1cyclictest21117-21sh09:43:360
2084799220,1cyclictest11479-21ssh09:35:150
2084799220,1cyclictest0-21swapper/009:05:010
2084799220,0cyclictest0-21swapper/010:10:120
2084799220,0cyclictest0-21swapper/009:51:470
20860992121,0cyclictest0-21swapper/312:06:383
20860992121,0cyclictest0-21swapper/310:55:053
20860992120,1cyclictest14987-21diskmemload11:36:023
20860992120,1cyclictest1192-21apt-get07:37:013
20860992120,1cyclictest0-21swapper/308:12:013
2086099210,20cyclictest25778-21apt-get08:27:013
2086099210,0cyclictest0-21swapper/309:41:043
2086099210,0cyclictest0-21swapper/308:00:023
20855992121,0cyclictest0-21swapper/208:22:012
2085599210,21cyclictest0-21swapper/208:02:022
2085599210,1cyclictest7763-21perf08:55:012
2085599210,0cyclictest0-21swapper/208:42:012
20850992121,0cyclictest0-21swapper/107:32:011
20850992120,0cyclictest21218-21apt-get07:12:021
2085099210,20cyclictest0-21swapper/108:42:011
2085099210,0cyclictest0-21swapper/110:15:251
2085099210,0cyclictest0-21swapper/107:22:001
2084799210,20cyclictest0-21swapper/007:17:010
2084799210,0cyclictest0-21swapper/010:30:030
20860992020,0cyclictest0-21swapper/307:17:013
20860992019,1cyclictest5766-21apt-get08:52:013
20860992019,0cyclictest0-21swapper/307:42:023
2086099200,19cyclictest26028-21apt-get07:22:003
20855992020,0cyclictest0-21swapper/208:47:032
20855992020,0cyclictest0-21swapper/208:27:012
20855992020,0cyclictest0-21swapper/208:12:022
2085599200,0cyclictest0-21swapper/207:12:022
20850992018,1cyclictest18566-21apt-get08:12:011
20847992020,0cyclictest0-21swapper/008:17:010
20847992020,0cyclictest0-21swapper/007:12:020
20847992019,1cyclictest0-21swapper/007:37:010
20847992018,1cyclictest10202-21latency_hist09:00:010
2084799200,0cyclictest0-21swapper/008:07:000
20860991919,0cyclictest8216-21apt-get08:57:003
20860991919,0cyclictest0-21swapper/309:02:003
20860991919,0cyclictest0-21swapper/307:12:023
20855991919,0cyclictest13025-21apt-get09:07:022
20855991919,0cyclictest0-21swapper/207:17:012
20855991912,3cyclictest28-21ksoftirqd/207:57:002
20850991919,0cyclictest0-21swapper/107:57:001
20847991918,0cyclictest3729-21apt-get07:42:020
20860991816,1cyclictest0-21swapper/308:45:003
20855991818,0cyclictest0-21swapper/208:37:012
20855991816,1cyclictest8099-21ls07:50:002
20855991816,1cyclictest0-21swapper/207:25:012
20850991818,0cyclictest0-21swapper/109:07:021
20850991818,0cyclictest0-21swapper/108:27:021
20850991815,2cyclictest5357-21awk08:50:001
20847991818,0cyclictest0-21swapper/007:57:000
20847991818,0cyclictest0-21swapper/007:27:000
2084799180,1cyclictest31186-21/usr/sbin/munin07:32:070
20860991716,1cyclictest22050irq/143-nvme0q408:25:003
20855991717,0cyclictest0-21swapper/207:52:002
20855991716,1cyclictest0-21swapper/207:42:022
20850991717,0cyclictest0-21swapper/108:17:011
2085099170,16cyclictest29224-21ntp_states08:32:061
20847991717,0cyclictest0-21swapper/008:47:030
20847991717,0cyclictest0-21swapper/007:47:010
20860991616,0cyclictest0-21swapper/308:17:013
20855991616,0cyclictest0-21swapper/207:30:022
20850991616,0cyclictest0-21swapper/108:22:001
2084799162,0cyclictest29600-21kworker/0:008:40:320
20847991616,0cyclictest0-21swapper/008:22:010
20847991615,1cyclictest0-21swapper/008:55:010
20860991515,0cyclictest28177-21apt-get08:32:013
20850991515,0cyclictest0-21swapper/108:57:001
20850991515,0cyclictest0-21swapper/108:52:001
20850991515,0cyclictest0-21swapper/107:37:011
20847991515,0cyclictest0-21swapper/008:37:010
20847991514,1cyclictest0-21swapper/008:34:560
2086099140,14cyclictest0-21swapper/308:45:353
2086099140,14cyclictest0-21swapper/307:45:073
2086099140,0cyclictest0-21swapper/308:05:293
2086099140,0cyclictest0-21swapper/307:50:093
2086099140,0cyclictest0-21swapper/307:25:103
2085599140,14cyclictest0-21swapper/208:31:112
2085599140,14cyclictest0-21swapper/208:05:042
2085599140,0cyclictest0-21swapper/209:00:142
2085599140,0cyclictest0-21swapper/207:25:342
2085099140,14cyclictest0-21swapper/107:25:101
2085099140,0cyclictest0-21swapper/109:00:011
20847991414,0cyclictest0-21swapper/009:05:240
2084799140,14cyclictest0-21swapper/008:26:360
2084799140,14cyclictest0-21swapper/008:10:130
2084799140,14cyclictest0-21swapper/007:50:310
2084799140,0cyclictest0-21swapper/007:20:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional