You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-04 - 15:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Thu Jun 04, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2860991193,67cyclictest26886-21chrt11:15:073
2849991114,81cyclictest15031-21apt-get11:50:012
2830991103,84cyclictest32059-21apt-get10:30:050
2830991103,84cyclictest32059-21apt-get10:30:050
28419910831,45cyclictest0-21swapper/109:49:381
28419910831,45cyclictest0-21swapper/109:49:381
2660210611,64sleep12701-21munin-run06:59:461
2860991003,41cyclictest0-21swapper/310:10:063
2860991003,41cyclictest0-21swapper/310:10:063
28419910047,47cyclictest0-21swapper/107:55:081
28419910047,47cyclictest0-21swapper/107:55:081
2830999974,17cyclictest6917-21latency_hist12:29:490
2830999974,17cyclictest6917-21latency_hist12:29:490
218829312,59sleep02282-21unixbench_multi06:55:330
2849999175,10cyclictest2820-21cyclictest11:14:452
2841999148,36cyclictest24552-21/usr/sbin/munin12:05:151
283099905,34cyclictest26019-21entropy10:20:060
2830998861,18cyclictest30810-21fschecks_count12:15:050
2830998814,49cyclictest1-21systemd07:04:500
2849998719,34cyclictest352-21runrttasks10:16:202
2841998746,34cyclictest9709-21diskmemload10:45:041
2830998752,12cyclictest181rcu_preempt10:52:160
283099873,63cyclictest15612-21kworker/u18:0+ext4-rsv-conversion11:50:050
284999863,66cyclictest32059-21apt-get10:30:012
284999863,66cyclictest32059-21apt-get10:30:012
284199864,70cyclictest1106-21ssh12:19:551
2841998646,35cyclictest352-21runrttasks07:45:221
284199863,70cyclictest0-21swapper/107:49:591
284199863,70cyclictest0-21swapper/107:49:591
284199862,49cyclictest0-21swapper/112:14:481
284199862,49cyclictest0-21swapper/112:14:481
284999859,35cyclictest30856-21wc09:34:492
2841998564,15cyclictest23052-21sh10:15:081
284199853,73cyclictest0-21swapper/107:30:031
284199853,71cyclictest0-21swapper/107:09:581
284199844,68cyclictest0-21swapper/108:45:001
284199843,69cyclictest0-21swapper/108:54:581
2830998461,16cyclictest2820-21cyclictest07:05:050
2830998458,17cyclictest8364-21latency_hist10:44:480
2830998458,17cyclictest8364-21latency_hist10:44:480
283099844,52cyclictest26851-21ssh11:15:010
2849998314,26cyclictest9709-21diskmemload11:31:372
2849998314,26cyclictest9709-21diskmemload11:31:372
2841998349,28cyclictest6084-21latency10:40:121
2841998349,28cyclictest6084-21latency10:40:121
284199834,73cyclictest0-21swapper/111:54:571
284199834,69cyclictest0-21swapper/108:49:561
284199832,71cyclictest5453-21cat07:05:141
284199832,6cyclictest0-21swapper/109:35:011
2841998320,42cyclictest0-21swapper/112:00:041
2830998362,15cyclictest25766-21sendmail08:09:460
2830998350,10cyclictest181rcu_preempt09:09:580
2830998337,11cyclictest0-21swapper/009:50:020
284199826,64cyclictest301ktimers/111:29:571
284199826,64cyclictest301ktimers/111:29:571
2841998261,15cyclictest2887-21fschecks_time10:35:081
2841998260,15cyclictest2820-21cyclictest09:01:561
2841998260,15cyclictest2820-21cyclictest09:01:561
2841998256,20cyclictest11566-21timerwakeupswit09:55:221
2841998256,20cyclictest11566-21timerwakeupswit09:55:221
2830998258,16cyclictest2820-21cyclictest11:11:500
2830998251,10cyclictest181rcu_preempt12:09:560
2830998251,10cyclictest181rcu_preempt12:09:560
2830998239,10cyclictest181rcu_preempt11:00:200
189228222,30sleep20-21swapper/206:55:272
284199814,66cyclictest0-21swapper/109:59:581
284199814,59cyclictest14736-21apt-get07:34:581
284199813,68cyclictest0-21swapper/110:19:581
284199813,59cyclictest352-21runrttasks10:10:041
284199813,59cyclictest352-21runrttasks10:10:041
284199812,73cyclictest0-21swapper/109:50:001
2830998158,15cyclictest26845-21sh12:08:380
2830998153,11cyclictest181rcu_preempt07:50:030
2830998153,11cyclictest181rcu_preempt07:50:030
2849998024,28cyclictest17679-21latency_hist07:44:492
2841998038,35cyclictest0-21swapper/111:49:561
284199803,65cyclictest0-21swapper/107:39:581
2830998052,21cyclictest19274-21latency_hist10:09:510
2830998047,12cyclictest181rcu_preempt08:30:080
283099802,42cyclictest4378-21latency_hist09:44:490
284999796,29cyclictest0-21swapper/208:55:182
2849997953,18cyclictest1841-21ssh11:26:282
2849997917,25cyclictest1026-21seq09:39:082
2849997913,28cyclictest352-21runrttasks10:01:572
2841997956,15cyclictest27190-21cpu11:15:571
2841997939,32cyclictest0-21swapper/110:30:151
2841997939,32cyclictest0-21swapper/110:30:151
284199793,70cyclictest0-21swapper/108:30:141
284199793,65cyclictest0-21swapper/108:04:581
284199793,64cyclictest0-21swapper/109:04:561
284199792,32cyclictest10070-21fschecks_count07:20:081
2830997952,9cyclictest181rcu_preempt10:14:560
2830997951,12cyclictest181rcu_preempt12:20:000
2830997947,9cyclictest181rcu_preempt07:35:130
284999786,35cyclictest0-21swapper/209:40:082
2849997857,15cyclictest18821-21fschecks_count11:55:072
2849997810,26cyclictest0-21swapper/210:43:482
2849997810,26cyclictest0-21swapper/210:43:482
2841997859,13cyclictest277-21dbus-daemon10:09:471
284199783,62cyclictest0-21swapper/107:14:581
284199782,71cyclictest0-21swapper/112:14:571
2830997865,9cyclictest26290-21kworker/u17:2+rpciod09:29:490
283099785,60cyclictest1245-21cron09:39:450
2830997851,11cyclictest181rcu_preempt07:54:570
2830997851,11cyclictest181rcu_preempt07:54:570
283099784,39cyclictest21855-21ssh11:05:510
283099784,39cyclictest21855-21ssh11:05:510
283099783,39cyclictest14614-21cron09:06:450
284199776,66cyclictest0-21swapper/109:40:011
2841997737,33cyclictest0-21swapper/109:10:061
284199773,70cyclictest0-21swapper/109:29:591
2830997755,13cyclictest14558-21ssh10:54:500
2830997744,11cyclictest181rcu_preempt11:30:500
2830997744,11cyclictest181rcu_preempt11:30:500
2830997739,12cyclictest181rcu_preempt07:20:200
2830997735,25cyclictest181rcu_preempt10:35:170
283099773,36cyclictest7504-21latency_hist09:49:510
283099773,36cyclictest7504-21latency_hist09:49:510
2849997657,14cyclictest15206-21netstat07:35:132
2849997657,10cyclictest0-21swapper/210:35:142
2849997653,16cyclictest0-21swapper/211:04:492
2849997617,25cyclictest6295-21seq12:28:352
2849997617,25cyclictest6295-21seq12:28:352
2841997638,28cyclictest24906-21kworker/u18:2+nfsiod10:27:231
284199763,60cyclictest0-21swapper/108:19:581
284199763,58cyclictest4854-21basename08:44:461
2841997633,31cyclictest13030-21processes11:45:181
283099764,37cyclictest16632-21idleruntime07:40:080
2830997643,11cyclictest181rcu_preempt12:03:000
2830997640,11cyclictest28358-21kworker/u19:3-events_unbound07:49:470
2830997633,28cyclictest181rcu_preempt11:39:080
2830997633,13cyclictest181rcu_preempt11:45:070
2830997629,23cyclictest181rcu_preempt09:31:090
2830997613,55cyclictest13544-21latency07:30:130
2849997557,12cyclictest277-21dbus-daemon10:59:462
2849997553,12cyclictest0-21swapper/210:09:472
2849997541,9cyclictest181rcu_preempt11:20:042
2849997541,24cyclictest20143-21kworker/u19:0+nfsiod09:29:502
284199755,64cyclictest0-21swapper/109:19:571
284199754,65cyclictest0-21swapper/111:40:001
284199754,62cyclictest23638-21ssh11:10:011
2841997531,37cyclictest0-21swapper/110:54:461
284199752,67cyclictest0-21swapper/112:25:001
284199752,67cyclictest0-21swapper/112:25:001
2830997547,16cyclictest181rcu_preempt09:01:060
2830997547,16cyclictest181rcu_preempt09:01:060
2830997537,14cyclictest181rcu_preempt07:25:130
2849997420,25cyclictest0-21swapper/209:00:082
2849997420,25cyclictest0-21swapper/209:00:082
2849997418,21cyclictest352-21runrttasks08:49:562
2849997415,23cyclictest0-21swapper/207:05:482
2849997413,24cyclictest0-21swapper/208:46:072
2849997412,27cyclictest8023-21munin-run07:14:462
2849997410,31cyclictest28220-21runrttasks12:10:152
2849997410,31cyclictest28220-21runrttasks12:10:152
284199743,59cyclictest0-21swapper/108:14:591
2841997430,37cyclictest0-21swapper/111:00:171
284199742,58cyclictest19047-21apt-get09:14:571
2830997453,13cyclictest9709-21diskmemload09:20:590
2830997450,19cyclictest2820-21cyclictest08:45:070
2830997449,10cyclictest181rcu_preempt09:55:180
2830997449,10cyclictest181rcu_preempt09:55:180
2830997442,12cyclictest181rcu_preempt10:10:580
2830997442,12cyclictest181rcu_preempt10:10:580
2830997442,12cyclictest181rcu_preempt08:04:460
283099742,26cyclictest8358-21apt-get08:55:010
2849997358,11cyclictest2820-21cyclictest11:05:212
2849997358,11cyclictest2820-21cyclictest11:05:212
2849997356,12cyclictest21949-21latency_hist09:19:502
2849997355,13cyclictest2820-21cyclictest09:10:162
2849997355,12cyclictest300-21rs:main2
2849997355,11cyclictest23185-21latency08:00:112
284999733,59cyclictest26817-21apt-get11:15:072
284999733,43cyclictest29192-21latency_hist08:19:502
2849997326,37cyclictest28733-21latency_hist10:24:492
284199734,57cyclictest942-21grep11:25:131
284199733,59cyclictest0-21swapper/111:04:551
284199733,59cyclictest0-21swapper/111:04:551
2830997350,15cyclictest2374-21systemd-journal10:27:070
2830997349,8cyclictest181rcu_preempt11:26:430
2830997348,10cyclictest181rcu_preempt07:14:460
283099734,36cyclictest9328-21/usr/sbin/munin11:40:130
2830997334,16cyclictest181rcu_preempt11:55:080
283099733,36cyclictest21211-21ssh09:18:220
2830997330,18cyclictest181rcu_preempt07:15:180
2830997326,13cyclictest181rcu_preempt08:10:020
2849997255,12cyclictest2820-21cyclictest08:30:332
2849997222,23cyclictest9709-21diskmemload11:46:342
2849997211,27cyclictest30596-21sh08:24:462
284199723,64cyclictest0-21swapper/108:25:011
2830997241,9cyclictest181rcu_preempt08:25:020
2830997234,17cyclictest181rcu_preempt08:40:060
2830997231,13cyclictest181rcu_preempt08:39:490
284999719,24cyclictest935-21latency_hist12:19:482
2849997156,10cyclictest13623-21ntp_offset09:05:142
2849997151,14cyclictest352-21runrttasks07:04:462
2849997150,13cyclictest0-21swapper/208:05:062
2849997147,18cyclictest32348-21apt-key08:29:492
2849997139,24cyclictest8462-21fschecks_count07:15:082
2849997123,30cyclictest1885-21apt-get08:35:002
2849997116,20cyclictest2334-21seq12:20:452
284199714,61cyclictest0-21swapper/107:24:571
2841997131,33cyclictest0-21swapper/110:56:011
283099717,30cyclictest8863-21fschecks_time10:45:070
2830997151,11cyclictest14814-21ssh10:00:430
283099714,38cyclictest32494-21latency_hist11:24:490
284999708,53cyclictest19837-21apt-get10:10:262
284999708,53cyclictest19837-21apt-get10:10:262
2849997049,15cyclictest10655-21timerandwakeup07:20:212
2849997046,16cyclictest22632-21unixbench_multi12:00:242
2841997050,14cyclictest9709-21diskmemload11:20:071
284199704,61cyclictest0-21swapper/111:34:581
284199703,57cyclictest0-21swapper/108:34:561
284199703,55cyclictest23123-21/usr/sbin/munin08:00:091
284199702,58cyclictest0-21swapper/107:00:021
283099709,24cyclictest7642-21unixbench_multi08:50:200
2830997014,20cyclictest15-21ksoftirqd/008:15:110
284999697,28cyclictest0-21swapper/210:25:222
284999694,43cyclictest352-21runrttasks09:55:202
284999694,43cyclictest352-21runrttasks09:55:202
284999693,35cyclictest21281-21cstates07:55:032
284999693,35cyclictest21281-21cstates07:55:032
2849996910,22cyclictest0-21swapper/208:13:012
284199693,57cyclictest0-21swapper/109:26:101
2849996846,15cyclictest12129-21latency_hist11:44:482
284999684,43cyclictest21056-21latency_hist07:54:482
284999684,43cyclictest21056-21latency_hist07:54:482
2849996818,21cyclictest21758-21kworker/u17:4+xprtiod09:20:072
284199683,54cyclictest26806-21/usr/sbin/munin08:10:211
284999679,22cyclictest0-21swapper/207:26:452
2849996748,11cyclictest0-21swapper/207:30:082
284999673,50cyclictest9546-21timerwakeupswit10:45:212
284999673,48cyclictest9709-21diskmemload11:35:082
2849996727,28cyclictest4584-21ssh09:44:592
2849996727,28cyclictest4584-21ssh09:44:592
284999672,44cyclictest4931-21latency_hist08:44:482
286099664,40cyclictest0-21swapper/310:30:063
286099664,40cyclictest0-21swapper/310:30:063
284999663,44cyclictest24829-21fschecks_count12:05:072
2849996632,24cyclictest17945-21apt-get07:45:012
2830996629,14cyclictest181rcu_preempt08:20:240
286099652,38cyclictest917-21kworker/3:1+events10:05:013
284999657,23cyclictest12608-21ssh10:50:202
286099643,36cyclictest917-21kworker/3:1+events09:00:173
286099643,36cyclictest917-21kworker/3:1+events09:00:173
286099605,37cyclictest0-21swapper/311:50:013
286099604,41cyclictest13363-21chrt11:45:223
286099603,42cyclictest6396-21taskset11:35:013
286099593,34cyclictest917-21kworker/3:1+events09:07:063
286099593,33cyclictest917-21kworker/3:1+events12:20:163
286099584,37cyclictest26948-21chrt08:10:223
286099583,38cyclictest24764-21chrt09:24:483
286099582,37cyclictest9300-21chrt11:39:513
286099573,39cyclictest14666-21taskset10:00:233
17862579,22sleep30-21swapper/306:55:203
286099567,34cyclictest0-21swapper/308:30:093
286099564,37cyclictest3188-21chrt07:00:083
286099563,38cyclictest9035-21chrt09:51:193
286099563,36cyclictest5849-21chrt09:45:523
286099563,36cyclictest5849-21chrt09:45:523
286099563,34cyclictest10085-21chrt07:20:083
286099562,38cyclictest29320-21taskset09:30:523
286099554,32cyclictest25968-21taskset08:09:493
286099553,38cyclictest31889-21taskset12:15:543
286099553,37cyclictest2388-21chrt08:35:133
286099553,36cyclictest6750-21chrt08:49:593
286099552,39cyclictest4796-21chrt11:31:163
286099552,39cyclictest4796-21chrt11:31:163
286099543,38cyclictest17263-21chrt07:40:213
286099543,34cyclictest23968-21chrt11:10:093
286099542,35cyclictest2903-21taskset10:35:083
286099533,39cyclictest23007-21taskset11:09:033
286099533,39cyclictest23007-21taskset11:09:033
286099533,37cyclictest3613-21chrt08:40:033
286099533,35cyclictest2762-21chrt09:40:373
286099533,35cyclictest21064-21chrt11:59:123
286099533,33cyclictest7500-21chrt07:10:203
286099533,32cyclictest13256-21chrt07:30:043
286099533,31cyclictest11750-21chrt07:25:063
286099533,27cyclictest19779-21chrt07:50:093
286099533,27cyclictest19779-21chrt07:50:093
286099532,37cyclictest23365-21taskset08:00:183
286099524,33cyclictest31035-21chrt10:28:313
286099523,36cyclictest12706-21taskset09:58:123
286099523,36cyclictest12706-21taskset09:58:123
286099522,36cyclictest16134-21taskset07:39:483
286099513,36cyclictest21374-21chrt07:55:073
286099513,36cyclictest21374-21chrt07:55:073
286099513,35cyclictest26987-21chrt09:27:483
286099513,33cyclictest32548-21chrt08:29:503
286099513,33cyclictest29197-21chrt08:19:503
286099513,32cyclictest31230-21chrt09:35:063
286099513,31cyclictest14482-21chrt10:54:493
286099512,36cyclictest4911-21chrt12:25:223
286099512,36cyclictest4911-21chrt12:25:223
286099512,34cyclictest27129-21taskset10:20:573
286099512,33cyclictest1631-21chrt11:25:533
286099503,36cyclictest6638-21taskset10:40:233
286099503,36cyclictest6638-21taskset10:40:233
286099503,35cyclictest26640-21chrt12:08:043
286099503,33cyclictest4715-21chrt07:04:533
286099503,31cyclictest5118-21chrt08:45:013
286099503,29cyclictest18486-21chrt11:00:203
286099502,36cyclictest8966-21taskset10:45:093
286099502,35cyclictest17176-21chrt09:10:253
286099502,30cyclictest18300-21chrt07:45:113
286099494,35cyclictest23488-21chrt10:15:183
286099492,32cyclictest28641-21chrt12:10:233
286099492,32cyclictest28641-21chrt12:10:233
286099484,34cyclictest19275-21chrt09:15:073
286099484,28cyclictest22711-21chrt12:00:263
286099474,30cyclictest32194-21chrt11:23:583
286099473,32cyclictest9308-21chrt08:55:223
286099473,31cyclictest9172-21taskset07:15:223
286099453,31cyclictest917-21kworker/3:1+events08:20:073
286099442,31cyclictest15181-21chrt10:55:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional