You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 16:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Tue Jun 16, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3101321336,90sleep231092-21timerwakeupswit06:54:432
3153121076,17sleep10-21swapper/106:58:291
2930121050,7sleep30-21swapper/308:29:233
31728991022,69cyclictest1794-21apt-get08:44:221
317309910135,39cyclictest0-21swapper/211:44:262
317309910135,39cyclictest0-21swapper/211:44:262
31728999446,27cyclictest4154-21ssh11:36:221
31730999130,25cyclictest23713-21sh09:27:102
31730999129,26cyclictest4536-21latency_hist10:43:592
31730999023,26cyclictest0-21swapper/211:03:012
31730998930,25cyclictest277-21dbus-daemon09:18:582
31730998926,28cyclictest15610-21taskset10:08:052
31730998926,28cyclictest15610-21taskset10:08:052
31728998914,41cyclictest8054-21apt-get10:49:131
31728998914,41cyclictest8054-21apt-get10:49:131
31723998969,14cyclictest32124-21sh11:29:180
31730998827,24cyclictest1145-21seq08:42:162
31730998826,28cyclictest0-21swapper/209:13:442
31730998823,28cyclictest0-21swapper/209:47:322
31728998846,19cyclictest181rcu_preempt12:09:151
3172399883,66cyclictest7489-21apt-get10:49:120
3172399883,66cyclictest7489-21apt-get10:49:120
31730998727,25cyclictest19231-21seq07:59:062
31730998630,20cyclictest6401-21diskmemload10:46:202
31730998627,26cyclictest31954-21seq08:36:412
31730998627,25cyclictest7470-21seq07:21:282
31730998626,32cyclictest2393-21ssh11:34:062
31730998625,24cyclictest15548-21seq07:46:432
31728998651,13cyclictest181rcu_preempt10:34:131
31728998651,13cyclictest181rcu_preempt10:34:131
31730998528,27cyclictest13845-21seq07:40:232
31730998527,22cyclictest25910-21ssh11:19:032
31730998527,20cyclictest7763-21seq11:43:142
31730998521,30cyclictest0-21swapper/209:02:092
31730998521,30cyclictest0-21swapper/209:02:092
31728998550,9cyclictest181rcu_preempt09:13:011
31730998428,22cyclictest277-21dbus-daemon11:28:582
31730998428,22cyclictest277-21dbus-daemon11:28:582
31730998427,31cyclictest15630-21seq11:55:142
31730998427,31cyclictest15630-21seq11:55:142
31728998461,15cyclictest2374-21systemd-journal10:57:161
31728998453,22cyclictest3701-21fschecks_time08:49:201
31730998328,24cyclictest26674-21seq10:25:292
31730998327,23cyclictest24638-21seq10:23:102
31730998327,23cyclictest24638-21seq10:23:102
31730998327,22cyclictest22260-21seq12:07:132
31730998326,25cyclictest18648-21taskset10:13:072
31730998326,24cyclictest8991-21seq07:25:212
31730998326,23cyclictest0-21swapper/210:49:322
31730998326,23cyclictest0-21swapper/210:49:322
31730998326,21cyclictest0-21swapper/212:24:192
31730998325,23cyclictest18190-21seq11:04:452
31730998324,24cyclictest0-21swapper/209:41:242
31730998323,23cyclictest0-21swapper/211:16:022
31730998319,26cyclictest0-21swapper/210:34:242
31730998319,26cyclictest0-21swapper/210:34:242
3172899834,34cyclictest25619-21latency_hist08:19:011
31723998365,13cyclictest14108-21sh10:59:130
31723998364,14cyclictest27169-21latency_hist08:24:000
31723998327,28cyclictest25772-21latency_hist11:19:000
31730998229,23cyclictest22343-21sh11:13:032
31730998228,22cyclictest4689-21seq08:52:572
31730998226,23cyclictest12468-21seq07:38:252
31730998225,22cyclictest1763-21ssh11:33:012
31730998223,20cyclictest25364-21seq08:18:102
3086028212,42sleep30-21swapper/306:54:403
3173799812,35cyclictest13365-21chrt10:04:133
3173799812,35cyclictest13365-21chrt10:04:133
31730998134,36cyclictest0-21swapper/209:59:132
31730998126,19cyclictest21119-21seq09:23:172
31730998125,22cyclictest6184-21seq09:51:502
31730998125,21cyclictest19749-21runrttasks12:03:312
31730998124,23cyclictest0-21swapper/208:30:282
31730998121,29cyclictest30836-21seq12:21:152
3172899816,29cyclictest352-21runrttasks08:34:121
31728998141,10cyclictest181rcu_preempt09:25:031
31728998138,12cyclictest181rcu_preempt12:04:251
31723998165,10cyclictest20900-21proc_pri12:04:300
44752800,5sleep3451rcuc/307:13:573
31730998028,21cyclictest21129-21seq10:16:422
31730998025,24cyclictest3111-21seq08:48:442
31730998021,23cyclictest29240-21grep10:29:352
31730998017,36cyclictest0-21swapper/207:09:002
31728998040,12cyclictest181rcu_preempt08:54:211
31723998053,15cyclictest19216-21sh11:07:350
3173799793,33cyclictest21631-21chrt10:18:073
31730997960,13cyclictest17460-21sshd09:54:162
31730997960,13cyclictest17460-21sshd09:54:162
31730997925,23cyclictest31878-21seq06:59:042
31730997924,18cyclictest6056-21seq07:18:572
31728997956,15cyclictest2374-21systemd-journal11:43:161
31728997955,10cyclictest181rcu_preempt11:26:281
31728997955,10cyclictest181rcu_preempt11:26:281
31723997963,10cyclictest10904-21kworker/u18:0+events_unbound08:58:570
31730997828,27cyclictest25576-21seq12:13:092
31730997825,20cyclictest27757-21taskset12:15:542
31730997821,24cyclictest0-21swapper/207:33:142
31730997820,24cyclictest25043-21fschecks_time09:29:212
31730997820,23cyclictest0-21swapper/207:57:162
31730997820,23cyclictest0-21swapper/207:57:162
31730997818,27cyclictest0-21swapper/207:09:322
31728997856,8cyclictest181rcu_preempt07:59:381
31728997851,10cyclictest181rcu_preempt11:05:291
3172899784,31cyclictest28974-21latency_hist12:19:001
3172899783,45cyclictest23878-21latency_hist08:14:001
31728997832,10cyclictest181rcu_preempt11:59:421
31723997862,10cyclictest18820-21ssh10:13:370
31723997857,16cyclictest9201-21ssh11:44:330
31723997857,16cyclictest9201-21ssh11:44:330
31730997738,26cyclictest9709-21apt-get09:04:092
31730997738,26cyclictest9709-21apt-get09:04:092
31730997733,31cyclictest0-21swapper/208:09:122
31730997714,30cyclictest0-21swapper/211:49:242
31728997752,10cyclictest181rcu_preempt09:20:571
31728997737,8cyclictest181rcu_preempt10:14:341
31728997736,10cyclictest181rcu_preempt10:59:331
31728997726,29cyclictest0-21swapper/109:44:201
31728997725,17cyclictest181rcu_preempt09:41:541
31728997713,32cyclictest0-21swapper/107:54:351
31728997713,32cyclictest0-21swapper/107:54:351
31723997759,13cyclictest13579-21switchtime09:09:350
3173799769,24cyclictest0-21swapper/307:59:143
31730997617,24cyclictest12349-21runrttasks10:55:082
31728997639,13cyclictest181rcu_preempt09:59:221
31728997620,24cyclictest0-21swapper/109:34:231
31723997658,13cyclictest32403-21fschecks_time12:24:200
31723997620,40cyclictest14275-21/usr/sbin/munin11:54:140
31723997620,40cyclictest14275-21/usr/sbin/munin11:54:140
31723997620,24cyclictest0-21swapper/010:04:240
31723997620,24cyclictest0-21swapper/010:04:240
31723997613,36cyclictest30317-21sh09:38:480
3173799753,30cyclictest17009-21chrt10:09:323
3173799753,29cyclictest9765-21chrt07:29:203
31728997562,9cyclictest31711-21cyclictest11:47:471
31728997562,9cyclictest31711-21cyclictest11:47:471
31728997554,13cyclictest22967-21/usr/sbin/munin11:14:291
31728997550,11cyclictest181rcu_preempt11:31:271
31728997547,13cyclictest181rcu_preempt08:44:011
31728997544,11cyclictest181rcu_preempt10:30:011
3172899754,28cyclictest25909-21fschecks_count08:19:191
31728997538,8cyclictest181rcu_preempt11:20:011
31728997516,24cyclictest0-21swapper/107:44:231
31723997554,15cyclictest29423-21kworker/u18:1+events_unbound10:28:570
31723997551,16cyclictest31118-21kworker/u19:2+events_unbound07:28:570
31730997452,15cyclictest31711-21cyclictest08:19:312
31730997424,19cyclictest6221-21seq08:56:582
31730997421,21cyclictest0-21swapper/207:52:182
31730997421,21cyclictest0-21swapper/207:52:182
31730997419,24cyclictest0-21swapper/208:24:332
31730997416,24cyclictest27825-21cstates09:34:142
31728997450,8cyclictest181rcu_preempt10:42:261
31728997446,12cyclictest181rcu_preempt11:10:471
31728997443,13cyclictest1933-21ssh12:27:571
31728997438,14cyclictest181rcu_preempt10:25:291
3172899743,35cyclictest16960-21ssh11:58:571
3172899743,35cyclictest16960-21ssh11:58:571
31728997428,14cyclictest181rcu_preempt10:14:001
31728997427,10cyclictest181rcu_preempt07:39:341
3172899742,45cyclictest31-21ksoftirqd/107:04:081
31728997421,24cyclictest31711-21cyclictest07:19:331
31728997410,27cyclictest15807-21kworker/1:1-mm_percpu_wq10:48:241
31723997451,16cyclictest27502-21latency_hist09:34:000
31723997414,33cyclictest15-21ksoftirqd/009:16:230
31728997353,14cyclictest297-21systemd-logind07:33:591
31728997334,12cyclictest181rcu_preempt09:29:081
31728997333,11cyclictest0-21swapper/107:49:131
31728997333,11cyclictest0-21swapper/107:49:131
31728997330,15cyclictest181rcu_preempt09:49:141
31723997356,13cyclictest13914-21kworker/u19:0+events_unbound10:48:570
31723997354,13cyclictest26514-21fschecks_time12:14:210
31730997213,27cyclictest0-21swapper/208:04:302
31728997247,11cyclictest181rcu_preempt07:24:181
31728997233,12cyclictest181rcu_preempt09:54:361
31728997233,12cyclictest181rcu_preempt09:54:361
31728997233,12cyclictest181rcu_preempt07:39:001
31723997258,8cyclictest0-21swapper/008:34:010
31723997257,9cyclictest7410-21diskmemload09:54:160
31723997257,9cyclictest7410-21diskmemload09:54:160
31723997255,11cyclictest0-21swapper/009:39:230
3172399725,44cyclictest29358-21ssh12:19:180
31723997246,10cyclictest20374-21runrttasks10:14:350
31723997214,13cyclictest2709-21sh09:45:360
31728997147,18cyclictest9489-21latency_hist09:04:011
31728997147,18cyclictest9489-21latency_hist09:04:011
31728997129,19cyclictest181rcu_preempt07:09:201
31723997155,11cyclictest0-21swapper/011:13:570
3172399713,37cyclictest24382-21grep08:14:200
3172399712,33cyclictest10234-21taskset09:04:250
3172399712,33cyclictest10234-21taskset09:04:250
31723997118,36cyclictest0-21swapper/008:46:540
31723997113,7cyclictest0-21swapper/011:19:390
31728997036,11cyclictest0-21swapper/110:04:171
31728997036,11cyclictest0-21swapper/110:04:171
3172899703,27cyclictest11878-21awk11:49:241
31728997031,8cyclictest181rcu_preempt10:23:591
31728997031,8cyclictest181rcu_preempt10:23:591
31728997027,11cyclictest181rcu_preempt07:04:011
31723997056,9cyclictest30766-21ssh11:26:420
31723997056,9cyclictest30766-21ssh11:26:420
31723997056,8cyclictest0-21swapper/007:04:360
31723997054,11cyclictest352-21runrttasks09:25:160
3172399704,43cyclictest14276-21latency_hist07:44:010
3172399704,36cyclictest14398-21apt-get07:44:130
31723997028,12cyclictest571-21sendmail_mailqu08:39:310
3172399702,38cyclictest30785-1kworker/0:2H+mmc_complete07:19:010
3172899696,34cyclictest0-21swapper/112:19:281
31728996951,11cyclictest0-21swapper/107:19:011
31728996937,13cyclictest181rcu_preempt09:04:321
31728996937,13cyclictest181rcu_preempt09:04:321
31723996954,10cyclictest352-21runrttasks08:34:490
31723996952,12cyclictest352-21runrttasks10:33:560
31723996951,12cyclictest352-21runrttasks10:39:240
3172399694,25cyclictest5058-21modprobe11:38:570
3173799687,38cyclictest0-21swapper/308:44:243
31728996852,10cyclictest16672-21timerwakeupswit09:14:331
31728996833,12cyclictest181rcu_preempt08:29:301
31728996817,9cyclictest21487-21mailstats08:04:311
3172399685,28cyclictest4786-21latency_hist08:54:010
31723996846,11cyclictest0-21swapper/012:09:180
3172399683,52cyclictest18990-21fschecks_time09:19:190
3172399683,38cyclictest4549-21fschecks_time09:49:190
31723996812,32cyclictest15-21ksoftirqd/007:34:050
31723996727,15cyclictest979-21systemctl07:04:010
31723996724,28cyclictest32079-21switchtime10:34:320
31723996724,28cyclictest32079-21switchtime10:34:320
3172399672,33cyclictest6537-21grep07:19:190
3172399672,23cyclictest6985-21ssh11:41:000
302242679,34sleep030225-21munin-node06:54:080
3172399664,48cyclictest22234-21/usr/sbin/munin10:19:240
3172399664,48cyclictest22234-21/usr/sbin/munin10:19:240
3172399663,34cyclictest17544-21grep11:59:200
3172399663,26cyclictest22914-21latency08:09:230
31723996613,27cyclictest277-21dbus-daemon10:58:580
3173799656,44cyclictest0-21swapper/310:49:203
3173799656,44cyclictest0-21swapper/310:49:203
31728996531,13cyclictest181rcu_preempt08:25:031
31723996552,9cyclictest31711-21cyclictest08:59:160
31723996552,9cyclictest31711-21cyclictest08:59:160
31723996545,14cyclictest16131-21cstates07:49:150
31723996545,14cyclictest16131-21cstates07:49:150
3172399654,34cyclictest28048-21switchtime08:24:330
3172399654,25cyclictest10992-21sendmail_mailst09:59:320
3172399652,41cyclictest352-21runrttasks11:51:000
3172399646,22cyclictest20141-21grep07:59:340
31723996425,30cyclictest4464-21latency_hist07:13:570
3172399633,20cyclictest17651-21taskset07:54:110
3172399633,20cyclictest17651-21taskset07:54:110
3172399624,30cyclictest9993-21latency07:29:250
3172399623,27cyclictest20840-21/usr/sbin/munin08:04:310
3173799613,41cyclictest22214-21taskset08:08:573
3173799583,37cyclictest20104-21taskset12:04:003
3173799574,36cyclictest2644-21chrt11:34:183
3173799573,34cyclictest31615-21chrt09:39:333
3173799563,41cyclictest28190-21taskset10:29:013
3173799563,41cyclictest14926-21chrt11:54:283
3173799563,41cyclictest14926-21chrt11:54:283
3173799563,40cyclictest12654-21chrt07:39:003
3173799563,39cyclictest5746-21taskset10:44:333
3173799563,39cyclictest5703-21chrt11:39:203
3173799563,39cyclictest1602-21chrt08:44:013
3173799563,37cyclictest11536-21taskset11:49:173
3173799563,32cyclictest32686-21chrt12:24:263
3173799554,36cyclictest23179-21chrt11:14:163
3173799553,37cyclictest30033-21chrt12:19:323
3173799544,33cyclictest16838-21chrt07:49:333
3173799544,33cyclictest16838-21chrt07:49:333
3173799543,36cyclictest10837-21chrt09:59:273
3173799542,38cyclictest20561-21chrt09:21:423
3173799542,38cyclictest1024-21taskset10:37:403
3173799542,38cyclictest1024-21taskset10:37:403
3173799542,37cyclictest14600-21chrt10:59:253
3173799542,36cyclictest9543-21taskset11:44:513
3173799542,36cyclictest9543-21taskset11:44:513
3173799542,36cyclictest32587-21chrt06:59:323
3173799542,36cyclictest23252-21taskset09:25:513
3173799542,35cyclictest24389-21chrt08:14:203
31737995411,14cyclictest0-21swapper/308:34:113
3173799533,38cyclictest518-21taskset11:29:363
3173799533,38cyclictest21293-21taskset11:10:023
3173799533,34cyclictest7047-21chrt08:59:203
3173799533,34cyclictest7047-21chrt08:59:203
3173799533,34cyclictest13478-21chrt09:09:343
3173799533,33cyclictest6786-21chrt07:19:243
3173799532,37cyclictest22217-21taskset10:19:043
3173799532,37cyclictest22217-21taskset10:19:043
3173799532,36cyclictest18403-21taskset11:05:203
3173799532,34cyclictest8268-21taskset07:24:223
3173799532,34cyclictest1437-21chrt07:04:093
3173799523,39cyclictest28735-21chrt12:18:433
3173799523,37cyclictest27252-21chrt09:33:373
3173799523,33cyclictest8364-21taskset09:54:363
3173799523,33cyclictest8364-21taskset09:54:363
3173799523,32cyclictest14519-21chrt07:44:153
3173799523,32cyclictest11175-21taskset10:54:143
3173799513,37cyclictest29563-21chrt09:36:413
3173799513,35cyclictest22494-21taskset12:07:533
3173799513,33cyclictest2637-21chrt10:39:343
3173799513,32cyclictest5551-21chrt08:54:263
3173799512,33cyclictest27140-21chrt08:24:003
3173799512,32cyclictest9925-21chrt09:04:193
3173799512,32cyclictest9925-21chrt09:04:193
3173799503,32cyclictest28818-21taskset11:24:003
3173799503,31cyclictest15906-21chrt09:14:163
3173799503,30cyclictest22558-21taskset08:09:143
3173799503,30cyclictest1385-21chrt09:44:153
3173799493,34cyclictest23849-21chrt12:09:273
3173799483,35cyclictest29274-21chrt11:24:213
3173799483,35cyclictest29274-21chrt11:24:213
3173799483,32cyclictest4145-21taskset08:49:323
3173799482,34cyclictest5597-21chrt07:14:343
3173799482,32cyclictest28233-21chrt10:29:053
3173799463,32cyclictest6274-21chrt09:52:053
3173799454,29cyclictest14163-21chrt07:43:593
3173799443,31cyclictest18987-21taskset07:58:573
3173799443,31cyclictest18987-21taskset07:58:573
3173799393,25cyclictest27296-21taskset08:24:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional