You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 18:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sat Sep 05, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3051421377,17sleep00-21swapper/007:06:200
3051421377,17sleep00-21swapper/007:06:200
31026991113,87cyclictest27690-21apt-get10:35:100
310719910255,40cyclictest23883-21cpuspeed11:20:072
31026999872,18cyclictest32733-21latency_hist07:14:530
31071999780,11cyclictest200-21systemd-journal11:54:542
3107199972,28cyclictest343-21runrttasks12:17:232
31071999656,33cyclictest200-21systemd-journal07:23:532
31052999348,39cyclictest15145-21fschecks_count10:15:131
31052999348,39cyclictest15145-21fschecks_count10:15:131
31071999249,36cyclictest3159-21fschecks_time09:00:142
31052999272,14cyclictest16775-21sh12:00:111
31071999173,12cyclictest6446-21fschecks_count09:10:132
31071999173,12cyclictest6446-21fschecks_count09:10:132
3107199914,44cyclictest19706-21sh12:05:062
31071999074,9cyclictest0-21swapper/209:16:152
31071999074,9cyclictest0-21swapper/209:16:152
31052999061,20cyclictest16525-21threads09:25:271
31052999052,30cyclictest0-21swapper/111:10:251
3105299903,79cyclictest0-21swapper/108:05:041
31071998946,36cyclictest0-21swapper/209:25:282
31052998947,36cyclictest5866-21diskmemload12:05:171
3107199883,50cyclictest17340-21apt-get08:05:042
31052998848,32cyclictest0-21swapper/111:20:241
31052998847,34cyclictest0-21swapper/110:45:131
31052998844,34cyclictest22512-21if_eth008:20:151
3107199878,35cyclictest14479-21wc11:05:082
3107199878,35cyclictest14479-21wc11:05:082
31071998744,36cyclictest0-21swapper/212:04:502
2981628712,49sleep129878-21latency07:05:241
2981628712,49sleep129878-21latency07:05:241
3107199863,37cyclictest31096-21rm10:40:052
3107199863,37cyclictest31096-21rm10:40:052
3107199863,28cyclictest343-21runrttasks10:55:512
31052998647,33cyclictest358-21ntpd11:05:201
31052998647,33cyclictest358-21ntpd11:05:201
3105299863,75cyclictest0-21swapper/108:35:031
3105299863,75cyclictest0-21swapper/108:35:031
3102699867,44cyclictest22828-21wc12:10:090
31071998567,12cyclictest18726-21sh10:20:232
3107199852,41cyclictest5855-21latency_hist09:09:542
31052998541,38cyclictest9875-21latency_hist11:49:521
31052998540,37cyclictest29361-21switchtime08:40:251
31052998510,41cyclictest0-21swapper/107:54:061
31052998510,41cyclictest0-21swapper/107:54:061
31026998525,49cyclictest4968-21cpu10:50:080
3102699852,42cyclictest15-21ksoftirqd/012:09:370
31071998445,33cyclictest5866-21diskmemload11:14:412
3107199844,32cyclictest4900-21/usr/sbin/munin10:50:032
31071998442,37cyclictest0-21swapper/208:44:542
3107199843,41cyclictest15700-21/usr/sbin/munin08:01:102
3107199843,36cyclictest27257-21apt-key10:34:522
3107199843,36cyclictest2309-21modprobe07:19:512
3107199843,34cyclictest28363-21run-parts08:39:502
3107199843,34cyclictest28363-21run-parts08:39:502
3107199842,36cyclictest1012-21awk08:54:502
3107199842,36cyclictest1012-21awk08:54:502
3107199842,35cyclictest200-21systemd-journal09:54:502
3107199842,35cyclictest200-21systemd-journal09:54:502
3107199842,33cyclictest13662-21ssh11:03:572
31052998465,13cyclictest12178-21latency_hist07:49:531
31052998465,13cyclictest12178-21latency_hist07:49:531
31052998447,30cyclictest0-21swapper/111:40:081
3105299843,75cyclictest0-21swapper/110:50:031
3105299843,69cyclictest0-21swapper/110:30:051
31026998462,14cyclictest13421-21latency_hist11:54:550
3102699843,27cyclictest15-21ksoftirqd/007:35:180
31071998367,10cyclictest27244-21runrttasks11:25:132
3107199834,37cyclictest23360-21ntp_kernel_pll_12:10:212
3107199833,8cyclictest0-21swapper/208:55:032
3107199833,35cyclictest6555-21grep10:00:282
3107199833,35cyclictest30758-21ssh10:39:532
3107199832,9cyclictest0-21swapper/212:20:082
3107199832,37cyclictest22473-21/usr/sbin/munin09:35:172
31052998343,33cyclictest5866-21diskmemload09:40:081
31052998341,36cyclictest5365-21latency_hist09:59:531
3105299833,46cyclictest343-21runrttasks07:56:541
3105299832,45cyclictest0-21swapper/108:25:271
31026998362,15cyclictest662-21cron09:49:510
31026998362,15cyclictest662-21cron09:49:510
31071998267,10cyclictest31016-21cyclictest10:04:542
31071998267,10cyclictest31016-21cyclictest10:04:542
31071998248,28cyclictest0-21swapper/209:55:102
3107199823,36cyclictest15241-21gpgv07:59:512
3107199823,35cyclictest7136-21latency_hist07:34:532
3107199823,34cyclictest22409-21grep08:20:132
3107199823,33cyclictest21157-21/usr/sbin/munin10:25:112
3107199822,36cyclictest31048-21grep08:46:112
3107199822,36cyclictest31048-21grep08:46:112
3107199822,36cyclictest1747-21/usr/sbin/munin10:45:192
3107199822,35cyclictest7042-21ssh11:45:022
31052998262,10cyclictest0-21swapper/112:35:081
31052998260,15cyclictest32032-21latency_hist12:24:541
3105299823,66cyclictest0-21swapper/111:00:041
31026998260,14cyclictest5866-21diskmemload11:33:540
3102699822,45cyclictest15-21ksoftirqd/007:29:450
3107199814,39cyclictest3399-21cpu12:31:052
3107199813,36cyclictest12480-21/usr/sbin/munin09:20:112
3107199813,35cyclictest21618-21awk09:34:512
3107199813,35cyclictest21618-21awk09:34:512
3107199813,34cyclictest6847-21cut11:44:522
3107199813,34cyclictest16164-21ssh10:15:532
3107199813,34cyclictest16164-21ssh10:15:532
3107199813,33cyclictest343-21runrttasks11:32:172
3107199813,33cyclictest21444-21grep08:15:242
3107199813,33cyclictest11369-21grep07:45:272
3107199813,33cyclictest11369-21grep07:45:272
3107199813,27cyclictest343-21runrttasks11:19:162
3107199812,36cyclictest31152-21cut07:09:562
3107199812,36cyclictest31152-21cut07:09:562
3107199812,34cyclictest6366-21fschecks_count12:35:132
3107199812,34cyclictest25385-21/usr/sbin/munin08:30:102
3107199812,33cyclictest2827-21date12:29:542
3107199812,33cyclictest2827-21date12:29:542
31052998157,17cyclictest30633-21apt-key10:39:531
31052998138,37cyclictest12984-21latency09:20:161
3105299812,74cyclictest0-21swapper/112:10:081
3102699818,64cyclictest31100-21ssh10:40:060
3102699818,64cyclictest31100-21ssh10:40:060
31026998161,13cyclictest5866-21diskmemload12:30:510
31026998158,15cyclictest1201-21latency_hist08:54:540
31026998158,15cyclictest1201-21latency_hist08:54:540
3102699813,48cyclictest15-21ksoftirqd/009:55:300
3102699813,41cyclictest15323-21kernelversion10:15:170
3102699813,41cyclictest15323-21kernelversion10:15:170
3107199803,35cyclictest25686-21/usr/sbin/munin09:40:192
3107199803,33cyclictest13159-21grep07:50:252
3107199803,33cyclictest13159-21grep07:50:252
3107199803,32cyclictest1076-21tune2fs11:35:142
3107199803,32cyclictest1076-21tune2fs11:35:142
3107199802,32cyclictest14294-21tr11:56:202
31052998059,15cyclictest32310-21fschecks_count08:50:131
31052998059,15cyclictest32310-21fschecks_count08:50:131
31026998058,13cyclictest25304-21ssh11:21:320
31026998040,20cyclictest0-21swapper/008:00:340
3102699803,42cyclictest15-21ksoftirqd/008:34:340
3102699803,38cyclictest16863-21fschecks_time12:00:130
3107199794,35cyclictest14566-21latency_hist10:14:532
3107199793,35cyclictest343-21runrttasks08:10:292
3107199793,35cyclictest10364-21modprobe07:44:502
3107199793,34cyclictest8892-21cat07:39:542
3107199793,31cyclictest5524-21modprobe07:29:512
3107199793,20cyclictest31074-21idleruntime-cro09:49:512
3107199793,20cyclictest31074-21idleruntime-cro09:49:512
3107199792,37cyclictest31634-21cut07:11:152
3107199792,35cyclictest24177-21/usr/sbin/munin08:25:172
31052997938,34cyclictest22402-21latency09:35:161
31052997937,34cyclictest0-21swapper/108:04:541
3105299793,63cyclictest0-21swapper/111:30:051
31026997957,14cyclictest200-21systemd-journal09:13:530
31026997957,14cyclictest200-21systemd-journal09:13:530
31026997954,19cyclictest19347-21latency08:10:160
3102699794,45cyclictest15-21ksoftirqd/008:44:100
3105299784,63cyclictest0-21swapper/109:00:041
31052997837,34cyclictest0-21swapper/110:20:281
3105299783,63cyclictest0-21swapper/108:15:031
3105299783,62cyclictest4193-21apt-get07:25:041
31026997842,13cyclictest181rcu_preempt07:58:090
3102699783,39cyclictest15-21ksoftirqd/008:24:590
3102699783,37cyclictest15-21ksoftirqd/007:47:590
3102699783,37cyclictest15-21ksoftirqd/007:47:590
3102699783,31cyclictest2076-21apt-config09:54:540
3102699783,31cyclictest2076-21apt-config09:54:540
3102699782,50cyclictest15-21ksoftirqd/008:24:100
31026997820,15cyclictest0-21swapper/009:43:090
31052997761,10cyclictest662-21cron10:25:501
31052997738,32cyclictest19130-21sh09:30:151
31052997738,32cyclictest19130-21sh09:30:151
31052997736,34cyclictest0-21swapper/110:00:271
31052997736,33cyclictest0-21swapper/109:05:221
3105299773,55cyclictest13702-21ssh11:55:391
31052997734,36cyclictest0-21swapper/110:04:541
31052997734,36cyclictest0-21swapper/110:04:541
31052997733,37cyclictest0-21swapper/111:25:021
3105299772,66cyclictest0-21swapper/109:45:021
3105299772,66cyclictest0-21swapper/109:45:021
3105299772,48cyclictest3902-21seq07:24:481
3102699773,44cyclictest15-21ksoftirqd/007:54:100
3102699773,44cyclictest15-21ksoftirqd/007:54:100
3105299763,58cyclictest0-21swapper/107:30:051
31052997634,35cyclictest0-21swapper/108:31:531
31026997655,13cyclictest17693-21kworker/u17:2+rpciod10:30:190
31026997653,16cyclictest28367-21basename08:39:500
31026997653,16cyclictest28367-21basename08:39:500
3102699763,39cyclictest15-21ksoftirqd/008:18:350
31052997561,10cyclictest31016-21cyclictest12:30:261
3105299753,66cyclictest0-21swapper/107:40:081
31052997535,32cyclictest0-21swapper/107:15:031
31052997527,40cyclictest1744-21latency_hist09:54:541
3105299752,67cyclictest0-21swapper/108:55:031
3105299752,57cyclictest31349-21apt-get07:10:091
3102699759,32cyclictest15-21ksoftirqd/011:29:530
31026997558,11cyclictest524-21in:imuxsock11:04:510
31026997554,12cyclictest18397-21ssh10:20:140
31052997459,9cyclictest21579-21timerwakeupswit11:15:271
31052997456,12cyclictest32499-21unixbench_multi10:41:301
31052997456,12cyclictest32499-21unixbench_multi10:41:301
3105299743,63cyclictest11772-21apt-get10:10:091
3105299743,59cyclictest0-21swapper/108:10:051
31052997430,37cyclictest0-21swapper/109:16:151
31052997430,37cyclictest0-21swapper/109:16:151
31026997452,12cyclictest0-21swapper/011:10:140
31026997448,18cyclictest1325-21ssh12:26:540
31026997448,18cyclictest1325-21ssh12:26:540
31052997356,11cyclictest200-21systemd-journal12:27:531
31052997356,11cyclictest200-21systemd-journal12:27:531
31052997343,21cyclictest28656-21sh12:19:511
31052997328,37cyclictest0-21swapper/109:10:131
31052997328,37cyclictest0-21swapper/109:10:131
31026997347,20cyclictest12452-21ssh10:10:260
31026997346,19cyclictest7366-21sh12:35:530
3102699734,45cyclictest7010-21/usr/sbin/munin11:45:010
3102699733,51cyclictest15-21ksoftirqd/009:27:180
3102699733,38cyclictest15-21ksoftirqd/009:15:070
3102699733,38cyclictest15-21ksoftirqd/009:15:070
3108599726,49cyclictest0-21swapper/310:35:133
3108599724,37cyclictest3397-21taskset12:31:043
3105299722,65cyclictest0-21swapper/109:50:111
3105299722,58cyclictest0-21swapper/110:55:041
31026997251,13cyclictest21803-21rm10:25:190
3102699724,50cyclictest15-21ksoftirqd/009:09:480
3102699723,40cyclictest15-21ksoftirqd/009:24:350
3102699723,33cyclictest15-21ksoftirqd/009:02:320
3108599713,38cyclictest16753-21taskset11:08:503
3108599713,38cyclictest16753-21taskset11:08:503
3108599713,35cyclictest31834-21chrt12:24:523
3105299713,57cyclictest30483-21apt-get08:45:371
3105299713,57cyclictest30483-21apt-get08:45:371
31026997155,10cyclictest1331-21cpuspeed08:55:070
3102699713,37cyclictest18754-21cat08:09:530
3108599704,35cyclictest18798-21taskset12:03:243
31085997010,49cyclictest2358-21chrt09:55:093
3105299703,56cyclictest7402-21apt-get07:35:021
31052997029,34cyclictest0-21swapper/111:54:391
3102699703,38cyclictest11425-21latency_hist10:09:530
31026997032,29cyclictest0-21swapper/011:54:570
31026997030,13cyclictest0-21swapper/010:45:230
31026997024,24cyclictest15-21ksoftirqd/007:17:190
3029227023,31sleep30-21swapper/307:05:383
3029227023,31sleep30-21swapper/307:05:383
3108599695,34cyclictest26514-21taskset09:41:153
31052996930,32cyclictest0-21swapper/111:35:271
31052996930,32cyclictest0-21swapper/111:35:271
31026996943,19cyclictest25042-21kworker/u17:1+nfsiod11:35:170
31026996943,19cyclictest25042-21kworker/u17:1+nfsiod11:35:170
3102699693,25cyclictest15-21ksoftirqd/012:21:040
31026996920,37cyclictest21043-21kernelversion11:15:160
3108599683,29cyclictest30332-21taskset08:44:543
3102699683,50cyclictest3872-21/usr/sbin/munin11:40:090
3102699683,33cyclictest9001-21timerwakeupswit10:55:270
3102699682,50cyclictest15-21ksoftirqd/007:21:320
3102699682,41cyclictest15-21ksoftirqd/008:47:420
3102699682,41cyclictest15-21ksoftirqd/008:47:420
31026996823,12cyclictest0-21swapper/011:05:270
31026996823,12cyclictest0-21swapper/011:05:270
3108599674,29cyclictest25305-21chrt10:30:303
3108599674,27cyclictest32053-21chrt11:32:493
3108599673,24cyclictest32751-21chrt12:25:213
3108599673,24cyclictest32751-21chrt12:25:213
3108599673,23cyclictest24958-21chrt09:39:533
3108599672,29cyclictest8260-21chrt09:12:553
3108599672,29cyclictest8260-21chrt09:12:553
3108599672,29cyclictest1133-21chrt08:54:543
3108599672,29cyclictest1133-21chrt08:54:543
3102699674,42cyclictest26325-21latency12:15:170
31026996742,18cyclictest22879-21timerwakeupswit09:35:260
3102699673,45cyclictest9028-21acpi07:40:030
3108599663,25cyclictest12403-21chrt10:10:243
3108599662,32cyclictest25560-21taskset08:30:123
3108599662,27cyclictest18698-21taskset11:10:453
3102699662,33cyclictest15-21ksoftirqd/007:32:210
3108599654,23cyclictest28673-21chrt11:27:093
3108599653,28cyclictest13923-21taskset09:21:143
3108599653,27cyclictest8841-21taskset12:39:473
3108599653,26cyclictest7818-21chrt11:45:253
3108599653,26cyclictest32270-21chrt10:41:283
3108599653,26cyclictest32270-21chrt10:41:283
3108599653,25cyclictest568-21taskset09:51:493
3108599653,25cyclictest568-21taskset09:51:493
3108599653,25cyclictest23006-21chrt11:18:473
3108599653,24cyclictest22292-21chrt10:25:273
3108599653,23cyclictest26619-21chrt11:24:503
3108599652,26cyclictest9089-21chrt07:40:093
31026996551,9cyclictest10663-21ssh10:07:530
3102699653,26cyclictest19387-21ntp_kernel_pll_09:30:210
3102699653,26cyclictest19387-21ntp_kernel_pll_09:30:210
3108599644,21cyclictest6466-21chrt11:44:153
3108599643,27cyclictest15792-21taskset10:15:273
3108599643,27cyclictest15792-21taskset10:15:273
3108599643,26cyclictest28364-21taskset09:45:083
3108599643,26cyclictest28364-21taskset09:45:083
3108599643,26cyclictest22991-21taskset12:10:133
3108599643,24cyclictest5679-21chrt10:00:113
3108599643,24cyclictest18548-21chrt10:20:173
3108599643,23cyclictest840-21chrt07:15:033
3108599643,23cyclictest30638-21chrt08:45:433
3108599643,23cyclictest30638-21chrt08:45:433
3108599642,27cyclictest11106-21chrt09:17:093
3108599642,27cyclictest11106-21chrt09:17:093
3108599642,26cyclictest3359-21taskset10:46:423
3108599642,26cyclictest14098-21taskset11:56:143
3102699645,38cyclictest15-21ksoftirqd/010:04:420
3108599634,28cyclictest17807-21taskset08:05:193
3108599633,23cyclictest10240-21chrt10:58:173
3108599633,22cyclictest9840-21chrt10:05:463
3108599633,22cyclictest9840-21chrt10:05:463
3108599632,26cyclictest21432-21taskset12:07:093
3108599632,26cyclictest19002-21chrt09:30:133
3108599632,26cyclictest19002-21chrt09:30:133
3108599632,23cyclictest8018-21chrt07:35:233
3108599632,23cyclictest19213-21chrt08:10:123
3108599632,20cyclictest1272-21chrt08:55:023
3108599623,25cyclictest7508-21chrt10:54:203
3108599622,28cyclictest12362-21taskset11:00:363
3108599622,25cyclictest3406-21taskset09:00:203
3108599622,24cyclictest26892-21chrt12:15:283
3108599613,24cyclictest18273-21chrt09:29:243
3108599613,24cyclictest11825-21chrt07:48:023
3108599613,24cyclictest11825-21chrt07:48:023
3108599612,25cyclictest1789-21chrt11:35:283
3108599612,25cyclictest1789-21chrt11:35:283
3108599612,23cyclictest28069-21chrt08:36:243
3108599612,23cyclictest28069-21chrt08:36:243
3108599612,22cyclictest31592-21chrt07:11:103
31085996110,41cyclictest0-21swapper/311:50:113
3108599602,23cyclictest3819-21chrt07:23:413
3108599602,23cyclictest21679-21chrt08:17:133
31085996010,40cyclictest0-21swapper/307:59:503
3108599594,22cyclictest17023-21chrt08:04:263
3108599593,23cyclictest23273-21chrt08:21:423
3108599593,22cyclictest24992-21chrt08:28:103
3108599592,24cyclictest5776-21chrt07:30:013
3108599592,24cyclictest13333-21chrt07:51:473
3108599592,24cyclictest13333-21chrt07:51:473
3108599592,22cyclictest5289-21chrt07:26:533
31085995910,40cyclictest0-21swapper/309:05:263
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional