You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-01 - 19:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 01, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
67319912361,13cyclictest29626-21sh09:23:270
5800210410,66sleep25822-21pluginstate06:53:382
6747991033,30cyclictest390-21seq11:17:512
67479910060,35cyclictest20495-21kworker/u18:2+events_unbound07:47:562
6747999976,15cyclictest15356-21systemd-run11:42:562
6747999976,15cyclictest15356-21systemd-run11:42:562
674799983,49cyclictest5576-21ssh09:38:082
6737999857,34cyclictest0-21swapper/109:48:291
6737999849,42cyclictest0-21swapper/111:38:291
6737999849,42cyclictest0-21swapper/111:38:291
674799963,32cyclictest6285-21seq12:21:502
6747999613,42cyclictest105752basename07:08:072
6737999654,35cyclictest19081-21kworker/u17:1-rpciod09:08:311
673799963,36cyclictest16935-21latency_hist07:27:591
673799963,36cyclictest16935-21latency_hist07:27:591
6747999556,30cyclictest11026-21kworker/u18:2-nfsiod11:47:092
6737999353,32cyclictest0-21swapper/110:40:131
6731999373,15cyclictest21496-21latency_hist11:52:590
6731999373,15cyclictest21496-21latency_hist11:52:590
6747999269,16cyclictest20009-21apt-key07:37:572
6747999269,16cyclictest20009-21apt-key07:37:572
6737999255,30cyclictest0-21swapper/109:23:291
6747999165,16cyclictest0-21swapper/208:23:242
6747999152,32cyclictest0-21swapper/212:13:202
6747999146,39cyclictest0-21swapper/212:08:182
6755999055,24cyclictest14742-21chrt07:18:323
6747999052,33cyclictest6723-21cyclictest11:52:352
6747999052,33cyclictest6723-21cyclictest11:52:352
6747999049,31cyclictest0-21swapper/211:58:282
6747999049,31cyclictest0-21swapper/211:58:282
6747999047,36cyclictest352-21runrttasks07:22:572
6737999069,15cyclictest18635-21threads09:58:311
6737999049,36cyclictest6723-21cyclictest09:02:581
6737999047,37cyclictest21282-21/usr/sbin/munin10:58:321
6747998951,31cyclictest0-21swapper/211:33:202
674799893,36cyclictest352-21runrttasks11:29:572
674799893,36cyclictest352-21runrttasks11:29:572
674799893,25cyclictest30957-21awk08:08:312
674799893,25cyclictest30957-21awk08:08:312
6747998866,14cyclictest2374-21systemd-journal09:24:282
6747998843,39cyclictest13618-21diskmemload10:43:462
6747998843,39cyclictest13618-21diskmemload10:43:462
673799884,39cyclictest15804-21ssh09:53:341
673799882,47cyclictest13618-21diskmemload12:18:071
673799882,34cyclictest23257-21fschecks_count09:13:181
6747998765,15cyclictest6723-21cyclictest09:18:332
674799873,35cyclictest19702-21munin-run09:07:572
674799873,31cyclictest29907-21/usr/sbin/munin10:19:232
674799873,31cyclictest29907-21/usr/sbin/munin10:19:232
673799873,40cyclictest26782-21ssh12:01:431
673799873,40cyclictest26782-21ssh12:01:431
673799872,36cyclictest14961-21ssh10:47:471
673799872,36cyclictest14961-21ssh10:47:471
6747998645,33cyclictest0-21swapper/208:02:592
674799863,10cyclictest0-21swapper/211:18:102
674799863,10cyclictest0-21swapper/211:18:102
674799862,32cyclictest2515-21latency_hist08:22:592
673799866,31cyclictest22478-21cat11:54:311
6737998647,32cyclictest0-21swapper/111:48:251
6737998647,32cyclictest0-21swapper/111:48:251
673799862,28cyclictest19420-21unixbench_singl10:53:331
673799862,28cyclictest19420-21unixbench_singl10:53:331
6747998547,31cyclictest0-21swapper/210:58:122
6747998542,36cyclictest23074-21runrttasks10:07:012
6747998542,36cyclictest23074-21runrttasks10:07:012
674799853,35cyclictest20255-21fschecks_time09:08:182
674799852,36cyclictest5421-21ssh09:37:592
6737998566,10cyclictest0-21swapper/107:03:331
673799853,29cyclictest16147-21sh11:43:221
673799852,39cyclictest28796-21tune2fs08:03:161
674799844,35cyclictest25523-21fschecks_count07:53:192
6747998443,34cyclictest0-21swapper/210:12:562
674799843,34cyclictest6605-21df_inode10:33:152
674799842,36cyclictest22033-21cat07:43:092
673799844,7cyclictest0-21swapper/108:13:121
6737998442,37cyclictest6723-21cyclictest08:53:271
6737998442,37cyclictest6723-21cyclictest08:53:271
673799843,12cyclictest0-21swapper/108:28:101
673799842,35cyclictest20913-21grep07:38:521
611128412,43sleep05233-21/usr/sbin/munin06:53:440
6747998359,16cyclictest13618-21diskmemload09:48:552
6747998353,21cyclictest7659-21threads06:58:312
674799833,28cyclictest352-21runrttasks11:04:272
674799832,31cyclictest352-21runrttasks08:50:112
6747998317,52cyclictest0-21swapper/207:27:592
6747998317,52cyclictest0-21swapper/207:27:592
6737998358,15cyclictest18250-21latency_hist10:52:591
673799834,37cyclictest3888-21latency_hist12:17:581
673799833,34cyclictest29378-21awk10:17:551
6731998362,14cyclictest24126-21latency_hist11:02:580
6731998355,22cyclictest24317-21latency_hist11:57:570
674799824,69cyclictest9263-21if_eth007:03:222
674799823,38cyclictest27724-21/usr/sbin/munin12:03:152
674799823,38cyclictest27724-21/usr/sbin/munin12:03:152
674799823,33cyclictest22066-21/usr/sbin/munin11:53:322
674799823,32cyclictest24646-21unixbench_multi07:48:342
674799822,38cyclictest15936-21/usr/sbin/munin10:48:232
6737998258,16cyclictest12572-21latency07:13:231
673799823,37cyclictest7395-21/usr/sbin/munin08:38:181
673799823,34cyclictest25962-21/usr/sbin/munin09:18:211
6731998262,14cyclictest9161-21latency_hist10:37:580
6747998144,30cyclictest0-21swapper/210:02:582
674799813,34cyclictest5753-21latency_hist08:32:592
674799813,33cyclictest9109-21sh09:43:342
674799813,31cyclictest12480-21fschecks_count08:53:172
674799813,31cyclictest12480-21fschecks_count08:53:172
674799813,28cyclictest32558-21/usr/sbin/munin08:13:322
674799812,35cyclictest7016-21ssh12:23:082
674799812,35cyclictest7016-21ssh12:23:082
6737998155,16cyclictest0-21swapper/110:28:201
673799814,35cyclictest7085-21/usr/sbin/munin11:28:181
673799814,35cyclictest7085-21/usr/sbin/munin11:28:181
673799814,32cyclictest21143-21ssh10:03:201
673799814,32cyclictest21143-21ssh10:03:201
673799813,35cyclictest30525-21sh11:13:161
6737998132,42cyclictest0-21swapper/112:08:221
673799812,41cyclictest7643-21sh12:23:281
673799812,41cyclictest7643-21sh12:23:281
673799812,36cyclictest5338-21ssh11:25:021
673799812,35cyclictest5858-21fschecks_time09:38:181
673799812,23cyclictest9689-21apt-get11:33:071
6737998113,29cyclictest19971-21modprobe07:37:551
6737998113,29cyclictest19971-21modprobe07:37:551
6747998066,9cyclictest6723-21cyclictest08:43:092
674799804,43cyclictest13968-21ssh08:58:122
674799803,33cyclictest14780-21/usr/sbin/munin09:53:322
674799803,32cyclictest6371-21munin-plugin-st11:27:552
674799802,33cyclictest29559-21latency_hist10:17:582
6737998059,11cyclictest0-21swapper/107:57:581
673799804,32cyclictest26934-21/usr/sbin/munin07:58:291
673799803,34cyclictest7277-21switchtime10:33:311
673799803,26cyclictest25276-21latency_hist07:52:591
6737998030,41cyclictest0-21swapper/112:07:121
6737998030,41cyclictest0-21swapper/112:07:121
673799802,35cyclictest11936-21idleruntime-cro07:12:561
674799793,35cyclictest32255-21fschecks_count09:28:182
674799793,35cyclictest32255-21fschecks_count09:28:182
674799793,32cyclictest524-21cpuspeed10:23:122
674799792,36cyclictest6354-21/usr/sbin/munin08:33:272
6737997961,11cyclictest0-21swapper/108:52:551
6737997955,12cyclictest0-21swapper/106:58:301
673799793,35cyclictest17220-21fschecks_time09:03:191
673799793,34cyclictest22889-21cat07:43:331
673799793,31cyclictest10341-21ssh09:44:461
673799792,34cyclictest29036-21taskset11:10:251
673199794,45cyclictest9448-21latency_hist11:32:580
673199794,45cyclictest9448-21latency_hist11:32:580
674799783,65cyclictest9598-21ssh10:38:172
674799783,36cyclictest18577-21wc07:32:592
674799783,35cyclictest18336-21/usr/sbin/munin10:53:062
674799783,35cyclictest18336-21/usr/sbin/munin10:53:062
674799783,33cyclictest23013-21sh09:13:112
674799783,32cyclictest8330-21tail08:38:332
674799782,30cyclictest27246-21/usr/sbin/munin11:08:272
673799789,62cyclictest1845-21grep08:18:331
673799784,32cyclictest17209-21kworker/u17:2+xprtiod10:10:191
6737997835,36cyclictest0-21swapper/109:28:191
6737997835,36cyclictest0-21swapper/109:28:191
673799783,36cyclictest3932-21idleruntime-cro08:27:561
673799783,34cyclictest31102-21grep08:08:321
673799783,34cyclictest31102-21grep08:08:321
673799783,29cyclictest13618-21diskmemload11:18:071
673799783,29cyclictest13618-21diskmemload11:18:071
673799783,26cyclictest15143-21idleruntime-cro07:22:561
673799782,25cyclictest665-21fschecks_count10:23:181
6731997862,10cyclictest3982-21ntp_kernel_err10:28:220
6731997858,14cyclictest10435-21latency_hist07:07:580
673199784,46cyclictest14235-21fschecks_time08:58:190
6731997843,29cyclictest0-21swapper/009:48:220
655927826,33sleep30-21swapper/306:57:503
674799772,34cyclictest28900-21/usr/sbin/munin08:03:182
674799772,31cyclictest3892-21sed10:28:202
673799773,34cyclictest5153-21ssh09:37:411
673799772,38cyclictest29894-21ssh10:18:041
673799772,38cyclictest29894-21ssh10:18:041
6737997712,28cyclictest6865-21seq08:34:271
6731997762,9cyclictest2763-21ssh09:33:150
6731997761,10cyclictest12869-21ssh10:43:220
6731997761,10cyclictest12869-21ssh10:43:220
6731997746,22cyclictest11594-21grep08:48:320
6731997739,28cyclictest19676-21snmpd11:58:120
6731997739,28cyclictest19676-21snmpd11:58:120
673199772,46cyclictest677-21modprobe08:17:550
674799762,21cyclictest12696-21/usr/sbin/munin07:13:262
673799763,24cyclictest9750-21switchtime08:43:341
673799763,24cyclictest24444-21sh11:03:131
673199766,10cyclictest4022-21apt-get12:18:070
6731997660,10cyclictest10360-21sendmail08:47:560
6731997659,11cyclictest17460-21sshd08:38:050
673199764,40cyclictest12037-21ssh10:42:550
673799752,25cyclictest17648-21/usr/sbin/munin07:28:291
6731997560,9cyclictest2502-21ssh12:14:320
6731997458,9cyclictest16039-21kworker/u17:3+xprtiod09:38:260
6731997456,12cyclictest2367-21latency_hist09:32:580
6731997456,12cyclictest2367-21latency_hist09:32:580
6731997451,17cyclictest30540-21fschecks_time10:19:120
6731997451,17cyclictest30540-21fschecks_time10:19:120
673199743,43cyclictest15912-21ntpq10:48:230
6731997354,13cyclictest1616-21timerandwakeup11:18:300
6731997354,13cyclictest1616-21timerandwakeup11:18:300
6731997258,9cyclictest15-21ksoftirqd/009:43:110
6731997256,11cyclictest6723-21cyclictest07:41:210
673199725,34cyclictest16732-21modprobe07:27:560
673199725,34cyclictest16732-21modprobe07:27:560
673199722,37cyclictest13024-21timerandwakeup08:53:310
673199722,37cyclictest13024-21timerandwakeup08:53:310
6731997156,10cyclictest24949-21ssh09:15:570
6731997155,10cyclictest17650-21ssh09:57:590
6731997152,13cyclictest30273-21latency_hist12:07:570
6731997152,13cyclictest30273-21latency_hist12:07:570
6731997146,8cyclictest181rcu_preempt11:08:070
673199714,39cyclictest29380-21munin-plugin-st10:17:580
6731997138,12cyclictest181rcu_preempt10:03:510
6731997138,12cyclictest181rcu_preempt10:03:510
6731997110,33cyclictest29944-21sendmail-msp08:07:560
66062719,39sleep11-21systemd06:57:571
6731997054,10cyclictest17824-21sh09:58:120
673199704,42cyclictest352-21runrttasks09:20:520
6731997042,20cyclictest10082-21kworker/u17:0+nfsiod09:12:480
6731997035,25cyclictest16914-21ssh09:03:070
673199703,36cyclictest352-21runrttasks12:08:400
673199703,32cyclictest15945-21cut11:43:180
6731997020,36cyclictest13618-21diskmemload11:13:010
673199695,34cyclictest18557-21sort10:53:170
673199695,34cyclictest18557-21sort10:53:170
6731996952,10cyclictest24253-21sh11:03:060
673199693,37cyclictest12558-21latency_hist11:37:590
673199692,33cyclictest18558-21latency_hist07:32:590
6731996849,13cyclictest8890-21ssh12:25:460
6731996849,13cyclictest8890-21ssh12:25:460
673199683,36cyclictest15127-21modprobe07:22:560
6731996826,33cyclictest19979-21apt-get07:37:550
6731996826,33cyclictest19979-21apt-get07:37:550
6731996810,8cyclictest181rcu_preempt10:23:190
6731996752,10cyclictest58-21kcompactd008:23:230
6731996747,14cyclictest3933-21fschecks_count11:23:160
673199673,48cyclictest12880-21fschecks_count11:38:160
673199673,48cyclictest12880-21fschecks_count11:38:160
6731996731,13cyclictest24512-21sendmail_mailtr10:08:300
6731996724,33cyclictest13518-21modprobe07:17:560
6731996635,13cyclictest181rcu_preempt06:58:230
673199663,37cyclictest10562-21/usr/sbin/munin07:08:340
673199662,54cyclictest1-21systemd08:02:570
6731996445,13cyclictest24139-21latency07:48:230
6731996440,17cyclictest7303-21latency_hist08:37:590
6731996431,9cyclictest0-21swapper/007:44:140
673199633,44cyclictest1926-21unixbench_singl08:18:340
673199633,43cyclictest5543-21modprobe08:32:560
6731996243,13cyclictest15-21ksoftirqd/008:09:380
6731996243,13cyclictest15-21ksoftirqd/008:09:380
673199623,40cyclictest26682-21latency_hist07:57:580
675599614,42cyclictest18851-21chrt11:48:153
675599614,42cyclictest18851-21chrt11:48:153
675599614,41cyclictest19369-21taskset07:33:303
675599614,41cyclictest19369-21taskset07:33:303
675599593,42cyclictest1014-21taskset08:18:143
675599593,41cyclictest9885-21chrt09:43:523
675599584,40cyclictest27304-21taskset07:58:213
675599583,41cyclictest9225-21taskset08:43:213
675599583,41cyclictest7167-21chrt06:58:183
675599583,39cyclictest28134-21taskset12:03:253
675599583,39cyclictest28134-21taskset12:03:253
675599575,38cyclictest6214-21taskset09:38:283
675599574,38cyclictest12499-21chrt08:53:183
675599574,38cyclictest12499-21chrt08:53:183
675599573,39cyclictest4233-21taskset12:18:173
675599573,39cyclictest25260-21taskset07:52:593
675599564,39cyclictest21982-21taskset10:58:283
675599563,40cyclictest2215-21taskset10:25:283
675599563,40cyclictest10108-21taskset10:38:293
675599563,37cyclictest26753-21taskset10:13:113
675599553,38cyclictest6140-21chrt10:32:583
675599553,37cyclictest32653-21chrt09:28:273
675599553,37cyclictest32653-21chrt09:28:273
675599553,36cyclictest31060-21taskset12:08:233
675599553,34cyclictest30254-21chrt11:13:083
675599552,38cyclictest7043-21taskset10:33:263
675599552,36cyclictest17726-21taskset09:03:313
675599544,36cyclictest7140-21chrt11:28:203
675599544,36cyclictest7140-21chrt11:28:203
675599544,35cyclictest0-21swapper/310:18:373
675599544,35cyclictest0-21swapper/310:18:373
675599543,37cyclictest22440-21chrt07:43:233
675599543,35cyclictest3053-21chrt08:23:243
675599543,33cyclictest10573-21chrt07:08:073
675599542,38cyclictest777-21chrt08:17:583
675599533,36cyclictest26638-21chrt10:12:593
675599533,36cyclictest25750-21chrt07:53:233
675599533,35cyclictest7642-21chrt12:23:283
675599533,35cyclictest7642-21chrt12:23:283
675599533,34cyclictest19921-21taskset10:01:313
675599533,31cyclictest27602-21chrt11:08:173
675599532,38cyclictest12097-21taskset11:37:163
675599532,36cyclictest1325-21chrt12:13:183
675599532,33cyclictest25067-21chrt11:58:223
675599532,33cyclictest25067-21chrt11:58:223
675599527,27cyclictest26904-21chrt11:07:533
675599523,37cyclictest16263-21chrt10:48:313
675599514,33cyclictest23707-21taskset11:56:273
675599514,33cyclictest13728-21chrt09:50:493
675599514,33cyclictest10449-21taskset07:07:583
675599513,35cyclictest2515-21chrt09:33:013
675599513,34cyclictest16933-21chrt07:27:593
675599513,34cyclictest16933-21chrt07:27:593
675599513,32cyclictest15001-21chrt09:53:163
675599512,34cyclictest30260-21chrt09:24:013
675599504,34cyclictest809-21chrt11:18:103
675599504,34cyclictest809-21chrt11:18:103
675599503,33cyclictest15710-21chrt11:43:123
675599503,33cyclictest15143-21taskset10:47:583
675599503,33cyclictest15143-21taskset10:47:583
675599503,32cyclictest6624-21chrt11:27:593
675599503,29cyclictest917-21kworker/3:1+events07:32:593
675599503,29cyclictest20718-21chrt10:03:053
675599503,29cyclictest20718-21chrt10:03:053
675599502,38cyclictest14470-21taskset08:58:243
675599502,35cyclictest21043-21taskset09:08:333
675599502,32cyclictest26270-21chrt09:18:223
675599494,31cyclictest20633-21chrt07:38:413
675599493,35cyclictest29239-21chrt08:03:283
675599493,31cyclictest19418-21chrt10:53:333
675599493,31cyclictest19418-21chrt10:53:333
675599492,35cyclictest4431-21chrt08:28:193
675599492,33cyclictest23345-21taskset09:13:193
675599483,33cyclictest12639-21chrt11:38:053
675599483,33cyclictest12639-21chrt11:38:053
675599472,33cyclictest8134-21chrt08:38:313
675599465,30cyclictest13027-21chrt07:13:333
675599464,29cyclictest30369-21chrt08:08:183
675599464,29cyclictest30369-21chrt08:08:183
675599423,28cyclictest917-21kworker/3:1+events08:48:163
675599423,28cyclictest7277-21taskset08:37:583
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional