You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 04:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Tue Jun 16, 2026 00:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3246426680,3sleep30-21swapper/318:59:043
3246426680,3sleep30-21swapper/318:59:043
31139213818,19sleep10-21swapper/118:54:221
31139213818,19sleep10-21swapper/118:54:221
324849911053,22cyclictest8200-21sh21:54:032
324849910946,37cyclictest17874-21latency_hist23:04:032
32465991057,68cyclictest12337-21latency_hist23:49:040
324849910343,36cyclictest17837-21sh21:14:432
32465991026,76cyclictest2374-21systemd-journal22:24:270
3113221019,60sleep030967-21/usr/sbin/munin18:54:210
3113221019,60sleep030967-21/usr/sbin/munin18:54:210
3105321019,60sleep231107-21cstates18:54:192
3105321019,60sleep231107-21cstates18:54:192
324769910060,35cyclictest32450-21cyclictest00:09:311
32484999629,29cyclictest14083-21seq22:03:512
3247699932,31cyclictest17460-21sshd19:34:201
3247699932,31cyclictest17460-21sshd19:34:201
32465999320,50cyclictest15-21ksoftirqd/020:35:280
3247699903,43cyclictest18549-21head22:09:371
32484998925,25cyclictest20325-21ssh21:19:312
32484998925,25cyclictest20325-21ssh21:19:312
32476998933,47cyclictest0-21swapper/121:00:151
32476998871,8cyclictest0-21swapper/123:48:591
32476998841,39cyclictest0-21swapper/121:34:241
3247699883,43cyclictest352-21runrttasks20:29:211
3247699883,37cyclictest3759-21ps22:39:321
32465998822,36cyclictest15-21ksoftirqd/019:29:030
32465998822,36cyclictest15-21ksoftirqd/019:29:030
32484998727,20cyclictest7373-21diskmemload23:35:272
32484998727,20cyclictest7373-21diskmemload23:35:272
32476998738,39cyclictest0-21swapper/122:29:341
3247699873,41cyclictest5747-21modprobe20:53:591
3247699873,39cyclictest18396-21latency_hist19:54:021
3247699872,28cyclictest30252-21ssh23:24:221
32476998710,20cyclictest0-21swapper/122:24:401
32484998619,50cyclictest0-21swapper/221:32:412
32484998619,50cyclictest0-21swapper/221:32:412
3247699864,35cyclictest28700-21fschecks_count20:24:231
32476998637,39cyclictest0-21swapper/122:14:101
3247699863,44cyclictest24191-21ssh23:14:191
3247699863,32cyclictest2374-21systemd-journal19:48:591
3247699863,31cyclictest14666-21latency_hist22:59:011
3247699863,30cyclictest27633-21ps23:19:341
3247699863,28cyclictest352-21runrttasks20:14:181
3247699863,25cyclictest7928-21apt-get21:54:151
3247699863,25cyclictest7928-21apt-get21:54:151
32476998632,45cyclictest0-21swapper/120:44:001
32465998641,13cyclictest181rcu_preempt23:58:320
3249099858,39cyclictest24232-21chrt23:14:273
32484998529,20cyclictest6778-21grep22:44:342
32484998528,19cyclictest16380-21seq19:44:532
32484998525,23cyclictest10084-21seq19:26:552
32484998525,23cyclictest10084-21seq19:26:552
32484998523,26cyclictest14809-21seq19:40:202
32484998521,31cyclictest28958-21cut21:34:222
3247699854,26cyclictest28586-21runrttasks21:34:031
3247699854,26cyclictest28586-21runrttasks21:34:031
32476998541,36cyclictest0-21swapper/123:49:361
32476998541,36cyclictest0-21swapper/123:49:361
32476998540,38cyclictest0-21swapper/122:38:531
3247699853,37cyclictest352-21runrttasks00:25:541
3247699853,37cyclictest352-21runrttasks00:25:541
3247699853,34cyclictest14715-21grep19:39:351
3247699853,30cyclictest6045-21/usr/sbin/munin22:44:391
3247699853,30cyclictest3394-21ssh23:34:031
3247699853,30cyclictest3394-21ssh23:34:031
3247699853,30cyclictest20386-21latency_hist19:59:041
3247699853,29cyclictest28347-21latency_hist20:24:021
3247699852,31cyclictest15426-21timerwakeupswit22:04:361
32465998558,17cyclictest300-21rs:main0
32465998558,17cyclictest300-21rs:main0
3246599855,25cyclictest161ktimers/019:49:350
32484998425,19cyclictest31987-21ssh00:21:082
32484998425,19cyclictest31987-21ssh00:21:082
32484998423,29cyclictest19584-21seq23:59:562
32484998423,29cyclictest19584-21seq23:59:562
32476998464,15cyclictest0-21swapper/119:04:191
3247699844,26cyclictest17918-21/usr/sbin/munin23:04:261
3247699843,34cyclictest7037-21modprobe19:19:001
3247699843,31cyclictest30322-21/usr/sbin/munin00:19:251
3247699843,31cyclictest30322-21/usr/sbin/munin00:19:251
3247699843,31cyclictest1471-21unixbench_multi23:29:341
3247699843,31cyclictest11730-21fschecks_count21:59:211
3247699843,25cyclictest2815-21taskset20:44:221
3247699842,31cyclictest8369-21date21:54:041
3247699842,31cyclictest10658-21/usr/sbin/munin21:04:341
32465998412,41cyclictest15-21ksoftirqd/019:34:080
32465998412,41cyclictest15-21ksoftirqd/019:34:080
32484998325,24cyclictest22017-21sh22:15:522
32476998363,12cyclictest277-21dbus-daemon23:59:001
32476998338,40cyclictest32450-21cyclictest20:59:011
32476998338,40cyclictest32450-21cyclictest20:59:011
3247699833,54cyclictest22446-21grep00:04:361
3247699833,33cyclictest30087-21latency_hist00:19:011
3247699833,30cyclictest32601-21timerandwakeup21:39:361
3247699833,29cyclictest23438-21systemctl20:08:591
3247699833,29cyclictest19441-21grep23:59:371
3247699833,29cyclictest19441-21grep23:59:371
3247699833,28cyclictest26438-21apt-key22:24:041
3247699832,32cyclictest15563-21ntp_kernel_pll_22:59:281
3247699832,32cyclictest15563-21ntp_kernel_pll_22:59:281
3247699832,31cyclictest87-21kswapd020:34:101
32476998316,59cyclictest0-21swapper/121:14:281
32465998360,17cyclictest32450-21cyclictest18:59:320
32465998359,17cyclictest15638-21fschecks_time19:44:220
3246599835,56cyclictest7928-21apt-get21:54:180
3246599835,56cyclictest7928-21apt-get21:54:180
3246599833,65cyclictest20492-21runrttasks19:59:340
3246599833,46cyclictest8202-21grep19:19:340
32465998314,37cyclictest15-21ksoftirqd/019:15:290
3249099824,34cyclictest27192-21chrt00:14:013
32484998259,17cyclictest21925-21latency_hist20:04:032
32484998227,21cyclictest11627-21seq22:53:492
3247699823,32cyclictest3234-21unixbench_multi21:44:351
3247699823,31cyclictest985-21sort18:59:351
3247699823,31cyclictest9269-21fschecks_count22:49:201
3247699823,30cyclictest25620-21latency_hist21:29:031
3247699822,30cyclictest9887-21unixbench_singl19:24:361
3247699822,30cyclictest9887-21unixbench_singl19:24:361
3247699822,30cyclictest5446-21latency_hist19:14:031
3247699822,24cyclictest8260-21unixbench_singl19:19:351
32465998225,23cyclictest0-21swapper/022:09:320
32465998224,35cyclictest15-21ksoftirqd/000:15:040
32484998127,23cyclictest5695-21seq20:53:232
32484998126,24cyclictest28140-21seq20:22:362
32484998125,25cyclictest6798-21seq19:15:582
32484998124,26cyclictest26379-21seq20:15:362
3247699814,29cyclictest20774-21fschecks_time20:00:101
3247699813,31cyclictest11006-21netstat19:29:251
3247699813,31cyclictest11006-21netstat19:29:251
3247699813,28cyclictest21608-21grep23:09:311
3247699813,28cyclictest21608-21grep23:09:311
3247699813,26cyclictest6403-21/usr/sbin/munin23:39:201
3247699812,31cyclictest24073-21uname20:09:251
32465998157,15cyclictest14650-21ssh22:58:590
3246599814,44cyclictest11889-21modprobe19:33:590
3246599814,44cyclictest11889-21modprobe19:33:590
3246599812,51cyclictest15-21ksoftirqd/020:49:030
32484998027,23cyclictest3674-21seq19:07:232
32484998023,23cyclictest7192-21seq20:56:592
32484998023,23cyclictest7192-21seq20:56:592
32484998018,27cyclictest0-21swapper/200:14:302
3247699803,31cyclictest13738-21cpu21:09:151
3247699803,31cyclictest13738-21cpu21:09:151
3247699803,30cyclictest19668-21/usr/sbin/munin21:19:221
3247699803,30cyclictest19668-21/usr/sbin/munin21:19:221
3246599806,37cyclictest7920-21apt-get20:59:150
32465998060,13cyclictest300-21rs:main0
32465998060,13cyclictest300-21rs:main0
32465998054,17cyclictest2442-21fschecks_count21:44:200
3246599803,43cyclictest15-21ksoftirqd/023:27:010
32484997929,21cyclictest14919-21seq21:09:552
32484997929,21cyclictest14919-21seq21:09:552
32484997922,25cyclictest5446-21latency_hist19:14:022
32484997922,24cyclictest2429-21sh22:38:032
32484997919,23cyclictest0-21swapper/219:33:222
32484997919,23cyclictest0-21swapper/219:33:222
3246599796,36cyclictest15-21ksoftirqd/019:12:580
3246599796,29cyclictest15-21ksoftirqd/021:23:310
3246599796,29cyclictest15-21ksoftirqd/021:23:310
32465997936,34cyclictest0-21swapper/023:39:290
32465997935,19cyclictest181rcu_preempt23:14:580
32465997929,29cyclictest15-21ksoftirqd/020:58:590
32465997929,29cyclictest15-21ksoftirqd/020:58:590
32465997914,30cyclictest161ktimers/023:04:370
32484997858,13cyclictest297-21systemd-logind20:14:002
32484997825,24cyclictest593-21seq20:38:242
32484997825,23cyclictest4641-21seq21:48:182
32484997825,18cyclictest29617-21latency_hist23:24:022
32484997824,25cyclictest1943-21seq20:40:022
32484997822,24cyclictest23373-21seq20:08:352
32484997816,27cyclictest0-21swapper/221:39:162
32484997814,26cyclictest0-21swapper/219:49:262
3248499781,38cyclictest30801-21timerandwakeup23:24:352
32465997856,14cyclictest7373-21diskmemload22:42:520
3246599784,44cyclictest15-21ksoftirqd/021:08:070
3246599783,46cyclictest15-21ksoftirqd/000:04:250
32465997817,16cyclictest15-21ksoftirqd/021:31:290
32465997817,16cyclictest15-21ksoftirqd/021:31:290
32465997816,32cyclictest15-21ksoftirqd/022:52:030
32484997757,14cyclictest352-21runrttasks22:24:022
32484997724,23cyclictest31373-21seq20:32:332
32484997724,23cyclictest29763-21seq20:27:512
32484997720,21cyclictest18052-21sed22:09:282
32484997719,33cyclictest0-21swapper/223:49:032
32484997719,26cyclictest1202-21runrttasks18:59:582
32465997758,13cyclictest352-21runrttasks22:19:370
3246599775,24cyclictest15253-21taskset19:44:020
32465997743,9cyclictest181rcu_preempt20:32:430
32465997722,29cyclictest15-21ksoftirqd/023:49:360
32465997722,29cyclictest15-21ksoftirqd/023:49:360
32484997644,10cyclictest181rcu_preempt23:09:502
32484997644,10cyclictest181rcu_preempt23:09:502
3248499763,61cyclictest24139-21apt-get23:14:172
32484997624,18cyclictest17449-21taskset23:03:322
32484997624,17cyclictest3596-21seq20:45:372
32484997622,26cyclictest0-21swapper/219:37:072
32484997622,26cyclictest0-21swapper/219:37:072
32484997622,22cyclictest0-21swapper/219:56:062
32484997621,26cyclictest0-21swapper/222:07:362
32484997619,27cyclictest3246-21expr22:39:162
32465997648,21cyclictest32450-21cyclictest20:39:200
32465997641,13cyclictest181rcu_preempt23:12:520
32465997641,13cyclictest181rcu_preempt23:12:520
32465997639,17cyclictest181rcu_preempt19:06:360
32465997616,31cyclictest15-21ksoftirqd/022:59:080
32465997616,31cyclictest15-21ksoftirqd/022:59:080
32465997615,23cyclictest15-21ksoftirqd/000:00:450
32465997615,23cyclictest15-21ksoftirqd/000:00:450
32465997613,39cyclictest15-21ksoftirqd/021:44:010
3248499758,29cyclictest0-21swapper/222:58:522
32484997523,22cyclictest14387-21taskset23:52:022
32484997523,22cyclictest14387-21taskset23:52:022
32484997515,24cyclictest0-21swapper/221:54:512
32484997515,24cyclictest0-21swapper/221:54:512
32465997540,13cyclictest181rcu_preempt20:24:290
3246599753,39cyclictest15-21ksoftirqd/021:49:200
32484997455,13cyclictest297-21systemd-logind23:09:002
32484997441,23cyclictest6426-21apt-get23:39:142
32484997416,28cyclictest8382-21runrttasks19:20:392
32484997415,24cyclictest0-21swapper/200:24:102
32484997415,24cyclictest0-21swapper/200:24:102
32465997454,14cyclictest17480-21sensors_temp21:14:340
32465997442,24cyclictest0-21swapper/022:35:360
3246599743,44cyclictest15-21ksoftirqd/021:12:460
3246599743,44cyclictest15-21ksoftirqd/021:12:460
32484997316,23cyclictest7373-21diskmemload23:56:182
3246599735,32cyclictest15-21ksoftirqd/023:22:080
32465997343,21cyclictest26649-21modprobe20:18:590
32465997338,25cyclictest0-21swapper/022:29:250
32465997336,12cyclictest181rcu_preempt22:15:280
3246599733,43cyclictest15-21ksoftirqd/022:04:180
3246599733,39cyclictest15-21ksoftirqd/000:19:320
3246599733,39cyclictest15-21ksoftirqd/000:19:320
3246599733,33cyclictest753-21fschecks_time23:29:200
32484997234,23cyclictest27047-21munin-plugin-st00:13:582
32484997218,24cyclictest21644-21cut00:04:202
3246599729,41cyclictest15-21ksoftirqd/020:10:540
32465997248,9cyclictest181rcu_preempt21:37:040
3246599723,33cyclictest12542-21grep21:59:370
32465997211,12cyclictest161ktimers/022:46:570
32484997129,36cyclictest0-21swapper/222:24:412
3248499712,30cyclictest13356-21modprobe21:08:592
32484997114,24cyclictest0-21swapper/221:02:152
3246599715,42cyclictest15-21ksoftirqd/020:54:030
3246599713,40cyclictest15-21ksoftirqd/019:54:290
3246599713,35cyclictest24569-21/usr/sbin/munin00:09:170
32465997132,12cyclictest181rcu_preempt20:23:540
32484996929,32cyclictest29690-21ssh22:29:172
32465996933,17cyclictest181rcu_preempt20:04:530
32484996848,14cyclictest22763-21sh21:24:172
32465996823,33cyclictest25053-21diskmemload21:28:110
32484996731,27cyclictest463-21apt-get23:29:092
3249099653,36cyclictest0-21swapper/321:54:193
3249099653,36cyclictest0-21swapper/321:54:193
32490996512,29cyclictest0-21swapper/319:04:213
3249099649,41cyclictest15707-21taskset19:44:243
3249099647,33cyclictest0-21swapper/320:49:383
3249099643,43cyclictest18354-21chrt19:54:003
3249099643,43cyclictest12736-21taskset19:34:323
3249099643,43cyclictest12736-21taskset19:34:323
36542620,5sleep30-21swapper/300:29:023
36542620,5sleep30-21swapper/300:29:023
3249099623,38cyclictest917-21kworker/3:1+events20:44:193
32490996210,41cyclictest0-21swapper/322:24:173
3249099605,40cyclictest7984-21chrt20:59:313
3249099603,27cyclictest0-21swapper/319:59:543
3249099592,35cyclictest917-21kworker/3:1+events21:34:033
3249099592,35cyclictest917-21kworker/3:1+events21:34:033
3249099584,29cyclictest24316-21taskset00:09:033
3249099583,42cyclictest24008-21taskset22:19:273
3249099583,40cyclictest20896-21chrt00:03:313
3249099583,40cyclictest20896-21chrt00:03:313
3249099574,37cyclictest29852-21taskset21:34:473
3249099573,39cyclictest14485-21chrt22:04:153
3249099572,39cyclictest20579-21taskset22:14:163
3249099564,35cyclictest21107-21chrt23:09:163
3249099564,35cyclictest21107-21chrt23:09:163
3249099563,40cyclictest24201-21taskset21:25:473
3249099563,39cyclictest10244-21taskset23:44:343
3249099563,37cyclictest29818-21taskset23:24:033
3249099563,36cyclictest5437-21taskset21:49:193
3249099562,39cyclictest17766-21chrt22:09:223
3249099562,33cyclictest917-21kworker/3:1+events19:54:133
3249099554,36cyclictest31798-21chrt22:32:433
3249099554,33cyclictest30667-21chrt00:19:213
3249099554,33cyclictest30667-21chrt00:19:213
3249099553,38cyclictest31234-21chrt23:25:123
3249099553,37cyclictest5605-21chrt22:43:383
3249099553,36cyclictest13964-21taskset21:09:213
3249099553,36cyclictest13964-21taskset21:09:213
3249099553,34cyclictest30129-21taskset20:29:033
3249099544,34cyclictest2042-21taskset22:36:573
3249099543,36cyclictest15105-21taskset19:43:593
3249099543,33cyclictest11581-21chrt21:59:163
3249099543,29cyclictest0-21swapper/321:08:593
3249099542,36cyclictest27894-21chrt20:19:363
3249099534,34cyclictest18448-21taskset23:04:263
3249099534,33cyclictest9233-21chrt22:49:183
3249099533,37cyclictest19511-21chrt21:19:023
3249099533,35cyclictest23627-21chrt20:09:033
3249099532,32cyclictest7579-21chrt19:19:213
3249099524,34cyclictest6385-21taskset22:44:233
3249099523,37cyclictest15935-21chrt23:54:273
3249099523,36cyclictest7481-21chrt23:39:353
3249099523,33cyclictest4847-21chrt23:35:263
3249099523,33cyclictest4847-21chrt23:35:263
3249099523,32cyclictest1122-21taskset23:29:303
3249099522,36cyclictest14619-21chrt23:52:413
3249099522,36cyclictest14619-21chrt23:52:413
3249099522,35cyclictest24569-21chrt20:09:353
3249099513,33cyclictest12122-21chrt19:34:033
3249099512,36cyclictest28985-21chrt00:16:043
3249099512,35cyclictest31911-21chrt21:39:213
3249099509,27cyclictest917-21kworker/3:1+events19:30:403
3249099503,33cyclictest5013-21taskset21:49:023
3249099502,37cyclictest6487-21chrt19:14:353
3249099502,32cyclictest14245-21chrt22:57:493
3249099492,32cyclictest1112-21chrt20:39:203
3249099483,29cyclictest917-21kworker/3:1+events19:04:033
3249099482,31cyclictest22306-21chrt21:23:533
3249099482,31cyclictest22306-21chrt21:23:533
3249099473,33cyclictest15624-21chrt22:59:313
3249099473,33cyclictest15624-21chrt22:59:313
3249099463,30cyclictest6898-21taskset20:54:353
3249099463,30cyclictest6898-21taskset20:54:353
3249099463,30cyclictest668-21chrt20:39:003
3249099463,27cyclictest9798-21chrt19:24:353
3249099463,27cyclictest9798-21chrt19:24:353
3249099443,28cyclictest28539-21taskset20:24:173
3249099443,24cyclictest917-21kworker/3:1+events20:14:143
3249099422,29cyclictest4772-21chrt19:09:333
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional