You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-26 - 14:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sun Apr 26, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
242768325847,8sleep50-21swapper/507:07:495
2428072995044,5cyclictest3051652-21latency_hist11:49:137
242755924535,7sleep40-21swapper/407:06:034
29659982440,0sleep72965996-21ssh11:13:197
2428065994239,2cyclictest3015210-21kworker/u16:4+events_unbound11:39:184
2428072994136,4cyclictest2917864-21latency_hist10:54:137
24268632413,31sleep70-21swapper/707:04:467
2428066993938,1cyclictest2735519-21kworker/u16:3+flush-8:010:04:135
2428068993634,2cyclictest2699308-21kworker/u16:4+events_unbound09:33:236
2428068993533,2cyclictest2633247-21kworker/u16:1+flush-8:008:54:136
2428065993533,2cyclictest3015210-21kworker/u16:4+flush-8:011:53:314
2428065993533,2cyclictest2699307-21kworker/u16:0+flush-8:010:24:134
2428065993331,2cyclictest2964339-21kworker/u16:1+events_unbound12:11:234
2428065993331,2cyclictest2735519-21kworker/u16:3+events_unbound10:02:244
2428065993331,2cyclictest2633247-21kworker/u16:1+events_unbound09:22:244
2428068993230,2cyclictest2735519-21kworker/u16:3+events_unbound09:52:246
2428068993229,3cyclictest3100145-21kworker/u16:2+flush-8:012:24:356
2428065993230,2cyclictest2843656-21kworker/u16:2+events_unbound11:14:234
2428065993229,2cyclictest2843656-21kworker/u16:2+events_unbound11:09:164
242767523222,7sleep60-21swapper/607:07:426
2428068993129,2cyclictest2633869-21kworker/u16:2+flush-8:009:29:136
2428068993129,2cyclictest2633869-21kworker/u16:2+flush-8:009:29:136
2428065993129,2cyclictest2699307-21kworker/u16:0+flush-8:009:49:244
2428072993024,5cyclictest3100188-21latency_hist12:09:137
2428065993028,2cyclictest2964339-21kworker/u16:1+events_unbound11:19:164
2428065993028,2cyclictest2906210-21kworker/u16:0+flush-8:011:04:484
2428065993028,2cyclictest2808879-21kworker/u16:4+events_unbound10:34:354
2428065993027,3cyclictest3084895-21kworker/u16:0+events_unbound12:00:244
2428068992927,2cyclictest2843656-21kworker/u16:2+events_unbound11:44:076
2428068992927,2cyclictest2808879-21kworker/u16:4+events_unbound10:36:116
2428068992927,2cyclictest2699307-21kworker/u16:0+flush-8:010:18:226
2428065992927,2cyclictest2808879-21kworker/u16:4+events_unbound10:59:304
2428065992926,2cyclictest2964339-21kworker/u16:1+events_unbound12:14:154
2428072992823,4cyclictest2954409-21latency_hist11:09:147
242807299280,26cyclictest3148764-21/usr/sbin/munin12:29:137
2428068992826,2cyclictest2633869-21kworker/u16:2+events_unbound09:18:286
2428068992826,2cyclictest2633247-21kworker/u16:1+flush-8:009:09:096
2428065992826,2cyclictest3100145-21kworker/u16:2+flush-8:012:24:474
2428065992825,2cyclictest3136680-21kworker/u16:4+events_unbound12:34:134
2428068992726,1cyclictest2964339-21kworker/u16:1+events_unbound11:12:396
2428068992725,2cyclictest2808879-21kworker/u16:4+events_unbound11:04:376
2428068992725,2cyclictest2633869-21kworker/u16:2+events_unbound10:00:156
2428068992724,3cyclictest2856521-21kworker/u16:1+flush-8:010:29:316
2428066992725,2cyclictest2699307-21kworker/u16:0+flush-8:009:44:475
2428065992725,2cyclictest3003155-21kworker/u16:0+events_unbound11:46:244
2428065992724,2cyclictest2735519-21kworker/u16:3+flush-8:010:04:234
2428065992724,2cyclictest2735519-21kworker/u16:3+flush-8:010:04:234
2428068992624,2cyclictest2906210-21kworker/u16:0+events_unbound10:54:076
2428068992624,2cyclictest2843656-21kworker/u16:2+flush-8:011:24:436
2428068992623,2cyclictest3015210-21kworker/u16:4+events_unbound11:54:156
2428065992624,2cyclictest2633869-21kworker/u16:2+events_unbound09:58:594
2428065992624,2cyclictest2427637-21kworker/u16:0+events_unbound07:19:094
2428072992524,0cyclictest0-21swapper/708:39:397
2428068992523,2cyclictest3136680-21kworker/u16:4+flush-8:012:34:286
2428068992523,2cyclictest3063177-21kworker/u16:3+flush-8:012:14:256
2428068992523,2cyclictest3015210-21kworker/u16:4+events_unbound11:49:006
2428068992523,2cyclictest2843656-21kworker/u16:2+events_unbound11:03:036
2428068992523,2cyclictest2699307-21kworker/u16:0+events_unbound10:23:036
2428068992523,2cyclictest2633869-21kworker/u16:2+events_unbound08:59:136
2428068992522,2cyclictest2567425-21kworker/u16:0+flush-8:008:34:146
2428065992523,2cyclictest3063177-21kworker/u16:3+events_unbound11:58:234
2428065992523,2cyclictest2964339-21kworker/u16:1+events_unbound12:09:104
2428065992523,2cyclictest2808879-21kworker/u16:4+events_unbound10:57:074
2428068992422,2cyclictest2964339-21kworker/u16:1+events_unbound12:19:146
2428068992422,2cyclictest2964339-21kworker/u16:1+events_unbound11:59:476
2428068992422,2cyclictest2964339-21kworker/u16:1+events_unbound11:30:156
2428068992421,3cyclictest2479824-21kworker/u16:2+events_unbound07:39:446
2428066992421,2cyclictest2964339-21kworker/u16:1+flush-8:011:59:315
2428065992422,2cyclictest2856521-21kworker/u16:1+events_unbound10:46:244
2428065992422,2cyclictest2856521-21kworker/u16:1+events_unbound10:46:244
2428065992422,2cyclictest2856521-21kworker/u16:1+events_unbound10:40:234
2428065992422,2cyclictest2808879-21kworker/u16:4+events_unbound10:30:234
2428065992422,2cyclictest2808262-21kworker/u16:1+flush-8:010:10:264
2428065992422,2cyclictest2699308-21kworker/u16:4+events_unbound09:30:234
2428072992321,1cyclictest0-21swapper/712:19:267
2428068992322,1cyclictest0-21swapper/609:56:246
2428068992321,2cyclictest3015210-21kworker/u16:4+events_unbound11:38:396
2428065992321,2cyclictest2808262-21kworker/u16:1+flush-8:010:15:234
2428065992321,2cyclictest2567425-21kworker/u16:0+events_unbound09:15:244
2428065992321,1cyclictest2964339-21kworker/u16:1+events_unbound11:29:224
2428068992220,2cyclictest3136432-21kworker/u16:0+events_unbound12:30:206
2428068992220,2cyclictest2964339-21kworker/u16:1+events_unbound12:09:326
2428068992220,2cyclictest2843656-21kworker/u16:2+events_unbound11:50:406
2428068992220,2cyclictest2633869-21kworker/u16:2+flush-8:009:19:406
2428068992220,2cyclictest2633869-21kworker/u16:2+events_unbound09:43:446
2428068992119,2cyclictest2856521-21kworker/u16:1+flush-8:010:44:336
2428068992119,2cyclictest2856521-21kworker/u16:1+flush-8:010:44:336
2428068992119,2cyclictest2808879-21kworker/u16:4+events_unbound10:27:486
2428068992119,2cyclictest2735519-21kworker/u16:3+events_unbound09:48:006
2428068992119,2cyclictest2633869-21kworker/u16:2+events_unbound09:34:196
2428068992119,2cyclictest2437558-21kworker/u16:3+flush-8:008:24:356
2428068992118,2cyclictest2546014-21kworker/u16:5+flush-8:008:09:336
2428065992119,2cyclictest2964339-21kworker/u16:1+events_unbound12:22:594
2428065992119,2cyclictest2633869-21kworker/u16:2+flush-8:009:11:034
2428065992119,2cyclictest2633869-21kworker/u16:2+events_unbound09:34:154
2428072992017,2cyclictest2604827-21cat08:39:137
2428068992018,2cyclictest2567425-21kworker/u16:0+events_unbound09:13:316
2428066992018,2cyclictest2633869-21kworker/u16:2+flush-8:009:19:015
2428072991914,3cyclictest124-21kswapd008:00:247
2428072991914,3cyclictest124-21kswapd008:00:247
2428068991917,2cyclictest3084895-21kworker/u16:0+flush-8:012:04:376
2428068991917,2cyclictest2465308-21kworker/u16:4+events_unbound07:54:436
2428068991917,2cyclictest2427637-21kworker/u16:0+flush-8:007:29:356
2428065991917,2cyclictest2843656-21kworker/u16:2+events_unbound10:51:394
2428065991917,2cyclictest2735519-21kworker/u16:3+events_unbound09:48:554
2428072991815,2cyclictest1234-21snmpd07:13:117
242807299180,16cyclictest2479823-21date07:34:147
2428068991816,2cyclictest2479824-21kworker/u16:2+events_unbound07:49:236
2428066991814,3cyclictest2489641-21munin-node07:39:275
2428065991816,2cyclictest3136680-21kworker/u16:4+flush-8:012:39:134
2428065991816,2cyclictest2843656-21kworker/u16:2+events_unbound10:24:234
2428072991713,3cyclictest1234-21snmpd08:07:517
242807299170,1cyclictest0-21swapper/708:59:367
2428068991715,2cyclictest2979118-21kworker/u16:3+events_unbound11:21:566
2428068991715,2cyclictest2843656-21kworker/u16:2+flush-8:010:43:486
2428068991715,2cyclictest2374963-21kworker/u16:2+events_unbound07:09:336
2428065991715,2cyclictest2843656-21kworker/u16:2+flush-8:011:24:554
2428065991715,2cyclictest2699307-21kworker/u16:0+events_unbound09:39:364
2428065991715,2cyclictest2437558-21kworker/u16:3+events_unbound08:24:334
2428072991612,3cyclictest1234-21snmpd09:37:247
2428072991611,4cyclictest2942226-21latency_hist11:04:137
242807299160,14cyclictest1234-21snmpd07:38:387
2428068991614,2cyclictest2964339-21kworker/u16:1+events_unbound11:18:516
2428068991614,2cyclictest2437558-21kworker/u16:3+flush-8:007:59:336
2428068991614,2cyclictest2437558-21kworker/u16:3+flush-8:007:59:336
2428068991614,2cyclictest2427637-21kworker/u16:0+flush-8:007:14:166
2428066991614,2cyclictest2808879-21kworker/u16:4+events_unbound11:04:275
2428066991613,2cyclictest3003155-21kworker/u16:0+flush-8:011:44:185
2428072991514,0cyclictest0-21swapper/710:34:527
2428072991514,0cyclictest0-21swapper/709:04:437
2428072991510,4cyclictest3063764-21latency_hist11:54:147
242807299150,13cyclictest1127-21containerd09:54:387
2428066991512,2cyclictest2459813-21sed07:19:415
242806699150,1cyclictest0-21swapper/509:58:465
2428065991513,2cyclictest2528085-21kworker/u16:1+flush-8:007:59:234
2428065991513,2cyclictest2528085-21kworker/u16:1+flush-8:007:59:234
242807299148,5cyclictest635-21systemd-journal08:49:147
2428072991413,0cyclictest0-21swapper/708:29:397
2428072991410,3cyclictest2662310-21diskmemload11:38:037
242807299140,6cyclictest0-21swapper/709:18:597
242807299140,1cyclictest0-21swapper/710:24:377
242807299140,1cyclictest0-21swapper/710:04:387
242807299140,1cyclictest0-21swapper/710:04:387
242807299140,13cyclictest0-21swapper/711:14:387
2428068991412,2cyclictest2808879-21kworker/u16:4+events_unbound10:56:386
2428068991412,2cyclictest2699307-21kworker/u16:0+events_unbound10:10:526
2428068991412,2cyclictest2567425-21kworker/u16:0+events_unbound08:44:396
2428068991412,2cyclictest2567425-21kworker/u16:0+events_unbound08:44:396
2428068991412,2cyclictest2437558-21kworker/u16:3+flush-8:008:14:406
2428066991413,1cyclictest0-21swapper/512:34:035
2428066991413,1cyclictest0-21swapper/509:54:115
2428066991412,2cyclictest3084895-21kworker/u16:0+flush-8:012:04:455
2428066991410,3cyclictest3113647-21cat12:14:285
2428065991413,1cyclictest0-21swapper/408:49:444
2428065991412,2cyclictest2576202-21kworker/u16:1+flush-8:008:33:404
2428065991412,2cyclictest2465308-21kworker/u16:4+flush-8:008:14:144
2428065991412,2cyclictest2405057-21kworker/u16:1+events_unbound07:39:094
2428065991411,3cyclictest2405057-21kworker/u16:1+flush-8:007:39:404
242807299138,4cyclictest2844915-21latency_hist10:24:147
242807299138,3cyclictest1234-21snmpd10:55:297
242807299138,3cyclictest1234-21snmpd09:24:387
242807299138,3cyclictest1234-21snmpd09:24:387
2428072991310,2cyclictest0-21swapper/711:29:407
242807299130,12cyclictest1234-21snmpd07:21:327
242807299130,11cyclictest2756540-21ssh09:44:387
2428066991312,1cyclictest0-21swapper/511:04:115
2428066991311,2cyclictest3100145-21kworker/u16:2+events_unbound12:19:435
2428065991311,2cyclictest3015210-21kworker/u16:4+events_unbound11:38:194
2428065991311,2cyclictest2528085-21kworker/u16:1+events_unbound08:04:414
2428065991311,2cyclictest2507669-21kworker/u16:5+events_unbound07:49:444
242807299129,2cyclictest1234-21snmpd12:14:317
242807299129,2cyclictest1234-21snmpd08:14:457
242807299128,3cyclictest1234-21snmpd09:19:417
242807299128,3cyclictest1234-21snmpd08:56:567
242807299128,3cyclictest1234-21snmpd08:11:517
242807299128,3cyclictest1234-21snmpd07:52:547
242807299128,3cyclictest1234-21snmpd07:40:297
242807299128,3cyclictest1234-21snmpd07:27:117
242807299128,3cyclictest1234-21snmpd07:15:327
242807299126,5cyclictest6382-21gvfs-afc-volume09:39:307
2428072991210,1cyclictest0-21swapper/710:29:437
242807299120,11cyclictest1234-21snmpd09:32:207
2428068991210,2cyclictest2567425-21kworker/u16:0+events_unbound09:01:246
2428066991211,1cyclictest0-21swapper/508:47:215
2428066991211,1cyclictest0-21swapper/508:47:215
2428066991211,1cyclictest0-21swapper/507:50:075
242806699120,1cyclictest0-21swapper/509:03:355
242806699120,1cyclictest0-21swapper/508:17:145
242806699120,12cyclictest0-21swapper/507:12:075
242807299119,1cyclictest0-21swapper/711:24:367
242807299118,2cyclictest1234-21snmpd11:55:407
242807299118,2cyclictest0-21swapper/712:34:337
242807299118,2cyclictest0-21swapper/708:44:147
242807299118,2cyclictest0-21swapper/708:44:147
242807299117,4cyclictest6382-21gvfs-afc-volume12:29:347
242807299117,3cyclictest6382-21gvfs-afc-volume10:00:117
242807299117,3cyclictest1234-21snmpd12:09:167
242807299117,3cyclictest1234-21snmpd10:48:177
242807299117,3cyclictest1234-21snmpd10:48:177
242807299117,3cyclictest1234-21snmpd07:58:037
242807299116,4cyclictest6382-21gvfs-afc-volume12:01:317
242807299115,5cyclictest6382-21gvfs-afc-volume10:39:407
242807299115,5cyclictest6382-21gvfs-afc-volume10:17:377
242807299114,6cyclictest6382-21gvfs-afc-volume07:44:417
242806899119,2cyclictest2699307-21kworker/u16:0+events_unbound10:05:596
242806899119,2cyclictest2699307-21kworker/u16:0+events_unbound10:05:596
242806899119,2cyclictest2437558-21kworker/u16:3+flush-8:008:29:416
242806899119,2cyclictest2437558-21kworker/u16:3+events_unbound08:22:246
2428068991110,1cyclictest0-21swapper/607:28:076
242806899110,11cyclictest0-21swapper/608:07:136
242806699118,2cyclictest2633869-21kworker/u16:2+flush-8:009:34:135
2428066991110,1cyclictest2843656-21kworker/u16:2+events_unbound10:30:035
2428066991110,1cyclictest0-21swapper/508:06:595
2428066991110,1cyclictest0-21swapper/507:26:095
242806699110,11cyclictest0-21swapper/509:05:005
242806699110,0cyclictest0-21swapper/508:30:095
2428065991110,1cyclictest0-21swapper/408:19:564
242806599110,11cyclictest0-21swapper/409:05:114
242806599110,11cyclictest0-21swapper/407:45:154
242806599110,11cyclictest0-21swapper/407:29:484
242806599110,11cyclictest0-21swapper/407:23:204
242807299108,1cyclictest2662310-21diskmemload10:11:147
242807299108,1cyclictest0-21swapper/711:39:367
242807299107,2cyclictest0-21swapper/709:49:547
242807299106,3cyclictest1234-21snmpd08:19:287
242807299100,9cyclictest1234-21snmpd11:21:217
242806899108,2cyclictest86-21ksoftirqd/607:44:306
242806699109,1cyclictest0-21swapper/507:32:375
242806699108,2cyclictest3015210-21kworker/u16:4+flush-8:011:39:345
242806699107,3cyclictest2699307-21kworker/u16:0+flush-8:010:09:315
242806699106,3cyclictest2821906-21cat10:14:295
242806699104,5cyclictest6376-21gdbus10:38:525
242806599108,2cyclictest2567425-21kworker/u16:0+flush-8:008:43:404
242806599107,3cyclictest2633247-21kworker/u16:1+events_unbound08:54:314
242806599107,2cyclictest2374963-21kworker/u16:2+flush-8:007:24:244
242806599107,2cyclictest0-21swapper/407:09:344
242806599100,9cyclictest0-21swapper/408:34:314
242806599100,10cyclictest0-21swapper/409:03:554
24280729996,2cyclictest1234-21snmpd08:24:347
24280729996,2cyclictest0-21swapper/709:09:267
24280689998,1cyclictest0-21swapper/608:44:066
24280689998,1cyclictest0-21swapper/607:21:586
24280689995,3cyclictest2480842-21cat07:34:286
24280669996,2cyclictest3010382-21kthreadcore11:29:355
24280669994,4cyclictest3109201-21ntpq12:09:385
24280669994,4cyclictest2988161-21wc11:19:425
24280669993,5cyclictest5824-21gdbus08:00:195
24280669993,5cyclictest5824-21gdbus08:00:195
24280669990,8cyclictest0-21swapper/507:14:305
24280659997,1cyclictest0-21swapper/409:24:314
24280659997,1cyclictest0-21swapper/409:24:314
24280659997,1cyclictest0-21swapper/407:54:344
24280659995,3cyclictest2557792-21iptables08:14:314
24280669986,1cyclictest0-21swapper/511:14:275
24280669986,1cyclictest0-21swapper/509:34:325
24280669986,1cyclictest0-21swapper/509:09:335
24280669986,1cyclictest0-21swapper/508:19:345
24280669985,2cyclictest2846263-21ip_192.168.114.10:24:305
24280669984,3cyclictest2906735-21diskstats10:49:285
24280669984,3cyclictest2834051-21cat10:19:275
24280669984,3cyclictest2687309-21tr09:19:265
24280669983,4cyclictest3165883-21cut12:34:325
24280669983,4cyclictest3059389-21cut11:49:335
24280669983,4cyclictest2736654-21fw_packets09:39:285
24280669983,4cyclictest2638643-21cut08:54:335
24280669983,4cyclictest2629069-21cut08:49:355
24280669983,4cyclictest2609558-21cut08:39:345
24280669983,4cyclictest2603825-21proc_pri08:34:395
24280669983,4cyclictest2499439-21grep07:44:265
24280669983,2cyclictest991rcuop/712:24:325
24280669980,3cyclictest2548344-21irqcore08:09:305
24280659986,1cyclictest0-21swapper/408:44:324
24280659986,1cyclictest0-21swapper/408:44:324
24280669975,1cyclictest0-21swapper/511:09:275
24280669974,2cyclictest3016942-21kthreadcore11:34:315
24280669974,2cyclictest2796998-21cpuspeed_turbos10:04:265
24280669974,2cyclictest2796998-21cpuspeed_turbos10:04:265
24280669973,3cyclictest3065132-21sed11:54:295
24280669973,3cyclictest2991786-21expr11:24:265
24280669973,3cyclictest2918385-21grep10:54:255
24280669973,3cyclictest2894621-21tune2fs10:44:295
24280669973,3cyclictest2894621-21tune2fs10:44:295
24280669973,3cyclictest2883290-21kthreadcore10:39:295
24280669973,3cyclictest2700353-21irqcore09:24:295
24280669973,3cyclictest2700353-21irqcore09:24:295
24280669973,3cyclictest2576765-21cut08:24:285
24280669973,3cyclictest2480968-21sed07:34:295
24280669972,4cyclictest2519064-21tune2fs07:54:285
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional