You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 00:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Wed Dec 24, 2025 12:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
248992126554,8sleep50-21swapper/507:08:335
248982425747,7sleep40-21swapper/407:07:114
2490251994541,3cyclictest2707075-21fwupd08:59:056
248968424232,7sleep60-21swapper/607:05:136
2490255993933,5cyclictest2980557-21latency_hist11:19:117
24889552393,31sleep70-21swapper/707:04:427
2490255993835,2cyclictest2853918-21cat10:14:117
2490255993630,5cyclictest2804845-21latency_hist09:49:117
2490250993229,2cyclictest2610417-21kworker/u16:2+events_unbound08:09:145
2490255993130,0cyclictest0-21swapper/709:04:077
2490250993126,4cyclictest2707070-21packagekitd08:59:055
2490251993028,2cyclictest2951275-21kworker/u16:0+events_unbound11:33:106
2490251993028,2cyclictest1805809-21kworker/u16:3+events_unbound08:24:376
2490251992927,2cyclictest2706983-21kworker/u16:0+events_unbound09:10:216
2490251992826,2cyclictest2951276-21kworker/u16:4+events_unbound12:23:106
2490251992826,2cyclictest2951275-21kworker/u16:0+events_unbound12:34:096
2490251992826,2cyclictest2882795-21kworker/u16:2+events_unbound10:30:266
2490251992826,2cyclictest2745984-21kworker/u16:5+events_unbound09:43:096
2490251992826,2cyclictest2678116-21kworker/u16:3+events_unbound08:50:386
2490251992826,2cyclictest2678116-21kworker/u16:3+events_unbound08:50:386
2490251992826,2cyclictest2639670-21kworker/u16:1+events_unbound10:10:426
2490251992826,2cyclictest2562256-21kworker/u16:0+events_unbound08:03:466
2490250992826,2cyclictest2706983-21kworker/u16:0+events_unbound09:11:235
2490250992826,2cyclictest2541548-21kworker/u16:4+events_unbound07:35:225
2490245992826,2cyclictest2951275-21kworker/u16:0+events_unbound11:28:354
2490245992826,2cyclictest1805809-21kworker/u16:3+events_unbound08:09:114
2490255992722,4cyclictest650-21systemd-journal07:39:127
2490255992721,5cyclictest2513390-21latency_hist07:19:127
2490255992721,5cyclictest2513390-21latency_hist07:19:127
2490251992725,2cyclictest2951276-21kworker/u16:4+flush-8:011:43:096
2490251992725,2cyclictest2951276-21kworker/u16:4+events_unbound11:56:536
2490251992725,2cyclictest2863732-21kworker/u16:0+events_unbound10:48:076
2490251992725,2cyclictest2805234-21kworker/u16:2+events_unbound09:50:346
2490251992725,2cyclictest2659020-21kworker/u16:2+events_unbound08:47:506
2490255992623,2cyclictest3000166-21wc11:29:117
2490251992624,2cyclictest2991509-21kworker/u16:2+events_unbound11:27:096
2490251992624,2cyclictest2951276-21kworker/u16:4+events_unbound11:48:426
2490251992624,2cyclictest2863732-21kworker/u16:0+events_unbound10:22:356
2490251992624,2cyclictest2745918-21kworker/u16:4+flush-8:009:39:056
2490251992624,2cyclictest2639670-21kworker/u16:1+events_unbound09:02:476
2490250992624,2cyclictest3029518-21kworker/u16:2+flush-8:011:44:415
2490250992624,2cyclictest2706983-21kworker/u16:0+events_unbound09:05:395
2490250992624,2cyclictest2659020-21kworker/u16:2+flush-8:008:49:215
2490250992624,2cyclictest2659020-21kworker/u16:2+flush-8:008:49:215
2490245992624,2cyclictest2951276-21kworker/u16:4+flush-8:011:09:344
2490245992624,2cyclictest2951276-21kworker/u16:4+flush-8:011:09:344
2490255992524,0cyclictest0-21swapper/708:09:337
2490255992523,1cyclictest0-21swapper/712:09:327
249025599250,23cyclictest3106471-21latency_hist12:24:117
2490251992523,2cyclictest3029518-21kworker/u16:2+events_unbound12:02:296
2490251992523,2cyclictest2882795-21kworker/u16:2+events_unbound10:59:026
2490251992523,2cyclictest2863732-21kworker/u16:0+events_unbound10:52:576
2490251992523,2cyclictest2639670-21kworker/u16:1+events_unbound11:17:096
2490251992523,2cyclictest2552574-21kworker/u16:1+events_unbound07:51:316
2490251992523,2cyclictest2541548-21kworker/u16:4+events_unbound07:57:076
2490251992523,2cyclictest2513423-21kworker/u16:1+events_unbound07:21:266
2490251992523,2cyclictest1805809-21kworker/u16:3+events_unbound07:14:146
2490251992523,2cyclictest1805809-21kworker/u16:3+events_unbound07:14:146
2490251992522,2cyclictest2745918-21kworker/u16:4+events_unbound10:04:156
2490250992523,2cyclictest2541548-21kworker/u16:4+events_unbound07:52:225
2490245992522,2cyclictest2745918-21kworker/u16:4+events_unbound09:54:294
2490245992522,2cyclictest2639670-21kworker/u16:1+flush-8:008:30:064
2490245992522,2cyclictest2639670-21kworker/u16:1+events_unbound10:34:254
2490251992422,2cyclictest3097188-21kworker/u16:1+events_unbound12:38:546
2490251992422,2cyclictest2951275-21kworker/u16:0+events_unbound12:05:586
2490251992422,2cyclictest2951275-21kworker/u16:0+events_unbound11:51:466
2490251992422,2cyclictest2745918-21kworker/u16:4+flush-8:009:48:346
2490251992422,2cyclictest2745918-21kworker/u16:4+events_unbound10:17:346
2490251992422,2cyclictest2639670-21kworker/u16:1+events_unbound09:56:146
2490251992422,2cyclictest2610417-21kworker/u16:2+events_unbound08:20:336
2490251992422,2cyclictest1805809-21kworker/u16:3+events_unbound08:18:146
2490251992422,2cyclictest1805809-21kworker/u16:3+events_unbound07:31:596
2490251992422,2cyclictest1805809-21kworker/u16:3+events_unbound07:28:476
2490250992422,2cyclictest2951276-21kworker/u16:4+flush-8:012:14:335
2490250992422,2cyclictest2678116-21kworker/u16:3+flush-8:009:04:115
2490250992422,2cyclictest2659020-21kworker/u16:2+flush-8:009:15:525
2490251992321,2cyclictest2951276-21kworker/u16:4+events_unbound11:37:546
2490251992321,2cyclictest2745984-21kworker/u16:5+flush-8:009:17:026
2490251992321,2cyclictest2639670-21kworker/u16:1+events_unbound10:40:306
2490251992321,2cyclictest2639670-21kworker/u16:1+events_unbound10:39:026
2490251992321,2cyclictest2639670-21kworker/u16:1+events_unbound09:23:386
2490251992321,2cyclictest2639670-21kworker/u16:1+events_unbound08:36:426
2490251992321,2cyclictest1805809-21kworker/u16:3+events_unbound08:10:336
2490251992321,2cyclictest1805809-21kworker/u16:3+events_unbound08:07:116
2490250992321,2cyclictest2882795-21kworker/u16:2+events_unbound10:30:225
2490250992321,2cyclictest2863732-21kworker/u16:0+events_unbound10:46:385
2490250992320,2cyclictest2745918-21kworker/u16:4+flush-8:010:09:225
2490245992321,2cyclictest3097188-21kworker/u16:1+events_unbound12:34:404
2490245992320,2cyclictest2639670-21kworker/u16:1+flush-8:011:19:284
2490255992217,4cyclictest2707187-21latency_hist08:59:127
2490251992220,2cyclictest2951276-21kworker/u16:4+events_unbound12:12:456
2490251992220,2cyclictest2931961-21kworker/u16:3+flush-8:011:01:416
2490251992220,2cyclictest2706983-21kworker/u16:0+events_unbound09:04:506
2490251992220,2cyclictest2552574-21kworker/u16:1+events_unbound07:41:066
2490250992220,2cyclictest2639670-21kworker/u16:1+events_unbound10:04:335
2490250992220,2cyclictest2471664-21kworker/u16:0+flush-8:007:19:115
2490250992220,2cyclictest2471664-21kworker/u16:0+flush-8:007:19:115
2490245992220,2cyclictest2639670-21kworker/u16:1+events_unbound10:09:264
2490245992219,3cyclictest2882795-21kworker/u16:2+flush-8:010:29:404
2490245992218,3cyclictest1805809-21kworker/u16:3+flush-8:008:14:304
2490251992119,2cyclictest3107591-21kworker/u16:2+events_unbound12:26:146
2490251992119,2cyclictest2745918-21kworker/u16:4+events_unbound09:59:386
2490251992119,2cyclictest2745918-21kworker/u16:4+events_unbound09:26:266
2490251992119,2cyclictest2562256-21kworker/u16:0+flush-8:007:48:586
2490250992119,2cyclictest2882795-21kworker/u16:2+events_unbound10:36:225
2490250992119,2cyclictest2639670-21kworker/u16:1+flush-8:011:24:415
2490250992119,2cyclictest2639670-21kworker/u16:1+flush-8:008:39:075
2490250992119,2cyclictest1805809-21kworker/u16:3+flush-8:008:24:345
2490250992119,2cyclictest1805809-21kworker/u16:3+events_unbound08:31:145
2490250992119,2cyclictest1805809-21kworker/u16:3+events_unbound08:17:235
2490250992118,2cyclictest2951276-21kworker/u16:4+events_unbound12:24:135
2490250992118,2cyclictest2951275-21kworker/u16:0+flush-8:011:54:425
2490250992118,2cyclictest2639670-21kworker/u16:1+events_unbound10:24:215
2490245992119,2cyclictest2745918-21kworker/u16:4+events_unbound09:44:354
2490245992119,2cyclictest2552574-21kworker/u16:1+events_unbound07:49:364
2490245992119,2cyclictest2552574-21kworker/u16:1+events_unbound07:49:074
2490255992019,0cyclictest0-21swapper/711:44:317
2490251992018,2cyclictest2745984-21kworker/u16:5+events_unbound09:31:546
2490251992018,2cyclictest2659020-21kworker/u16:2+flush-8:008:39:586
2490251992018,2cyclictest2639670-21kworker/u16:1+events_unbound10:24:466
2490251992018,2cyclictest2639670-21kworker/u16:1+events_unbound08:31:576
2490250992018,2cyclictest2951275-21kworker/u16:0+events_unbound11:53:225
2490250992018,2cyclictest2882795-21kworker/u16:2+events_unbound10:40:425
2490250992018,2cyclictest2639670-21kworker/u16:1+events_unbound09:19:345
2490250992018,2cyclictest2552574-21kworker/u16:1+events_unbound07:54:335
2490250992018,2cyclictest1805809-21kworker/u16:3+events_unbound08:03:235
2490245992018,2cyclictest3107591-21kworker/u16:2+events_unbound12:29:414
2490245992017,3cyclictest2471664-21kworker/u16:0+flush-8:007:24:304
2490255991916,2cyclictest1267-21snmpd12:27:517
2490251991917,2cyclictest2951276-21kworker/u16:4+events_unbound11:05:336
2490251991917,2cyclictest2951275-21kworker/u16:0+flush-8:012:17:376
2490251991917,2cyclictest2639670-21kworker/u16:1+events_unbound11:13:146
2490251991917,2cyclictest2639670-21kworker/u16:1+events_unbound11:13:146
2490251991917,2cyclictest2487331-21kworker/u16:2+events_unbound07:12:346
2490250991917,2cyclictest3029518-21kworker/u16:2+events_unbound12:01:345
2490250991917,2cyclictest2951276-21kworker/u16:4+events_unbound11:17:225
2490250991917,2cyclictest2863732-21kworker/u16:0+events_unbound10:21:335
2490250991917,2cyclictest2745918-21kworker/u16:4+events_unbound09:49:145
2490250991917,2cyclictest2639670-21kworker/u16:1+events_unbound11:10:225
2490250991917,2cyclictest2639670-21kworker/u16:1+events_unbound11:10:225
2490250991917,2cyclictest2541548-21kworker/u16:4+events_unbound07:39:425
2490255991817,0cyclictest0-21swapper/710:04:257
2490251991816,2cyclictest1805809-21kworker/u16:3+flush-8:007:37:016
2490250991816,2cyclictest2951275-21kworker/u16:0+flush-8:012:19:595
2490250991816,2cyclictest2629670-21kworker/u16:0+events_unbound08:42:225
2490250991816,2cyclictest1805809-21kworker/u16:3+events_unbound07:32:225
2490245991815,2cyclictest1805809-21kworker/u16:3+events_unbound07:29:404
2490255991716,0cyclictest0-21swapper/711:04:217
2490255991716,0cyclictest0-21swapper/710:32:227
2490255991713,3cyclictest2696751-21cat08:49:407
2490255991713,3cyclictest2696751-21cat08:49:407
2490250991715,2cyclictest2882795-21kworker/u16:2+flush-8:010:56:215
2490250991715,2cyclictest2745984-21kworker/u16:5+events_unbound09:32:395
2490250991715,2cyclictest2659020-21kworker/u16:2+flush-8:008:48:225
2490250991715,2cyclictest2639670-21kworker/u16:1+events_unbound11:05:315
2490250991714,2cyclictest2562256-21kworker/u16:0+flush-8:008:04:325
2490245991715,2cyclictest3029518-21kworker/u16:2+flush-8:012:04:394
2490245991715,2cyclictest2951275-21kworker/u16:0+events_unbound12:24:384
2490245991715,2cyclictest2745984-21kworker/u16:5+flush-8:009:29:294
2490245991715,2cyclictest2745918-21kworker/u16:4+flush-8:009:16:104
2490245991715,2cyclictest2639670-21kworker/u16:1+events_unbound10:19:394
2490245991715,2cyclictest2639670-21kworker/u16:1+events_unbound09:24:114
2490245991715,2cyclictest2629670-21kworker/u16:0+flush-8:008:39:254
2490255991615,0cyclictest0-21swapper/709:04:197
2490255991614,1cyclictest0-21swapper/707:24:327
249025599160,15cyclictest1267-21snmpd11:34:137
2490251991614,2cyclictest2951276-21kworker/u16:4+events_unbound11:20:126
2490250991614,2cyclictest3097188-21kworker/u16:1+events_unbound12:37:225
2490250991614,2cyclictest2951275-21kworker/u16:0+events_unbound11:29:355
2490250991614,2cyclictest2745918-21kworker/u16:4+flush-8:009:36:215
2490250991614,2cyclictest2745918-21kworker/u16:4+events_unbound10:03:225
2490250991614,2cyclictest2745918-21kworker/u16:4+events_unbound09:41:275
2490250991614,2cyclictest2639670-21kworker/u16:1+events_unbound09:56:345
2490250991613,2cyclictest2745918-21kworker/u16:4+flush-8:010:14:155
2490245991614,2cyclictest2951276-21kworker/u16:4+flush-8:011:04:354
2490245991614,2cyclictest2951276-21kworker/u16:4+events_unbound11:44:344
2490245991614,2cyclictest2863732-21kworker/u16:0+flush-8:010:49:344
2490245991614,2cyclictest2552574-21kworker/u16:1+events_unbound07:54:254
2490245991613,2cyclictest2931961-21kworker/u16:3+flush-8:010:54:374
2490245991613,2cyclictest2745918-21kworker/u16:4+events_unbound09:24:274
2490245991613,2cyclictest2513423-21kworker/u16:1+events_unbound07:19:424
249025599159,5cyclictest2931738-21latency_hist10:54:127
249025599159,5cyclictest2523078-21latency_hist07:24:127
249025599157,7cyclictest6344-21gmain12:34:377
2490255991514,0cyclictest0-21swapper/708:30:157
2490255991514,0cyclictest0-21swapper/707:09:267
2490255991510,4cyclictest2921994-21latency_hist10:49:127
249025599150,7cyclictest1060-21runrttasks08:14:297
249025599150,13cyclictest0-21swapper/711:29:377
2490250991513,2cyclictest2951276-21kworker/u16:4+events_unbound12:10:225
2490250991513,2cyclictest2951275-21kworker/u16:0+events_unbound11:38:215
2490250991513,2cyclictest1805809-21kworker/u16:3+events_unbound08:19:325
2490245991513,2cyclictest2471664-21kworker/u16:0+events_unbound07:09:384
249025599148,5cyclictest2951197-21latency_hist11:04:117
249025599148,5cyclictest2571541-21latency_hist07:49:117
2490255991413,0cyclictest0-21swapper/708:34:387
2490255991412,1cyclictest0-21swapper/711:54:367
2490255991412,1cyclictest0-21swapper/711:09:397
2490255991412,1cyclictest0-21swapper/711:09:397
249025599140,1cyclictest0-21swapper/711:19:367
249025599140,1cyclictest0-21swapper/710:14:367
249025599140,1cyclictest0-21swapper/709:39:347
249025599140,1cyclictest0-21swapper/707:49:357
249025599140,13cyclictest1267-21snmpd10:38:397
249025599140,13cyclictest0-21swapper/710:54:367
2490250991412,2cyclictest3029518-21kworker/u16:2+flush-8:012:04:215
2490250991412,2cyclictest2745918-21kworker/u16:4+events_unbound09:49:085
2490250991412,2cyclictest2562256-21kworker/u16:0+events_unbound07:47:025
2490250991412,2cyclictest2487331-21kworker/u16:2+events_unbound07:10:235
2490250991412,2cyclictest2471664-21kworker/u16:0+events_unbound07:24:595
2490245991412,2cyclictest2951276-21kworker/u16:4+events_unbound12:09:374
249025599137,5cyclictest2818822-21kthreadcore09:54:317
249025599136,6cyclictest6344-21gmain09:29:257
2490255991312,0cyclictest0-21swapper/709:14:277
2490255991312,0cyclictest0-21swapper/708:04:417
2490255991311,1cyclictest0-21swapper/709:24:307
2490255991310,2cyclictest2833245-21ntpq09:59:387
2490255991310,2cyclictest2639679-21/usr/sbin/munin08:24:337
2490245991312,1cyclictest0-21swapper/408:11:324
2490245991312,1cyclictest0-21swapper/408:00:204
2490245991311,2cyclictest2882795-21kworker/u16:2+events_unbound10:39:354
2490245991311,2cyclictest2678116-21kworker/u16:3+flush-8:008:44:504
2490245991310,3cyclictest1805809-21kworker/u16:3+flush-8:007:34:364
249024599130,13cyclictest0-21swapper/411:58:244
249025599129,2cyclictest1267-21snmpd12:17:357
249025599128,3cyclictest2755097-21ntpq09:19:367
249025599128,3cyclictest1267-21snmpd12:31:277
249025599128,3cyclictest1267-21snmpd11:40:477
249025599128,3cyclictest1267-21snmpd08:48:227
249025599128,3cyclictest1267-21snmpd08:20:277
249025599128,3cyclictest1267-21snmpd08:00:537
249025599128,3cyclictest1267-21snmpd07:31:147
249025599126,5cyclictest6184-21gvfs-afc-volume12:04:287
249025599126,5cyclictest2806470-21kthreadcore09:49:307
2490255991211,0cyclictest0-21swapper/711:59:397
2490255991211,0cyclictest0-21swapper/708:39:287
249025599120,10cyclictest0-21swapper/707:54:377
2490250991210,2cyclictest3019575-21kworker/u16:1+events_unbound11:42:335
2490250991210,2cyclictest2639670-21kworker/u16:1+events_unbound10:49:395
2490245991210,2cyclictest2951276-21kworker/u16:4+flush-8:011:34:354
2490245991210,2cyclictest2951275-21kworker/u16:0+events_unbound11:29:394
249024599120,1cyclictest0-21swapper/410:19:044
249024599120,12cyclictest0-21swapper/412:23:184
249024599120,12cyclictest0-21swapper/408:36:554
249024599120,12cyclictest0-21swapper/407:16:594
249024599120,12cyclictest0-21swapper/407:16:594
249024599120,0cyclictest0-21swapper/409:14:074
626589110,1rtkit-daemon0-21swapper/410:44:184
249025599118,2cyclictest1267-21snmpd10:41:457
249025599117,3cyclictest1267-21snmpd10:21:217
249025599117,3cyclictest1267-21snmpd09:37:027
249025599117,3cyclictest1267-21snmpd07:40:567
249025599113,7cyclictest2736142-21runrttasks09:11:177
249025599110,10cyclictest2873640-21/usr/sbin/munin10:24:387
249025099119,2cyclictest2951275-21kworker/u16:0+flush-8:012:29:345
249025099119,2cyclictest2882795-21kworker/u16:2+events_unbound10:59:395
249025099110,11cyclictest0-21swapper/511:21:365
249024599119,2cyclictest2745984-21kworker/u16:5+events_unbound10:24:234
249024599119,2cyclictest2706983-21kworker/u16:0+flush-8:008:59:374
249024599119,2cyclictest2639670-21kworker/u16:1+events_unbound11:14:254
2490245991110,1cyclictest0-21swapper/411:50:024
2490245991110,1cyclictest0-21swapper/408:51:164
2490245991110,1cyclictest0-21swapper/408:51:164
2490245991110,1cyclictest0-21swapper/408:22:434
249024599110,0cyclictest0-21swapper/409:36:404
249025599107,2cyclictest0-21swapper/711:49:387
249025099109,1cyclictest0-21swapper/507:20:525
249024599109,1cyclictest0-21swapper/410:04:534
249024599108,2cyclictest3019575-21kworker/u16:1+flush-8:011:39:374
249024599108,2cyclictest2552574-21kworker/u16:1+events_unbound07:39:344
24902509997,2cyclictest2745984-21kworker/u16:5+events_unbound09:25:045
24902459998,1cyclictest0-21swapper/408:25:244
24902459997,2cyclictest2639670-21kworker/u16:1+flush-8:009:04:374
24902459995,3cyclictest2805742-21df09:49:254
24902459994,4cyclictest3066910-21ntp_states11:59:364
24902459987,1cyclictest0-21swapper/411:02:264
24902459986,1cyclictest0-21swapper/409:39:304
24902459983,4cyclictest3089844-21cut12:14:284
24902459983,4cyclictest2698609-21iostat_ios08:54:304
24902459976,1cyclictest0-21swapper/409:59:124
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional