You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-05 - 11:17
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Sat Sep 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
252317325848,7sleep50-21swapper/519:06:015
252332525622,29sleep70-21swapper/719:08:117
2523694994941,7cyclictest2894899-21kworker/u16:5+flush-8:022:39:226
2523694994845,2cyclictest2566775-21kworker/u16:1+flush-8:020:19:226
31382762470,0chrt3138274-21ssh23:43:447
2523692994341,2cyclictest2894899-21kworker/u16:5+events_unbound22:29:415
2523692994341,2cyclictest2882788-21kworker/u16:4+flush-8:022:14:225
2523697994239,2cyclictest3078963-21hddtemp_smartct23:19:377
2523692994240,2cyclictest2882788-21kworker/u16:4+flush-8:022:19:385
2523688994240,2cyclictest2484632-21kworker/u16:5+flush-8:019:14:234
2523694994138,2cyclictest3175696-21kworker/u16:1+flush-8:000:19:226
252314024130,7sleep40-21swapper/419:05:354
252369799400,38cyclictest3102168-21date23:29:227
2523692994037,2cyclictest3102169-21kworker/u16:2+events_unbound23:34:525
2523688994037,2cyclictest2547329-21kworker/u16:0+flush-8:019:34:224
2523692993937,2cyclictest2808554-21kworker/u16:2+events_unbound21:30:345
252310323929,7sleep60-21swapper/619:05:056
252369799380,36cyclictest2614987-21sleep19:54:227
2523694993836,2cyclictest2882788-21kworker/u16:4+flush-8:023:04:176
2523692993836,2cyclictest2821653-21kworker/u16:3+events_unbound21:36:145
2523692993835,2cyclictest3175696-21kworker/u16:1+events_unbound00:19:455
2523692993835,2cyclictest2894899-21kworker/u16:5+events_unbound22:39:245
2523688993836,2cyclictest3029063-21kworker/u16:5+flush-8:000:24:224
2523697993731,5cyclictest2870371-21latency_hist21:54:227
2523697993731,5cyclictest2870371-21latency_hist21:54:227
2523694993735,2cyclictest2566775-21kworker/u16:1+flush-8:021:49:226
2523692993735,2cyclictest2566775-21kworker/u16:1+events_unbound21:25:145
252369799360,34cyclictest2576228-21sed19:34:227
2523694993633,2cyclictest2449629-21kworker/u16:3+flush-8:019:19:236
2523692993634,2cyclictest3152141-21kworker/u16:3+events_unbound23:57:105
2523692993634,2cyclictest2882788-21kworker/u16:4+events_unbound23:05:585
2523692993634,2cyclictest2821653-21kworker/u16:3+events_unbound21:57:055
2523692993634,2cyclictest2808554-21kworker/u16:2+flush-8:022:01:535
2523692993634,2cyclictest2751424-21kworker/u16:3+flush-8:021:14:575
2523692993633,2cyclictest3211867-21kworker/u16:2+events_unbound00:29:295
2523694993533,2cyclictest3211867-21kworker/u16:2+flush-8:000:29:376
2523692993533,2cyclictest3016668-21kworker/u16:0+events_unbound23:49:535
2523692993533,2cyclictest3016668-21kworker/u16:0+events_unbound23:49:535
2523692993533,2cyclictest2821653-21kworker/u16:3+flush-8:021:40:335
2523692993533,2cyclictest2566775-21kworker/u16:1+events_unbound21:48:025
2523697993428,5cyclictest2566397-21latency_hist19:29:227
2523694993431,2cyclictest2692916-21kworker/u16:4+flush-8:021:09:426
2523694993431,2cyclictest2547329-21kworker/u16:0+flush-8:019:39:466
2523694993431,2cyclictest2547329-21kworker/u16:0+flush-8:019:39:466
2523692993432,2cyclictest3102169-21kworker/u16:2+events_unbound23:43:415
2523692993432,2cyclictest3029063-21kworker/u16:5+events_unbound23:47:105
2523692993432,2cyclictest3029063-21kworker/u16:5+events_unbound00:03:065
2523692993432,2cyclictest3017099-21kworker/u16:1+events_unbound23:04:095
2523692993432,2cyclictest2894899-21kworker/u16:5+events_unbound22:27:385
2523692993432,2cyclictest2882788-21kworker/u16:4+flush-8:023:14:505
2523692993432,2cyclictest2882788-21kworker/u16:4+events_unbound23:32:025
2523692993432,2cyclictest2821653-21kworker/u16:3+flush-8:021:52:105
2523692993432,2cyclictest2821653-21kworker/u16:3+flush-8:021:52:105
2523692993432,2cyclictest2808554-21kworker/u16:2+events_unbound22:34:425
2523692993331,2cyclictest3029063-21kworker/u16:5+flush-8:023:25:255
2523692993331,2cyclictest3017099-21kworker/u16:1+flush-8:023:12:025
2523692993331,2cyclictest3017099-21kworker/u16:1+flush-8:023:12:025
2523692993331,2cyclictest2808554-21kworker/u16:2+flush-8:022:51:535
2523692993331,2cyclictest2808554-21kworker/u16:2+events_unbound22:15:495
2523692993331,2cyclictest2566775-21kworker/u16:1+events_unbound20:47:345
2523692993330,2cyclictest3029063-21kworker/u16:5+flush-8:000:04:255
2523694993230,2cyclictest2547329-21kworker/u16:0+flush-8:019:34:376
2523692993230,2cyclictest3211867-21kworker/u16:2+events_unbound00:18:385
2523692993230,2cyclictest3175696-21kworker/u16:1+events_unbound00:27:025
2523692993230,2cyclictest3017099-21kworker/u16:1+flush-8:023:23:175
2523692993229,2cyclictest2882788-21kworker/u16:4+events_unbound22:04:255
2523688993229,2cyclictest2614988-21kworker/u16:0+flush-8:020:09:234
2523697993126,4cyclictest648-21systemd-journal22:24:217
2523694993129,2cyclictest3016668-21kworker/u16:0+flush-8:000:05:136
2523694993128,2cyclictest3029063-21kworker/u16:5+events_unbound23:24:386
2523692993129,2cyclictest3260355-21kworker/u16:4+events_unbound00:37:405
2523692993129,2cyclictest3016668-21kworker/u16:0+events_unbound00:11:095
2523692993129,2cyclictest2955882-21kworker/u16:3+events_unbound22:58:465
2523692993129,2cyclictest2882788-21kworker/u16:4+events_unbound22:48:175
2523692993028,2cyclictest2751424-21kworker/u16:3+events_unbound21:10:175
2523692993028,2cyclictest2566775-21kworker/u16:1+events_unbound21:21:115
2523694992927,2cyclictest2882788-21kworker/u16:4+events_unbound23:15:056
2523694992927,2cyclictest2566775-21kworker/u16:1+events_unbound21:04:376
2523694992927,2cyclictest2566775-21kworker/u16:1+events_unbound20:04:376
2523694992926,2cyclictest2566775-21kworker/u16:1+flush-8:020:49:226
2523692992927,2cyclictest2547329-21kworker/u16:0+events_unbound19:36:345
2523688992926,2cyclictest2894899-21kworker/u16:5+flush-8:022:24:344
2523697992822,5cyclictest2546942-21latency_hist19:19:237
2523694992822,6cyclictest2894899-21kworker/u16:5+events_unbound22:29:576
2523692992825,2cyclictest2614988-21kworker/u16:0+events_unbound20:49:305
2523688992826,2cyclictest3248911-21kworker/u16:6+events_unbound00:33:354
2523697992625,0cyclictest0-21swapper/721:14:357
252369799260,24cyclictest3026184-21xargs22:54:537
2523692992624,2cyclictest2614988-21kworker/u16:0+flush-8:020:29:235
2523688992624,2cyclictest2751424-21kworker/u16:3+flush-8:021:14:534
2523688992623,2cyclictest2449629-21kworker/u16:3+events_unbound19:14:254
2523697992520,4cyclictest2931378-21latency_hist22:19:237
2523694992523,2cyclictest3029063-21kworker/u16:5+flush-8:023:44:376
2523692992523,2cyclictest2566775-21kworker/u16:1+events_unbound20:58:335
2523692992523,2cyclictest2449629-21kworker/u16:3+events_unbound19:10:585
2523688992521,3cyclictest2955882-21kworker/u16:3+flush-8:022:49:374
28405752240,1chrt0-21swapper/421:39:434
2523697992422,1cyclictest2809488-21munin-plugin-st21:29:227
2523697992422,1cyclictest0-21swapper/720:24:377
2523694992422,2cyclictest2955882-21kworker/u16:3+events_unbound22:45:336
2523694992422,2cyclictest2821653-21kworker/u16:3+events_unbound21:40:306
2523694992421,2cyclictest2808554-21kworker/u16:2+events_unbound21:54:506
2523697992321,1cyclictest3054640-21sh23:09:377
2523697992321,1cyclictest3054640-21sh23:09:377
2523694992321,2cyclictest3029063-21kworker/u16:5+flush-8:023:09:416
2523694992321,2cyclictest3029063-21kworker/u16:5+flush-8:023:09:416
2523694992321,2cyclictest2566775-21kworker/u16:1+flush-8:021:19:346
2523694992319,3cyclictest2692916-21kworker/u16:4+events_unbound20:54:426
2523692992321,2cyclictest2484632-21kworker/u16:5+flush-8:019:20:575
2523694992220,2cyclictest3102169-21kworker/u16:2+events_unbound23:51:506
2523694992220,2cyclictest3102169-21kworker/u16:2+events_unbound23:51:506
2523694992220,2cyclictest2655955-21kworker/u16:2+flush-8:020:29:176
2523694992219,2cyclictest2882788-21kworker/u16:4+flush-8:022:19:326
2523692992220,2cyclictest2644267-21kworker/u16:4+events_unbound20:11:025
2523688992220,2cyclictest3029063-21kworker/u16:5+flush-8:023:09:524
2523688992220,2cyclictest3029063-21kworker/u16:5+flush-8:023:09:524
2523688992219,2cyclictest2808554-21kworker/u16:2+events_unbound21:29:374
252369799210,19cyclictest2831115-21cat21:34:547
2523694992119,2cyclictest3029063-21kworker/u16:5+flush-8:023:59:326
2523694992119,2cyclictest2692916-21kworker/u16:4+events_unbound21:16:146
2523688992118,2cyclictest2955882-21kworker/u16:3+flush-8:022:59:174
2523694992018,2cyclictest2566775-21kworker/u16:1+flush-8:021:26:346
2523694992018,2cyclictest2484632-21kworker/u16:5+events_unbound19:24:356
2523694992017,2cyclictest3102169-21kworker/u16:2+events_unbound23:39:256
2523694992016,3cyclictest2808554-21kworker/u16:2+events_unbound22:06:396
2523692992018,2cyclictest2614988-21kworker/u16:0+events_unbound21:00:245
2523688992018,2cyclictest2882788-21kworker/u16:4+flush-8:023:15:134
2523688992017,2cyclictest2808554-21kworker/u16:2+flush-8:021:44:234
2523697991918,0cyclictest0-21swapper/720:29:427
2523694991917,2cyclictest3175696-21kworker/u16:1+flush-8:000:35:126
2523694991917,2cyclictest2808554-21kworker/u16:2+events_unbound21:59:356
2523694991917,2cyclictest2575120-21kworker/u16:2+flush-8:019:49:176
2523694991916,2cyclictest2882788-21kworker/u16:4+flush-8:022:54:376
2523692991917,2cyclictest2614988-21kworker/u16:0+events_unbound20:01:335
2523697991816,1cyclictest0-21swapper/719:39:467
2523697991816,1cyclictest0-21swapper/719:39:467
2523697991811,5cyclictest648-21systemd-journal00:39:217
2523694991815,2cyclictest2808554-21kworker/u16:2+flush-8:021:29:436
2523694991812,6cyclictest2566775-21kworker/u16:1+events_unbound21:38:496
2523694991811,6cyclictest2882788-21kworker/u16:4+flush-8:023:30:066
2523692991816,2cyclictest2566775-21kworker/u16:1+events_unbound20:08:575
2523692991816,2cyclictest2449629-21kworker/u16:3+flush-8:019:26:455
2523692991815,2cyclictest2682081-21kworker/u16:3+flush-8:020:34:335
2523688991816,2cyclictest2692916-21kworker/u16:4+flush-8:020:54:224
2523697991716,0cyclictest0-21swapper/720:04:417
2523697991714,2cyclictest5701-21gnome-shell20:51:327
2523694991715,2cyclictest3175696-21kworker/u16:1+events_unbound00:20:026
2523694991715,2cyclictest2894899-21kworker/u16:5+events_unbound22:39:496
2523694991715,2cyclictest2566775-21kworker/u16:1+events_unbound19:59:466
2523692991715,2cyclictest2614988-21kworker/u16:0+events_unbound20:26:345
2523692991715,2cyclictest2566775-21kworker/u16:1+flush-8:019:54:325
2523688991715,2cyclictest2932625-21kworker/u16:0+events_unbound22:24:174
2523688991715,2cyclictest2882788-21kworker/u16:4+events_unbound22:09:374
2523688991715,2cyclictest2449629-21kworker/u16:3+flush-8:019:59:184
2523697991614,1cyclictest0-21swapper/722:49:487
2523697991611,4cyclictest2653875-21latency_hist20:14:227
2523697991610,5cyclictest2721833-21latency_hist20:49:237
2523694991613,2cyclictest3102169-21kworker/u16:2+events_unbound23:34:426
2523692991614,2cyclictest2575120-21kworker/u16:2+events_unbound19:41:355
2523692991614,2cyclictest2575120-21kworker/u16:2+events_unbound19:41:355
2523692991614,2cyclictest2566775-21kworker/u16:1+events_unbound20:43:325
2523692991613,2cyclictest2566775-21kworker/u16:1+flush-8:020:19:325
2523697991513,1cyclictest2990965-21ssh22:41:507
2523697991513,1cyclictest0-21swapper/720:59:467
2523694991513,2cyclictest3175696-21kworker/u16:1+flush-8:000:09:326
2523694991513,2cyclictest3017099-21kworker/u16:1+events_unbound23:04:246
2523694991513,2cyclictest2566775-21kworker/u16:1+flush-8:019:49:486
252369499150,1cyclictest0-21swapper/622:14:306
2523692991513,2cyclictest2566775-21kworker/u16:1+flush-8:019:29:385
2523688991514,1cyclictest0-21swapper/400:36:284
2523688991513,2cyclictest3175696-21kworker/u16:1+flush-8:000:14:384
252368899150,1cyclictest0-21swapper/423:01:064
252368899150,14cyclictest0-21swapper/423:44:274
252369799146,7cyclictest5994-21gmain21:09:457
2523697991413,0cyclictest0-21swapper/723:52:157
2523697991413,0cyclictest0-21swapper/723:52:157
2523697991411,2cyclictest0-21swapper/723:54:497
2523697991411,2cyclictest0-21swapper/722:09:237
252369799140,1cyclictest0-21swapper/719:54:457
2523694991412,2cyclictest2566775-21kworker/u16:1+flush-8:020:49:496
252369499140,14cyclictest0-21swapper/623:55:146
252369499140,14cyclictest0-21swapper/622:26:486
2523692991412,2cyclictest2484632-21kworker/u16:5+events_unbound19:15:325
2523688991413,1cyclictest0-21swapper/423:20:584
2523688991413,1cyclictest0-21swapper/422:44:424
2523688991413,1cyclictest0-21swapper/422:17:354
2523688991413,1cyclictest0-21swapper/422:06:334
2523688991413,1cyclictest0-21swapper/422:03:144
2523688991413,1cyclictest0-21swapper/421:56:374
2523688991413,1cyclictest0-21swapper/400:10:184
252368899140,1cyclictest0-21swapper/421:36:364
252368899140,1cyclictest0-21swapper/400:25:364
252369799139,3cyclictest1277-21snmpd00:22:437
2523697991312,0cyclictest0-21swapper/719:47:387
2523697991312,0cyclictest0-21swapper/719:36:267
2523697991310,2cyclictest1277-21snmpd00:11:557
2523697991310,2cyclictest0-21swapper/723:14:537
252369799130,2cyclictest3111143-21ntpq23:29:477
252369799130,11cyclictest3042457-21cat23:04:377
252369499130,13cyclictest0-21swapper/622:12:276
2523692991310,2cyclictest2750760-21kworker/u16:2+flush-8:021:04:225
2523688991312,1cyclictest0-21swapper/423:50:554
2523688991312,1cyclictest0-21swapper/423:50:554
2523688991312,1cyclictest0-21swapper/423:37:594
2523688991312,1cyclictest0-21swapper/421:28:144
2523688991312,1cyclictest0-21swapper/421:10:164
2523688991312,1cyclictest0-21swapper/419:25:074
2523688991312,1cyclictest0-21swapper/400:07:284
252369799129,2cyclictest1277-21snmpd00:26:017
252369799128,3cyclictest1277-21snmpd20:20:437
252369799128,3cyclictest1277-21snmpd19:20:577
252369799127,4cyclictest2846014-21latency_hist21:44:227
2523697991211,0cyclictest0-21swapper/721:04:347
2523697991210,1cyclictest0-21swapper/722:29:527
2523697991210,1cyclictest0-21swapper/700:29:377
252369799120,2cyclictest3039810-21ssh23:01:507
252369799120,2cyclictest2892593-21crond22:00:217
252369799120,2cyclictest2882244-21ssh21:58:457
252369799120,2cyclictest2796518-21ssh21:22:577
252369799120,2cyclictest1065-21runrttasks19:10:587
252369799120,10cyclictest2847470-21sed21:44:387
2523694991211,1cyclictest0-21swapper/623:22:276
252369499120,1cyclictest0-21swapper/619:56:156
252369499120,12cyclictest0-21swapper/620:13:076
252369499120,0cyclictest0-21swapper/620:32:306
252368899128,3cyclictest2586988-21cat19:39:374
252368899128,3cyclictest2586988-21cat19:39:374
2523688991211,1cyclictest0-21swapper/423:31:314
2523688991211,1cyclictest0-21swapper/423:06:464
2523688991210,2cyclictest3175696-21kworker/u16:1+flush-8:023:59:504
252368899120,1cyclictest0-21swapper/420:26:464
252368899120,1cyclictest0-21swapper/420:20:184
252368899120,1cyclictest0-21swapper/420:13:034
252368899120,12cyclictest0-21swapper/422:39:204
252369799118,2cyclictest1277-21snmpd23:35:097
252369799118,2cyclictest1277-21snmpd21:30:247
252369799117,3cyclictest1277-21snmpd20:38:147
252369799117,3cyclictest1277-21snmpd00:04:257
252369799116,4cyclictest2993638-21cat22:44:377
2523697991111,0cyclictest0-21swapper/720:55:257
252369799110,3cyclictest3222183-21sh00:15:527
252369799110,3cyclictest3179587-21kthreadcore23:59:417
252369799110,2cyclictest2634377-21sshd-session20:03:567
252369799110,1cyclictest3148603-21ssh23:45:177
252369799110,1cyclictest2954303-21ssh22:26:447
252369799110,10cyclictest2977936-21ssh22:35:217
252369799110,10cyclictest2905690-21ssh22:06:597
252369499119,2cyclictest2808554-21kworker/u16:2+flush-8:022:52:456
252369499118,2cyclictest0-21swapper/620:19:356
252369499110,4cyclictest2553955-21cut19:19:436
252369299119,2cyclictest2575120-21kworker/u16:2+events_unbound19:44:525
252369299110,11cyclictest0-21swapper/519:50:395
252368899119,2cyclictest2655955-21kworker/u16:2+events_unbound20:14:414
252368899118,2cyclictest2655955-21kworker/u16:2+flush-8:020:30:294
2523688991110,1cyclictest0-21swapper/421:22:244
252368899110,11cyclictest0-21swapper/419:50:584
252368899110,0cyclictest0-21swapper/421:02:234
252368899110,0cyclictest0-21swapper/419:44:594
252369799107,2cyclictest869-21systemd-oomd20:14:477
252369799105,4cyclictest2711842-21seq20:40:177
252369499109,1cyclictest0-21swapper/600:26:466
252369499100,3cyclictest2568380-21kthreadcore19:29:386
252368899109,1cyclictest0-21swapper/421:09:004
252368899109,1cyclictest0-21swapper/420:46:094
252368899108,2cyclictest3029063-21kworker/u16:5+flush-8:023:24:274
252368899105,1cyclictest0-21swapper/420:34:384
252368899100,10cyclictest0-21swapper/419:34:374
25236949990,8cyclictest0-21swapper/620:59:376
25236949990,2cyclictest2702805-21/usr/sbin/munin20:39:356
25236929996,3cyclictest2614988-21kworker/u16:0+flush-8:020:14:485
25236889998,1cyclictest0-21swapper/423:57:234
25236889998,1cyclictest0-21swapper/421:53:184
25236889998,1cyclictest0-21swapper/421:53:184
25236889998,1cyclictest0-21swapper/419:59:484
25236889990,1cyclictest0-21swapper/420:43:064
25236949987,1cyclictest0-21swapper/621:51:486
25236949987,1cyclictest0-21swapper/621:51:486
25236949986,2cyclictest86-21ksoftirqd/620:34:396
25236889987,1cyclictest0-21swapper/423:40:494
25236889986,1cyclictest0-21swapper/420:54:364
25236949975,1cyclictest0-21swapper/619:09:386
25236889973,3cyclictest2547717-21cat19:19:354
25236889973,3cyclictest1-21systemd22:44:224
25236889965,1cyclictest0-21swapper/422:31:094
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional