You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 11:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Mon Jul 20, 2026 00:43:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
310618825848,7sleep50-21swapper/519:08:125
310625525520,30sleep70-21swapper/719:09:107
310621424937,8sleep40-21swapper/419:08:354
3106576994240,2cyclictest3314483-21kworker/u16:0+events_unbound21:30:094
3106576994037,2cyclictest3600070-21kworker/u16:1+events_unbound23:44:384
3106582993836,2cyclictest3733012-21kworker/u16:0+events_unbound23:52:545
3106582993835,2cyclictest3514494-21cat22:19:305
3106576993835,3cyclictest3758588-21kworker/u16:4+events_unbound00:38:094
3106584993735,2cyclictest3539347-21kworker/u16:2+events_unbound22:55:496
3106582993735,2cyclictest3366988-21kworker/u16:2+events_unbound21:47:135
3106584993634,2cyclictest3587038-21kworker/u16:0+events_unbound23:05:496
3106582993634,2cyclictest3380323-21kworker/u16:5+events_unbound22:43:145
3106582993634,2cyclictest3380323-21kworker/u16:5+events_unbound22:43:145
3106576993634,2cyclictest3758116-21kworker/u16:2+events_unbound00:31:094
3106576993634,2cyclictest3648769-21kworker/u16:3+events_unbound23:34:094
3106576993634,2cyclictest3539347-21kworker/u16:2+events_unbound23:15:504
3106576993634,2cyclictest3425930-21kworker/u16:0+events_unbound21:46:264
3106576993634,2cyclictest3380323-21kworker/u16:5+events_unbound22:40:554
3106576993634,2cyclictest3380323-21kworker/u16:5+events_unbound22:40:554
3106576993634,2cyclictest3380323-21kworker/u16:5+events_unbound22:04:174
3106584993533,2cyclictest3600070-21kworker/u16:1+events_unbound23:03:106
3106584993533,2cyclictest3380323-21kworker/u16:5+events_unbound22:03:186
3106584993529,2cyclictest3648769-21kworker/u16:3+events_unbound00:23:376
3106582993533,2cyclictest3758116-21kworker/u16:2+events_unbound00:38:135
3106582993533,2cyclictest3539347-21kworker/u16:2+events_unbound23:11:055
3106582993533,2cyclictest3380323-21kworker/u16:5+events_unbound22:30:185
3106582993533,2cyclictest3314483-21kworker/u16:0+events_unbound21:31:585
3106582993533,2cyclictest3265942-21kworker/u16:3+events_unbound21:26:425
3106576993533,2cyclictest3600070-21kworker/u16:1+events_unbound23:04:344
3106576993533,2cyclictest3453659-21kworker/u16:1+events_unbound22:22:024
3106576993533,2cyclictest3425930-21kworker/u16:0+events_unbound21:58:154
3106576993533,2cyclictest3366988-21kworker/u16:2+events_unbound21:37:424
3106584993432,2cyclictest3587038-21kworker/u16:0+events_unbound23:26:496
3106584993432,2cyclictest3587038-21kworker/u16:0+events_unbound22:51:426
3106584993432,2cyclictest3539347-21kworker/u16:2+events_unbound22:38:256
3106584993432,2cyclictest3539347-21kworker/u16:2+events_unbound22:38:256
3106584993432,2cyclictest3425930-21kworker/u16:0+events_unbound21:48:376
3106582993432,2cyclictest3758116-21kworker/u16:2+events_unbound00:08:345
3106582993432,2cyclictest3600070-21kworker/u16:1+events_unbound23:55:585
3106582993429,4cyclictest3343294-21latency_hist21:09:365
3106576993432,2cyclictest3758588-21kworker/u16:4+events_unbound00:04:094
3106576993432,2cyclictest3648769-21kworker/u16:3+events_unbound23:44:264
3106576993432,2cyclictest3600070-21kworker/u16:1+events_unbound23:25:544
3106576993432,2cyclictest3478083-21kworker/u16:3+events_unbound22:16:384
3106576993432,2cyclictest3380323-21kworker/u16:5+events_unbound22:39:024
3106576993432,2cyclictest3380323-21kworker/u16:5+events_unbound22:39:024
310608323424,7sleep60-21swapper/619:06:456
3106584993331,2cyclictest3758116-21kworker/u16:2+events_unbound00:08:296
3106584993331,2cyclictest3265942-21kworker/u16:3+events_unbound21:26:226
3106582993331,2cyclictest3758116-21kworker/u16:2+events_unbound00:20:305
3106582993331,2cyclictest3648769-21kworker/u16:3+events_unbound23:42:415
3106582993331,2cyclictest3600070-21kworker/u16:1+events_unbound23:45:335
3106582993331,2cyclictest3380323-21kworker/u16:5+events_unbound21:41:175
3106582993331,2cyclictest3265942-21kworker/u16:3+events_unbound21:37:385
3106576993331,2cyclictest3758588-21kworker/u16:4+events_unbound00:22:334
3106576993331,2cyclictest3733012-21kworker/u16:0+events_unbound23:56:414
3106576993331,2cyclictest3648769-21kworker/u16:3+events_unbound23:21:504
3106576993331,2cyclictest3648769-21kworker/u16:3+events_unbound00:13:224
3106576993331,2cyclictest3600070-21kworker/u16:1+events_unbound23:10:384
3106576993331,2cyclictest3600070-21kworker/u16:1+events_unbound23:06:064
3106576993331,2cyclictest3587038-21kworker/u16:0+events_unbound22:52:534
3106576993331,2cyclictest3380323-21kworker/u16:5+events_unbound22:14:214
3106576993331,2cyclictest3380323-21kworker/u16:5+events_unbound21:53:554
3106576993331,2cyclictest3366988-21kworker/u16:2+events_unbound22:07:214
3106576993331,2cyclictest3235559-21kworker/u16:1+events_unbound21:22:474
3106584993230,2cyclictest3587038-21kworker/u16:0+events_unbound22:48:416
3106576993230,2cyclictest3758116-21kworker/u16:2+events_unbound00:15:094
3106576993230,2cyclictest3600070-21kworker/u16:1+events_unbound23:37:464
3106576993230,2cyclictest3539347-21kworker/u16:2+events_unbound22:58:374
3106576993230,2cyclictest3478083-21kworker/u16:3+events_unbound22:31:154
3106576993230,2cyclictest3453659-21kworker/u16:1+events_unbound22:28:584
3106576993230,2cyclictest3343723-21kworker/u16:4+events_unbound21:17:504
3106588993125,5cyclictest648-21systemd-journal22:04:357
3106584993129,2cyclictest3733012-21kworker/u16:0+events_unbound23:56:066
3106584993129,2cyclictest3453659-21kworker/u16:1+events_unbound22:18:176
3106582993129,2cyclictest3758116-21kworker/u16:2+events_unbound00:12:255
3106582993129,2cyclictest3539347-21kworker/u16:2+events_unbound22:53:225
3106582993129,2cyclictest3380323-21kworker/u16:5+events_unbound22:45:335
3106582993129,2cyclictest3116508-21kworker/u16:2+events_unbound19:27:155
3106576993129,2cyclictest3380323-21kworker/u16:5+events_unbound22:47:264
3106576993129,2cyclictest3380323-21kworker/u16:5+events_unbound21:42:184
3106576993129,2cyclictest3380323-21kworker/u16:5+events_unbound21:27:074
3106576993129,2cyclictest3116508-21kworker/u16:2+events_unbound20:30:464
3106584993028,2cyclictest3758116-21kworker/u16:2+events_unbound00:18:426
3106584993028,2cyclictest3425930-21kworker/u16:0+events_unbound21:49:456
3106584993028,2cyclictest3235559-21kworker/u16:1+events_unbound21:04:466
3106582993028,2cyclictest3758116-21kworker/u16:2+events_unbound00:33:415
3106582993028,2cyclictest3425930-21kworker/u16:0+events_unbound21:55:535
3106582993027,2cyclictest3138922-21kworker/u16:1+flush-8:019:59:385
3106576993028,2cyclictest3758116-21kworker/u16:2+events_unbound00:25:504
3106584992927,2cyclictest3758116-21kworker/u16:2+events_unbound00:00:206
3106584992927,2cyclictest3648769-21kworker/u16:3+events_unbound23:22:086
3106584992927,2cyclictest3380323-21kworker/u16:5+events_unbound22:05:256
3106584992927,2cyclictest3116508-21kworker/u16:2+events_unbound19:56:466
3106582992927,2cyclictest3453659-21kworker/u16:1+events_unbound22:27:015
3106582992927,2cyclictest3265942-21kworker/u16:3+events_unbound21:14:295
3106582992927,2cyclictest3235559-21kworker/u16:1+events_unbound20:50:465
3106576992927,2cyclictest3648769-21kworker/u16:3+events_unbound00:07:224
3106576992927,2cyclictest3600070-21kworker/u16:1+events_unbound23:54:054
3106576992927,2cyclictest3116508-21kworker/u16:2+flush-8:019:20:084
3106576992926,2cyclictest3235559-21kworker/u16:1+events_unbound20:24:454
3106584992826,2cyclictest3733012-21kworker/u16:0+events_unbound23:50:536
3106584992826,2cyclictest3648769-21kworker/u16:3+events_unbound23:45:096
3106584992826,2cyclictest3648769-21kworker/u16:3+events_unbound23:35:176
3106584992826,2cyclictest3648769-21kworker/u16:3+events_unbound00:24:366
3106584992826,2cyclictest3453659-21kworker/u16:1+events_unbound22:12:086
3106584992826,2cyclictest3186909-21kworker/u16:4+events_unbound20:00:466
3106582992826,2cyclictest3648769-21kworker/u16:3+events_unbound23:33:495
3106582992826,2cyclictest3587038-21kworker/u16:0+events_unbound23:03:575
3106582992826,2cyclictest3539347-21kworker/u16:2+events_unbound22:55:335
3106582992826,2cyclictest3380323-21kworker/u16:5+flush-8:022:00:295
3106582992826,2cyclictest3366988-21kworker/u16:2+events_unbound22:08:255
3106576992826,2cyclictest3235559-21kworker/u16:1+flush-8:020:54:454
3106576992826,2cyclictest3216760-21kworker/u16:0+events_unbound20:20:464
38549362270,1chrt3854937-21ssh00:38:037
3106584992725,2cyclictest3600070-21kworker/u16:1+events_unbound23:30:496
3106584992725,2cyclictest3600070-21kworker/u16:1+events_unbound23:12:356
3106584992725,2cyclictest3478083-21kworker/u16:3+events_unbound22:22:086
3106584992725,2cyclictest3380323-21kworker/u16:5+events_unbound22:30:266
3106584992725,2cyclictest3366988-21kworker/u16:2+events_unbound21:32:536
3106584992725,2cyclictest3235559-21kworker/u16:1+flush-8:020:54:416
3106584992725,2cyclictest3216760-21kworker/u16:0+flush-8:020:30:426
3106584992725,2cyclictest3216760-21kworker/u16:0+events_unbound20:23:466
3106584992725,2cyclictest3116508-21kworker/u16:2+events_unbound19:53:466
3106584992725,2cyclictest3116508-21kworker/u16:2+events_unbound19:49:076
3106584992725,2cyclictest3104227-21kworker/u16:1+events_unbound19:13:466
3106582992725,2cyclictest3758116-21kworker/u16:2+events_unbound00:19:085
3106582992725,2cyclictest3600070-21kworker/u16:1+events_unbound23:25:095
3106582992725,2cyclictest3600070-21kworker/u16:1+events_unbound23:06:455
3106582992725,2cyclictest3539347-21kworker/u16:2+events_unbound23:15:135
3106582992725,2cyclictest3116508-21kworker/u16:2+events_unbound20:33:075
3106576992725,2cyclictest3265942-21kworker/u16:3+events_unbound21:06:464
3106576992725,2cyclictest3235559-21kworker/u16:1+events_unbound20:53:464
3106576992725,2cyclictest3149485-21kworker/u16:3+flush-8:019:36:464
3106584992624,2cyclictest3043033-21kworker/u16:0+flush-8:019:18:106
3106582992625,1cyclictest3380323-21kworker/u16:5+events_unbound22:11:055
3106582992624,2cyclictest3758588-21kworker/u16:4+events_unbound00:03:245
3106582992624,2cyclictest3600070-21kworker/u16:1+events_unbound23:37:205
3106582992624,2cyclictest3315234-21kworker/u16:4+events_unbound20:57:465
3106584992523,2cyclictest3758116-21kworker/u16:2+events_unbound00:13:376
3106584992523,2cyclictest3380323-21kworker/u16:5+events_unbound22:44:196
3106584992523,2cyclictest3380323-21kworker/u16:5+events_unbound22:44:196
3106582992523,2cyclictest3648769-21kworker/u16:3+events_unbound23:22:045
3106582992523,2cyclictest3380323-21kworker/u16:5+flush-8:021:50:375
3106582992523,2cyclictest3116508-21kworker/u16:2+events_unbound19:48:105
3106576992523,2cyclictest3138922-21kworker/u16:1+flush-8:019:24:474
3106576992521,3cyclictest3178386-21cat19:44:364
3106584992422,2cyclictest3648769-21kworker/u16:3+events_unbound23:19:086
3106584992422,2cyclictest3600070-21kworker/u16:1+flush-8:023:40:236
3106584992422,2cyclictest3453659-21kworker/u16:1+events_unbound22:26:536
3106584992422,2cyclictest3380323-21kworker/u16:5+events_unbound21:39:246
3106582992422,2cyclictest3758116-21kworker/u16:2+events_unbound00:28:155
3106582992422,2cyclictest3314483-21kworker/u16:0+flush-8:021:19:575
3106582992422,2cyclictest3265942-21kworker/u16:3+flush-8:021:15:095
3106582992422,2cyclictest3265942-21kworker/u16:3+events_unbound20:46:055
3106582992422,2cyclictest3235559-21kworker/u16:1+events_unbound21:02:105
3106582992422,2cyclictest3216760-21kworker/u16:0+events_unbound20:26:075
3106582992422,2cyclictest3116508-21kworker/u16:2+events_unbound20:43:075
3106582992422,2cyclictest3116508-21kworker/u16:2+events_unbound20:18:435
3106582992422,2cyclictest3104227-21kworker/u16:1+events_unbound19:11:145
3106576992422,2cyclictest3186909-21kworker/u16:4+flush-8:019:51:474
3106588992321,1cyclictest0-21swapper/700:00:067
3106584992321,2cyclictest3380323-21kworker/u16:5+flush-8:021:40:166
3106584992321,2cyclictest3366988-21kworker/u16:2+events_unbound21:56:046
3106584992321,2cyclictest3235559-21kworker/u16:1+flush-8:021:18:446
3106584992321,2cyclictest3235559-21kworker/u16:1+events_unbound20:49:516
3106584992321,2cyclictest3186909-21kworker/u16:4+events_unbound20:07:466
3106584992321,2cyclictest3149485-21kworker/u16:3+events_unbound19:36:076
3106584992321,2cyclictest3138922-21kworker/u16:1+flush-8:019:32:096
3106582992321,2cyclictest3478083-21kworker/u16:3+events_unbound22:22:255
3106582992321,2cyclictest3380323-21kworker/u16:5+events_unbound22:36:285
3106582992321,2cyclictest3380323-21kworker/u16:5+events_unbound22:36:285
3106582992321,2cyclictest3216760-21kworker/u16:0+flush-8:020:36:505
3106582992321,2cyclictest3216760-21kworker/u16:0+flush-8:020:36:505
3106576992321,2cyclictest3149485-21kworker/u16:3+events_unbound19:47:454
3106576992321,2cyclictest3116508-21kworker/u16:2+events_unbound20:18:474
3106588992221,0cyclictest0-21swapper/719:24:517
3106588992219,2cyclictest3343295-21diskmemload21:14:547
3106584992220,2cyclictest3758116-21kworker/u16:2+events_unbound00:38:566
3106584992220,2cyclictest3235559-21kworker/u16:1+flush-8:021:03:176
3106584992220,2cyclictest3216760-21kworker/u16:0+flush-8:020:36:096
3106584992220,2cyclictest3216760-21kworker/u16:0+flush-8:020:36:096
3106584992220,2cyclictest3216760-21kworker/u16:0+flush-8:020:19:266
3106584992220,2cyclictest3043033-21kworker/u16:0+events_unbound19:29:076
3106582992220,2cyclictest3235559-21kworker/u16:1+events_unbound20:22:555
3106582992220,2cyclictest3149485-21kworker/u16:3+events_unbound19:38:435
3106582992220,2cyclictest3138922-21kworker/u16:1+events_unbound19:41:105
3106576992220,2cyclictest3235559-21kworker/u16:1+flush-8:021:11:134
3106576992219,2cyclictest3216760-21kworker/u16:0+events_unbound20:34:454
3106576992219,2cyclictest3216760-21kworker/u16:0+events_unbound20:34:454
3106582992119,2cyclictest3186909-21kworker/u16:4+events_unbound20:06:425
3106582992119,2cyclictest3186909-21kworker/u16:4+events_unbound19:53:115
3106582992119,2cyclictest3149485-21kworker/u16:3+events_unbound19:34:145
3106576992119,2cyclictest3186909-21kworker/u16:4+events_unbound20:05:044
3106576992118,2cyclictest3314483-21kworker/u16:0+events_unbound20:59:594
310658899200,18cyclictest3401536-21ntp_states21:30:057
3106584992018,2cyclictest3758116-21kworker/u16:2+events_unbound00:33:126
3106584992018,2cyclictest3314483-21kworker/u16:0+events_unbound21:21:336
3106584992018,2cyclictest3265942-21kworker/u16:3+events_unbound21:14:356
3106584992018,2cyclictest3149485-21kworker/u16:3+flush-8:019:42:556
3106582992018,2cyclictest3043033-21kworker/u16:0+events_unbound19:16:405
3106588991918,0cyclictest0-21swapper/723:19:417
3106588991917,1cyclictest0-21swapper/721:49:537
3106588991917,1cyclictest0-21swapper/720:10:077
3106588991913,5cyclictest648-21systemd-journal23:04:367
3106584991917,2cyclictest3235559-21kworker/u16:1+events_unbound20:11:276
3106584991917,2cyclictest3116508-21kworker/u16:2+events_unbound19:20:016
3106582991916,2cyclictest3186909-21kworker/u16:4+events_unbound19:54:435
3106576991917,2cyclictest3043033-21kworker/u16:0+events_unbound19:14:414
310658899180,16cyclictest3250351-21kthreadcore20:19:547
3106584991816,2cyclictest3235559-21kworker/u16:1+events_unbound20:28:106
3106582991816,2cyclictest3116508-21kworker/u16:2+events_unbound20:12:515
3106582991816,2cyclictest3043033-21kworker/u16:0+events_unbound19:22:505
3106576991816,2cyclictest3116508-21kworker/u16:2+flush-8:020:40:334
3106588991714,2cyclictest1302-21snmpd23:29:517
3106588991712,4cyclictest3207343-21perf19:59:357
310658899170,16cyclictest3129751-21turbostat19:19:367
310658899170,15cyclictest1302-21snmpd19:20:047
3106576991715,2cyclictest3149485-21kworker/u16:3+events_unbound19:32:464
3106588991615,0cyclictest0-21swapper/722:40:057
3106588991615,0cyclictest0-21swapper/722:40:057
3106588991612,3cyclictest1302-21snmpd20:44:327
3106584991614,2cyclictest3265942-21kworker/u16:3+events_unbound20:49:126
3106584991614,2cyclictest3265942-21kworker/u16:3+events_unbound20:43:226
3106576991614,2cyclictest3186909-21kworker/u16:4+events_unbound20:09:484
310658899159,5cyclictest3343295-21diskmemload00:24:347
3106588991513,1cyclictest0-21swapper/722:54:367
3106588991512,2cyclictest3226796-21turbostat20:09:357
310658899150,1cyclictest0-21swapper/723:10:007
310658899150,14cyclictest0-21swapper/721:00:037
310658899150,13cyclictest1302-21snmpd20:30:027
310658899150,13cyclictest0-21swapper/722:25:007
310658899149,4cyclictest958-21NetworkManager20:14:487
310658899149,4cyclictest1302-21snmpd19:33:197
310658899146,7cyclictest5834-21gmain21:05:017
3106588991410,3cyclictest1302-21snmpd23:46:137
310658899140,1cyclictest0-21swapper/723:34:587
310658899140,13cyclictest0-21swapper/722:20:017
3106576991412,2cyclictest3116508-21kworker/u16:2+events_unbound19:54:564
310657699140,14cyclictest0-21swapper/420:45:014
310658899139,3cyclictest1302-21snmpd21:22:397
310658899139,3cyclictest1302-21snmpd20:00:447
310658899136,6cyclictest6124-21gmain23:16:417
3106588991311,1cyclictest3416761-21ssh21:39:257
3106588991310,2cyclictest1302-21snmpd23:52:347
310658899130,3cyclictest3783014-21ssh00:09:397
310658899130,3cyclictest3464253-21ssh21:57:027
310658899130,1cyclictest0-21swapper/721:13:047
310658899130,12cyclictest3514552-21turbostat22:19:357
310658899130,11cyclictest3771830-21ssh00:04:577
3106576991311,2cyclictest3104227-21kworker/u16:1+events_unbound19:09:564
310658899129,2cyclictest1302-21snmpd22:35:027
310658899129,2cyclictest1302-21snmpd22:35:027
310658899129,2cyclictest1302-21snmpd00:33:087
310658899128,3cyclictest1302-21snmpd22:49:027
310658899128,3cyclictest1302-21snmpd20:54:427
310658899128,3cyclictest1302-21snmpd20:47:507
310658899128,3cyclictest1302-21snmpd19:48:317
310658899128,3cyclictest1302-21snmpd19:40:587
310658899128,3cyclictest1302-21snmpd19:09:467
310658899121,9cyclictest0-21swapper/700:24:357
3106588991212,0cyclictest0-21swapper/722:07:107
310658899120,2cyclictest3803899-21ssh00:15:017
310658899120,11cyclictest3612128-21turbostat22:59:357
310658899120,11cyclictest3284995-21turbostat20:39:367
310658899120,11cyclictest3284995-21turbostat20:39:367
310658899118,2cyclictest1302-21snmpd23:58:377
310658899118,2cyclictest1302-21snmpd22:34:087
310658899118,2cyclictest1302-21snmpd20:25:327
310658899118,2cyclictest0-21swapper/721:39:537
310658899117,3cyclictest1302-21snmpd19:49:407
310658899115,5cyclictest6233-21gvfs-afc-volume23:25:107
310658899110,2cyclictest3500086-21ssh22:10:247
310658899110,2cyclictest3313139-21ntpq20:50:007
310658899110,1cyclictest3634661-21ssh23:06:147
310658899110,10cyclictest3438840-21ssh21:45:117
310658899106,3cyclictest1302-21snmpd23:42:437
310658899106,3cyclictest1302-21snmpd19:35:167
310658899100,9cyclictest0-21swapper/721:25:007
310657699108,2cyclictest3138922-21kworker/u16:1+flush-8:020:00:014
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional