You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-21 - 02:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Mon Sep 21, 2026 00:43:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
306948025747,7sleep50-21swapper/519:05:045
306969025420,29sleep70-21swapper/719:08:027
306956424838,7sleep40-21swapper/419:06:154
3070076994139,2cyclictest3759232-21kworker/u16:1+events_unbound00:19:486
3070076994038,2cyclictest3417046-21kworker/u16:1+flush-8:023:49:336
3070076993835,2cyclictest3686012-21kworker/u16:3+events_unbound00:24:496
3070076993835,2cyclictest3686012-21kworker/u16:3+events_unbound00:24:496
3070076993735,2cyclictest3417046-21kworker/u16:1+events_unbound23:14:066
3070076993734,2cyclictest3417046-21kworker/u16:1+events_unbound22:51:066
3070076993634,2cyclictest3417046-21kworker/u16:1+events_unbound23:03:096
3070076993634,2cyclictest3380393-21kworker/u16:2+events_unbound21:51:226
3070076993634,2cyclictest3341761-21kworker/u16:3+events_unbound22:04:026
3070076993634,2cyclictest3150614-21kworker/u16:0+events_unbound21:32:466
3070076993634,2cyclictest3150614-21kworker/u16:0+events_unbound21:15:176
3070076993630,6cyclictest3487945-21kworker/u16:0+events_unbound23:38:576
3070076993533,2cyclictest3732052-21kworker/u16:0+flush-8:000:08:136
3070076993533,2cyclictest3732052-21kworker/u16:0+events_unbound00:01:376
3070076993533,2cyclictest3624906-21kworker/u16:3+events_unbound23:20:466
3070076993533,2cyclictest3417046-21kworker/u16:1+events_unbound22:40:376
3070076993533,2cyclictest3417046-21kworker/u16:1+events_unbound22:37:066
3070076993533,2cyclictest3417046-21kworker/u16:1+events_unbound22:06:466
3070076993533,2cyclictest3219417-21kworker/u16:1+events_unbound21:34:576
3070076993533,2cyclictest3219417-21kworker/u16:1+events_unbound21:23:116
3070076993432,2cyclictest3732052-21kworker/u16:0+events_unbound00:13:386
3070076993432,2cyclictest3539634-21kworker/u16:3+events_unbound22:45:426
3070076993432,2cyclictest3502764-21kworker/u16:2+events_unbound23:40:546
3070076993432,2cyclictest3487945-21kworker/u16:0+events_unbound23:16:096
3070076993432,2cyclictest3150614-21kworker/u16:0+events_unbound21:55:346
3070076993432,2cyclictest3150614-21kworker/u16:0+events_unbound21:26:546
3070076993331,2cyclictest3698301-21kworker/u16:4+events_unbound00:16:306
3070076993331,2cyclictest3686012-21kworker/u16:3+events_unbound23:57:416
3070076993331,2cyclictest3658624-21kworker/u16:3+events_unbound23:33:386
3070076993331,2cyclictest3502764-21kworker/u16:2+events_unbound23:07:456
3070076993331,2cyclictest3417046-21kworker/u16:1+events_unbound22:57:376
3070076993331,2cyclictest3417046-21kworker/u16:1+events_unbound22:31:106
34289832320,4chrt3428981-21ssh21:58:457
3070076993230,2cyclictest3686012-21kworker/u16:3+events_unbound23:46:016
3070076993230,2cyclictest3686012-21kworker/u16:3+events_unbound23:46:016
3070076993230,2cyclictest3219417-21kworker/u16:1+flush-8:021:04:486
3070076993230,2cyclictest3150614-21kworker/u16:0+flush-8:021:10:096
3070076993229,2cyclictest3417046-21kworker/u16:1+events_unbound23:24:236
3070076993129,2cyclictest3805775-21kworker/u16:1+events_unbound00:38:416
3070076993129,2cyclictest3417046-21kworker/u16:1+events_unbound22:20:496
3070076993129,2cyclictest3417046-21kworker/u16:1+events_unbound22:20:496
3070076993129,2cyclictest3417046-21kworker/u16:1+events_unbound22:18:106
3070076993129,2cyclictest3341761-21kworker/u16:3+events_unbound22:29:016
3070076993129,2cyclictest3341761-21kworker/u16:3+events_unbound22:11:266
3070076993129,2cyclictest3341761-21kworker/u16:3+events_unbound21:41:476
3070076993129,2cyclictest3341761-21kworker/u16:3+events_unbound21:41:476
306958523121,7sleep60-21swapper/619:06:336
3070082993025,4cyclictest3588226-21latency_hist23:04:187
3070076993028,2cyclictest3380393-21kworker/u16:2+events_unbound21:48:106
3070082992927,1cyclictest3308354-21ssh21:09:337
3070076992927,2cyclictest3771755-21kworker/u16:6+flush-8:000:29:376
3070082992620,5cyclictest3268349-21latency_hist20:49:187
3070076992523,2cyclictest3027483-21kworker/u16:0+events_unbound19:29:156
3070076992523,2cyclictest3027483-21kworker/u16:0+events_unbound19:29:156
3070076992422,2cyclictest3219417-21kworker/u16:1+events_unbound20:32:296
3070076992422,2cyclictest3150614-21kworker/u16:0+events_unbound20:12:296
3070076992422,2cyclictest3132515-21kworker/u16:3+events_unbound20:04:516
3070076992321,2cyclictest3112711-21kworker/u16:1+events_unbound19:48:306
3070076992321,2cyclictest3079354-21kworker/u16:1+events_unbound19:10:556
3070076992321,2cyclictest3027483-21kworker/u16:0+events_unbound19:30:306
3070082992220,1cyclictest3392621-21idleruntime-cro21:44:187
3070082992220,1cyclictest3392621-21idleruntime-cro21:44:187
3070076992220,2cyclictest2985645-21kworker/u16:2+events_unbound20:38:306
3070076992119,2cyclictest3150614-21kworker/u16:0+events_unbound20:18:036
3070076992119,2cyclictest3150614-21kworker/u16:0+events_unbound20:18:036
3070076992018,2cyclictest3027483-21kworker/u16:0+events_unbound19:14:386
37360362190,0sleep40-21swapper/400:04:324
3070076991917,2cyclictest2985645-21kworker/u16:2+flush-8:020:24:446
3070082991815,2cyclictest1274-21snmpd22:48:267
3070076991816,2cyclictest3150614-21kworker/u16:0+events_unbound20:54:416
3070076991816,2cyclictest3027483-21kworker/u16:0+events_unbound19:37:576
3070076991816,2cyclictest2985645-21kworker/u16:2+flush-8:019:43:466
307007299180,18cyclictest0-21swapper/523:08:005
34410862170,0sleep73441087-21sh22:03:267
3070082991713,3cyclictest1274-21snmpd00:35:017
307008299170,1cyclictest0-21swapper/720:04:437
307008299170,1cyclictest0-21swapper/719:49:447
307008299170,15cyclictest0-21swapper/719:29:457
3070076991715,2cyclictest3027483-21kworker/u16:0+events_unbound19:23:516
3070076991714,2cyclictest2985645-21kworker/u16:2+events_unbound19:49:216
307007299170,14cyclictest0-21swapper/523:28:305
3070082991611,4cyclictest3380359-21latency_hist21:39:187
307008299160,1cyclictest0-21swapper/721:44:417
307008299160,14cyclictest0-21swapper/719:34:437
3070076991614,2cyclictest2985645-21kworker/u16:2+events_unbound19:58:036
307007299160,0cyclictest0-21swapper/521:23:575
307006499160,15cyclictest3275802-21kthreadcore20:49:394
3070082991512,2cyclictest1274-21snmpd20:18:267
3070082991512,2cyclictest1274-21snmpd20:18:267
307008299150,14cyclictest0-21swapper/720:59:397
307008299150,14cyclictest0-21swapper/720:59:397
307008299150,13cyclictest0-21swapper/719:44:437
3070076991513,2cyclictest3219417-21kworker/u16:1+flush-8:020:21:546
3070076991513,2cyclictest3150614-21kworker/u16:0+events_unbound20:46:546
3070072991512,2cyclictest3354549-21taskset21:26:375
307007299150,14cyclictest0-21swapper/523:19:215
307007299150,14cyclictest0-21swapper/520:59:215
307007299150,14cyclictest0-21swapper/520:59:215
3070064991514,1cyclictest0-21swapper/423:39:084
3070064991514,1cyclictest0-21swapper/421:15:494
307006499150,15cyclictest0-21swapper/422:46:484
307008299148,5cyclictest3258647-21latency_hist20:44:197
307008299144,8cyclictest6398-21gmain21:29:337
3070082991411,2cyclictest0-21swapper/700:14:197
307008299140,1cyclictest0-21swapper/720:29:457
3070076991412,2cyclictest2985645-21kworker/u16:2+flush-8:020:49:496
3070076991412,2cyclictest2985645-21kworker/u16:2+events_unbound21:01:106
3070076991412,2cyclictest2985645-21kworker/u16:2+events_unbound21:01:106
3070072991413,1cyclictest0-21swapper/520:54:185
3070072991412,2cyclictest0-21swapper/523:52:285
3070072991412,2cyclictest0-21swapper/523:32:365
3070072991411,3cyclictest0-21swapper/500:02:245
307007299140,1cyclictest0-21swapper/523:11:385
307007299140,1cyclictest0-21swapper/522:56:395
307007299140,1cyclictest0-21swapper/522:45:185
307007299140,14cyclictest0-21swapper/521:45:335
307007299140,14cyclictest0-21swapper/521:32:565
307007299140,0cyclictest0-21swapper/519:15:365
3070064991413,1cyclictest0-21swapper/423:42:184
3070064991413,1cyclictest0-21swapper/423:18:394
3070064991413,1cyclictest0-21swapper/423:02:154
3070064991413,1cyclictest0-21swapper/421:44:414
3070064991413,1cyclictest0-21swapper/400:30:514
3070064991411,2cyclictest3297111-21users20:59:454
3070064991411,2cyclictest3297111-21users20:59:454
3070064991411,2cyclictest0-21swapper/419:19:354
307006499140,1cyclictest3103626-21cstates19:24:314
307006499140,1cyclictest3103626-21cstates19:24:314
307006499140,1cyclictest0-21swapper/421:34:454
307006499140,14cyclictest0-21swapper/423:27:194
307006499140,14cyclictest0-21swapper/422:43:104
307006499140,14cyclictest0-21swapper/422:36:204
307006499140,14cyclictest0-21swapper/400:09:534
307008299139,3cyclictest1274-21snmpd19:40:527
307008299139,3cyclictest1274-21snmpd00:30:467
307008299139,3cyclictest1274-21snmpd00:13:047
3070082991310,2cyclictest3624873-21munin-run23:19:187
3070082991310,2cyclictest0-21swapper/722:59:187
307008299130,2cyclictest3722262-21ssh23:58:317
307008299130,2cyclictest3606948-21ssh23:09:387
3070076991311,2cyclictest2985645-21kworker/u16:2+events_unbound20:03:186
307007299137,5cyclictest3210399-21/usr/sbin/munin20:19:345
307007299132,5cyclictest3267696-21timerandwakeup20:44:465
3070072991312,1cyclictest0-21swapper/522:34:255
3070072991312,1cyclictest0-21swapper/521:56:255
3070072991312,1cyclictest0-21swapper/521:39:145
3070072991312,1cyclictest0-21swapper/521:17:385
3070072991312,1cyclictest0-21swapper/519:38:565
3070072991312,1cyclictest0-21swapper/500:38:215
3070072991312,1cyclictest0-21swapper/500:25:345
3070072991312,1cyclictest0-21swapper/500:25:345
3070072991310,3cyclictest0-21swapper/522:17:425
307007299130,13cyclictest0-21swapper/523:00:175
307007299130,13cyclictest0-21swapper/521:52:485
307007299130,13cyclictest0-21swapper/521:42:235
307007299130,13cyclictest0-21swapper/521:42:235
307007299130,13cyclictest0-21swapper/500:34:155
307006499136,6cyclictest3082774-21kthreadcore19:14:224
3070064991312,1cyclictest0-21swapper/423:45:274
3070064991312,1cyclictest0-21swapper/423:45:274
3070064991312,1cyclictest0-21swapper/400:26:454
3070064991312,1cyclictest0-21swapper/400:26:454
307006499130,13cyclictest0-21swapper/422:32:174
307006499130,13cyclictest0-21swapper/421:22:084
307006499130,12cyclictest0-21swapper/419:39:304
307006499130,0cyclictest0-21swapper/422:58:374
307008299129,2cyclictest1274-21snmpd21:22:157
307008299129,2cyclictest1274-21snmpd21:16:067
307008299129,2cyclictest0-21swapper/700:24:327
307008299129,2cyclictest0-21swapper/700:24:327
307008299128,3cyclictest1274-21snmpd23:53:347
307008299128,3cyclictest1274-21snmpd23:34:457
307008299128,3cyclictest1274-21snmpd22:42:177
307008299128,3cyclictest1274-21snmpd22:29:537
307008299128,3cyclictest1274-21snmpd22:24:477
307008299128,3cyclictest1274-21snmpd22:04:317
307008299128,3cyclictest1274-21snmpd20:24:207
307008299128,3cyclictest1274-21snmpd20:21:507
307008299128,3cyclictest1274-21snmpd19:59:257
307008299128,3cyclictest1274-21snmpd19:57:467
307008299128,3cyclictest1274-21snmpd19:23:367
307008299128,3cyclictest1274-21snmpd19:18:307
307008299128,3cyclictest1274-21snmpd00:06:077
3070082991210,1cyclictest0-21swapper/722:19:457
3070082991210,1cyclictest0-21swapper/722:19:457
307008299120,10cyclictest1117-21ntpd23:19:417
307008299120,10cyclictest1117-21ntpd20:54:427
307007299129,2cyclictest3226250-21kthreadcore20:24:405
307007299123,4cyclictest3312211-21cut21:09:385
307007299123,4cyclictest3160713-21cat19:49:475
3070072991211,1cyclictest0-21swapper/523:55:375
3070072991211,1cyclictest0-21swapper/523:45:415
3070072991211,1cyclictest0-21swapper/523:45:415
3070072991211,1cyclictest0-21swapper/521:04:525
3070072991211,1cyclictest0-21swapper/520:15:035
3070072991211,1cyclictest0-21swapper/520:15:035
307007299120,1cyclictest0-21swapper/520:34:175
307007299120,11cyclictest0-21swapper/523:39:455
3070064991211,1cyclictest0-21swapper/423:22:454
3070064991211,1cyclictest0-21swapper/422:11:294
3070064991211,1cyclictest0-21swapper/422:08:204
3070064991211,1cyclictest0-21swapper/421:41:314
3070064991211,1cyclictest0-21swapper/421:41:314
3070064991211,1cyclictest0-21swapper/421:28:264
3070064991211,1cyclictest0-21swapper/421:12:124
3070064991211,1cyclictest0-21swapper/420:44:544
3070064991211,1cyclictest0-21swapper/400:02:384
307006499120,1cyclictest0-21swapper/420:28:134
307006499120,1cyclictest0-21swapper/420:06:564
307006499120,12cyclictest0-21swapper/422:50:254
307006499120,12cyclictest0-21swapper/421:31:354
307006499120,12cyclictest0-21swapper/420:16:144
307006499120,12cyclictest0-21swapper/420:16:144
307006499120,12cyclictest0-21swapper/419:59:034
307006499120,11cyclictest0-21swapper/420:29:364
307006499120,0cyclictest0-21swapper/400:34:574
307008299118,2cyclictest1274-21snmpd23:43:487
307008299118,2cyclictest1274-21snmpd23:26:337
307008299118,2cyclictest1274-21snmpd22:36:027
307008299118,2cyclictest1274-21snmpd21:50:167
307008299118,2cyclictest1274-21snmpd21:25:277
307008299118,2cyclictest1274-21snmpd20:10:017
307008299117,3cyclictest868-21systemd-oomd22:49:457
307008299117,3cyclictest1274-21snmpd23:44:337
307008299117,3cyclictest1274-21snmpd23:44:337
307008299117,3cyclictest1274-21snmpd21:06:487
307008299115,5cyclictest6241-21gvfs-afc-volume00:19:327
307008299115,5cyclictest0-21swapper/723:33:427
307007699119,2cyclictest2985645-21kworker/u16:2+events_unbound20:43:066
307007299119,2cyclictest0-21swapper/520:00:425
307007299112,3cyclictest3102528-21awk19:19:485
3070072991110,1cyclictest0-21swapper/522:20:525
3070072991110,1cyclictest0-21swapper/522:20:525
3070072991110,1cyclictest0-21swapper/520:37:545
3070072991110,1cyclictest0-21swapper/500:21:285
3070072991110,1cyclictest0-21swapper/500:13:165
307007299110,11cyclictest0-21swapper/520:42:005
307007299110,0cyclictest0-21swapper/519:49:115
307006499117,3cyclictest3601842-21irqcore23:09:344
307006499117,3cyclictest3467723-21sed22:14:364
307006499113,6cyclictest3490984-21taskset22:24:304
307006499113,3cyclictest34351031kthreadcore21:59:394
3070064991110,1cyclictest0-21swapper/423:55:234
3070064991110,1cyclictest0-21swapper/423:52:144
3070064991110,1cyclictest0-21swapper/423:31:254
3070064991110,1cyclictest0-21swapper/423:05:524
3070064991110,1cyclictest0-21swapper/421:56:024
3070064991110,1cyclictest0-21swapper/421:51:564
3070064991110,1cyclictest0-21swapper/420:35:564
3070064991110,1cyclictest0-21swapper/400:18:054
307006499110,11cyclictest0-21swapper/419:50:414
307008299106,3cyclictest868-21systemd-oomd20:49:397
307008299106,3cyclictest1274-21snmpd22:18:057
307008299106,3cyclictest1274-21snmpd20:37:477
307008299106,3cyclictest1274-21snmpd19:09:457
307008299105,4cyclictest3112807-21cut19:29:187
307008299105,4cyclictest3112807-21cut19:29:187
3070082991010,0cyclictest0-21swapper/722:11:377
3070082991010,0cyclictest0-21swapper/700:00:057
307008299100,8cyclictest1274-21snmpd23:04:277
307007299109,1cyclictest0-21swapper/522:00:035
307007299109,1cyclictest0-21swapper/520:08:065
307007299109,1cyclictest0-21swapper/500:17:225
307007299109,1cyclictest0-21swapper/500:05:335
307007299106,3cyclictest3113849-21cat19:29:365
307007299105,1cyclictest0-21swapper/523:34:405
307007299104,3cyclictest3613722-21diskstats23:14:375
307007299103,3cyclictest3494969-21grep22:24:385
307006499109,1cyclictest0-21swapper/420:40:024
307006499108,1cyclictest3218069-21kthreadcore20:19:404
307006499106,3cyclictest3479260-21expr22:19:324
307006499106,3cyclictest3479260-21expr22:19:324
307006499105,4cyclictest3282091-21kthreadcore20:54:384
307006499103,6cyclictest3177407-21kthreadcore19:59:384
307006499103,6cyclictest3142994-21if_err_p4p119:44:344
307006499103,6cyclictest3126657-21cut19:34:384
307006499103,6cyclictest3121291-21cat19:29:434
307006499103,6cyclictest3078311-21cut19:09:424
30700729998,1cyclictest0-21swapper/522:52:335
30700729998,1cyclictest0-21swapper/522:41:125
30700649993,5cyclictest3782068-21chrt00:21:234
30700649993,5cyclictest3298296-21cstates21:04:324
30700649993,5cyclictest3192821-21grep20:09:364
30700729987,1cyclictest0-21swapper/522:10:565
30700729985,2cyclictest3199303-21ntp_kernel_err20:09:415
30700729984,3cyclictest3079263-21grep19:09:505
30700729983,4cyclictest3170276-21switchtime19:54:465
30700729973,3cyclictest3442454-21cat22:04:315
30700729972,4cyclictest3503578-21expr22:29:315
30700729972,4cyclictest3281079-21cut20:54:375
30700729972,4cyclictest3132824-21expr19:39:315
30700729970,6cyclictest0-21swapper/519:24:355
30700729970,6cyclictest0-21swapper/519:24:355
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional