You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-19 - 03:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot2.osadl.org (updated Sun Apr 19, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
301583924735,7sleep50-21swapper/519:05:055
3022442994239,2cyclictest3519191-21kworker/u16:0+events_unbound00:04:454
302198824029,8sleep40-21swapper/419:07:214
30135852403,31sleep70-21swapper/719:04:597
302244999390,37cyclictest3689023-21ssh00:06:427
3022442993735,2cyclictest3265022-21kworker/u16:2+events_unbound22:01:574
3022449993635,0cyclictest0-21swapper/722:19:467
3022449993633,2cyclictest3676354-21ssh00:00:417
3022442993634,2cyclictest3519191-21kworker/u16:0+events_unbound23:49:384
3022442993634,2cyclictest3519191-21kworker/u16:0+events_unbound23:22:014
3022442993634,2cyclictest3410808-21kworker/u16:0+events_unbound22:39:424
3022442993634,2cyclictest3410808-21kworker/u16:0+events_unbound22:39:424
3022442993634,2cyclictest3246856-21kworker/u16:3+events_unbound21:28:344
3022442993633,2cyclictest3485501-21kworker/u16:3+events_unbound23:04:454
3022449993534,0cyclictest0-21swapper/723:13:217
3022449993534,0cyclictest0-21swapper/722:44:457
3022449993530,4cyclictest3738889-21latency_hist00:29:437
3022442993533,2cyclictest3750873-21kworker/u16:3+events_unbound00:36:094
3022442993533,2cyclictest3688267-21kworker/u16:1+events_unbound00:32:184
3022442993533,2cyclictest3688267-21kworker/u16:1+events_unbound00:17:584
3022442993533,2cyclictest3688267-21kworker/u16:1+events_unbound00:10:584
3022442993533,2cyclictest3667746-21kworker/u16:3+events_unbound00:02:014
3022442993533,2cyclictest3546098-21kworker/u16:1+events_unbound23:32:344
3022442993533,2cyclictest3519191-21kworker/u16:0+events_unbound23:58:404
3022442993533,2cyclictest3519191-21kworker/u16:0+events_unbound23:58:404
3022442993533,2cyclictest3413082-21kworker/u16:4+flush-8:022:55:214
3022442993533,2cyclictest3410808-21kworker/u16:0+events_unbound22:42:464
3022442993533,2cyclictest3292248-21kworker/u16:0+events_unbound21:59:414
3022442993533,2cyclictest3292248-21kworker/u16:0+events_unbound21:51:404
3022442993533,2cyclictest3246856-21kworker/u16:3+events_unbound21:47:184
3022449993429,3cyclictest3602946-21ntpq23:30:087
3022442993433,1cyclictest3268252-21kworker/u16:4+events_unbound21:19:334
3022442993432,2cyclictest3519191-21kworker/u16:0+events_unbound23:41:534
3022442993432,2cyclictest3519191-21kworker/u16:0+events_unbound23:17:374
3022442993432,2cyclictest3519191-21kworker/u16:0+events_unbound23:17:374
3022442993432,2cyclictest3519191-21kworker/u16:0+events_unbound23:01:494
3022442993432,2cyclictest3497468-21kworker/u16:5+events_unbound22:53:414
3022442993432,2cyclictest3268252-21kworker/u16:4+events_unbound21:21:424
3022442993432,2cyclictest3265022-21kworker/u16:2+events_unbound22:15:524
3022442993432,2cyclictest3265022-21kworker/u16:2+events_unbound21:40:494
3022442993432,2cyclictest3121965-21kworker/u16:0+events_unbound21:11:484
3022442993432,2cyclictest3121965-21kworker/u16:0+events_unbound21:11:484
3022449993328,4cyclictest635-21systemd-journal20:59:447
3022442993331,2cyclictest3519191-21kworker/u16:0+events_unbound23:13:454
3022442993331,2cyclictest3246856-21kworker/u16:3+events_unbound21:33:064
3022449993231,0cyclictest0-21swapper/723:17:417
3022449993231,0cyclictest0-21swapper/723:17:417
3022442993230,2cyclictest3732386-21kworker/u16:2+events_unbound00:27:254
3022442993230,2cyclictest3413082-21kworker/u16:4+events_unbound23:54:414
3022442993230,2cyclictest3398508-21kworker/u16:3+events_unbound22:11:404
3022449993130,0cyclictest0-21swapper/723:03:417
3022449993130,0cyclictest0-21swapper/721:13:457
3022449993130,0cyclictest0-21swapper/721:13:457
3022449993129,1cyclictest3715281-21ssh00:19:487
3022449993129,1cyclictest3664834-21ssh23:56:427
3022449993129,1cyclictest3664834-21ssh23:56:427
3022442993129,2cyclictest3413082-21kworker/u16:4+events_unbound23:36:384
3022442993129,2cyclictest3410808-21kworker/u16:0+events_unbound22:23:494
3022442993129,2cyclictest3265022-21kworker/u16:2+flush-8:022:25:254
3022442993129,2cyclictest3265022-21kworker/u16:2+events_unbound22:48:404
3022442993129,2cyclictest3265022-21kworker/u16:2+events_unbound21:37:574
3022449993028,1cyclictest3375822-21ssh21:57:577
3022449993027,2cyclictest3485376-21munin-run22:44:437
3022442993028,2cyclictest3546098-21kworker/u16:1+events_unbound23:26:254
3022442993028,2cyclictest3410808-21kworker/u16:0+events_unbound22:34:244
3022442993028,2cyclictest3398508-21kworker/u16:3+events_unbound22:08:264
3022449992928,0cyclictest0-21swapper/723:50:547
3022449992927,1cyclictest0-21swapper/721:47:147
3022449992925,3cyclictest3314977-21rm21:32:097
3022449992827,0cyclictest0-21swapper/721:51:347
3022449992827,0cyclictest0-21swapper/700:17:537
3022449992825,2cyclictest3617005-21ssh23:37:457
3022449992726,0cyclictest0-21swapper/721:59:537
3022442992725,2cyclictest3688267-21kworker/u16:1+events_unbound00:20:134
3022442992725,2cyclictest3159223-21kworker/u16:2+events_unbound20:47:344
3022442992725,2cyclictest3031928-21kworker/u16:1+events_unbound20:00:454
3022449992624,1cyclictest3327920-21ssh21:38:427
3022442992624,2cyclictest3121965-21kworker/u16:0+events_unbound20:32:544
302205822615,8sleep60-21swapper/619:08:196
3022449992524,0cyclictest0-21swapper/723:25:577
3022449992524,0cyclictest0-21swapper/723:06:297
3022449992524,0cyclictest0-21swapper/722:51:407
3022449992523,1cyclictest3425028-21ssh22:19:387
3022449992523,1cyclictest0-21swapper/719:35:067
3022442992523,2cyclictest3074068-21kworker/u16:3+events_unbound19:42:534
3022442992523,2cyclictest3074068-21kworker/u16:3+events_unbound19:42:534
3022442992523,2cyclictest3031928-21kworker/u16:1+events_unbound20:13:534
3022442992523,2cyclictest3030632-21kworker/u16:0+events_unbound19:28:544
3022449992423,0cyclictest0-21swapper/722:30:417
3022449992423,0cyclictest0-21swapper/722:05:527
3022449992423,0cyclictest0-21swapper/721:15:137
3022444992422,2cyclictest3398508-21kworker/u16:3+events_unbound22:07:456
3022442992422,2cyclictest3121965-21kworker/u16:0+events_unbound21:06:254
3022442992422,2cyclictest3074068-21kworker/u16:3+events_unbound19:38:544
3022442992422,2cyclictest3030632-21kworker/u16:0+events_unbound19:31:544
3022449992322,0cyclictest0-21swapper/722:57:377
3022449992321,1cyclictest3761928-21ssh00:37:417
302244999230,21cyclictest3055256-21sshd-session19:24:467
3022442992321,2cyclictest3159223-21kworker/u16:2+events_unbound20:25:544
3022442992321,2cyclictest3159223-21kworker/u16:2+events_unbound20:16:534
3022442992321,2cyclictest3074068-21kworker/u16:3+events_unbound19:49:234
3022442992321,2cyclictest2997303-21kworker/u16:2+events_unbound19:15:544
3022449992221,0cyclictest0-21swapper/723:23:377
3022442992220,2cyclictest3031928-21kworker/u16:1+events_unbound20:09:234
3022449992119,1cyclictest3302679-21ssh21:26:497
3022442992119,2cyclictest3159223-21kworker/u16:2+events_unbound21:01:524
3022442992018,2cyclictest3169878-21kworker/u16:1+events_unbound20:58:464
3022442992018,2cyclictest3169878-21kworker/u16:1+events_unbound20:39:024
3022442992018,2cyclictest3121965-21kworker/u16:0+events_unbound20:21:464
3022449991918,0cyclictest0-21swapper/722:11:307
3022449991918,0cyclictest0-21swapper/700:30:177
3022449991917,1cyclictest3702060-21ssh00:13:217
3022444991917,2cyclictest3485501-21kworker/u16:3+events_unbound22:56:506
3022444991917,2cyclictest3246856-21kworker/u16:3+events_unbound21:18:176
3022442991917,2cyclictest3074068-21kworker/u16:3+events_unbound19:58:334
3022449991817,0cyclictest0-21swapper/722:28:097
3022449991817,0cyclictest0-21swapper/721:43:437
3022449991813,4cyclictest3141080-21latency_hist20:09:447
3022444991816,2cyclictest3413082-21kworker/u16:4+events_unbound23:29:176
3022444991816,2cyclictest3292248-21kworker/u16:0+events_unbound22:02:016
3022444991816,2cyclictest3121965-21kworker/u16:0+events_unbound21:07:456
3022449991715,1cyclictest0-21swapper/721:22:447
3022444991714,1cyclictest201rcu_preempt22:34:246
3022449991615,0cyclictest0-21swapper/723:47:377
3022449991615,0cyclictest0-21swapper/723:42:407
3022449991615,0cyclictest0-21swapper/719:32:537
302244499169,6cyclictest3421779-21memory22:15:066
3022444991614,2cyclictest5944-21gsd-housekeepin23:15:426
3022444991614,2cyclictest5944-21gsd-housekeepin23:15:426
3022444991614,2cyclictest3606047-21kworker/u16:2+events_unbound23:41:376
3022444991614,2cyclictest3121965-21kworker/u16:0+events_unbound20:29:216
302244999156,7cyclictest5975-21gmain20:24:567
3022449991514,0cyclictest0-21swapper/722:36:337
3022449991514,0cyclictest0-21swapper/722:36:337
302244999150,1cyclictest0-21swapper/720:20:067
3022444991514,1cyclictest3226051-21sed20:50:046
302244399159,5cyclictest3523142-21irqcore23:00:015
3022442991513,2cyclictest1594734-21kworker/u16:5+events_unbound19:12:574
3022449991413,0cyclictest0-21swapper/719:45:437
3022444991413,1cyclictest3755086-21cut00:35:006
3022444991413,1cyclictest3462257-21df22:34:566
3022444991413,1cyclictest3462257-21df22:34:566
3022444991413,1cyclictest3229298-21kthreadcore20:55:026
3022444991413,1cyclictest0-21swapper/620:35:106
3022444991412,2cyclictest5829-21JS15:59:266
3022444991412,2cyclictest3030632-21kworker/u16:0+events_unbound19:26:536
3022444991412,2cyclictest2997303-21kworker/u16:2+events_unbound19:18:506
3022444991412,1cyclictest3506419-21ntpq22:50:056
3022444991412,1cyclictest3349605-21open_files21:45:096
3022444991412,1cyclictest3329157-21cpuspeed_turbos21:39:556
3022444991412,1cyclictest3090151-21kthreadcore19:40:036
3022444991412,1cyclictest3090151-21kthreadcore19:40:036
3022444991412,1cyclictest0-21swapper/600:14:556
3022444991411,3cyclictest5826-21JS15:59:266
302244399149,4cyclictest3190162-21cat20:35:005
302244399149,3cyclictest0-21swapper/522:07:525
3022442991412,2cyclictest2997303-21kworker/u16:2+flush-8:019:20:114
302244999139,3cyclictest1234-21snmpd21:05:277
302244999139,3cyclictest1234-21snmpd19:56:467
302244999138,4cyclictest6382-21gvfs-afc-volume20:15:107
302244999138,4cyclictest635-21systemd-journal19:14:447
3022449991310,2cyclictest1234-21snmpd20:39:597
302244499137,5cyclictest0-21swapper/600:05:016
302244499134,6cyclictest201rcu_preempt23:00:056
3022444991312,1cyclictest3715341-21/usr/sbin/munin00:20:056
3022444991312,1cyclictest3607118-21fschecks_count23:34:566
3022444991312,1cyclictest3578962-21processes23:20:096
3022444991312,1cyclictest3488901-21kthreadcore22:45:016
3022444991312,1cyclictest3355904-21tr21:50:006
3022444991312,1cyclictest3298975-21cut21:25:026
3022444991312,1cyclictest3146099-21kthreadcore20:10:016
3022444991312,1cyclictest3113961-21kthreadcore19:55:006
3022444991312,1cyclictest3065673-21ip_192.168.114.19:30:006
3022444991312,1cyclictest0-21swapper/621:29:556
3022444991312,1cyclictest0-21swapper/620:40:026
3022444991312,1cyclictest0-21swapper/600:25:036
3022444991311,1cyclictest3663418-21ntpq23:55:106
3022444991311,1cyclictest3663418-21ntpq23:55:106
3022444991311,1cyclictest3446092-21ntpq22:25:066
3022444991311,1cyclictest3434057-21ntpq22:20:076
3022444991311,1cyclictest3409819-21ntpq22:10:066
3022444991311,1cyclictest3325323-21ntpq21:35:066
3022444991311,1cyclictest3187605-21kthreadcore20:30:026
3022444991311,1cyclictest3168875-21ntpq20:20:046
3022444991311,1cyclictest3123302-21sed20:00:016
3022443991310,3cyclictest0-21swapper/523:34:255
3022443991310,3cyclictest0-21swapper/521:01:305
302244399130,4cyclictest3511603-21kthreadcore22:55:015
302244399130,1cyclictest0-21swapper/523:40:115
302244399130,13cyclictest0-21swapper/523:20:085
302244999129,2cyclictest6382-21gvfs-afc-volume20:35:027
302244999129,2cyclictest1234-21snmpd20:47:267
302244999129,2cyclictest1234-21snmpd20:02:087
302244999128,3cyclictest1234-21snmpd21:03:337
302244999128,3cyclictest1234-21snmpd20:50:087
302244999128,3cyclictest1234-21snmpd19:52:467
302244999126,5cyclictest6895-21gmain20:09:487
302244999126,5cyclictest6032-21gmain20:30:087
302244999125,6cyclictest6895-21gmain19:40:047
302244999125,6cyclictest6895-21gmain19:40:047
302244499128,3cyclictest3547009-21cat23:09:586
302244499121,8cyclictest86-21ksoftirqd/623:30:036
3022444991211,1cyclictest3632721-21kthreadcore23:44:586
3022444991211,1cyclictest3134799-21kthreadcore20:05:026
3022444991211,1cyclictest3098697-21kthreadcore19:45:046
3022444991211,1cyclictest3029598-21kthreadcore19:10:046
3022444991211,1cyclictest0-21swapper/623:05:066
3022444991210,1cyclictest3699635-21ntpq00:10:056
3022444991210,1cyclictest201rcu_preempt21:03:526
3022444991210,1cyclictest0-21swapper/622:40:006
302244399124,7cyclictest3712150-21wc00:15:095
302244399124,7cyclictest3178483-21cat20:25:075
302244399123,8cyclictest3647178-21cut23:50:025
302244399123,7cyclictest3228466-21grep20:55:005
302244399122,4cyclictest3474661-21irqcore22:39:575
302244399121,4cyclictest3260394-21kthreadcore21:10:025
302244399121,4cyclictest3260394-21kthreadcore21:10:025
302244399121,3cyclictest3456514-21kthreadcore22:30:025
3022443991211,1cyclictest0-21swapper/523:13:465
3022443991211,1cyclictest0-21swapper/522:38:565
3022443991211,1cyclictest0-21swapper/522:38:565
3022443991211,1cyclictest0-21swapper/522:23:385
302244399120,4cyclictest3494353-21ntp_states22:45:075
302244399120,2cyclictest0-21swapper/521:40:015
302244399120,1cyclictest0-21swapper/522:49:545
302244999117,3cyclictest1234-21snmpd19:21:527
302244499119,2cyclictest3030632-21kworker/u16:0+events_unbound19:22:576
302244499112,5cyclictest86-21ksoftirqd/621:10:046
302244499112,5cyclictest86-21ksoftirqd/621:10:046
302244499111,6cyclictest86-21ksoftirqd/620:44:556
302244499111,6cyclictest86-21ksoftirqd/619:35:016
3022444991110,1cyclictest3651308-21ntpq23:50:076
3022444991110,1cyclictest3365484-21cstates21:54:556
3022444991110,1cyclictest3107365-21kthreadcore19:50:026
3022444991110,1cyclictest0-21swapper/621:19:576
302244499110,4cyclictest3740533-21irqcore00:30:006
302244399118,2cyclictest3353709-21fschecks_count21:49:565
302244399113,7cyclictest3691574-21expr00:09:555
302244399113,7cyclictest3368929-21cut21:55:015
302244399113,7cyclictest3345518-21cut21:45:025
302244399113,7cyclictest3320346-21cut21:35:015
302244399113,7cyclictest3275161-21tr21:15:035
302244399113,7cyclictest3247496-21uniq21:04:585
302244399113,7cyclictest3035217-21cut19:14:475
302244399112,8cyclictest3415790-21kthreadcore22:15:025
302244399112,8cyclictest3128585-21cut20:00:055
302244399112,8cyclictest3094376-21cat19:44:595
302244399112,7cyclictest3151580-21entropy20:14:565
302244399112,4cyclictest3377283-21cpu21:59:555
302244399112,4cyclictest3214656-21kthreadcore20:45:035
302244399112,3cyclictest3746517-21cut00:30:045
302244399112,3cyclictest3218483-21expr20:49:565
302244399111,2cyclictest3755682-21kthreadcore00:35:035
3022443991110,1cyclictest0-21swapper/520:30:365
3022443991110,1cyclictest0-21swapper/519:54:205
3022443991110,1cyclictest0-21swapper/519:21:325
302244399110,4cyclictest3725999-21taskset00:23:095
302244399110,4cyclictest3558862-21cut23:14:565
302244399110,4cyclictest3558862-21cut23:14:565
302244399110,4cyclictest3405624-21kthreadcore22:10:035
302244399110,2cyclictest0-21swapper/520:09:595
302244399110,10cyclictest3300844-21latency21:25:035
302244999104,4cyclictest3032383-21sed19:14:457
302244399103,6cyclictest3728528-21irqcore00:25:015
302244399103,6cyclictest3655352-21cstates23:54:575
302244399103,6cyclictest3655352-21cstates23:54:575
302244399103,6cyclictest3161194-21grep20:19:555
302244399102,7cyclictest3607614-21cut23:34:595
302244399101,3cyclictest3670747-21cut00:00:025
302244399100,4cyclictest3681300-21cut00:04:595
302244399100,4cyclictest3630806-21cpuspeed_turbos23:44:535
302244399100,4cyclictest3584615-21kthreadcore23:25:015
302244399100,4cyclictest3534329-21cpuspeed_turbos23:04:555
302244399100,4cyclictest3441951-21grep22:25:015
302244399100,4cyclictest3305803-21cut21:29:595
302244399100,4cyclictest3282035-21kthreadcore21:20:005
302244399100,4cyclictest3199173-21grep20:39:555
302244399100,4cyclictest3113618-21sed19:54:595
302244399100,4cyclictest3074600-21grep19:34:565
302244399100,4cyclictest3066569-21grep19:30:015
302244399100,4cyclictest3058326-21kthreadcore19:25:025
302244399100,3cyclictest3131951-21/usr/sbin/munin20:04:565
302244399100,3cyclictest3084821-21iostat_ios19:39:595
302244399100,3cyclictest3084821-21iostat_ios19:39:595
302244399100,3cyclictest3022734-21cat19:09:555
302244299108,2cyclictest3169878-21kworker/u16:1+events_unbound20:40:574
302244299108,2cyclictest3159223-21kworker/u16:2+events_unbound20:51:504
30224429997,2cyclictest3031928-21kworker/u16:1+events_unbound19:53:224
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional