You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-22 - 03:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Wed Apr 22, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30951712950,1sleep73095172-21rm21:30:457
33155742920,1sleep70-21swapper/723:04:457
31287432540,0sleep60-21swapper/621:44:546
2803034994943,5cyclictest3121356-21latency_hist21:44:327
280260624434,7sleep50-21swapper/519:07:255
28025242411,35sleep70-21swapper/719:06:157
280274723222,7sleep40-21swapper/419:09:254
280274023019,8sleep60-21swapper/619:09:196
2803034992928,0cyclictest0-21swapper/719:59:497
2803034992716,9cyclictest635-21systemd-journal23:59:307
2803033992422,2cyclictest3387383-21kworker/u16:3+flush-8:000:20:286
2803024992420,3cyclictest3336695-21kworker/u16:0+flush-8:023:54:324
2803034992320,2cyclictest3458230-21sh00:01:077
2803034992320,2cyclictest3458230-21sh00:01:077
280303499220,20cyclictest3423825-21latency_hist23:49:317
2803033992220,2cyclictest3375656-21kworker/u16:2+events_unbound23:35:056
2803033992220,2cyclictest2719700-21kworker/u16:1+events_unbound19:19:376
2803024992220,2cyclictest3448385-21kworker/u16:1+events_unbound00:02:484
2803024992220,2cyclictest3448385-21kworker/u16:1+events_unbound00:02:484
2803024992219,2cyclictest2864373-21kworker/u16:3+flush-8:019:49:374
2803033992119,2cyclictest2999496-21kworker/u16:3+events_unbound21:25:016
2803033992119,2cyclictest2950413-21kworker/u16:4+flush-8:021:19:566
2803033992119,2cyclictest2864373-21kworker/u16:3+events_unbound20:09:456
2803034992016,3cyclictest1234-21snmpd00:11:437
280303499200,18cyclictest3472301-21cat00:09:317
2803033992018,2cyclictest3469792-21kworker/u16:0+flush-8:000:35:006
2803033992018,2cyclictest2719700-21kworker/u16:1+events_unbound19:14:346
2803034991913,5cyclictest3145561-21latency_hist21:54:317
2803033991917,2cyclictest3314730-21kworker/u16:4+events_unbound23:24:456
2803033991917,2cyclictest3058550-21kworker/u16:0+flush-8:022:14:466
2803034991815,2cyclictest1234-21snmpd22:49:147
2803034991814,3cyclictest1234-21snmpd22:59:147
2803034991813,4cyclictest3375233-21latency_hist23:29:317
280303499180,1cyclictest0-21swapper/720:09:557
2803033991816,2cyclictest2774584-21kworker/u16:2+events_unbound19:44:546
2803033991816,2cyclictest2719700-21kworker/u16:1+events_unbound19:25:256
2803024991815,2cyclictest3519644-21kworker/u16:1+flush-8:000:29:514
2803024991814,3cyclictest3194147-21kworker/u16:1+flush-8:023:14:494
280303499179,7cyclictest6895-21gmain19:44:567
2803034991715,1cyclictest0-21swapper/723:39:497
2803034991713,3cyclictest1234-21snmpd19:26:427
2803034991712,4cyclictest3218061-21latency_hist22:24:327
280303499170,1cyclictest0-21swapper/719:34:557
280303499170,15cyclictest3254339-21latency_hist22:39:317
2803033991715,2cyclictest3469792-21kworker/u16:0+flush-8:000:14:476
2803033991715,2cyclictest3112133-21kworker/u16:2+events_unbound21:39:506
2803033991715,2cyclictest3058550-21kworker/u16:0+events_unbound21:35:136
2803033991715,2cyclictest3058550-21kworker/u16:0+events_unbound21:29:456
2803033991715,2cyclictest2950413-21kworker/u16:4+flush-8:021:10:006
2803029991714,3cyclictest3469792-21kworker/u16:0+flush-8:000:09:315
2803034991611,4cyclictest3193946-21latency_hist22:14:317
280303499160,14cyclictest3505308-21ssh00:19:557
280303499160,14cyclictest2803021-21cyclictest20:19:547
280303499160,14cyclictest1234-21snmpd00:24:597
280303499160,14cyclictest0-21swapper/720:44:547
2803033991614,2cyclictest3387383-21kworker/u16:3+events_unbound00:29:566
2803033991614,2cyclictest3218531-21kworker/u16:4+flush-8:022:49:266
2803033991614,2cyclictest2979179-21kworker/u16:0+flush-8:021:00:016
2803033991614,2cyclictest2825879-21kworker/u16:4+events_unbound19:38:276
280302999164,5cyclictest0-21swapper/520:29:145
2803024991614,2cyclictest2774584-21kworker/u16:2+events_unbound20:03:474
280303499159,5cyclictest3338974-21latency_hist23:14:317
280303499150,14cyclictest0-21swapper/719:54:547
280303499150,13cyclictest0-21swapper/722:04:577
2803033991513,2cyclictest3448385-21kworker/u16:1+events_unbound00:00:336
2803033991513,2cyclictest3448385-21kworker/u16:1+events_unbound00:00:336
2803033991513,2cyclictest3387383-21kworker/u16:3+events_unbound00:04:576
2803033991513,2cyclictest3278542-21kworker/u16:0+events_unbound22:54:456
2803033991513,2cyclictest2864373-21kworker/u16:3+events_unbound20:34:566
2803033991513,2cyclictest2719700-21kworker/u16:1+events_unbound19:39:456
2803024991513,2cyclictest3058550-21kworker/u16:0+events_unbound22:09:464
2803024991513,2cyclictest2774584-21kworker/u16:2+flush-8:019:30:054
280303499149,4cyclictest3544683-21latency_hist00:39:307
280303499140,1cyclictest0-21swapper/700:14:557
2803033991412,2cyclictest3375656-21kworker/u16:2+flush-8:023:29:556
2803033991412,2cyclictest3314730-21kworker/u16:4+flush-8:023:09:556
2803033991412,2cyclictest3194147-21kworker/u16:1+events_unbound23:20:336
2803033991412,2cyclictest3112133-21kworker/u16:2+events_unbound22:09:566
2803033991412,2cyclictest3058550-21kworker/u16:0+flush-8:021:15:206
2803033991412,2cyclictest2999496-21kworker/u16:3+flush-8:022:35:116
2803033991412,2cyclictest2999496-21kworker/u16:3+events_unbound22:04:516
2803033991412,2cyclictest2864373-21kworker/u16:3+flush-8:020:00:016
2803029991413,1cyclictest0-21swapper/523:05:555
2803029991413,1cyclictest0-21swapper/522:44:005
2803029991413,1cyclictest0-21swapper/500:02:215
2803029991413,1cyclictest0-21swapper/500:02:215
280302999140,1cyclictest0-21swapper/522:29:205
280302999140,14cyclictest0-21swapper/521:25:015
2803024991413,1cyclictest0-21swapper/423:43:574
2803024991413,1cyclictest0-21swapper/422:05:344
2803024991413,1cyclictest0-21swapper/421:50:174
2803024991413,1cyclictest0-21swapper/421:26:004
2803024991413,1cyclictest0-21swapper/421:13:424
2803024991413,1cyclictest0-21swapper/400:13:264
2803024991412,1cyclictest0-21swapper/422:49:534
280302499140,1cyclictest0-21swapper/422:20:234
280302499140,14cyclictest0-21swapper/423:05:384
280302499140,14cyclictest0-21swapper/422:46:244
280302499140,14cyclictest0-21swapper/422:33:194
280303499139,3cyclictest3314485-21sh23:04:077
280303499139,3cyclictest1234-21snmpd20:51:387
280303499139,3cyclictest1234-21snmpd19:40:317
280303499139,3cyclictest1234-21snmpd19:21:157
280303499138,4cyclictest6382-21gvfs-afc-volume00:29:547
280303499137,5cyclictest5975-21gmain21:38:447
280303499136,6cyclictest6382-21gvfs-afc-volume23:34:587
280303399139,3cyclictest2913238-21cat20:04:486
280303399139,3cyclictest2894096-21cat19:54:476
280303399133,4cyclictest3509147-21grep00:24:436
2803033991311,2cyclictest3314730-21kworker/u16:4+events_unbound23:45:126
2803033991311,2cyclictest3194147-21kworker/u16:1+events_unbound23:16:176
2803033991311,2cyclictest2999496-21kworker/u16:3+events_unbound23:08:076
2803033991311,2cyclictest2999496-21kworker/u16:3+events_unbound20:49:566
2803033991311,2cyclictest2719700-21kworker/u16:1+events_unbound19:12:476
280303399130,1cyclictest0-21swapper/622:02:076
2803029991312,1cyclictest0-21swapper/521:36:505
2803029991312,1cyclictest0-21swapper/521:10:305
2803029991310,1cyclictest681rcuog/423:10:285
280302999130,1cyclictest0-21swapper/500:14:555
280302999130,13cyclictest0-21swapper/521:54:305
280303499128,3cyclictest1234-21snmpd23:33:067
280303499128,3cyclictest1234-21snmpd20:56:087
280303499127,4cyclictest3122637-21cat21:44:477
280303499126,5cyclictest6382-21gvfs-afc-volume20:39:587
280303499120,1cyclictest0-21swapper/721:04:587
280303499120,11cyclictest1234-21snmpd23:50:407
280303499120,11cyclictest1234-21snmpd19:14:277
280303399123,1cyclictest86-21ksoftirqd/622:23:556
2803033991210,2cyclictest3408594-21kworker/u16:5+events_unbound23:59:176
2803033991210,2cyclictest3194147-21kworker/u16:1+events_unbound22:24:476
2803033991210,2cyclictest3112133-21kworker/u16:2+flush-8:021:55:256
2803033991210,2cyclictest3112133-21kworker/u16:2+flush-8:021:55:256
2803033991210,2cyclictest3058550-21kworker/u16:0+events_unbound21:52:236
2803033991210,2cyclictest2774584-21kworker/u16:2+events_unbound20:14:566
280302999129,2cyclictest3299374-21needreboot22:54:545
280302999128,3cyclictest2855807-21cat19:34:475
2803029991211,1cyclictest0-21swapper/520:35:025
280302499129,2cyclictest3006875-21strings20:49:544
280302499128,3cyclictest3194147-21kworker/u16:1+flush-8:023:09:484
2803024991211,1cyclictest0-21swapper/421:36:344
2803024991211,1cyclictest0-21swapper/420:21:504
2803024991211,1cyclictest0-21swapper/419:59:264
2803024991210,2cyclictest2719700-21kworker/u16:1+events_unbound19:44:464
280303499118,2cyclictest6101-21gmain21:54:487
280303499118,2cyclictest6101-21gmain21:54:487
280303499118,2cyclictest1234-21snmpd23:21:337
280303499118,2cyclictest1234-21snmpd22:03:227
280303499118,2cyclictest0-21swapper/722:14:507
280303499118,2cyclictest0-21swapper/721:09:487
280303499117,4cyclictest6382-21gvfs-afc-volume22:30:467
280303499117,3cyclictest5975-21gmain20:59:447
280303499117,3cyclictest1234-21snmpd21:18:037
280303499117,3cyclictest1234-21snmpd20:39:237
280303499117,3cyclictest1234-21snmpd20:16:197
280303499115,5cyclictest6382-21gvfs-afc-volume22:24:387
280303499115,5cyclictest6382-21gvfs-afc-volume21:23:027
280303499115,5cyclictest6101-21gmain22:49:447
280303499110,10cyclictest1234-21snmpd19:53:227
280303499110,10cyclictest1234-21snmpd19:30:517
280303499110,10cyclictest0-21swapper/720:04:567
280303399119,2cyclictest3314730-21kworker/u16:4+events_unbound00:11:246
280303399119,2cyclictest3194147-21kworker/u16:1+events_unbound23:03:046
280303399119,2cyclictest2999496-21kworker/u16:3+events_unbound21:08:426
280303399119,2cyclictest2950413-21kworker/u16:4+events_unbound20:39:456
280303399119,2cyclictest2864373-21kworker/u16:3+flush-8:020:25:006
280303399116,4cyclictest86-21ksoftirqd/622:29:496
280303399113,7cyclictest3261683-21kthreadcore22:39:526
280303399112,8cyclictest3403181-21cut23:39:506
280303399112,8cyclictest3284139-21cut22:49:486
280303399110,3cyclictest3010499-21cut20:54:496
2803029991110,1cyclictest0-21swapper/522:14:225
2803029991110,1cyclictest0-21swapper/520:02:245
280302499119,2cyclictest2999496-21kworker/u16:3+events_unbound20:59:454
280303499107,2cyclictest0-21swapper/723:14:447
280303499107,2cyclictest0-21swapper/722:39:517
280303499106,3cyclictest1234-21snmpd20:28:267
280303499105,4cyclictest1206-21containerd19:14:357
280303499100,9cyclictest1234-21snmpd20:30:357
280303499100,9cyclictest1234-21snmpd20:30:357
280303399108,2cyclictest2719700-21kworker/u16:1+events_unbound19:31:386
280303399107,2cyclictest2864373-21kworker/u16:3+events_unbound20:29:336
280303399107,2cyclictest2864373-21kworker/u16:3+events_unbound20:29:336
280303399100,9cyclictest3427535-21cat23:49:486
280302999107,2cyclictest2939990-21find20:14:585
280302999107,2cyclictest1011-21lldpd21:59:145
280302999107,2cyclictest1011-21lldpd21:59:145
280302999106,3cyclictest3425115-21cat23:49:455
280302999104,1cyclictest681rcuog/423:30:585
280302999102,5cyclictest2829350-21kthreadcore19:19:495
280302499108,2cyclictest3314730-21kworker/u16:4+flush-8:023:25:094
280302499108,2cyclictest2719700-21kworker/u16:1+events_unbound19:34:464
280302499106,3cyclictest3352370-21cat23:19:474
280302499100,5cyclictest0-21swapper/423:29:464
28030349994,4cyclictest6101-21gmain21:24:487
28030339995,3cyclictest2884524-21cat19:49:476
28030339992,6cyclictest2941178-21/usr/sbin/munin20:19:466
28030339990,8cyclictest2993359-21tr20:44:506
28030299996,2cyclictest3061649-21tr21:19:445
28030299996,2cyclictest2774584-21kworker/u16:2+flush-8:020:04:505
28030299996,2cyclictest0-21swapper/523:54:465
28030299995,3cyclictest3110661-21cat21:39:465
28030299995,3cyclictest3009081-21interrupts20:54:475
28030299994,4cyclictest3511195-21cut00:24:485
28030249997,2cyclictest2719700-21kworker/u16:1+flush-8:019:19:324
28030249995,3cyclictest3462752-21kthreadcore00:04:504
28030249995,3cyclictest3255416-21tune2fs22:39:464
28030249995,3cyclictest3086368-21cat21:29:464
28030249994,4cyclictest3311770-21smart_sda22:59:574
28030299987,1cyclictest0-21swapper/519:09:355
28030299986,1cyclictest0-21swapper/523:44:515
28030299986,1cyclictest0-21swapper/523:14:525
28030299986,1cyclictest0-21swapper/520:59:485
28030299986,1cyclictest0-21swapper/520:49:445
28030299986,1cyclictest0-21swapper/520:44:495
28030299986,1cyclictest0-21swapper/520:09:495
28030299985,3cyclictest3194147-21kworker/u16:1+flush-8:023:01:075
28030299985,2cyclictest0-21swapper/523:24:515
28030299984,3cyclictest3473434-21if_err_p4p100:09:465
28030299984,3cyclictest3086367-21cat21:29:465
28030299983,4cyclictest3541628-21awk00:34:585
28030299983,4cyclictest3522983-21cut00:29:475
28030299983,4cyclictest3396239-21missed_timers23:34:535
28030299983,4cyclictest3282787-21cut22:49:475
28030299983,4cyclictest3231901-21cut22:29:485
28030299983,4cyclictest3213293-21grep22:19:525
28030299983,4cyclictest3198997-21cut22:14:505
28030299983,4cyclictest3172782-21cut22:04:505
28030299983,4cyclictest3054605-21grep21:14:525
28030299983,4cyclictest2961600-21kernelversion20:29:485
28030299983,4cyclictest2961600-21kernelversion20:29:485
28030299983,4cyclictest2897310-21cut19:54:505
28030299983,4cyclictest2883896-21tr19:49:445
28030299983,4cyclictest2875503-21cut19:44:485
28030299983,4cyclictest2837826-21tr19:24:495
28030299981,4cyclictest3243036-21expr22:34:445
28030299980,5cyclictest2941465-21cat20:19:445
28030249985,2cyclictest2864554-21/usr/sbin/munin19:39:434
28030249985,2cyclictest0-21swapper/423:49:504
28030249985,2cyclictest0-21swapper/420:14:494
28030249984,3cyclictest3533744-21tune2fs00:34:474
28030249984,3cyclictest3226892-21sed22:24:544
28030249984,3cyclictest3013283-21cut20:54:524
28030249984,3cyclictest2980099-21uniq20:39:454
28030249984,3cyclictest2837156-21kthreadcore19:24:484
28030249983,4cyclictest3246548-21grep22:34:504
28030249983,4cyclictest3195398-21sed22:14:474
28030249983,4cyclictest3146256-21expr21:54:444
28030249983,4cyclictest3146256-21expr21:54:444
28030249983,4cyclictest3115259-21cut21:39:504
28030249983,4cyclictest3062079-21grep21:19:464
28030249983,4cyclictest3049970-21perl21:14:474
28030249983,4cyclictest2972667-21cut20:34:514
28030249983,4cyclictest2963934-21grep20:29:504
28030249983,4cyclictest2963934-21grep20:29:504
28030249983,4cyclictest2922253-21tr20:09:444
28030249983,4cyclictest2913184-21tune2fs20:04:474
28030249983,4cyclictest2809712-21cut19:09:514
28030249980,7cyclictest0-21swapper/422:54:474
28030249980,7cyclictest0-21swapper/400:19:494
28030249980,1cyclictest0-21swapper/420:44:484
28030299975,1cyclictest0-21swapper/521:59:495
28030299975,1cyclictest0-21swapper/519:14:335
28030299974,3cyclictest3027825-21cstates21:04:445
28030299974,2cyclictest3400002-21cpu23:39:445
28030299974,2cyclictest0-21swapper/523:19:445
28030299974,2cyclictest0-21swapper/522:44:435
28030299973,3cyclictest2982939-21kthreadcore20:39:495
28030299972,4cyclictest3497082-21expr00:19:435
28030299972,4cyclictest3121923-21cpuspeed_turbos21:44:435
28030299972,4cyclictest2864602-21awk19:39:445
28030299972,4cyclictest2846626-21cut19:29:485
28030249975,1cyclictest0-21swapper/423:44:494
28030249975,1cyclictest0-21swapper/423:34:444
28030249975,1cyclictest0-21swapper/421:59:484
28030249974,2cyclictest3484802-21cpuspeed_turbos00:14:424
28030249973,3cyclictest3027830-21expr21:04:444
28030249973,3cyclictest2950822-21cat20:24:444
28030249973,3cyclictest2826621-21cat19:19:434
28030249972,4cyclictest3509195-21cat00:24:434
28030249950,4cyclictest3121826-21munin-node21:44:434
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional