You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-05 - 02:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack0slot2.osadl.org (updated Tue May 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
35989242750,1sleep73598925-21ssh00:21:397
289185824737,7sleep50-21swapper/519:06:545
2892270994442,2cyclictest3307003-21kworker/u16:0+flush-8:023:08:404
2892270994240,2cyclictest3107795-21kworker/u16:4+flush-8:021:29:124
2892270994038,2cyclictest3430368-21kworker/u16:1+events_unbound23:33:394
28917222395,29sleep70-21swapper/719:05:037
289227799360,34cyclictest3236109-21latency_hist21:53:397
2892270993533,2cyclictest3369698-21kworker/u16:2+events_unbound22:59:024
2892277993429,4cyclictest635-21systemd-journal22:13:347
289227799340,32cyclictest635-21systemd-journal23:03:347
289227799340,32cyclictest3624245-21updatedb00:33:357
2892270993432,2cyclictest3107795-21kworker/u16:4+events_unbound21:38:194
2892270993331,2cyclictest3502538-21kworker/u16:0+flush-8:000:09:084
2892270993331,2cyclictest3502538-21kworker/u16:0+flush-8:000:09:084
33224052320,1chrt0-21swapper/622:28:546
2892270993230,2cyclictest3334973-21kworker/u16:4+events_unbound23:56:524
2892277993130,0cyclictest0-21swapper/721:29:057
2892277993129,1cyclictest0-21swapper/721:34:037
2892270993128,2cyclictest3430368-21kworker/u16:1+events_unbound23:41:504
289175723120,8sleep40-21swapper/419:05:324
2892277993025,4cyclictest3138997-21latency_hist21:13:397
2892270993028,2cyclictest3573373-21kworker/u16:2+events_unbound00:32:114
2892270993028,2cyclictest3430368-21kworker/u16:1+events_unbound23:35:114
2892270993028,2cyclictest3334973-21kworker/u16:4+events_unbound23:25:034
2892270992927,2cyclictest3246683-21kworker/u16:0+events_unbound22:04:504
2892270992927,2cyclictest3107795-21kworker/u16:4+events_unbound21:47:124
2892270992926,2cyclictest3430368-21kworker/u16:1+events_unbound00:03:474
2892270992826,2cyclictest3430368-21kworker/u16:1+flush-8:023:46:554
2892270992826,2cyclictest3307003-21kworker/u16:0+events_unbound22:29:354
2892270992725,2cyclictest3430368-21kworker/u16:1+flush-8:023:16:434
2892270992725,2cyclictest3077953-21kworker/u16:1+events_unbound22:22:234
2892270992725,2cyclictest3077953-21kworker/u16:1+events_unbound21:59:124
2892270992725,2cyclictest3077953-21kworker/u16:1+events_unbound21:59:124
2892270992724,2cyclictest3334973-21kworker/u16:4+events_unbound22:43:554
2892270992724,2cyclictest3334973-21kworker/u16:4+events_unbound22:43:554
2892270992624,2cyclictest3107795-21kworker/u16:4+events_unbound21:16:594
2892270992624,2cyclictest3077953-21kworker/u16:1+events_unbound22:15:194
2892270992624,2cyclictest2188985-21kworker/u16:3+flush-8:019:24:024
289168322616,7sleep60-21swapper/619:04:306
2892277992521,3cyclictest635-21systemd-journal21:48:357
2892270992523,2cyclictest3600162-21kworker/u16:4+events_unbound00:28:124
2892270992523,2cyclictest3334973-21kworker/u16:4+events_unbound22:49:494
2892270992523,2cyclictest3223993-21kworker/u16:2+events_unbound21:53:394
2892277992419,4cyclictest3442453-21latency_hist23:18:397
2892270992422,2cyclictest3502538-21kworker/u16:0+events_unbound23:53:064
2892270992422,2cyclictest3430368-21kworker/u16:1+events_unbound23:21:444
2892270992422,2cyclictest3077953-21kworker/u16:1+flush-8:022:40:324
2892270992422,2cyclictest3021180-21kworker/u16:0+events_unbound21:10:404
2892270992321,2cyclictest3573373-21kworker/u16:2+events_unbound00:20:144
2892270992321,2cyclictest3502538-21kworker/u16:0+flush-8:000:01:104
2892270992321,2cyclictest3430368-21kworker/u16:1+events_unbound00:16:314
2892270992321,2cyclictest3369698-21kworker/u16:2+events_unbound22:53:434
2892270992321,2cyclictest3107795-21kworker/u16:4+events_unbound21:23:164
2892270992321,2cyclictest3021180-21kworker/u16:0+flush-8:021:28:354
2892270992321,2cyclictest2892014-21kworker/u16:1+flush-8:019:58:044
2892270992220,2cyclictest3599906-21kworker/u16:3+flush-8:000:36:154
2892270992220,2cyclictest3394003-21kworker/u16:3+events_unbound23:12:564
2892270992220,2cyclictest3307003-21kworker/u16:0+events_unbound22:36:354
2892270992220,2cyclictest3284695-21kworker/u16:3+flush-8:022:28:154
2892270992220,2cyclictest3246683-21kworker/u16:0+events_unbound21:56:294
2892270992220,2cyclictest2892014-21kworker/u16:1+events_unbound19:18:214
2892270992119,2cyclictest3246683-21kworker/u16:0+events_unbound22:10:044
2892270992119,2cyclictest3107795-21kworker/u16:4+events_unbound21:40:364
2892270992119,2cyclictest3040704-21kworker/u16:2+flush-8:020:38:344
2892270992119,2cyclictest2892014-21kworker/u16:1+events_unbound19:53:364
2892270992119,2cyclictest2892014-21kworker/u16:1+events_unbound19:53:364
289227099210,20cyclictest0-21swapper/420:58:554
34765722180,0sleep73476573-21sh23:29:307
2892277991815,2cyclictest1234-21snmpd00:03:357
289227799180,17cyclictest0-21swapper/721:59:067
289227799180,17cyclictest0-21swapper/721:59:067
289227799180,16cyclictest2972892-21latency_hist19:48:407
2892271991813,4cyclictest3148000-21ntpq21:14:045
2892277991712,4cyclictest3539499-21latency_hist23:58:407
2892277991712,4cyclictest3490959-21latency_hist23:38:397
2892273991714,2cyclictest3334973-21kworker/u16:4+flush-8:023:53:446
2892271991715,2cyclictest3077953-21kworker/u16:1+flush-8:021:07:325
2892271991715,2cyclictest2892014-21kworker/u16:1+events_unbound19:13:545
2892277991615,0cyclictest0-21swapper/719:13:447
289227799160,14cyclictest635-21systemd-journal23:53:397
289227799160,14cyclictest0-21swapper/719:54:037
2892271991612,1cyclictest0-21swapper/523:18:565
2892270991614,2cyclictest3040704-21kworker/u16:2+flush-8:020:49:074
2892270991614,2cyclictest3021180-21kworker/u16:0+events_unbound20:54:054
289227799157,7cyclictest6514-21gmain19:39:597
289227799157,7cyclictest5822-21gmain20:08:597
2892277991512,2cyclictest0-21swapper/723:48:397
2892273991514,1cyclictest0-21swapper/622:18:336
2892273991513,2cyclictest3430368-21kworker/u16:1+flush-8:000:14:126
289227199150,1cyclictest0-21swapper/522:56:395
289227199150,14cyclictest3041722-21ps20:23:565
2892270991512,2cyclictest2892014-21kworker/u16:1+events_unbound19:08:434
289227799149,4cyclictest1234-21snmpd20:29:007
289227799148,5cyclictest3098038-21latency_hist20:53:407
2892277991413,0cyclictest0-21swapper/722:31:577
2892277991411,2cyclictest0-21swapper/700:13:397
289227799140,1cyclictest0-21swapper/720:04:037
289227799140,13cyclictest3126916-21diskmemload22:37:467
2892273991412,2cyclictest2188985-21kworker/u16:3+events_unbound19:28:556
2892271991413,1cyclictest0-21swapper/523:02:135
289227199140,14cyclictest0-21swapper/523:50:565
289227199140,14cyclictest0-21swapper/523:35:205
289227199140,14cyclictest0-21swapper/521:24:285
2892270991412,2cyclictest3077953-21kworker/u16:1+events_unbound20:39:104
2892270991412,2cyclictest3021180-21kworker/u16:0+events_unbound20:24:154
2892270991412,2cyclictest3001824-21kworker/u16:4+events_unbound20:12:084
289227099140,1cyclictest0-21swapper/421:08:194
289227799139,3cyclictest3272226-21ssh22:08:087
289227799139,3cyclictest1234-21snmpd21:15:167
289227799139,3cyclictest1234-21snmpd19:10:377
289227799139,3cyclictest1234-21snmpd00:27:517
289227799137,5cyclictest6895-21gmain21:54:117
2892277991312,0cyclictest0-21swapper/721:21:287
289227799130,11cyclictest635-21systemd-journal20:53:407
289227799130,11cyclictest3201507-21kthreadcore21:38:577
2892273991312,1cyclictest0-21swapper/623:25:526
2892273991312,1cyclictest0-21swapper/623:08:516
2892273991312,1cyclictest0-21swapper/621:12:586
2892273991312,1cyclictest0-21swapper/600:05:266
289227399130,13cyclictest0-21swapper/622:07:316
289227199139,3cyclictest3625569-21cat00:33:545
2892271991312,1cyclictest0-21swapper/522:17:365
2892271991312,1cyclictest0-21swapper/500:13:385
2892271991312,1cyclictest0-21swapper/500:13:385
289227199130,13cyclictest0-21swapper/522:43:275
289227199130,13cyclictest0-21swapper/521:44:485
2892270991312,1cyclictest0-21swapper/420:29:034
2892270991311,2cyclictest3021180-21kworker/u16:0+events_unbound20:46:414
289227799129,2cyclictest1234-21snmpd19:35:357
289227799129,2cyclictest0-21swapper/723:09:027
289227799129,2cyclictest0-21swapper/719:24:007
289227799129,2cyclictest0-21swapper/700:08:517
289227799129,2cyclictest0-21swapper/700:08:517
289227799128,3cyclictest6382-21gvfs-afc-volume00:34:027
289227799128,3cyclictest1234-21snmpd22:22:307
289227799128,3cyclictest1234-21snmpd21:08:317
289227799128,3cyclictest1234-21snmpd20:36:247
289227799128,3cyclictest1234-21snmpd20:17:517
2892277991212,0cyclictest0-21swapper/723:26:587
2892277991212,0cyclictest0-21swapper/720:26:087
2892277991211,0cyclictest0-21swapper/719:48:557
2892277991211,0cyclictest0-21swapper/719:48:557
2892277991211,0cyclictest0-21swapper/719:29:067
289227799120,1cyclictest0-21swapper/722:49:057
289227799120,11cyclictest3563724-21turbostat00:08:397
289227799120,10cyclictest1234-21snmpd20:38:577
289227399129,2cyclictest3200960-21fschecks_time21:38:546
289227399128,4cyclictest86-21ksoftirqd/622:02:236
289227399128,4cyclictest86-21ksoftirqd/622:02:236
2892273991211,1cyclictest0-21swapper/622:49:366
2892273991211,1cyclictest0-21swapper/621:56:006
2892273991211,1cyclictest0-21swapper/621:45:076
2892273991211,1cyclictest0-21swapper/600:29:046
289227399120,3cyclictest3171175-21tr21:24:006
2892271991211,1cyclictest0-21swapper/521:55:035
289227199120,1cyclictest0-21swapper/522:28:485
2892270991210,2cyclictest2892014-21kworker/u16:1+events_unbound20:19:044
2892270991210,2cyclictest2188985-21kworker/u16:3+events_unbound20:03:034
289227799119,1cyclictest0-21swapper/722:44:037
289227799119,1cyclictest0-21swapper/722:44:037
289227799118,2cyclictest3454601-21awk23:23:397
289227799117,3cyclictest1234-21snmpd21:25:017
289227799116,5cyclictest6382-21gvfs-afc-volume22:14:507
289227799115,5cyclictest6382-21gvfs-afc-volume20:58:587
289227399119,2cyclictest86-21ksoftirqd/622:18:536
289227399119,2cyclictest86-21ksoftirqd/620:58:566
289227399119,2cyclictest3107795-21kworker/u16:4+flush-8:021:13:446
289227399119,2cyclictest2188985-21kworker/u16:3+flush-8:019:58:556
289227399117,3cyclictest2898928-21kthreadcore19:09:016
2892273991110,1cyclictest0-21swapper/621:34:436
2892273991110,1cyclictest0-21swapper/620:40:396
2892273991110,1cyclictest0-21swapper/620:20:376
289227399110,10cyclictest3589664-21grep00:18:536
289227399110,10cyclictest3479704-21expr23:33:516
289227399110,10cyclictest3317974-21ntpq22:24:056
289227399110,10cyclictest3050574-21cpuspeed_turbos20:28:516
2892271991110,1cyclictest0-21swapper/522:06:155
2892271991110,1cyclictest0-21swapper/521:34:435
2892271991110,1cyclictest0-21swapper/521:02:435
2892271991110,1cyclictest0-21swapper/520:42:325
289227099119,2cyclictest2188985-21kworker/u16:3+events_unbound20:18:044
289227099119,2cyclictest2188985-21kworker/u16:3+events_unbound19:22:594
289227099118,3cyclictest2188985-21kworker/u16:3+flush-8:020:04:004
35501432100,1sleep50-21swapper/500:00:545
289227799107,2cyclictest1234-21snmpd20:46:127
289227799107,2cyclictest0-21swapper/723:38:537
289227799107,2cyclictest0-21swapper/722:38:557
289227799106,4cyclictest6382-21gvfs-afc-volume23:06:207
289227799105,4cyclictest6382-21gvfs-afc-volume22:53:437
289227799105,4cyclictest1234-21snmpd19:19:017
289227399109,1cyclictest0-21swapper/623:43:326
289227399107,2cyclictest3467179-21/usr/sbin/munin23:29:016
289227399107,2cyclictest0-21swapper/623:59:036
289227399107,2cyclictest0-21swapper/622:09:076
289227399106,3cyclictest3334504-21cat22:33:536
289227399105,4cyclictest3451608-21gzip23:19:056
289227399104,6cyclictest0-21swapper/622:53:536
289227399101,8cyclictest3606376-21kthreadcore00:24:006
289227399100,9cyclictest3099135-21perl20:53:546
289227399100,9cyclictest3095474-21cut20:49:016
289227399100,9cyclictest3004254-21kthreadcore20:03:586
289227399100,3cyclictest2966333-21cut19:43:576
289227399100,2cyclictest3122109-21kthreadcore21:04:016
289227399100,2cyclictest3020208-21ntpq20:09:036
289227199106,3cyclictest3528555-21cat23:53:535
289227099108,2cyclictest2953699-21kworker/u16:0+flush-8:019:39:004
289227099108,2cyclictest2892014-21kworker/u16:1+events_unbound19:34:034
28922779996,2cyclictest1234-21snmpd22:23:517
28922779996,2cyclictest1234-21snmpd20:19:007
28922779994,5cyclictest6382-21gvfs-afc-volume20:01:047
28922739997,2cyclictest86-21ksoftirqd/623:15:586
28922739997,2cyclictest86-21ksoftirqd/622:44:336
28922739997,2cyclictest86-21ksoftirqd/622:44:336
28922739996,2cyclictest3021530-21/usr/sbin/munin20:13:546
28922739996,2cyclictest0-21swapper/620:24:066
28922739994,5cyclictest0-21swapper/623:04:026
28922739993,5cyclictest0-21swapper/600:33:566
28922739990,8cyclictest2955340-21cut19:38:566
28922739990,8cyclictest2949907-21kthreadcore19:34:006
28922739990,8cyclictest2915639-21/usr/sbin/munin19:19:096
28922739990,8cyclictest0-21swapper/620:33:526
28922739990,4cyclictest3151954-21cstates21:18:526
28922739990,3cyclictest3564247-21/usr/sbin/munin00:08:516
28922739990,3cyclictest3564247-21/usr/sbin/munin00:08:516
28922739990,2cyclictest3516186-21entropy23:48:526
28922739990,2cyclictest3354124-21latency22:39:006
28922739990,2cyclictest3224426-21/usr/sbin/munin21:48:546
28922739990,2cyclictest3079160-21/usr/sbin/munin20:44:026
28922719996,2cyclictest1011-21lldpd22:28:315
28922719995,3cyclictest3594375-21kthreadcore00:18:565
28922709997,2cyclictest2953699-21kworker/u16:0+flush-8:019:44:044
28922739986,2cyclictest86-21ksoftirqd/623:01:266
28922739986,2cyclictest86-21ksoftirqd/621:28:566
28922739985,2cyclictest0-21swapper/623:43:536
28922739983,4cyclictest2983688-21cat19:53:556
28922739983,4cyclictest2912857-21cut19:14:016
28922739980,3cyclictest2928813-21grep19:23:596
28922739980,1cyclictest0-21swapper/619:48:576
28922739980,1cyclictest0-21swapper/619:48:576
28922719986,1cyclictest0-21swapper/523:28:585
28922719986,1cyclictest0-21swapper/522:08:565
28922719986,1cyclictest0-21swapper/520:43:525
28922719986,1cyclictest0-21swapper/520:34:055
28922719986,1cyclictest0-21swapper/500:28:595
28922719985,2cyclictest3058870-21xargs20:29:075
28922719984,3cyclictest3583385-21cut00:14:005
28922719984,3cyclictest3461440-21cut23:24:015
28922719984,3cyclictest2995730-21cut19:58:595
28922719984,2cyclictest3002359-21cpuspeed_turbos20:03:525
28922719984,1cyclictest681rcuog/423:38:575
28922719983,4cyclictest3602395-21tr00:23:575
28922719983,4cyclictest3303168-21tr22:19:005
28922719983,4cyclictest3127687-21seq21:08:515
28922719983,4cyclictest3092000-21cat20:48:595
28922719983,4cyclictest3027263-21cut20:14:005
28922719983,4cyclictest2985365-21tr19:53:585
28922719983,4cyclictest2968508-21cut19:43:595
28922719983,4cyclictest2927375-21cut19:23:585
28922719983,4cyclictest2900721-21grep19:09:035
28922709986,2cyclictest2188985-21kworker/u16:3+flush-8:019:30:364
28922719975,1cyclictest2954688-21fschecks_time19:38:535
28922719975,1cyclictest0-21swapper/523:13:535
28922719975,1cyclictest0-21swapper/523:08:585
28922719975,1cyclictest0-21swapper/521:58:535
28922719975,1cyclictest0-21swapper/521:58:535
28922719975,1cyclictest0-21swapper/521:48:575
28922719975,1cyclictest0-21swapper/521:38:535
28922719975,1cyclictest0-21swapper/521:28:525
28922719975,1cyclictest0-21swapper/520:53:555
28922719975,1cyclictest0-21swapper/520:18:585
28922719975,1cyclictest0-21swapper/519:33:585
28922719975,1cyclictest0-21swapper/500:03:585
28922719973,3cyclictest3505764-21cut23:43:575
28922719973,3cyclictest3408508-21grep23:03:595
28922719973,3cyclictest3370303-21grep22:48:535
28922719973,3cyclictest3334767-21sed22:33:545
28922719973,3cyclictest2975160-21kthreadcore19:48:585
28922719973,3cyclictest2975160-21kthreadcore19:48:585
28922719973,3cyclictest2935076-21cstates19:28:525
28922719973,3cyclictest2915985-21cat19:18:535
28922719972,4cyclictest3012669-21ip_192.168.115.20:08:555
28922719970,6cyclictest0-21swapper/521:18:575
28922719962,3cyclictest3358186-21expr22:43:515
28922719962,3cyclictest3358186-21expr22:43:515
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional