You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-16 - 05:58
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot2.osadl.org (updated Tue Dec 16, 2025 00:43:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
312913024936,8sleep50-21swapper/519:05:045
3135690994438,5cyclictest3391711-21latency_hist21:19:457
313516524332,8sleep60-21swapper/619:06:346
31344712433,30sleep70-21swapper/719:05:147
313524824030,7sleep40-21swapper/419:07:444
3135689993129,2cyclictest3226737-21kworker/u16:2+flush-8:020:34:456
34282702280,1chrt3428273-21kthreadcore21:35:057
3135689992826,2cyclictest3167503-21kworker/u16:1+events_unbound19:25:516
3135689992724,2cyclictest3215676-21kworker/u16:3+events_unbound21:39:476
3135690992621,4cyclictest3255847-21latency_hist20:09:457
3135690992621,4cyclictest3236427-21latency_hist19:59:457
3135690992518,5cyclictest3731429-21latency_hist00:14:457
3135677992422,2cyclictest3644026-21kworker/u16:2+flush-8:000:14:404
3135689992321,2cyclictest2877171-21kworker/u16:1+events_unbound19:10:076
3135689992321,2cyclictest2427269-21kworker/u16:6+events_unbound22:36:396
3135685992320,2cyclictest3557110-21kworker/u16:1+events_unbound23:19:585
3135689992220,2cyclictest3497538-21kworker/u16:0+events_unbound22:10:516
3135689992220,2cyclictest3497538-21kworker/u16:0+events_unbound22:10:516
3135689992220,2cyclictest3362346-21kworker/u16:0+events_unbound21:16:356
3135689992220,2cyclictest3167503-21kworker/u16:1+events_unbound19:50:206
3135689992220,2cyclictest2427269-21kworker/u16:6+flush-8:022:50:226
3135689992220,2cyclictest2427269-21kworker/u16:6+flush-8:020:28:306
3135689992220,2cyclictest2427269-21kworker/u16:6+events_unbound20:11:446
3135689992219,2cyclictest3197265-21kworker/u16:0+events_unbound19:59:476
3135677992220,2cyclictest3654882-21kworker/u16:1+flush-8:000:25:114
3135689992119,2cyclictest3644026-21kworker/u16:2+events_unbound23:42:256
3135689992119,2cyclictest3557110-21kworker/u16:1+events_unbound22:48:306
3135689992119,2cyclictest3449760-21kworker/u16:0+flush-8:021:59:236
3135689992119,2cyclictest3362346-21kworker/u16:0+events_unbound21:12:356
3135689992119,2cyclictest3215676-21kworker/u16:3+flush-8:021:26:276
3135689992119,2cyclictest1647241-21kworker/u16:0+events_unbound19:16:516
3135677992117,3cyclictest3197265-21kworker/u16:0+flush-8:019:50:104
3135689992018,2cyclictest3732647-21kworker/u16:4+events_unbound00:26:316
3135689992018,2cyclictest3537518-21kworker/u16:0+flush-8:022:42:236
3135689992018,2cyclictest3362346-21kworker/u16:0+flush-8:021:35:086
3135689992018,2cyclictest3362346-21kworker/u16:0+flush-8:021:08:116
3135689992018,2cyclictest3323634-21kworker/u16:0+flush-8:020:43:476
3135689992018,2cyclictest2427269-21kworker/u16:6+events_unbound22:22:586
3135689992018,2cyclictest2427269-21kworker/u16:6+events_unbound20:37:466
3135677992017,2cyclictest3197265-21kworker/u16:0+flush-8:019:55:104
3135689991917,2cyclictest3644026-21kworker/u16:2+flush-8:023:59:426
3135689991917,2cyclictest3595881-21kworker/u16:0+events_unbound23:14:266
3135689991917,2cyclictest3478736-21kworker/u16:2+flush-8:022:16:276
3135689991917,2cyclictest3362346-21kworker/u16:0+flush-8:021:23:226
3135689991917,2cyclictest2427269-21kworker/u16:6+flush-8:020:19:226
3135689991917,2cyclictest2427269-21kworker/u16:6+events_unbound22:07:086
3135689991917,2cyclictest1647241-21kworker/u16:0+events_unbound19:22:316
3135690991816,1cyclictest3760669-21awk00:29:447
313569099180,16cyclictest3605158-21latency_hist23:09:457
3135689991816,2cyclictest3732647-21kworker/u16:4+flush-8:000:33:196
3135689991816,2cyclictest3663760-21kworker/u16:3+events_unbound23:44:456
3135689991816,2cyclictest3595881-21kworker/u16:0+events_unbound23:23:026
3135689991816,2cyclictest3459364-21kworker/u16:4+events_unbound22:32:276
3135689991816,2cyclictest3333833-21kworker/u16:1+events_unbound20:55:356
3135689991816,2cyclictest3167503-21kworker/u16:1+flush-8:019:42:516
3135689991816,2cyclictest3167503-21kworker/u16:1+events_unbound19:38:396
3135689991815,2cyclictest3459364-21kworker/u16:4+flush-8:021:59:456
3135685991815,2cyclictest2427269-21kworker/u16:6+flush-8:021:34:595
313569099170,16cyclictest650-21systemd-journal22:19:397
313569099170,15cyclictest3168462-21latency_hist19:24:457
3135689991715,2cyclictest3654882-21kworker/u16:1+flush-8:023:35:196
3135689991715,2cyclictest3654882-21kworker/u16:1+flush-8:000:13:266
3135689991715,2cyclictest3226737-21kworker/u16:2+events_unbound20:06:476
3135689991715,2cyclictest3215676-21kworker/u16:3+flush-8:021:50:386
3135689991715,2cyclictest3215676-21kworker/u16:3+flush-8:020:45:196
3135689991715,2cyclictest3197265-21kworker/u16:0+events_unbound19:56:356
3135689991715,2cyclictest2427269-21kworker/u16:6+flush-8:020:50:366
3135677991715,2cyclictest3459364-21kworker/u16:4+flush-8:022:45:004
313569099160,14cyclictest1267-21snmpd22:29:177
3135689991614,2cyclictest3732647-21kworker/u16:4+flush-8:000:35:116
3135689991614,2cyclictest3732647-21kworker/u16:4+flush-8:000:35:116
3135689991614,2cyclictest3644026-21kworker/u16:2+flush-8:000:20:436
3135689991614,2cyclictest3333833-21kworker/u16:1+events_unbound21:03:476
3135689991614,2cyclictest3215676-21kworker/u16:3+events_unbound19:47:156
3135689991614,2cyclictest3215676-21kworker/u16:3+events_unbound19:47:156
3135689991614,2cyclictest2427269-21kworker/u16:6+events_unbound23:04:306
3135677991612,3cyclictest3732647-21kworker/u16:4+flush-8:000:34:594
3135677991612,3cyclictest3732647-21kworker/u16:4+flush-8:000:34:594
313569099159,5cyclictest3158781-21latency_hist19:19:457
3135690991513,1cyclictest0-21swapper/700:05:067
3135690991512,2cyclictest0-21swapper/719:49:457
3135690991511,3cyclictest0-21swapper/700:39:447
3135690991511,3cyclictest0-21swapper/700:39:447
313569099150,14cyclictest0-21swapper/721:25:097
313569099150,13cyclictest3673057-21latency_hist23:44:447
3135689991513,2cyclictest3644026-21kworker/u16:2+flush-8:000:00:536
3135689991513,2cyclictest3595881-21kworker/u16:0+events_unbound23:33:066
3135689991513,2cyclictest3557110-21kworker/u16:1+flush-8:022:59:316
3135689991513,2cyclictest3557110-21kworker/u16:1+events_unbound23:19:276
3135689991513,2cyclictest3478736-21kworker/u16:2+events_unbound22:27:516
3135689991513,2cyclictest3362346-21kworker/u16:0+events_unbound21:33:146
3135689991513,2cyclictest3215676-21kworker/u16:3+flush-8:021:48:386
3135689991513,2cyclictest2427269-21kworker/u16:6+flush-8:020:23:386
3135689991513,2cyclictest2426814-21kworker/u16:2+events_unbound19:30:596
3135685991510,4cyclictest3284189-21smart_sda20:20:125
3135677991513,2cyclictest2427269-21kworker/u16:6+events_unbound22:10:024
3135677991513,2cyclictest2427269-21kworker/u16:6+events_unbound22:10:024
313569099149,4cyclictest3537320-21latency_hist22:34:457
313569099149,4cyclictest3214306-21grep19:45:047
313569099149,4cyclictest3214306-21grep19:45:047
313569099146,6cyclictest6450-21gmain20:25:107
3135690991412,1cyclictest0-21swapper/722:10:107
3135690991412,1cyclictest0-21swapper/722:10:107
3135689991412,2cyclictest3654882-21kworker/u16:1+events_unbound23:51:226
3135689991412,2cyclictest3654882-21kworker/u16:1+events_unbound00:06:506
313568999140,14cyclictest0-21swapper/623:24:586
313567799141,5cyclictest0-21swapper/423:40:344
313567799140,14cyclictest0-21swapper/422:50:124
313567799140,14cyclictest0-21swapper/422:20:154
313569099139,3cyclictest1267-21snmpd23:44:497
313569099139,3cyclictest1267-21snmpd23:22:187
313569099139,3cyclictest1267-21snmpd21:59:567
313569099137,5cyclictest3711998-21latency_hist00:04:457
313569099137,5cyclictest3449877-21latency_hist21:49:457
313569099137,5cyclictest3401392-21latency_hist21:24:457
3135690991310,2cyclictest3644003-21munin-run23:29:457
3135690991310,2cyclictest0-21swapper/723:55:087
313569099130,1cyclictest0-21swapper/719:40:077
313569099130,12cyclictest96-21ksoftirqd/721:30:087
3135685991312,1cyclictest0-21swapper/522:52:235
3135685991312,1cyclictest0-21swapper/521:31:595
3135685991312,1cyclictest0-21swapper/521:17:105
313568599130,1cyclictest0-21swapper/520:55:095
313567799130,13cyclictest0-21swapper/423:35:084
313567799130,13cyclictest0-21swapper/423:20:104
313567799130,13cyclictest0-21swapper/422:35:144
313569099129,2cyclictest3352900-21basename20:59:457
313569099128,3cyclictest3652749-21ntpq23:30:087
313569099128,3cyclictest1267-21snmpd23:34:587
313569099128,3cyclictest1267-21snmpd23:03:577
313569099128,3cyclictest1267-21snmpd21:43:527
313569099128,3cyclictest1267-21snmpd20:51:517
313569099128,3cyclictest1267-21snmpd20:31:477
313569099128,3cyclictest1267-21snmpd20:00:317
313569099128,3cyclictest1267-21snmpd19:30:367
313569099128,3cyclictest1267-21snmpd00:34:417
313569099128,3cyclictest1267-21snmpd00:18:347
313569099121,1cyclictest0-21swapper/722:45:037
313569099120,4cyclictest3142022-21kthreadcore19:10:077
313569099120,11cyclictest3517937-21latency_hist22:24:457
313569099120,11cyclictest3275257-21turbostat20:19:447
313569099120,11cyclictest1267-21snmpd22:41:417
313569099120,10cyclictest1267-21snmpd21:05:487
313569099120,10cyclictest0-21swapper/719:25:107
313568599129,2cyclictest3509435-21irqcore22:20:005
3135685991211,1cyclictest0-21swapper/523:57:585
3135685991211,1cyclictest0-21swapper/523:45:125
3135685991211,1cyclictest0-21swapper/523:17:465
3135685991211,1cyclictest0-21swapper/521:12:555
3135685991211,1cyclictest0-21swapper/520:11:355
313568599120,1cyclictest0-21swapper/522:41:505
313568599120,1cyclictest0-21swapper/522:14:245
313568599120,1cyclictest0-21swapper/522:14:245
313568599120,1cyclictest0-21swapper/520:01:015
313568599120,1cyclictest0-21swapper/519:16:345
313568599120,12cyclictest0-21swapper/521:51:045
313568599120,12cyclictest0-21swapper/519:31:235
3135677991211,1cyclictest0-21swapper/421:52:304
3135677991211,1cyclictest0-21swapper/400:22:074
3135677991210,1cyclictest0-21swapper/400:15:124
313567799120,12cyclictest0-21swapper/422:41:424
626589110,2rtkit-daemon0-21swapper/500:12:255
313569099118,2cyclictest1267-21snmpd20:14:117
313569099117,3cyclictest96-21ksoftirqd/720:59:577
313569099117,3cyclictest1267-21snmpd22:49:487
313569099117,3cyclictest1267-21snmpd20:39:577
313569099115,5cyclictest847-21systemd-oomd22:55:037
313569099115,5cyclictest3750914-21latency_hist00:24:447
313569099114,6cyclictest0-21swapper/723:10:257
313569099113,7cyclictest924-21NetworkManager22:05:107
313569099111,9cyclictest0-21swapper/721:50:067
313569099111,2cyclictest0-21swapper/723:50:037
313569099110,3cyclictest3469327-21munin-run21:59:447
313569099110,10cyclictest3624588-21latency_hist23:19:457
313569099110,10cyclictest3373927-21kthreadcore21:10:037
313569099110,10cyclictest3284955-21latency_hist20:24:457
313569099110,10cyclictest0-21swapper/719:35:087
313568599119,2cyclictest3732647-21kworker/u16:4+flush-8:000:20:005
313568599117,3cyclictest3654882-21kworker/u16:1+flush-8:023:50:105
3135685991110,1cyclictest0-21swapper/523:43:095
3135685991110,1cyclictest0-21swapper/523:00:455
3135685991110,1cyclictest0-21swapper/519:44:095
3135685991110,1cyclictest0-21swapper/519:27:075
313568599110,11cyclictest0-21swapper/522:27:005
313568599110,11cyclictest0-21swapper/522:16:275
313568599110,11cyclictest0-21swapper/521:02:215
313568599110,11cyclictest0-21swapper/520:09:325
313568599110,11cyclictest0-21swapper/519:48:245
313568599110,11cyclictest0-21swapper/519:48:245
313568599110,0cyclictest0-21swapper/520:39:105
313567799119,2cyclictest3167503-21kworker/u16:1+flush-8:019:25:024
313567799119,2cyclictest1647241-21kworker/u16:0+flush-8:019:10:004
313567799119,1cyclictest3150114-21fschecks_time19:14:594
313567799118,2cyclictest3315694-21kthreadcore20:40:024
3135677991110,1cyclictest0-21swapper/423:07:244
3135677991110,1cyclictest0-21swapper/421:11:504
3135677991110,1cyclictest0-21swapper/419:46:044
3135677991110,1cyclictest0-21swapper/419:46:044
3135677991110,1cyclictest0-21swapper/419:44:014
3135677991110,1cyclictest0-21swapper/400:30:384
3135677991110,1cyclictest0-21swapper/400:02:534
313567799110,11cyclictest0-21swapper/421:46:034
313567799110,11cyclictest0-21swapper/421:29:014
313567799110,11cyclictest0-21swapper/421:05:224
313567799110,11cyclictest0-21swapper/419:22:354
313569099106,3cyclictest1267-21snmpd20:39:307
313569099105,5cyclictest6344-21gmain22:35:307
313569099104,5cyclictest6045-21gmain20:45:027
313568999109,1cyclictest0-21swapper/600:14:576
313568599109,1cyclictest0-21swapper/523:05:005
313568599109,1cyclictest0-21swapper/522:01:375
313568599109,1cyclictest0-21swapper/521:59:345
313568599109,1cyclictest0-21swapper/520:47:325
313568599109,1cyclictest0-21swapper/519:12:185
313568599107,2cyclictest3641417-21kthreadcore23:25:065
313567799109,1cyclictest0-21swapper/421:22:334
313567799108,2cyclictest3226737-21kworker/u16:2+flush-8:020:10:004
313567799105,4cyclictest3519051-21tune2fs22:24:584
313567799102,7cyclictest0-21swapper/422:05:014
31356899997,2cyclictest3557110-21kworker/u16:1+events_unbound23:04:576
31356859998,1cyclictest0-21swapper/523:38:545
31356859998,1cyclictest0-21swapper/522:58:425
31356859998,1cyclictest0-21swapper/522:35:225
31356859998,1cyclictest0-21swapper/521:27:445
31356859998,1cyclictest0-21swapper/519:54:435
31356859998,1cyclictest0-21swapper/500:25:245
31356859998,1cyclictest0-21swapper/500:14:505
31356859998,1cyclictest0-21swapper/500:08:325
31356859997,2cyclictest3215676-21kworker/u16:3+events_unbound20:39:595
31356779998,1cyclictest0-21swapper/423:54:224
31356779998,1cyclictest0-21swapper/423:47:554
31356779998,1cyclictest0-21swapper/421:16:054
31356779998,1cyclictest0-21swapper/419:31:284
31356779998,1cyclictest0-21swapper/400:09:214
31356779997,2cyclictest2427269-21kworker/u16:6+events_unbound20:15:114
31356779995,3cyclictest3586972-21cat22:59:594
31356779995,3cyclictest3412199-21tune2fs21:29:584
31356779994,4cyclictest3281013-21cut20:20:054
31356779990,8cyclictest3337708-21cut20:50:034
31356859984,3cyclictest3441341-21cat21:45:005
31356859983,4cyclictest3769488-21awk00:30:075
31356859983,4cyclictest3610460-21cut23:10:035
31356859983,4cyclictest3528786-21hostname22:30:005
31356859983,4cyclictest3227117-21grep19:54:565
31356859983,4cyclictest3159474-21cat19:19:555
31356779986,2cyclictest3595881-21kworker/u16:0+flush-8:023:25:104
31356779986,2cyclictest2427269-21kworker/u16:6+flush-8:020:55:114
31356779986,1cyclictest0-21swapper/423:54:584
31356779986,1cyclictest0-21swapper/422:14:594
31356779985,2cyclictest0-21swapper/421:00:054
31356779984,3cyclictest3618489-21kthreadcore23:15:044
31356779984,3cyclictest3532475-21kthreadcore22:30:044
31356779984,3cyclictest3473002-21cat22:00:034
31356779984,3cyclictest3431186-21cstates21:39:584
31356779984,3cyclictest3423321-21kthreadcore21:35:014
31356779983,4cyclictest3608450-21cat23:10:014
31356779983,4cyclictest3249760-21cut20:05:034
31356779983,4cyclictest3188598-21cstates19:34:574
31356779980,7cyclictest3285588-21cpuspeed_turbos20:24:584
31356859975,1cyclictest0-21swapper/523:30:025
31356859975,1cyclictest0-21swapper/521:39:585
31356859975,1cyclictest0-21swapper/521:04:565
31356859975,1cyclictest0-21swapper/520:30:035
31356859973,3cyclictest3771132-21cat00:34:565
31356859973,3cyclictest3771132-21cat00:34:565
31356859973,3cyclictest3557521-21expr22:44:575
31356859973,3cyclictest3479486-21cat22:04:575
31356859973,3cyclictest3393603-21cut21:20:035
31356859973,3cyclictest3188259-21grep19:34:565
31356859973,1cyclictest0-21swapper/520:25:015
31356859972,4cyclictest3702699-21cpuspeed23:59:585
31356859972,4cyclictest3334454-21grep20:49:585
31356859972,4cyclictest3266551-21fschecks_count20:14:585
31356779975,1cyclictest0-21swapper/421:55:034
31356779975,1cyclictest0-21swapper/420:35:024
31356779975,1cyclictest0-21swapper/420:30:024
31356779974,2cyclictest3576742-21cpuspeed_turbos22:54:584
31356779974,2cyclictest0-21swapper/420:00:024
31356779973,3cyclictest3644680-21cstates23:29:574
31356779973,3cyclictest3327400-21cut20:45:024
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional