You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 18:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack0slot2.osadl.org (updated Wed Apr 15, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
10318872670,1sleep60-21swapper/611:22:556
10318872670,1sleep60-21swapper/611:22:556
9733452650,1sleep7973346-21sh11:00:137
46925225848,7sleep40-21swapper/407:07:084
469757994843,4cyclictest996608-21latency_hist11:09:577
469757994137,3cyclictest715237-21latency_hist09:14:577
4685282413,31sleep70-21swapper/707:05:277
469757994035,4cyclictest862046-21latency_hist10:14:577
469752993936,2cyclictest935791-21kworker/u16:0+events_unbound10:49:595
469752993634,2cyclictest935791-21kworker/u16:0+events_unbound11:00:585
469757993428,5cyclictest664666-21latency_hist08:49:577
469752993432,2cyclictest540495-21kworker/u16:3+events_unbound09:29:595
469752993230,2cyclictest883938-21kworker/u16:1+events_unbound10:35:225
11886992310,1chrt1188700-21sh12:25:317
10692542310,1chrt1069255-21sh11:39:397
46920923019,7sleep60-21swapper/607:06:306
469757992924,4cyclictest1057267-21latency_hist11:34:577
469752992927,2cyclictest995344-21kworker/u16:1+flush-8:011:10:175
469752992925,3cyclictest664339-21kworker/u16:0+events_unbound09:40:095
46920822917,9sleep50-21swapper/507:06:295
469752992826,2cyclictest935791-21kworker/u16:0+flush-8:010:47:585
469752992826,2cyclictest1176735-21kworker/u16:0+events_unbound12:34:525
469752992825,2cyclictest727926-21kworker/u16:1+events_unbound10:00:505
469757992726,0cyclictest0-21swapper/711:29:117
469757992725,1cyclictest0-21swapper/710:51:397
469757992721,5cyclictest635-21systemd-journal10:34:567
469752992725,2cyclictest764571-21kworker/u16:2+events_unbound09:54:525
469752992725,2cyclictest478222-21kworker/u16:2+flush-8:007:29:585
469752992724,2cyclictest664339-21kworker/u16:0+events_unbound09:20:115
469752992724,2cyclictest1009282-21kworker/u16:0+flush-8:011:49:585
469757992623,2cyclictest1104705-21ssh11:52:557
469752992624,2cyclictest947760-21kworker/u16:3+flush-8:012:05:265
469752992624,2cyclictest935791-21kworker/u16:0+events_unbound11:06:305
469752992624,2cyclictest883938-21kworker/u16:1+events_unbound10:33:075
469752992624,2cyclictest727926-21kworker/u16:1+flush-8:010:10:315
469752992624,2cyclictest664339-21kworker/u16:0+flush-8:009:45:005
469752992624,2cyclictest664339-21kworker/u16:0+flush-8:009:15:205
469752992624,2cyclictest664339-21kworker/u16:0+flush-8:009:15:205
469752992624,2cyclictest1176735-21kworker/u16:0+events_unbound12:26:065
469757992524,0cyclictest0-21swapper/712:08:257
469757992524,0cyclictest0-21swapper/711:13:187
469757992524,0cyclictest0-21swapper/709:29:437
469757992523,1cyclictest1116794-21ssh11:57:517
469757992523,1cyclictest0-21swapper/709:33:197
469757992522,2cyclictest787689-21ssh09:43:117
469752992523,2cyclictest727926-21kworker/u16:1+flush-8:009:55:025
469752992522,2cyclictest822143-21kworker/u16:4+events_unbound10:15:005
469757992423,0cyclictest0-21swapper/712:31:377
469757992423,0cyclictest0-21swapper/712:13:027
469757992423,0cyclictest0-21swapper/712:02:597
469757992423,0cyclictest0-21swapper/712:02:597
469757992423,0cyclictest0-21swapper/710:45:537
469757992423,0cyclictest0-21swapper/710:16:187
469757992423,0cyclictest0-21swapper/709:38:467
469752992422,2cyclictest947760-21kworker/u16:3+flush-8:011:42:025
469752992422,2cyclictest947760-21kworker/u16:3+events_unbound11:45:275
469752992422,2cyclictest947760-21kworker/u16:3+events_unbound11:37:465
469752992422,2cyclictest664339-21kworker/u16:0+events_unbound10:09:365
469752992422,2cyclictest1033054-21kworker/u16:2+events_unbound11:29:145
469752992422,2cyclictest1009282-21kworker/u16:0+flush-8:011:24:075
469752992422,2cyclictest1009282-21kworker/u16:0+flush-8:011:24:075
469757992322,0cyclictest0-21swapper/708:21:517
469757992322,0cyclictest0-21swapper/708:08:167
469757992322,0cyclictest0-21swapper/707:44:127
469752992321,2cyclictest540495-21kworker/u16:3+flush-8:009:26:035
469757992221,0cyclictest0-21swapper/711:22:337
469757992221,0cyclictest0-21swapper/711:22:337
469757992221,0cyclictest0-21swapper/711:17:057
469757992221,0cyclictest0-21swapper/707:11:477
469752992220,2cyclictest886626-21kworker/u16:2+events_unbound10:56:085
469752992220,2cyclictest883938-21kworker/u16:1+events_unbound10:24:445
469752992220,2cyclictest862473-21kworker/u16:3+flush-8:010:29:075
469752992220,2cyclictest636373-21kworker/u16:1+flush-8:008:45:155
469752992220,2cyclictest1176735-21kworker/u16:0+flush-8:012:35:185
469757992120,0cyclictest0-21swapper/709:22:337
469757992120,0cyclictest0-21swapper/708:28:207
469757992120,0cyclictest0-21swapper/708:02:447
469757992115,5cyclictest511620-21latency_hist07:29:587
469755992116,4cyclictest982017-21packagekitd11:00:596
469752992119,2cyclictest886626-21kworker/u16:2+events_unbound10:40:195
469752992119,2cyclictest540495-21kworker/u16:3+events_unbound09:35:105
469752992119,2cyclictest540495-21kworker/u16:3+events_unbound09:14:475
469752992119,2cyclictest1130559-21kworker/u16:4+flush-8:012:13:595
469752992119,2cyclictest1115606-21kworker/u16:2+events_unbound12:01:015
469752992119,2cyclictest1115606-21kworker/u16:2+events_unbound12:01:015
469752992118,2cyclictest1009282-21kworker/u16:0+events_unbound11:15:065
469757992019,0cyclictest0-21swapper/712:20:037
469757992019,0cyclictest0-21swapper/710:58:497
469757992019,0cyclictest0-21swapper/709:16:537
469757992019,0cyclictest0-21swapper/709:16:537
469757992019,0cyclictest0-21swapper/709:02:327
469757992019,0cyclictest0-21swapper/707:32:447
469757992019,0cyclictest0-21swapper/707:19:237
469752992018,2cyclictest947760-21kworker/u16:3+events_unbound12:22:065
469757991918,0cyclictest0-21swapper/710:35:057
469752991917,2cyclictest636373-21kworker/u16:1+flush-8:009:05:215
469757991817,0cyclictest0-21swapper/710:27:337
469757991817,0cyclictest0-21swapper/708:56:447
469757991817,0cyclictest0-21swapper/708:50:447
469757991816,1cyclictest0-21swapper/709:45:457
469752991816,2cyclictest636373-21kworker/u16:1+flush-8:008:44:525
469757991716,0cyclictest0-21swapper/708:16:277
469757991715,1cyclictest703028-21diskmemload12:15:117
469755991713,1cyclictest0-21swapper/610:49:076
469752991715,2cyclictest578556-21kworker/u16:4+flush-8:008:15:215
469752991715,2cyclictest1009282-21kworker/u16:0+flush-8:011:30:215
469752991715,2cyclictest1009282-21kworker/u16:0+events_unbound11:57:155
46975799168,7cyclictest6895-21gmain08:40:187
469757991615,0cyclictest0-21swapper/711:45:497
469757991615,0cyclictest0-21swapper/708:10:517
469747991614,2cyclictest935791-21kworker/u16:0+flush-8:011:01:064
469757991514,0cyclictest0-21swapper/710:08:497
469757991514,0cyclictest0-21swapper/708:38:517
469757991514,0cyclictest0-21swapper/707:45:357
469757991514,0cyclictest0-21swapper/707:45:357
469757991514,0cyclictest0-21swapper/707:23:357
469757991513,1cyclictest559490-21cat07:54:577
469755991513,2cyclictest947760-21kworker/u16:3+flush-8:011:25:076
469752991513,2cyclictest947760-21kworker/u16:3+events_unbound12:16:065
469752991513,2cyclictest540495-21kworker/u16:3+flush-8:008:35:235
469752991513,2cyclictest511315-21kworker/u16:0+events_unbound08:00:175
46975799149,3cyclictest1234-21snmpd07:57:527
469757991413,0cyclictest0-21swapper/709:09:367
469755991413,1cyclictest0-21swapper/611:56:086
469755991413,1cyclictest0-21swapper/610:29:256
469755991413,1cyclictest0-21swapper/610:12:526
469755991413,1cyclictest0-21swapper/609:49:316
469755991413,1cyclictest0-21swapper/609:15:286
469755991413,1cyclictest0-21swapper/609:15:286
469755991413,1cyclictest0-21swapper/609:03:106
46975599140,1cyclictest0-21swapper/610:00:056
46975599140,1cyclictest0-21swapper/609:39:076
469752991412,2cyclictest664884-21kworker/u16:4+flush-8:008:55:135
46974799140,1cyclictest0-21swapper/412:17:074
46974799140,1cyclictest0-21swapper/412:09:524
46974799140,1cyclictest0-21swapper/410:18:144
46974799140,14cyclictest0-21swapper/409:27:104
469757991312,0cyclictest0-21swapper/707:39:407
469755991312,1cyclictest0-21swapper/608:35:076
469755991310,2cyclictest0-21swapper/608:40:136
46975599130,1cyclictest0-21swapper/608:08:286
46975599130,1cyclictest0-21swapper/608:04:226
46975599130,13cyclictest0-21swapper/608:11:476
46975599130,13cyclictest0-21swapper/607:59:106
46975299138,4cyclictest522346-21cat07:35:115
46975299130,13cyclictest0-21swapper/507:53:045
46974799139,3cyclictest1058556-21cat11:35:124
469747991312,1cyclictest0-21swapper/412:14:264
469747991312,1cyclictest0-21swapper/409:20:194
469747991312,1cyclictest0-21swapper/409:13:364
46974799130,1cyclictest0-21swapper/412:21:134
46974799130,1cyclictest0-21swapper/408:25:234
46974799130,13cyclictest0-21swapper/410:48:024
46975799129,2cyclictest1234-21snmpd10:02:587
46975799129,2cyclictest0-21swapper/709:55:237
46975799128,3cyclictest1234-21snmpd11:40:487
469755991211,1cyclictest0-21swapper/611:09:566
469755991211,1cyclictest0-21swapper/609:26:216
469755991211,1cyclictest0-21swapper/607:54:356
46975599120,1cyclictest0-21swapper/607:37:156
46975599120,1cyclictest0-21swapper/607:17:146
46975599120,12cyclictest0-21swapper/609:40:226
469752991211,1cyclictest0-21swapper/508:52:315
469752991210,2cyclictest478222-21kworker/u16:2+flush-8:007:40:105
46975299120,1cyclictest0-21swapper/507:23:165
469747991211,1cyclictest0-21swapper/412:25:094
469747991211,1cyclictest0-21swapper/409:42:554
46974799120,1cyclictest0-21swapper/408:38:174
46974799120,12cyclictest0-21swapper/409:58:414
46975799118,2cyclictest810958-21ssh09:51:077
46975799118,2cyclictest1234-21snmpd10:43:477
46975799118,2cyclictest1234-21snmpd08:33:297
46975799117,3cyclictest1234-21snmpd12:39:567
46975799117,3cyclictest1234-21snmpd10:24:027
46975599118,2cyclictest1066252-21ntpq11:35:206
46975599118,2cyclictest0-21swapper/608:15:156
46975599117,3cyclictest663328-21kthreadcore08:45:176
469755991110,1cyclictest0-21swapper/608:34:576
46975599110,4cyclictest840378-21cut10:05:136
46975599110,4cyclictest519972-21sed07:30:186
46975599110,3cyclictest1200104-21grep12:30:176
46975599110,3cyclictest1146623-21kthreadcore12:10:136
46975599110,2cyclictest882236-21cut10:20:156
46975599110,10cyclictest678024-21grep08:55:166
46975299119,2cyclictest578556-21kworker/u16:4+flush-8:008:09:535
46974799118,2cyclictest889575-21kthreadcore10:25:144
469747991110,1cyclictest0-21swapper/407:37:164
46974799110,11cyclictest0-21swapper/408:23:184
46974799110,11cyclictest0-21swapper/407:23:334
46975599107,2cyclictest711951-21ntpq09:10:206
46975599107,2cyclictest625493-21ntpq08:25:226
46975599107,2cyclictest537290-21grep07:40:176
46975599107,2cyclictest1212241-21ntpq12:35:196
46975599107,2cyclictest0-21swapper/610:35:226
46975599106,3cyclictest997918-21cat11:10:126
46975599105,4cyclictest864021-21kthreadcore10:15:126
46975599105,4cyclictest804188-21grep09:50:156
46975599104,5cyclictest0-21swapper/609:55:146
46975599102,7cyclictest1120178-21tr12:00:136
46975599102,7cyclictest1120178-21tr12:00:136
46975599100,9cyclictest548526-21cut07:45:196
46975599100,9cyclictest548526-21cut07:45:196
46975599100,9cyclictest1187959-21ntpq12:25:206
46975599100,9cyclictest0-21swapper/607:20:156
46975599100,4cyclictest962201-21kthreadcore10:55:136
46975599100,4cyclictest1172268-21kthreadcore12:20:166
46975599100,3cyclictest510466-21latency07:25:186
46975599100,3cyclictest474866-21cut07:10:176
46975599100,3cyclictest1053071-21kthreadcore11:30:176
4697559997,2cyclictest86-21ksoftirqd/609:20:106
4697559996,2cyclictest753412-21sed09:30:136
4697559996,2cyclictest1135573-21kthreadcore12:05:166
4697559993,5cyclictest0-21swapper/610:50:166
4697559992,6cyclictest1082205-21cpuspeed_turbos11:45:086
4697559990,8cyclictest611763-21tr08:20:166
4697559990,8cyclictest1098166-21kthreadcore11:50:156
4697559990,8cyclictest0-21swapper/610:30:126
4697559990,3cyclictest1072154-21grep11:40:156
4697559990,2cyclictest925512-21kthreadcore10:40:146
4697559990,2cyclictest1156785-21cut12:15:146
4697559990,2cyclictest1016674-21cut11:15:156
4697529997,2cyclictest540495-21kworker/u16:3+flush-8:008:25:075
4697529997,2cyclictest511315-21kworker/u16:0+events_unbound07:57:065
4697479998,1cyclictest0-21swapper/407:50:504
4697479994,4cyclictest807584-21cut09:50:174
4697479994,4cyclictest570142-21cat08:00:134
4697479994,4cyclictest1212379-21proc_pri12:35:224
4697479994,4cyclictest1034311-21cat11:25:124
4697479990,8cyclictest478207-21ntp_states07:10:224
4697529986,2cyclictest540495-21kworker/u16:3+flush-8:008:19:585
4697479986,1cyclictest972098-21turbostat10:59:574
4697479986,1cyclictest0-21swapper/410:05:114
4697479986,1cyclictest0-21swapper/409:05:154
4697479986,1cyclictest0-21swapper/408:55:164
4697479986,1cyclictest0-21swapper/408:05:174
4697479984,3cyclictest993903-21unixbench_multi11:05:254
4697479984,3cyclictest656256-21cat08:45:114
4697479984,3cyclictest601647-21kthreadcore08:15:164
4697479984,3cyclictest1106757-21cstates11:55:094
4697479984,3cyclictest1097343-21kthreadcore11:50:144
4697479984,3cyclictest1086566-21cut11:45:144
4697479983,4cyclictest914777-21grep10:35:164
4697479983,4cyclictest876990-21grep10:20:124
4697479983,4cyclictest828873-21grep10:00:144
4697479983,4cyclictest791260-21cut09:45:144
4697479983,4cyclictest667489-21cut08:50:134
4697479983,4cyclictest559917-21cat07:55:104
4697479983,4cyclictest1192134-21diskstats12:30:084
4697479983,4cyclictest1070453-21diskstats11:40:114
4697479983,4cyclictest1022026-21fschecks_count11:20:104
4697479983,4cyclictest1022026-21fschecks_count11:20:104
4697479980,7cyclictest480593-21cut07:15:004
4697559975,1cyclictest0-21swapper/609:05:096
4697559972,4cyclictest665166-21cat08:50:086
4697529975,2cyclictest664884-21kworker/u16:4+events_unbound09:02:085
4697529973,3cyclictest626913-21cat08:30:095
4697529973,3cyclictest540804-21cpuspeed_turbos07:45:115
4697529973,3cyclictest540804-21cpuspeed_turbos07:45:115
4697529973,3cyclictest512426-21cat07:30:085
4697529973,3cyclictest470727-21if_err_p4p107:10:135
4697529972,4cyclictest481614-21tr07:15:015
4697479975,1cyclictest0-21swapper/412:00:144
4697479975,1cyclictest0-21swapper/412:00:144
4697479975,1cyclictest0-21swapper/411:15:094
4697479975,1cyclictest0-21swapper/410:30:094
4697479975,1cyclictest0-21swapper/410:10:134
4697479975,1cyclictest0-21swapper/408:40:164
4697479974,2cyclictest764674-21cpu09:35:084
4697479973,3cyclictest997416-21expr11:10:094
4697479973,3cyclictest753957-21cut09:30:134
4697479973,3cyclictest716427-21tune2fs09:15:114
4697479973,3cyclictest716427-21tune2fs09:15:114
4697479973,3cyclictest628878-21cut08:30:154
4697479973,3cyclictest541009-21seq07:45:114
4697479973,3cyclictest541009-21seq07:45:114
4697479973,3cyclictest504543-21grep07:25:144
4697479973,3cyclictest1050598-21cut11:30:154
4697479972,4cyclictest948704-21tune2fs10:50:104
4697479972,4cyclictest925887-21cut10:40:154
4697479972,4cyclictest588571-21cat08:10:094
4697479972,4cyclictest531196-21cpuspeed07:40:094
4697479972,4cyclictest513626-21grep07:30:134
4697529962,3cyclictest588578-21cpuspeed08:10:095
4697479962,3cyclictest684361-21cpuspeed_turbos09:00:094
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional