You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-11 - 14:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Sat Apr 11, 2026 12:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28369521390,129pltrace0-21swapper/507:05:225
28369521360,121pltrace0-21swapper/107:05:011
28369521280,114pltrace0-21swapper/307:05:153
28369521140,105pltrace0-21swapper/607:05:126
2836952930,74pltrace0-21swapper/207:05:182
2836952810,65pltrace0-21swapper/707:05:217
1855352650,2pltrace0-21swapper/209:39:422
3092725844,10sleep00-21swapper/007:06:420
3109125743,10sleep40-21swapper/407:09:024
524252310,0pltrace0-21swapper/707:20:157
31334992623,2cyclictest0-21swapper/009:12:540
3135499241,12cyclictest0-21swapper/508:31:455
3134399240,16cyclictest0-21swapper/207:29:272
2196352230,3pltrace22568-21cat07:50:147
2906752210,2pltrace30424-21grep11:55:137
31362992014,3cyclictest0-21swapper/710:56:347
3136299200,6cyclictest0-21swapper/709:27:097
3136299200,6cyclictest0-21swapper/709:27:097
1576852200,3pltrace0-21swapper/709:35:127
505952190,2pltrace0-21swapper/712:10:047
31362991916,2cyclictest1178-21runrttasks10:18:027
31357991915,2cyclictest0-21swapper/610:32:036
3135499191,1cyclictest0-21swapper/512:10:205
2412652190,0pltrace0-21swapper/709:50:067
227252190,4pltrace0-21swapper/712:05:237
31362991815,2cyclictest4382-21taskset11:10:007
31362991815,2cyclictest14283-21processes11:25:207
31362991812,5cyclictest0-21swapper/708:01:147
2349152180,3pltrace0-21swapper/711:45:237
1917752180,3pltrace0-21swapper/707:47:267
1405552180,5pltrace0-21swapper/710:32:517
803052170,0pltrace0-21swapper/707:27:587
31362991714,2cyclictest2953-21fschecks_time09:10:137
31362991714,2cyclictest17253-21/usr/sbin/munin10:35:137
31362991714,2cyclictest1146-21snmpd09:33:017
31354991711,3cyclictest0-21swapper/509:05:365
3135499171,4cyclictest0-21swapper/509:34:285
3135499171,15cyclictest0-21swapper/509:59:025
3133899170,9cyclictest0-21swapper/109:12:241
3133499171,15cyclictest0-21swapper/007:28:280
227252170,3pltrace0-21swapper/112:07:271
2241652170,2pltrace0-21swapper/710:45:177
1127052170,0pltrace0-21swapper/710:29:107
3143052160,2pltrace0-21swapper/709:05:427
31362991613,2cyclictest30945-21cpuspeed_turbos08:05:147
31362991613,2cyclictest27380-21wc10:50:217
31362991613,2cyclictest12821-21cat08:30:137
31362991612,2cyclictest0-21swapper/710:23:247
31362991611,4cyclictest0-21swapper/709:20:007
3136299161,13cyclictest0-21swapper/711:40:357
3135799161,14cyclictest0-21swapper/610:24:576
3135799161,14cyclictest0-21swapper/610:08:056
3135799160,15cyclictest0-21swapper/609:09:516
3135799160,15cyclictest0-21swapper/608:40:116
31354991611,4cyclictest0-21swapper/507:42:395
3135499161,8cyclictest0-21swapper/510:27:425
3135499161,14cyclictest0-21swapper/509:36:135
31350991610,5cyclictest0-21swapper/412:15:144
3135099160,5cyclictest0-21swapper/409:05:284
31347991610,5cyclictest0-21swapper/312:17:453
3134799161,7cyclictest0-21swapper/307:48:303
3134799161,14cyclictest0-21swapper/311:31:413
3134799161,13cyclictest0-21swapper/308:26:323
3134799160,8cyclictest0-21swapper/308:22:593
3134799160,14cyclictest0-21swapper/311:28:553
31343991611,3cyclictest0-21swapper/211:01:132
3134399160,15cyclictest0-21swapper/209:04:152
31334991611,3cyclictest0-21swapper/012:40:000
3133499161,8cyclictest0-21swapper/009:42:400
3133499161,7cyclictest0-21swapper/007:24:190
2582452160,10pltrace0-21swapper/308:56:003
2520052160,11pltrace0-21swapper/510:50:005
161052160,11pltrace0-21swapper/107:16:071
631552150,7pltrace6584-21latency_hist08:20:016
3136299157,7cyclictest0-21swapper/712:23:427
3136299155,6cyclictest78-21ksoftirqd/710:41:577
3136299155,6cyclictest78-21ksoftirqd/707:17:347
31362991512,2cyclictest5446-21ps08:15:207
31362991512,2cyclictest2619-21ls11:05:157
31362991512,2cyclictest2232-21interrupts08:10:177
31362991512,2cyclictest20416-21sshd11:35:517
31362991512,2cyclictest11042-21processes08:25:177
3136299150,14cyclictest0-21swapper/709:24:427
3136299150,14cyclictest0-21swapper/709:24:427
3136299150,14cyclictest0-21swapper/708:57:267
3135799159,5cyclictest0-21swapper/608:33:356
3135799159,3cyclictest0-21swapper/612:18:256
3135799150,8cyclictest10042-21smart_sda07:25:216
3135799150,8cyclictest0-21swapper/611:54:486
3135799150,4cyclictest0-21swapper/609:53:346
3135799150,4cyclictest0-21swapper/608:39:446
3135799150,14cyclictest1178-21runrttasks08:20:226
3135799150,14cyclictest0-21swapper/611:00:436
3135799150,14cyclictest0-21swapper/609:00:006
3135799150,14cyclictest0-21swapper/607:53:166
3135799150,14cyclictest0-21swapper/607:15:086
3135799150,14cyclictest0-21swapper/607:10:516
3135799150,13cyclictest0-21swapper/607:55:256
3135499159,5cyclictest0-21swapper/510:01:325
31354991510,3cyclictest0-21swapper/508:40:015
3135499151,7cyclictest0-21swapper/509:11:035
3135499150,8cyclictest0-21swapper/511:41:145
3135499150,4cyclictest0-21swapper/512:30:375
3135499150,4cyclictest0-21swapper/512:30:375
3135499150,14cyclictest0-21swapper/512:28:375
3135499150,14cyclictest0-21swapper/512:28:375
3135499150,14cyclictest0-21swapper/509:23:545
3135499150,14cyclictest0-21swapper/509:23:545
3135499150,14cyclictest0-21swapper/508:50:545
3135499150,14cyclictest0-21swapper/508:14:135
3135099150,4cyclictest0-21swapper/411:32:254
3135099150,3cyclictest0-21swapper/412:20:264
3135099150,14cyclictest0-21swapper/412:10:564
31347991510,3cyclictest0-21swapper/307:32:333
3134799150,14cyclictest0-21swapper/312:31:513
3134799150,14cyclictest0-21swapper/312:31:513
3134799150,14cyclictest0-21swapper/310:04:543
3134399151,3cyclictest0-21swapper/209:45:352
3134399151,13cyclictest0-21swapper/208:33:112
3134399150,7cyclictest0-21swapper/212:29:422
3134399150,7cyclictest0-21swapper/212:29:422
3134399150,7cyclictest0-21swapper/211:52:202
3134399150,7cyclictest0-21swapper/210:01:062
3134399150,14cyclictest0-21swapper/210:16:332
3134399150,14cyclictest0-21swapper/209:26:492
3134399150,14cyclictest0-21swapper/209:26:492
3134399150,14cyclictest0-21swapper/209:16:272
31338991510,3cyclictest0-21swapper/108:05:341
3133899150,7cyclictest0-21swapper/108:13:161
3133899150,14cyclictest0-21swapper/111:30:221
3133899150,14cyclictest0-21swapper/110:33:281
31334991513,1cyclictest0-21swapper/007:55:230
3133499150,4cyclictest0-21swapper/011:47:110
3133499150,14cyclictest0-21swapper/012:15:140
3133499150,14cyclictest0-21swapper/011:15:560
3133499150,14cyclictest0-21swapper/008:28:110
2520052150,8pltrace25341-21cat10:50:001
2134352150,10pltrace0-21swapper/009:48:370
2134352150,0pltrace0-21swapper/709:47:287
1298152150,4pltrace15674-21taskset09:33:371
68152140,6pltrace0-21swapper/208:10:002
68152140,6pltrace0-21swapper/008:10:000
31362991412,1cyclictest32340-21grep07:10:137
31362991412,1cyclictest1146-21snmpd12:01:317
31362991411,2cyclictest8014-21grep11:15:147
31362991411,2cyclictest29186-21timerwakeupswit09:55:227
31362991411,2cyclictest27502-21fschecks_time11:50:147
31362991411,2cyclictest21633-21sshd12:37:497
31362991411,2cyclictest20858-21cpuspeed_turbos08:45:127
31362991411,2cyclictest17877-21/usr/sbin/munin08:40:177
31362991411,2cyclictest1146-21snmpd07:30:187
31362991411,2cyclictest10073-21wget11:20:147
31362991410,3cyclictest0-21swapper/707:55:417
3136299140,9cyclictest17280-21timerandwakeup11:30:237
3136299140,13cyclictest0-21swapper/712:28:567
3136299140,13cyclictest0-21swapper/712:28:567
3136299140,13cyclictest0-21swapper/707:39:517
3135799148,5cyclictest0-21swapper/609:41:256
3135799140,8cyclictest0-21swapper/610:46:126
3135799140,7cyclictest0-21swapper/610:13:476
3135799140,3cyclictest0-21swapper/607:34:276
3135499149,4cyclictest0-21swapper/511:50:005
3135499149,3cyclictest0-21swapper/508:00:375
3135499149,2cyclictest0-21swapper/511:30:295
31354991411,2cyclictest0-21swapper/508:27:545
3135499140,7cyclictest0-21swapper/508:49:255
31350991413,1cyclictest0-21swapper/408:10:154
31350991412,1cyclictest0-21swapper/412:35:184
31350991410,3cyclictest0-21swapper/409:50:374
3135099140,8cyclictest0-21swapper/409:04:554
3135099140,7cyclictest0-21swapper/411:16:104
3135099140,13cyclictest0-21swapper/412:02:424
3135099140,13cyclictest0-21swapper/409:32:244
31347991413,1cyclictest0-21swapper/309:35:133
3134799140,7cyclictest0-21swapper/310:10:143
3134799140,3cyclictest0-21swapper/311:41:233
3134799140,3cyclictest0-21swapper/307:19:353
3134799140,13cyclictest0-21swapper/309:54:543
3134399140,13cyclictest0-21swapper/211:05:522
3134399140,12cyclictest0-21swapper/212:10:002
31338991413,1cyclictest0-21swapper/107:10:211
3133899140,8cyclictest0-21swapper/109:15:241
3133899140,8cyclictest0-21swapper/107:55:101
3133899140,7cyclictest0-21swapper/112:01:551
3133899140,7cyclictest0-21swapper/111:37:381
3133899140,13cyclictest0-21swapper/110:50:391
3133899140,12cyclictest0-21swapper/109:08:331
3133499140,7cyclictest0-21swapper/010:42:550
3133499140,7cyclictest0-21swapper/009:07:240
3133499140,3cyclictest0-21swapper/010:54:250
2025252140,1pltrace0-21swapper/508:44:565
161052140,1pltrace1613-21pltrace-run07:14:405
68152130,5pltrace1178-21runrttasks08:10:022
569552130,5pltrace0-21swapper/510:15:215
31362991312,1cyclictest0-21swapper/712:30:117
31362991312,1cyclictest0-21swapper/712:30:117
31362991311,1cyclictest9328-21cat08:25:007
31362991310,2cyclictest30470-21cstates10:00:127
31362991310,2cyclictest30028-21sort09:00:147
31362991310,2cyclictest15447-21cstates08:35:147
31362991310,2cyclictest1178-21runrttasks07:40:177
31362991310,2cyclictest1141-21polkitd09:45:007
3136299130,12cyclictest0-21swapper/710:06:507
3135799138,3cyclictest0-21swapper/612:02:466
31357991312,1cyclictest0-21swapper/607:23:516
31357991310,2cyclictest16971-21sort07:40:126
3135799130,12cyclictest0-21swapper/612:38:586
3135799130,12cyclictest0-21swapper/609:16:126
3135499139,3cyclictest0-21swapper/510:55:545
3135499130,12cyclictest0-21swapper/508:10:005
3135099138,1cyclictest191rcu_preempt07:14:214
3135099137,5cyclictest0-21swapper/410:40:004
3135099137,3cyclictest54-21ksoftirqd/411:45:174
3135099136,6cyclictest22206-21processes08:45:204
31350991310,2cyclictest23253-21taskset11:41:314
3135099131,11cyclictest0-21swapper/408:02:104
3135099130,6cyclictest0-21swapper/411:50:264
3134799137,5cyclictest0-21swapper/312:12:363
3134799137,5cyclictest0-21swapper/308:41:323
3134799130,12cyclictest0-21swapper/311:02:193
3134799130,12cyclictest0-21swapper/310:39:093
3134399133,9cyclictest0-21swapper/207:21:362
3134399130,9cyclictest0-21swapper/211:45:592
3134399130,13cyclictest0-21swapper/212:30:232
3134399130,13cyclictest0-21swapper/212:30:232
3134399130,12cyclictest0-21swapper/209:31:052
3077552130,4pltrace0-21swapper/711:00:007
3077552130,3pltrace54-21ksoftirqd/411:04:254
2520052130,5pltrace0-21swapper/510:50:035
1638952130,5pltrace0-21swapper/107:44:211
161052130,5pltrace0-21swapper/207:17:532
1513052130,5pltrace0-21swapper/211:32:142
1342452130,6pltrace0-21swapper/012:28:210
1342452130,6pltrace0-21swapper/012:28:210
1188852130,5pltrace0-21swapper/308:33:413
631552120,5pltrace0-21swapper/508:21:505
569552120,5pltrace0-21swapper/010:15:210
462252120,5pltrace0-21swapper/009:16:520
39412120,10sleep44012-21aten_r4power_po08:15:124
3136299127,3cyclictest0-21swapper/710:14:357
31362991211,1cyclictest0-21swapper/708:50:137
3136299120,1cyclictest0-21swapper/712:16:047
3135799127,3cyclictest0-21swapper/610:42:066
3135799127,2cyclictest0-21swapper/609:04:366
3135799126,5cyclictest0-21swapper/609:38:406
31357991211,1cyclictest0-21swapper/612:30:206
31357991211,1cyclictest0-21swapper/612:30:206
31357991211,1cyclictest0-21swapper/611:30:166
3135799120,1cyclictest0-21swapper/607:47:586
3135499120,11cyclictest0-21swapper/511:26:045
3135099129,2cyclictest7375-21awk07:20:214
3135099129,2cyclictest3616-21expr10:10:124
3135099129,2cyclictest28073-21sed08:55:224
3135099129,2cyclictest24193-21tune2fs08:50:144
3135099129,2cyclictest1178-21runrttasks09:44:224
3135099128,2cyclictest54-21ksoftirqd/410:30:134
3135099126,5cyclictest0-21swapper/411:25:344
3135099126,5cyclictest0-21swapper/408:08:434
3135099125,4cyclictest54-21ksoftirqd/412:05:204
3135099125,4cyclictest54-21ksoftirqd/408:31:324
31350991211,1cyclictest0-21swapper/410:50:134
3134799129,2cyclictest0-21swapper/312:35:263
3134799127,4cyclictest0-21swapper/308:08:463
3134799126,3cyclictest0-21swapper/312:28:213
3134799126,3cyclictest0-21swapper/312:28:213
31347991210,1cyclictest0-21swapper/310:51:483
3134799120,11cyclictest0-21swapper/310:44:463
3134799120,11cyclictest0-21swapper/309:48:113
3134799120,1cyclictest0-21swapper/308:10:043
3134399128,3cyclictest1064-13audispd10:58:502
3134399127,3cyclictest0-21swapper/209:40:352
3134399126,5cyclictest0-21swapper/209:56:352
31343991211,1cyclictest0-21swapper/211:14:562
31343991211,1cyclictest0-21swapper/208:45:012
31343991211,1cyclictest0-21swapper/207:12:342
31343991210,1cyclictest0-21swapper/210:24:362
3134399120,12cyclictest0-21swapper/208:23:002
3134399120,1cyclictest0-21swapper/208:29:092
3133899129,2cyclictest1055-17auditd12:20:001
3133899120,11cyclictest0-21swapper/111:09:251
3133899120,11cyclictest0-21swapper/109:56:581
3133899120,11cyclictest0-21swapper/109:48:321
3133899120,11cyclictest0-21swapper/108:01:071
3133499128,2cyclictest0-21swapper/008:57:240
3133499126,5cyclictest0-21swapper/011:14:290
3133499120,11cyclictest0-21swapper/012:13:560
3133499120,11cyclictest0-21swapper/010:10:270
3133499120,11cyclictest0-21swapper/008:33:540
3133499120,11cyclictest0-21swapper/007:40:220
3077552120,5pltrace0-21swapper/011:04:410
2970052120,5pltrace0-21swapper/010:01:020
2582452120,0pltrace0-21swapper/208:55:592
2474952120,5pltrace0-21swapper/507:57:135
1621052120,9pltrace54-21ksoftirqd/412:30:114
1621052120,9pltrace54-21ksoftirqd/412:30:114
161052120,5pltrace1178-21runrttasks07:15:105
1081452120,4pltrace54-21ksoftirqd/407:33:574
569552110,6pltrace0-21swapper/110:15:231
569552110,4pltrace0-21swapper/310:15:213
3186252110,1pltrace0-21swapper/512:00:125
3143052110,1pltrace31714-21latency_hist09:05:001
3135799118,2cyclictest1063-17auditd12:10:016
3135799112,8cyclictest0-21swapper/612:29:156
3135799112,8cyclictest0-21swapper/612:29:156
31357991110,1cyclictest0-21swapper/611:22:596
31357991110,1cyclictest0-21swapper/609:34:506
3135799110,11cyclictest0-21swapper/610:28:066
3135799110,11cyclictest0-21swapper/610:17:156
3135799110,11cyclictest0-21swapper/608:27:206
3135799110,1cyclictest0-21swapper/609:25:466
3135799110,1cyclictest0-21swapper/609:25:466
3135799110,1cyclictest0-21swapper/609:24:286
3135799110,1cyclictest0-21swapper/609:24:286
3135799110,1cyclictest0-21swapper/608:08:326
3135499117,3cyclictest1478-21lldpd12:21:275
3135499116,4cyclictest0-21swapper/507:35:125
3135499115,5cyclictest0-21swapper/511:12:585
3135499115,5cyclictest0-21swapper/507:21:515
31354991110,1cyclictest0-21swapper/511:51:105
3135499111,8cyclictest0-21swapper/509:46:465
3135499110,11cyclictest0-21swapper/510:10:575
3135499110,11cyclictest0-21swapper/508:58:355
3135499110,11cyclictest0-21swapper/507:27:455
3135499110,1cyclictest0-21swapper/512:08:305
3135499110,1cyclictest0-21swapper/510:05:365
3135499110,1cyclictest0-21swapper/509:27:045
3135499110,1cyclictest0-21swapper/509:27:045
3135499110,1cyclictest0-21swapper/507:49:365
3135099118,2cyclictest8957-21aten_r4power_po10:20:114
3135099118,2cyclictest8764-21expr07:25:134
3135099118,2cyclictest6489-21expr10:15:124
3135099118,2cyclictest25751-21tune2fs07:55:144
3135099118,2cyclictest2557-21tr09:10:114
3135099118,2cyclictest24504-21cat10:45:214
3135099118,2cyclictest21815-21aten_r4power_po09:45:124
3135099118,2cyclictest20356-21tune2fs07:45:144
3135099118,2cyclictest16646-21cat09:35:124
3135099118,2cyclictest15689-21ls07:35:214
3135099118,2cyclictest15272-21cat08:35:134
3135099118,2cyclictest1283-21pltrace-run09:24:414
3135099118,2cyclictest1283-21pltrace-run09:24:414
3135099118,2cyclictest12127-21expr10:25:144
3135099115,2cyclictest54-21ksoftirqd/411:55:204
3135099114,4cyclictest0-21swapper/411:10:204
3135099112,8cyclictest0-21swapper/409:27:314
3135099112,8cyclictest0-21swapper/409:27:314
31350991110,1cyclictest0-21swapper/409:16:194
3135099110,11cyclictest0-21swapper/408:28:134
3135099110,11cyclictest0-21swapper/408:22:534
3135099110,11cyclictest0-21swapper/407:19:354
3135099110,1cyclictest0-21swapper/411:07:134
3135099110,1cyclictest0-21swapper/408:43:174
3134799117,3cyclictest1146-21snmpd07:44:093
3134799116,4cyclictest0-21swapper/308:16:043
3134799116,4cyclictest0-21swapper/307:35:423
3134799116,3cyclictest0-21swapper/312:01:453
3134799115,5cyclictest0-21swapper/309:14:433
31347991110,1cyclictest0-21swapper/311:48:573
31347991110,1cyclictest0-21swapper/310:34:003
31347991110,1cyclictest0-21swapper/309:20:303
31347991110,1cyclictest0-21swapper/309:20:303
31347991110,1cyclictest0-21swapper/309:08:323
3134799110,4cyclictest15803-21crond09:35:003
3134799110,11cyclictest0-21swapper/309:19:133
3134399116,2cyclictest0-21swapper/212:21:152
31343991110,1cyclictest0-21swapper/212:19:132
31343991110,1cyclictest0-21swapper/211:35:302
31343991110,1cyclictest0-21swapper/209:09:572
31343991110,1cyclictest0-21swapper/207:55:382
31343991110,1cyclictest0-21swapper/207:34:162
3134399110,11cyclictest0-21swapper/211:41:102
3134399110,11cyclictest0-21swapper/210:51:572
3134399110,1cyclictest0-21swapper/210:10:112
3134399110,1cyclictest0-21swapper/208:03:242
3133899118,2cyclictest1146-21snmpd11:28:381
3133899118,2cyclictest0-21swapper/110:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional