You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 17:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Jul 29, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7975521150,107pltrace0-21swapper/607:07:126
7975521130,105pltrace0-21swapper/307:08:043
7975521040,99pltrace0-21swapper/707:07:577
797552810,77pltrace0-21swapper/207:05:172
797552740,53pltrace0-21swapper/507:07:315
1061426551,10sleep10-21swapper/107:06:181
1056626147,10sleep00-21swapper/007:05:370
1070025945,10sleep40-21swapper/407:07:334
2623852540,3pltrace0-21swapper/712:00:177
2994652480,7pltrace78-21ksoftirqd/712:35:247
874252420,1pltrace11474-21sed10:40:157
1689052420,3pltrace0-21swapper/709:44:457
2781052410,4pltrace0-21swapper/711:32:347
2929752390,1pltrace0-21swapper/711:01:577
2108452380,13pltrace78-21ksoftirqd/711:55:487
11134993728,8cyclictest0-21swapper/707:56:047
3088852360,0pltrace0-21swapper/710:30:137
27332340,1sleep60-21swapper/612:38:106
2266352340,15pltrace78-21ksoftirqd/711:24:067
129022300,1sleep346-21ksoftirqd/309:05:173
129022300,1sleep346-21ksoftirqd/309:05:173
1075852300,2pltrace0-21swapper/707:12:487
565652290,5pltrace78-21ksoftirqd/711:40:237
416352290,9pltrace78-21ksoftirqd/712:11:177
416352290,9pltrace78-21ksoftirqd/712:11:177
2851452290,1pltrace29996-21ssh09:25:047
2781052290,0pltrace0-21swapper/711:29:037
1449252290,7pltrace78-21ksoftirqd/712:19:377
1449252290,7pltrace78-21ksoftirqd/712:19:377
1389552280,8pltrace78-21ksoftirqd/710:47:217
359852270,7pltrace78-21ksoftirqd/710:35:137
3236252270,6pltrace78-21ksoftirqd/710:01:367
2204352270,9pltrace78-21ksoftirqd/709:50:477
204652270,1pltrace2051-21pltrace-run11:03:063
132952270,6pltrace78-21ksoftirqd/709:32:427
1547452260,0pltrace0-21swapper/710:14:357
1027452260,2pltrace0-21swapper/710:09:267
3088852250,0pltrace0-21swapper/710:29:577
156952240,1pltrace0-21swapper/707:50:187
651552230,3pltrace0-21swapper/709:37:527
11120992321,1cyclictest0-21swapper/411:37:514
264852220,2pltrace4776-21smart_sda08:50:227
1810552220,6pltrace78-21ksoftirqd/709:15:427
1112999220,22cyclictest0-21swapper/611:40:216
719852210,0pltrace0-21swapper/711:08:127
11112992015,4cyclictest0-21swapper/209:10:392
11112992015,4cyclictest0-21swapper/209:10:392
11112992014,3cyclictest0-21swapper/212:20:452
719852190,6pltrace54-21ksoftirqd/411:13:014
719852190,0pltrace0-21swapper/711:10:167
323992190,0sleep00-21swapper/008:44:550
1547452190,0pltrace0-21swapper/710:15:057
1275052180,0pltrace0-21swapper/708:08:097
1112099180,1cyclictest0-21swapper/410:35:244
1112099180,1cyclictest0-21swapper/409:30:094
822552170,2pltrace0-21swapper/708:58:377
719852170,11pltrace0-21swapper/611:11:506
3226352170,4pltrace0-21swapper/708:45:337
2946952170,0pltrace0-21swapper/708:38:327
1689052170,2pltrace54-21ksoftirqd/409:45:134
11129991711,5cyclictest0-21swapper/607:19:096
1112999171,8cyclictest0-21swapper/610:01:096
1112099176,4cyclictest1055-13auditd07:20:004
11120991713,3cyclictest0-21swapper/410:15:494
1112099170,15cyclictest0-21swapper/410:10:384
1112099170,13cyclictest0-21swapper/410:32:584
1112099170,1cyclictest0-21swapper/412:14:494
1112099170,1cyclictest0-21swapper/412:14:494
1111299177,9cyclictest1063-17auditd12:35:002
11112991711,5cyclictest0-21swapper/209:28:462
1111299171,15cyclictest0-21swapper/210:21:052
1111299170,16cyclictest25509-21wc09:50:222
11108991714,2cyclictest12844-21idleruntime10:10:141
1110899170,15cyclictest0-21swapper/107:11:571
1110599171,8cyclictest0-21swapper/007:20:220
2389752160,2pltrace0-21swapper/108:32:041
2389752160,10pltrace0-21swapper/608:30:186
2003252160,0pltrace0-21swapper/707:23:507
156952160,3pltrace0-21swapper/707:48:227
11134991612,2cyclictest0-21swapper/709:00:347
11129991611,3cyclictest0-21swapper/611:00:596
11129991610,5cyclictest0-21swapper/612:20:066
1112999161,14cyclictest0-21swapper/608:27:296
1112999161,12cyclictest0-21swapper/608:00:006
1112999160,5cyclictest0-21swapper/607:10:126
1112599161,14cyclictest0-21swapper/511:03:115
1112599160,15cyclictest0-21swapper/508:14:565
11120991611,4cyclictest0-21swapper/410:47:524
11120991611,4cyclictest0-21swapper/409:18:484
11120991611,3cyclictest0-21swapper/408:34:204
1112099160,8cyclictest0-21swapper/410:43:394
1112099160,8cyclictest0-21swapper/407:46:554
1112099160,15cyclictest0-21swapper/412:01:524
1112099160,15cyclictest0-21swapper/411:08:264
1112099160,11cyclictest0-21swapper/408:45:354
1111799161,8cyclictest0-21swapper/312:38:403
1111799161,8cyclictest0-21swapper/312:30:423
1111799160,15cyclictest0-21swapper/309:44:103
11112991611,3cyclictest0-21swapper/209:04:362
11112991611,2cyclictest0-21swapper/209:18:362
11112991610,5cyclictest0-21swapper/212:36:132
1111299161,14cyclictest0-21swapper/211:26:162
1111299160,15cyclictest0-21swapper/210:06:202
11108991614,1cyclictest6741-21perl08:55:121
11108991613,2cyclictest27737-21/usr/sbin/munin12:00:151
11108991610,5cyclictest0-21swapper/108:09:471
1110599160,2cyclictest17084-21interrupts12:20:150
1110599160,15cyclictest0-21swapper/010:53:070
416352150,2pltrace6983-21sed12:10:186
416352150,2pltrace6983-21sed12:10:186
416352150,1pltrace5308-21latency_hist12:10:003
211722150,0sleep3441rcuc/310:50:143
1113499159,5cyclictest0-21swapper/707:31:157
1113499150,8cyclictest0-21swapper/707:19:577
1113499150,7cyclictest0-21swapper/711:17:437
1113499150,7cyclictest0-21swapper/710:58:227
1113499150,14cyclictest0-21swapper/712:25:427
1113499150,14cyclictest0-21swapper/710:54:377
11129991513,1cyclictest0-21swapper/610:17:316
11129991513,1cyclictest0-21swapper/610:05:146
1112999150,8cyclictest0-21swapper/611:32:396
1112999150,14cyclictest0-21swapper/607:48:196
1112599150,8cyclictest0-21swapper/508:49:125
1112599150,8cyclictest0-21swapper/508:42:395
1112599150,7cyclictest0-21swapper/508:36:475
1112599150,14cyclictest0-21swapper/511:07:415
1112599150,14cyclictest0-21swapper/509:15:125
1112099156,8cyclictest0-21swapper/408:13:054
11120991510,3cyclictest0-21swapper/411:48:474
1112099150,9cyclictest19732-21unixbench_multi07:20:234
1112099150,14cyclictest0-21swapper/407:36:254
1111799150,8cyclictest0-21swapper/312:23:483
1111799150,8cyclictest0-21swapper/309:46:103
1111799150,8cyclictest0-21swapper/307:15:453
1111799150,7cyclictest0-21swapper/311:17:043
1111799150,7cyclictest0-21swapper/310:42:423
1111799150,7cyclictest0-21swapper/307:25:513
1111799150,4cyclictest0-21swapper/309:56:063
1111799150,14cyclictest0-21swapper/309:34:403
1111299159,5cyclictest0-21swapper/208:04:442
1111299150,8cyclictest0-21swapper/210:36:572
1111299150,14cyclictest0-21swapper/210:02:262
1111299150,14cyclictest0-21swapper/207:20:022
1110899159,3cyclictest0-21swapper/111:54:171
11108991511,3cyclictest0-21swapper/109:27:131
11108991510,3cyclictest0-21swapper/109:53:471
1110899151,8cyclictest0-21swapper/108:50:031
1110899150,8cyclictest0-21swapper/111:08:401
1110899150,8cyclictest0-21swapper/107:56:521
1110899150,14cyclictest0-21swapper/112:34:131
11105991510,3cyclictest0-21swapper/011:59:560
1110599150,7cyclictest0-21swapper/011:14:460
1110599150,7cyclictest0-21swapper/010:39:150
1110599150,3cyclictest0-21swapper/008:25:060
1110599150,14cyclictest0-21swapper/012:16:150
1110599150,14cyclictest0-21swapper/012:16:150
1110599150,14cyclictest0-21swapper/011:39:320
719852140,8pltrace11639-21ssh11:11:495
565652140,10pltrace0-21swapper/511:40:505
2573252140,12pltrace0-21swapper/610:24:196
2560352140,5pltrace0-21swapper/707:35:497
2108452140,8pltrace25152-21ssh11:56:105
1449252140,0pltrace0-21swapper/312:18:263
1449252140,0pltrace0-21swapper/312:18:263
1113499140,7cyclictest0-21swapper/708:16:347
1113499140,1cyclictest0-21swapper/712:20:077
1112999149,3cyclictest26221-21tail09:20:186
1112999149,3cyclictest0-21swapper/608:03:056
11129991413,1cyclictest0-21swapper/610:56:046
11129991412,1cyclictest23640-21ssh10:52:116
1112999140,7cyclictest0-21swapper/612:25:436
1112999140,7cyclictest0-21swapper/611:15:046
1112999140,2cyclictest0-21swapper/607:41:376
1112999140,14cyclictest0-21swapper/611:36:326
1112999140,14cyclictest0-21swapper/609:56:586
1112999140,14cyclictest0-21swapper/609:18:266
1112999140,1cyclictest0-21swapper/610:43:546
1112599143,9cyclictest0-21swapper/509:50:015
11125991413,1cyclictest0-21swapper/512:17:225
11125991413,1cyclictest0-21swapper/512:17:225
11125991412,1cyclictest0-21swapper/510:19:015
1112599140,14cyclictest0-21swapper/512:27:155
1112099149,4cyclictest0-21swapper/409:43:464
1112099149,3cyclictest0-21swapper/412:10:004
1112099148,4cyclictest0-21swapper/412:39:584
1112099145,2cyclictest1146-21snmpd11:31:394
1112099144,4cyclictest24640-21if_eth009:50:154
1112099144,3cyclictest0-21swapper/411:55:404
11120991411,2cyclictest0-21swapper/412:27:124
1112099140,9cyclictest23428-21taskset11:24:284
1112099140,8cyclictest0-21swapper/408:56:334
1112099140,4cyclictest1178-21runrttasks11:41:074
1112099140,3cyclictest0-21swapper/408:17:044
1112099140,14cyclictest0-21swapper/411:54:544
1112099140,14cyclictest0-21swapper/410:53:524
1112099140,13cyclictest0-21swapper/409:23:114
1112099140,1cyclictest0-21swapper/411:26:454
1112099140,1cyclictest0-21swapper/410:55:094
1111799149,3cyclictest0-21swapper/311:11:433
1111799140,7cyclictest0-21swapper/312:27:423
1111799140,3cyclictest0-21swapper/310:58:553
1111799140,14cyclictest0-21swapper/308:35:203
11112991413,1cyclictest0-21swapper/210:45:592
11112991412,1cyclictest0-21swapper/211:53:402
1111299141,12cyclictest0-21swapper/208:19:472
1111299140,6cyclictest0-21swapper/212:25:302
1111299140,4cyclictest0-21swapper/211:57:052
1111299140,14cyclictest0-21swapper/209:49:382
1111299140,1cyclictest0-21swapper/211:13:112
1111299140,1cyclictest0-21swapper/210:55:422
1111299140,1cyclictest0-21swapper/210:51:492
1110899140,8cyclictest0-21swapper/107:19:031
1110899140,7cyclictest0-21swapper/110:48:271
1110899140,2cyclictest30-21ksoftirqd/112:23:081
1110899140,14cyclictest0-21swapper/111:55:171
1110899140,14cyclictest0-21swapper/107:20:131
1110899140,1cyclictest0-21swapper/111:13:121
1110599149,3cyclictest0-21swapper/008:35:480
11105991411,2cyclictest1146-21snmpd11:44:500
1110599140,1cyclictest0-21swapper/010:15:150
91172130,0sleep30-21swapper/309:00:123
416352130,10pltrace5144-21ssh12:09:535
359852130,8pltrace0-21swapper/210:34:502
2389752130,7pltrace0-21swapper/208:30:202
11134991310,2cyclictest1066-13audispd09:50:007
1113499130,1cyclictest0-21swapper/709:21:127
11129991312,1cyclictest0-21swapper/611:56:176
11129991312,1cyclictest0-21swapper/611:28:066
11129991312,1cyclictest0-21swapper/611:23:156
11129991312,1cyclictest0-21swapper/609:52:266
11129991312,1cyclictest0-21swapper/609:13:256
11129991312,1cyclictest0-21swapper/609:13:246
1112999130,13cyclictest0-21swapper/612:01:576
1112999130,13cyclictest0-21swapper/609:28:096
1112999130,12cyclictest0-21swapper/607:54:046
11125991312,1cyclictest0-21swapper/512:03:075
11125991312,1cyclictest0-21swapper/511:36:245
11125991312,1cyclictest0-21swapper/510:58:315
11125991312,1cyclictest0-21swapper/510:50:455
11125991312,1cyclictest0-21swapper/510:44:365
11125991312,1cyclictest0-21swapper/510:01:215
11125991312,1cyclictest0-21swapper/509:45:395
11125991312,1cyclictest0-21swapper/509:39:495
1112599130,13cyclictest0-21swapper/512:37:565
1112599130,13cyclictest0-21swapper/511:31:335
1112599130,13cyclictest0-21swapper/510:45:245
1112599130,13cyclictest0-21swapper/510:05:545
1112599130,13cyclictest0-21swapper/509:28:485
1112599130,12cyclictest0-21swapper/510:35:405
1112599130,1cyclictest0-21swapper/510:25:105
1112599130,1cyclictest0-21swapper/510:12:525
1112599130,1cyclictest0-21swapper/507:42:555
1112099136,6cyclictest0-21swapper/409:26:454
1112099134,4cyclictest9498-21fschecks_time09:00:144
1112099133,4cyclictest1474-21lldpd07:40:044
1112099132,4cyclictest29524-21cut09:55:134
11120991312,1cyclictest0-21swapper/410:08:514
1112099130,2cyclictest0-21swapper/409:39:344
1112099130,12cyclictest0-21swapper/411:18:074
1111799137,5cyclictest0-21swapper/309:37:523
11117991312,1cyclictest0-21swapper/311:59:493
1111799130,12cyclictest0-21swapper/311:07:023
1111799130,12cyclictest0-21swapper/308:48:303
1111799130,1cyclictest0-21swapper/311:27:463
11112991312,1cyclictest0-21swapper/211:46:132
11112991312,1cyclictest0-21swapper/211:21:362
11112991312,1cyclictest0-21swapper/211:06:232
11112991312,1cyclictest0-21swapper/209:40:052
1111299130,6cyclictest0-21swapper/208:21:172
1111299130,13cyclictest0-21swapper/211:36:592
1111299130,13cyclictest0-21swapper/210:15:332
1111299130,13cyclictest0-21swapper/209:22:562
1111299130,12cyclictest0-21swapper/212:03:112
1111299130,12cyclictest0-21swapper/207:50:462
1111299130,1cyclictest0-21swapper/211:40:042
1110899137,5cyclictest0-21swapper/110:02:231
11108991312,1cyclictest0-21swapper/112:38:121
11108991312,1cyclictest0-21swapper/111:37:091
11108991312,1cyclictest0-21swapper/111:26:281
11108991311,1cyclictest16118-21ssh11:48:221
11108991311,1cyclictest0-21swapper/110:05:211
11108991310,2cyclictest22664-21sed11:23:571
1110899130,6cyclictest0-21swapper/110:55:391
1110899130,13cyclictest0-21swapper/112:09:421
1110899130,13cyclictest0-21swapper/109:49:291
1110899130,1cyclictest0-21swapper/109:24:141
1110599138,4cyclictest0-21swapper/009:40:000
11105991312,1cyclictest0-21swapper/012:35:180
11105991310,2cyclictest0-21swapper/011:51:260
1110599130,13cyclictest0-21swapper/010:30:280
1110599130,13cyclictest0-21swapper/010:02:280
1110599130,12cyclictest0-21swapper/009:43:280
1110599130,12cyclictest0-21swapper/009:01:550
1110599130,1cyclictest0-21swapper/009:19:530
1103452130,8pltrace78-21ksoftirqd/709:07:207
1103452130,8pltrace78-21ksoftirqd/709:07:207
995352120,4pltrace10585-21cpu08:05:136
543952120,5pltrace0-21swapper/208:53:592
416352120,4pltrace0-21swapper/712:09:577
416352120,4pltrace0-21swapper/512:10:145
416352120,4pltrace0-21swapper/512:10:145
416352120,10pltrace0-21swapper/212:10:152
416352120,10pltrace0-21swapper/212:10:152
359852120,4pltrace4632-21ssh10:34:586
2266352120,5pltrace0-21swapper/511:24:155
2204352120,4pltrace0-21swapper/309:50:073
1724452120,10pltrace0-21swapper/607:20:486
1389552120,5pltrace0-21swapper/210:44:222
1113499126,5cyclictest0-21swapper/711:35:087
11134991211,1cyclictest0-21swapper/711:46:367
1113499120,12cyclictest0-21swapper/710:20:087
1113499120,12cyclictest0-21swapper/708:20:207
1112999126,5cyclictest0-21swapper/608:57:156
11129991211,1cyclictest0-21swapper/610:12:106
1112599126,5cyclictest0-21swapper/507:51:135
11125991211,1cyclictest0-21swapper/512:31:565
11125991211,1cyclictest0-21swapper/511:51:475
1112099126,1cyclictest0-21swapper/409:08:054
1112099126,1cyclictest0-21swapper/409:08:054
1112099125,3cyclictest0-21swapper/412:22:004
1112099123,4cyclictest22769-21cut08:25:164
1112099123,4cyclictest20966-21cat07:25:134
1112099123,2cyclictest5131-21cpuspeed_turbos07:55:134
1112099122,4cyclictest9080-21ntpq08:00:184
1112099122,4cyclictest27415-21cut08:35:124
1112099122,4cyclictest2523-21basename10:00:154
1112099121,5cyclictest14435-21/usr/sbin/munin09:10:214
1112099121,5cyclictest14435-21/usr/sbin/munin09:10:214
1112099120,5cyclictest3084-21hwlatdetect07:50:154
1112099120,5cyclictest30479-21cstates08:40:144
1112099120,5cyclictest28653-21chrt12:30:464
1112099120,5cyclictest27206-21chrt10:25:074
1112099120,5cyclictest24139-21grep07:30:154
1112099120,5cyclictest18956-21wget08:20:114
1112099120,5cyclictest12720-21taskset08:07:574
1112099120,5cyclictest11563-21tr07:10:124
1112099120,4cyclictest23479-21tr10:20:164
1111799127,3cyclictest0-21swapper/310:28:303
1111799126,5cyclictest20590-21ssh11:52:143
1111799126,5cyclictest0-21swapper/311:35:443
11117991211,1cyclictest0-21swapper/312:13:253
11117991211,1cyclictest0-21swapper/312:13:253
11117991211,1cyclictest0-21swapper/309:27:373
11117991211,1cyclictest0-21swapper/309:13:323
11117991211,1cyclictest0-21swapper/309:13:323
11117991211,1cyclictest0-21swapper/307:40:173
1111799120,12cyclictest0-21swapper/310:03:543
1111799120,11cyclictest0-21swapper/308:50:343
1111799120,1cyclictest0-21swapper/310:20:053
11112991211,1cyclictest0-21swapper/211:32:082
11112991211,1cyclictest0-21swapper/211:15:172
11112991211,1cyclictest0-21swapper/211:01:412
11112991211,1cyclictest0-21swapper/209:30:422
11112991211,1cyclictest0-21swapper/208:48:172
11112991211,1cyclictest0-21swapper/208:26:062
11112991211,1cyclictest0-21swapper/207:10:492
1111299120,11cyclictest0-21swapper/210:28:082
1110899129,2cyclictest1065-17sedispatch09:20:001
1110899127,2cyclictest28518-21missed_timers10:25:161
11108991211,1cyclictest0-21swapper/109:35:441
11108991210,1cyclictest822-21sendmail_mailst07:45:201
11108991210,1cyclictest2204-21ssh11:03:221
11108991210,1cyclictest13585-21ssh12:16:301
11108991210,1cyclictest13585-21ssh12:16:301
1110899121,5cyclictest5798-21cpu12:10:131
1110899121,5cyclictest5798-21cpu12:10:131
1110899121,2cyclictest15661-21/usr/sbin/munin09:10:171
1110899121,2cyclictest15661-21/usr/sbin/munin09:10:171
1110899120,2cyclictest13240-21/usr/sbin/munin09:40:161
1110599127,4cyclictest20027-21hwlatdetect11:20:160
1110599126,5cyclictest0-21swapper/007:38:530
11105991211,1cyclictest0-21swapper/011:46:340
11105991211,1cyclictest0-21swapper/011:04:190
11105991211,1cyclictest0-21swapper/010:55:150
11105991211,1cyclictest0-21swapper/010:24:190
11105991211,1cyclictest0-21swapper/010:10:430
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional