You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 00:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Mon Jun 01, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
14611521010,97pltrace0-21swapper/307:05:213
14611521000,96pltrace0-21swapper/107:05:221
1461152990,90pltrace0-21swapper/707:05:187
1577352970,2pltrace0-21swapper/110:47:111
1461152900,86pltrace0-21swapper/607:05:026
1461152860,82pltrace0-21swapper/507:06:305
1729127258,10sleep20-21swapper/207:05:562
1519026046,10sleep00-21swapper/007:05:060
1753125844,10sleep40-21swapper/407:09:034
2396952400,5pltrace78-21ksoftirqd/709:12:297
1138452390,6pltrace78-21ksoftirqd/711:21:127
2970452340,7pltrace78-21ksoftirqd/711:38:577
2970452340,7pltrace78-21ksoftirqd/711:38:577
2418352340,6pltrace78-21ksoftirqd/710:23:037
125452320,0pltrace78-21ksoftirqd/711:07:437
643452310,2pltrace0-21swapper/710:37:237
17755993029,1cyclictest0-21swapper/712:05:107
1520752290,0pltrace78-21ksoftirqd/710:15:597
17746992723,1cyclictest1520752pltrace10:14:585
643452260,0pltrace0-21swapper/710:40:247
627752260,6pltrace78-21ksoftirqd/711:52:007
2920352230,1pltrace0-21swapper/711:03:517
2521752230,7pltrace78-21ksoftirqd/711:34:297
2863552200,5pltrace0-21swapper/709:54:217
2863852190,15pltrace54-21ksoftirqd/409:19:264
1774499190,5cyclictest0-21swapper/409:49:424
1774499190,19cyclictest0-21swapper/407:47:354
2496752180,12pltrace26949-21netstat08:20:172
17750991812,4cyclictest0-21swapper/610:29:146
1775099180,15cyclictest5494-21ssh09:27:006
17746991815,2cyclictest0-21swapper/508:06:155
17729991813,4cyclictest0-21swapper/111:50:191
1138452180,12pltrace0-21swapper/611:19:456
2868152170,4pltrace0-21swapper/710:29:047
2863552170,11pltrace31039-21expr09:55:155
1772999175,5cyclictest4310-21sed10:35:151
1772999170,16cyclictest0-21swapper/112:28:511
1772999170,13cyclictest0-21swapper/109:30:361
1127752170,12pltrace54-21ksoftirqd/411:52:514
1127752170,12pltrace11665-21chrt11:52:530
542352160,10pltrace5652-21idleruntime-cro07:45:005
255132160,1sleep2361rcuc/207:20:132
2473552160,11pltrace0-21swapper/610:57:266
2047352160,10pltrace23599-21ssh09:11:182
1822352160,1pltrace18224-21sed12:37:111
1775099161,8cyclictest0-21swapper/608:51:106
1775099160,4cyclictest0-21swapper/608:03:196
1775099160,2cyclictest0-21swapper/607:10:166
17746991611,3cyclictest0-21swapper/509:50:585
17746991610,5cyclictest0-21swapper/511:01:095
1774699160,8cyclictest0-21swapper/512:23:325
1774499161,8cyclictest0-21swapper/411:28:524
1774499161,14cyclictest0-21swapper/408:58:194
1774499160,8cyclictest0-21swapper/412:23:494
1774499160,8cyclictest0-21swapper/412:18:254
1774499160,8cyclictest0-21swapper/410:11:364
17735991610,4cyclictest0-21swapper/212:34:072
1773599161,13cyclictest0-21swapper/208:02:032
1773599160,15cyclictest0-21swapper/210:36:312
1772999167,8cyclictest1146-21snmpd08:10:301
17729991612,3cyclictest0-21swapper/111:06:361
17729991611,4cyclictest0-21swapper/110:29:121
1772999161,7cyclictest0-21swapper/108:01:181
1772999160,16cyclictest0-21swapper/112:18:001
1099852160,12pltrace0-21swapper/107:53:151
1009952160,14pltrace0-21swapper/509:33:355
629052150,3pltrace10094-21ssh10:05:425
590052150,10pltrace9697-21ssh12:26:185
3054152150,10pltrace0-21swapper/608:31:046
2863852150,9pltrace30113-21ssh09:19:560
2496752150,3pltrace25993-21cat08:20:126
1907852150,10pltrace19798-21ssh09:43:556
1775599150,1cyclictest761rcuc/709:34:367
1775099151,7cyclictest0-21swapper/607:57:416
1775099150,7cyclictest0-21swapper/609:02:526
1775099150,4cyclictest0-21swapper/611:55:016
1775099150,14cyclictest0-21swapper/610:12:286
1774699150,7cyclictest0-21swapper/512:30:265
1774699150,7cyclictest0-21swapper/511:40:435
1774699150,7cyclictest0-21swapper/508:36:065
1774699150,7cyclictest0-21swapper/508:36:065
1774699150,14cyclictest0-21swapper/511:32:215
1774699150,14cyclictest0-21swapper/510:37:235
1774699150,14cyclictest0-21swapper/510:29:465
1774699150,14cyclictest0-21swapper/509:41:595
1774699150,14cyclictest0-21swapper/508:26:195
1774699150,14cyclictest0-21swapper/507:18:315
1774699150,13cyclictest0-21swapper/511:28:515
17744991512,2cyclictest0-21swapper/408:29:214
1774499151,13cyclictest0-21swapper/412:06:484
1774499150,7cyclictest0-21swapper/410:45:164
1774499150,7cyclictest0-21swapper/409:57:154
1774499150,7cyclictest0-21swapper/407:42:384
1774499150,14cyclictest0-21swapper/408:31:004
1774499150,14cyclictest0-21swapper/408:04:154
1773599151,3cyclictest0-21swapper/208:33:362
1773599150,7cyclictest0-21swapper/211:17:412
1773599150,7cyclictest0-21swapper/208:29:452
1773599150,14cyclictest0-21swapper/208:48:432
1773599150,14cyclictest0-21swapper/208:48:432
1773599150,14cyclictest0-21swapper/207:48:112
1773599150,14cyclictest0-21swapper/207:32:232
17729991512,2cyclictest0-21swapper/108:35:051
17729991512,2cyclictest0-21swapper/108:35:051
1772999150,4cyclictest0-21swapper/109:20:201
1772999150,14cyclictest0-21swapper/112:13:481
1772999150,14cyclictest0-21swapper/111:59:231
1772999150,14cyclictest0-21swapper/108:17:511
1772999150,1cyclictest0-21swapper/108:28:361
1772199150,14cyclictest0-21swapper/011:06:290
1772199150,14cyclictest0-21swapper/010:51:220
1772199150,1cyclictest0-21swapper/010:35:140
1138452150,11pltrace54-21ksoftirqd/411:19:364
590052140,10pltrace9676-21ssh12:26:140
542352140,6pltrace5938-21latency_hist07:45:006
371652140,10pltrace78-21ksoftirqd/708:40:177
371652140,10pltrace54-21ksoftirqd/408:41:234
2970452140,8pltrace1526-21ssh11:41:356
2863552140,10pltrace54-21ksoftirqd/409:55:004
2473552140,7pltrace24903-21ssh10:57:355
188102140,1sleep562-21ksoftirqd/512:00:125
17755991413,1cyclictest0-21swapper/712:37:137
17755991413,1cyclictest0-21swapper/712:02:537
17755991413,1cyclictest0-21swapper/710:49:147
17755991412,1cyclictest0-21swapper/710:02:377
17755991411,2cyclictest0-21swapper/712:12:217
1775599140,14cyclictest0-21swapper/711:45:347
1775599140,14cyclictest0-21swapper/711:45:347
1775599140,14cyclictest0-21swapper/709:36:237
1775599140,1cyclictest0-21swapper/712:24:557
1775599140,1cyclictest0-21swapper/712:19:447
1775599140,1cyclictest0-21swapper/711:44:377
1775599140,1cyclictest0-21swapper/711:26:087
1775599140,1cyclictest0-21swapper/709:56:187
1775099143,9cyclictest0-21swapper/607:19:586
17750991410,3cyclictest0-21swapper/612:16:166
1775099140,8cyclictest0-21swapper/609:14:386
1775099140,13cyclictest0-21swapper/612:31:306
1775099140,13cyclictest0-21swapper/607:35:126
1775099140,1cyclictest0-21swapper/611:02:576
1775099140,1cyclictest0-21swapper/610:53:436
1775099140,1cyclictest0-21swapper/609:30:206
1774699140,3cyclictest0-21swapper/511:49:375
1774699140,3cyclictest0-21swapper/511:49:375
1774699140,3cyclictest0-21swapper/510:34:085
1774699140,14cyclictest0-21swapper/510:00:285
1774699140,13cyclictest0-21swapper/508:56:105
1774699140,1cyclictest0-21swapper/510:45:295
17744991413,1cyclictest0-21swapper/410:17:384
17744991411,2cyclictest0-21swapper/409:43:054
1774499140,8cyclictest0-21swapper/411:02:594
1774499140,7cyclictest0-21swapper/410:51:434
1774499140,14cyclictest0-21swapper/409:36:114
1774499140,13cyclictest0-21swapper/412:27:194
1774499140,13cyclictest0-21swapper/412:03:304
1774499140,13cyclictest0-21swapper/410:30:044
1774499140,1cyclictest0-21swapper/412:13:144
1774499140,1cyclictest0-21swapper/411:06:024
17739991413,1cyclictest0-21swapper/312:38:233
17739991413,1cyclictest0-21swapper/312:11:113
17739991413,1cyclictest0-21swapper/311:25:313
17739991413,1cyclictest0-21swapper/311:17:453
17739991413,1cyclictest0-21swapper/310:45:513
17739991413,1cyclictest0-21swapper/309:51:273
17739991412,1cyclictest0-21swapper/310:38:443
1773999140,14cyclictest0-21swapper/312:25:063
1773999140,14cyclictest0-21swapper/311:36:413
1773999140,14cyclictest0-21swapper/311:36:413
1773999140,14cyclictest0-21swapper/311:22:363
1773999140,14cyclictest0-21swapper/310:30:093
1773999140,14cyclictest0-21swapper/309:40:363
1773999140,14cyclictest0-21swapper/308:06:153
1773999140,1cyclictest0-21swapper/309:25:233
17735991412,1cyclictest0-21swapper/209:40:192
1773599140,7cyclictest0-21swapper/212:23:042
1773599140,14cyclictest0-21swapper/211:34:572
1773599140,14cyclictest0-21swapper/211:23:562
1773599140,13cyclictest0-21swapper/210:25:202
1773599140,13cyclictest0-21swapper/210:15:082
1773599140,13cyclictest0-21swapper/210:07:312
1773599140,1cyclictest0-21swapper/211:10:202
1772999149,4cyclictest0-21swapper/111:26:021
1772999149,4cyclictest0-21swapper/107:13:401
1772999149,3cyclictest0-21swapper/111:31:411
1772999148,4cyclictest0-21swapper/108:59:231
1772999147,6cyclictest11913-21crond10:09:591
1772999147,6cyclictest1146-21snmpd09:49:511
1772999145,7cyclictest0-21swapper/107:15:011
1772999145,3cyclictest1146-21snmpd12:08:211
1772999144,4cyclictest31225-21cat07:30:161
1772999144,3cyclictest1066-13audispd10:19:591
1772999143,4cyclictest19765-21cut12:00:161
17729991413,1cyclictest0-21swapper/109:13:361
1772999141,12cyclictest0-21swapper/111:16:321
1772999140,7cyclictest15766-21latency_hist09:40:011
1772999140,7cyclictest0-21swapper/111:47:111
1772999140,7cyclictest0-21swapper/111:47:111
1772999140,14cyclictest0-21swapper/111:24:351
1772999140,14cyclictest0-21swapper/110:42:581
1772999140,14cyclictest0-21swapper/109:55:221
1772999140,11cyclictest0-21swapper/108:22:071
1772999140,1cyclictest2548-21ssh10:34:231
1772999140,1cyclictest0-21swapper/110:03:571
17721991413,1cyclictest0-21swapper/010:43:200
17721991413,1cyclictest0-21swapper/009:11:520
17721991411,2cyclictest1146-21snmpd09:49:420
1772199140,7cyclictest0-21swapper/011:40:230
1772199140,7cyclictest0-21swapper/008:46:190
1772199140,7cyclictest0-21swapper/008:46:190
1772199140,13cyclictest0-21swapper/010:06:210
1772199140,13cyclictest0-21swapper/009:36:180
1772199140,13cyclictest0-21swapper/009:30:580
1772199140,13cyclictest0-21swapper/009:00:440
1772199140,1cyclictest0-21swapper/012:33:160
1772199140,1cyclictest0-21swapper/011:30:460
1772199140,1cyclictest0-21swapper/010:00:160
1520752140,9pltrace0-21swapper/510:15:035
1378652140,0pltrace0-21swapper/708:00:487
1138452140,1pltrace12787-21ssh11:19:455
542352130,7pltrace0-21swapper/607:45:006
542352130,2pltrace5903-21sed07:45:002
371652130,4pltrace0-21swapper/008:41:260
3005652130,5pltrace30353-21ssh12:13:035
2946152130,4pltrace0-21swapper/707:30:477
2863552130,5pltrace30709-21ssh09:55:132
2863552130,1pltrace0-21swapper/609:55:136
2496752130,3pltrace25561-21aten_r4power_cu08:20:115
2473552130,5pltrace0-21swapper/210:57:262
2418352130,5pltrace0-21swapper/210:23:532
2418352130,4pltrace0-21swapper/310:22:573
1775599134,5cyclictest0-21swapper/709:25:247
17755991312,1cyclictest0-21swapper/711:19:507
17755991312,1cyclictest0-21swapper/709:49:597
17755991312,1cyclictest0-21swapper/709:40:557
17755991312,1cyclictest0-21swapper/709:16:287
1775099137,5cyclictest16302-21ssh11:22:186
17750991312,1cyclictest0-21swapper/609:24:016
17750991312,1cyclictest0-21swapper/609:17:516
17750991310,2cyclictest0-21swapper/612:03:106
1775099131,11cyclictest0-21swapper/607:22:346
1775099130,13cyclictest0-21swapper/611:08:176
1775099130,13cyclictest0-21swapper/610:17:176
1775099130,13cyclictest0-21swapper/609:05:136
1775099130,12cyclictest0-21swapper/608:47:016
1775099130,12cyclictest0-21swapper/608:47:016
1775099130,12cyclictest0-21swapper/608:14:196
1775099130,1cyclictest0-21swapper/612:23:156
1775099130,1cyclictest0-21swapper/612:11:456
1774699139,3cyclictest0-21swapper/508:33:215
1774699137,5cyclictest0-21swapper/509:09:315
1774699137,5cyclictest0-21swapper/508:12:155
1774699137,3cyclictest0-21swapper/509:24:595
17746991312,1cyclictest0-21swapper/511:51:225
17746991312,1cyclictest0-21swapper/511:39:435
17746991312,1cyclictest0-21swapper/511:39:435
17746991312,1cyclictest0-21swapper/511:23:415
1774699130,13cyclictest0-21swapper/509:27:355
1774699130,1cyclictest0-21swapper/509:11:145
17744991312,1cyclictest0-21swapper/410:08:434
17744991312,1cyclictest0-21swapper/409:11:154
17744991310,2cyclictest1066-13audispd08:10:004
1774499130,13cyclictest0-21swapper/410:40:574
1774499130,12cyclictest0-21swapper/410:36:554
1774499130,1cyclictest0-21swapper/410:02:544
17739991312,1cyclictest0-21swapper/309:45:083
17739991312,1cyclictest0-21swapper/309:15:503
1773999130,13cyclictest0-21swapper/310:03:363
1773599139,2cyclictest15273-21ssh09:38:502
1773599137,5cyclictest0-21swapper/208:13:242
1773599130,6cyclictest0-21swapper/211:30:002
1773599130,13cyclictest0-21swapper/212:36:182
1773599130,13cyclictest0-21swapper/210:40:422
1773599130,12cyclictest0-21swapper/208:57:012
1773599130,12cyclictest0-21swapper/208:15:572
1773599130,12cyclictest0-21swapper/207:58:492
1772999137,5cyclictest0-21swapper/109:16:291
1772999137,3cyclictest0-21swapper/108:33:131
1772999135,2cyclictest0-21swapper/109:05:161
1772999133,4cyclictest7826-21timerwakeupswit07:45:211
1772999132,4cyclictest1055-13auditd08:00:001
17729991312,1cyclictest0-21swapper/111:38:401
17729991312,1cyclictest0-21swapper/111:38:401
17729991311,1cyclictest0-21swapper/112:20:361
17729991310,2cyclictest1146-21snmpd10:51:101
1772999130,13cyclictest0-21swapper/111:44:001
17721991312,1cyclictest0-21swapper/012:21:270
17721991312,1cyclictest0-21swapper/012:18:510
17721991312,1cyclictest0-21swapper/012:06:520
17721991312,1cyclictest0-21swapper/011:18:380
17721991312,1cyclictest0-21swapper/010:34:450
17721991312,1cyclictest0-21swapper/010:18:330
1772199130,7cyclictest0-21swapper/011:48:330
1772199130,7cyclictest0-21swapper/011:48:330
1772199130,6cyclictest10281-21pluginstate07:50:190
1772199130,6cyclictest0-21swapper/011:04:080
1772199130,13cyclictest0-21swapper/012:12:320
1772199130,13cyclictest0-21swapper/010:23:250
1772199130,13cyclictest0-21swapper/007:27:360
1772199130,12cyclictest0-21swapper/010:12:180
1772199130,12cyclictest0-21swapper/009:57:360
1772199130,12cyclictest0-21swapper/008:37:200
1772199130,12cyclictest0-21swapper/008:37:200
1772199130,1cyclictest0-21swapper/010:26:290
1767552130,10pltrace0-21swapper/509:03:485
133452130,8pltrace0-21swapper/210:33:332
133452130,5pltrace0-21swapper/610:33:356
1130652130,6pltrace15032-21sh10:45:266
1130652130,2pltrace14673-21timerandwakeup10:45:202
928652120,5pltrace0-21swapper/208:51:522
3225152120,3pltrace1549-21kernelversion07:35:152
2970452120,3pltrace949-21uptime11:40:202
2863852120,8pltrace0-21swapper/009:20:020
2863852120,4pltrace0-21swapper/209:20:052
2473552120,5pltrace0-21swapper/010:57:290
2473552120,4pltrace0-21swapper/110:57:301
2355252120,0pltrace0-21swapper/509:47:105
1939352120,5pltrace0-21swapper/208:09:062
1775599129,2cyclictest9017-21grep08:45:237
1775599129,2cyclictest9017-21grep08:45:237
1775599129,2cyclictest711-21users08:30:237
1775599129,2cyclictest16363-21gltestperf09:00:157
1775599129,2cyclictest1146-21snmpd07:42:367
1775599129,2cyclictest0-21swapper/707:57:487
1775599126,5cyclictest78-21ksoftirqd/711:10:037
1775599120,1cyclictest0-21swapper/707:29:277
1775099126,5cyclictest0-21swapper/607:31:086
1775099126,4cyclictest0-21swapper/609:46:556
17750991211,1cyclictest0-21swapper/610:44:006
1775099120,12cyclictest0-21swapper/609:37:576
1774699129,2cyclictest5080-21fschecks_time08:40:135
17746991211,1cyclictest0-21swapper/509:17:525
1774499129,2cyclictest0-21swapper/411:41:214
1774499129,2cyclictest0-21swapper/407:10:584
1774499128,3cyclictest0-21swapper/411:23:324
1774499128,3cyclictest0-21swapper/408:14:484
17744991210,1cyclictest0-21swapper/409:04:494
1774499120,11cyclictest0-21swapper/411:49:164
1774499120,11cyclictest0-21swapper/411:49:154
1774499120,11cyclictest0-21swapper/407:19:424
1774499120,1cyclictest0-21swapper/412:37:414
1773999129,2cyclictest1063-17auditd09:21:193
1773999129,2cyclictest0-21swapper/309:10:003
1773999127,3cyclictest191rcu_preempt07:25:163
1773999127,1cyclictest191rcu_preempt08:20:203
1773999127,1cyclictest191rcu_preempt07:15:013
17739991211,1cyclictest0-21swapper/312:17:203
17739991211,1cyclictest0-21swapper/312:05:013
17739991211,1cyclictest0-21swapper/307:10:123
1773599129,2cyclictest0-21swapper/211:09:232
1773599120,11cyclictest0-21swapper/208:38:522
1773599120,11cyclictest0-21swapper/208:38:522
1772999129,2cyclictest0-21swapper/108:51:261
1772999127,4cyclictest0-21swapper/111:02:111
1772999127,4cyclictest0-21swapper/107:44:141
1772999124,3cyclictest13478-21latency10:10:131
1772999123,4cyclictest12731-21cat12:30:151
1772999123,2cyclictest16587-21latency09:00:171
17729991210,2cyclictest0-21swapper/107:24:291
1772999120,5cyclictest26896-21uname09:50:171
1772999120,5cyclictest24448-21chrt10:22:481
1772999120,4cyclictest19750-21chrt09:43:461
17721991211,1cyclictest0-21swapper/009:43:060
17721991211,1cyclictest0-21swapper/009:25:090
1772199120,11cyclictest0-21swapper/008:56:200
1772199120,11cyclictest0-21swapper/007:56:350
1772199120,1cyclictest0-21swapper/008:09:520
1130652120,5pltrace0-21swapper/010:45:260
2496752110,7pltrace54-21ksoftirqd/408:20:164
2128552110,1pltrace0-21swapper/212:03:182
1907852110,5pltrace21042-21cstates09:45:112
1775599119,1cyclictest1438-21ls07:35:157
1775599119,1cyclictest0-21swapper/710:50:137
1775599118,2cyclictest2955-21ntpq08:35:207
1775599118,2cyclictest2955-21ntpq08:35:197
1775599118,2cyclictest22524-21fschecks_count10:55:157
1775599118,2cyclictest18228-21grep07:10:137
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional