You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-07 - 20:40
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Wed Jan 07, 2026 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22608521480,139pltrace0-21swapper/307:09:323
22608521300,125pltrace0-21swapper/207:10:012
22608521230,111pltrace0-21swapper/607:09:566
19821521070,104pltrace0-21swapper/107:09:121
31722521050,1pltrace1283-21pltrace-run12:14:163
1341752990,2pltrace0-21swapper/607:49:156
1982152940,90pltrace0-21swapper/507:09:105
2260852920,78pltrace0-21swapper/707:09:357
1110652740,2pltrace0-21swapper/010:39:170
2234325844,10sleep00-21swapper/007:05:460
2238525743,10sleep40-21swapper/407:06:224
2566752200,7pltrace0-21swapper/709:10:317
2285399200,14cyclictest0-21swapper/108:45:201
22848992014,5cyclictest0-21swapper/011:54:340
22870991915,3cyclictest0-21swapper/508:05:215
2117752190,13pltrace23813-21chrt10:02:005
22876991814,3cyclictest0-21swapper/711:58:507
2284899188,4cyclictest15-21ksoftirqd/008:45:110
22848991813,2cyclictest0-21swapper/012:06:260
724652170,12pltrace8314-21fschecks_count09:35:135
553452170,13pltrace54-21ksoftirqd/410:29:344
22870991711,5cyclictest0-21swapper/509:27:475
22857991711,5cyclictest0-21swapper/211:50:462
22857991711,5cyclictest0-21swapper/208:54:262
22853991711,5cyclictest0-21swapper/110:57:291
2284899177,4cyclictest15-21ksoftirqd/009:05:160
22848991712,3cyclictest0-21swapper/009:40:420
2284899171,8cyclictest0-21swapper/007:15:330
2284899170,5cyclictest2884-21expr12:20:120
2284899170,5cyclictest2884-21expr12:20:120
1899352170,3pltrace20552-21kernelversion08:00:172
1899352170,10pltrace54-21ksoftirqd/408:00:004
1899352170,10pltrace0-21swapper/508:00:155
3188152160,11pltrace54-21ksoftirqd/407:28:124
2287699160,15cyclictest0-21swapper/712:13:507
2287699160,15cyclictest0-21swapper/712:06:407
2287699160,15cyclictest0-21swapper/707:10:227
2287499161,8cyclictest0-21swapper/612:27:126
2287499161,8cyclictest0-21swapper/612:27:126
2287499161,14cyclictest0-21swapper/608:51:436
2287499160,15cyclictest0-21swapper/608:56:356
22870991613,2cyclictest0-21swapper/507:50:175
22865991610,5cyclictest0-21swapper/407:24:564
2286599160,8cyclictest0-21swapper/412:18:004
2286599160,4cyclictest0-21swapper/412:21:454
2286599160,4cyclictest0-21swapper/412:21:454
2286599160,15cyclictest0-21swapper/408:50:204
2286599160,15cyclictest0-21swapper/407:31:204
2286199164,11cyclictest1055-13auditd11:23:063
2286199161,8cyclictest0-21swapper/309:54:553
2286199160,8cyclictest0-21swapper/311:54:043
2286199160,15cyclictest0-21swapper/310:32:163
22857991610,5cyclictest0-21swapper/210:10:022
2285799160,15cyclictest0-21swapper/212:05:232
2285799160,15cyclictest0-21swapper/207:34:472
2285399168,7cyclictest1055-13auditd10:10:001
22853991610,5cyclictest0-21swapper/109:24:301
22853991610,5cyclictest0-21swapper/109:24:301
2285399161,4cyclictest0-21swapper/112:19:421
2284899167,6cyclictest15-21ksoftirqd/011:20:210
2284899167,6cyclictest15-21ksoftirqd/007:35:140
2284899166,4cyclictest15-21ksoftirqd/011:35:230
22848991613,2cyclictest17184-21taskset08:53:100
22848991611,3cyclictest0-21swapper/009:58:060
22848991611,2cyclictest15-21ksoftirqd/012:30:420
22848991611,2cyclictest15-21ksoftirqd/012:30:420
2006652160,4pltrace0-21swapper/709:01:257
2006652160,10pltrace1146-21snmpd08:59:207
939652150,4pltrace12049-21chrt11:37:435
724652150,12pltrace0-21swapper/109:35:161
3016852150,11pltrace54-21ksoftirqd/408:19:164
22876991511,3cyclictest1146-21snmpd11:10:137
22876991511,3cyclictest0-21swapper/712:15:567
22876991510,3cyclictest0-21swapper/710:10:007
2287699150,7cyclictest0-21swapper/711:23:157
2287699150,14cyclictest0-21swapper/712:31:487
2287699150,14cyclictest0-21swapper/712:31:487
2287699150,14cyclictest0-21swapper/709:34:427
22874991510,3cyclictest0-21swapper/610:29:196
2287499150,8cyclictest0-21swapper/612:23:066
2287499150,8cyclictest0-21swapper/612:23:066
2287499150,8cyclictest0-21swapper/607:59:006
2287499150,8cyclictest0-21swapper/607:10:406
2287499150,7cyclictest0-21swapper/608:21:026
2287499150,14cyclictest0-21swapper/611:20:496
22870991511,3cyclictest0-21swapper/508:16:365
22870991510,3cyclictest0-21swapper/511:13:185
2287099150,7cyclictest0-21swapper/511:31:115
2287099150,7cyclictest0-21swapper/508:20:555
2287099150,7cyclictest0-21swapper/507:47:375
2287099150,4cyclictest0-21swapper/511:53:125
2287099150,4cyclictest0-21swapper/509:31:115
2287099150,3cyclictest0-21swapper/510:56:405
2287099150,14cyclictest0-21swapper/511:06:335
2287099150,13cyclictest0-21swapper/508:44:235
2286599155,8cyclictest0-21swapper/408:41:044
2286599150,8cyclictest0-21swapper/409:07:404
2286599150,8cyclictest0-21swapper/408:24:384
2286599150,7cyclictest0-21swapper/408:00:074
2286599150,14cyclictest0-21swapper/412:36:574
2286199157,7cyclictest1146-21snmpd10:43:203
2286199157,7cyclictest1146-21snmpd10:39:233
22861991512,2cyclictest0-21swapper/309:15:163
22861991512,2cyclictest0-21swapper/309:15:163
2286199151,2cyclictest0-21swapper/310:15:003
2286199150,8cyclictest0-21swapper/307:36:203
2286199150,2cyclictest0-21swapper/307:30:013
2286199150,14cyclictest0-21swapper/309:38:413
22857991510,3cyclictest0-21swapper/211:35:462
2285799151,8cyclictest0-21swapper/210:53:232
2285799150,8cyclictest0-21swapper/212:39:032
2285799150,8cyclictest0-21swapper/211:14:392
2285799150,8cyclictest0-21swapper/210:41:172
2285799150,8cyclictest0-21swapper/210:26:582
2285799150,7cyclictest0-21swapper/211:43:462
2285799150,7cyclictest0-21swapper/210:15:222
2285799150,14cyclictest0-21swapper/210:04:222
2285799150,14cyclictest0-21swapper/207:21:442
2285399156,3cyclictest0-21swapper/107:16:271
2285399151,8cyclictest0-21swapper/108:28:491
2285399150,14cyclictest0-21swapper/111:11:361
2285399150,14cyclictest0-21swapper/110:27:531
2285399150,14cyclictest0-21swapper/109:11:561
2285399150,11cyclictest0-21swapper/111:59:081
2285399150,1cyclictest0-21swapper/111:29:201
2284899158,4cyclictest15-21ksoftirqd/012:00:210
2284899158,4cyclictest15-21ksoftirqd/010:05:140
2284899158,4cyclictest15-21ksoftirqd/009:50:120
2284899158,4cyclictest15-21ksoftirqd/009:20:130
2284899158,4cyclictest15-21ksoftirqd/009:20:130
2284899158,4cyclictest15-21ksoftirqd/008:05:170
2284899158,4cyclictest15-21ksoftirqd/007:10:230
2284899155,4cyclictest15-21ksoftirqd/011:58:470
2284899155,4cyclictest15-21ksoftirqd/009:30:150
2284899155,4cyclictest15-21ksoftirqd/008:35:170
2284899155,4cyclictest15-21ksoftirqd/008:30:120
2284899155,4cyclictest15-21ksoftirqd/008:20:140
22848991512,2cyclictest29302-21taskset10:10:440
2284899151,7cyclictest0-21swapper/010:24:040
2284899151,7cyclictest0-21swapper/010:16:430
2284899150,14cyclictest13444-21cpuspeed_turbos09:45:100
2284899150,14cyclictest0-21swapper/011:40:250
2284899150,14cyclictest0-21swapper/007:29:060
1775652150,4pltrace0-21swapper/611:50:176
1281752150,0pltrace0-21swapper/709:48:027
832052140,2pltrace0-21swapper/710:34:417
768252140,11pltrace0-21swapper/212:31:332
768252140,11pltrace0-21swapper/212:31:332
724652140,6pltrace0-21swapper/709:35:157
3127852140,9pltrace0-21swapper/709:23:087
3127852140,9pltrace0-21swapper/709:23:087
22876991410,3cyclictest0-21swapper/708:31:017
2287499149,4cyclictest0-21swapper/610:56:086
2287499149,3cyclictest0-21swapper/609:26:296
2287499141,12cyclictest0-21swapper/607:40:476
2287499140,1cyclictest0-21swapper/610:39:166
2287099140,7cyclictest0-21swapper/509:52:305
2287099140,7cyclictest0-21swapper/509:47:335
2287099140,3cyclictest0-21swapper/510:42:415
2286599149,3cyclictest0-21swapper/410:47:504
22865991413,1cyclictest0-21swapper/409:10:194
2286599140,7cyclictest0-21swapper/411:25:114
2286599140,13cyclictest0-21swapper/412:09:154
2286599140,1cyclictest0-21swapper/409:55:194
2286599140,1cyclictest0-21swapper/409:28:084
2286599140,1cyclictest0-21swapper/408:10:244
2286199147,6cyclictest1065-17sedispatch11:45:003
2286199145,8cyclictest1146-21snmpd09:03:083
2286199145,7cyclictest0-21swapper/309:20:133
2286199145,7cyclictest0-21swapper/309:20:133
2286199143,5cyclictest1141-21polkitd09:15:003
2286199143,4cyclictest25332-21expr08:10:123
2286199143,4cyclictest1303-21gltestperf10:20:153
22861991410,3cyclictest0-21swapper/307:45:143
2286199140,8cyclictest0-21swapper/311:58:113
2286199140,8cyclictest0-21swapper/311:45:113
2286199140,3cyclictest21241-21latency_hist10:00:023
2286199140,13cyclictest0-21swapper/308:35:163
2286199140,13cyclictest0-21swapper/308:25:243
2286199140,12cyclictest25935-21gltestperf07:15:013
2285799141,12cyclictest0-21swapper/209:54:392
2285799140,8cyclictest0-21swapper/211:49:402
2285799140,7cyclictest0-21swapper/211:05:032
2285799140,7cyclictest0-21swapper/210:22:012
2285799140,7cyclictest0-21swapper/209:55:032
2285799140,3cyclictest0-21swapper/212:26:212
2285799140,3cyclictest0-21swapper/212:26:212
2285799140,13cyclictest0-21swapper/208:48:552
2285799140,13cyclictest0-21swapper/208:39:432
2285799140,13cyclictest0-21swapper/207:50:202
2285799140,12cyclictest0-21swapper/212:15:082
2285399149,4cyclictest0-21swapper/112:25:031
2285399149,4cyclictest0-21swapper/112:25:031
2285399149,4cyclictest0-21swapper/107:11:451
2285399146,2cyclictest0-21swapper/112:02:221
2285399146,1cyclictest0-21swapper/108:50:131
22853991412,2cyclictest0-21swapper/112:35:241
22853991410,3cyclictest0-21swapper/107:40:021
2285399141,12cyclictest0-21swapper/110:12:011
2285399140,8cyclictest0-21swapper/111:07:111
2285399140,7cyclictest0-21swapper/110:45:001
2285399140,11cyclictest0-21swapper/111:21:141
2285399140,1cyclictest0-21swapper/109:02:201
2284899148,5cyclictest0-21swapper/007:50:580
2284899147,4cyclictest15-21ksoftirqd/011:30:160
2284899147,2cyclictest106311pltrace-run07:44:160
2284899146,5cyclictest15-21ksoftirqd/010:30:220
2284899146,5cyclictest15-21ksoftirqd/007:55:120
2284899144,7cyclictest15-21ksoftirqd/011:45:120
22848991412,1cyclictest29626-21cut07:20:120
22848991411,2cyclictest31294-21expr11:15:110
22848991411,2cyclictest18159-21expr08:55:130
22848991411,2cyclictest1146-21snmpd08:17:020
22848991410,2cyclictest15-21ksoftirqd/009:02:550
2284899140,3cyclictest0-21swapper/012:10:410
2284899140,13cyclictest0-21swapper/009:39:100
1775652140,2pltrace0-21swapper/711:49:577
891952130,5pltrace0-21swapper/608:39:526
724652130,4pltrace0-21swapper/609:35:156
48952130,9pltrace78-21ksoftirqd/708:29:137
3172252130,5pltrace0-21swapper/112:14:481
2678152130,0pltrace0-21swapper/710:14:027
2333652130,3pltrace25973-21sshd12:02:075
2287699139,3cyclictest31464-21unixbench-2d07:20:217
2287699130,7cyclictest0-21swapper/708:47:097
2287499139,2cyclictest0-21swapper/607:31:566
2287499130,12cyclictest0-21swapper/611:33:416
2287499130,12cyclictest0-21swapper/609:02:416
2287499130,12cyclictest0-21swapper/608:50:006
2287499130,12cyclictest0-21swapper/608:34:096
2287499130,12cyclictest0-21swapper/608:28:266
2287099139,3cyclictest0-21swapper/508:54:245
2287099137,5cyclictest0-21swapper/511:19:365
2287099137,3cyclictest0-21swapper/508:25:015
2287099130,13cyclictest0-21swapper/509:00:145
2286599138,4cyclictest0-21swapper/409:20:014
2286599138,4cyclictest0-21swapper/409:20:014
2286599138,3cyclictest0-21swapper/411:54:074
2286599130,12cyclictest0-21swapper/408:45:404
2286199138,4cyclictest0-21swapper/311:37:403
2286199138,3cyclictest0-21swapper/307:56:483
2286199137,5cyclictest0-21swapper/309:49:313
2286199137,4cyclictest0-21swapper/309:34:133
2286199136,4cyclictest26688-21aten_r4power_vo12:05:113
2286199135,7cyclictest1146-21snmpd12:26:133
2286199135,7cyclictest1146-21snmpd12:26:133
2286199133,4cyclictest4150-21cut10:25:153
2286199133,4cyclictest32424-21cat08:20:213
2286199133,4cyclictest30754-21cat07:20:153
2286199133,3cyclictest10774-21date12:35:013
2286199133,3cyclictest10774-21date12:35:013
2286199132,5cyclictest10050-21timerandwakeup07:40:223
2286199130,5cyclictest26560-21chrt10:06:233
2286199130,12cyclictest0-21swapper/308:55:393
2285799137,5cyclictest0-21swapper/208:09:032
2285799130,12cyclictest0-21swapper/211:18:092
2285799130,12cyclictest0-21swapper/209:48:102
2285799130,12cyclictest0-21swapper/209:06:092
2285399139,3cyclictest0-21swapper/109:33:341
2285399139,1cyclictest0-21swapper/108:56:401
2285399135,2cyclictest0-21swapper/111:40:001
2285399135,2cyclictest0-21swapper/109:10:001
22853991311,2cyclictest0-21swapper/112:22:561
22853991311,2cyclictest0-21swapper/112:22:561
22853991310,2cyclictest7910-21sadc07:40:001
2285399130,13cyclictest0-21swapper/107:25:211
2284899138,3cyclictest0-21swapper/008:41:220
2284899138,2cyclictest15-21ksoftirqd/012:15:120
2284899138,2cyclictest15-21ksoftirqd/011:05:150
2284899138,2cyclictest15-21ksoftirqd/008:10:170
2284899137,5cyclictest0-21swapper/007:32:240
2284899137,4cyclictest15-21ksoftirqd/010:50:150
2284899137,4cyclictest15-21ksoftirqd/009:10:150
2284899135,5cyclictest15-21ksoftirqd/010:40:220
2284899135,5cyclictest15-21ksoftirqd/008:00:170
2284899133,2cyclictest191rcu_preempt10:25:230
2284899132,4cyclictest15-21ksoftirqd/007:46:570
22848991311,1cyclictest0-21swapper/009:15:130
22848991311,1cyclictest0-21swapper/009:15:130
22848991310,2cyclictest29234-21gltestperf11:10:150
22848991310,2cyclictest15193-21fschecks_time10:45:150
1899352130,1pltrace191rcu_preempt08:00:211
1775652130,9pltrace0-21swapper/711:50:207
784552120,3pltrace8402-21cpu07:40:132
724652120,5pltrace0-21swapper/209:35:172
489552120,3pltrace7499-21taskset12:26:585
489552120,3pltrace7499-21taskset12:26:585
48952120,9pltrace54-21ksoftirqd/408:25:174
3016852120,4pltrace0-21swapper/208:19:212
2678152120,4pltrace29263-21users10:10:222
2287699129,2cyclictest18514-21timerwakeupswit07:55:227
2287699128,3cyclictest25014-21switchtime09:05:217
2287699126,5cyclictest0-21swapper/711:00:197
2287699126,5cyclictest0-21swapper/710:43:447
2287699123,8cyclictest0-21swapper/708:53:397
22876991210,1cyclictest0-21swapper/709:40:017
2287699120,12cyclictest0-21swapper/710:57:267
2287699120,11cyclictest0-21swapper/711:26:437
2287499126,5cyclictest0-21swapper/609:33:026
2287499126,5cyclictest0-21swapper/608:17:556
22874991210,1cyclictest0-21swapper/610:07:036
2287499120,11cyclictest0-21swapper/612:06:226
2287499120,11cyclictest0-21swapper/607:15:066
2287499120,1cyclictest0-21swapper/609:21:236
2287499120,1cyclictest0-21swapper/609:21:236
2287099126,4cyclictest1055-17auditd10:15:005
2287099120,11cyclictest0-21swapper/509:24:215
2287099120,11cyclictest0-21swapper/509:24:215
2287099120,11cyclictest0-21swapper/507:26:065
2286599129,2cyclictest1065-17sedispatch10:09:064
22865991211,1cyclictest0-21swapper/411:31:294
2286599120,11cyclictest0-21swapper/411:19:114
2286599120,11cyclictest0-21swapper/411:02:214
2286599120,11cyclictest0-21swapper/410:38:414
2286599120,1cyclictest0-21swapper/409:50:284
2286599120,1cyclictest0-21swapper/409:47:134
2286199126,5cyclictest0-21swapper/311:29:493
2286199124,7cyclictest20426-21hwlatdetect08:00:153
2286199123,7cyclictest13976-21wc07:50:123
2286199123,4cyclictest4772-21hwlatdetect08:30:133
2286199123,4cyclictest11729-21cut12:35:143
2286199123,3cyclictest1054-21irqbalance08:45:153
2286199123,2cyclictest23876-21taskset10:02:553
2286199122,4cyclictest16188-21cat08:50:163
2286199121,2cyclictest0-21swapper/312:20:223
2286199121,2cyclictest0-21swapper/312:20:223
2286199120,5cyclictest31005-21grep10:15:143
2286199120,5cyclictest28671-21cstates11:10:133
2286199120,5cyclictest2670-21forks09:25:153
2286199120,5cyclictest25694-21chrt09:09:353
2286199120,5cyclictest24462-21tune2fs12:00:133
2286199120,5cyclictest17465-21/usr/sbin/munin10:50:123
2286199120,5cyclictest14414-21aten_r4power_vo10:45:123
2286199120,5cyclictest12079-21getsmi09:40:223
2286199120,5cyclictest10935-21sendmail_mailst08:40:203
2286199120,4cyclictest3252-21df_inode07:30:143
2286199120,4cyclictest22747-21tr11:00:113
2286199120,11cyclictest24795-21date08:10:003
2285799127,3cyclictest0-21swapper/212:20:232
2285799127,3cyclictest0-21swapper/212:20:232
2285799120,11cyclictest0-21swapper/211:32:112
2285799120,11cyclictest0-21swapper/209:33:382
2285399128,1cyclictest0-21swapper/108:11:391
2285399127,1cyclictest0-21swapper/111:45:511
2285399127,1cyclictest0-21swapper/108:05:011
2285399126,5cyclictest0-21swapper/111:03:571
2285399125,2cyclictest1146-21snmpd08:44:191
2285399123,4cyclictest18091-21sed10:50:141
2285399122,8cyclictest0-21swapper/107:30:411
22853991210,2cyclictest0-21swapper/110:49:501
22853991210,1cyclictest0-21swapper/108:15:031
2285399120,11cyclictest0-21swapper/110:32:111
2285399120,11cyclictest0-21swapper/107:55:371
2284899129,2cyclictest3533-21ntpq09:25:180
2284899129,2cyclictest22207-21grep10:00:120
2284899129,2cyclictest21412-21processes10:55:210
2284899129,2cyclictest1019-21cut08:25:120
2284899126,4cyclictest15-21ksoftirqd/011:00:120
2284899120,11cyclictest0-21swapper/011:25:050
1899352120,5pltrace0-21swapper/608:00:196
1218052120,6pltrace0-21swapper/711:39:437
1046952120,1pltrace0-21swapper/012:36:300
784552110,2pltrace9201-21grep07:40:155
553452110,7pltrace0-21swapper/510:29:455
3016852110,6pltrace31095-21expr08:20:132
2333652110,7pltrace24469-21fschecks_count12:00:132
2287699119,1cyclictest0-21swapper/712:25:107
2287699119,1cyclictest0-21swapper/712:25:107
2287699118,2cyclictest1146-21snmpd11:08:247
2287699118,2cyclictest0-21swapper/708:35:087
2287699117,3cyclictest24657-21fschecks_time12:00:147
2287699116,3cyclictest0-21swapper/707:34:417
2287699115,5cyclictest0-21swapper/707:39:267
22876991110,1cyclictest0-21swapper/709:50:137
22876991110,1cyclictest0-21swapper/708:16:387
22876991110,1cyclictest0-21swapper/707:45:347
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional