You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-03 - 22:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Thu Sep 03, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9274521140,51pltrace0-21swapper/707:05:167
9274521060,102pltrace0-21swapper/507:05:225
3967521060,0pltrace0-21swapper/508:45:465
9785521000,0pltrace0-21swapper/010:05:470
1207852890,85pltrace0-21swapper/207:10:012
1235828751,10sleep60-21swapper/607:09:446
927452840,79pltrace0-21swapper/307:05:143
927452840,74pltrace0-21swapper/107:05:121
3039152690,1pltrace30395-21pltrace-run12:00:471
1211926652,10sleep00-21swapper/007:06:170
1236725844,10sleep40-21swapper/407:09:504
135452500,3pltrace78-21ksoftirqd/711:01:587
992552440,0pltrace78-21ksoftirqd/711:45:027
3207352430,7pltrace78-21ksoftirqd/711:32:027
2172052410,0pltrace0-21swapper/709:50:147
821852400,5pltrace0-21swapper/710:40:267
1156752350,2pltrace0-21swapper/709:38:207
303742330,0sleep20-21swapper/212:33:502
2522452330,0pltrace0-21swapper/710:24:447
2353152310,2pltrace0-21swapper/712:30:417
1667552300,0pltrace0-21swapper/709:40:537
305252290,0pltrace0-21swapper/710:31:247
2870052280,8pltrace78-21ksoftirqd/712:35:297
822652270,8pltrace78-21ksoftirqd/712:15:407
822652270,8pltrace78-21ksoftirqd/712:15:407
992552260,0pltrace0-21swapper/711:44:447
149202250,0sleep00-21swapper/011:15:110
1259799230,12cyclictest0-21swapper/109:29:281
821852210,0pltrace0-21swapper/710:38:147
2531252210,12pltrace27192-21ssh11:59:116
12614992115,5cyclictest25375-21taskset08:27:594
2863752200,6pltrace78-21ksoftirqd/709:25:407
1259299200,11cyclictest13341-21netstat08:05:160
2690452190,13pltrace0-21swapper/611:26:256
2351352190,14pltrace23990-21ssh09:16:376
2185152190,0pltrace0-21swapper/711:23:257
1259299190,14cyclictest0-21swapper/010:01:490
1259299190,1cyclictest0-21swapper/011:02:510
1207852190,0pltrace0-21swapper/707:10:207
305252180,15pltrace0-21swapper/310:32:073
2013352180,12pltrace0-21swapper/710:17:337
1677052180,4pltrace0-21swapper/711:15:507
1262699180,17cyclictest24534-21awk08:25:176
1261499187,5cyclictest54-21ksoftirqd/410:40:164
12614991817,1cyclictest0-21swapper/411:05:314
12614991815,2cyclictest29277-21taskset09:22:094
12614991815,2cyclictest26425-21smartctl07:30:204
12614991813,2cyclictest54-21ksoftirqd/407:46:184
12614991811,3cyclictest54-21ksoftirqd/407:55:094
1259799181,8cyclictest0-21swapper/111:40:001
12592991813,4cyclictest0-21swapper/011:33:470
1259299180,8cyclictest25358-21df07:30:120
1259299180,8cyclictest1178-21runrttasks10:16:140
1259299180,8cyclictest1178-21runrttasks08:54:370
1259299180,8cyclictest1178-21runrttasks08:24:380
1259299180,11cyclictest1981-21missed_timers10:30:200
1259299180,1cyclictest0-21swapper/011:21:280
1259299180,1cyclictest0-21swapper/009:27:000
2685452170,12pltrace28687-21ssh09:54:066
1497652170,12pltrace16389-21ssh11:48:206
1496352170,2pltrace0-21swapper/710:10:527
12618991715,1cyclictest0-21swapper/511:48:005
12614991714,2cyclictest9607-21expr08:00:134
12614991714,2cyclictest305-21taskset07:44:324
12614991714,2cyclictest24517-21/usr/sbin/munin09:50:274
12614991714,2cyclictest19282-21timerandwakeup08:15:214
12614991714,2cyclictest13096-21wget09:05:134
12614991714,2cyclictest11506-21taskset11:43:534
12604991711,4cyclictest0-21swapper/209:55:112
1259799172,13cyclictest0-21swapper/110:31:481
1259299175,8cyclictest0-21swapper/007:38:360
1259299173,9cyclictest0-21swapper/012:20:030
12592991712,4cyclictest0-21swapper/011:52:430
12592991712,4cyclictest0-21swapper/009:54:320
1259299170,9cyclictest1178-21runrttasks07:46:180
1259299170,8cyclictest24704-21ssh12:27:540
1259299170,8cyclictest24704-21ssh12:27:540
1259299170,8cyclictest20595-21sed07:20:160
1259299170,8cyclictest15345-21ssh11:46:260
1259299170,8cyclictest1178-21runrttasks09:08:260
1259299170,10cyclictest30857-21chrt08:36:380
1259299170,10cyclictest1178-21runrttasks09:14:160
1259299170,10cyclictest1178-21runrttasks07:59:410
1259299170,1cyclictest0-21swapper/010:41:580
1158952170,12pltrace13904-21sh11:14:576
470952160,11pltrace9296-21rm10:05:225
2863752160,13pltrace0-21swapper/609:21:596
146052160,11pltrace0-21swapper/312:37:003
126452160,11pltrace6212-21vmstat09:30:265
126452160,11pltrace6212-21vmstat09:30:265
1263399161,8cyclictest0-21swapper/708:24:157
1263399161,7cyclictest0-21swapper/707:41:087
1263399160,15cyclictest3542-21ssh12:06:397
1263399160,15cyclictest0-21swapper/711:11:517
12626991611,3cyclictest0-21swapper/611:35:026
1262699161,2cyclictest0-21swapper/610:04:426
1261899160,4cyclictest0-21swapper/507:55:575
1261499166,6cyclictest54-21ksoftirqd/409:11:344
1261499166,6cyclictest54-21ksoftirqd/408:54:374
1261499166,6cyclictest54-21ksoftirqd/408:24:384
1261499165,7cyclictest54-21ksoftirqd/407:20:164
12614991613,2cyclictest32465-21sed08:40:154
12614991613,2cyclictest29701-21sed10:25:204
12614991613,2cyclictest25296-21pltrace-run11:55:474
12614991613,2cyclictest16219-21wc11:15:204
12614991613,2cyclictest14841-21sed07:10:234
12614991613,2cyclictest1178-21runrttasks12:02:264
12614991613,2cyclictest1178-21runrttasks09:55:224
12614991613,2cyclictest1178-21runrttasks07:27:134
12614991613,2cyclictest1146-21snmpd11:47:474
12614991613,2cyclictest1146-21snmpd11:33:244
12614991613,2cyclictest1146-21snmpd10:03:074
12608991611,3cyclictest0-21swapper/312:14:423
12608991610,5cyclictest0-21swapper/312:02:483
12608991610,5cyclictest0-21swapper/308:13:483
1260499160,8cyclictest0-21swapper/208:24:332
1259799160,4cyclictest0-21swapper/111:31:231
1259799160,4cyclictest0-21swapper/111:26:001
1259799160,15cyclictest0-21swapper/110:15:571
1259299167,8cyclictest16571-21timerwakeupswit08:10:200
1259299161,8cyclictest0-21swapper/009:35:140
1259299161,14cyclictest0-21swapper/010:36:030
1259299160,9cyclictest16464-21/usr/sbin/munin07:15:230
1259299160,9cyclictest1146-21snmpd12:19:030
1259299160,9cyclictest1146-21snmpd12:19:030
1259299160,9cyclictest10228-21/usr/sbin/munin09:00:160
1259299160,8cyclictest32342-21perl08:40:140
1259299160,8cyclictest25845-21ssh10:54:590
1259299160,8cyclictest23009-21ssh09:48:070
1259299160,7cyclictest1178-21runrttasks07:27:520
1158952160,11pltrace0-21swapper/511:14:585
470952150,0pltrace0-21swapper/710:01:117
44542150,0sleep20-21swapper/210:00:212
396752150,4pltrace191rcu_preempt08:50:221
3079152150,1pltrace0-21swapper/608:40:006
2013352150,11pltrace0-21swapper/310:17:333
12633991512,2cyclictest0-21swapper/710:58:357
12633991510,3cyclictest0-21swapper/708:41:337
1263399151,7cyclictest0-21swapper/712:00:067
1263399150,7cyclictest0-21swapper/711:06:437
1263399150,7cyclictest0-21swapper/709:13:227
1263399150,14cyclictest0-21swapper/711:54:077
1263399150,14cyclictest0-21swapper/708:50:007
12626991511,2cyclictest0-21swapper/610:16:366
1262699150,8cyclictest0-21swapper/610:11:006
1262699150,4cyclictest0-21swapper/609:40:296
1262699150,14cyclictest0-21swapper/612:29:046
1262699150,14cyclictest0-21swapper/612:29:046
1262699150,14cyclictest0-21swapper/608:20:156
1261899150,8cyclictest0-21swapper/512:30:165
1261899150,7cyclictest0-21swapper/511:20:135
1261899150,7cyclictest0-21swapper/507:20:195
1261899150,14cyclictest0-21swapper/511:44:105
1261899150,14cyclictest0-21swapper/510:14:005
1261899150,1cyclictest0-21swapper/511:27:295
1261499159,3cyclictest54-21ksoftirqd/409:15:184
1261499159,2cyclictest1146-21snmpd10:10:094
1261499158,6cyclictest21254-21cpu12:25:104
1261499158,6cyclictest21254-21cpu12:25:104
1261499158,4cyclictest54-21ksoftirqd/411:10:494
1261499158,4cyclictest54-21ksoftirqd/407:15:194
1261499158,2cyclictest4407-21grep09:30:164
1261499158,2cyclictest4407-21grep09:30:164
1261499156,5cyclictest54-21ksoftirqd/412:17:274
1261499156,5cyclictest54-21ksoftirqd/412:17:274
1261499155,6cyclictest54-21ksoftirqd/410:16:144
1261499155,6cyclictest54-21ksoftirqd/410:05:174
1261499155,6cyclictest54-21ksoftirqd/408:55:074
1261499155,5cyclictest54-21ksoftirqd/410:36:244
12614991513,2cyclictest19993-21cut09:45:124
12614991513,1cyclictest32350-21idleruntime09:25:144
12614991513,1cyclictest0-21swapper/408:30:214
12614991512,2cyclictest4519-21expr07:50:144
12614991512,2cyclictest28006-21/usr/sbin/munin12:30:244
12614991512,2cyclictest2602-21cpuspeed_turbos11:35:114
12614991512,2cyclictest21660-21cstates10:50:114
12614991512,2cyclictest21050-21sshd11:52:254
12614991512,2cyclictest17282-21cat10:45:174
12614991512,2cyclictest17103-21taskset08:14:124
12614991512,2cyclictest16013-21sensors_fan09:40:214
12614991512,2cyclictest1146-21snmpd11:25:014
12614991512,2cyclictest1146-21snmpd08:45:584
12614991512,2cyclictest10973-21cat09:35:204
12614991511,4cyclictest0-21swapper/412:12:564
12614991510,2cyclictest54-21ksoftirqd/412:24:384
1261499150,8cyclictest0-21swapper/410:24:034
1261499150,7cyclictest0-21swapper/410:33:064
12608991510,3cyclictest0-21swapper/307:22:103
1260899150,7cyclictest0-21swapper/311:25:433
1260899150,7cyclictest0-21swapper/310:29:153
1260899150,7cyclictest0-21swapper/310:07:513
1260899150,3cyclictest0-21swapper/311:08:003
1260899150,14cyclictest0-21swapper/312:25:423
1260899150,14cyclictest0-21swapper/312:25:423
1260899150,14cyclictest0-21swapper/312:18:063
1260899150,14cyclictest0-21swapper/312:18:063
1260899150,13cyclictest0-21swapper/308:16:513
1260499151,7cyclictest0-21swapper/211:21:102
1260499151,3cyclictest0-21swapper/208:18:272
1260499151,1cyclictest0-21swapper/209:22:422
1260499150,7cyclictest0-21swapper/208:55:272
12597991513,1cyclictest0-21swapper/110:27:331
1259799151,7cyclictest0-21swapper/108:22:361
1259799150,8cyclictest0-21swapper/110:07:421
1259799150,4cyclictest0-21swapper/108:08:541
1259799150,3cyclictest0-21swapper/111:48:171
1259799150,14cyclictest0-21swapper/111:24:321
1259799150,13cyclictest0-21swapper/110:46:161
1259799150,1cyclictest0-21swapper/109:55:001
1259799150,1cyclictest0-21swapper/109:41:541
1259299159,5cyclictest0-21swapper/011:28:500
1259299155,8cyclictest1146-21snmpd10:59:160
1259299152,7cyclictest1178-21runrttasks10:27:200
1259299150,9cyclictest27762-21sed08:30:210
1259299150,8cyclictest9789-21rm11:40:310
1259299150,8cyclictest7535-21sensors12:10:240
1259299150,8cyclictest6852-21rm09:31:320
1259299150,8cyclictest6852-21rm09:31:320
1259299150,8cyclictest3530-21ssh12:39:310
1259299150,4cyclictest0-21swapper/011:56:310
1259299150,14cyclictest0-21swapper/010:20:550
1259299150,14cyclictest0-21swapper/008:25:190
2352152140,2pltrace24570-21chrt10:52:415
1829652140,1pltrace0-21swapper/509:15:115
1332352140,3pltrace191rcu_preempt10:41:465
1263399148,5cyclictest0-21swapper/707:19:347
12633991413,1cyclictest0-21swapper/707:30:227
1263399140,7cyclictest0-21swapper/707:26:227
1263399140,12cyclictest0-21swapper/707:48:357
12626991413,1cyclictest0-21swapper/611:18:326
12626991413,1cyclictest0-21swapper/611:04:466
12626991413,1cyclictest0-21swapper/610:41:476
12626991413,1cyclictest0-21swapper/610:25:166
1262699140,14cyclictest0-21swapper/612:31:336
1262699140,14cyclictest0-21swapper/610:33:216
1262699140,14cyclictest0-21swapper/609:57:056
1262699140,1cyclictest0-21swapper/612:16:396
1262699140,1cyclictest0-21swapper/612:16:396
1262699140,1cyclictest0-21swapper/611:24:516
1262699140,1cyclictest0-21swapper/610:51:396
12618991413,1cyclictest0-21swapper/510:47:405
12618991413,1cyclictest0-21swapper/510:30:245
1261899140,3cyclictest0-21swapper/512:15:305
1261899140,3cyclictest0-21swapper/512:15:305
1261899140,3cyclictest0-21swapper/507:45:205
1261899140,13cyclictest0-21swapper/512:04:245
1261899140,13cyclictest0-21swapper/507:32:205
1261899140,1cyclictest0-21swapper/509:39:595
1261499145,6cyclictest54-21ksoftirqd/410:59:054
12614991412,2cyclictest32223-21fschecks_time12:35:154
12614991412,1cyclictest0-21swapper/407:35:124
12614991411,2cyclictest613-21/usr/sbin/munin12:05:124
12614991411,2cyclictest30310-21wc08:35:204
12614991411,2cyclictest14110-21runrttasks08:06:184
1260899148,5cyclictest25453-21ssh11:56:023
12608991412,1cyclictest0-21swapper/307:55:143
1260899141,12cyclictest0-21swapper/307:53:443
1260899140,8cyclictest0-21swapper/308:45:373
1260899140,2cyclictest25439-21ssh10:21:173
1260899140,12cyclictest0-21swapper/309:56:533
1260899140,1cyclictest0-21swapper/312:30:193
1260899140,1cyclictest0-21swapper/311:30:253
1260899140,1cyclictest0-21swapper/309:45:003
12604991413,1cyclictest0-21swapper/212:03:092
1260499141,13cyclictest0-21swapper/211:41:082
1260499140,14cyclictest0-21swapper/211:35:572
1260499140,14cyclictest0-21swapper/211:27:032
1260499140,14cyclictest0-21swapper/210:05:462
1260499140,14cyclictest0-21swapper/209:26:452
1260499140,13cyclictest0-21swapper/210:26:182
1260499140,1cyclictest0-21swapper/212:11:152
1260499140,1cyclictest0-21swapper/210:37:012
1260499140,1cyclictest0-21swapper/210:20:502
1260499140,1cyclictest0-21swapper/210:10:282
1260499140,1cyclictest0-21swapper/208:50:122
12597991413,1cyclictest0-21swapper/111:55:381
12597991413,1cyclictest0-21swapper/110:01:101
12597991412,1cyclictest0-21swapper/107:35:171
1259799140,7cyclictest0-21swapper/107:18:521
1259799140,14cyclictest0-21swapper/112:25:541
1259799140,14cyclictest0-21swapper/112:25:541
1259799140,13cyclictest0-21swapper/110:51:211
1259799140,1cyclictest0-21swapper/112:31:151
1259799140,1cyclictest0-21swapper/112:17:291
1259799140,1cyclictest0-21swapper/112:17:291
1259799140,1cyclictest0-21swapper/110:20:551
1259799140,1cyclictest0-21swapper/109:05:181
1259299146,7cyclictest1146-21snmpd12:04:570
12592991413,1cyclictest0-21swapper/011:37:300
1259299140,8cyclictest29394-21ssh09:22:220
1259299140,8cyclictest22245-21ssh09:15:140
1259299140,8cyclictest18682-21ssh10:46:220
1259299140,7cyclictest0-21swapper/007:52:570
1259299140,13cyclictest0-21swapper/011:12:530
954652130,8pltrace78-21ksoftirqd/709:00:127
3079152130,1pltrace0-21swapper/208:40:002
2522452130,2pltrace0-21swapper/710:25:157
2351352130,3pltrace191rcu_preempt09:16:421
1849852130,7pltrace0-21swapper/512:24:455
1685952130,3pltrace191rcu_preempt08:15:115
1685952130,1pltrace0-21swapper/508:15:005
1263399138,2cyclictest27731-21ssh11:27:177
1263399130,13cyclictest0-21swapper/710:54:127
1263399130,13cyclictest0-21swapper/709:59:587
1263399130,13cyclictest0-21swapper/709:20:287
1263399130,12cyclictest0-21swapper/712:28:257
1263399130,12cyclictest0-21swapper/712:28:257
1263399130,12cyclictest0-21swapper/708:17:187
12626991312,1cyclictest0-21swapper/611:44:076
12626991312,1cyclictest0-21swapper/611:08:296
12626991312,1cyclictest0-21swapper/610:56:016
12626991312,1cyclictest0-21swapper/609:11:166
12626991312,1cyclictest0-21swapper/608:40:216
12626991312,1cyclictest0-21swapper/607:50:486
12626991311,1cyclictest0-21swapper/611:54:316
12626991311,1cyclictest0-21swapper/610:20:056
12626991311,1cyclictest0-21swapper/607:20:036
1262699130,2cyclictest0-21swapper/608:50:166
1262699130,13cyclictest0-21swapper/612:13:356
1262699130,13cyclictest0-21swapper/612:02:246
1262699130,13cyclictest0-21swapper/611:33:456
1262699130,13cyclictest0-21swapper/609:39:366
1262699130,13cyclictest0-21swapper/609:27:086
1262699130,12cyclictest0-21swapper/608:56:496
1262699130,12cyclictest0-21swapper/608:46:496
1262699130,12cyclictest0-21swapper/607:44:276
1262699130,12cyclictest0-21swapper/607:39:576
1261899139,3cyclictest0-21swapper/510:55:435
1261899139,3cyclictest0-21swapper/510:15:335
1261899138,3cyclictest1146-21snmpd09:45:565
12618991312,1cyclictest0-21swapper/511:38:595
12618991312,1cyclictest0-21swapper/510:03:375
12618991311,1cyclictest0-21swapper/512:07:295
12618991311,1cyclictest0-21swapper/511:30:055
12618991311,1cyclictest0-21swapper/511:00:225
12618991311,1cyclictest0-21swapper/509:56:015
12618991311,1cyclictest0-21swapper/509:41:265
12618991310,2cyclictest1066-13audispd07:40:005
12618991310,2cyclictest0-21swapper/507:50:205
1261899130,13cyclictest0-21swapper/512:29:205
1261899130,13cyclictest0-21swapper/512:29:205
1261899130,13cyclictest0-21swapper/509:23:285
1261899130,12cyclictest0-21swapper/509:28:025
1261899130,12cyclictest0-21swapper/508:41:035
12614991311,1cyclictest19895-21/usr/sbin/munin11:20:114
12614991310,2cyclictest1146-21snmpd11:04:164
12614991310,2cyclictest11039-21perl09:00:134
1260899139,3cyclictest0-21swapper/308:51:163
12608991312,1cyclictest0-21swapper/311:37:513
12608991312,1cyclictest0-21swapper/309:46:283
1260899130,13cyclictest0-21swapper/312:23:023
1260899130,13cyclictest0-21swapper/311:13:153
1260899130,13cyclictest0-21swapper/310:43:473
1260899130,13cyclictest0-21swapper/310:13:503
1260899130,13cyclictest0-21swapper/309:21:033
1260899130,12cyclictest0-21swapper/311:20:013
1260899130,12cyclictest0-21swapper/310:51:463
1260899130,1cyclictest0-21swapper/311:53:053
1260899130,1cyclictest0-21swapper/310:49:173
1260899130,1cyclictest0-21swapper/309:26:143
1260499137,5cyclictest0-21swapper/207:28:342
12604991312,1cyclictest0-21swapper/212:18:322
12604991312,1cyclictest0-21swapper/212:18:322
12604991312,1cyclictest0-21swapper/211:11:502
12604991312,1cyclictest0-21swapper/209:39:132
12604991312,1cyclictest0-21swapper/209:17:322
1260499130,13cyclictest0-21swapper/212:22:452
1260499130,13cyclictest0-21swapper/211:18:092
1260499130,13cyclictest0-21swapper/210:45:262
1260499130,12cyclictest0-21swapper/209:01:432
1260499130,1cyclictest0-21swapper/211:52:572
1259799138,2cyclictest0-21swapper/108:48:341
1259799137,3cyclictest0-21swapper/110:40:471
12597991312,1cyclictest0-21swapper/110:58:381
12597991311,1cyclictest0-21swapper/111:18:141
12597991310,2cyclictest1028-21unixbench_singl08:40:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional