You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-28 - 14:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Thu May 28, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24365521180,49pltrace0-21swapper/707:06:277
27153521060,102pltrace0-21swapper/207:10:002
2436552990,96pltrace0-21swapper/607:05:106
2436552850,81pltrace0-21swapper/307:08:123
2700727359,10sleep50-21swapper/507:07:585
2700327157,10sleep10-21swapper/107:07:541
2461452600,0pltrace0-21swapper/308:59:453
2696625945,10sleep00-21swapper/007:07:210
2705325844,10sleep40-21swapper/407:08:374
2928052510,9pltrace78-21ksoftirqd/711:31:427
2928052410,3pltrace0-21swapper/711:30:017
507752400,0pltrace0-21swapper/709:55:107
1529352400,6pltrace78-21ksoftirqd/711:16:077
1398052370,1pltrace16328-21timerandwakeup10:05:197
229852340,1pltrace0-21swapper/712:09:527
2515352330,6pltrace78-21ksoftirqd/712:01:397
719752320,8pltrace78-21ksoftirqd/711:41:357
27382993130,1cyclictest54-21ksoftirqd/411:40:014
1529352310,8pltrace78-21ksoftirqd/711:14:507
1898252300,0pltrace0-21swapper/710:11:277
2461452290,3pltrace0-21swapper/709:00:147
146452260,4pltrace0-21swapper/710:27:467
2515352250,6pltrace78-21ksoftirqd/711:59:517
2413652250,6pltrace78-21ksoftirqd/710:15:497
596552230,6pltrace78-21ksoftirqd/710:33:577
27375992320,2cyclictest371ktimers/211:40:012
1398052230,6pltrace78-21ksoftirqd/710:04:567
507752210,12pltrace7265-21getsmi09:55:206
2413652210,13pltrace28174-21ssh10:17:431
1973652210,0pltrace0-21swapper/511:19:455
27391992010,8cyclictest0-21swapper/611:17:086
2391552200,5pltrace78-21ksoftirqd/709:42:327
1710652200,6pltrace78-21ksoftirqd/712:27:297
2914452190,12pltrace31146-21sensors08:10:191
27382991910,8cyclictest0-21swapper/412:01:364
2738299190,3cyclictest789252pltrace08:30:274
2914452180,11pltrace31155-21smart_sda08:10:195
2738299180,5cyclictest0-21swapper/409:28:294
2738299180,2cyclictest54-21ksoftirqd/409:00:104
247842180,1sleep70-21swapper/709:00:007
2156752180,0pltrace0-21swapper/712:32:157
1942052180,0pltrace0-21swapper/710:45:127
1346452180,5pltrace0-21swapper/708:42:037
507752170,12pltrace5154-21ssh09:54:556
291912170,0sleep10-21swapper/112:03:431
27391991711,5cyclictest0-21swapper/611:38:266
2738299173,3cyclictest0-21swapper/411:47:534
27382991714,2cyclictest28791-21taskset10:53:344
27382991714,2cyclictest28606-21taskset10:18:304
27382991714,2cyclictest14994-21taskset07:42:224
27382991714,2cyclictest14994-21taskset07:42:224
27382991714,2cyclictest10978-21/usr/sbin/munin10:35:184
27382991714,2cyclictest10978-21/usr/sbin/munin10:35:184
27382991711,2cyclictest54-21ksoftirqd/411:03:254
27382991711,2cyclictest54-21ksoftirqd/408:22:574
2737999170,16cyclictest6410-21grep07:25:213
2737199170,16cyclictest30353-21cat09:45:171
1238852170,0pltrace0-21swapper/707:42:077
1238852170,0pltrace0-21swapper/707:42:077
1016952170,12pltrace14079-21ssh09:29:086
2739199160,16cyclictest0-21swapper/608:20:206
2738299166,7cyclictest54-21ksoftirqd/411:19:054
2738299166,6cyclictest54-21ksoftirqd/412:28:404
2738299165,7cyclictest54-21ksoftirqd/411:50:204
27382991614,1cyclictest1178-21runrttasks10:11:454
27382991613,2cyclictest30176-21/usr/sbin/munin12:05:184
27382991613,2cyclictest19643-21cpuspeed_turbos08:50:124
27382991611,3cyclictest0-21swapper/408:09:444
27382991611,2cyclictest54-21ksoftirqd/412:32:504
27382991610,2cyclictest8495-21sed10:30:214
27382991610,2cyclictest7832-21perl11:05:134
27382991610,2cyclictest54-21ksoftirqd/407:55:134
2738299161,8cyclictest0-21swapper/407:30:554
2738299161,4cyclictest0-21swapper/407:53:024
2738299160,15cyclictest0-21swapper/408:10:184
2738299160,12cyclictest0-21swapper/410:57:144
27375991611,3cyclictest0-21swapper/212:39:072
27375991611,3cyclictest0-21swapper/211:04:072
2737599161,14cyclictest0-21swapper/209:24:142
2736699161,14cyclictest0-21swapper/010:21:270
2736699161,14cyclictest0-21swapper/007:23:340
2736699160,2cyclictest15826-21ssh09:30:140
2736699160,15cyclictest0-21swapper/012:25:250
1262852160,9pltrace1474-21lldpd12:23:376
1085652160,11pltrace14471-21ssh11:12:465
507752150,2pltrace6623-21cat09:55:133
2945352150,8pltrace1683-21ssh10:58:576
27394991512,2cyclictest0-21swapper/708:48:527
2739499150,14cyclictest0-21swapper/711:22:197
27391991512,2cyclictest14566-21ssh10:38:556
27391991512,2cyclictest14566-21ssh10:38:556
2739199150,7cyclictest0-21swapper/607:58:326
2739199150,14cyclictest0-21swapper/609:20:586
2739199150,14cyclictest0-21swapper/608:58:226
2739199150,14cyclictest0-21swapper/607:23:076
2739199150,13cyclictest0-21swapper/609:02:376
2739199150,13cyclictest0-21swapper/608:44:496
2739199150,13cyclictest0-21swapper/608:26:066
2738299159,5cyclictest1178-21runrttasks09:56:064
2738299159,2cyclictest3283-21ls07:20:214
2738299159,2cyclictest22538-21cpuspeed_turbos08:55:114
2738299157,4cyclictest3619-21sendmail_mailtr10:25:174
2738299155,7cyclictest54-21ksoftirqd/412:18:334
2738299155,6cyclictest54-21ksoftirqd/411:25:204
2738299154,7cyclictest54-21ksoftirqd/410:00:114
2738299153,11cyclictest54-21ksoftirqd/409:49:294
27382991513,1cyclictest29402-21taskset12:37:014
27382991512,2cyclictest17633-21vmstat07:45:224
27382991512,2cyclictest1146-21snmpd09:44:324
2738299150,7cyclictest0-21swapper/411:14:254
2738299150,14cyclictest0-21swapper/409:36:564
2738299150,14cyclictest0-21swapper/408:46:524
2738299150,14cyclictest0-21swapper/408:39:274
2738299150,14cyclictest0-21swapper/408:04:354
2738299150,14cyclictest0-21swapper/407:26:494
2737999150,14cyclictest0-21swapper/312:01:333
2737599159,5cyclictest0-21swapper/209:26:112
27375991511,3cyclictest1066-13audispd08:20:012
27375991510,3cyclictest0-21swapper/208:23:542
2737599151,7cyclictest0-21swapper/209:16:262
2737599150,3cyclictest0-21swapper/210:59:492
2737599150,14cyclictest0-21swapper/208:10:162
2737599150,14cyclictest0-21swapper/207:15:102
27371991512,2cyclictest1047-21NetworkManager12:00:001
2737199150,4cyclictest0-21swapper/111:51:051
2737199150,2cyclictest0-21swapper/109:58:331
2737199150,1cyclictest0-21swapper/109:11:261
27366991513,1cyclictest0-21swapper/011:09:330
27366991510,4cyclictest0-21swapper/010:56:550
2736699151,7cyclictest0-21swapper/010:41:130
2736699151,7cyclictest0-21swapper/010:41:130
2736699151,7cyclictest0-21swapper/007:51:530
2736699150,14cyclictest0-21swapper/012:35:470
2736699150,14cyclictest0-21swapper/011:30:520
2736699150,14cyclictest0-21swapper/011:12:340
2736699150,14cyclictest0-21swapper/010:03:210
2736699150,14cyclictest0-21swapper/009:04:040
2736699150,14cyclictest0-21swapper/008:10:120
960352140,12pltrace54-21ksoftirqd/407:37:444
719752140,10pltrace9568-21kworker/u16:0+xprtiod@
xs_stream_data_receive_workfn
07:47:276
507752140,8pltrace0-21swapper/209:55:002
507752140,3pltrace6096-21cat09:55:115
27394991412,1cyclictest0-21swapper/712:12:017
2739499140,14cyclictest0-21swapper/710:54:287
2739499140,14cyclictest0-21swapper/709:45:597
2739499140,14cyclictest0-21swapper/708:25:217
2739499140,14cyclictest0-21swapper/707:35:207
2739499140,14cyclictest0-21swapper/707:10:147
2739499140,1cyclictest0-21swapper/709:53:457
27391991412,1cyclictest0-21swapper/607:50:126
2739199140,7cyclictest0-21swapper/612:11:426
2739199140,3cyclictest0-21swapper/611:32:356
27386991413,1cyclictest0-21swapper/510:59:575
27386991413,1cyclictest0-21swapper/509:50:205
27386991413,1cyclictest0-21swapper/509:35:165
27386991411,2cyclictest0-21swapper/511:56:155
27386991411,2cyclictest0-21swapper/510:36:405
27386991411,2cyclictest0-21swapper/510:36:405
2738699140,1cyclictest0-21swapper/512:14:545
2738699140,1cyclictest0-21swapper/511:27:385
2738299149,4cyclictest1055-17auditd12:00:004
2738299149,2cyclictest54-21ksoftirqd/410:40:124
2738299149,2cyclictest54-21ksoftirqd/410:40:124
2738299149,2cyclictest54-21ksoftirqd/409:18:144
2738299148,5cyclictest4815-21timerwakeupswit12:10:204
2738299148,2cyclictest54-21ksoftirqd/410:20:214
27382991411,2cyclictest6354-21perl08:25:134
27382991411,2cyclictest32499-21cat07:15:164
27382991411,2cyclictest30690-21perl11:30:124
27382991411,2cyclictest21873-21wc11:20:194
27382991411,2cyclictest14511-21grep08:40:134
27382991411,2cyclictest1178-21runrttasks08:18:124
2738299140,7cyclictest0-21swapper/409:52:474
2737999149,4cyclictest26166-21crond12:35:003
27379991413,1cyclictest0-21swapper/312:35:243
27379991413,1cyclictest0-21swapper/312:05:363
27379991413,1cyclictest0-21swapper/309:48:183
2737999140,2cyclictest0-21swapper/309:19:053
2737999140,13cyclictest0-21swapper/311:20:063
2737999140,1cyclictest0-21swapper/310:48:133
2737999140,1cyclictest0-21swapper/310:26:123
2737999140,1cyclictest0-21swapper/310:21:203
2737999140,1cyclictest0-21swapper/309:36:293
27375991411,2cyclictest0-21swapper/212:00:122
2737599140,3cyclictest0-21swapper/210:23:482
2737599140,1cyclictest0-21swapper/211:05:182
2737599140,1cyclictest0-21swapper/210:48:382
2737199140,14cyclictest0-21swapper/112:13:351
2737199140,1cyclictest0-21swapper/111:11:441
2737199140,1cyclictest0-21swapper/110:48:161
2737199140,1cyclictest0-21swapper/110:30:081
27366991413,1cyclictest0-21swapper/012:06:580
2736699140,8cyclictest0-21swapper/011:01:330
2736699140,13cyclictest0-21swapper/009:56:380
2736699140,13cyclictest0-21swapper/009:48:320
2736699140,1cyclictest0-21swapper/010:17:120
2736699140,1cyclictest0-21swapper/009:41:440
2432252140,1pltrace24326-21pltrace-run10:49:454
2391552140,2pltrace27317-21ssh09:42:036
209952140,2pltrace0-21swapper/710:59:497
1942052140,8pltrace22881-21ssh10:47:036
190952140,3pltrace4467-21sed09:15:220
182712140,0sleep30-21swapper/310:08:313
1624152140,9pltrace20541-21ssh11:54:235
1176452140,0pltrace0-21swapper/011:44:450
960352130,6pltrace0-21swapper/007:39:040
789252130,6pltrace0-21swapper/008:32:480
719752130,1pltrace10394-21ssh11:41:343
3001352130,0pltrace0-21swapper/707:16:157
27394991311,1cyclictest0-21swapper/709:22:217
27394991310,2cyclictest1478-21lldpd10:25:007
2739499130,13cyclictest0-21swapper/711:38:407
2739499130,1cyclictest0-21swapper/712:18:017
2739499130,1cyclictest0-21swapper/709:28:017
2739199138,3cyclictest0-21swapper/607:46:236
27391991312,1cyclictest0-21swapper/610:07:016
27391991311,1cyclictest0-21swapper/609:33:296
27391991310,2cyclictest1146-21snmpd10:43:526
27391991310,2cyclictest1146-21snmpd10:43:526
2739199130,13cyclictest0-21swapper/610:24:206
2739199130,13cyclictest0-21swapper/609:39:296
2739199130,12cyclictest0-21swapper/611:54:366
2739199130,12cyclictest0-21swapper/610:28:306
2739199130,1cyclictest0-21swapper/612:06:306
27386991312,1cyclictest0-21swapper/512:15:245
27386991312,1cyclictest0-21swapper/508:20:185
2738699130,13cyclictest0-21swapper/512:38:135
2738699130,13cyclictest0-21swapper/512:02:175
2738699130,13cyclictest0-21swapper/511:37:305
2738699130,13cyclictest0-21swapper/511:21:385
2738699130,13cyclictest0-21swapper/510:12:505
2738699130,13cyclictest0-21swapper/509:43:325
2738299138,2cyclictest14956-21expr10:05:104
2738299136,4cyclictest10309-21cat09:25:004
2738299135,5cyclictest54-21ksoftirqd/409:32:534
2738299134,5cyclictest54-21ksoftirqd/412:20:214
27382991311,1cyclictest32392-21sed09:10:194
27382991310,2cyclictest9848-21sed11:40:214
27382991310,2cyclictest28598-21tail07:10:144
27379991312,1cyclictest0-21swapper/312:24:043
27379991312,1cyclictest0-21swapper/311:11:123
27379991312,1cyclictest0-21swapper/310:53:243
27379991312,1cyclictest0-21swapper/310:04:013
2737999130,13cyclictest0-21swapper/311:02:183
2737999130,13cyclictest0-21swapper/309:52:213
2737999130,13cyclictest0-21swapper/309:21:063
2737999130,1cyclictest0-21swapper/311:37:263
2737599138,3cyclictest0-21swapper/208:29:272
2737599137,5cyclictest0-21swapper/212:28:192
27375991312,1cyclictest0-21swapper/209:33:012
27375991311,1cyclictest0-21swapper/212:17:212
27375991310,2cyclictest14217-21timerwakeupswit11:45:192
2737599130,13cyclictest0-21swapper/210:17:032
2737599130,1cyclictest0-21swapper/212:07:482
2737599130,1cyclictest0-21swapper/211:41:152
2737599130,1cyclictest0-21swapper/211:32:212
2737599130,1cyclictest0-21swapper/211:25:522
2737599130,1cyclictest0-21swapper/209:56:202
27371991312,1cyclictest0-21swapper/110:52:571
27371991312,1cyclictest0-21swapper/110:41:371
27371991312,1cyclictest0-21swapper/110:41:371
27371991312,1cyclictest0-21swapper/110:28:111
27371991312,1cyclictest0-21swapper/110:02:361
27371991312,1cyclictest0-21swapper/109:35:141
2737199130,13cyclictest0-21swapper/112:33:201
2737199130,13cyclictest0-21swapper/111:30:021
2737199130,13cyclictest0-21swapper/109:18:531
2737199130,1cyclictest0-21swapper/111:21:371
2737199130,1cyclictest0-21swapper/109:28:461
2736699133,8cyclictest0-21swapper/010:36:130
2736699133,8cyclictest0-21swapper/010:36:130
27366991312,1cyclictest0-21swapper/009:52:350
2736699130,13cyclictest0-21swapper/011:22:560
2736699130,13cyclictest0-21swapper/010:49:250
2736699130,13cyclictest0-21swapper/010:29:200
2736699130,13cyclictest0-21swapper/010:08:170
2736699130,1cyclictest0-21swapper/012:17:290
2417652130,1pltrace0-21swapper/611:27:416
2391552130,1pltrace0-21swapper/209:42:062
1942052130,2pltrace22850-21ssh10:47:005
190952130,8pltrace4552-21ssh09:15:295
1085652130,5pltrace0-21swapper/611:12:456
719752120,5pltrace0-21swapper/511:41:365
596552120,5pltrace0-21swapper/610:33:196
596552120,5pltrace0-21swapper/310:33:203
596552120,1pltrace9735-21ssh10:33:045
507752120,4pltrace0-21swapper/109:54:561
403152120,5pltrace0-21swapper/607:29:336
2743652120,3pltrace0-21swapper/709:08:017
2739499126,2cyclictest3056052pltrace12:39:467
27394991210,1cyclictest0-21swapper/708:39:267
2739199126,5cyclictest0-21swapper/608:34:156
2739199122,8cyclictest0-21swapper/608:54:316
27391991211,1cyclictest0-21swapper/610:12:316
27391991211,1cyclictest0-21swapper/609:47:166
2739199120,12cyclictest0-21swapper/612:28:316
2739199120,12cyclictest0-21swapper/611:46:556
2739199120,12cyclictest0-21swapper/611:22:376
2739199120,12cyclictest0-21swapper/611:05:376
2739199120,11cyclictest0-21swapper/608:10:206
2738699127,4cyclictest21833-21pltrace-run08:54:455
27386991211,1cyclictest0-21swapper/512:21:235
27386991211,1cyclictest0-21swapper/510:54:465
27386991211,1cyclictest0-21swapper/510:40:315
27386991211,1cyclictest0-21swapper/510:40:315
27386991211,1cyclictest0-21swapper/509:22:095
27386991210,1cyclictest0-21swapper/509:45:485
2738699120,1cyclictest0-21swapper/507:45:305
27382991210,1cyclictest28281-21expr09:05:114
2737999129,2cyclictest7904-21perl11:05:133
2737999129,2cyclictest1178-21runrttasks12:25:153
27379991211,1cyclictest0-21swapper/312:10:083
27379991211,1cyclictest0-21swapper/311:58:003
27379991211,1cyclictest0-21swapper/309:41:303
27379991210,1cyclictest0-21swapper/309:30:013
27379991210,1cyclictest0-21swapper/309:05:053
27379991210,1cyclictest0-21swapper/308:41:553
2737999120,12cyclictest0-21swapper/307:41:223
2737999120,12cyclictest0-21swapper/307:41:223
2737599129,2cyclictest31374-21tune2fs09:10:122
2737599126,5cyclictest0-21swapper/208:48:012
27375991211,1cyclictest0-21swapper/209:39:302
27375991211,1cyclictest0-21swapper/207:52:482
2737599120,9cyclictest191rcu_preempt07:46:112
2737599120,11cyclictest0-21swapper/212:11:122
2737599120,11cyclictest0-21swapper/207:42:322
2737599120,11cyclictest0-21swapper/207:42:322
27371991211,1cyclictest0-21swapper/108:47:381
2737199120,4cyclictest8943-21sshd09:21:151
2736699128,3cyclictest1146-21snmpd08:58:580
2736699127,3cyclictest0-21swapper/010:12:090
27366991211,1cyclictest0-21swapper/010:54:060
27366991211,1cyclictest0-21swapper/009:11:280
27366991210,1cyclictest0-21swapper/008:02:360
27366991210,1cyclictest0-21swapper/007:33:400
2736699120,11cyclictest0-21swapper/011:35:170
2736699120,11cyclictest0-21swapper/008:53:580
2736699120,11cyclictest0-21swapper/008:09:460
2736699120,11cyclictest0-21swapper/007:40:280
2736699120,11cyclictest0-21swapper/007:40:280
2736699120,1cyclictest0-21swapper/008:23:320
2461452120,5pltrace0-21swapper/309:00:563
2413652120,5pltrace28198-21ssh10:17:466
190952120,2pltrace4033-21which09:15:206
1624152120,6pltrace0-21swapper/011:54:210
1517852120,5pltrace0-21swapper/007:47:130
1262852120,5pltrace0-21swapper/012:23:160
1016952120,3pltrace191rcu_preempt09:29:135
2739499115,5cyclictest1146-21snmpd10:41:077
2739499115,5cyclictest1146-21snmpd10:41:077
2739499115,5cyclictest0-21swapper/712:20:247
2739499115,5cyclictest0-21swapper/711:51:427
2739499114,6cyclictest0-21swapper/709:10:117
2739499112,8cyclictest0-21swapper/711:00:037
27394991110,1cyclictest0-21swapper/710:39:447
27394991110,1cyclictest0-21swapper/710:39:447
27394991110,1cyclictest0-21swapper/709:35:287
27394991110,1cyclictest0-21swapper/709:15:437
2739499110,11cyclictest0-21swapper/708:33:467
2739499110,11cyclictest0-21swapper/707:47:387
2739199119,1cyclictest0-21swapper/610:03:276
2739199116,3cyclictest0-21swapper/608:06:296
2739199116,3cyclictest0-21swapper/607:11:346
2739199114,6cyclictest1055-13auditd09:10:006
27391991110,1cyclictest0-21swapper/608:37:006
2739199110,11cyclictest0-21swapper/611:59:526
2739199110,11cyclictest0-21swapper/608:19:216
2739199110,11cyclictest0-21swapper/607:44:136
2739199110,11cyclictest0-21swapper/607:44:136
2739199110,1cyclictest0-21swapper/607:32:146
2738699110,11cyclictest0-21swapper/510:02:485
2738699110,11cyclictest0-21swapper/508:41:505
2738699110,11cyclictest0-21swapper/507:36:455
2738699110,10cyclictest0-21swapper/508:15:275
2738699110,1cyclictest0-21swapper/508:31:485
2738699110,1cyclictest0-21swapper/507:23:005
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional