You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 00:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Thu Apr 23, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
17709521080,104pltrace0-21swapper/207:05:122
2049452900,77pltrace0-21swapper/607:10:026
1770952710,63pltrace0-21swapper/507:05:215
2037526652,10sleep30-21swapper/307:05:573
2035226450,10sleep70-21swapper/707:05:377
2063826349,10sleep10-21swapper/107:09:241
2056325945,10sleep00-21swapper/007:08:180
2037625844,10sleep40-21swapper/407:05:584
1516852350,0pltrace0-21swapper/708:55:157
679952310,2pltrace0-21swapper/708:41:247
20895993126,4cyclictest0-21swapper/708:10:477
20892992114,6cyclictest0-21swapper/610:23:466
231652190,4pltrace0-21swapper/709:30:207
20881991915,2cyclictest0-21swapper/311:55:573
1004452190,0pltrace0-21swapper/711:38:307
851152180,13pltrace0-21swapper/507:44:585
2089599184,3cyclictest0-21swapper/707:57:507
2089599180,17cyclictest0-21swapper/711:25:197
2089599180,12cyclictest0-21swapper/708:25:547
20892991813,3cyclictest0-21swapper/609:23:336
2088799181,12cyclictest0-21swapper/509:58:145
20872991814,3cyclictest0-21swapper/109:01:491
896852170,12pltrace0-21swapper/310:38:073
339252170,10pltrace0-21swapper/210:29:572
3129452170,4pltrace0-21swapper/711:18:287
293952170,3pltrace0-21swapper/707:32:417
2089599173,3cyclictest0-21swapper/711:47:367
20892991712,3cyclictest0-21swapper/607:50:386
20887991714,2cyclictest0-21swapper/507:56:025
2088799170,15cyclictest84902sleep512:34:315
2087299171,4cyclictest0-21swapper/108:21:361
1687852170,11pltrace54-21ksoftirqd/408:00:004
1516852170,0pltrace0-21swapper/708:53:377
618252160,4pltrace0-21swapper/710:35:187
54652160,2pltrace1466-21cpuspeed_turbos10:25:120
3255252160,2pltrace0-21swapper/707:28:317
2355452160,11pltrace54-21ksoftirqd/409:10:014
2355452160,11pltrace54-21ksoftirqd/409:10:014
2355452160,10pltrace23745-21crond09:10:001
2355452160,10pltrace23745-21crond09:10:001
2335352160,6pltrace0-21swapper/707:12:317
20895991611,4cyclictest0-21swapper/710:48:437
20895991611,3cyclictest0-21swapper/712:01:217
2089599161,8cyclictest0-21swapper/708:18:027
2089599161,14cyclictest0-21swapper/709:28:137
2089599160,8cyclictest0-21swapper/710:53:467
2089299167,5cyclictest11558-21grep11:40:136
20892991610,4cyclictest0-21swapper/610:10:186
2089299160,15cyclictest0-21swapper/611:18:356
2089299160,15cyclictest0-21swapper/610:02:176
20887991614,1cyclictest0-21swapper/512:39:585
20887991611,4cyclictest0-21swapper/511:44:455
20887991611,4cyclictest0-21swapper/510:26:575
2088799161,8cyclictest0-21swapper/511:56:035
2088799161,14cyclictest0-21swapper/509:43:535
20881991611,2cyclictest0-21swapper/310:42:043
2088199161,7cyclictest0-21swapper/308:34:063
2088199160,8cyclictest0-21swapper/311:20:363
2088199160,15cyclictest0-21swapper/308:19:243
2087699160,15cyclictest0-21swapper/207:46:282
20872991612,3cyclictest1146-21snmpd08:42:241
20872991611,3cyclictest0-21swapper/109:19:441
2087299161,13cyclictest0-21swapper/110:28:061
2087299160,15cyclictest0-21swapper/112:04:061
54652150,2pltrace805-21date10:25:003
2914652150,8pltrace54-21ksoftirqd/409:20:014
2089599150,8cyclictest0-21swapper/707:52:447
2089599150,7cyclictest0-21swapper/710:02:477
2089599150,7cyclictest0-21swapper/709:35:147
2089599150,1cyclictest191rcu_preempt10:42:197
2089299159,5cyclictest0-21swapper/610:58:016
2089299159,5cyclictest0-21swapper/608:00:116
2089299153,11cyclictest0-21swapper/610:46:556
20892991513,1cyclictest0-21swapper/612:35:136
20892991512,3cyclictest0-21swapper/611:32:476
20892991510,3cyclictest0-21swapper/607:21:076
2089299151,7cyclictest0-21swapper/611:04:356
2089299151,3cyclictest0-21swapper/609:13:016
2089299151,3cyclictest0-21swapper/609:13:016
2089299150,14cyclictest0-21swapper/611:53:486
2089299150,14cyclictest0-21swapper/611:48:006
2089299150,14cyclictest0-21swapper/610:33:466
2089299150,14cyclictest0-21swapper/608:35:136
2089299150,14cyclictest0-21swapper/607:39:046
2088799150,14cyclictest0-21swapper/512:19:435
2088799150,14cyclictest0-21swapper/508:49:545
20884991512,2cyclictest0-21swapper/409:00:214
20881991510,3cyclictest0-21swapper/308:41:283
2088199150,8cyclictest0-21swapper/311:12:233
2088199150,14cyclictest0-21swapper/312:07:243
2088199150,14cyclictest0-21swapper/310:48:253
2088199150,14cyclictest0-21swapper/309:50:113
2088199150,14cyclictest0-21swapper/308:46:273
2088199150,14cyclictest0-21swapper/307:37:043
2088199150,13cyclictest0-21swapper/310:52:403
2088199150,13cyclictest0-21swapper/307:17:583
2087699159,4cyclictest0-21swapper/207:35:462
20876991511,3cyclictest17548-21needreboot11:50:162
2087699150,7cyclictest0-21swapper/207:12:552
2087699150,14cyclictest0-21swapper/209:55:152
2087699150,14cyclictest0-21swapper/207:52:472
2087699150,13cyclictest0-21swapper/207:25:132
20872991513,1cyclictest0-21swapper/108:30:161
20872991512,2cyclictest0-21swapper/111:02:441
20872991510,4cyclictest0-21swapper/108:57:431
2087299150,4cyclictest0-21swapper/112:21:381
1968352150,1pltrace0-21swapper/708:05:177
1733552150,8pltrace54-21ksoftirqd/410:55:194
3084452140,11pltrace32410-21idleruntime08:25:145
2976852140,5pltrace0-21swapper/207:25:002
2958852140,12pltrace0-21swapper/212:13:052
2958852140,12pltrace0-21swapper/212:13:052
2914652140,8pltrace54-21ksoftirqd/409:20:124
2680052140,3pltrace28232-21fschecks_time12:10:120
2680052140,3pltrace28232-21fschecks_time12:10:120
2464452140,1pltrace0-21swapper/310:10:013
2335352140,9pltrace54-21ksoftirqd/407:15:144
2185952140,10pltrace0-21swapper/510:03:275
2089599149,3cyclictest0-21swapper/712:39:407
2089599140,7cyclictest0-21swapper/712:05:277
2089599140,7cyclictest0-21swapper/707:39:287
2089599140,13cyclictest0-21swapper/710:55:147
2089299140,7cyclictest0-21swapper/607:59:206
2089299140,3cyclictest0-21swapper/611:21:056
2089299140,14cyclictest0-21swapper/612:10:156
2089299140,14cyclictest0-21swapper/612:10:156
2089299140,13cyclictest0-21swapper/609:55:136
20887991411,2cyclictest0-21swapper/510:40:165
2088799140,3cyclictest0-21swapper/511:33:065
2088799140,13cyclictest0-21swapper/511:27:065
2088799140,13cyclictest0-21swapper/510:55:115
2088799140,13cyclictest0-21swapper/508:35:115
2088799140,13cyclictest0-21swapper/507:45:315
2088799140,13cyclictest0-21swapper/507:25:215
20884991412,1cyclictest0-21swapper/409:45:024
20884991411,2cyclictest0-21swapper/412:22:494
20884991411,2cyclictest0-21swapper/407:42:374
2088199149,3cyclictest0-21swapper/308:38:093
20881991413,1cyclictest0-21swapper/309:30:123
20881991412,1cyclictest0-21swapper/309:25:113
2088199140,8cyclictest0-21swapper/311:25:113
2088199140,7cyclictest0-21swapper/307:10:523
2088199140,13cyclictest0-21swapper/308:50:543
2088199140,13cyclictest0-21swapper/307:21:313
2087699140,3cyclictest0-21swapper/211:50:002
2087699140,13cyclictest0-21swapper/210:55:132
2087699140,13cyclictest0-21swapper/208:35:162
2087299140,3cyclictest0-21swapper/110:24:341
2087299140,13cyclictest0-21swapper/110:55:191
2087299140,13cyclictest0-21swapper/107:25:131
2086799140,13cyclictest0-21swapper/012:17:240
2049452140,6pltrace0-21swapper/107:12:111
1841052140,2pltrace0-21swapper/711:55:187
1687852140,9pltrace54-21ksoftirqd/408:00:164
1175752140,8pltrace11777-21taskset10:42:342
833652130,8pltrace54-21ksoftirqd/412:35:014
833652130,6pltrace0-21swapper/112:36:581
572252130,1pltrace0-21swapper/107:42:041
3237352130,3pltrace564-21aten_r4power_vo12:20:105
2680052130,4pltrace0-21swapper/112:10:171
2680052130,4pltrace0-21swapper/112:10:171
2572252130,8pltrace54-21ksoftirqd/411:10:134
2572252130,4pltrace0-21swapper/111:11:431
2464452130,6pltrace24839-21sh10:10:012
2355452130,4pltrace0-21swapper/109:10:091
2355452130,4pltrace0-21swapper/109:10:081
2089599137,5cyclictest0-21swapper/710:08:067
20895991312,1cyclictest0-21swapper/709:47:247
20895991310,2cyclictest25735-21sensors_volt09:10:177
20895991310,2cyclictest25735-21sensors_volt09:10:177
2089599131,11cyclictest0-21swapper/711:05:477
2089599130,12cyclictest0-21swapper/709:09:287
2089599130,12cyclictest0-21swapper/709:09:287
2089599130,12cyclictest0-21swapper/707:18:007
2089299136,4cyclictest70-21ksoftirqd/612:03:346
20892991312,1cyclictest0-21swapper/608:40:256
2089299130,13cyclictest0-21swapper/608:15:196
2089299130,12cyclictest0-21swapper/607:46:016
2089299130,1cyclictest0-21swapper/608:30:226
2088799137,5cyclictest0-21swapper/512:12:225
2088799137,5cyclictest0-21swapper/512:12:225
2088799134,6cyclictest0-21swapper/509:10:005
2088799134,6cyclictest0-21swapper/509:10:005
2088799130,12cyclictest0-21swapper/511:35:365
2088799130,12cyclictest0-21swapper/508:55:325
2088799130,12cyclictest0-21swapper/508:51:365
20884991310,2cyclictest0-21swapper/409:30:224
2088499130,12cyclictest0-21swapper/410:08:304
2088499130,12cyclictest0-21swapper/409:36:084
2088199139,3cyclictest1146-21snmpd09:24:583
2088199130,12cyclictest0-21swapper/309:04:563
2088199130,12cyclictest0-21swapper/308:03:353
2087699138,3cyclictest0-21swapper/210:54:252
2087699130,12cyclictest0-21swapper/208:50:122
2087699130,12cyclictest0-21swapper/208:07:442
2087299131,11cyclictest0-21swapper/109:30:521
2087299130,12cyclictest0-21swapper/111:50:211
2087299130,1cyclictest0-21swapper/108:02:251
20867991312,1cyclictest0-21swapper/009:00:120
2086799130,13cyclictest0-21swapper/011:06:000
2011852130,5pltrace0-21swapper/310:57:453
1795352130,4pltrace0-21swapper/208:59:142
1409352130,5pltrace14100-21sshd07:52:241
896852120,1pltrace9167-21munin-plugin-st10:40:000
572252120,10pltrace0-21swapper/507:38:035
554952120,10pltrace0-21swapper/112:31:491
54652120,2pltrace739-21crond10:25:003
510452120,3pltrace6019-21/usr/sbin/munin09:35:115
446852120,2pltrace4472-21pltrace-run11:27:236
2976852120,6pltrace31437-21irqstats_LOC07:25:150
2976852120,2pltrace31203-21perl07:25:133
2914652120,5pltrace0-21swapper/009:21:070
2805552120,5pltrace0-21swapper/108:19:071
2743652120,0pltrace0-21swapper/710:14:537
2680052120,3pltrace27597-21cpuspeed_turbos12:10:103
2680052120,3pltrace27597-21cpuspeed_turbos12:10:103
2572252120,3pltrace54-21ksoftirqd/411:09:224
2464452120,4pltrace0-21swapper/310:10:093
2089599129,2cyclictest19530-21basename09:00:147
2089599126,5cyclictest0-21swapper/712:30:497
2089599126,5cyclictest0-21swapper/711:40:037
2089599125,4cyclictest78-21ksoftirqd/712:20:187
2089599125,2cyclictest191rcu_preempt11:03:507
2089599123,8cyclictest0-21swapper/710:16:037
20895991210,1cyclictest0-21swapper/712:17:007
20895991210,1cyclictest0-21swapper/708:35:127
2089599120,12cyclictest0-21swapper/710:30:007
2089599120,11cyclictest0-21swapper/711:22:057
2089599120,11cyclictest0-21swapper/707:21:247
2089599120,1cyclictest0-21swapper/710:28:327
2089299129,2cyclictest375-21cut09:25:116
2089299129,2cyclictest25273-21pltrace-run08:12:236
2089299129,2cyclictest22931-21sensors09:05:196
2089299129,2cyclictest22931-21sensors09:05:196
2089299129,2cyclictest20311-21sed09:00:206
2089299126,5cyclictest0-21swapper/610:52:586
2089299125,4cyclictest70-21ksoftirqd/608:05:116
20892991211,1cyclictest0-21swapper/609:31:256
20892991210,1cyclictest0-21swapper/611:05:216
20892991210,1cyclictest0-21swapper/609:45:006
20892991210,1cyclictest0-21swapper/608:47:236
20892991210,1cyclictest0-21swapper/607:25:116
2089299120,11cyclictest0-21swapper/608:51:146
2088799129,2cyclictest29909-21cpuspeed_turbos09:20:125
2088799129,2cyclictest25401-21expr07:15:145
2088799129,2cyclictest21571-21ls07:10:115
2088799126,5cyclictest0-21swapper/511:10:415
2088799126,5cyclictest0-21swapper/510:21:485
2088799125,4cyclictest0-21swapper/509:10:105
2088799125,4cyclictest0-21swapper/509:10:105
20887991210,1cyclictest0-21swapper/512:25:135
20887991210,1cyclictest0-21swapper/512:05:135
20887991210,1cyclictest0-21swapper/509:19:335
2088799120,8cyclictest191rcu_preempt08:01:385
2088799120,11cyclictest0-21swapper/508:22:155
2088799120,11cyclictest0-21swapper/507:21:245
20884991210,1cyclictest0-21swapper/409:50:034
2088499120,11cyclictest0-21swapper/412:17:424
2088499120,11cyclictest0-21swapper/410:47:514
2088499120,11cyclictest0-21swapper/410:18:424
2088499120,11cyclictest0-21swapper/408:44:194
2088499120,11cyclictest0-21swapper/408:18:354
2088499120,1cyclictest0-21swapper/408:48:324
2088199126,5cyclictest0-21swapper/312:32:523
2088199126,5cyclictest0-21swapper/311:07:173
20881991211,1cyclictest0-21swapper/309:58:323
20881991211,1cyclictest0-21swapper/308:24:573
2088199120,11cyclictest0-21swapper/309:12:333
2088199120,11cyclictest0-21swapper/309:12:333
2088199120,1cyclictest0-21swapper/307:44:093
2087699128,2cyclictest0-21swapper/207:33:282
20876991211,1cyclictest0-21swapper/210:48:252
20876991210,1cyclictest0-21swapper/212:16:292
20876991210,1cyclictest0-21swapper/208:35:002
2087699120,11cyclictest0-21swapper/209:18:332
2087699120,1cyclictest0-21swapper/209:13:032
2087699120,1cyclictest0-21swapper/209:13:032
2087299129,2cyclictest1065-17sedispatch10:15:011
2087299128,3cyclictest1146-21snmpd12:25:191
2087299127,4cyclictest0-21swapper/108:28:391
2087299126,3cyclictest0-21swapper/108:48:211
2087299120,11cyclictest0-21swapper/109:41:201
20867991211,1cyclictest0-21swapper/010:18:140
20867991211,1cyclictest0-21swapper/007:45:240
20867991210,1cyclictest0-21swapper/010:55:090
2086799120,4cyclictest5029-21switchtime12:25:210
2086799120,11cyclictest0-21swapper/010:21:280
2011852120,4pltrace20687-21chrt11:00:073
1841052120,3pltrace54-21ksoftirqd/411:55:144
1625952120,8pltrace18940-21runrttasks09:56:111
1625952120,5pltrace0-21swapper/009:56:120
1283852120,5pltrace0-21swapper/311:43:443
1283852120,5pltrace0-21swapper/111:43:431
1237852120,0pltrace0-21swapper/208:47:482
121352120,6pltrace0-21swapper/008:27:260
1068152120,2pltrace1146-21snmpd09:43:077
789152110,4pltrace0-21swapper/209:41:242
446852110,5pltrace4906-21cut11:30:000
2355452110,6pltrace0-21swapper/009:10:070
2355452110,6pltrace0-21swapper/009:10:070
2248152110,0pltrace0-21swapper/208:10:352
2089599118,2cyclictest7889-21sensors07:40:207
2089599118,2cyclictest5874-21grep11:30:127
2089599118,2cyclictest4753-21ntpq12:25:187
2089599118,2cyclictest29718-21/usr/sbin/munin09:20:117
2089599118,2cyclictest17489-21sort11:50:157
2089599115,2cyclictest78-21ksoftirqd/711:10:117
2089599115,2cyclictest78-21ksoftirqd/709:15:227
2089599110,8cyclictest78-21ksoftirqd/708:00:177
2089599110,11cyclictest0-21swapper/709:56:297
2089599110,1cyclictest0-21swapper/708:49:077
2089299119,1cyclictest0-21swapper/612:15:226
2089299119,1cyclictest0-21swapper/611:11:546
2089299118,2cyclictest9425-21/usr/sbin/munin11:35:196
2089299118,2cyclictest28585-21switchtime09:15:216
2089299118,2cyclictest21360-21taskset11:59:316
2089299118,2cyclictest1341-21fschecks_count07:30:146
2089299118,2cyclictest1055-17auditd07:12:246
20892991110,1cyclictest0-21swapper/612:22:526
20892991110,1cyclictest0-21swapper/608:23:156
2089299110,11cyclictest0-21swapper/612:27:536
2089299110,11cyclictest0-21swapper/608:26:496
2088799119,1cyclictest0-21swapper/509:28:375
2088799118,2cyclictest26387-21diskstats08:15:145
2088799118,2cyclictest1623-21expr07:30:145
2088799118,2cyclictest1297-21sed11:20:215
2088799118,2cyclictest12091-21expr07:50:115
2088799118,2cyclictest1146-21snmpd11:06:295
2088799118,2cyclictest1146-21snmpd10:08:125
2088799114,4cyclictest0-21swapper/511:00:205
20887991110,1cyclictest0-21swapper/511:50:385
20887991110,1cyclictest0-21swapper/510:33:145
20887991110,1cyclictest0-21swapper/509:54:135
2088799110,9cyclictest0-21swapper/512:00:575
2088799110,9cyclictest0-21swapper/511:16:505
2088799110,11cyclictest0-21swapper/508:13:315
2088799110,11cyclictest0-21swapper/508:08:205
2088799110,1cyclictest0-21swapper/509:32:025
2088799110,1cyclictest0-21swapper/508:41:025
2088499119,1cyclictest0-21swapper/408:38:494
2088499119,1cyclictest0-21swapper/408:28:324
20884991110,1cyclictest0-21swapper/412:36:204
20884991110,1cyclictest0-21swapper/411:16:304
20884991110,1cyclictest0-21swapper/410:42:504
20884991110,1cyclictest0-21swapper/408:14:124
20884991110,1cyclictest0-21swapper/408:09:014
2088499110,9cyclictest32530-21/usr/sbin/munin09:25:104
2088499110,11cyclictest0-21swapper/412:06:524
2088499110,11cyclictest0-21swapper/411:36:554
2088499110,11cyclictest0-21swapper/411:03:434
2088499110,11cyclictest0-21swapper/410:30:514
2088499110,11cyclictest0-21swapper/408:56:084
2088499110,11cyclictest0-21swapper/408:50:384
2088499110,11cyclictest0-21swapper/407:29:414
2088499110,1cyclictest0-21swapper/412:26:464
2088499110,1cyclictest0-21swapper/410:27:084
2088499110,1cyclictest0-21swapper/409:56:514
2088199117,2cyclictest1478-21lldpd08:10:023
2088199116,3cyclictest0-21swapper/308:56:433
20881991110,1cyclictest0-21swapper/310:00:193
20881991110,1cyclictest0-21swapper/309:38:563
20881991110,1cyclictest0-21swapper/307:32:493
2088199110,11cyclictest0-21swapper/312:29:363
2088199110,11cyclictest0-21swapper/312:22:193
2088199110,11cyclictest0-21swapper/311:35:053
2088199110,1cyclictest0-21swapper/310:16:203
2087699118,2cyclictest0-21swapper/211:57:082
2087699115,5cyclictest0-21swapper/211:07:352
20876991110,1cyclictest0-21swapper/211:18:322
2087699110,11cyclictest0-21swapper/212:35:362
2087699110,11cyclictest0-21swapper/212:30:342
2087699110,11cyclictest0-21swapper/212:25:332
2087699110,11cyclictest0-21swapper/212:01:362
2087699110,11cyclictest0-21swapper/210:18:472
2087699110,11cyclictest0-21swapper/209:20:402
2087699110,11cyclictest0-21swapper/209:09:402
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional