You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 06:15
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Mon May 04, 2026 00:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24097521130,107pltrace0-21swapper/619:08:236
24097521050,101pltrace0-21swapper/519:07:275
24097521020,99pltrace0-21swapper/319:08:103
24097521000,96pltrace0-21swapper/119:05:141
2409752880,77pltrace0-21swapper/219:08:532
2684026046,10sleep70-21swapper/719:08:507
2692725844,10sleep40-21swapper/419:09:424
2645825842,11sleep00-21swapper/019:05:220
2434052280,0pltrace0-21swapper/721:00:187
1876752280,1pltrace18771-21pltrace-run20:49:095
358852240,2pltrace0-21swapper/700:15:117
2715099220,22cyclictest0-21swapper/522:20:285
27136992217,3cyclictest0-21swapper/200:30:352
1211952210,4pltrace14720-21sshd19:41:467
358852200,13pltrace0-21swapper/500:15:205
27145992017,2cyclictest0-21swapper/419:15:114
73952190,4pltrace0-21swapper/700:10:137
2714199198,4cyclictest46-21ksoftirqd/321:05:223
1643152190,0pltrace0-21swapper/723:40:237
1040852190,13pltrace12405-21rt-features20:35:202
2715499180,17cyclictest0-21swapper/620:00:026
2714599180,17cyclictest0-21swapper/423:24:044
2713399180,2cyclictest0-21swapper/123:33:191
358852170,2pltrace5917-21timerwakeupswit00:15:211
27150991711,3cyclictest0-21swapper/523:19:575
2715099171,15cyclictest0-21swapper/520:06:525
2714599171,8cyclictest0-21swapper/423:10:554
2714599171,8cyclictest0-21swapper/422:29:264
2714199179,4cyclictest46-21ksoftirqd/321:45:133
2714199179,4cyclictest46-21ksoftirqd/321:40:133
2714199177,7cyclictest191rcu_preempt20:01:213
2714199176,4cyclictest46-21ksoftirqd/322:50:363
27141991712,3cyclictest0-21swapper/322:36:513
27141991712,1cyclictest221601cpuspeed_turbos20:55:123
27141991712,1cyclictest221601cpuspeed_turbos20:55:123
27128991715,1cyclictest0-21swapper/000:32:510
2650852170,3pltrace0-21swapper/722:59:357
1257352170,4pltrace0-21swapper/722:37:087
1040852170,6pltrace0-21swapper/320:38:413
916252160,13pltrace0-21swapper/200:27:112
3165952160,3pltrace0-21swapper/720:16:427
3103852160,11pltrace0-21swapper/122:11:191
2994752160,0pltrace0-21swapper/721:09:297
2932452160,4pltrace0-21swapper/723:04:387
2932452160,3pltrace0-21swapper/723:05:187
27157991611,3cyclictest0-21swapper/722:09:567
2715499169,6cyclictest1146-21snmpd00:22:156
27154991611,4cyclictest0-21swapper/623:41:256
27154991611,3cyclictest0-21swapper/622:27:206
27154991611,3cyclictest0-21swapper/620:20:506
27150991611,3cyclictest0-21swapper/520:41:085
27150991610,5cyclictest0-21swapper/523:55:585
27150991610,5cyclictest0-21swapper/523:55:585
2715099161,14cyclictest0-21swapper/519:23:205
2714599160,15cyclictest0-21swapper/421:57:224
2714599160,14cyclictest0-21swapper/420:00:104
2714199168,4cyclictest46-21ksoftirqd/323:55:143
2714199168,4cyclictest46-21ksoftirqd/323:55:143
2714199168,4cyclictest46-21ksoftirqd/322:40:223
2714199168,4cyclictest46-21ksoftirqd/320:20:123
2714199168,4cyclictest46-21ksoftirqd/300:20:193
2714199168,4cyclictest46-21ksoftirqd/300:05:223
2714199166,6cyclictest46-21ksoftirqd/319:25:193
2714199166,4cyclictest46-21ksoftirqd/323:20:183
2714199166,4cyclictest46-21ksoftirqd/323:10:193
2714199166,4cyclictest46-21ksoftirqd/321:20:183
2714199162,3cyclictest0-21swapper/320:29:293
2714199160,8cyclictest0-21swapper/321:31:093
2714199160,8cyclictest0-21swapper/319:24:353
2714199160,7cyclictest191rcu_preempt00:37:493
2714199160,15cyclictest0-21swapper/322:24:413
27136991611,3cyclictest0-21swapper/223:14:282
27136991611,3cyclictest0-21swapper/223:06:012
27136991611,3cyclictest0-21swapper/219:10:122
27136991611,3cyclictest0-21swapper/200:07:382
2713699161,7cyclictest0-21swapper/223:47:592
2713699160,4cyclictest0-21swapper/220:30:132
2713699160,3cyclictest0-21swapper/220:11:222
27133991610,5cyclictest0-21swapper/120:57:471
27133991610,5cyclictest0-21swapper/120:57:471
27133991610,5cyclictest0-21swapper/119:51:211
27133991610,5cyclictest0-21swapper/119:42:031
2713399160,3cyclictest0-21swapper/123:49:261
2688252160,3pltrace0-21swapper/719:12:477
249952160,1pltrace4384-21ntpq23:15:187
1876752160,12pltrace54-21ksoftirqd/420:53:164
1876752160,12pltrace0-21swapper/020:53:240
358852150,4pltrace5754-21timerandwakeup00:15:202
3103852150,2pltrace0-21swapper/722:10:277
27157991510,3cyclictest0-21swapper/720:43:287
27157991510,3cyclictest0-21swapper/719:28:067
2715799150,2cyclictest0-21swapper/719:30:237
2715799150,14cyclictest0-21swapper/720:34:447
2715799150,14cyclictest0-21swapper/700:29:217
2715499150,14cyclictest0-21swapper/621:59:416
2715499150,14cyclictest0-21swapper/621:22:146
2715499150,14cyclictest0-21swapper/620:30:186
2715499150,11cyclictest0-21swapper/623:48:286
27150991512,2cyclictest629-21awk20:15:155
2715099150,8cyclictest0-21swapper/500:35:185
2715099150,7cyclictest0-21swapper/500:03:135
2715099150,7cyclictest0-21swapper/500:03:135
2715099150,4cyclictest0-21swapper/523:42:185
2715099150,2cyclictest0-21swapper/519:30:115
2715099150,14cyclictest0-21swapper/523:12:315
2715099150,14cyclictest0-21swapper/521:16:325
27145991511,3cyclictest0-21swapper/421:37:394
2714599151,3cyclictest0-21swapper/422:33:274
2714599150,8cyclictest0-21swapper/419:12:504
2714599150,3cyclictest0-21swapper/421:31:394
2714599150,14cyclictest0-21swapper/423:31:164
2714599150,14cyclictest0-21swapper/422:42:034
2714599150,14cyclictest0-21swapper/420:12:554
2714199159,2cyclictest46-21ksoftirqd/321:25:113
2714199158,4cyclictest46-21ksoftirqd/320:05:193
2714199158,4cyclictest46-21ksoftirqd/300:10:173
2714199157,4cyclictest46-21ksoftirqd/323:30:113
2714199157,4cyclictest46-21ksoftirqd/321:10:133
2714199157,4cyclictest46-21ksoftirqd/320:40:213
2714199157,4cyclictest46-21ksoftirqd/320:30:153
2714199156,4cyclictest46-21ksoftirqd/321:00:173
2714199155,6cyclictest46-21ksoftirqd/322:30:153
2714199155,4cyclictest46-21ksoftirqd/322:05:113
2714199155,4cyclictest46-21ksoftirqd/320:48:353
27141991512,2cyclictest860-21taskset19:18:373
27141991512,2cyclictest29169-21timerandwakeup19:10:193
27141991512,2cyclictest1178-21runrttasks23:38:473
27141991512,2cyclictest1146-21snmpd23:40:463
27141991510,2cyclictest46-21ksoftirqd/320:10:153
2714199150,4cyclictest0-21swapper/322:03:553
2714199150,14cyclictest0-21swapper/300:32:203
2713699151,6cyclictest0-21swapper/200:38:142
2713699150,8cyclictest0-21swapper/223:20:342
2713699150,7cyclictest0-21swapper/222:36:542
2713699150,7cyclictest0-21swapper/219:45:062
2713699150,7cyclictest0-21swapper/200:14:132
2713699150,14cyclictest0-21swapper/223:17:012
2713699150,14cyclictest0-21swapper/222:15:132
2713399159,5cyclictest0-21swapper/100:11:501
27133991511,3cyclictest0-21swapper/120:03:301
2713399150,7cyclictest0-21swapper/120:08:001
2713399150,4cyclictest0-21swapper/119:35:581
2713399150,14cyclictest0-21swapper/120:34:491
2713399150,14cyclictest0-21swapper/120:14:191
2712899150,7cyclictest0-21swapper/022:38:500
2712899150,4cyclictest0-21swapper/022:54:470
2712899150,3cyclictest0-21swapper/023:20:480
2712899150,14cyclictest0-21swapper/023:46:190
2712899150,13cyclictest0-21swapper/022:42:500
2712899150,13cyclictest0-21swapper/000:18:480
2650852150,11pltrace0-21swapper/023:00:360
1598252150,11pltrace54-21ksoftirqd/420:44:274
141352150,5pltrace0-21swapper/722:18:127
807152140,11pltrace0-21swapper/723:26:467
27157991413,1cyclictest0-21swapper/721:50:127
2715799140,13cyclictest0-21swapper/721:10:027
2715799140,1cyclictest0-21swapper/720:09:097
2715499143,4cyclictest5851-21timerwakeupswit00:15:216
2715499143,4cyclictest21598-21fschecks_count19:55:146
2715499140,8cyclictest0-21swapper/623:26:486
2715499140,13cyclictest0-21swapper/623:36:096
2715499140,13cyclictest0-21swapper/621:06:246
2715499140,1cyclictest0-21swapper/621:10:176
2715499140,1cyclictest0-21swapper/621:03:586
2715099140,7cyclictest0-21swapper/520:26:385
2715099140,13cyclictest0-21swapper/522:40:215
2715099140,13cyclictest0-21swapper/522:15:215
2714599149,4cyclictest0-21swapper/423:39:104
2714599140,13cyclictest0-21swapper/422:15:164
2714199148,5cyclictest0-21swapper/300:27:353
2714199148,4cyclictest46-21ksoftirqd/323:15:163
2714199148,2cyclictest46-21ksoftirqd/323:06:413
2714199147,4cyclictest46-21ksoftirqd/323:25:133
2714199147,4cyclictest46-21ksoftirqd/322:14:493
2714199147,4cyclictest46-21ksoftirqd/321:35:143
2714199147,4cyclictest46-21ksoftirqd/319:40:123
2714199145,6cyclictest46-21ksoftirqd/319:30:223
27141991411,2cyclictest23093-21/usr/sbin/munin21:55:193
27141991411,2cyclictest19219-21/usr/sbin/munin20:50:203
27141991411,2cyclictest16187-21cut19:45:133
2714199140,7cyclictest0-21swapper/322:45:483
2713699149,3cyclictest0-21swapper/223:43:412
2713699149,3cyclictest0-21swapper/219:40:332
27136991413,1cyclictest0-21swapper/220:55:022
27136991413,1cyclictest0-21swapper/220:55:022
27136991410,2cyclictest0-21swapper/200:22:592
2713699140,7cyclictest0-21swapper/223:38:312
2713699140,7cyclictest0-21swapper/222:23:462
2713699140,7cyclictest0-21swapper/221:38:512
2713699140,12cyclictest0-21swapper/222:50:452
2713699140,1cyclictest0-21swapper/221:45:222
27133991413,1cyclictest0-21swapper/100:05:181
27133991410,3cyclictest0-21swapper/123:58:081
27133991410,3cyclictest0-21swapper/123:58:081
27133991410,3cyclictest0-21swapper/122:33:081
2713399141,12cyclictest0-21swapper/121:30:551
2713399140,7cyclictest0-21swapper/119:28:431
2713399140,1cyclictest0-21swapper/119:30:151
2713399140,1cyclictest0-21swapper/100:00:171
2713399140,1cyclictest0-21swapper/100:00:171
27128991412,1cyclictest0-21swapper/019:37:430
2712899140,13cyclictest0-21swapper/022:16:470
1814652140,10pltrace20235-21switchtime22:45:211
1040852140,0pltrace0-21swapper/720:39:077
807152130,4pltrace0-21swapper/223:25:132
528452130,4pltrace7237-21ps23:20:186
483352130,9pltrace54-21ksoftirqd/420:25:454
313852130,1pltrace0-21swapper/121:21:311
2715799130,12cyclictest0-21swapper/721:58:177
2715799130,12cyclictest0-21swapper/700:02:027
2715799130,12cyclictest0-21swapper/700:02:027
2715499136,6cyclictest0-21swapper/600:35:456
2715499135,7cyclictest1146-21snmpd22:40:156
2715499134,7cyclictest22784-21fschecks_time20:55:136
2715499134,7cyclictest22784-21fschecks_time20:55:136
2715499133,9cyclictest11539-21chrt21:34:386
2715499133,8cyclictest0-21swapper/622:10:296
2715499133,4cyclictest2507-21sed21:15:196
2715499132,4cyclictest3156-21timerandwakeup19:20:216
2715499130,6cyclictest19959-21timerwakeupswit19:50:216
2715499130,1cyclictest0-21swapper/620:45:216
2715499130,1cyclictest0-21swapper/600:13:346
27150991312,1cyclictest0-21swapper/520:55:175
27150991312,1cyclictest0-21swapper/520:55:165
27150991310,2cyclictest0-21swapper/519:45:155
27150991310,2cyclictest0-21swapper/500:20:115
2715099131,1cyclictest0-21swapper/519:25:195
2715099130,12cyclictest0-21swapper/523:52:285
2715099130,12cyclictest0-21swapper/500:34:275
2715099130,1cyclictest0-21swapper/521:35:255
2715099130,1cyclictest0-21swapper/521:30:205
2714599139,3cyclictest0-21swapper/422:06:444
2714599137,5cyclictest0-21swapper/419:25:324
2714599137,3cyclictest0-21swapper/423:01:064
2714599130,12cyclictest0-21swapper/419:20:414
2714199137,2cyclictest46-21ksoftirqd/319:35:223
2714199136,4cyclictest0-21swapper/300:16:113
2714199135,5cyclictest46-21ksoftirqd/322:15:203
27141991310,2cyclictest870-21cpu21:15:103
27141991310,2cyclictest1478-21lldpd22:27:173
2713699137,3cyclictest0-21swapper/222:50:002
27136991312,1cyclictest0-21swapper/222:25:212
27136991312,1cyclictest0-21swapper/219:24:122
27136991310,2cyclictest1146-21snmpd21:00:122
2713699130,7cyclictest0-21swapper/222:11:252
2713699130,13cyclictest0-21swapper/222:30:142
2713699130,12cyclictest0-21swapper/223:51:142
2713699130,12cyclictest0-21swapper/219:15:572
2713399138,3cyclictest0-21swapper/122:28:341
27133991310,1cyclictest0-21swapper/121:12:451
2713399130,12cyclictest0-21swapper/122:41:231
2712899130,12cyclictest0-21swapper/023:34:570
2712899130,12cyclictest0-21swapper/023:19:180
2712899130,12cyclictest0-21swapper/022:31:520
2712899130,12cyclictest0-21swapper/019:59:140
2650852130,5pltrace0-21swapper/123:00:361
2200652130,3pltrace24550-21runrttasks23:50:581
1985652130,5pltrace0-21swapper/121:49:131
1769352130,5pltrace0-21swapper/719:53:457
1490552130,5pltrace17484-21taskset19:46:241
1473352130,0pltrace0-21swapper/100:38:221
1150052130,3pltrace0-21swapper/721:35:527
1040852130,5pltrace0-21swapper/120:35:211
933452120,4pltrace0-21swapper/219:38:342
483352120,5pltrace0-21swapper/020:25:520
313852120,6pltrace0-21swapper/221:21:352
2974352120,3pltrace32728-21switchtime19:15:211
2716152120,5pltrace0-21swapper/121:06:271
2716152120,5pltrace0-21swapper/021:06:250
2715799128,2cyclictest0-21swapper/722:45:177
2715799126,5cyclictest0-21swapper/723:47:497
2715799120,3cyclictest0-21swapper/721:30:207
2715799120,11cyclictest0-21swapper/723:23:187
2715799120,1cyclictest0-21swapper/721:43:147
2715799120,1cyclictest0-21swapper/720:10:277
2715499124,7cyclictest13378-21cstates22:35:136
2715499124,7cyclictest1064-13audispd19:30:006
2715499123,8cyclictest9645-21aten_r4power_en00:25:116
2715499123,8cyclictest13109-21cat21:35:186
2715499123,7cyclictest0-21swapper/622:20:146
2715499122,5cyclictest1055-13auditd20:10:116
2715499122,4cyclictest30352-21open_files19:15:006
2715499122,4cyclictest2071-21cpuspeed_turbos22:15:116
2715499122,3cyclictest25111-21sed22:55:146
2715499121,4cyclictest23367-21grep23:50:136
2715499120,5cyclictest6934-21/usr/sbin/munin21:25:126
2715499120,5cyclictest606-21chrt00:07:326
2715499120,5cyclictest5264-21chrt23:19:096
2715499120,5cyclictest32538-21expr20:15:136
2715499120,5cyclictest31355-21sendmail_mailtr23:05:206
2715499120,5cyclictest28889-21taskset20:09:206
2715499120,5cyclictest26283-21cat23:55:146
2715499120,5cyclictest26283-21cat23:55:146
2715499120,5cyclictest25881-21/usr/sbin/munin22:00:236
2715499120,5cyclictest19635-21chrt21:46:166
2715499120,5cyclictest15880-21cstates19:45:126
2715499120,5cyclictest14142-21ls20:40:116
2715499120,5cyclictest13480-21chrt23:32:076
2715499120,5cyclictest12934-21df_inode00:30:136
2715499120,5cyclictest12861-21grep20:35:226
2715499120,5cyclictest10666-21expr22:30:126
2715499120,5cyclictest10025-21cpuspeed_turbos19:35:136
2715499120,4cyclictest29482-21/usr/sbin/munin00:00:176
2715499120,4cyclictest29482-21/usr/sbin/munin00:00:176
2715099129,2cyclictest25297-21expr21:00:105
2715099129,2cyclictest18691-21diskstats19:50:135
2715099129,2cyclictest10811-21basename19:35:165
2715099129,2cyclictest0-21swapper/500:10:225
2715099127,3cyclictest0-21swapper/521:41:545
2715099126,3cyclictest0-21swapper/519:57:015
27150991211,1cyclictest0-21swapper/500:05:495
27150991210,1cyclictest0-21swapper/521:57:295
2715099120,11cyclictest0-21swapper/523:38:245
2714599129,2cyclictest0-21swapper/422:54:104
2714599127,4cyclictest0-21swapper/421:42:094
2714599126,5cyclictest1478-21lldpd23:47:194
2714599120,2cyclictest0-21swapper/419:30:164
2714599120,1cyclictest0-21swapper/419:39:134
2714599120,1cyclictest0-21swapper/400:08:474
2714199129,2cyclictest25757-21sensors22:55:203
2714199129,2cyclictest23546-21iostat23:50:153
2714199129,2cyclictest22261-21missed_timers19:55:163
2714199127,2cyclictest46-21ksoftirqd/323:00:133
2714199127,2cyclictest46-21ksoftirqd/321:50:113
2714199126,4cyclictest46-21ksoftirqd/323:45:143
27141991210,1cyclictest0-21swapper/320:15:063
2713699128,3cyclictest0-21swapper/221:08:302
2713699127,3cyclictest0-21swapper/220:15:222
2713699126,5cyclictest0-21swapper/222:00:002
27136991210,1cyclictest0-21swapper/219:50:152
2713699120,12cyclictest0-21swapper/220:46:172
2713399129,2cyclictest214632sleep120:53:061
2713399126,3cyclictest0-21swapper/121:56:221
2713399125,6cyclictest0-21swapper/119:59:451
2713399122,8cyclictest0-21swapper/123:44:561
27133991210,1cyclictest0-21swapper/122:50:091
27133991210,1cyclictest0-21swapper/119:15:001
2713399120,11cyclictest0-21swapper/123:25:381
2713399120,11cyclictest0-21swapper/122:59:591
2713399120,11cyclictest0-21swapper/121:52:211
2713399120,11cyclictest0-21swapper/120:20:581
2713399120,1cyclictest0-21swapper/122:01:161
2712899129,2cyclictest8782-21crond21:30:010
2712899129,2cyclictest1063-17auditd22:24:590
27128991210,1cyclictest0-21swapper/020:57:360
27128991210,1cyclictest0-21swapper/020:57:360
2712899120,5cyclictest0-21swapper/021:55:440
2712899120,11cyclictest0-21swapper/023:44:070
2712899120,11cyclictest0-21swapper/021:21:120
2712899120,11cyclictest0-21swapper/021:00:380
2712899120,11cyclictest0-21swapper/019:30:360
2712899120,11cyclictest0-21swapper/019:27:430
2712899120,11cyclictest0-21swapper/000:02:380
2712899120,11cyclictest0-21swapper/000:02:380
1985652120,5pltrace21610-21missed_timers21:50:175
1814652120,6pltrace0-21swapper/022:46:340
1598252120,5pltrace0-21swapper/020:44:340
1040852120,6pltrace0-21swapper/020:35:210
3211052110,6pltrace1508-21needreboot23:10:151
3103852110,0pltrace0-21swapper/122:09:321
27157991110,1cyclictest0-21swapper/721:22:017
27157991110,1cyclictest0-21swapper/720:48:397
27157991110,1cyclictest0-21swapper/720:03:587
27157991110,1cyclictest0-21swapper/719:55:247
27157991110,1cyclictest0-21swapper/719:16:237
27157991110,1cyclictest0-21swapper/700:20:177
27157991110,1cyclictest0-21swapper/700:06:417
2715799110,11cyclictest0-21swapper/723:52:067
2715799110,11cyclictest0-21swapper/723:30:217
2715799110,11cyclictest0-21swapper/720:29:147
2715799110,11cyclictest0-21swapper/720:23:247
2715799110,1cyclictest0-21swapper/722:44:447
2715799110,1cyclictest0-21swapper/722:00:047
2715799110,1cyclictest0-21swapper/721:29:387
2715499111,2cyclictest0-21swapper/622:50:006
2715499111,2cyclictest0-21swapper/621:50:126
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional