You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-24 - 07:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Fri Apr 24, 2026 00:44:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2338421400,0sleep50-21swapper/500:40:005
29797521230,118pltrace0-21swapper/619:05:166
29797521130,108pltrace0-21swapper/519:05:155
29797521050,56pltrace0-21swapper/719:05:217
29797521050,100pltrace0-21swapper/119:05:121
15033521010,1pltrace1283-21pltrace-run19:32:415
2979752760,67pltrace0-21swapper/219:07:412
3271627258,10sleep30-21swapper/319:09:333
3271325945,10sleep00-21swapper/019:09:310
3034025843,10sleep40-21swapper/419:05:104
445992115,3cyclictest0-21swapper/521:03:435
2662852200,15pltrace26646-21seq22:47:541
2168052190,13pltrace0-21swapper/020:45:110
2168052190,13pltrace0-21swapper/020:45:110
45399180,17cyclictest7725-21/usr/sbin/munin21:15:167
449991813,4cyclictest1055-17auditd21:50:006
44599181,9cyclictest0-21swapper/520:10:005
819552170,12pltrace0-21swapper/123:13:521
445991715,1cyclictest0-21swapper/522:18:255
445991711,5cyclictest0-21swapper/521:49:415
44599171,15cyclictest0-21swapper/519:58:535
2555252170,2pltrace0-21swapper/721:50:227
666952160,0pltrace0-21swapper/719:17:567
44999169,4cyclictest0-21swapper/621:13:546
44999160,15cyclictest0-21swapper/621:20:126
445991611,4cyclictest0-21swapper/500:20:005
445991610,5cyclictest0-21swapper/523:19:055
44599161,7cyclictest0-21swapper/520:54:345
44599161,7cyclictest0-21swapper/520:54:345
44599161,14cyclictest0-21swapper/523:26:065
44599160,8cyclictest0-21swapper/522:02:205
44599160,15cyclictest0-21swapper/521:56:535
44599160,1cyclictest191rcu_preempt21:24:325
437991614,1cyclictest0-21swapper/321:45:223
430991611,3cyclictest0-21swapper/121:32:111
43099161,8cyclictest0-21swapper/123:53:431
43099161,8cyclictest0-21swapper/123:53:421
43099160,4cyclictest0-21swapper/100:27:321
43099160,14cyclictest0-21swapper/121:25:131
774452150,8pltrace0-21swapper/620:19:596
453991510,4cyclictest1055-17auditd20:15:007
44599150,14cyclictest0-21swapper/519:10:115
430991510,3cyclictest0-21swapper/120:49:571
430991510,3cyclictest0-21swapper/120:49:571
43099150,8cyclictest0-21swapper/123:27:141
43099150,4cyclictest0-21swapper/100:32:011
43099150,4cyclictest0-21swapper/100:10:311
43099150,14cyclictest0-21swapper/119:58:081
453991411,2cyclictest0-21swapper/723:15:117
45399140,14cyclictest0-21swapper/700:30:137
45399140,1cyclictest0-21swapper/722:25:147
449991411,2cyclictest0-21swapper/621:42:426
44599149,3cyclictest0-21swapper/523:41:095
445991411,2cyclictest6075-21cat19:15:205
445991411,2cyclictest16444-21perl19:35:145
44599140,7cyclictest0-21swapper/521:42:535
441991413,1cyclictest0-21swapper/400:15:194
44199140,13cyclictest0-21swapper/422:15:004
43399140,1cyclictest0-21swapper/220:27:422
43099140,13cyclictest0-21swapper/121:42:561
43099140,1cyclictest0-21swapper/121:20:121
426991411,2cyclictest1146-21snmpd20:35:140
3258252140,2pltrace1178-21runrttasks19:11:040
2941552140,2pltrace0-21swapper/722:57:397
217052140,6pltrace0-21swapper/620:11:246
2168052140,6pltrace0-21swapper/620:45:126
2168052140,6pltrace0-21swapper/620:45:126
2060552140,8pltrace0-21swapper/119:44:371
1997752140,2pltrace22669-21taskset21:41:372
1610752140,6pltrace18812-21runrttasks20:36:511
1503352140,1pltrace15036-21grep19:32:421
45399136,6cyclictest0-21swapper/723:06:517
453991312,1cyclictest0-21swapper/721:00:137
45399130,13cyclictest0-21swapper/720:54:237
45399130,13cyclictest0-21swapper/720:54:237
449991310,2cyclictest1146-21snmpd23:09:056
44999130,1cyclictest304352pltrace19:15:556
44599138,2cyclictest62-21ksoftirqd/519:42:425
445991310,2cyclictest29343-21taskset22:52:005
445991310,2cyclictest27681-21sshd23:47:425
445991310,2cyclictest1178-21runrttasks20:00:365
441991310,2cyclictest30310-21ntpq21:55:204
441991310,2cyclictest0-21swapper/423:35:234
437991312,1cyclictest0-21swapper/300:07:023
437991310,2cyclictest1146-21snmpd23:49:003
43399137,1cyclictest649352pltrace00:07:432
433991312,1cyclictest0-21swapper/223:30:212
43399130,1cyclictest0-21swapper/220:15:242
43099130,12cyclictest0-21swapper/122:42:211
43099130,12cyclictest0-21swapper/120:34:501
43099130,12cyclictest0-21swapper/120:10:061
43099130,12cyclictest0-21swapper/100:01:431
3219952130,2pltrace1181-21fschecks_time23:00:130
2833952130,5pltrace0-21swapper/221:54:332
1826752130,5pltrace0-21swapper/622:34:016
1826752130,4pltrace0-21swapper/522:34:585
1440452130,5pltrace0-21swapper/621:32:366
1332052130,1pltrace0-21swapper/620:28:326
1207152130,4pltrace14126-21processes00:20:195
990852120,6pltrace0-21swapper/022:18:410
990852120,5pltrace0-21swapper/622:18:376
928652120,5pltrace0-21swapper/000:13:470
84052120,4pltrace1178-21runrttasks23:59:191
774452120,6pltrace0-21swapper/020:20:000
45399129,2cyclictest3443-21munin-node22:10:037
45399129,2cyclictest0-21swapper/721:07:547
45399129,2cyclictest0-21swapper/700:22:437
45399126,5cyclictest78-21ksoftirqd/721:47:257
45399126,5cyclictest78-21ksoftirqd/719:55:187
45399124,7cyclictest0-21swapper/721:10:217
45399124,4cyclictest0-21swapper/723:55:117
453991211,1cyclictest0-21swapper/720:40:197
453991211,1cyclictest0-21swapper/720:40:197
45399120,11cyclictest0-21swapper/723:48:597
44999129,2cyclictest0-21swapper/623:12:476
44999129,2cyclictest0-21swapper/619:36:256
44999125,2cyclictest1889152pltrace20:40:126
44999125,2cyclictest1889152pltrace20:40:126
44999125,2cyclictest1098352pltrace23:20:186
449991211,1cyclictest0-21swapper/621:50:186
449991210,1cyclictest0-21swapper/622:07:246
449991210,1cyclictest0-21swapper/621:38:586
449991210,1cyclictest0-21swapper/600:31:356
44599129,2cyclictest7288-21timerandwakeup20:15:215
44599129,2cyclictest6156-21tr23:10:135
44599129,2cyclictest3829-21fschecks_count23:05:135
44599129,2cyclictest23262-21basename20:45:155
44599129,2cyclictest23262-21basename20:45:155
44599129,2cyclictest2086-21/usr/sbin/munin22:05:205
44599129,2cyclictest20099-21missed_timers22:35:185
44599129,2cyclictest18318-21sed23:30:175
44599129,2cyclictest15108-21cpu21:30:135
44599129,2cyclictest15005-21latency20:30:165
44599129,2cyclictest10570-21fschecks_count19:25:135
44599128,2cyclictest62-21ksoftirqd/521:50:135
44599127,2cyclictest62-21ksoftirqd/523:58:155
44599127,2cyclictest62-21ksoftirqd/523:20:195
44599127,2cyclictest62-21ksoftirqd/521:26:025
44599127,2cyclictest62-21ksoftirqd/521:10:135
44599126,5cyclictest0-21swapper/523:35:455
44599126,3cyclictest62-21ksoftirqd/522:10:215
44599126,3cyclictest0-21swapper/520:37:365
44599122,6cyclictest62-21ksoftirqd/520:57:165
445991210,1cyclictest23026-21ntpq22:40:185
445991210,1cyclictest13711-21cat22:25:135
445991210,1cyclictest12239-21cat22:20:225
445991210,1cyclictest0-21swapper/500:13:365
44199129,2cyclictest21150-21/usr/sbin/munin19:45:154
44199129,2cyclictest0-21swapper/420:35:154
44199124,5cyclictest0-21swapper/422:53:464
441991211,1cyclictest0-21swapper/421:50:154
44199120,12cyclictest0-21swapper/400:02:314
44199120,11cyclictest0-21swapper/422:11:314
44199120,1cyclictest0-21swapper/423:26:054
44199120,1cyclictest0-21swapper/423:01:294
44199120,1cyclictest0-21swapper/420:41:264
44199120,1cyclictest0-21swapper/420:41:264
44199120,1cyclictest0-21swapper/419:31:094
44199120,1cyclictest0-21swapper/400:26:394
43799129,2cyclictest1146-21snmpd22:00:143
437991211,1cyclictest0-21swapper/323:43:243
437991211,1cyclictest0-21swapper/319:25:283
43799120,12cyclictest0-21swapper/323:22:503
43799120,12cyclictest0-21swapper/321:26:063
43799120,1cyclictest0-21swapper/323:09:333
43799120,1cyclictest0-21swapper/322:50:373
43799120,1cyclictest0-21swapper/321:41:293
43799120,1cyclictest0-21swapper/320:19:423
43799120,1cyclictest0-21swapper/319:20:073
43399129,2cyclictest4878-21/usr/sbin/munin22:10:172
43399128,3cyclictest1081-21crond22:20:002
433991211,1cyclictest0-21swapper/221:05:172
433991211,1cyclictest0-21swapper/219:21:592
43399120,7cyclictest20117-21unixbench-2d00:30:222
43399120,1cyclictest0-21swapper/200:14:332
43099126,5cyclictest0-21swapper/120:52:271
43099126,5cyclictest0-21swapper/120:52:271
43099126,5cyclictest0-21swapper/100:23:171
430991210,1cyclictest0-21swapper/121:00:081
430991210,1cyclictest0-21swapper/119:35:171
426991210,1cyclictest0-21swapper/000:15:150
42699120,12cyclictest0-21swapper/023:59:340
42699120,11cyclictest0-21swapper/021:15:020
38052120,6pltrace0-21swapper/021:03:450
3258252120,8pltrace1146-21snmpd19:11:003
3258252120,4pltrace0-21swapper/719:11:007
2725352120,4pltrace0-21swapper/620:53:546
2725352120,4pltrace0-21swapper/620:53:546
2168052120,7pltrace54-21ksoftirqd/420:45:054
2168052120,7pltrace54-21ksoftirqd/420:45:054
1655552120,5pltrace0-21swapper/623:28:376
1269452120,8pltrace1055-17auditd22:25:006
1162052120,5pltrace0-21swapper/221:23:172
45399119,1cyclictest0-21swapper/720:05:017
45399119,1cyclictest0-21swapper/700:00:137
45399118,2cyclictest7758-21df_inode19:20:117
45399118,2cyclictest3315-21cat22:05:167
45399118,2cyclictest23314-21sed22:40:217
45399118,2cyclictest17473-21expr23:30:137
45399118,2cyclictest17214-21cat00:25:227
45399118,2cyclictest15524-21latency23:25:177
45399118,2cyclictest11910-21cstates23:20:117
45399118,2cyclictest10340-21expr00:15:117
45399115,6cyclictest0-21swapper/721:40:187
45399114,6cyclictest0-21swapper/722:45:177
45399114,6cyclictest0-21swapper/721:35:137
45399114,6cyclictest0-21swapper/720:35:207
45399114,6cyclictest0-21swapper/719:45:117
45399114,6cyclictest0-21swapper/719:25:137
453991110,1cyclictest0-21swapper/723:00:517
453991110,1cyclictest0-21swapper/720:30:467
453991110,1cyclictest0-21swapper/719:53:127
453991110,1cyclictest0-21swapper/719:30:227
45399110,11cyclictest0-21swapper/721:24:307
45399110,11cyclictest0-21swapper/700:36:327
45399110,11cyclictest0-21swapper/700:14:217
45399110,1cyclictest0-21swapper/723:11:127
45399110,1cyclictest0-21swapper/722:04:407
45399110,1cyclictest0-21swapper/719:41:237
44999119,1cyclictest0-21swapper/622:49:546
44999118,2cyclictest27423-21unixbench_multi23:45:196
44999114,2cyclictest0-21swapper/623:00:136
449991110,1cyclictest0-21swapper/622:01:006
449991110,1cyclictest0-21swapper/621:07:356
449991110,1cyclictest0-21swapper/619:41:376
44999110,11cyclictest0-21swapper/619:56:596
44999110,11cyclictest0-21swapper/600:02:256
44999110,1cyclictest0-21swapper/622:37:076
44999110,1cyclictest0-21swapper/620:37:476
44999110,1cyclictest0-21swapper/619:10:416
44599118,2cyclictest7522-21cpuspeed_turbos19:20:095
44599118,2cyclictest7058-21expr21:15:135
44599118,2cyclictest669-21expr23:00:115
44599118,2cyclictest30557-21cut22:55:145
44599118,2cyclictest2879-21cpuspeed_turbos20:10:125
44599118,2cyclictest28356-21wget23:50:125
44599118,2cyclictest28356-21wget23:50:125
44599118,2cyclictest24669-21tr22:45:135
44599118,2cyclictest24283-21cstates19:50:125
44599118,2cyclictest21469-21cpuspeed_turbos19:45:115
44599118,2cyclictest19902-21expr20:40:125
44599118,2cyclictest19902-21expr20:40:125
44599118,2cyclictest18566-21cstates00:30:125
44599118,2cyclictest18219-21cat21:35:135
44599118,2cyclictest15595-21cpuspeed_turbos00:25:115
44599118,2cyclictest1146-21snmpd21:06:265
44599118,2cyclictest11274-21cpuspeed_turbos20:25:135
44599116,2cyclictest62-21ksoftirqd/520:20:205
44599116,2cyclictest62-21ksoftirqd/500:05:135
44199118,2cyclictest3508-21ntp_kernel_pll_22:05:164
44199118,2cyclictest24251-21cut19:50:114
441991110,1cyclictest0-21swapper/423:46:104
441991110,1cyclictest0-21swapper/423:11:214
441991110,1cyclictest0-21swapper/421:26:274
441991110,1cyclictest0-21swapper/420:28:194
441991110,1cyclictest0-21swapper/400:36:594
44199110,11cyclictest0-21swapper/423:43:544
44199110,11cyclictest0-21swapper/423:05:324
44199110,11cyclictest0-21swapper/421:41:014
44199110,11cyclictest0-21swapper/420:50:114
44199110,11cyclictest0-21swapper/420:50:114
44199110,11cyclictest0-21swapper/419:17:334
44199110,10cyclictest0-21swapper/419:22:384
44199110,1cyclictest0-21swapper/423:17:214
44199110,1cyclictest0-21swapper/421:48:284
44199110,1cyclictest0-21swapper/421:07:114
44199110,1cyclictest0-21swapper/421:00:324
44199110,1cyclictest0-21swapper/419:55:554
44199110,1cyclictest0-21swapper/419:41:214
44199110,1cyclictest0-21swapper/419:26:274
44199110,1cyclictest0-21swapper/419:12:224
43799118,2cyclictest5175-21perl19:15:143
43799118,2cyclictest16612-21idleruntime19:35:143
43799118,2cyclictest1146-21snmpd21:50:423
43799118,2cyclictest0-21swapper/321:35:133
437991110,1cyclictest0-21swapper/323:11:203
437991110,1cyclictest0-21swapper/321:24:173
437991110,1cyclictest0-21swapper/320:23:163
437991110,1cyclictest0-21swapper/319:58:253
437991110,1cyclictest0-21swapper/319:50:333
437991110,1cyclictest0-21swapper/319:47:483
437991110,1cyclictest0-21swapper/300:33:453
437991110,1cyclictest0-21swapper/300:16:353
437991110,1cyclictest0-21swapper/300:04:463
43799110,7cyclictest16103-21aten_r4power_po22:30:103
43799110,11cyclictest0-21swapper/323:25:353
43799110,11cyclictest0-21swapper/323:01:273
43799110,11cyclictest0-21swapper/322:35:323
43799110,11cyclictest0-21swapper/322:27:173
43799110,11cyclictest0-21swapper/322:24:033
43799110,11cyclictest0-21swapper/322:16:463
43799110,11cyclictest0-21swapper/321:31:553
43799110,11cyclictest0-21swapper/321:16:033
43799110,11cyclictest0-21swapper/320:47:533
43799110,11cyclictest0-21swapper/320:47:533
43799110,1cyclictest0-21swapper/300:14:193
43399118,2cyclictest23383-21fschecks_time23:40:132
43399118,2cyclictest1283-21pltrace-run20:37:412
43399118,2cyclictest1139-21polkitd19:12:422
43399118,2cyclictest0-21swapper/223:55:172
43399118,2cyclictest0-21swapper/219:15:172
43399117,3cyclictest22190-21grep22:40:132
43399117,3cyclictest1146-21snmpd21:15:522
433991110,1cyclictest0-21swapper/222:05:302
433991110,1cyclictest0-21swapper/220:48:462
433991110,1cyclictest0-21swapper/220:48:462
433991110,1cyclictest0-21swapper/220:12:382
433991110,1cyclictest0-21swapper/220:09:532
433991110,1cyclictest0-21swapper/200:29:562
433991110,1cyclictest0-21swapper/200:21:212
43399111,5cyclictest14703-21cstates23:25:112
43399110,7cyclictest30943-21cstates21:00:122
43399110,7cyclictest28630-21fschecks_time20:55:142
43399110,7cyclictest26256-21missed_timers20:50:162
43399110,7cyclictest26256-21missed_timers20:50:162
43399110,6cyclictest24409-21aten_r4power_cu22:45:112
43399110,6cyclictest14570-21timerandwakeup19:30:202
43399110,4cyclictest24917-21getsmi21:45:212
43399110,11cyclictest0-21swapper/223:24:492
43399110,11cyclictest0-21swapper/220:23:202
43399110,11cyclictest0-21swapper/200:36:142
43399110,10cyclictest13567-21cpuspeed_turbos22:25:132
43399110,1cyclictest0-21swapper/223:16:052
43399110,1cyclictest0-21swapper/219:58:532
43399110,1cyclictest0-21swapper/219:38:492
43399110,1cyclictest0-21swapper/200:16:492
43099119,1cyclictest0-21swapper/119:50:011
43099116,2cyclictest0-21swapper/120:15:261
43099115,5cyclictest0-21swapper/122:52:461
430991110,1cyclictest0-21swapper/123:16:551
430991110,1cyclictest0-21swapper/122:31:561
430991110,1cyclictest0-21swapper/121:55:101
430991110,1cyclictest0-21swapper/100:15:231
43099110,11cyclictest0-21swapper/123:49:571
43099110,11cyclictest0-21swapper/123:41:121
43099110,11cyclictest0-21swapper/123:05:061
43099110,11cyclictest0-21swapper/122:11:321
43099110,11cyclictest0-21swapper/122:08:271
43099110,11cyclictest0-21swapper/119:18:561
43099110,11cyclictest0-21swapper/119:14:141
43099110,10cyclictest0-21swapper/120:05:061
43099110,1cyclictest0-21swapper/123:36:111
43099110,1cyclictest0-21swapper/122:58:471
43099110,1cyclictest0-21swapper/122:22:421
43099110,1cyclictest0-21swapper/121:39:481
43099110,1cyclictest0-21swapper/120:24:211
43099110,1cyclictest0-21swapper/119:22:391
43099110,1cyclictest0-21swapper/100:05:501
42699119,1cyclictest0-21swapper/000:05:130
426991110,1cyclictest0-21swapper/023:13:240
426991110,1cyclictest0-21swapper/023:08:520
426991110,1cyclictest0-21swapper/021:43:040
426991110,1cyclictest0-21swapper/021:34:190
426991110,1cyclictest0-21swapper/019:52:290
42699110,2cyclictest17805-21cat22:30:210
42699110,11cyclictest0-21swapper/023:25:510
42699110,11cyclictest0-21swapper/022:41:110
42699110,11cyclictest0-21swapper/022:35:410
42699110,11cyclictest0-21swapper/022:06:420
42699110,11cyclictest0-21swapper/020:33:170
42699110,10cyclictest0-21swapper/023:42:220
42699110,10cyclictest0-21swapper/021:58:170
42699110,1cyclictest0-21swapper/022:48:570
42699110,1cyclictest0-21swapper/022:26:270
42699110,1cyclictest0-21swapper/022:23:130
42699110,1cyclictest0-21swapper/021:54:430
42699110,1cyclictest0-21swapper/021:26:230
42699110,1cyclictest0-21swapper/021:12:560
42699110,1cyclictest0-21swapper/020:54:570
42699110,1cyclictest0-21swapper/020:54:570
42699110,1cyclictest0-21swapper/020:43:370
42699110,1cyclictest0-21swapper/020:43:370
42699110,1cyclictest0-21swapper/020:05:060
42699110,1cyclictest0-21swapper/019:43:250
42699110,1cyclictest0-21swapper/019:23:100
42699110,1cyclictest0-21swapper/019:19:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional