You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 10:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Sun Jul 05, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25881521240,115pltrace0-21swapper/319:05:463
25881521230,53pltrace0-21swapper/719:05:167
28674521180,103pltrace0-21swapper/219:08:462
2867452940,79pltrace0-21swapper/519:10:015
2867452850,80pltrace0-21swapper/619:09:386
207102830,0sleep20-21swapper/200:25:162
2879226046,10sleep00-21swapper/019:09:300
2848725945,10sleep10-21swapper/119:05:301
2863125844,10sleep40-21swapper/419:07:334
1885652540,7pltrace78-21ksoftirqd/723:52:117
723752530,7pltrace78-21ksoftirqd/722:31:097
1430852520,9pltrace78-21ksoftirqd/723:44:247
82552460,1pltrace0-21swapper/200:37:532
268352460,7pltrace78-21ksoftirqd/722:23:077
1885652430,7pltrace78-21ksoftirqd/723:49:257
1214252420,7pltrace78-21ksoftirqd/721:27:087
1250952410,6pltrace78-21ksoftirqd/722:37:397
1692752380,6pltrace0-21swapper/722:05:287
3242152360,7pltrace78-21ksoftirqd/700:06:547
1368152360,7pltrace78-21ksoftirqd/700:18:587
3242152350,0pltrace0-21swapper/700:04:227
2146452350,9pltrace78-21ksoftirqd/722:11:207
1499252340,2pltrace0-21swapper/720:40:107
3182952330,7pltrace78-21ksoftirqd/722:54:247
3101652330,3pltrace0-21swapper/721:47:467
3101652330,3pltrace0-21swapper/721:47:467
3134352320,5pltrace78-21ksoftirqd/723:28:557
1368152310,0pltrace0-21swapper/700:22:077
184292260,2sleep40-21swapper/423:14:354
1235752220,2pltrace0-21swapper/721:58:007
3054352210,15pltrace78-21ksoftirqd/722:17:537
311552200,0pltrace0-21swapper/121:12:521
2902999200,19cyclictest0-21swapper/619:40:216
29020992018,1cyclictest521rcuc/422:20:014
2900999200,1cyclictest31916-21diskmemload21:45:021
2900999200,1cyclictest31916-21diskmemload21:45:021
3182952190,13pltrace0-21swapper/222:53:192
29029991917,1cyclictest6807-21kworker/u16:3-rpciod22:00:066
29020991916,2cyclictest0-21swapper/419:54:464
2902099190,19cyclictest0-21swapper/420:37:594
2902999180,15cyclictest22146-21ssh00:26:286
2902999180,1cyclictest0-21swapper/620:00:216
2902499184,13cyclictest0-21swapper/521:00:195
2901299189,8cyclictest0-21swapper/219:55:282
1499252180,12pltrace1146-21snmpd20:41:203
413052170,12pltrace4180-21sh23:32:586
29029991713,2cyclictest0-21swapper/619:40:016
29029991711,3cyclictest0-21swapper/600:35:026
2902099171,15cyclictest0-21swapper/423:20:294
2902099170,1cyclictest0-21swapper/423:07:134
2901599171,15cyclictest0-21swapper/323:53:573
2901599170,15cyclictest0-21swapper/322:00:443
29009991711,5cyclictest0-21swapper/119:30:121
2900999171,3cyclictest0-21swapper/121:04:391
2227052170,2pltrace0-21swapper/719:55:197
856252160,11pltrace0-21swapper/123:06:321
833652160,7pltrace10233-21strings19:30:183
723752160,12pltrace8159-21sh22:29:295
3054352160,14pltrace0-21swapper/122:18:271
29036991611,4cyclictest0-21swapper/723:11:137
2903699161,7cyclictest0-21swapper/720:00:317
2903699161,14cyclictest0-21swapper/721:34:147
2902999160,15cyclictest0-21swapper/623:52:526
2902499160,15cyclictest0-21swapper/522:51:195
2902499160,15cyclictest0-21swapper/521:56:325
2902499160,15cyclictest0-21swapper/500:12:275
29020991611,3cyclictest0-21swapper/421:14:514
29020991611,2cyclictest0-21swapper/422:24:364
29020991610,5cyclictest0-21swapper/419:45:334
2902099161,8cyclictest0-21swapper/421:00:484
2902099160,8cyclictest0-21swapper/420:25:024
2902099160,4cyclictest0-21swapper/420:46:414
2902099160,15cyclictest30429-21gltestperf21:05:134
2902099160,15cyclictest0-21swapper/422:11:304
2902099160,15cyclictest0-21swapper/421:57:534
2902099160,15cyclictest0-21swapper/419:22:214
29004991611,3cyclictest0-21swapper/019:53:100
29004991611,3cyclictest0-21swapper/019:13:450
29004991610,5cyclictest0-21swapper/021:00:200
2335452160,12pltrace54-21ksoftirqd/420:54:394
2146452160,11pltrace54-21ksoftirqd/422:08:224
457552150,6pltrace5512-21awk00:10:006
29036991510,3cyclictest23169-21ssh00:28:407
2903699150,13cyclictest0-21swapper/720:22:227
2902999150,8cyclictest0-21swapper/623:22:026
2902999150,7cyclictest0-21swapper/621:31:286
2902999150,14cyclictest0-21swapper/622:08:596
2902999150,14cyclictest0-21swapper/619:58:406
2902999150,14cyclictest0-21swapper/619:53:406
29024991513,1cyclictest0-21swapper/520:30:135
29024991511,2cyclictest0-21swapper/520:56:005
2902499150,7cyclictest0-21swapper/523:59:015
2902499150,3cyclictest0-21swapper/500:30:035
2902499150,14cyclictest3065-21ssh21:47:375
2902499150,14cyclictest3065-21ssh21:47:375
2902499150,14cyclictest0-21swapper/523:03:355
2902499150,13cyclictest0-21swapper/519:44:305
29020991513,1cyclictest0-21swapper/421:46:264
29020991513,1cyclictest0-21swapper/421:46:264
2902099151,3cyclictest0-21swapper/400:23:134
2902099150,14cyclictest0-21swapper/400:39:584
29015991512,2cyclictest0-21swapper/300:39:033
29015991511,3cyclictest0-21swapper/300:18:023
2901599151,7cyclictest0-21swapper/321:15:153
2901599151,7cyclictest0-21swapper/320:14:373
2901599150,7cyclictest0-21swapper/322:47:463
2901599150,7cyclictest0-21swapper/300:12:213
2901599150,3cyclictest0-21swapper/323:48:443
2901599150,14cyclictest0-21swapper/322:34:243
2901599150,14cyclictest0-21swapper/321:57:413
29012991513,1cyclictest0-21swapper/223:55:132
29012991511,3cyclictest0-21swapper/221:02:092
2901299151,7cyclictest0-21swapper/221:50:562
2901299151,7cyclictest0-21swapper/221:50:562
2901299150,8cyclictest0-21swapper/219:19:482
2901299150,7cyclictest0-21swapper/222:47:192
2901299150,14cyclictest0-21swapper/223:46:022
2901299150,14cyclictest0-21swapper/221:40:492
2901299150,14cyclictest0-21swapper/221:30:302
2900999159,5cyclictest0-21swapper/123:33:381
29009991510,3cyclictest0-21swapper/123:20:001
2900999150,7cyclictest0-21swapper/100:18:461
2900999150,14cyclictest0-21swapper/123:27:351
2900999150,14cyclictest0-21swapper/121:29:141
2900999150,14cyclictest0-21swapper/100:08:181
2900499159,5cyclictest0-21swapper/020:44:540
2900499150,7cyclictest0-21swapper/021:30:460
2900499150,4cyclictest0-21swapper/021:14:300
2900499150,14cyclictest0-21swapper/023:25:000
2900499150,14cyclictest0-21swapper/023:15:170
2900499150,14cyclictest0-21swapper/023:04:490
2900499150,14cyclictest0-21swapper/022:18:540
2900499150,13cyclictest0-21swapper/022:08:560
2900499150,13cyclictest0-21swapper/021:37:280
2900499150,13cyclictest0-21swapper/020:50:270
2790652150,8pltrace27913-21sh23:57:541
2338952150,11pltrace54-21ksoftirqd/423:57:474
2222652150,11pltrace54-21ksoftirqd/423:19:344
413052140,8pltrace4190-21ssh23:33:005
413052140,6pltrace4142-21ssh23:32:540
3054352140,3pltrace30606-21taskset22:18:013
2903699149,2cyclictest0-21swapper/723:59:427
2903699148,5cyclictest78-21ksoftirqd/723:23:077
2903699146,7cyclictest2332-21ps22:55:197
29036991413,1cyclictest0-21swapper/722:46:357
29036991413,1cyclictest0-21swapper/700:32:087
2903699140,14cyclictest0-21swapper/721:38:557
2903699140,1cyclictest0-21swapper/723:37:257
2903699140,1cyclictest0-21swapper/721:22:057
29029991411,2cyclictest0-21swapper/623:55:016
2902999140,8cyclictest0-21swapper/622:58:226
2902999140,7cyclictest0-21swapper/623:36:266
2902999140,14cyclictest0-21swapper/621:50:386
2902999140,14cyclictest0-21swapper/621:50:376
2902999140,13cyclictest0-21swapper/623:28:596
2902999140,13cyclictest0-21swapper/621:45:076
2902999140,13cyclictest0-21swapper/621:45:076
2902999140,13cyclictest0-21swapper/621:00:166
2902999140,13cyclictest0-21swapper/619:31:286
2902999140,1cyclictest0-21swapper/623:13:316
2902999140,1cyclictest0-21swapper/622:40:296
2902999140,1cyclictest0-21swapper/622:33:416
2902999140,1cyclictest0-21swapper/621:25:326
2902999140,1cyclictest0-21swapper/600:15:516
29024991413,1cyclictest0-21swapper/522:49:185
2902499140,8cyclictest0-21swapper/519:30:575
2902499140,3cyclictest22815-21ssh00:27:595
2902499140,14cyclictest0-21swapper/523:26:245
2902499140,14cyclictest0-21swapper/521:38:135
2902499140,12cyclictest0-21swapper/519:58:435
2902499140,1cyclictest0-21swapper/523:20:035
2902499140,1cyclictest0-21swapper/522:43:465
2902499140,1cyclictest0-21swapper/522:23:435
2902499140,1cyclictest0-21swapper/522:02:315
2902499140,1cyclictest0-21swapper/521:44:015
29020991413,1cyclictest0-21swapper/422:44:144
29020991413,1cyclictest0-21swapper/422:27:244
29020991412,1cyclictest0-21swapper/421:20:124
29020991411,2cyclictest1146-21snmpd19:41:034
2902099140,12cyclictest0-21swapper/421:31:344
2902099140,1cyclictest0-21swapper/423:38:384
2902099140,1cyclictest0-21swapper/422:51:024
2902099140,1cyclictest0-21swapper/422:02:084
2902099140,1cyclictest0-21swapper/421:38:594
2902099140,1cyclictest0-21swapper/400:00:104
2901599148,3cyclictest0-21swapper/323:41:413
29015991413,1cyclictest0-21swapper/322:36:093
29015991412,1cyclictest0-21swapper/322:25:193
2901599140,6cyclictest0-21swapper/320:02:583
2901599140,14cyclictest0-21swapper/321:29:083
2901599140,13cyclictest0-21swapper/323:19:133
2901599140,13cyclictest0-21swapper/323:03:003
2901599140,13cyclictest0-21swapper/322:24:213
2901599140,13cyclictest0-21swapper/322:11:043
2901599140,1cyclictest0-21swapper/321:12:473
2901299149,3cyclictest0-21swapper/223:19:292
29012991413,1cyclictest0-21swapper/223:21:322
29012991413,1cyclictest0-21swapper/222:57:152
2901299141,12cyclictest0-21swapper/220:07:312
2901299140,14cyclictest0-21swapper/221:19:572
2901299140,1cyclictest0-21swapper/222:39:362
2901299140,1cyclictest0-21swapper/222:04:382
2900999149,3cyclictest0-21swapper/122:50:251
2900999148,5cyclictest0-21swapper/122:39:151
2900999148,5cyclictest0-21swapper/119:42:031
29009991413,1cyclictest0-21swapper/123:48:571
29009991413,1cyclictest0-21swapper/123:22:531
2900999140,7cyclictest0-21swapper/119:48:071
2900999140,3cyclictest0-21swapper/121:39:281
2900999140,14cyclictest0-21swapper/122:10:211
2900999140,14cyclictest0-21swapper/121:51:341
2900999140,14cyclictest0-21swapper/121:51:341
2900999140,14cyclictest0-21swapper/121:41:221
2900999140,1cyclictest0-21swapper/123:43:461
2900999140,1cyclictest0-21swapper/120:05:221
2900999140,1cyclictest0-21swapper/100:38:391
2900499149,3cyclictest0-21swapper/020:17:010
2900499148,5cyclictest0-21swapper/019:47:480
29004991413,1cyclictest0-21swapper/000:28:280
2900499140,7cyclictest0-21swapper/020:06:370
2900499140,7cyclictest0-21swapper/019:26:450
2900499140,3cyclictest0-21swapper/023:48:010
2900499140,13cyclictest0-21swapper/022:59:310
2900499140,13cyclictest0-21swapper/020:35:590
2900499140,1cyclictest0-21swapper/022:43:430
1368152140,5pltrace0-21swapper/100:22:181
941852130,6pltrace0-21swapper/320:32:023
941852130,0pltrace0-21swapper/720:31:137
833652130,5pltrace0-21swapper/019:30:220
762452130,4pltrace0-21swapper/621:18:526
723752130,5pltrace0-21swapper/622:29:276
723752130,1pltrace0-21swapper/222:29:252
663352130,5pltrace0-21swapper/120:23:171
555252130,10pltrace0-21swapper/519:23:475
457552130,6pltrace0-21swapper/200:10:072
457552130,5pltrace0-21swapper/600:10:066
319852130,1pltrace3546-21ssh21:48:403
319852130,1pltrace3546-21ssh21:48:403
3153352130,0pltrace0-21swapper/719:16:337
2903699139,3cyclictest0-21swapper/722:28:517
2903699137,5cyclictest78-21ksoftirqd/723:17:427
2903699136,6cyclictest0-21swapper/722:00:207
2903699136,6cyclictest0-21swapper/719:30:227
2903699136,6cyclictest0-21swapper/700:11:177
2903699131,11cyclictest0-21swapper/720:12:007
2903699130,13cyclictest0-21swapper/721:54:367
2903699130,13cyclictest0-21swapper/721:54:367
2903699130,13cyclictest0-21swapper/721:11:337
2903699130,13cyclictest0-21swapper/720:52:077
2903699130,13cyclictest0-21swapper/700:39:357
29029991312,1cyclictest0-21swapper/623:40:046
29029991312,1cyclictest0-21swapper/623:06:146
29029991312,1cyclictest0-21swapper/620:10:246
29029991312,1cyclictest0-21swapper/600:34:186
29029991310,2cyclictest17907-21ssh00:22:106
29029991310,2cyclictest1063-17auditd00:01:006
2902999130,13cyclictest0-21swapper/622:52:286
2902999130,12cyclictest0-21swapper/623:17:476
2902999130,12cyclictest0-21swapper/621:57:006
2902499133,9cyclictest0-21swapper/519:29:515
29024991312,1cyclictest0-21swapper/523:35:365
29024991312,1cyclictest0-21swapper/523:12:185
29024991312,1cyclictest0-21swapper/522:31:205
29024991312,1cyclictest0-21swapper/500:20:285
29024991310,2cyclictest0-21swapper/523:47:015
2902499130,7cyclictest0-21swapper/521:29:305
2902499130,13cyclictest0-21swapper/523:42:245
2902499130,13cyclictest0-21swapper/522:38:565
2902499130,13cyclictest0-21swapper/522:09:095
2902499130,13cyclictest0-21swapper/500:07:505
2902499130,12cyclictest0-21swapper/521:07:185
2902499130,12cyclictest0-21swapper/520:46:355
2902499130,12cyclictest0-21swapper/520:05:525
2902499130,12cyclictest0-21swapper/519:37:585
2902099138,3cyclictest0-21swapper/400:07:274
29020991312,1cyclictest0-21swapper/422:37:264
29020991311,1cyclictest0-21swapper/423:44:314
2902099130,6cyclictest0-21swapper/421:51:264
2902099130,6cyclictest0-21swapper/421:51:264
2902099130,2cyclictest5452ksoftirqd/420:18:314
2902099130,13cyclictest0-21swapper/421:28:474
2902099130,13cyclictest0-21swapper/421:16:194
2902099130,13cyclictest0-21swapper/400:30:564
2902099130,12cyclictest0-21swapper/423:31:474
29015991312,1cyclictest0-21swapper/323:32:303
29015991312,1cyclictest0-21swapper/322:42:573
29015991312,1cyclictest0-21swapper/321:36:353
2901599131,11cyclictest0-21swapper/300:26:343
2901599130,13cyclictest0-21swapper/300:34:213
2901299138,3cyclictest0-21swapper/220:02:012
2901299137,4cyclictest0-21swapper/220:26:262
2901299133,8cyclictest0-21swapper/219:30:062
29012991312,1cyclictest0-21swapper/221:46:102
29012991312,1cyclictest0-21swapper/221:46:102
29012991312,1cyclictest0-21swapper/221:23:502
29012991312,1cyclictest0-21swapper/200:18:122
29012991311,1cyclictest0-21swapper/221:25:462
29012991310,2cyclictest0-21swapper/222:09:002
2901299130,13cyclictest0-21swapper/223:44:512
2901299130,13cyclictest0-21swapper/223:35:372
2901299130,13cyclictest0-21swapper/222:15:582
2901299130,13cyclictest0-21swapper/200:00:232
2901299130,12cyclictest0-21swapper/222:13:012
2900999137,5cyclictest0-21swapper/120:04:401
29009991312,1cyclictest0-21swapper/123:53:191
29009991312,1cyclictest0-21swapper/121:22:351
29009991312,1cyclictest0-21swapper/121:16:461
29009991310,2cyclictest1063-17auditd22:35:001
2900999130,13cyclictest0-21swapper/121:59:011
29004991312,1cyclictest0-21swapper/023:39:540
29004991312,1cyclictest0-21swapper/022:51:190
29004991312,1cyclictest0-21swapper/022:32:030
2900499130,13cyclictest0-21swapper/023:55:550
2900499130,13cyclictest0-21swapper/023:40:420
2900499130,13cyclictest0-21swapper/021:53:120
2900499130,13cyclictest0-21swapper/021:53:120
2900499130,13cyclictest0-21swapper/021:29:340
2900499130,13cyclictest0-21swapper/000:35:550
2900499130,12cyclictest0-21swapper/021:15:330
2900499130,1cyclictest0-21swapper/023:29:030
2900499130,1cyclictest0-21swapper/023:13:400
2895452130,4pltrace0-21swapper/721:03:197
2797852130,2pltrace28375-21ssh00:33:341
2227052130,5pltrace0-21swapper/119:57:501
2146452130,5pltrace0-21swapper/322:08:313
1779752130,8pltrace20410-21grep22:40:141
1499252130,6pltrace0-21swapper/620:41:206
1368152130,2pltrace17945-21ssh00:22:163
856252120,4pltrace0-21swapper/323:06:313
723752120,7pltrace0-21swapper/122:29:291
723752120,6pltrace0-21swapper/022:29:280
663352120,5pltrace0-21swapper/020:23:260
384352120,4pltrace5192-21grep20:20:143
2903699129,2cyclictest7219-21kernelversion19:25:157
2903699126,5cyclictest78-21ksoftirqd/723:32:217
2903699125,6cyclictest0-21swapper/722:45:017
2903699124,7cyclictest0-21swapper/721:40:127
2903699122,8cyclictest0-21swapper/720:08:107
2903699121,10cyclictest0-21swapper/723:10:007
2902999127,4cyclictest0-21swapper/619:45:066
2902999122,9cyclictest0-21swapper/621:22:406
29029991210,1cyclictest0-21swapper/623:00:346
2902999120,12cyclictest0-21swapper/623:47:416
29024991211,1cyclictest0-21swapper/522:11:055
29024991211,1cyclictest0-21swapper/521:10:325
29024991211,1cyclictest0-21swapper/520:10:195
2902499120,12cyclictest0-21swapper/520:21:005
2902499120,11cyclictest0-21swapper/519:17:485
2902099126,5cyclictest0-21swapper/421:41:254
29020991211,1cyclictest0-21swapper/423:50:374
29020991211,1cyclictest0-21swapper/400:10:514
2902099120,11cyclictest0-21swapper/420:56:054
2902099120,1cyclictest0-21swapper/420:05:344
2902099120,1cyclictest0-21swapper/420:04:264
2901599126,5cyclictest0-21swapper/320:58:003
29015991211,1cyclictest0-21swapper/321:20:333
2901599120,11cyclictest0-21swapper/323:20:303
2901599120,11cyclictest0-21swapper/319:49:293
2901599120,11cyclictest0-21swapper/319:44:183
2901299129,2cyclictest0-21swapper/200:31:092
29012991211,1cyclictest0-21swapper/223:34:492
29012991211,1cyclictest0-21swapper/221:11:222
29012991211,1cyclictest0-21swapper/200:21:462
2901299120,12cyclictest0-21swapper/219:21:452
2901299120,11cyclictest0-21swapper/220:24:242
2901299120,1cyclictest0-21swapper/220:48:032
2900999127,4cyclictest0-21swapper/100:10:301
2900999127,3cyclictest0-21swapper/100:04:121
2900999126,5cyclictest0-21swapper/121:05:181
2900999126,5cyclictest0-21swapper/120:47:201
29004991211,1cyclictest0-21swapper/021:55:570
2900499120,12cyclictest0-21swapper/000:19:240
2867452120,5pltrace0-21swapper/119:10:061
2797852120,5pltrace0-21swapper/000:33:400
2786852120,5pltrace0-21swapper/320:06:243
2614252120,4pltrace0-21swapper/220:59:512
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional