You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-07 - 20:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Fri Aug 07, 2026 12:44:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28905521490,141pltrace0-21swapper/507:05:215
3075321440,1sleep10-21swapper/110:39:381
28905521320,123pltrace0-21swapper/107:05:161
28905521280,116pltrace0-21swapper/207:07:092
28905521200,117pltrace0-21swapper/607:05:186
28905521120,108pltrace0-21swapper/707:05:177
28905521060,102pltrace0-21swapper/307:05:113
1978452610,0pltrace0-21swapper/712:35:247
3166225945,10sleep00-21swapper/007:08:350
2904225844,10sleep40-21swapper/407:05:024
1469252540,3pltrace0-21swapper/710:25:197
171052470,8pltrace78-21ksoftirqd/711:17:307
2890352450,5pltrace78-21ksoftirqd/711:10:337
1205152450,6pltrace78-21ksoftirqd/711:28:377
436452440,6pltrace78-21ksoftirqd/710:14:247
696652420,9pltrace78-21ksoftirqd/709:17:367
696652420,9pltrace78-21ksoftirqd/709:17:367
2121152410,13pltrace78-21ksoftirqd/710:01:507
299852400,8pltrace78-21ksoftirqd/710:46:537
1602752390,7pltrace78-21ksoftirqd/709:57:137
2241852370,1pltrace24347-21fschecks_time11:35:137
2627152360,6pltrace78-21ksoftirqd/712:12:267
1469252360,8pltrace78-21ksoftirqd/710:23:457
1205152360,6pltrace78-21ksoftirqd/711:24:127
1073652360,8pltrace78-21ksoftirqd/711:54:357
568052350,9pltrace78-21ksoftirqd/709:48:177
2110152350,8pltrace78-21ksoftirqd/712:06:167
1073652350,8pltrace78-21ksoftirqd/711:58:417
436452340,8pltrace78-21ksoftirqd/710:16:447
3276352330,9pltrace78-21ksoftirqd/711:46:287
1593252330,0pltrace78-21ksoftirqd/712:03:147
427652320,1pltrace4319-21ssh12:18:497
2772452320,5pltrace78-21ksoftirqd/709:34:437
1458952320,8pltrace78-21ksoftirqd/712:28:487
1458952320,8pltrace78-21ksoftirqd/712:28:487
1083852320,6pltrace78-21ksoftirqd/709:52:587
304382310,0sleep30-21swapper/308:00:213
2772452310,7pltrace78-21ksoftirqd/709:35:167
1458952290,0pltrace0-21swapper/712:30:167
1458952290,0pltrace0-21swapper/712:30:167
31972992622,1cyclictest299852pltrace10:47:325
2627152250,1pltrace26274-21pltrace-run12:08:446
2528852240,0pltrace0-21swapper/707:54:217
3195799230,22cyclictest0-21swapper/210:11:022
31960992111,3cyclictest0-21swapper/310:50:493
2635952210,3pltrace0-21swapper/710:08:437
31965992017,2cyclictest0-21swapper/410:45:544
31965991914,3cyclictest0-21swapper/410:08:354
3195299190,4cyclictest30-21ksoftirqd/111:57:111
2110152190,1pltrace21105-21pltrace-run12:03:446
3198452180,4pltrace0-21swapper/709:06:317
3194899180,7cyclictest1135052pltrace07:32:520
3023852180,15pltrace54-21ksoftirqd/410:40:514
2370452180,4pltrace0-21swapper/711:08:117
2370452180,1pltrace0-21swapper/711:03:487
1135052180,0pltrace0-21swapper/707:30:127
964552170,0pltrace0-21swapper/708:28:057
690752170,12pltrace11307-21ssh11:22:260
3196599171,4cyclictest0-21swapper/410:32:514
31952991714,2cyclictest32566-21latency08:05:201
31952991714,2cyclictest27415-21fschecks_count08:55:121
31952991714,2cyclictest13048-21sshd10:53:111
1336652170,10pltrace18405-21chrt10:58:312
690752160,11pltrace0-21swapper/511:22:305
427652160,0pltrace0-21swapper/712:22:317
3198099161,14cyclictest0-21swapper/710:44:007
31976991613,2cyclictest0-21swapper/611:47:466
31976991613,1cyclictest0-21swapper/610:01:356
3197699161,8cyclictest0-21swapper/609:44:346
3197699160,4cyclictest15315-21munin-run12:30:006
3197699160,4cyclictest15315-21munin-run12:30:006
31972991610,5cyclictest0-21swapper/508:48:155
3197299160,2cyclictest5890-21ssh11:49:215
3197299160,15cyclictest27934-21ssh11:39:195
3197299160,15cyclictest19970-21sh10:28:535
31965991611,3cyclictest0-21swapper/407:12:194
3196599161,8cyclictest0-21swapper/408:04:264
3196599161,14cyclictest0-21swapper/407:22:314
3196599160,15cyclictest0-21swapper/412:39:494
3196099166,2cyclictest0-21swapper/311:45:143
31960991610,4cyclictest0-21swapper/312:37:013
3196099161,7cyclictest0-21swapper/310:22:003
3196099161,4cyclictest0-21swapper/309:34:343
31957991610,5cyclictest0-21swapper/208:03:052
3195799161,8cyclictest0-21swapper/209:35:282
3195799160,15cyclictest0-21swapper/208:16:502
31952991614,1cyclictest291ktimers/109:18:321
31952991614,1cyclictest291ktimers/109:18:321
31952991614,1cyclictest1597-21missed_timers12:15:181
31952991613,2cyclictest5599-21tr12:20:131
31952991613,2cyclictest29138-21switchtime12:10:191
31952991613,2cyclictest1178-21runrttasks10:20:391
3195299161,8cyclictest0-21swapper/108:34:361
3195299161,7cyclictest0-21swapper/108:23:251
3195299161,14cyclictest0-21swapper/111:21:551
3195299161,14cyclictest0-21swapper/109:44:251
3195299161,13cyclictest0-21swapper/108:30:001
3195299160,9cyclictest0-21swapper/107:48:161
3195299160,2cyclictest281rcuc/108:40:001
3195299160,15cyclictest30-21ksoftirqd/112:01:341
3195299160,15cyclictest0-21swapper/107:33:371
3194899161,8cyclictest0-21swapper/007:44:310
3194899160,4cyclictest0-21swapper/012:32:000
3194899160,4cyclictest0-21swapper/012:32:000
3147252160,13pltrace0-21swapper/612:14:386
2241852160,12pltrace0-21swapper/211:35:312
3198099150,7cyclictest0-21swapper/708:07:057
3198099150,4cyclictest0-21swapper/707:59:207
3198099150,4cyclictest0-21swapper/707:14:577
3198099150,14cyclictest0-21swapper/709:13:107
3197699159,4cyclictest1055-17auditd11:40:006
3197299150,8cyclictest0-21swapper/510:41:185
3197299150,8cyclictest0-21swapper/507:19:165
3197299150,14cyclictest0-21swapper/509:55:145
3196599151,3cyclictest0-21swapper/408:31:034
3196599151,3cyclictest0-21swapper/408:13:324
3196599150,8cyclictest0-21swapper/410:27:184
3196599150,8cyclictest0-21swapper/409:54:264
3196599150,2cyclictest0-21swapper/411:08:534
3196599150,14cyclictest0-21swapper/409:41:194
3196599150,14cyclictest0-21swapper/409:17:564
3196599150,14cyclictest0-21swapper/409:17:564
3196099154,4cyclictest0-21swapper/310:07:443
31960991513,1cyclictest0-21swapper/311:01:523
3196099151,13cyclictest0-21swapper/308:21:023
3196099150,8cyclictest0-21swapper/311:27:593
3196099150,8cyclictest0-21swapper/309:05:003
3196099150,3cyclictest0-21swapper/308:52:123
31957991513,1cyclictest0-21swapper/207:50:142
3195799151,3cyclictest0-21swapper/209:45:522
3195799150,8cyclictest0-21swapper/210:25:512
3195799150,8cyclictest0-21swapper/208:08:352
3195799150,14cyclictest0-21swapper/210:51:432
31952991514,1cyclictest0-21swapper/109:28:071
31952991514,1cyclictest0-21swapper/109:28:071
31952991513,1cyclictest13375-21sh12:26:341
31952991513,1cyclictest13375-21sh12:26:331
31952991513,1cyclictest1291-21cat09:40:001
31952991512,2cyclictest7273-21idleruntime07:20:151
31952991512,2cyclictest25483-21timerandwakeup09:30:191
31952991512,2cyclictest20938-21/usr/sbin/munin12:35:191
31952991512,2cyclictest1178-21runrttasks12:07:511
31952991512,1cyclictest191rcu_preempt11:41:561
31952991510,3cyclictest0-21swapper/111:33:341
31952991510,3cyclictest0-21swapper/107:13:401
3195299151,6cyclictest30-21ksoftirqd/107:15:121
3195299150,8cyclictest0-21swapper/111:10:061
3195299150,8cyclictest0-21swapper/108:45:151
3195299150,14cyclictest0-21swapper/111:29:101
3195299150,14cyclictest0-21swapper/109:55:151
3195299150,14cyclictest0-21swapper/107:38:311
31948991511,3cyclictest0-21swapper/009:39:460
3194899150,8cyclictest0-21swapper/011:42:530
3194899150,14cyclictest0-21swapper/012:36:120
2808052150,3pltrace0-21swapper/708:01:477
2772452150,1pltrace0-21swapper/309:35:253
2637152150,0pltrace0-21swapper/208:55:012
184672150,0sleep30-21swapper/309:25:053
184672150,0sleep30-21swapper/309:25:053
1458952150,9pltrace17306-21proc_pri12:30:202
1458952150,9pltrace17306-21proc_pri12:30:202
577752140,12pltrace0-21swapper/507:23:405
554252140,8pltrace54-21ksoftirqd/411:49:254
46752140,9pltrace4011-21ssh09:40:462
31980991411,2cyclictest17700-21cpuspeed_turbos07:40:107
3198099140,2cyclictest78-21ksoftirqd/710:39:367
3198099140,13cyclictest0-21swapper/710:58:337
3197699149,3cyclictest0-21swapper/609:50:356
3197699148,5cyclictest0-21swapper/608:01:566
31976991413,1cyclictest0-21swapper/611:03:346
31976991413,1cyclictest0-21swapper/610:10:276
31976991412,1cyclictest0-21swapper/608:30:186
3197699140,13cyclictest0-21swapper/612:19:016
3197699140,13cyclictest0-21swapper/611:59:456
3197699140,13cyclictest0-21swapper/609:55:126
3197699140,1cyclictest0-21swapper/610:16:276
3197699140,1cyclictest0-21swapper/609:45:126
31972991413,1cyclictest0-21swapper/511:28:485
31972991413,1cyclictest0-21swapper/510:21:465
31972991413,1cyclictest0-21swapper/508:15:195
31972991411,2cyclictest0-21swapper/511:05:235
3197299140,8cyclictest0-21swapper/511:17:295
3197299140,3cyclictest0-21swapper/509:13:555
3197299140,3cyclictest0-21swapper/507:50:545
3197299140,14cyclictest0-21swapper/510:15:475
3197299140,13cyclictest0-21swapper/512:18:395
3197299140,13cyclictest0-21swapper/509:15:555
3197299140,13cyclictest0-21swapper/509:15:555
3197299140,1cyclictest0-21swapper/512:20:365
3197299140,1cyclictest0-21swapper/511:57:005
3197299140,1cyclictest0-21swapper/510:52:415
3197299140,1cyclictest0-21swapper/510:09:475
3196599144,9cyclictest0-21swapper/408:51:334
3196599140,13cyclictest0-21swapper/411:21:214
3196599140,13cyclictest0-21swapper/410:18:424
3196599140,13cyclictest0-21swapper/409:55:234
3196599140,1cyclictest0-21swapper/410:20:584
3196099148,5cyclictest0-21swapper/311:55:483
31960991413,1cyclictest0-21swapper/309:53:223
31960991412,1cyclictest0-21swapper/311:32:183
3196099140,7cyclictest0-21swapper/312:00:423
3196099140,14cyclictest0-21swapper/311:54:483
3196099140,13cyclictest0-21swapper/310:26:053
3196099140,13cyclictest0-21swapper/307:47:103
3196099140,1cyclictest0-21swapper/312:19:153
3196099140,1cyclictest0-21swapper/310:18:573
3196099140,1cyclictest0-21swapper/310:12:583
31957991411,2cyclictest15833-21ssh11:58:352
31957991410,3cyclictest26739-21expr10:35:122
31957991410,2cyclictest0-21swapper/211:33:592
3195799140,7cyclictest0-21swapper/210:40:242
3195799140,3cyclictest0-21swapper/212:24:452
3195799140,3cyclictest0-21swapper/207:40:552
3195799140,13cyclictest0-21swapper/209:55:122
3195799140,13cyclictest0-21swapper/209:05:112
3195299148,5cyclictest0-21swapper/110:04:581
3195299146,5cyclictest21592-21ssh10:30:111
31952991413,1cyclictest0-21swapper/110:29:261
31952991412,1cyclictest2948-21latency08:10:161
31952991412,1cyclictest26816-21timerwakeupswit11:05:221
31952991412,1cyclictest0-21swapper/111:15:061
31952991411,2cyclictest31067-21ntpq09:00:181
31952991411,2cyclictest1146-21snmpd11:35:041
3195299140,13cyclictest0-21swapper/111:51:121
31948991411,2cyclictest1146-21snmpd09:20:540
3194899140,7cyclictest0-21swapper/008:59:080
3194899140,13cyclictest0-21swapper/012:17:000
3194899140,13cyclictest0-21swapper/007:11:190
3147252140,8pltrace0-21swapper/212:16:052
299852140,8pltrace7428-21ssh10:47:263
2253352140,2pltrace22619-21ssh09:28:522
2253352140,2pltrace22619-21ssh09:28:522
2253352140,11pltrace54-21ksoftirqd/409:28:474
2253352140,11pltrace54-21ksoftirqd/409:28:474
2241852140,5pltrace0-21swapper/311:35:273
1854752140,12pltrace0-21swapper/111:01:301
1723052140,10pltrace54-21ksoftirqd/411:31:024
1593252140,3pltrace19844-21ssh12:01:310
1593252140,2pltrace19863-21ssh12:01:332
1458952140,3pltrace16516-21fschecks_time12:30:145
1458952140,3pltrace16516-21fschecks_time12:30:145
1336652140,2pltrace18349-21ssh10:58:255
1205152140,1pltrace0-21swapper/311:23:443
696652130,5pltrace0-21swapper/309:17:553
696652130,5pltrace0-21swapper/309:17:553
46752130,8pltrace4005-21ssh09:40:455
436452130,6pltrace0-21swapper/010:14:510
3198452130,5pltrace0-21swapper/309:06:513
31980991311,1cyclictest0-21swapper/711:30:177
31980991311,1cyclictest0-21swapper/709:22:427
3198099130,1cyclictest0-21swapper/710:31:217
3197699139,3cyclictest0-21swapper/610:06:356
3197699133,8cyclictest0-21swapper/608:45:306
31976991312,1cyclictest0-21swapper/611:16:026
31976991312,1cyclictest0-21swapper/609:32:546
3197699130,13cyclictest0-21swapper/612:37:286
3197699130,13cyclictest0-21swapper/611:26:536
3197699130,13cyclictest0-21swapper/611:10:126
3197699130,13cyclictest0-21swapper/610:51:546
3197699130,13cyclictest0-21swapper/610:23:346
3197699130,13cyclictest0-21swapper/609:05:136
3197699130,12cyclictest0-21swapper/607:13:246
3197699130,1cyclictest0-21swapper/611:54:346
3197699130,1cyclictest0-21swapper/611:33:416
3197299133,8cyclictest0-21swapper/509:35:285
31972991312,1cyclictest0-21swapper/511:54:325
31972991312,1cyclictest0-21swapper/509:21:325
31972991311,1cyclictest0-21swapper/509:47:275
31972991310,2cyclictest1146-21snmpd12:06:395
3197299130,2cyclictest0-21swapper/508:39:125
3197299130,13cyclictest0-21swapper/508:58:135
3197299130,13cyclictest0-21swapper/507:59:565
3197299130,1cyclictest0-21swapper/512:25:575
3197299130,1cyclictest0-21swapper/512:25:575
3197299130,1cyclictest0-21swapper/512:12:325
3197299130,1cyclictest0-21swapper/510:31:215
3196599137,5cyclictest0-21swapper/408:49:394
31965991312,1cyclictest0-21swapper/411:10:504
31965991311,1cyclictest0-21swapper/412:34:234
31965991311,1cyclictest0-21swapper/412:34:234
3196599130,13cyclictest0-21swapper/412:13:204
3196599130,12cyclictest0-21swapper/410:39:454
3196599130,12cyclictest0-21swapper/407:18:544
3196599130,1cyclictest0-21swapper/411:17:284
31960991312,1cyclictest0-21swapper/310:35:483
31960991312,1cyclictest0-21swapper/309:45:263
3196099130,13cyclictest0-21swapper/311:06:333
31957991312,1cyclictest0-21swapper/212:38:442
31957991312,1cyclictest0-21swapper/211:10:112
31957991310,2cyclictest0-21swapper/209:50:592
3195799130,13cyclictest0-21swapper/211:22:192
3195799130,12cyclictest0-21swapper/211:28:352
3195799130,12cyclictest0-21swapper/209:20:572
3195299137,4cyclictest0-21swapper/107:56:471
3195299134,6cyclictest191rcu_preempt08:43:421
31952991312,1cyclictest0-21swapper/110:16:191
31952991310,2cyclictest17493-21switchtime12:30:211
31952991310,2cyclictest17493-21switchtime12:30:211
31952991310,2cyclictest0-21swapper/109:45:061
3195299131,11cyclictest0-21swapper/107:50:521
3195299130,13cyclictest0-21swapper/108:00:201
3194899137,2cyclictest0-21swapper/007:52:440
3194899133,9cyclictest0-21swapper/008:07:070
31948991310,2cyclictest0-21swapper/010:00:020
3194899130,12cyclictest0-21swapper/012:25:210
3194899130,12cyclictest0-21swapper/012:25:200
3194899130,12cyclictest0-21swapper/010:48:290
3194899130,12cyclictest0-21swapper/010:20:570
2890352130,5pltrace0-21swapper/311:11:003
2890352130,1pltrace32563-21ssh11:10:585
2637152130,6pltrace26474-21latency_hist08:54:590
2637152130,5pltrace0-21swapper/208:55:052
2637152130,2pltrace26679-21latency_hist08:55:015
2504852130,1pltrace0-21swapper/610:37:086
2253352130,5pltrace0-21swapper/509:28:515
2253352130,5pltrace0-21swapper/509:28:515
2121152130,5pltrace0-21swapper/310:02:103
1971152130,10pltrace54-21ksoftirqd/407:44:514
1800552130,10pltrace54-21ksoftirqd/408:43:314
1692252130,5pltrace0-21swapper/207:39:112
1458952130,7pltrace0-21swapper/312:30:153
1458952130,7pltrace0-21swapper/312:30:153
554252120,1pltrace6006-21rm11:49:340
3198099129,2cyclictest0-21swapper/707:35:127
3198099126,5cyclictest78-21ksoftirqd/709:44:447
31980991211,1cyclictest0-21swapper/708:30:157
3197699129,2cyclictest6718-21cat12:20:186
3197699129,2cyclictest20397-21grep07:45:116
3197699123,4cyclictest1089-21dbus-daemon07:25:016
31976991211,1cyclictest0-21swapper/610:29:346
31976991211,1cyclictest0-21swapper/609:39:036
31976991211,1cyclictest0-21swapper/608:35:256
3197699120,12cyclictest0-21swapper/607:38:556
3197299126,3cyclictest0-21swapper/507:41:165
31972991211,1cyclictest0-21swapper/511:30:255
3197299120,12cyclictest0-21swapper/508:40:355
3197299120,11cyclictest0-21swapper/508:32:095
3196599127,2cyclictest0-21swapper/410:00:354
3196599126,5cyclictest0-21swapper/412:19:424
3196599126,5cyclictest0-21swapper/412:02:484
31965991211,1cyclictest0-21swapper/411:56:104
3196599120,12cyclictest0-21swapper/411:03:234
3196599120,11cyclictest0-21swapper/408:55:254
3196599120,1cyclictest0-21swapper/408:35:214
3196099123,8cyclictest0-21swapper/308:27:553
31960991211,1cyclictest0-21swapper/312:05:103
31960991211,1cyclictest0-21swapper/309:56:373
31960991211,1cyclictest0-21swapper/309:40:453
31960991210,1cyclictest0-21swapper/309:24:573
3196099120,11cyclictest0-21swapper/308:13:093
3195799129,2cyclictest1065-17sedispatch10:35:012
3195799128,3cyclictest0-21swapper/211:44:202
3195799126,3cyclictest0-21swapper/208:14:052
31957991211,1cyclictest0-21swapper/211:17:382
31957991211,1cyclictest0-21swapper/211:00:182
31957991211,1cyclictest0-21swapper/209:19:462
31957991211,1cyclictest0-21swapper/209:19:462
3195799120,12cyclictest0-21swapper/211:07:262
3195799120,11cyclictest0-21swapper/207:29:542
3195799120,1cyclictest0-21swapper/210:45:442
3195799120,1cyclictest0-21swapper/210:17:042
3195299129,2cyclictest811-21fschecks_time09:05:121
3195299129,2cyclictest6060-21processes08:15:201
3195299129,2cyclictest4181-21wget10:45:101
3195299129,2cyclictest4084-21ssh10:13:141
3195299129,2cyclictest27743-21cpuspeed_turbos10:05:121
3195299129,2cyclictest1665-21cpu11:45:111
3195299129,2cyclictest14215-21fschecks_time09:20:131
3195299129,2cyclictest1178-21runrttasks09:11:281
3195299129,2cyclictest1146-21snmpd08:54:331
3195299129,2cyclictest10431-21netstat07:25:171
3195299122,6cyclictest30-21ksoftirqd/110:55:181
31952991211,1cyclictest0-21swapper/110:41:451
31952991211,1cyclictest0-21swapper/107:43:201
31952991210,1cyclictest15078-21ssh09:52:041
3194899128,2cyclictest0-21swapper/008:18:490
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional