You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 15:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Jun 16, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
23773521520,1pltrace0-21swapper/310:56:293
17878521310,123pltrace0-21swapper/207:07:482
17878521150,104pltrace0-21swapper/607:07:346
17878521140,98pltrace0-21swapper/507:07:165
17878521010,93pltrace0-21swapper/107:06:341
1783727157,10sleep30-21swapper/307:06:113
1811126248,10sleep70-21swapper/707:09:457
1790625945,10sleep00-21swapper/007:06:490
1813125844,10sleep40-21swapper/407:09:574
2377352560,0pltrace0-21swapper/710:56:357
2910552520,0pltrace0-21swapper/710:31:107
1018152480,0pltrace0-21swapper/710:45:017
2323752450,4pltrace0-21swapper/711:35:137
2094952420,9pltrace78-21ksoftirqd/709:10:557
172582410,0sleep60-21swapper/612:00:206
1426052400,0pltrace0-21swapper/711:25:467
2272052380,1pltrace78-21ksoftirqd/712:10:177
156052380,4pltrace0-21swapper/710:01:027
1373752380,0pltrace0-21swapper/711:56:497
1373752380,0pltrace0-21swapper/711:56:497
1036952380,1pltrace0-21swapper/709:32:307
3179052360,2pltrace0-21swapper/712:20:027
156052350,6pltrace78-21ksoftirqd/709:58:217
882852340,2pltrace0-21swapper/712:26:427
978352310,3pltrace10718-21rm11:18:437
882852310,0pltrace0-21swapper/712:30:567
1049352310,7pltrace78-21ksoftirqd/710:08:497
1018152310,3pltrace11581-21ssh10:44:487
64652300,3pltrace0-21swapper/709:22:257
2323752300,5pltrace78-21ksoftirqd/711:34:587
1707252300,0pltrace0-21swapper/708:05:187
1467352290,0pltrace0-21swapper/710:50:327
2910552280,9pltrace78-21ksoftirqd/710:28:277
1426052280,0pltrace0-21swapper/711:24:507
1036952270,1pltrace78-21ksoftirqd/709:35:407
530352250,5pltrace0-21swapper/711:11:377
18271992521,2cyclictest0-21swapper/310:29:083
2874952240,6pltrace78-21ksoftirqd/711:06:067
2823452210,15pltrace29224-21cat08:25:120
1827699210,20cyclictest0-21swapper/409:05:214
2715752200,0pltrace0-21swapper/707:25:157
140152190,0pltrace0-21swapper/708:35:437
2823452180,13pltrace54-21ksoftirqd/408:25:114
2323752180,14pltrace54-21ksoftirqd/411:31:394
2094952180,5pltrace0-21swapper/709:08:477
1917652180,13pltrace54-21ksoftirqd/410:55:344
1827999180,16cyclictest0-21swapper/511:20:015
18271991812,5cyclictest0-21swapper/308:37:023
18267991815,2cyclictest1146-21snmpd08:10:282
434652170,3pltrace54-21ksoftirqd/412:24:564
3271952170,11pltrace54-21ksoftirqd/411:44:374
3179052170,13pltrace54-21ksoftirqd/412:18:234
2094952170,13pltrace1178-21runrttasks09:08:523
18282991711,5cyclictest0-21swapper/612:30:036
18276991711,4cyclictest0-21swapper/412:30:474
18271991711,3cyclictest0-21swapper/308:55:413
1827199171,8cyclictest0-21swapper/307:31:323
18267991714,2cyclictest0-21swapper/212:20:162
18261991712,4cyclictest0-21swapper/110:00:221
18261991711,5cyclictest0-21swapper/107:30:231
1826199171,9cyclictest1055-13auditd08:05:001
1826199170,12cyclictest0-21swapper/110:34:391
1824652170,13pltrace54-21ksoftirqd/412:06:154
1426552170,2pltrace0-21swapper/708:00:137
927952160,11pltrace54-21ksoftirqd/411:54:084
927952160,11pltrace54-21ksoftirqd/411:54:084
520352160,2pltrace7593-21/usr/sbin/munin09:30:142
51022160,1sleep60-21swapper/609:26:206
1917652160,13pltrace54-21ksoftirqd/410:54:484
18287991611,3cyclictest0-21swapper/709:28:007
1828799161,4cyclictest0-21swapper/709:52:117
18282991611,3cyclictest0-21swapper/609:53:106
1827999161,8cyclictest0-21swapper/507:31:115
1827999160,15cyclictest0-21swapper/509:58:135
18276991613,2cyclictest0-21swapper/409:17:074
18276991611,4cyclictest0-21swapper/410:28:514
1827699161,7cyclictest0-21swapper/407:46:154
1827699160,15cyclictest0-21swapper/409:41:094
18271991611,3cyclictest0-21swapper/312:16:143
1827199161,8cyclictest0-21swapper/308:22:103
18267991611,3cyclictest0-21swapper/210:17:562
1826799161,14cyclictest0-21swapper/210:25:412
1826799160,8cyclictest0-21swapper/210:04:502
1826799160,15cyclictest0-21swapper/208:56:472
18261991611,4cyclictest0-21swapper/109:47:521
18261991611,4cyclictest0-21swapper/107:15:111
18261991610,5cyclictest0-21swapper/108:53:531
18261991610,5cyclictest0-21swapper/108:53:531
1826199161,7cyclictest0-21swapper/109:11:241
1826199160,12cyclictest0-21swapper/109:53:221
1826199160,10cyclictest18024-21taskset12:01:011
1826199160,1cyclictest0-21swapper/110:40:491
1826199160,1cyclictest0-21swapper/110:37:441
1826199160,1cyclictest0-21swapper/107:57:371
18256991610,5cyclictest0-21swapper/009:05:120
1825699161,8cyclictest0-21swapper/011:36:290
1825699161,8cyclictest0-21swapper/011:05:010
1825699160,8cyclictest0-21swapper/010:56:390
1049352160,10pltrace54-21ksoftirqd/410:10:164
978352150,6pltrace0-21swapper/611:20:236
978352150,3pltrace11998-21grep11:20:132
882852150,3pltrace12363-21sensors12:30:190
60542150,1sleep20-21swapper/208:40:172
60542150,1sleep20-21swapper/208:40:172
3273552150,11pltrace54-21ksoftirqd/407:32:064
2501952150,2pltrace28956-21grep09:50:220
2460152150,10pltrace0-21swapper/210:22:082
1963852150,11pltrace54-21ksoftirqd/410:19:554
1828799150,14cyclictest0-21swapper/710:22:507
1828799150,14cyclictest0-21swapper/709:49:417
1828799150,14cyclictest0-21swapper/708:50:087
1828799150,14cyclictest0-21swapper/708:50:087
1828799150,14cyclictest0-21swapper/708:49:417
1828799150,14cyclictest0-21swapper/708:49:417
18282991510,3cyclictest0-21swapper/608:25:216
1828299150,8cyclictest0-21swapper/608:48:206
1828299150,8cyclictest0-21swapper/608:48:196
1828299150,7cyclictest0-21swapper/610:52:486
1828299150,7cyclictest0-21swapper/609:30:256
1828299150,3cyclictest0-21swapper/612:19:006
1828299150,14cyclictest0-21swapper/611:39:156
1828299150,14cyclictest0-21swapper/611:08:196
1828299150,14cyclictest0-21swapper/610:01:206
1828299150,14cyclictest0-21swapper/607:11:136
1827999150,8cyclictest0-21swapper/512:11:185
1827999150,14cyclictest15585-21ssh10:12:585
1827999150,14cyclictest0-21swapper/510:41:385
1827999150,14cyclictest0-21swapper/509:36:065
1827999150,14cyclictest0-21swapper/508:34:195
1827999150,14cyclictest0-21swapper/507:37:115
18276991511,3cyclictest0-21swapper/407:39:544
1827699151,3cyclictest0-21swapper/411:14:544
1827699150,8cyclictest0-21swapper/411:15:124
1827699150,7cyclictest0-21swapper/408:00:424
1827699150,7cyclictest0-21swapper/407:40:274
1827699150,14cyclictest0-21swapper/412:01:184
1827699150,14cyclictest0-21swapper/411:25:214
1827699150,14cyclictest0-21swapper/411:06:064
18271991513,1cyclictest0-21swapper/310:51:443
1827199151,13cyclictest0-21swapper/311:03:013
1827199150,7cyclictest0-21swapper/310:19:173
1827199150,7cyclictest0-21swapper/310:11:443
1827199150,7cyclictest0-21swapper/308:31:293
1827199150,14cyclictest0-21swapper/311:40:133
1827199150,14cyclictest0-21swapper/311:37:373
1827199150,14cyclictest0-21swapper/311:23:373
1826799158,6cyclictest0-21swapper/210:54:062
18267991510,4cyclictest0-21swapper/211:18:192
1826799151,3cyclictest0-21swapper/209:36:222
1826799151,2cyclictest0-21swapper/210:39:272
1826799150,7cyclictest0-21swapper/209:50:312
1826799150,7cyclictest0-21swapper/207:50:512
1826799150,14cyclictest0-21swapper/211:31:582
1826799150,14cyclictest0-21swapper/210:45:572
1826799150,14cyclictest0-21swapper/207:14:142
1826799150,13cyclictest0-21swapper/207:25:052
1826199159,5cyclictest0-21swapper/108:40:231
1826199159,5cyclictest0-21swapper/108:40:231
1826199157,7cyclictest1178-21runrttasks12:09:001
1826199154,9cyclictest3324-21sed08:35:181
18261991511,3cyclictest0-21swapper/109:20:011
18261991510,4cyclictest0-21swapper/109:03:401
1826199151,7cyclictest0-21swapper/110:14:401
1826199151,3cyclictest0-21swapper/110:55:481
1826199150,9cyclictest28575-21grep07:25:151
1826199150,9cyclictest1198-21taskset11:43:351
1826199150,4cyclictest0-21swapper/108:14:041
1826199150,14cyclictest0-21swapper/112:31:041
1826199150,14cyclictest0-21swapper/111:14:191
1826199150,14cyclictest0-21swapper/109:30:521
1826199150,11cyclictest0-21swapper/111:38:171
1826199150,1cyclictest0-21swapper/111:05:061
1826199150,1cyclictest0-21swapper/110:28:301
1826199150,1cyclictest0-21swapper/110:09:241
1826199150,1cyclictest0-21swapper/109:43:301
1826199150,1cyclictest0-21swapper/109:16:371
1826199150,1cyclictest0-21swapper/107:35:261
18256991510,3cyclictest0-21swapper/012:29:480
1825699151,13cyclictest0-21swapper/011:26:160
1825699150,8cyclictest0-21swapper/012:12:180
1825699150,8cyclictest0-21swapper/008:40:010
1825699150,14cyclictest0-21swapper/010:45:060
1825699150,14cyclictest0-21swapper/010:42:590
1552952150,10pltrace19320-21tr09:40:182
1049352150,10pltrace14931-21ssh10:11:280
1018152150,6pltrace0-21swapper/310:45:123
978352140,1pltrace0-21swapper/011:20:000
927952140,9pltrace54-21ksoftirqd/411:56:284
927952140,9pltrace54-21ksoftirqd/411:56:284
927952140,1pltrace0-21swapper/011:55:140
927952140,1pltrace0-21swapper/011:55:140
698352140,1pltrace0-21swapper/008:45:140
698352140,1pltrace0-21swapper/008:45:140
569552140,2pltrace0-21swapper/710:36:327
520352140,5pltrace0-21swapper/509:30:115
3273552140,0pltrace0-21swapper/707:31:407
3271952140,6pltrace0-21swapper/511:44:455
3179052140,8pltrace1253-21ssh12:19:570
3179052140,1pltrace0-21swapper/712:20:017
2823452140,6pltrace0-21swapper/208:25:132
2323752140,7pltrace23801-21ssh11:32:510
2272052140,10pltrace23560-21ssh12:08:310
2073852140,5pltrace0-21swapper/607:15:156
18287991413,1cyclictest0-21swapper/712:39:107
1828799140,14cyclictest0-21swapper/712:07:557
1828799140,1cyclictest0-21swapper/711:42:497
1828299148,5cyclictest0-21swapper/607:31:016
1828299140,7cyclictest0-21swapper/611:11:466
1828299140,7cyclictest0-21swapper/610:55:426
1828299140,6cyclictest0-21swapper/612:09:126
1828299140,3cyclictest30334-21ssh10:29:246
1828299140,3cyclictest0-21swapper/609:11:486
1828299140,12cyclictest0-21swapper/608:20:066
18279991413,1cyclictest0-21swapper/512:26:435
18279991413,1cyclictest0-21swapper/512:07:465
1827999140,14cyclictest0-21swapper/511:52:435
1827999140,14cyclictest0-21swapper/511:52:425
1827999140,14cyclictest0-21swapper/509:21:485
1827999140,1cyclictest0-21swapper/510:06:115
1827999140,1cyclictest0-21swapper/509:41:335
1827699148,5cyclictest0-21swapper/409:00:084
18276991412,1cyclictest0-21swapper/409:55:304
1827699140,14cyclictest0-21swapper/409:33:584
1827699140,1cyclictest0-21swapper/410:43:354
1827199140,13cyclictest0-21swapper/311:08:063
1827199140,13cyclictest0-21swapper/309:52:483
1827199140,13cyclictest0-21swapper/309:30:283
1827199140,1cyclictest0-21swapper/312:21:063
1826799148,3cyclictest0-21swapper/211:13:432
1826799141,12cyclictest0-21swapper/209:13:112
1826799140,7cyclictest0-21swapper/209:45:582
1826799140,6cyclictest0-21swapper/210:41:422
1826799140,13cyclictest0-21swapper/211:38:492
1826799140,13cyclictest0-21swapper/209:56:112
1826799140,13cyclictest0-21swapper/208:37:262
1826199143,9cyclictest26755-21cut08:20:131
1826199141,8cyclictest0-21swapper/112:38:441
1826199141,12cyclictest0-21swapper/107:55:011
1826199140,3cyclictest0-21swapper/112:24:391
1826199140,3cyclictest0-21swapper/107:47:101
1826199140,12cyclictest25346-21cut12:10:141
1826199140,12cyclictest17060-21cut10:15:101
1826199140,1cyclictest0-21swapper/108:57:111
1826199140,1cyclictest0-21swapper/108:33:431
1825699148,5cyclictest0-21swapper/011:45:050
18256991410,3cyclictest0-21swapper/009:00:010
1825699140,1cyclictest0-21swapper/009:10:420
1495752140,7pltrace0-21swapper/710:11:357
1018152140,9pltrace13251-21grep10:45:155
927952130,5pltrace0-21swapper/211:56:132
927952130,5pltrace0-21swapper/211:56:132
882852130,6pltrace12892-21ssh12:30:315
869152130,8pltrace8792-21taskset07:47:510
77752130,5pltrace0-21swapper/511:08:575
698352130,10pltrace54-21ksoftirqd/408:45:164
698352130,10pltrace54-21ksoftirqd/408:45:164
3271952130,1pltrace0-21swapper/011:43:560
2823452130,3pltrace29747-21fschecks_time08:25:125
2715752130,3pltrace0-21swapper/507:26:145
2436752130,0pltrace0-21swapper/707:17:567
2272052130,5pltrace0-21swapper/212:08:372
2265852130,7pltrace0-21swapper/008:13:350
2073852130,2pltrace21210-21munin-node07:15:222
2052252130,0pltrace0-21swapper/709:43:057
1963852130,1pltrace0-21swapper/010:20:150
18287991312,1cyclictest0-21swapper/711:49:477
18287991312,1cyclictest0-21swapper/708:41:297
18287991312,1cyclictest0-21swapper/708:41:297
18287991311,1cyclictest0-21swapper/711:00:347
1828799130,13cyclictest0-21swapper/708:30:287
1828799130,1cyclictest0-21swapper/708:24:587
1828299139,3cyclictest13188-21/usr/sbin/munin11:55:226
1828299139,3cyclictest13188-21/usr/sbin/munin11:55:226
18279991312,1cyclictest0-21swapper/511:48:215
18279991312,1cyclictest0-21swapper/511:30:035
18279991312,1cyclictest0-21swapper/511:24:235
18279991312,1cyclictest0-21swapper/510:24:295
18279991312,1cyclictest0-21swapper/509:15:295
18279991311,1cyclictest0-21swapper/512:18:475
1827999130,13cyclictest0-21swapper/510:58:185
1827999130,13cyclictest0-21swapper/510:16:235
1827999130,1cyclictest0-21swapper/512:01:085
18276991312,1cyclictest0-21swapper/412:27:224
18276991312,1cyclictest0-21swapper/411:49:484
18276991312,1cyclictest0-21swapper/411:39:464
18276991312,1cyclictest0-21swapper/410:09:354
18276991312,1cyclictest0-21swapper/408:20:194
18276991311,1cyclictest0-21swapper/409:25:334
18276991311,1cyclictest0-21swapper/409:23:264
1827699130,13cyclictest0-21swapper/409:50:484
1827699130,12cyclictest0-21swapper/407:20:104
1827199138,4cyclictest0-21swapper/310:07:263
18271991312,1cyclictest0-21swapper/312:30:193
18271991312,1cyclictest0-21swapper/312:01:113
18271991312,1cyclictest0-21swapper/310:43:003
18271991312,1cyclictest0-21swapper/310:20:293
18271991312,1cyclictest0-21swapper/310:00:543
18271991312,1cyclictest0-21swapper/307:45:143
18271991310,2cyclictest0-21swapper/308:50:423
18271991310,2cyclictest0-21swapper/308:50:423
1827199130,13cyclictest0-21swapper/311:16:013
1827199130,13cyclictest0-21swapper/309:26:153
1827199130,13cyclictest0-21swapper/309:10:143
1827199130,12cyclictest0-21swapper/309:03:003
1826799137,5cyclictest0-21swapper/207:56:512
18267991310,1cyclictest0-21swapper/212:03:162
1826799130,12cyclictest0-21swapper/209:22:542
1826799130,12cyclictest0-21swapper/207:43:002
1826799130,1cyclictest0-21swapper/212:16:422
1826199133,8cyclictest26473-21tr11:00:121
1826199131,10cyclictest26356-21needreboot07:20:171
1826199131,10cyclictest11569-21expr11:55:131
1826199131,10cyclictest11569-21expr11:55:131
1826199130,12cyclictest0-21swapper/108:05:151
1826199130,11cyclictest7993-21grep11:15:141
1826199130,11cyclictest4371-21cut07:40:141
1826199130,11cyclictest3333-21cut09:25:131
1826199130,11cyclictest32234-21fschecks_time09:55:141
1826199130,11cyclictest30924-21sed12:15:231
1826199130,11cyclictest24410-21uname08:15:171
1826199130,11cyclictest2437-21cut11:45:111
1826199130,11cyclictest22611-21cat11:30:211
1826199130,11cyclictest22485-21expr10:20:131
1826199130,11cyclictest19132-21cpuspeed_turbos09:05:131
1826199130,11cyclictest17926-21cat10:50:181
1826199130,11cyclictest14549-21sed09:35:231
1826199130,11cyclictest12547-21expr10:45:131
1826199130,11cyclictest12339-21grep11:20:141
1825699138,3cyclictest0-21swapper/008:41:320
1825699138,3cyclictest0-21swapper/008:41:320
18256991312,1cyclictest0-21swapper/011:54:230
18256991312,1cyclictest0-21swapper/011:54:230
18256991312,1cyclictest0-21swapper/011:00:480
18256991312,1cyclictest0-21swapper/009:58:470
18256991312,1cyclictest0-21swapper/009:49:240
18256991310,2cyclictest1063-17auditd10:10:000
18256991310,2cyclictest0-21swapper/009:03:360
1825699130,13cyclictest0-21swapper/012:37:370
1825699130,13cyclictest0-21swapper/010:28:150
1825699130,12cyclictest0-21swapper/008:54:210
1825699130,12cyclictest0-21swapper/008:54:210
1776252130,1pltrace0-21swapper/212:40:012
1552952130,5pltrace0-21swapper/609:40:216
1426552130,4pltrace0-21swapper/707:59:597
119452130,5pltrace0-21swapper/310:33:403
1018152130,6pltrace0-21swapper/610:45:226
927952120,8pltrace78-21ksoftirqd/711:52:057
927952120,8pltrace78-21ksoftirqd/711:52:057
520352120,2pltrace7375-21latency_hist09:30:005
3271952120,6pltrace0-21swapper/211:44:502
2866352120,5pltrace0-21swapper/209:19:532
2866352120,5pltrace0-21swapper/009:19:530
2823452120,2pltrace29270-21expr08:25:127
2823452120,2pltrace28519-21idleruntime-cro08:25:010
2715752120,6pltrace0-21swapper/007:26:170
2715752120,2pltrace0-21swapper/707:23:047
2323752120,4pltrace0-21swapper/611:33:026
2073852120,6pltrace0-21swapper/007:14:080
2073852120,0pltrace0-21swapper/707:12:597
1828799123,8cyclictest4034-21expr07:40:127
18287991211,1cyclictest0-21swapper/709:18:047
18287991211,1cyclictest0-21swapper/708:15:357
1828799120,12cyclictest0-21swapper/709:03:117
1828799120,1cyclictest0-21swapper/707:51:377
1828299129,2cyclictest1146-21snmpd12:38:406
1828299129,2cyclictest1146-21snmpd07:40:296
1828299126,5cyclictest0-21swapper/608:33:216
1828299122,8cyclictest0-21swapper/607:26:106
1828299120,11cyclictest0-21swapper/610:35:136
1828299120,11cyclictest0-21swapper/610:13:426
1828299120,11cyclictest0-21swapper/610:09:126
1828299120,1cyclictest0-21swapper/610:40:246
1828299120,1cyclictest0-21swapper/609:58:586
1828299120,1cyclictest0-21swapper/609:35:226
1827999128,2cyclictest0-21swapper/511:35:445
18279991211,1cyclictest0-21swapper/510:50:025
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional