You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-21 - 21:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Jul 21, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
26834521200,116pltrace0-21swapper/307:05:173
251392890,1sleep60-21swapper/607:55:186
2683452880,82pltrace0-21swapper/707:05:167
2962252810,56pltrace0-21swapper/207:09:362
2683452810,73pltrace0-21swapper/607:05:256
2952827143,10sleep00-21swapper/007:07:070
2952027044,10sleep10-21swapper/107:06:591
2735326855,9sleep50-21swapper/507:05:105
2735226242,5sleep40-21swapper/407:05:094
2998599430,42cyclictest0-21swapper/712:20:007
1526152380,0pltrace0-21swapper/711:16:567
1473852380,6pltrace78-21ksoftirqd/711:52:077
1223752370,6pltrace78-21ksoftirqd/710:00:427
1526152360,5pltrace78-21ksoftirqd/711:14:207
1027352350,9pltrace78-21ksoftirqd/711:45:177
2974052340,8pltrace78-21ksoftirqd/710:56:117
1995552340,8pltrace78-21ksoftirqd/711:21:187
1670952340,8pltrace78-21ksoftirqd/710:07:507
1183052330,8pltrace78-21ksoftirqd/710:33:457
2758052320,6pltrace78-21ksoftirqd/712:39:137
2430852300,2pltrace0-21swapper/708:55:157
2974052280,1pltrace0-21swapper/710:53:177
2525652280,2pltrace0-21swapper/710:48:387
633352270,6pltrace0-21swapper/711:06:077
2997999251,23cyclictest0-21swapper/507:27:345
2470752250,0pltrace0-21swapper/711:25:537
29979992318,1cyclictest633352pltrace11:05:015
2997999230,22cyclictest0-21swapper/509:23:205
2997499230,16cyclictest0-21swapper/412:26:014
2996299230,12cyclictest0-21swapper/107:41:581
2043352200,0pltrace0-21swapper/707:50:137
1486052200,8pltrace0-21swapper/607:43:026
134712200,0sleep00-21swapper/009:23:260
29965991814,3cyclictest0-21swapper/212:18:512
2996599180,15cyclictest8306-21ssh09:54:262
1223752180,2pltrace0-21swapper/709:59:127
3161752170,3pltrace32759-21expr08:10:140
2998599171,4cyclictest0-21swapper/709:02:207
2998599170,16cyclictest0-21swapper/707:11:297
2998599170,13cyclictest0-21swapper/711:57:537
2998599170,13cyclictest0-21swapper/711:57:527
29983991713,3cyclictest1134-21rsyslogd10:50:006
29979991711,5cyclictest0-21swapper/509:41:095
2997999171,8cyclictest0-21swapper/507:33:495
2997999171,4cyclictest0-21swapper/509:37:175
29974991711,5cyclictest0-21swapper/409:14:104
2997099171,8cyclictest0-21swapper/310:13:333
29965991711,5cyclictest0-21swapper/207:33:592
2996599170,9cyclictest0-21swapper/210:49:552
2116552170,0pltrace78-21ksoftirqd/710:10:037
856952160,2pltrace0-21swapper/209:22:382
392152160,0pltrace0-21swapper/709:16:517
3265552160,1pltrace0-21swapper/312:11:023
29985991614,1cyclictest0-21swapper/709:46:487
29983991610,5cyclictest0-21swapper/610:30:466
29979991611,3cyclictest0-21swapper/508:43:135
29979991611,3cyclictest0-21swapper/508:43:135
2997999161,8cyclictest0-21swapper/508:39:595
2997999161,4cyclictest0-21swapper/512:09:435
2997999160,2cyclictest0-21swapper/512:11:065
2997999160,2cyclictest0-21swapper/510:01:345
29974991612,3cyclictest0-21swapper/410:04:024
2997499161,8cyclictest0-21swapper/412:16:404
2997499161,8cyclictest0-21swapper/411:30:244
2997499161,7cyclictest0-21swapper/409:55:154
2997499161,14cyclictest0-21swapper/408:39:524
2997499160,8cyclictest0-21swapper/411:53:124
2997499160,15cyclictest0-21swapper/410:37:554
2997099161,8cyclictest0-21swapper/307:33:343
2997099160,2cyclictest0-21swapper/308:05:143
2997099160,15cyclictest0-21swapper/310:04:323
29965991610,5cyclictest0-21swapper/211:35:112
2996599161,8cyclictest0-21swapper/208:51:172
2996599161,8cyclictest0-21swapper/208:51:172
2996599160,2cyclictest14131-21irqstats_LOC10:35:142
2996599160,15cyclictest0-21swapper/207:54:062
29962991611,3cyclictest0-21swapper/108:58:411
2996299161,7cyclictest0-21swapper/111:23:081
2996299160,4cyclictest0-21swapper/107:58:241
2996299160,2cyclictest3500-21ssh09:48:391
2996299160,15cyclictest0-21swapper/111:08:551
2996299160,15cyclictest0-21swapper/110:36:121
2996299160,15cyclictest0-21swapper/110:16:591
2996299160,15cyclictest0-21swapper/109:29:571
29957991611,3cyclictest0-21swapper/011:49:560
2995799160,8cyclictest0-21swapper/011:38:170
2995799160,8cyclictest0-21swapper/010:15:040
2995799160,4cyclictest0-21swapper/007:31:200
2995799160,15cyclictest0-21swapper/012:36:180
2881952160,6pltrace0-21swapper/608:04:026
650352150,3pltrace54-21ksoftirqd/407:23:274
29985991513,1cyclictest0-21swapper/712:00:577
29985991513,1cyclictest0-21swapper/712:00:577
29985991510,4cyclictest0-21swapper/707:45:337
2998599150,14cyclictest0-21swapper/710:19:437
2998399150,8cyclictest0-21swapper/609:52:026
2998399150,14cyclictest0-21swapper/610:12:286
2998399150,14cyclictest0-21swapper/608:59:536
2998399150,14cyclictest0-21swapper/608:34:216
2998399150,14cyclictest0-21swapper/608:07:146
2998399150,13cyclictest0-21swapper/607:38:256
29979991513,1cyclictest0-21swapper/509:28:125
29979991510,4cyclictest0-21swapper/511:25:155
29979991510,3cyclictest0-21swapper/512:33:225
2997999151,8cyclictest0-21swapper/508:25:185
2997999151,6cyclictest0-21swapper/510:35:465
2997999150,7cyclictest0-21swapper/512:27:075
2997999150,7cyclictest0-21swapper/509:30:475
2997999150,14cyclictest0-21swapper/511:47:095
2997999150,14cyclictest0-21swapper/511:19:275
2997999150,14cyclictest0-21swapper/510:57:355
2997999150,14cyclictest0-21swapper/509:16:495
2997499157,7cyclictest1146-21snmpd12:09:164
2997499156,4cyclictest9394-21timerwakeupswit11:05:234
29974991512,2cyclictest28564-21/usr/sbin/munin10:50:224
29974991510,3cyclictest0-21swapper/409:38:414
2997499151,3cyclictest0-21swapper/408:29:094
2997499150,7cyclictest0-21swapper/412:36:554
2997499150,7cyclictest0-21swapper/410:59:354
2997499150,4cyclictest0-21swapper/411:04:054
2997499150,14cyclictest0-21swapper/409:16:374
2997499150,14cyclictest0-21swapper/408:50:054
2997499150,14cyclictest0-21swapper/408:50:054
2997499150,14cyclictest0-21swapper/408:08:094
29970991511,3cyclictest19663-21proc_pri07:45:203
29970991510,4cyclictest0-21swapper/307:27:193
29970991510,3cyclictest0-21swapper/311:05:343
2997099150,8cyclictest0-21swapper/310:29:453
2997099150,8cyclictest0-21swapper/308:51:463
2997099150,8cyclictest0-21swapper/308:51:463
2997099150,7cyclictest0-21swapper/310:16:243
2997099150,7cyclictest0-21swapper/309:43:013
2997099150,2cyclictest0-21swapper/310:09:153
2997099150,14cyclictest0-21swapper/311:32:383
2997099150,14cyclictest0-21swapper/309:34:173
2997099150,14cyclictest0-21swapper/308:20:243
2996599159,5cyclictest0-21swapper/212:10:572
2996599150,8cyclictest0-21swapper/208:17:592
2996599150,4cyclictest0-21swapper/208:15:012
2996599150,14cyclictest0-21swapper/211:13:492
2996599150,14cyclictest0-21swapper/209:59:292
29962991510,3cyclictest0-21swapper/110:32:271
2996299151,6cyclictest0-21swapper/111:57:111
2996299151,6cyclictest0-21swapper/111:57:111
2996299150,8cyclictest0-21swapper/107:31:021
2996299150,8cyclictest0-21swapper/107:20:201
2996299150,7cyclictest0-21swapper/109:13:321
2995799159,5cyclictest0-21swapper/008:46:350
2995799159,5cyclictest0-21swapper/008:46:350
29957991512,2cyclictest0-21swapper/010:02:020
2995799150,8cyclictest19722-21ssh11:17:460
2995799150,14cyclictest0-21swapper/011:51:590
2995799150,14cyclictest0-21swapper/009:29:210
2995799150,13cyclictest0-21swapper/012:05:140
2995799150,13cyclictest0-21swapper/010:48:350
2116552150,11pltrace54-21ksoftirqd/410:09:264
1995552150,1pltrace0-21swapper/611:21:436
1781152150,11pltrace54-21ksoftirqd/409:32:124
392152140,2pltrace7860-21ssh09:16:522
371252140,10pltrace78-21ksoftirqd/707:20:567
2998599140,13cyclictest0-21swapper/709:13:007
2998599140,1cyclictest0-21swapper/712:18:467
2998399149,3cyclictest0-21swapper/609:04:416
2998399140,8cyclictest0-21swapper/609:56:026
2998399140,7cyclictest0-21swapper/610:07:326
2998399140,6cyclictest0-21swapper/612:24:196
2998399140,13cyclictest0-21swapper/609:29:276
2998399140,1cyclictest0-21swapper/608:20:186
29979991413,1cyclictest0-21swapper/511:53:275
29979991413,1cyclictest0-21swapper/510:44:285
2997999140,7cyclictest0-21swapper/507:16:255
2997999140,13cyclictest0-21swapper/512:16:075
2997999140,13cyclictest0-21swapper/510:11:175
2997999140,1cyclictest0-21swapper/512:00:445
2997999140,1cyclictest0-21swapper/512:00:445
2997999140,1cyclictest0-21swapper/510:54:315
2997999140,1cyclictest0-21swapper/510:34:165
2997999140,1cyclictest0-21swapper/510:26:015
2997999140,1cyclictest0-21swapper/509:49:455
2997499149,4cyclictest0-21swapper/411:26:104
2997499149,4cyclictest0-21swapper/409:09:594
2997499148,5cyclictest0-21swapper/411:36:324
2997499146,7cyclictest1146-21snmpd09:27:324
2997499145,8cyclictest1146-21snmpd09:48:024
2997499145,3cyclictest22296-21chrt10:10:014
2997499140,4cyclictest1146-21snmpd07:37:434
2997499140,13cyclictest0-21swapper/409:20:114
2997499140,11cyclictest0-21swapper/407:26:224
29970991413,1cyclictest0-21swapper/312:26:533
29970991413,1cyclictest0-21swapper/311:00:343
29970991413,1cyclictest0-21swapper/310:52:293
29970991410,3cyclictest1065-17sedispatch09:55:003
2997099140,7cyclictest0-21swapper/307:22:073
2997099140,7cyclictest0-21swapper/307:17:073
2997099140,3cyclictest0-21swapper/310:31:333
2997099140,14cyclictest0-21swapper/309:10:093
2997099140,13cyclictest0-21swapper/312:33:503
2997099140,13cyclictest0-21swapper/312:03:083
2997099140,13cyclictest0-21swapper/312:03:083
2997099140,1cyclictest0-21swapper/311:17:053
2997099140,1cyclictest0-21swapper/309:26:593
2996599149,3cyclictest0-21swapper/207:19:352
29965991412,1cyclictest0-21swapper/210:59:022
29965991412,1cyclictest0-21swapper/210:10:182
2996599140,7cyclictest0-21swapper/208:47:442
2996599140,7cyclictest0-21swapper/208:47:442
2996599140,13cyclictest0-21swapper/212:08:492
2996599140,13cyclictest0-21swapper/209:40:312
2996599140,1cyclictest0-21swapper/212:04:372
2996599140,1cyclictest0-21swapper/212:04:372
2996599140,1cyclictest0-21swapper/211:54:152
2996599140,1cyclictest0-21swapper/211:26:142
2996599140,1cyclictest0-21swapper/209:11:032
2996299146,5cyclictest0-21swapper/112:08:031
29962991413,1cyclictest0-21swapper/111:40:121
29962991413,1cyclictest0-21swapper/111:15:161
29962991413,1cyclictest0-21swapper/110:07:071
29962991413,1cyclictest0-21swapper/109:53:501
2996299140,8cyclictest0-21swapper/112:00:051
2996299140,8cyclictest0-21swapper/112:00:051
2996299140,7cyclictest0-21swapper/110:41:331
2996299140,3cyclictest0-21swapper/107:29:441
2996299140,13cyclictest0-21swapper/112:30:431
2996299140,13cyclictest0-21swapper/111:11:041
2996299140,13cyclictest0-21swapper/108:12:201
2996299140,13cyclictest0-21swapper/107:15:411
2996299140,1cyclictest0-21swapper/110:49:321
2996299140,1cyclictest0-21swapper/109:41:131
2996299140,1cyclictest0-21swapper/109:35:141
2995799149,3cyclictest0-21swapper/007:36:200
29957991413,1cyclictest0-21swapper/012:32:050
29957991413,1cyclictest0-21swapper/011:58:340
29957991413,1cyclictest0-21swapper/011:58:340
2995799140,8cyclictest0-21swapper/010:06:520
2995799140,14cyclictest0-21swapper/012:22:030
2995799140,14cyclictest0-21swapper/012:18:580
2995799140,13cyclictest0-21swapper/010:28:090
2995799140,12cyclictest0-21swapper/008:20:130
2995799140,1cyclictest0-21swapper/012:13:570
2995799140,1cyclictest0-21swapper/009:17:100
2116552140,10pltrace21677-21ssh10:09:255
3265552130,1pltrace78-21ksoftirqd/712:11:037
2998599139,3cyclictest11414-21getsmi07:30:227
2998599136,6cyclictest0-21swapper/709:25:177
29985991312,1cyclictest0-21swapper/711:38:277
29985991312,1cyclictest0-21swapper/711:00:347
29985991312,1cyclictest0-21swapper/708:18:107
2998599130,13cyclictest0-21swapper/710:28:217
2998599130,13cyclictest0-21swapper/709:43:597
2998599130,1cyclictest0-21swapper/710:43:537
2998599130,1cyclictest0-21swapper/709:22:567
29983991312,1cyclictest0-21swapper/612:25:166
29983991312,1cyclictest0-21swapper/612:15:336
29983991312,1cyclictest0-21swapper/612:13:376
29983991312,1cyclictest0-21swapper/609:42:336
2998399130,13cyclictest0-21swapper/610:28:526
2998399130,13cyclictest0-21swapper/609:14:436
2998399130,12cyclictest0-21swapper/608:19:216
2998399130,12cyclictest0-21swapper/607:13:496
2998399130,1cyclictest0-21swapper/610:58:496
2998399130,1cyclictest0-21swapper/610:36:486
2998399130,1cyclictest0-21swapper/610:00:516
2998399130,1cyclictest0-21swapper/609:49:416
29979991311,1cyclictest0-21swapper/511:20:355
2997999130,13cyclictest0-21swapper/509:52:205
2997999130,13cyclictest0-21swapper/509:11:025
2997999130,12cyclictest0-21swapper/510:15:215
2997999130,12cyclictest0-21swapper/508:21:545
2997999130,1cyclictest0-21swapper/512:21:085
2997499136,6cyclictest1146-21snmpd10:45:094
2997499134,3cyclictest0-21swapper/410:42:154
2997499134,2cyclictest131872chrt08:33:304
2997499131,11cyclictest0-21swapper/412:24:004
2997499130,5cyclictest7599-21sshd08:23:184
2997499130,5cyclictest25928-21chrt07:57:164
2997499130,5cyclictest11274-21flock07:30:194
2997499130,4cyclictest3822-21chrt12:11:004
2997499130,4cyclictest32230-21grep07:10:224
2997499130,3cyclictest7601-21sh10:28:464
2997499130,12cyclictest0-21swapper/411:44:054
2997099138,3cyclictest0-21swapper/309:58:263
29970991312,1cyclictest0-21swapper/312:21:523
29970991312,1cyclictest0-21swapper/311:58:233
29970991312,1cyclictest0-21swapper/311:58:233
29970991312,1cyclictest0-21swapper/311:12:533
29970991312,1cyclictest0-21swapper/310:35:383
29970991312,1cyclictest0-21swapper/309:48:513
29970991312,1cyclictest0-21swapper/309:18:253
29970991312,1cyclictest0-21swapper/308:55:253
2997099130,13cyclictest0-21swapper/312:38:513
2997099130,13cyclictest0-21swapper/312:09:523
2997099130,12cyclictest0-21swapper/311:52:333
2997099130,12cyclictest0-21swapper/308:49:553
2997099130,12cyclictest0-21swapper/308:49:553
29965991312,1cyclictest0-21swapper/210:00:362
29965991310,2cyclictest0-21swapper/210:21:322
2996599130,13cyclictest0-21swapper/212:31:392
2996599130,13cyclictest0-21swapper/211:16:222
2996599130,13cyclictest0-21swapper/210:50:572
2996599130,12cyclictest0-21swapper/211:42:032
2996599130,12cyclictest0-21swapper/210:15:332
29962991312,1cyclictest0-21swapper/111:39:041
29962991312,1cyclictest0-21swapper/110:55:411
29962991312,1cyclictest0-21swapper/110:52:361
29962991312,1cyclictest0-21swapper/110:00:281
29962991312,1cyclictest0-21swapper/108:30:191
29962991312,1cyclictest0-21swapper/108:08:471
2996299130,13cyclictest0-21swapper/112:25:421
2996299130,13cyclictest0-21swapper/111:54:561
2995799138,3cyclictest0-21swapper/008:25:220
29957991312,1cyclictest0-21swapper/009:50:310
29957991312,1cyclictest0-21swapper/009:38:130
29957991312,1cyclictest0-21swapper/009:10:410
29957991312,1cyclictest0-21swapper/008:00:250
2995799130,13cyclictest0-21swapper/011:05:470
2995799130,13cyclictest0-21swapper/010:42:390
2995799130,13cyclictest0-21swapper/010:10:360
2995799130,12cyclictest0-21swapper/008:36:320
1872952130,4pltrace0-21swapper/508:46:075
1872952130,4pltrace0-21swapper/508:46:075
1781152130,1pltrace21942-21ssh09:32:246
371252120,4pltrace0-21swapper/507:21:095
2998599129,2cyclictest29339-21/usr/sbin/munin08:05:147
2998599126,5cyclictest0-21swapper/709:34:347
2998399126,4cyclictest0-21swapper/608:28:186
2998399126,3cyclictest0-21swapper/611:36:036
2998399123,8cyclictest0-21swapper/607:50:576
29983991211,1cyclictest0-21swapper/611:50:286
29983991211,1cyclictest0-21swapper/611:09:406
29983991210,1cyclictest32461-21ssh12:07:476
2998399120,12cyclictest0-21swapper/611:28:276
2998399120,12cyclictest0-21swapper/611:04:396
2998399120,11cyclictest0-21swapper/607:25:056
2998399120,1cyclictest0-21swapper/611:11:366
2997999127,4cyclictest0-21swapper/507:41:415
2997999127,3cyclictest0-21swapper/511:11:355
29979991211,1cyclictest0-21swapper/511:57:395
29979991211,1cyclictest0-21swapper/511:57:395
29979991211,1cyclictest0-21swapper/510:23:455
29979991211,1cyclictest0-21swapper/507:36:195
29979991210,1cyclictest0-21swapper/509:04:345
2997999120,11cyclictest0-21swapper/508:08:235
2997999120,1cyclictest0-21swapper/509:06:405
2997999120,1cyclictest0-21swapper/508:57:075
2997499125,2cyclictest24170-21ssh11:21:554
2997499123,3cyclictest793-21timerandwakeup07:15:004
2997499122,4cyclictest29111-21latency09:40:154
2997499122,4cyclictest18475-21grep07:45:134
2997499122,4cyclictest16672-21cut08:40:124
2997499122,4cyclictest16672-21cut08:40:124
2997499122,4cyclictest16338-21grep07:40:154
2997499121,3cyclictest27241-21latency_hist09:00:004
2997499121,3cyclictest0-21swapper/411:45:224
2997499120,5cyclictest4217-21switchtime08:15:214
2997499120,5cyclictest29125-21processes09:00:194
2997499120,5cyclictest28199-21cut10:15:174
2997499120,5cyclictest26773-21tr08:00:134
2997499120,5cyclictest25595-21cut12:00:144
2997499120,5cyclictest25595-21cut12:00:144
2997499120,5cyclictest21061-21tr07:50:104
2997499120,5cyclictest20317-21if_eth008:45:154
2997499120,5cyclictest20317-21if_eth008:45:154
2997499120,5cyclictest20280-21expr12:30:144
2997499120,5cyclictest16428-21chrt11:15:084
2997499120,5cyclictest14003-21grep11:10:234
2997499120,4cyclictest790-21sed10:20:154
2997499120,4cyclictest5461-21expr09:50:144
2997499120,4cyclictest32575-21cstates08:10:124
2997499120,4cyclictest21396-21http_loadtime11:55:164
2997499120,4cyclictest21396-21http_loadtime11:55:164
2997099127,3cyclictest0-21swapper/308:39:223
29970991211,1cyclictest0-21swapper/312:16:513
29970991211,1cyclictest0-21swapper/310:47:273
2996599127,2cyclictest0-21swapper/208:26:582
2996599122,8cyclictest0-21swapper/211:58:082
2996599122,8cyclictest0-21swapper/211:58:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional