You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 16:57
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Sun Jul 05, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30914521430,134pltrace0-21swapper/307:08:263
30914521260,118pltrace0-21swapper/507:09:475
30914521240,116pltrace0-21swapper/207:09:042
28128521210,117pltrace0-21swapper/707:05:137
30914521110,103pltrace0-21swapper/607:08:326
30914521040,100pltrace0-21swapper/107:09:201
3235852600,3pltrace78-21ksoftirqd/712:04:007
2864625844,10sleep40-21swapper/407:05:094
3074825743,10sleep00-21swapper/007:06:010
2766752520,0pltrace0-21swapper/712:37:047
922252500,10pltrace78-21ksoftirqd/709:54:537
922252470,0pltrace0-21swapper/709:57:257
295632460,0sleep50-21swapper/511:25:185
3249552450,7pltrace78-21ksoftirqd/710:54:257
965752440,7pltrace78-21ksoftirqd/711:41:117
2242152420,2pltrace0-21swapper/611:18:106
3260352390,8pltrace78-21ksoftirqd/709:44:027
3260352390,8pltrace78-21ksoftirqd/709:44:027
520452380,7pltrace78-21ksoftirqd/709:13:537
355652370,1pltrace0-21swapper/710:28:027
3176552370,7pltrace78-21ksoftirqd/711:29:567
1442852360,7pltrace78-21ksoftirqd/711:46:507
520452350,6pltrace78-21ksoftirqd/709:15:557
37702350,0sleep00-21swapper/012:06:380
3123599340,1cyclictest0-21swapper/309:15:023
1797352340,3pltrace0-21swapper/711:14:037
2348352330,0pltrace0-21swapper/710:47:497
2252352330,6pltrace78-21ksoftirqd/712:32:187
471752320,2pltrace0-21swapper/709:49:187
2706652320,7pltrace78-21ksoftirqd/710:16:507
934452300,8pltrace0-21swapper/709:22:287
886852300,3pltrace0-21swapper/712:17:387
2450752300,4pltrace0-21swapper/707:55:227
1351452300,5pltrace13516-21tee11:08:106
130862300,1sleep10-21swapper/108:30:131
779252290,3pltrace0-21swapper/707:25:137
265552290,0sleep00-21swapper/011:22:240
1780252290,8pltrace78-21ksoftirqd/709:32:447
1780252290,8pltrace78-21ksoftirqd/709:32:447
886852280,8pltrace78-21ksoftirqd/712:13:157
3176552280,6pltrace78-21ksoftirqd/711:31:457
3150352280,9pltrace78-21ksoftirqd/710:21:037
1780352280,6pltrace78-21ksoftirqd/712:26:167
1780352280,6pltrace78-21ksoftirqd/712:26:167
2798552270,1pltrace0-21swapper/510:48:105
1797352270,10pltrace78-21ksoftirqd/711:17:487
1356952270,0pltrace0-21swapper/710:35:477
1349752260,8pltrace78-21ksoftirqd/709:26:257
1349752260,8pltrace78-21ksoftirqd/709:26:257
1334152260,1pltrace13345-21pltrace-run12:18:102
451952250,0pltrace0-21swapper/711:36:567
3124499240,1cyclictest0-21swapper/511:45:015
3123099230,12cyclictest0-21swapper/207:39:022
1367752230,6pltrace78-21ksoftirqd/710:02:007
164992210,1sleep6681rcuc/611:10:206
84912200,0sleep30-21swapper/310:28:193
500652200,7pltrace0-21swapper/707:21:387
31217992017,2cyclictest211rcuc/010:25:000
2706652200,15pltrace0-21swapper/610:14:116
3150352190,0pltrace0-21swapper/210:18:092
31239991917,1cyclictest4668-21sed10:25:014
2784252190,0pltrace0-21swapper/711:59:587
1614852190,3pltrace0-21swapper/707:38:187
1334152190,3pltrace0-21swapper/712:22:057
3123599180,9cyclictest191rcu_preempt12:25:233
3123599180,9cyclictest191rcu_preempt12:25:233
3123099180,16cyclictest1490-21latency_hist12:40:012
3122399186,11cyclictest0-21swapper/111:19:591
2784252180,12pltrace0-21swapper/211:59:542
1165052180,3pltrace0-21swapper/708:31:537
886552170,2pltrace0-21swapper/708:25:167
31230991711,5cyclictest0-21swapper/211:42:022
31230991711,5cyclictest0-21swapper/208:44:392
3123099171,2cyclictest0-21swapper/209:39:582
3123099171,2cyclictest0-21swapper/209:39:582
3118252170,0pltrace0-21swapper/709:07:297
1614852170,4pltrace0-21swapper/707:40:137
1336352170,4pltrace0-21swapper/707:33:127
3125499161,7cyclictest0-21swapper/708:13:307
3125499160,4cyclictest0-21swapper/710:32:337
31248991611,4cyclictest0-21swapper/610:01:486
31244991611,3cyclictest0-21swapper/512:35:285
31244991611,3cyclictest0-21swapper/508:23:065
3124499161,3cyclictest0-21swapper/508:28:185
3124499161,14cyclictest0-21swapper/507:17:255
3124499160,4cyclictest7879-21ssh12:10:485
3123999167,4cyclictest24391-21cstates12:30:124
31235991610,5cyclictest0-21swapper/308:48:403
3123599160,15cyclictest0-21swapper/311:26:413
31230991611,4cyclictest0-21swapper/208:50:192
31230991611,3cyclictest0-21swapper/207:40:292
3123099160,4cyclictest13570-21ssh09:57:562
31223991611,4cyclictest0-21swapper/111:51:081
31223991610,5cyclictest0-21swapper/112:33:331
3122399160,15cyclictest0-21swapper/112:03:111
2688252160,10pltrace0-21swapper/111:24:371
1891452160,11pltrace19105-21ssh11:48:362
355652150,8pltrace4301-21ssh10:24:552
3235852150,0pltrace0-21swapper/712:05:107
31254991511,3cyclictest0-21swapper/708:21:187
3125499151,7cyclictest0-21swapper/707:10:497
3125499150,8cyclictest0-21swapper/710:08:187
3125499150,14cyclictest0-21swapper/710:55:527
3125499150,14cyclictest0-21swapper/709:36:477
3125499150,14cyclictest0-21swapper/709:36:477
3125499150,14cyclictest0-21swapper/708:48:137
31248991511,3cyclictest0-21swapper/611:59:306
3124899151,13cyclictest0-21swapper/610:46:216
3124899150,8cyclictest0-21swapper/609:42:176
3124899150,8cyclictest0-21swapper/609:42:176
3124899150,13cyclictest0-21swapper/608:04:236
31244991510,3cyclictest0-21swapper/511:10:435
3124499150,8cyclictest0-21swapper/509:15:435
3124499150,8cyclictest0-21swapper/508:09:335
3124499150,8cyclictest0-21swapper/507:47:175
3124499150,7cyclictest0-21swapper/512:22:165
3124499150,7cyclictest0-21swapper/511:07:345
3124499150,7cyclictest0-21swapper/509:33:145
3124499150,7cyclictest0-21swapper/509:33:145
3124499150,7cyclictest0-21swapper/509:04:015
3124499150,3cyclictest0-21swapper/511:52:245
3124499150,2cyclictest0-21swapper/511:15:215
3124499150,14cyclictest0-21swapper/511:04:495
3124499150,14cyclictest0-21swapper/508:43:545
3124499150,13cyclictest0-21swapper/510:50:075
3124499150,13cyclictest0-21swapper/508:54:585
3123999157,4cyclictest25563-21df07:55:124
31239991513,1cyclictest0-21swapper/407:35:014
31235991513,1cyclictest46-21ksoftirqd/310:25:013
31235991511,3cyclictest0-21swapper/308:13:243
3123599150,7cyclictest0-21swapper/310:00:393
3123599150,14cyclictest0-21swapper/310:12:043
3123599150,13cyclictest0-21swapper/310:55:253
3123099150,8cyclictest0-21swapper/209:51:492
3123099150,7cyclictest0-21swapper/211:54:562
3123099150,7cyclictest0-21swapper/208:57:282
3123099150,14cyclictest0-21swapper/212:26:462
3123099150,14cyclictest0-21swapper/212:26:462
3123099150,14cyclictest0-21swapper/210:42:182
3122399159,5cyclictest0-21swapper/112:25:481
3122399159,5cyclictest0-21swapper/112:25:481
3122399151,3cyclictest0-21swapper/109:27:131
3122399151,3cyclictest0-21swapper/109:27:131
3122399150,8cyclictest0-21swapper/108:41:461
3122399150,13cyclictest0-21swapper/107:37:251
2798552150,8pltrace0-21swapper/110:50:001
2558352150,11pltrace0-21swapper/608:57:486
2252352150,11pltrace0-21swapper/212:32:372
1891452150,8pltrace0-21swapper/111:48:321
1814952150,8pltrace18337-21ssh10:03:355
1780252150,9pltrace18411-21ssh09:29:376
1780252150,9pltrace18411-21ssh09:29:376
459152140,3pltrace6042-21tr11:00:131
451952140,6pltrace6455-21cstates11:35:146
451952140,3pltrace8672-21ssh11:36:241
43552140,2pltrace526-21sshd08:09:171
3125499140,3cyclictest0-21swapper/710:11:497
31248991411,2cyclictest1146-21snmpd08:10:576
3124899140,13cyclictest0-21swapper/611:22:506
3124499149,3cyclictest0-21swapper/509:07:555
3124499148,5cyclictest0-21swapper/512:15:045
3124499140,14cyclictest0-21swapper/511:20:295
3124499140,14cyclictest0-21swapper/509:45:465
3124499140,13cyclictest0-21swapper/510:35:215
3124499140,12cyclictest0-21swapper/510:40:255
3124499140,1cyclictest0-21swapper/512:30:065
3124499140,1cyclictest0-21swapper/510:28:215
3124499140,1cyclictest0-21swapper/509:36:135
3124499140,1cyclictest0-21swapper/509:36:135
3124499140,1cyclictest0-21swapper/509:13:035
3123999147,6cyclictest31068-21sed12:00:214
3123999147,2cyclictest25654-21pltrace09:35:184
3123999147,2cyclictest25654-21pltrace09:35:184
31235991413,1cyclictest0-21swapper/311:33:593
3123599140,7cyclictest0-21swapper/310:49:433
3123599140,7cyclictest0-21swapper/308:02:473
3123599140,3cyclictest0-21swapper/308:30:453
3123599140,14cyclictest0-21swapper/309:35:573
3123599140,14cyclictest0-21swapper/309:35:573
3123599140,13cyclictest0-21swapper/310:07:323
3123599140,1cyclictest0-21swapper/308:25:223
3123099148,5cyclictest0-21swapper/210:52:432
31230991412,1cyclictest0-21swapper/211:20:012
3123099140,8cyclictest0-21swapper/207:15:312
3123099140,14cyclictest0-21swapper/212:07:482
3123099140,1cyclictest0-21swapper/209:32:412
3123099140,1cyclictest0-21swapper/209:32:412
3123099140,1cyclictest0-21swapper/209:11:092
3122399140,7cyclictest0-21swapper/110:43:491
3122399140,7cyclictest0-21swapper/109:58:581
3122399140,7cyclictest0-21swapper/109:37:401
3122399140,7cyclictest0-21swapper/109:37:401
3122399140,6cyclictest0-21swapper/111:27:491
3122399140,14cyclictest0-21swapper/111:43:251
3122399140,14cyclictest0-21swapper/110:54:121
3122399140,14cyclictest0-21swapper/110:15:301
3122399140,13cyclictest0-21swapper/110:03:021
3122399140,1cyclictest0-21swapper/111:55:241
3122399140,1cyclictest0-21swapper/110:37:311
3122399140,1cyclictest0-21swapper/109:22:051
3122399140,1cyclictest0-21swapper/108:20:141
2781552140,4pltrace30669-21grep09:40:162
2781552140,4pltrace30669-21grep09:40:162
230752140,0sleep60-21swapper/611:52:276
197242140,0sleep00-21swapper/012:25:130
197242140,0sleep00-21swapper/012:25:130
1722152140,3pltrace1146-21snmpd08:39:422
1356952140,6pltrace0-21swapper/610:37:456
1356952140,2pltrace14630-21idleruntime-cro10:35:016
97592130,0sleep20-21swapper/209:19:192
779252130,5pltrace0-21swapper/507:24:195
779252130,2pltrace0-21swapper/107:23:211
471752130,1pltrace8944-21ssh09:52:326
459152130,5pltrace0-21swapper/611:01:366
451952130,0pltrace0-21swapper/511:36:185
355652130,1pltrace4268-21ssh10:24:516
31254991312,1cyclictest0-21swapper/711:06:097
3125499130,13cyclictest0-21swapper/711:01:087
3124899139,2cyclictest0-21swapper/609:38:176
3124899139,2cyclictest0-21swapper/609:38:176
3124499138,2cyclictest0-21swapper/508:14:485
31244991312,1cyclictest0-21swapper/511:42:015
31244991312,1cyclictest0-21swapper/511:30:025
31244991312,1cyclictest0-21swapper/509:53:225
31244991312,1cyclictest0-21swapper/509:24:535
3124499130,13cyclictest0-21swapper/507:30:255
3124499130,1cyclictest0-21swapper/510:56:415
31239991312,1cyclictest0-21swapper/408:15:104
31239991310,2cyclictest6953-21cstates08:20:124
31239991310,2cyclictest28511-21expr10:15:114
31239991310,2cyclictest2542-21cstates09:10:124
31239991310,2cyclictest15518-21cut09:25:154
31239991310,2cyclictest15518-21cut09:25:154
3123999130,12cyclictest0-21swapper/412:25:094
3123999130,12cyclictest0-21swapper/412:25:094
3123999130,12cyclictest0-21swapper/407:25:184
3123999130,1cyclictest0-21swapper/409:22:514
3123599139,2cyclictest0-21swapper/312:14:373
3123599138,3cyclictest0-21swapper/311:35:233
31235991312,1cyclictest0-21swapper/312:37:083
31235991312,1cyclictest0-21swapper/311:16:013
31235991312,1cyclictest0-21swapper/309:40:103
31235991312,1cyclictest0-21swapper/309:40:103
31235991312,1cyclictest0-21swapper/309:27:133
31235991312,1cyclictest0-21swapper/309:27:133
31235991312,1cyclictest0-21swapper/309:20:353
3123599130,13cyclictest0-21swapper/311:24:263
3123599130,13cyclictest0-21swapper/311:11:483
3123599130,13cyclictest0-21swapper/309:51:593
3123599130,12cyclictest0-21swapper/308:52:553
31230991312,1cyclictest0-21swapper/211:08:312
31230991312,1cyclictest0-21swapper/208:26:182
31230991310,2cyclictest0-21swapper/211:12:442
3123099131,9cyclictest18836-21ssh10:04:482
3123099130,2cyclictest0-21swapper/211:15:202
3123099130,13cyclictest0-21swapper/212:10:522
3123099130,13cyclictest0-21swapper/212:04:432
3123099130,12cyclictest0-21swapper/207:45:262
3122399138,2cyclictest0-21swapper/107:57:161
31223991312,1cyclictest0-21swapper/112:10:471
31223991312,1cyclictest0-21swapper/112:07:421
31223991312,1cyclictest0-21swapper/110:30:531
31223991312,1cyclictest0-21swapper/110:14:221
31223991312,1cyclictest0-21swapper/110:07:341
31223991312,1cyclictest0-21swapper/109:46:411
31223991312,1cyclictest0-21swapper/109:19:301
31223991310,2cyclictest0-21swapper/112:38:471
3122399130,13cyclictest0-21swapper/112:20:011
3122399130,13cyclictest0-21swapper/112:16:561
3122399130,13cyclictest0-21swapper/109:53:101
3122399130,13cyclictest0-21swapper/109:31:001
3122399130,13cyclictest0-21swapper/109:30:591
3122399130,13cyclictest0-21swapper/109:11:441
31217991312,1cyclictest0-21swapper/012:03:210
31217991312,1cyclictest0-21swapper/007:15:180
3121799130,13cyclictest0-21swapper/011:36:000
3121799130,13cyclictest0-21swapper/011:27:050
3121799130,1cyclictest0-21swapper/011:07:200
3121799130,1cyclictest0-21swapper/011:01:300
3121799130,1cyclictest0-21swapper/009:52:030
2706652130,6pltrace1730-21diskmemload10:14:122
2450752130,5pltrace0-21swapper/707:53:487
2279452130,1pltrace0-21swapper/608:49:226
1356952130,2pltrace1146-21snmpd10:37:462
934452120,5pltrace0-21swapper/609:20:016
329552120,3pltrace5053-21missed_timers08:15:166
3125499128,3cyclictest0-21swapper/711:53:547
3125499120,11cyclictest0-21swapper/707:45:047
3124899127,3cyclictest0-21swapper/612:05:126
3124899126,5cyclictest0-21swapper/610:07:426
3124899126,5cyclictest0-21swapper/607:22:166
3124899123,8cyclictest0-21swapper/610:53:046
3124899122,8cyclictest0-21swapper/608:34:426
3124899120,11cyclictest0-21swapper/611:48:186
3124899120,11cyclictest0-21swapper/607:28:196
3124899120,1cyclictest0-21swapper/610:18:076
3124499120,11cyclictest0-21swapper/507:11:385
3123999121,1cyclictest0-21swapper/410:52:564
3123999120,7cyclictest20741-21sed09:30:224
3123999120,7cyclictest20741-21sed09:30:224
3123999120,12cyclictest0-21swapper/411:01:304
3123999120,12cyclictest0-21swapper/408:55:204
3123999120,1cyclictest0-21swapper/412:14:384
3123999120,1cyclictest0-21swapper/410:57:144
3123999120,1cyclictest0-21swapper/409:15:444
3123999120,1cyclictest0-21swapper/408:50:094
3123599129,2cyclictest5958-21expr07:20:133
3123599127,4cyclictest0-21swapper/308:19:393
3123599126,5cyclictest0-21swapper/310:53:433
31235991211,1cyclictest0-21swapper/312:32:553
31235991211,1cyclictest0-21swapper/311:08:443
31235991211,1cyclictest0-21swapper/309:45:313
31235991211,1cyclictest0-21swapper/309:32:533
31235991211,1cyclictest0-21swapper/309:32:533
31235991210,1cyclictest0-21swapper/310:34:443
3123599120,12cyclictest0-21swapper/307:51:123
3123599120,1cyclictest0-21swapper/308:37:313
3123099127,3cyclictest0-21swapper/211:32:222
3123099127,3cyclictest0-21swapper/207:58:412
31230991211,1cyclictest0-21swapper/211:39:362
31230991211,1cyclictest0-21swapper/210:31:472
31230991211,1cyclictest0-21swapper/209:46:262
31230991211,1cyclictest0-21swapper/209:20:232
31230991210,1cyclictest0-21swapper/208:15:182
3122399127,4cyclictest0-21swapper/108:59:211
3122399126,5cyclictest0-21swapper/111:08:181
31223991211,1cyclictest0-21swapper/111:12:391
31223991211,1cyclictest0-21swapper/109:02:191
3122399120,1cyclictest0-21swapper/108:47:261
31217991211,1cyclictest0-21swapper/012:15:000
31217991211,1cyclictest0-21swapper/012:11:070
31217991211,1cyclictest0-21swapper/010:45:290
31217991211,1cyclictest0-21swapper/010:31:420
31217991211,1cyclictest0-21swapper/009:59:200
31217991211,1cyclictest0-21swapper/009:14:190
3121799120,12cyclictest0-21swapper/009:28:530
3121799120,12cyclictest0-21swapper/009:28:530
3121799120,1cyclictest0-21swapper/012:20:490
3091452120,8pltrace32101-21cut07:10:136
2837152120,4pltrace0-21swapper/708:59:247
2837152120,3pltrace1146-21snmpd08:59:205
2798552120,6pltrace0-21swapper/210:50:002
2781552120,5pltrace0-21swapper/509:41:405
2781552120,5pltrace0-21swapper/509:41:405
2259452120,4pltrace24332-21df10:10:125
157852120,4pltrace0-21swapper/309:09:543
965752110,7pltrace12650-21/usr/sbin/munin11:40:183
451952110,2pltrace5097-21diskmemload11:34:126
43552110,2pltrace0-21swapper/708:08:187
3125499116,4cyclictest0-21swapper/709:01:557
3125499115,5cyclictest0-21swapper/711:22:027
3125499110,1cyclictest0-21swapper/708:19:337
3124899117,3cyclictest1146-21snmpd12:19:556
3124899117,3cyclictest1146-21snmpd11:42:096
3124899117,3cyclictest1146-21snmpd07:44:596
31248991110,1cyclictest0-21swapper/612:00:266
3124899110,9cyclictest0-21swapper/612:20:316
3124899110,11cyclictest0-21swapper/612:38:396
3124899110,11cyclictest0-21swapper/609:55:276
3124899110,11cyclictest0-21swapper/608:51:496
3124899110,1cyclictest0-21swapper/612:13:436
3124899110,1cyclictest0-21swapper/610:41:456
3124899110,1cyclictest0-21swapper/608:21:136
3124899110,1cyclictest0-21swapper/607:16:276
3124499119,1cyclictest0-21swapper/507:55:015
3124499112,8cyclictest0-21swapper/512:26:195
3124499112,8cyclictest0-21swapper/512:26:195
31244991110,1cyclictest0-21swapper/512:06:185
31244991110,1cyclictest0-21swapper/512:00:095
31244991110,1cyclictest0-21swapper/511:57:045
31244991110,1cyclictest0-21swapper/510:30:175
31244991110,1cyclictest0-21swapper/508:31:275
3124499110,11cyclictest0-21swapper/508:02:385
3123999119,1cyclictest0-21swapper/409:55:174
3123999118,2cyclictest3438-21latency_hist08:15:004
3123999118,2cyclictest21106-21grep08:45:144
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional