You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 23:33
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack4slot6.osadl.org (updated Tue Jun 23, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27750521390,130pltrace0-21swapper/307:06:213
27750521190,89pltrace0-21swapper/707:06:417
2494352940,90pltrace0-21swapper/207:05:212
2494352900,84pltrace0-21swapper/507:05:225
2494352780,74pltrace0-21swapper/107:05:401
2775052710,63pltrace0-21swapper/607:05:586
68912650,1sleep40-21swapper/407:25:204
2804126046,10sleep00-21swapper/007:09:540
2770925945,10sleep40-21swapper/407:05:324
2995152430,5pltrace78-21ksoftirqd/709:45:187
3250052360,0pltrace0-21swapper/710:57:237
651652330,0pltrace78-21ksoftirqd/709:51:307
2254252330,0pltrace0-21swapper/011:20:510
28214993229,2cyclictest24257-21expr12:00:111
817952300,0pltrace0-21swapper/711:41:527
713852300,0pltrace0-21swapper/712:20:327
28237992918,10cyclictest0-21swapper/608:35:176
1480352270,8pltrace78-21ksoftirqd/709:27:187
357552250,6pltrace78-21ksoftirqd/711:37:387
1457952250,6pltrace78-21ksoftirqd/710:39:417
106052240,6pltrace78-21ksoftirqd/710:22:297
2821499210,5cyclictest0-21swapper/111:37:061
2062952200,5pltrace0-21swapper/712:34:507
2823499190,14cyclictest0-21swapper/510:58:495
2823499190,1cyclictest0-21swapper/509:24:015
2352652190,3pltrace54-21ksoftirqd/410:50:144
1457952190,7pltrace0-21swapper/710:40:077
289182180,0sleep50-21swapper/510:16:025
28234991812,5cyclictest0-21swapper/507:47:315
2822999180,2cyclictest0-21swapper/411:51:214
1991652180,12pltrace0-21swapper/110:09:021
145952180,13pltrace1146-21snmpd09:13:374
1020052180,11pltrace0-21swapper/107:35:211
28237991711,5cyclictest0-21swapper/610:14:426
2823799171,15cyclictest0-21swapper/610:55:116
2823499174,6cyclictest0-21swapper/512:22:445
28234991712,4cyclictest0-21swapper/511:46:595
204352170,11pltrace54-21ksoftirqd/409:46:574
1168452170,12pltrace12649-21ssh12:23:090
1009352170,11pltrace54-21ksoftirqd/410:35:314
28237991611,3cyclictest0-21swapper/611:55:496
2823799160,15cyclictest0-21swapper/612:20:516
2823799160,15cyclictest0-21swapper/608:00:436
2823499167,8cyclictest0-21swapper/509:41:045
2823499167,8cyclictest0-21swapper/509:41:045
28234991612,3cyclictest0-21swapper/511:00:115
28234991612,3cyclictest0-21swapper/507:25:015
28234991611,3cyclictest0-21swapper/510:13:395
2823499160,4cyclictest0-21swapper/508:29:165
2823499160,16cyclictest0-21swapper/511:12:205
28229991611,2cyclictest0-21swapper/407:47:474
2822999161,8cyclictest0-21swapper/408:01:414
28217991612,3cyclictest84-21kauditd08:50:002
28217991611,3cyclictest0-21swapper/208:30:242
28217991610,3cyclictest0-21swapper/212:19:512
2821799161,14cyclictest0-21swapper/207:45:112
2821799160,15cyclictest0-21swapper/209:06:042
2821499161,4cyclictest0-21swapper/111:54:551
2821499161,4cyclictest0-21swapper/107:10:161
2821499161,14cyclictest0-21swapper/108:10:081
2821099160,4cyclictest0-21swapper/007:20:450
1615852160,0pltrace0-21swapper/712:25:527
1020052160,11pltrace54-21ksoftirqd/407:35:134
1020052160,11pltrace0-21swapper/007:35:220
28242991513,1cyclictest0-21swapper/711:32:147
2824299150,1cyclictest0-21swapper/711:58:097
2823799150,8cyclictest0-21swapper/612:39:276
2823799150,8cyclictest0-21swapper/612:39:276
2823799150,8cyclictest0-21swapper/608:16:116
2823799150,4cyclictest0-21swapper/612:29:176
2823799150,14cyclictest0-21swapper/612:18:596
2823799150,14cyclictest0-21swapper/610:15:226
2823799150,14cyclictest0-21swapper/609:09:576
2823799150,14cyclictest0-21swapper/607:12:186
2823499159,5cyclictest0-21swapper/507:11:245
2823499158,6cyclictest0-21swapper/510:40:455
2823499156,2cyclictest0-21swapper/511:53:525
2823499150,8cyclictest0-21swapper/509:15:015
2823499150,7cyclictest0-21swapper/511:05:535
2823499150,4cyclictest0-21swapper/507:43:175
2823499150,14cyclictest0-21swapper/512:19:325
2823499150,14cyclictest0-21swapper/511:20:175
28229991510,4cyclictest0-21swapper/411:19:264
2822999150,4cyclictest0-21swapper/412:03:254
2822999150,4cyclictest0-21swapper/408:29:564
2822999150,2cyclictest0-21swapper/409:15:144
2822999150,14cyclictest54-21ksoftirqd/408:34:354
2822999150,14cyclictest0-21swapper/410:20:554
2822999150,14cyclictest0-21swapper/410:14:374
2822999150,14cyclictest0-21swapper/409:58:264
2822999150,14cyclictest0-21swapper/408:40:294
2822499150,14cyclictest0-21swapper/310:04:513
2821799159,5cyclictest0-21swapper/209:36:412
28217991510,3cyclictest0-21swapper/212:04:312
2821799150,8cyclictest0-21swapper/210:18:162
2821799150,7cyclictest0-21swapper/212:22:212
2821799150,7cyclictest0-21swapper/208:58:182
2821799150,3cyclictest0-21swapper/210:54:202
2821799150,14cyclictest0-21swapper/208:24:362
2821799150,14cyclictest0-21swapper/207:22:132
2821499151,3cyclictest0-21swapper/112:35:591
2821499151,3cyclictest0-21swapper/112:35:591
2821499150,3cyclictest13074-21perl10:35:131
2821499150,14cyclictest0-21swapper/110:26:521
2821499150,14cyclictest0-21swapper/109:19:201
2821499150,14cyclictest0-21swapper/107:52:291
2821099151,13cyclictest0-21swapper/011:11:240
2821099150,14cyclictest0-21swapper/009:22:110
2800352150,11pltrace54-21ksoftirqd/409:02:474
2160652150,9pltrace22685-21ssh11:58:270
2160652150,2pltrace22841-21rm11:58:481
204352150,6pltrace0-21swapper/009:46:530
1963252150,11pltrace54-21ksoftirqd/408:48:354
145952150,10pltrace3036-21ssh09:14:385
1406352150,10pltrace54-21ksoftirqd/408:39:304
1168452150,7pltrace54-21ksoftirqd/412:23:054
570452140,11pltrace54-21ksoftirqd/408:24:104
28242991413,1cyclictest0-21swapper/712:01:237
28242991413,1cyclictest0-21swapper/709:24:497
28242991411,2cyclictest0-21swapper/708:02:587
28242991411,2cyclictest0-21swapper/707:12:277
2824299140,14cyclictest0-21swapper/712:07:037
2824299140,14cyclictest0-21swapper/711:29:397
2824299140,14cyclictest0-21swapper/711:16:527
2824299140,14cyclictest0-21swapper/710:14:227
2824299140,14cyclictest0-21swapper/708:25:137
2824299140,13cyclictest0-21swapper/710:25:227
2824299140,13cyclictest0-21swapper/707:35:027
2824299140,1cyclictest0-21swapper/710:50:187
2824299140,1cyclictest0-21swapper/708:55:217
2823799149,3cyclictest0-21swapper/611:53:526
2823799140,7cyclictest0-21swapper/608:50:476
2823799140,12cyclictest0-21swapper/609:12:006
2823499148,5cyclictest0-21swapper/510:24:485
2823499146,2cyclictest1146-21snmpd12:26:145
2823499146,2cyclictest1146-21snmpd10:03:355
2823499145,3cyclictest1146-21snmpd08:31:565
2823499145,3cyclictest0-21swapper/511:35:165
2823499144,3cyclictest18803-21awk09:30:175
2823499144,3cyclictest1146-21snmpd07:55:225
2823499143,4cyclictest23163-21sed10:45:225
2823499142,4cyclictest26064-21wc08:00:155
28234991413,1cyclictest0-21swapper/509:50:445
28234991412,1cyclictest0-21swapper/509:27:445
2823499141,12cyclictest0-21swapper/511:16:295
2823499140,7cyclictest0-21swapper/507:52:165
2823499140,6cyclictest0-21swapper/508:37:325
2823499140,1cyclictest0-21swapper/511:58:295
2823499140,1cyclictest0-21swapper/511:25:475
2823499140,1cyclictest0-21swapper/509:46:315
2822999149,3cyclictest0-21swapper/411:21:024
2822999149,3cyclictest0-21swapper/407:52:024
28229991413,1cyclictest0-21swapper/410:45:224
28229991413,1cyclictest0-21swapper/409:30:154
28229991412,1cyclictest0-21swapper/411:09:594
2822999140,14cyclictest0-21swapper/411:10:474
2822999140,1cyclictest0-21swapper/411:47:524
2822999140,1cyclictest0-21swapper/411:30:524
2822999140,1cyclictest0-21swapper/410:25:374
28224991413,1cyclictest0-21swapper/312:08:233
28224991413,1cyclictest0-21swapper/311:27:443
28224991413,1cyclictest0-21swapper/309:13:133
28224991412,1cyclictest0-21swapper/308:05:133
2822499140,14cyclictest0-21swapper/312:10:483
2822499140,14cyclictest0-21swapper/311:10:253
2822499140,1cyclictest0-21swapper/310:55:023
2822499140,1cyclictest0-21swapper/310:25:243
2822499140,1cyclictest0-21swapper/310:15:133
2822499140,1cyclictest0-21swapper/309:45:153
2822499140,1cyclictest0-21swapper/309:39:353
28217991411,2cyclictest32616-21if_err_eth009:10:152
2821799140,8cyclictest0-21swapper/211:31:532
2821799140,8cyclictest0-21swapper/207:11:482
2821799140,13cyclictest0-21swapper/212:32:232
2821499149,3cyclictest0-21swapper/108:27:451
2821499148,5cyclictest0-21swapper/109:06:161
2821499141,12cyclictest0-21swapper/109:53:031
2821499140,7cyclictest0-21swapper/110:00:121
2821499140,3cyclictest0-21swapper/109:10:221
2821099149,3cyclictest0-21swapper/010:45:260
28210991412,1cyclictest0-21swapper/007:15:010
28210991410,3cyclictest26101-21missed_timers08:00:160
28210991410,2cyclictest0-21swapper/010:23:490
2821099140,7cyclictest0-21swapper/007:43:350
2821099140,3cyclictest0-21swapper/010:10:550
2254252140,4pltrace24229-21ssh11:24:563
1480352140,6pltrace0-21swapper/309:27:133
1020052140,5pltrace54-21ksoftirqd/407:35:014
1020052140,5pltrace0-21swapper/607:35:166
462752130,4pltrace6675-21netstat07:25:172
3253252130,5pltrace0-21swapper/208:15:442
3148952130,0pltrace0-21swapper/011:31:290
2824299130,1cyclictest0-21swapper/707:45:437
28237991311,1cyclictest0-21swapper/612:02:346
2823799130,12cyclictest0-21swapper/611:36:436
2823799130,1cyclictest0-21swapper/611:43:576
2823499139,3cyclictest0-21swapper/512:01:435
2823499137,5cyclictest0-21swapper/512:11:445
2823499137,5cyclictest0-21swapper/510:35:135
2823499137,5cyclictest0-21swapper/508:19:175
2823499133,4cyclictest8031-21tr10:30:115
2823499133,4cyclictest30915-21expr08:10:125
2823499132,4cyclictest1478-21lldpd09:56:185
2823499132,3cyclictest0-21swapper/512:31:065
28234991312,1cyclictest0-21swapper/510:50:285
2823499130,12cyclictest0-21swapper/508:54:425
2823499130,12cyclictest0-21swapper/508:23:085
2822999138,3cyclictest0-21swapper/412:09:404
2822999138,3cyclictest0-21swapper/408:52:094
2822999137,3cyclictest0-21swapper/412:17:214
2822999137,3cyclictest0-21swapper/410:30:064
28229991312,1cyclictest0-21swapper/411:42:514
28229991312,1cyclictest0-21swapper/411:39:274
28229991312,1cyclictest0-21swapper/411:25:024
28229991310,2cyclictest54-21ksoftirqd/409:41:064
28229991310,2cyclictest54-21ksoftirqd/409:41:064
2822999130,13cyclictest0-21swapper/409:20:324
2822999130,12cyclictest0-21swapper/409:54:204
2822999130,1cyclictest0-21swapper/409:25:044
2822499139,3cyclictest15552-21switchtime12:25:203
28224991312,1cyclictest0-21swapper/311:36:193
28224991312,1cyclictest0-21swapper/311:17:323
28224991312,1cyclictest0-21swapper/311:09:363
28224991312,1cyclictest0-21swapper/310:20:443
28224991310,2cyclictest9464-21ssh11:43:563
2822499130,13cyclictest0-21swapper/310:49:323
2822499130,1cyclictest0-21swapper/310:05:393
2821799130,2cyclictest0-21swapper/209:15:182
2821799130,12cyclictest0-21swapper/211:48:062
2821799130,12cyclictest0-21swapper/210:26:222
2821799130,12cyclictest0-21swapper/209:58:482
2821799130,12cyclictest0-21swapper/209:42:052
2821799130,12cyclictest0-21swapper/209:42:052
2821499138,4cyclictest0-21swapper/112:26:071
2821499137,5cyclictest0-21swapper/109:00:131
2821499130,12cyclictest0-21swapper/110:51:391
2821499130,12cyclictest0-21swapper/110:44:321
2821099139,3cyclictest0-21swapper/010:25:190
28210991310,2cyclictest1065-17sedispatch08:00:000
2254252130,7pltrace0-21swapper/211:25:032
2254252130,2pltrace24528-21latency_hist11:25:002
204352130,5pltrace0-21swapper/109:47:131
1991652130,5pltrace0-21swapper/510:09:055
1963252130,6pltrace0-21swapper/508:48:435
1127652130,8pltrace0-21swapper/608:33:386
1127652130,5pltrace0-21swapper/108:33:211
1020052130,4pltrace0-21swapper/507:35:205
1009352130,8pltrace14527-21rm10:35:460
28242991211,1cyclictest0-21swapper/711:45:507
28242991211,1cyclictest0-21swapper/710:31:327
28242991211,1cyclictest0-21swapper/709:38:457
28242991211,1cyclictest0-21swapper/707:26:277
2824299120,12cyclictest0-21swapper/709:06:517
2824299120,12cyclictest0-21swapper/708:12:367
2824299120,1cyclictest0-21swapper/708:08:437
2824299120,1cyclictest0-21swapper/707:16:057
2823799128,3cyclictest1146-21snmpd11:46:076
2823799128,3cyclictest0-21swapper/609:51:396
2823799123,8cyclictest0-21swapper/609:04:576
2823799122,8cyclictest0-21swapper/609:37:356
28237991211,1cyclictest0-21swapper/610:37:436
2823499129,3cyclictest0-21swapper/507:34:145
2823499125,1cyclictest0-21swapper/511:40:135
2823499122,4cyclictest761-21crond11:35:005
28234991211,1cyclictest0-21swapper/509:39:245
2823499121,7cyclictest0-21swapper/510:27:155
2823499120,1cyclictest0-21swapper/507:18:225
28229991211,1cyclictest0-21swapper/407:43:234
2822999120,11cyclictest0-21swapper/408:09:474
2822999120,11cyclictest0-21swapper/407:16:324
2822499129,2cyclictest31097-21munin-node12:34:573
2822499129,2cyclictest11577-21crond08:35:003
2822499129,2cyclictest1146-21snmpd11:56:183
2822499129,2cyclictest1146-21snmpd09:30:343
2822499129,2cyclictest0-21swapper/310:30:163
28224991211,1cyclictest0-21swapper/311:51:233
28224991211,1cyclictest0-21swapper/310:44:213
28224991211,1cyclictest0-21swapper/309:24:133
28224991211,1cyclictest0-21swapper/307:16:193
2822499120,5cyclictest6483-21aten_r4power_vo08:25:133
2822499120,3cyclictest31228-21sed07:15:013
2821799129,2cyclictest1146-21snmpd10:06:572
2821799126,5cyclictest0-21swapper/210:12:012
2821799126,3cyclictest0-21swapper/211:38:422
2821799120,11cyclictest0-21swapper/211:06:192
2821799120,11cyclictest0-21swapper/209:46:422
2821799120,1cyclictest0-21swapper/210:38:202
2821499127,4cyclictest9044-21sshd11:05:391
2821499126,4cyclictest0-21swapper/110:33:311
2821499120,4cyclictest16901-21crond09:30:011
2821099129,2cyclictest0-21swapper/007:52:250
2821099126,5cyclictest0-21swapper/012:29:410
2821099126,5cyclictest0-21swapper/008:20:300
28210991210,1cyclictest0-21swapper/010:40:140
2821099121,6cyclictest0-21swapper/009:57:440
2821099120,11cyclictest0-21swapper/007:45:080
2821099120,1cyclictest0-21swapper/012:15:480
2821099120,1cyclictest0-21swapper/011:39:150
2821099120,1cyclictest0-21swapper/008:40:210
2254252120,4pltrace0-21swapper/611:25:016
2160652120,8pltrace54-21ksoftirqd/411:58:214
1991652120,5pltrace0-21swapper/010:09:040
1963252120,5pltrace0-21swapper/008:48:420
1855652120,6pltrace0-21swapper/107:47:071
145952120,1pltrace2995-21ssh09:14:330
2973952110,1pltrace0-21swapper/208:06:482
2824299114,6cyclictest0-21swapper/711:51:527
28242991110,1cyclictest0-21swapper/710:46:357
2824299110,4cyclictest9431-21tune2fs09:55:137
2824299110,11cyclictest0-21swapper/710:06:577
2824299110,10cyclictest24790-21unixbench_multi12:35:217
2824299110,10cyclictest24790-21unixbench_multi12:35:217
2824299110,10cyclictest1063-17auditd09:40:397
2824299110,10cyclictest1063-17auditd09:40:397
2824299110,1cyclictest0-21swapper/707:33:547
2823799116,3cyclictest0-21swapper/610:49:466
2823799115,5cyclictest0-21swapper/610:00:576
2823799115,3cyclictest0-21swapper/609:21:526
28237991110,1cyclictest0-21swapper/611:15:466
28237991110,1cyclictest0-21swapper/610:50:016
28237991110,1cyclictest0-21swapper/609:33:266
28237991110,1cyclictest0-21swapper/608:45:116
28237991110,1cyclictest0-21swapper/607:19:236
2823799110,9cyclictest0-21swapper/612:10:026
2823799110,11cyclictest0-21swapper/611:14:586
2823799110,11cyclictest0-21swapper/611:06:426
2823799110,11cyclictest0-21swapper/610:44:416
2823799110,11cyclictest0-21swapper/610:25:536
2823799110,11cyclictest0-21swapper/610:05:306
2823799110,11cyclictest0-21swapper/609:19:506
2823799110,11cyclictest0-21swapper/608:43:536
2823799110,11cyclictest0-21swapper/607:54:216
2823799110,1cyclictest0-21swapper/609:58:046
2823799110,1cyclictest0-21swapper/608:58:576
2823499110,9cyclictest0-21swapper/508:06:375
2822999116,4cyclictest0-21swapper/412:38:334
2822999116,4cyclictest0-21swapper/412:38:324
2822999116,4cyclictest0-21swapper/410:01:234
2822999116,3cyclictest0-21swapper/411:00:194
28229991110,1cyclictest0-21swapper/410:58:394
28229991110,1cyclictest0-21swapper/409:36:054
28229991110,1cyclictest0-21swapper/407:23:594
2822999110,9cyclictest0-21swapper/408:13:324
2822999110,1cyclictest0-21swapper/408:17:334
2822499119,1cyclictest0-21swapper/309:58:223
2822499118,2cyclictest6400-21crond11:04:593
2822499118,2cyclictest31097-21munin-node12:39:143
2822499118,2cyclictest31097-21munin-node12:39:143
2822499118,2cyclictest1146-21snmpd07:20:383
2822499118,2cyclictest1139-21polkitd09:44:313
2822499118,2cyclictest1139-21polkitd09:44:313
2822499118,2cyclictest0-21swapper/307:55:143
2822499117,3cyclictest30715-21tr08:10:133
2822499117,3cyclictest1478-21lldpd08:04:183
28224991110,1cyclictest0-21swapper/310:38:213
28224991110,1cyclictest0-21swapper/310:14:243
28224991110,1cyclictest0-21swapper/309:50:073
28224991110,1cyclictest0-21swapper/309:03:103
28224991110,1cyclictest0-21swapper/308:47:463
2822499110,11cyclictest0-21swapper/308:53:283
2822499110,11cyclictest0-21swapper/307:53:533
2822499110,1cyclictest0-21swapper/307:50:003
2821799119,1cyclictest0-21swapper/210:32:492
2821799118,2cyclictest0-21swapper/208:10:142
2821799115,5cyclictest0-21swapper/210:22:492
2821799115,5cyclictest0-21swapper/209:25:592
2821799114,5cyclictest22836-21grep12:35:102
2821799114,5cyclictest22836-21grep12:35:102
28217991110,1cyclictest0-21swapper/211:12:192
28217991110,1cyclictest0-21swapper/208:26:422
28217991110,1cyclictest0-21swapper/207:16:262
2821799110,11cyclictest0-21swapper/210:56:282
2821799110,1cyclictest0-21swapper/212:09:082
2821799110,1cyclictest0-21swapper/211:51:302
2821799110,1cyclictest0-21swapper/210:01:542
2821799110,1cyclictest0-21swapper/208:35:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional