You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-23 - 14:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat May 23, 2026 12:57:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31619969211,635cyclictest0-21swapper/411:26:584
31629965117,3cyclictest0-21swapper/511:29:275
31639964511,2cyclictest0-21swapper/611:29:266
31619961722,592cyclictest0-21swapper/412:07:544
31589960514,383cyclictest0-21swapper/111:29:261
31649960311,383cyclictest0-21swapper/711:29:267
3157995975,383cyclictest0-21swapper/011:29:260
31589959482,338cyclictest0-21swapper/112:39:591
31589956516,85cyclictest0-21swapper/110:39:011
31649956193,465cyclictest0-21swapper/712:38:237
3161995608,549cyclictest0-21swapper/411:19:164
31589956012,84cyclictest10969-21diskmemload10:05:131
31599955449,290cyclictest0-21swapper/211:53:382
31619955183,465cyclictest64450irq/122-eth011:20:234
3158995501,2cyclictest0-21swapper/112:16:141
316299543461,3cyclictest551rcuc/510:33:115
316199542163,255cyclictest15144-21rm10:02:504
31619954076,337cyclictest0-21swapper/409:45:474
31589954074,126cyclictest6615-21rm10:34:231
316099531151,92cyclictest0-21swapper/310:30:513
31619953019,380cyclictest0-21swapper/410:33:114
31619952617,506cyclictest0-21swapper/407:48:504
31599952518,85cyclictest0-21swapper/210:02:492
31589952518,84cyclictest0-21swapper/111:30:541
31629952413,339cyclictest0-21swapper/510:23:445
31599952215,345cyclictest0-21swapper/211:43:092
31579951911,92cyclictest0-21swapper/012:39:590
31609951852,127cyclictest0-21swapper/310:25:143
31579951811,3cyclictest0-21swapper/012:18:500
31619951546,211cyclictest49-21ksoftirqd/410:36:574
3160995146,3cyclictest10703-21ssh11:29:263
3161995137,297cyclictest20455-21ssh11:53:424
3164995081,2cyclictest0-21swapper/710:39:597
3159995070,256cyclictest0-21swapper/212:39:342
31609950640,342cyclictest0-21swapper/309:44:593
31589950679,296cyclictest1551-21snmpd11:19:511
316399505121,381cyclictest8467-21ssh10:35:216
315999505465,37cyclictest311rcuc/210:05:252
31579950537,2cyclictest0-21swapper/010:32:370
31599950381,256cyclictest3155-21cyclictest11:19:012
315999502418,3cyclictest311rcuc/209:49:402
31589950030,381cyclictest0-21swapper/112:20:151
31579950073,211cyclictest101ktimersoftd/012:08:110
315799500159,126cyclictest121rcu_preempt12:20:220
31619949935,46cyclictest0-21swapper/409:44:594
31579949733,3cyclictest0-21swapper/010:38:390
316399494113,297cyclictest0-21swapper/612:17:576
31579949430,340cyclictest0-21swapper/009:44:590
316399493109,381cyclictest3155-21cyclictest10:32:556
31639948920,169cyclictest18252-1kworker/u17:009:48:406
316399488151,127cyclictest0-21swapper/610:22:566
31619948618,380cyclictest0-21swapper/412:16:274
31599948620,3cyclictest0-21swapper/212:16:132
315999485105,207cyclictest698-21ptp4l10:39:452
31619948416,465cyclictest2562-21ssh12:36:594
31579948420,85cyclictest0-21swapper/011:52:390
31649948317,343cyclictest14364-21ssh09:44:597
31589948319,340cyclictest0-21swapper/109:44:591
31579948113,168cyclictest0-21swapper/011:44:240
31619948012,465cyclictest0-21swapper/411:30:474
31619948012,295cyclictest0-21swapper/409:29:044
31629947915,253cyclictest0-21swapper/512:35:545
31599947915,260cyclictest0-21swapper/209:43:232
31619947716,246cyclictest0-21swapper/407:23:284
31579947793,126cyclictest0-21swapper/009:46:200
31619947594,84cyclictest0-21swapper/410:25:014
3161994746,465cyclictest0-21swapper/411:43:284
3162994695,2cyclictest0-21swapper/511:18:445
3160994694,3cyclictest0-21swapper/312:16:133
315999469170,126cyclictest121rcu_preempt10:34:562
316299465166,126cyclictest121rcu_preempt12:19:115
3158994651,2cyclictest0-21swapper/111:42:341
31649946441,3cyclictest0-21swapper/709:50:127
31649946441,3cyclictest0-21swapper/709:49:087
316399464123,338cyclictest0-21swapper/610:04:176
315899464207,126cyclictest121rcu_preempt12:08:061
3157994640,126cyclictest18247-21df_inode10:05:170
31649946341,2cyclictest0-21swapper/710:24:017
31649946340,3cyclictest0-21swapper/710:05:067
315999463122,338cyclictest0-21swapper/210:23:112
31589946240,2cyclictest0-21swapper/109:45:431
31579946240,3cyclictest0-21swapper/011:18:120
31579946240,2cyclictest0-21swapper/010:23:150
31579946240,2cyclictest0-21swapper/010:04:440
31649946139,2cyclictest0-21swapper/710:31:557
31629946140,2cyclictest0-21swapper/509:45:475
31649946039,2cyclictest0-21swapper/707:24:407
31649946038,2cyclictest0-21swapper/711:42:487
31609946038,255cyclictest0-21swapper/307:49:173
315999460120,126cyclictest121rcu_preempt07:25:132
316399459334,41cyclictest8427-1kworker/u17:212:39:156
31599945978,84cyclictest0-21swapper/210:40:052
31639945835,47cyclictest4093-21ssh11:44:316
31619945879,84cyclictest15610-21timerandwakeup10:40:324
31589945836,2cyclictest0-21swapper/110:04:281
31649945774,380cyclictest0-21swapper/711:53:327
31649945735,2cyclictest0-21swapper/712:08:437
31609945773,381cyclictest41-21ksoftirqd/312:38:233
31599945772,211cyclictest9879-21ssh11:27:572
315899457199,84cyclictest21292-21sh10:23:071
315899457117,338cyclictest0-21swapper/109:50:141
31649945634,2cyclictest0-21swapper/712:10:077
316399456115,338cyclictest0-21swapper/610:40:316
316399456115,126cyclictest121rcu_preempt11:19:556
315999456114,126cyclictest0-21swapper/209:27:442
31629945533,3cyclictest0-21swapper/511:44:025
316299455285,168cyclictest6968-1kworker/u17:010:38:115
31609945532,85cyclictest0-21swapper/309:29:183
31579945533,2cyclictest0-21swapper/009:27:430
31649945431,85cyclictest0-21swapper/711:20:227
31609945431,85cyclictest0-21swapper/311:30:093
31609945431,257cyclictest0-21swapper/310:04:483
31649945331,2cyclictest0-21swapper/707:49:147
31619945328,422cyclictest0-21swapper/412:10:114
31609945330,168cyclictest0-21swapper/312:08:223
31579945331,2cyclictest0-21swapper/007:25:100
31609945272,84cyclictest0-21swapper/310:40:323
31609945229,257cyclictest0-21swapper/310:23:593
31589945231,2cyclictest0-21swapper/111:54:381
31619945129,45cyclictest0-21swapper/412:40:134
31619945129,45cyclictest0-21swapper/412:40:124
316099450108,211cyclictest26263-21sh11:18:213
31639944928,255cyclictest0-21swapper/607:49:176
31629944875,118cyclictest2391-21sh12:20:275
31649944724,257cyclictest0-21swapper/712:16:137
31639944726,255cyclictest0-21swapper/609:44:346
31649944662,211cyclictest0-21swapper/711:30:127
31599944564,211cyclictest33-21ksoftirqd/212:05:582
31649944422,256cyclictest0-21swapper/711:19:017
31629944360,210cyclictest0-21swapper/509:43:335
316299443106,170cyclictest0-21swapper/511:50:545
31619944318,422cyclictest21280-21sh09:50:124
31629944216,211cyclictest13350-21pmu-power11:30:515
31629944161,213cyclictest0-21swapper/512:10:035
31619944018,219cyclictest0-21swapper/410:05:154
31589944017,3cyclictest0-21swapper/109:29:261
31579944018,169cyclictest9-21ksoftirqd/010:25:080
31639943922,37cyclictest14817-21rm12:08:436
316399438144,126cyclictest121rcu_preempt10:05:166
31629943858,84cyclictest0-21swapper/510:40:325
31629943815,256cyclictest0-21swapper/511:20:235
316299438139,126cyclictest121rcu_preempt10:25:135
31619943812,423cyclictest0-21swapper/412:20:424
31629943715,289cyclictest0-21swapper/510:02:545
31609943713,169cyclictest31645-21kworker/u16:210:36:373
3160994369,211cyclictest0-21swapper/312:20:423
31589943555,296cyclictest0-21swapper/110:40:331
316399434135,126cyclictest7063-21kworker/u16:011:20:196
3163994297,254cyclictest0-21swapper/609:27:456
31629942911,288cyclictest0-21swapper/512:07:165
3161994282,423cyclictest18961-21/usr/sbin/munin09:30:124
3161994282,423cyclictest18961-21/usr/sbin/munin09:30:114
31609942848,215cyclictest3788-21nscd11:52:593
31599942642,169cyclictest33-21ksoftirqd/210:25:062
31649942444,211cyclictest0-21swapper/710:02:457
3160994241,3cyclictest0-21swapper/311:42:343
3163994231,2cyclictest0-21swapper/611:52:596
3159994231,2cyclictest0-21swapper/211:20:232
3159994231,2cyclictest0-21swapper/207:50:032
3158994231,2cyclictest0-21swapper/107:50:051
316499422343,2cyclictest711rcuc/709:27:447
31589942281,338cyclictest0-21swapper/112:40:121
31589942281,338cyclictest0-21swapper/112:40:121
31579942283,42cyclictest0-21swapper/012:40:300
31579942283,42cyclictest0-21swapper/012:40:300
31629942182,84cyclictest0-21swapper/509:27:195
316299421122,126cyclictest0-21swapper/507:22:435
31609942141,3cyclictest0-21swapper/307:23:543
31589942141,256cyclictest0-21swapper/110:25:111
31589942140,84cyclictest0-21swapper/111:20:231
31589942077,211cyclictest25-21ksoftirqd/107:24:141
31579942077,84cyclictest0-21swapper/011:20:220
31579942041,295cyclictest21280-21ssh09:50:130
31599941475,84cyclictest0-21swapper/209:50:022
31599941432,42cyclictest121rcu_preempt11:30:462
31579941436,296cyclictest20334-21nscd11:30:280
31609941373,85cyclictest0-21swapper/309:47:563
31579941274,253cyclictest0-21swapper/010:40:320
31639941172,84cyclictest0-21swapper/609:50:146
31599941180,120cyclictest2326-21sed12:20:262
31589941131,3cyclictest0-21swapper/109:30:091
31589941131,3cyclictest0-21swapper/109:30:091
31629940970,84cyclictest0-21swapper/509:50:095
31639940828,255cyclictest0-21swapper/607:24:136
31609940768,84cyclictest0-21swapper/307:25:123
31649940626,2cyclictest0-21swapper/712:20:287
31589940627,2cyclictest0-21swapper/107:48:301
31579940626,3cyclictest0-21swapper/012:10:260
31639940463,126cyclictest0-21swapper/612:10:106
31609940263,84cyclictest0-21swapper/310:05:073
31599940258,126cyclictest33-21ksoftirqd/207:23:492
316499401111,45cyclictest121rcu_preempt12:40:147
316499401111,45cyclictest121rcu_preempt12:40:147
31619940162,84cyclictest0-21swapper/410:25:144
31599940163,171cyclictest0-21swapper/207:48:282
31629939919,254cyclictest0-21swapper/510:05:265
31649939817,2cyclictest0-21swapper/707:50:047
31609939862,170cyclictest0-21swapper/311:20:043
31579939617,2cyclictest0-21swapper/007:24:390
31649939456,171cyclictest0-21swapper/709:30:047
31649939456,171cyclictest0-21swapper/709:30:047
31599939212,7cyclictest0-21swapper/212:10:072
3163993916,211cyclictest65-21ksoftirqd/611:30:186
31609937941,3cyclictest0-21swapper/307:50:043
31579937740,2cyclictest0-21swapper/007:48:300
316399376119,254cyclictest23241-21ssh10:25:146
315899376332,42cyclictest231rcuc/112:10:271
31609937335,87cyclictest18898-21users12:10:253
31649937131,126cyclictest73-21ksoftirqd/710:25:117
31639936628,171cyclictest0-21swapper/607:50:036
31579936427,3cyclictest0-21swapper/009:30:040
31579936427,3cyclictest0-21swapper/009:30:040
31639936363,126cyclictest121rcu_preempt12:40:326
31639936363,126cyclictest121rcu_preempt12:40:326
31649936225,2cyclictest0-21swapper/710:40:277
31639936224,84cyclictest0-21swapper/612:20:186
31589936225,2cyclictest0-21swapper/107:25:111
31579936225,3cyclictest0-21swapper/007:50:130
31629936061,176cyclictest0-21swapper/507:50:145
316299360107,85cyclictest0-21swapper/507:49:145
315999360108,168cyclictest32095-21kworker/u16:312:40:152
315999360108,168cyclictest32095-21kworker/u16:312:40:152
31619935864,210cyclictest0-21swapper/407:50:134
316099358148,129cyclictest7272-21kworker/u16:012:40:303
316099358148,129cyclictest7272-21kworker/u16:012:40:303
31599935762,211cyclictest0-21swapper/209:30:112
31599935762,211cyclictest0-21swapper/209:30:112
31629935661,168cyclictest0-21swapper/512:40:065
31629935661,168cyclictest0-21swapper/512:40:065
31639935416,172cyclictest0-21swapper/609:30:046
31639935416,172cyclictest0-21swapper/609:30:046
31609934247,211cyclictest0-21swapper/309:50:063
31629933983,84cyclictest121rcu_preempt09:30:035
31629933983,84cyclictest121rcu_preempt09:30:035
31609933679,254cyclictest7604-21kworker/u16:009:30:023
31609933679,254cyclictest7604-21kworker/u16:009:30:023
31649932631,2cyclictest0-21swapper/707:25:117
31619932525,84cyclictest0-21swapper/407:25:124
31629932268,84cyclictest0-21swapper/507:25:125
316399319236,3cyclictest631rcuc/607:25:016
242628959,27sleep10-21swapper/107:05:401
187328883,2sleep60-21swapper/607:05:216
256328756,28sleep70-21swapper/707:07:387
243728554,27sleep30-21swapper/307:05:503
253928251,27sleep20-21swapper/207:07:172
251328250,28sleep50-21swapper/507:06:565
250328243,35sleep40-21swapper/407:06:474
260428150,28sleep00-21swapper/007:08:120
75402710,2sleep5316299cyclictest07:15:125
13462710,0sleep60-21swapper/610:13:016
3163992810,17cyclictest0-21swapper/609:01:396
3161992827,0cyclictest0-21swapper/409:01:154
3161992810,17cyclictest0-21swapper/407:13:484
3160992810,18cyclictest0-21swapper/309:01:153
3160992810,17cyclictest0-21swapper/309:11:253
3160992810,0cyclictest0-21swapper/307:38:013
3159992810,18cyclictest0-21swapper/209:11:252
3158992810,0cyclictest0-21swapper/109:11:541
3164992727,0cyclictest0-21swapper/708:50:127
3164992727,0cyclictest0-21swapper/707:14:067
3164992710,17cyclictest0-21swapper/708:40:587
3164992710,17cyclictest0-21swapper/708:04:137
3164992710,17cyclictest0-21swapper/707:37:567
3164992710,0cyclictest0-21swapper/709:11:437
3163992727,0cyclictest0-21swapper/608:31:326
3163992710,17cyclictest0-21swapper/608:49:506
3163992710,17cyclictest0-21swapper/608:21:596
3163992710,17cyclictest0-21swapper/608:13:256
3163992710,17cyclictest0-21swapper/607:37:506
3163992710,0cyclictest0-21swapper/609:25:006
3163992710,0cyclictest0-21swapper/609:11:286
3163992710,0cyclictest0-21swapper/608:50:106
3162992727,0cyclictest0-21swapper/509:11:265
3162992727,0cyclictest0-21swapper/508:49:515
3162992727,0cyclictest0-21swapper/508:40:545
3162992710,17cyclictest0-21swapper/508:13:145
3162992710,0cyclictest0-21swapper/509:24:595
3162992710,0cyclictest0-21swapper/508:21:565
3162992710,0cyclictest0-21swapper/507:14:055
3161992710,17cyclictest0-21swapper/408:40:474
3161992710,0cyclictest0-21swapper/409:11:274
3161992710,0cyclictest0-21swapper/408:22:144
3161992710,0cyclictest0-21swapper/408:13:224
3160992727,0cyclictest0-21swapper/307:13:503
3160992726,1cyclictest0-21swapper/308:22:173
3160992710,17cyclictest0-21swapper/308:40:493
3160992710,17cyclictest0-21swapper/308:31:293
3160992710,0cyclictest0-21swapper/308:50:133
3160992710,0cyclictest0-21swapper/308:13:173
3160992710,0cyclictest0-21swapper/308:03:533
3159992727,0cyclictest0-21swapper/208:21:582
3159992727,0cyclictest0-21swapper/208:13:082
3159992710,17cyclictest0-21swapper/208:40:542
3159992710,17cyclictest0-21swapper/208:31:332
3159992710,17cyclictest0-21swapper/207:37:532
3159992710,17cyclictest0-21swapper/207:13:512
3159992710,0cyclictest0-21swapper/208:04:002
3158992710,17cyclictest0-21swapper/109:01:181
3158992710,17cyclictest0-21swapper/108:40:581
3158992710,17cyclictest0-21swapper/108:13:151
3158992710,17cyclictest0-21swapper/108:03:521
3158992710,0cyclictest0-21swapper/108:21:491
3158992710,0cyclictest0-21swapper/107:38:191
3158992710,0cyclictest0-21swapper/107:14:081
3157992727,0cyclictest0-21swapper/008:31:340
3157992727,0cyclictest0-21swapper/007:38:020
3157992710,17cyclictest0-21swapper/009:01:180
3157992710,17cyclictest0-21swapper/008:49:460
3157992710,17cyclictest0-21swapper/008:22:140
3157992710,17cyclictest0-21swapper/008:03:550
3157992710,17cyclictest0-21swapper/007:13:430
3157992710,0cyclictest0-21swapper/009:11:380
3157992710,0cyclictest0-21swapper/008:50:120
3157992710,0cyclictest0-21swapper/008:40:480
3157992710,0cyclictest0-21swapper/008:13:150
3164992626,0cyclictest0-21swapper/708:21:567
3164992610,0cyclictest0-21swapper/709:01:167
3164992610,0cyclictest0-21swapper/708:31:317
3162992626,0cyclictest0-21swapper/509:01:135
3162992626,0cyclictest0-21swapper/508:50:125
3162992626,0cyclictest0-21swapper/508:04:035
3162992626,0cyclictest0-21swapper/507:37:545
3161992626,0cyclictest0-21swapper/408:31:304
3161992610,0cyclictest0-21swapper/408:04:004
3161992610,0cyclictest0-21swapper/407:37:504
3160992626,0cyclictest0-21swapper/308:49:433
3159992626,0cyclictest0-21swapper/209:01:172
3158992626,0cyclictest0-21swapper/108:49:551
3158992626,0cyclictest0-21swapper/108:31:301
3157992626,0cyclictest0-21swapper/007:20:000
3164992525,0cyclictest0-21swapper/708:13:237
3163992525,0cyclictest0-21swapper/608:40:536
3161992525,0cyclictest0-21swapper/408:50:124
3161992525,0cyclictest0-21swapper/408:49:454
3159992525,0cyclictest0-21swapper/208:49:542
3157992525,0cyclictest0-21swapper/009:25:010
71642240,1sleep1241ktimersoftd/111:45:191
3163992424,0cyclictest0-21swapper/608:03:496
3163992424,0cyclictest0-21swapper/607:20:006
3163992424,0cyclictest0-21swapper/607:13:396
3162992424,0cyclictest0-21swapper/508:31:425
316199241,21cyclictest0-21swapper/409:20:194
3160992424,0cyclictest0-21swapper/309:24:593
3158992323,0cyclictest0-21swapper/108:50:131
3159992222,0cyclictest0-21swapper/208:50:052
3158992222,0cyclictest0-21swapper/109:25:011
3159992121,0cyclictest0-21swapper/209:24:552
3158992121,0cyclictest0-21swapper/107:20:001
91402200,0sleep50-21swapper/510:53:595
3164992017,2cyclictest0-21swapper/707:15:177
316199209,6cyclictest49-21ksoftirqd/411:40:004
316199209,6cyclictest49-21ksoftirqd/411:40:004
3160992018,1cyclictest0-21swapper/311:00:223
315999200,1cyclictest0-21swapper/211:45:222
316499190,17cyclictest0-21swapper/712:25:217
316299190,1cyclictest0-21swapper/511:45:225
3161991919,0cyclictest0-21swapper/407:19:594
316099190,1cyclictest10011-21apt-config07:20:003
3159991917,1cyclictest0-21swapper/210:10:172
316499180,17cyclictest0-21swapper/708:49:437
311052180,0sleep70-21swapper/709:35:217
115862180,1sleep60-21swapper/610:55:126
3164991710,0cyclictest0-21swapper/709:24:587
316199172,8cyclictest49-21ksoftirqd/412:05:004
3159991710,7cyclictest0-21swapper/207:19:502
315799172,7cyclictest0-21swapper/010:50:000
316299161,10cyclictest57-21ksoftirqd/510:00:015
288352160,0sleep60-21swapper/610:47:196
161812160,0sleep60-21swapper/611:13:076
3163991513,1cyclictest0-21swapper/611:45:226
316199151,9cyclictest49-21ksoftirqd/407:45:004
316199151,7cyclictest49-21ksoftirqd/410:46:034
3161991512,2cyclictest481ktimersoftd/411:11:074
316199150,13cyclictest0-21swapper/411:55:134
315999156,2cyclictest33-21ksoftirqd/211:00:002
315999152,7cyclictest469-21ssh10:50:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional