You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-03 - 05:37
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Aug 03, 2026 00:55:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
295309980236,592cyclictest0-21swapper/423:24:504
295309970670,633cyclictest0-21swapper/400:23:154
295309969617,676cyclictest0-21swapper/422:12:164
2952799691183,84cyclictest121rcu_preempt22:51:511
295309967441,549cyclictest0-21swapper/400:41:244
2952999674123,126cyclictest21275-21rm21:17:313
295309967277,592cyclictest0-21swapper/419:31:404
295309966431,422cyclictest0-21swapper/422:44:014
295309966431,422cyclictest0-21swapper/422:44:014
295309966431,422cyclictest0-21swapper/422:44:014
295309966431,422cyclictest0-21swapper/422:44:014
295309966431,422cyclictest0-21swapper/422:44:004
295309963784,550cyclictest0-21swapper/421:10:144
295289963746,126cyclictest0-21swapper/222:30:072
29527996350,84cyclictest0-21swapper/121:18:211
2952899634124,294cyclictest0-21swapper/223:48:432
295309963179,549cyclictest0-21swapper/422:54:104
2952999631124,126cyclictest29157-21ssh00:38:063
295329962875,339cyclictest0-21swapper/621:20:136
2953299624115,84cyclictest0-21swapper/623:00:306
2953299618148,296cyclictest0-21swapper/621:20:026
295279961364,84cyclictest0-21swapper/123:09:191
2953199611568,41cyclictest561ktimersoftd/500:06:335
295329960999,380cyclictest1553-21runrttasks23:47:176
295309960611,42cyclictest0-21swapper/423:48:514
295279959947,295cyclictest0-21swapper/122:00:151
29526995961,592cyclictest0-21swapper/000:18:410
29533995930,84cyclictest0-21swapper/723:18:217
295319959281,462cyclictest0-21swapper/522:10:325
29531995920,83cyclictest0-21swapper/500:23:175
295269959041,296cyclictest0-21swapper/020:09:580
2953099589249,338cyclictest64450irq/122-eth021:19:014
295299958573,381cyclictest0-21swapper/323:19:463
295269958577,126cyclictest0-21swapper/022:53:030
295329958476,126cyclictest0-21swapper/622:12:236
295309958435,423cyclictest0-21swapper/422:15:234
295269958334,84cyclictest0-21swapper/023:50:140
295279958232,126cyclictest0-21swapper/122:43:571
295279958232,126cyclictest0-21swapper/122:43:571
295279958232,126cyclictest0-21swapper/122:43:571
295279958232,126cyclictest0-21swapper/122:43:571
295279958232,126cyclictest0-21swapper/122:43:571
295289957526,84cyclictest0-21swapper/223:18:552
2952899573529,42cyclictest311rcuc/223:21:512
295329957019,126cyclictest121rcu_preempt22:44:476
295329957019,126cyclictest121rcu_preempt22:44:476
295329957019,126cyclictest121rcu_preempt22:44:476
295329957019,126cyclictest121rcu_preempt22:44:476
295329957019,126cyclictest121rcu_preempt22:44:476
295309957018,168cyclictest64450irq/122-eth022:28:174
295329956719,84cyclictest121rcu_preempt23:50:186
295289956211,127cyclictest0-21swapper/222:10:452
295319956053,123cyclictest0-21swapper/523:22:165
29530995553,549cyclictest0-21swapper/420:45:184
29528995551,127cyclictest24576-21ssh22:29:452
2953199552168,168cyclictest57-21ksoftirqd/522:43:395
2953199552168,168cyclictest57-21ksoftirqd/522:43:395
2953199552168,168cyclictest57-21ksoftirqd/522:43:395
2953199552168,168cyclictest57-21ksoftirqd/522:43:395
2953199552168,168cyclictest57-21ksoftirqd/522:43:395
295289955244,126cyclictest121rcu_preempt00:07:032
29527995520,84cyclictest0-21swapper/120:45:171
29531995511,49cyclictest0-21swapper/522:53:155
29526995510,84cyclictest0-21swapper/020:45:170
29527995500,83cyclictest29306-21ssh22:11:331
295299954778,381cyclictest0-21swapper/322:52:143
2952899547121,211cyclictest14001-21apt-get20:30:162
295329954637,126cyclictest0-21swapper/622:53:546
295309954434,127cyclictest6892-21sh23:32:044
295269954478,127cyclictest0-21swapper/022:27:460
295329954274,465cyclictest0-21swapper/623:43:226
2953099542201,338cyclictest64450irq/122-eth023:43:224
295289954274,211cyclictest5530-21diskmemload22:16:112
295289954235,84cyclictest0-21swapper/200:31:322
295289954129,254cyclictest0-21swapper/221:18:232
295269954135,337cyclictest0-21swapper/022:17:210
295339954029,380cyclictest0-21swapper/723:57:247
2953399540200,338cyclictest29524-21cyclictest22:11:257
2952799540157,211cyclictest22154-1kworker/u17:223:43:341
295309953929,295cyclictest0-21swapper/400:31:474
295299953972,84cyclictest0-21swapper/322:17:323
295279953975,126cyclictest5530-21diskmemload23:20:521
295269953970,253cyclictest0-21swapper/023:43:180
295309953727,507cyclictest0-21swapper/420:07:164
295329953629,300cyclictest0-21swapper/600:11:496
2952699536111,168cyclictest121rcu_preempt22:43:390
2952699536111,168cyclictest121rcu_preempt22:43:390
2952699536111,168cyclictest121rcu_preempt22:43:390
2952699536111,168cyclictest121rcu_preempt22:43:380
2952699536111,168cyclictest121rcu_preempt22:43:380
295269953566,296cyclictest0-21swapper/000:23:150
295309953327,3cyclictest0-21swapper/423:18:444
295329953225,338cyclictest0-21swapper/623:09:046
295309953223,506cyclictest0-21swapper/400:26:014
2953099531110,126cyclictest0-21swapper/421:20:144
295279953163,126cyclictest0-21swapper/123:33:371
2953399528190,84cyclictest29524-21cyclictest20:09:117
295319952721,44cyclictest0-21swapper/522:15:435
295309952718,426cyclictest0-21swapper/422:45:104
295289952759,211cyclictest0-21swapper/221:10:272
295269952662,126cyclictest0-21swapper/023:48:440
295289952417,84cyclictest0-21swapper/222:51:562
2953399523439,3cyclictest711rcuc/722:54:087
295319952314,84cyclictest0-21swapper/500:26:295
295299952315,84cyclictest24877-21dump-pmu-power22:30:013
295329952114,7cyclictest0-21swapper/623:23:056
295309952156,211cyclictest0-21swapper/400:18:404
295309952156,126cyclictest121rcu_preempt19:47:074
295309952014,340cyclictest0-21swapper/400:07:134
29530995198,42cyclictest0-21swapper/423:09:134
295269951812,295cyclictest5530-21diskmemload23:08:220
2953199517138,126cyclictest29524-21cyclictest00:18:495
295289951751,126cyclictest0-21swapper/200:02:162
2952799515472,41cyclictest231rcuc/119:32:541
2952699514343,84cyclictest723-21nscd00:12:080
29530995121,464cyclictest0-21swapper/422:55:044
2952899511212,84cyclictest121rcu_preempt21:52:342
295289951082,211cyclictest33-21ksoftirqd/200:18:492
295279951083,127cyclictest0-21swapper/100:26:061
29528995090,84cyclictest0-21swapper/223:33:372
29527995090,84cyclictest0-21swapper/120:05:371
295319950882,211cyclictest57-21ksoftirqd/523:17:365
29528995080,84cyclictest0-21swapper/223:50:082
29532995071,44cyclictest0-21swapper/600:23:046
295299950780,296cyclictest0-21swapper/323:24:593
295319950681,422cyclictest0-21swapper/521:17:585
295269950680,297cyclictest0-21swapper/021:10:140
295309950437,464cyclictest0-21swapper/421:52:084
295299950482,84cyclictest0-21swapper/322:10:263
2952899504124,296cyclictest26347-21sh23:42:512
295329950377,211cyclictest65-21ksoftirqd/622:15:056
295319950380,126cyclictest121rcu_preempt23:43:275
295269950378,253cyclictest0-21swapper/000:38:300
295269950334,253cyclictest0-21swapper/023:21:360
2953299502162,337cyclictest29524-21cyclictest00:07:466
295289950131,296cyclictest0-21swapper/220:45:202
295269950174,211cyclictest9-21ksoftirqd/022:12:320
295329950032,84cyclictest0-21swapper/619:14:546
295319950077,126cyclictest28528-21ssh00:02:195
295319950073,211cyclictest0-21swapper/520:08:025
295299950077,84cyclictest0-21swapper/300:02:283
295269950079,126cyclictest9-21ksoftirqd/022:05:270
295339949871,211cyclictest73-21ksoftirqd/722:27:577
2953399498157,126cyclictest121rcu_preempt20:45:157
2953099498115,127cyclictest0-21swapper/400:38:504
295279949771,211cyclictest25-21ksoftirqd/123:18:341
295339949572,84cyclictest0-21swapper/700:02:287
295319949531,84cyclictest0-21swapper/523:09:395
295309949526,466cyclictest0-21swapper/422:30:214
2952999495113,84cyclictest26727-21ssh22:30:243
295319949429,298cyclictest0-21swapper/519:33:255
295279949429,211cyclictest0-21swapper/121:10:241
295269949366,210cyclictest0-21swapper/022:20:100
295269949328,126cyclictest0-21swapper/000:01:420
295299949223,296cyclictest0-21swapper/323:48:523
295299949068,126cyclictest0-21swapper/300:07:133
295279949068,84cyclictest0-21swapper/123:49:581
295299948923,211cyclictest0-21swapper/323:33:013
295329948861,296cyclictest0-21swapper/623:33:446
2952699488107,126cyclictest4904-21rm00:07:120
295299948722,419cyclictest0-21swapper/320:08:403
295339948662,126cyclictest19749-21sshd22:43:537
295339948662,126cyclictest19749-21sshd22:43:537
295339948662,126cyclictest19749-21sshd22:43:537
295339948662,126cyclictest19749-21sshd22:43:537
295339948662,126cyclictest19749-21sshd22:43:527
295309948616,169cyclictest0-21swapper/419:58:334
295339948516,338cyclictest0-21swapper/700:38:267
295299948462,84cyclictest29524-21cyclictest22:44:203
295299948462,84cyclictest29524-21cyclictest22:44:203
295299948462,84cyclictest29524-21cyclictest22:44:203
295299948462,84cyclictest29524-21cyclictest22:44:203
295299948462,84cyclictest29524-21cyclictest22:44:193
295299948456,211cyclictest0-21swapper/323:42:293
295269948459,253cyclictest0-21swapper/019:30:540
295319948356,211cyclictest0-21swapper/522:29:455
295299948361,84cyclictest0-21swapper/319:32:313
295329948296,211cyclictest0-21swapper/620:09:586
295339948058,83cyclictest0-21swapper/723:21:547
2952699479223,126cyclictest9-21ksoftirqd/000:31:550
295299947812,211cyclictest0-21swapper/323:08:373
29528994789,88cyclictest0-21swapper/223:00:022
295269947754,126cyclictest7906-21ssh00:26:300
295339947654,84cyclictest0-21swapper/721:18:217
29526994768,253cyclictest0-21swapper/023:00:300
295339947452,84cyclictest0-21swapper/723:49:587
295339947452,84cyclictest0-21swapper/719:31:017
295309947145,423cyclictest0-21swapper/423:50:224
2952699471257,126cyclictest1548-21lldpd23:18:480
29532994701,338cyclictest0-21swapper/619:34:176
29528994701,127cyclictest0-21swapper/200:41:082
295319946945,84cyclictest121rcu_preempt23:48:465
29530994683,3cyclictest64450irq/122-eth020:15:104
295289946740,295cyclictest0-21swapper/222:44:192
295289946740,295cyclictest0-21swapper/222:44:192
295289946740,295cyclictest0-21swapper/222:44:192
295289946740,295cyclictest0-21swapper/222:44:192
295289946740,295cyclictest0-21swapper/222:44:192
29527994671,211cyclictest0-21swapper/123:57:201
2953399466124,127cyclictest73-21ksoftirqd/722:19:287
2953199466171,84cyclictest11323-1kworker/u17:000:39:075
2952899466125,339cyclictest0-21swapper/220:06:212
2952899466125,338cyclictest0-21swapper/200:38:022
2953399465124,338cyclictest5186-21sshd00:07:387
295289946583,209cyclictest33-21ksoftirqd/220:10:072
29528994651,380cyclictest0-21swapper/221:43:502
295339946480,210cyclictest73-21ksoftirqd/723:08:237
295299946481,84cyclictest0-21swapper/300:31:163
295299946442,338cyclictest0-21swapper/320:10:153
2952999464122,339cyclictest0-21swapper/322:59:413
295289946480,211cyclictest33-21ksoftirqd/222:55:042
2952899464122,339cyclictest0-21swapper/223:09:542
295329946342,126cyclictest121rcu_preempt00:01:426
2953299463253,41cyclictest0-21swapper/600:31:326
295299946340,256cyclictest0-21swapper/319:14:543
2952999463123,338cyclictest0-21swapper/300:26:293
295279946380,126cyclictest23306-21ssh22:28:211
295339946281,296cyclictest0-21swapper/700:18:517
2953299462419,41cyclictest631rcuc/622:30:236
295299946181,84cyclictest0-21swapper/300:18:513
295299946138,256cyclictest0-21swapper/321:10:243
2952799461159,126cyclictest121rcu_preempt22:18:401
295299946038,338cyclictest0-21swapper/300:41:243
2952899460203,84cyclictest0-21swapper/200:11:432
295269946076,253cyclictest0-21swapper/019:47:080
295329945937,2cyclictest0-21swapper/623:17:356
295299945974,84cyclictest0-21swapper/320:45:183
2952899459119,338cyclictest0-21swapper/200:23:092
295279945937,2cyclictest0-21swapper/123:50:131
295319945875,211cyclictest0-21swapper/521:10:265
295309945833,85cyclictest121rcu_preempt00:02:374
295279945879,84cyclictest0-21swapper/100:18:511
2952799458204,84cyclictest3244-21kworker/u16:200:40:581
2952799458123,246cyclictest0-21swapper/100:02:361
295269945873,339cyclictest121rcu_preempt21:19:000
295299945776,84cyclictest0-21swapper/322:20:103
2952799457116,126cyclictest25-21ksoftirqd/100:23:321
295329945634,2cyclictest0-21swapper/600:38:156
2952699456157,126cyclictest121rcu_preempt23:33:150
295339945533,256cyclictest0-21swapper/700:23:057
295339945533,255cyclictest0-21swapper/721:10:257
295309945529,127cyclictest0-21swapper/421:43:514
2953099455114,338cyclictest29524-21cyclictest23:00:304
295279945532,42cyclictest0-21swapper/120:10:111
2953299454114,338cyclictest0-21swapper/620:45:246
2953299454113,339cyclictest29524-21cyclictest00:26:516
295319945432,338cyclictest0-21swapper/520:10:165
295279945373,84cyclictest0-21swapper/100:39:051
2952799453115,169cyclictest24902-21df_inode21:20:171
2953299452112,337cyclictest18715-21runrttasks22:05:276
2953299452111,338cyclictest0-21swapper/600:18:326
295319945130,338cyclictest0-21swapper/500:31:255
295329945066,168cyclictest65-21ksoftirqd/621:35:206
2953299450197,88cyclictest13918-21sh22:59:446
2953299450108,339cyclictest5530-21diskmemload21:43:506
295319945066,126cyclictest57-21ksoftirqd/523:33:375
295339944923,168cyclictest0-21swapper/700:41:227
295289944969,256cyclictest13319-21nscd22:20:082
2952699449110,84cyclictest0-21swapper/020:10:230
2952899447109,335cyclictest0-21swapper/223:25:202
295319944662,127cyclictest7253-21ssh22:20:125
295279944619,254cyclictest0-21swapper/100:11:421
2953299445104,211cyclictest65-21ksoftirqd/621:52:226
295269944523,168cyclictest0-21swapper/021:43:580
295329944421,3cyclictest0-21swapper/622:29:296
295319944417,211cyclictest57-21ksoftirqd/520:45:235
2952899444102,339cyclictest0-21swapper/200:26:172
295319944359,211cyclictest1981-21ssh00:40:325
295299944358,211cyclictest1857-21chrt23:10:213
2952999443187,126cyclictest121rcu_preempt21:20:113
2953299442101,338cyclictest0-21swapper/600:40:426
295329944118,257cyclictest0-21swapper/621:10:196
295289944118,126cyclictest0-21swapper/222:00:152
2953299440100,338cyclictest698-21ptp4l22:00:136
295299944017,3cyclictest0-21swapper/323:50:133
295269944099,338cyclictest25739-21ssh23:25:150
295339943917,255cyclictest704-21nscd22:20:087
295289943999,43cyclictest0-21swapper/221:20:162
295279943818,295cyclictest0-21swapper/100:31:551
295269943855,380cyclictest3298-21sh00:41:500
295329943715,84cyclictest0-21swapper/622:20:176
295329943715,3cyclictest0-21swapper/623:57:206
2952699437181,84cyclictest121rcu_preempt20:30:130
295299943699,211cyclictest121rcu_preempt19:18:543
295339943555,84cyclictest0-21swapper/723:33:527
29532994359,169cyclictest0-21swapper/622:36:266
29530994359,42cyclictest0-21swapper/420:10:264
29527994348,253cyclictest0-21swapper/123:10:181
295339943311,127cyclictest0-21swapper/722:59:447
295269943396,84cyclictest0-21swapper/022:30:050
295319942844,85cyclictest0-21swapper/523:50:185
2952799426169,84cyclictest4519-21ssh00:06:441
295319942583,339cyclictest0-21swapper/500:11:385
29528994251,84cyclictest0-21swapper/219:33:182
295339942483,338cyclictest0-21swapper/700:26:517
295319942484,338cyclictest0-21swapper/522:00:155
295319942483,338cyclictest0-21swapper/521:43:505
2953199424125,126cyclictest57-21ksoftirqd/522:55:035
295279942441,84cyclictest0-21swapper/122:59:521
295339942382,338cyclictest0-21swapper/720:10:147
295319942383,338cyclictest0-21swapper/521:20:235
295309942383,338cyclictest0-21swapper/420:30:204
295299942382,338cyclictest0-21swapper/322:05:283
2952999423123,127cyclictest889-21ssh00:23:033
295289942341,126cyclictest0-21swapper/223:35:182
295269942386,127cyclictest101ktimersoftd/022:59:530
295329942281,338cyclictest0-21swapper/620:30:206
295319942281,338cyclictest26737-21wc22:30:245
295309942281,338cyclictest0-21swapper/423:25:204
295299942282,338cyclictest0-21swapper/323:57:213
295279942283,84cyclictest0-21swapper/122:20:131
295339942179,339cyclictest0-21swapper/723:25:207
295339942179,338cyclictest0-21swapper/700:31:167
295319942180,338cyclictest0-21swapper/523:57:245
2953199421164,84cyclictest121rcu_preempt21:52:225
295309942181,338cyclictest64450irq/122-eth022:20:134
295299942182,84cyclictest0-21swapper/323:25:203
295299942181,338cyclictest0-21swapper/300:11:433
295269942181,338cyclictest0-21swapper/021:52:340
295339942077,339cyclictest0-21swapper/721:43:567
2953399420121,126cyclictest73-21ksoftirqd/723:50:187
295329942079,338cyclictest0-21swapper/623:25:206
295319942081,337cyclictest0-21swapper/523:00:155
2953199420124,84cyclictest0-21swapper/523:10:205
295299942079,338cyclictest0-21swapper/323:00:143
295319941935,211cyclictest57-21ksoftirqd/521:35:185
295339941879,336cyclictest0-21swapper/719:14:587
295339941877,338cyclictest0-21swapper/721:20:237
2953199418164,84cyclictest561ktimersoftd/522:05:285
295309941878,337cyclictest0-21swapper/400:12:104
295299941839,168cyclictest0-21swapper/322:45:053
295289941839,3cyclictest0-21swapper/219:58:412
2952699418119,126cyclictest121rcu_preempt23:57:290
295309941734,126cyclictest0-21swapper/419:15:074
295299941777,338cyclictest0-21swapper/323:35:183
295299941777,338cyclictest0-21swapper/321:52:143
295299941636,296cyclictest0-21swapper/322:00:203
295269941675,338cyclictest0-21swapper/023:10:190
295299941575,338cyclictest0-21swapper/320:30:153
295279941577,83cyclictest0-21swapper/123:25:201
295309941474,338cyclictest0-21swapper/423:57:294
295299941434,296cyclictest0-21swapper/322:36:253
295269941434,254cyclictest0-21swapper/021:20:160
295339941332,8cyclictest0-21swapper/722:30:077
295329941231,45cyclictest121rcu_preempt20:10:116
295319941272,338cyclictest0-21swapper/523:25:205
295299941273,84cyclictest0-21swapper/321:43:503
295339941173,83cyclictest0-21swapper/723:43:047
295339941172,84cyclictest0-21swapper/722:45:167
295319941170,338cyclictest0-21swapper/520:30:205
295309941132,300cyclictest1841-21ntpq23:10:184
295309941070,338cyclictest0-21swapper/422:00:254
295299941030,296cyclictest0-21swapper/321:35:193
295339940969,84cyclictest0-21swapper/722:00:137
295339940969,84cyclictest0-21swapper/720:30:147
295339940869,84cyclictest0-21swapper/700:11:447
295289940828,3cyclictest0-21swapper/223:57:202
295339940766,126cyclictest73-21ksoftirqd/723:10:187
295319940564,338cyclictest0-21swapper/521:27:215
295289940565,338cyclictest0-21swapper/222:36:272
295289940524,84cyclictest0-21swapper/223:10:182
295279940566,84cyclictest0-21swapper/122:36:271
295279940566,84cyclictest0-21swapper/121:52:211
295339940465,83cyclictest0-21swapper/721:35:197
295289940464,338cyclictest0-21swapper/219:15:062
295339940318,211cyclictest0-21swapper/723:00:147
295309940364,169cyclictest0-21swapper/421:35:194
295269940363,338cyclictest0-21swapper/019:15:060
295299940261,339cyclictest0-21swapper/321:27:233
295279940118,253cyclictest0-21swapper/122:30:181
295279940057,211cyclictest0-21swapper/121:43:571
295299939915,211cyclictest401ktimersoftd/319:47:093
295339939859,84cyclictest0-21swapper/719:15:067
295319939857,338cyclictest0-21swapper/519:14:595
295309939656,337cyclictest0-21swapper/419:14:594
295339939556,84cyclictest0-21swapper/721:52:217
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional