You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-23 - 23:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 23, 2026 12:55:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
239139975233,639cyclictest0-21swapper/311:44:253
2391799742358,126cyclictest8366-21fschecks_count09:50:157
239139973816,719cyclictest0-21swapper/308:54:563
239139969398,592cyclictest0-21swapper/307:43:263
23912996879,126cyclictest21775-21kworker/u16:009:42:422
23913996814,466cyclictest0-21swapper/310:46:393
239119967335,507cyclictest0-21swapper/111:16:461
2391299666239,296cyclictest704-21nscd09:23:402
239139965217,126cyclictest0-21swapper/311:45:353
239129965213,127cyclictest0-21swapper/211:17:432
239139964894,380cyclictest0-21swapper/311:13:243
239139964852,593cyclictest0-21swapper/311:54:543
239139964852,593cyclictest0-21swapper/311:54:543
2391399634122,381cyclictest0-21swapper/308:36:023
239139963380,550cyclictest0-21swapper/310:08:143
2391599631121,507cyclictest0-21swapper/510:53:595
239139963134,84cyclictest0-21swapper/310:34:203
239139963134,84cyclictest0-21swapper/310:34:193
2391299630119,126cyclictest0-21swapper/210:55:092
2391299627116,380cyclictest0-21swapper/211:44:312
2391499626120,126cyclictest0-21swapper/410:45:504
2391499626115,508cyclictest0-21swapper/411:54:284
2391499626115,508cyclictest0-21swapper/411:54:284
239119961725,304cyclictest0-21swapper/110:08:301
239139961561,381cyclictest0-21swapper/310:59:043
2391299612103,127cyclictest0-21swapper/212:06:182
239169960912,381cyclictest0-21swapper/609:32:456
239109960614,126cyclictest2264-21ssh11:55:290
23917996058,338cyclictest0-21swapper/707:42:127
239119960514,124cyclictest0-21swapper/111:44:311
2391499600261,337cyclictest64450irq/122-eth007:50:094
239109960047,380cyclictest0-21swapper/008:41:110
23913995981,42cyclictest0-21swapper/308:44:253
23910995971,380cyclictest0-21swapper/009:50:150
23916995950,84cyclictest0-21swapper/611:51:336
23916995950,84cyclictest0-21swapper/611:51:336
239179959481,296cyclictest0-21swapper/711:53:507
239179959481,296cyclictest0-21swapper/711:53:507
239139959482,84cyclictest0-21swapper/310:41:563
23912995940,85cyclictest0-21swapper/211:51:332
23912995940,85cyclictest0-21swapper/211:51:332
23917995930,84cyclictest0-21swapper/711:11:537
23915995930,84cyclictest0-21swapper/511:51:335
23915995930,84cyclictest0-21swapper/511:51:325
23915995930,83cyclictest0-21swapper/509:03:215
239129959344,126cyclictest0-21swapper/209:51:122
239139959280,381cyclictest0-21swapper/309:53:163
239109959239,126cyclictest0-21swapper/011:20:360
239119958877,380cyclictest0-21swapper/107:17:121
239109958840,126cyclictest0-21swapper/009:16:110
239109958779,126cyclictest0-21swapper/011:44:540
2391299586162,127cyclictest14478-21kworker/u16:211:13:212
239169958233,90cyclictest0-21swapper/608:50:276
239149958233,126cyclictest0-21swapper/409:38:154
239129958174,126cyclictest0-21swapper/211:30:072
239129958174,126cyclictest0-21swapper/211:30:072
239119958031,345cyclictest0-21swapper/110:28:011
239109958032,92cyclictest0-21swapper/010:45:370
2391799578534,41cyclictest711rcuc/708:32:227
239159957870,127cyclictest0-21swapper/511:03:355
239129957724,84cyclictest0-21swapper/210:51:212
239139957622,126cyclictest0-21swapper/310:52:493
2391399576192,296cyclictest22046-21ssh12:24:143
239109957564,337cyclictest0-21swapper/012:24:050
239139957421,550cyclictest0-21swapper/311:24:143
239139957318,127cyclictest0-21swapper/309:18:183
2391299573102,296cyclictest0-21swapper/210:41:392
239119957323,126cyclictest0-21swapper/111:24:201
2391499572146,126cyclictest121rcu_preempt09:51:324
239139957261,508cyclictest0-21swapper/309:24:513
239109957219,338cyclictest0-21swapper/011:25:370
239109957118,126cyclictest0-21swapper/008:37:120
2391499570186,381cyclictest23908-21cyclictest07:43:164
239159956919,84cyclictest0-21swapper/509:53:245
239149956857,211cyclictest0-21swapper/411:16:314
239149956698,295cyclictest0-21swapper/412:24:554
239109956658,84cyclictest121rcu_preempt07:17:120
239169956512,296cyclictest0-21swapper/609:22:486
239139956512,550cyclictest0-21swapper/312:06:123
239159956410,381cyclictest0-21swapper/507:50:035
239109956294,211cyclictest0-21swapper/010:34:240
239109956294,211cyclictest0-21swapper/010:34:240
239129956051,127cyclictest0-21swapper/209:17:272
239119955546,507cyclictest0-21swapper/111:54:281
239119955546,507cyclictest0-21swapper/111:54:271
23917995533,381cyclictest0-21swapper/708:46:097
23910995512,127cyclictest2037-21sh11:16:560
2391699550511,3cyclictest641ktimersoftd/611:25:366
239159955082,465cyclictest0-21swapper/512:18:535
23911995500,84cyclictest0-21swapper/110:58:571
23910995500,84cyclictest0-21swapper/010:58:560
2391799549510,36cyclictest711rcuc/711:25:367
239129954938,338cyclictest0-21swapper/210:35:202
23910995496,375cyclictest0-21swapper/010:09:530
239149954837,339cyclictest49-21ksoftirqd/411:43:224
2391399548421,42cyclictest391rcuc/311:05:263
239139954837,508cyclictest0-21swapper/308:45:233
239129954882,211cyclictest0-21swapper/211:06:032
239109954840,126cyclictest0-21swapper/012:31:010
239129954681,42cyclictest0-21swapper/210:27:462
239139954574,85cyclictest401ktimersoftd/311:04:273
239109954579,84cyclictest0-21swapper/011:51:330
239109954579,84cyclictest0-21swapper/011:51:330
239109954536,127cyclictest0-21swapper/010:27:110
239149954477,464cyclictest23908-21cyclictest08:46:454
239139954337,427cyclictest0-21swapper/309:39:333
239109954378,210cyclictest0-21swapper/011:05:180
239149954231,295cyclictest32495-21cpuspeed_turbos09:10:174
239109954234,84cyclictest21865-21ssh11:46:430
2391799540283,126cyclictest0-21swapper/709:43:157
2391699539283,126cyclictest0-21swapper/608:48:486
2391499538112,211cyclictest5227-21turbostat11:04:554
239119953769,295cyclictest0-21swapper/112:31:261
239109953729,84cyclictest0-21swapper/009:21:380
239169953527,42cyclictest0-21swapper/609:40:006
239159953567,211cyclictest0-21swapper/508:49:475
239119953567,253cyclictest0-21swapper/110:49:041
2391199535278,126cyclictest11284-21ssh12:18:181
2391499534108,211cyclictest0-21swapper/410:54:324
2391199533111,126cyclictest0-21swapper/111:03:001
239149953225,127cyclictest0-21swapper/412:06:134
239119953166,211cyclictest0-21swapper/111:32:551
239119953166,211cyclictest0-21swapper/111:32:551
2391299530106,126cyclictest0-21swapper/207:43:142
239179952918,84cyclictest0-21swapper/710:27:587
2391499529484,42cyclictest471rcuc/411:24:164
239139952918,380cyclictest0-21swapper/311:15:553
2391799528230,83cyclictest0-21swapper/712:13:147
239129952720,295cyclictest0-21swapper/211:04:112
239159952560,84cyclictest121rcu_preempt11:13:205
239169952417,42cyclictest0-21swapper/609:25:156
2391399524267,254cyclictest401ktimersoftd/309:42:563
239139952411,380cyclictest0-21swapper/312:03:433
239119952415,84cyclictest0-21swapper/110:53:491
239129952212,127cyclictest0-21swapper/209:38:242
239169952116,331cyclictest0-21swapper/612:24:286
239119952198,126cyclictest0-21swapper/107:44:581
239119952153,211cyclictest25-21ksoftirqd/109:21:421
23917995207,84cyclictest0-21swapper/707:19:447
2391699520179,338cyclictest5742-1kworker/u17:009:54:336
239149952011,84cyclictest0-21swapper/410:34:454
239149952011,84cyclictest0-21swapper/410:34:454
239129951997,249cyclictest121rcu_preempt10:08:152
239109951911,211cyclictest0-21swapper/010:50:230
239119951850,380cyclictest31679-21diskmemload09:44:121
239109951796,295cyclictest121rcu_preempt09:55:230
23910995168,84cyclictest0-21swapper/011:03:280
239159951588,341cyclictest0-21swapper/510:34:455
239159951588,341cyclictest0-21swapper/510:34:455
239149951446,295cyclictest0-21swapper/412:44:514
23912995146,127cyclictest0-21swapper/212:44:512
23911995144,126cyclictest0-21swapper/110:13:341
23911995144,126cyclictest0-21swapper/110:13:341
23911995135,84cyclictest0-21swapper/110:42:291
2391099513430,3cyclictest111rcuc/007:44:260
2391699512338,84cyclictest0-21swapper/611:13:206
239179951083,211cyclictest0-21swapper/710:52:507
239169951042,211cyclictest0-21swapper/610:52:066
239159951042,126cyclictest0-21swapper/509:43:465
239149951041,211cyclictest0-21swapper/411:30:114
239149951041,211cyclictest0-21swapper/411:30:114
23917995090,84cyclictest0-21swapper/711:20:377
23916995090,84cyclictest0-21swapper/609:03:216
23915995091,126cyclictest3866-21ssh10:59:045
239149950982,211cyclictest1551-21snmpd11:45:574
239109950941,346cyclictest0-21swapper/012:45:020
23910995091,84cyclictest0-21swapper/009:10:190
23917995080,83cyclictest0-21swapper/712:24:057
2391599508336,42cyclictest0-21swapper/512:25:215
239159950782,252cyclictest31679-21diskmemload09:36:305
239139950737,296cyclictest41-21ksoftirqd/311:55:193
2391599506123,253cyclictest31679-21diskmemload12:06:065
239129950638,126cyclictest0-21swapper/208:40:392
239159950579,210cyclictest57-21ksoftirqd/512:30:205
2391799504120,126cyclictest0-21swapper/711:18:207
239139950434,166cyclictest0-21swapper/312:30:153
239129950435,296cyclictest0-21swapper/209:45:142
2391299504124,296cyclictest23908-21cyclictest12:24:432
2391199504120,169cyclictest25-21ksoftirqd/108:43:491
239109950434,337cyclictest0-21swapper/010:40:560
239109950381,253cyclictest121rcu_preempt12:04:450
239179950276,211cyclictest0-21swapper/708:43:517
2391699502287,83cyclictest31826-21kworker/u16:312:41:326
239129950280,84cyclictest0-21swapper/212:30:192
239109950275,169cyclictest0-21swapper/012:05:350
239109950233,211cyclictest16243-21taskset07:50:070
239149950177,211cyclictest49-21ksoftirqd/411:05:224
239139950136,387cyclictest0-21swapper/309:45:123
239169949930,253cyclictest0-21swapper/608:43:106
239139949973,423cyclictest23908-21cyclictest09:10:163
239139949934,127cyclictest18194-21ssh11:25:503
239119949973,211cyclictest0-21swapper/109:55:201
239119949934,296cyclictest0-21swapper/108:36:311
2391199499328,169cyclictest8999-1kworker/u17:109:32:441
239149949834,169cyclictest0-21swapper/408:40:444
239179949770,296cyclictest0-21swapper/709:55:207
239119949733,130cyclictest0-21swapper/112:25:321
239109949627,423cyclictest0-21swapper/011:13:020
239179949567,169cyclictest0-21swapper/710:33:237
239179949567,169cyclictest0-21swapper/710:33:227
2391199495116,295cyclictest0-21swapper/110:34:291
2391199495116,295cyclictest0-21swapper/110:34:291
239169949428,211cyclictest0-21swapper/609:42:566
2391599494112,126cyclictest0-21swapper/507:16:585
239149949469,422cyclictest0-21swapper/410:27:584
239139949425,466cyclictest28876-21sh10:18:313
239139949424,127cyclictest0-21swapper/308:06:043
239109949431,252cyclictest20941-21latency08:50:250
239159949327,125cyclictest121rcu_preempt08:35:295
239149949368,422cyclictest0-21swapper/410:42:084
239119949368,294cyclictest0-21swapper/109:38:451
239119949329,84cyclictest0-21swapper/111:55:031
239119949234,168cyclictest121rcu_preempt09:50:161
239159949166,422cyclictest0-21swapper/510:27:585
239129949167,84cyclictest0-21swapper/211:21:042
2391299491276,84cyclictest0-21swapper/211:45:232
239129949126,42cyclictest0-21swapper/208:48:002
239159949024,127cyclictest20709-21ssh11:45:395
239129949064,127cyclictest121rcu_preempt08:50:212
239109949064,338cyclictest0-21swapper/009:42:420
239109949025,83cyclictest0-21swapper/010:38:280
239139948962,169cyclictest0-21swapper/310:27:473
239139948924,385cyclictest0-21swapper/311:38:063
239109948923,84cyclictest0-21swapper/011:39:000
239179948760,84cyclictest0-21swapper/709:21:097
239169948761,295cyclictest0-21swapper/611:40:236
2391499487148,84cyclictest64450irq/122-eth009:40:174
239159948621,84cyclictest0-21swapper/508:41:225
239149948622,42cyclictest0-21swapper/412:26:004
239139948415,466cyclictest11696-21ssh12:18:373
2391799483142,338cyclictest17096-21ssh11:43:517
239169948319,332cyclictest31679-21diskmemload09:45:126
239159948314,84cyclictest0-21swapper/510:46:025
239129948356,257cyclictest121rcu_preempt12:25:382
239119948357,211cyclictest0-21swapper/111:12:141
2391199483103,338cyclictest0-21swapper/111:46:421
2391099483226,254cyclictest19139-21sshd08:48:250
239179948260,84cyclictest0-21swapper/712:42:157
2391199482103,255cyclictest0-21swapper/108:49:591
239149948115,126cyclictest0-21swapper/407:17:174
239119948116,83cyclictest121rcu_preempt11:05:221
239159948011,126cyclictest121rcu_preempt11:30:265
239159948011,126cyclictest121rcu_preempt11:30:265
239129948015,41cyclictest0-21swapper/207:57:582
239109948016,253cyclictest0-21swapper/012:18:380
239149947953,210cyclictest49-21ksoftirqd/409:45:234
239149947910,84cyclictest0-21swapper/410:13:354
239149947910,84cyclictest0-21swapper/410:13:354
23913994789,169cyclictest0-21swapper/310:38:153
239139947852,253cyclictest9472-21taskset09:33:043
239129947810,260cyclictest0-21swapper/211:37:582
239119947852,211cyclictest25-21ksoftirqd/112:24:081
239119947813,8cyclictest0-21swapper/112:38:301
239149947610,84cyclictest0-21swapper/411:13:234
23910994757,295cyclictest0-21swapper/009:36:330
239179947452,126cyclictest0-21swapper/710:44:287
23917994744,254cyclictest0-21swapper/711:30:167
23917994744,254cyclictest0-21swapper/711:30:167
239159947245,296cyclictest0-21swapper/509:16:305
23914994723,338cyclictest0-21swapper/410:35:154
23916994711,211cyclictest0-21swapper/607:44:286
23913994711,338cyclictest0-21swapper/308:24:553
2391699470132,172cyclictest641ktimersoftd/611:05:326
23910994701,85cyclictest0-21swapper/011:30:330
23910994701,85cyclictest0-21swapper/011:30:330
239119946847,343cyclictest0-21swapper/112:04:371
239159946782,296cyclictest121rcu_preempt08:50:145
2391499467126,338cyclictest64450irq/122-eth011:55:174
239179946681,211cyclictest73-21ksoftirqd/710:46:407
239169946642,126cyclictest0-21swapper/612:04:016
2391699466124,338cyclictest0-21swapper/612:05:546
2391699466123,340cyclictest0-21swapper/607:17:196
239129946679,126cyclictest0-21swapper/207:45:062
239179946581,169cyclictest0-21swapper/711:38:137
2391699465124,339cyclictest0-21swapper/610:09:536
2391699465124,338cyclictest24530-21/usr/sbin/munin11:30:166
2391699465124,338cyclictest24530-21/usr/sbin/munin11:30:166
2391699465124,338cyclictest0-21swapper/608:06:046
2391699465122,340cyclictest0-21swapper/610:48:196
23915994651,84cyclictest121rcu_preempt10:40:585
239139946582,381cyclictest0-21swapper/307:45:273
2391299465124,338cyclictest0-21swapper/207:17:192
2391799464123,338cyclictest12531-21ssh11:03:357
239159946482,210cyclictest57-21ksoftirqd/511:20:595
2391299464124,338cyclictest0-21swapper/211:29:522
239119946479,211cyclictest0-21swapper/109:15:411
2391699463123,337cyclictest0-21swapper/610:44:186
239159946379,210cyclictest57-21ksoftirqd/511:38:195
239129946379,126cyclictest121rcu_preempt08:36:452
2391299463122,338cyclictest0-21swapper/210:48:192
2391699462123,296cyclictest0-21swapper/611:45:326
239149946240,213cyclictest31679-21diskmemload10:09:554
239149946239,256cyclictest0-21swapper/412:04:564
2391299462418,42cyclictest321ktimersoftd/212:18:542
239109946240,256cyclictest0-21swapper/009:49:260
2391799461205,254cyclictest31679-21diskmemload11:59:407
2391699461121,338cyclictest0-21swapper/611:24:306
2391699461121,338cyclictest0-21swapper/609:55:216
239149946140,255cyclictest0-21swapper/409:15:284
2391499461120,338cyclictest0-21swapper/409:22:124
2391399461118,211cyclictest17276-21processes09:55:213
2391199461121,126cyclictest674-21sh10:37:471
239109946140,295cyclictest0-21swapper/012:25:110
239179946079,85cyclictest0-21swapper/712:30:117
239149946038,256cyclictest0-21swapper/410:58:264
239129946036,84cyclictest121rcu_preempt12:04:242
239119946077,295cyclictest0-21swapper/111:38:531
239179945978,83cyclictest0-21swapper/709:45:237
239159945933,83cyclictest121rcu_preempt11:05:145
239159945933,3cyclictest0-21swapper/509:10:085
239139945978,84cyclictest0-21swapper/312:41:543
239139945936,338cyclictest0-21swapper/309:25:143
239119945975,261cyclictest0-21swapper/108:50:111
239119945932,296cyclictest0-21swapper/109:14:141
2391499458118,338cyclictest0-21swapper/411:25:444
239179945776,212cyclictest73-21ksoftirqd/711:45:247
2391699457116,338cyclictest0-21swapper/611:55:496
2391699457116,338cyclictest0-21swapper/611:04:236
239129945776,84cyclictest0-21swapper/210:23:282
2391299457116,338cyclictest0-21swapper/209:55:232
2391299457115,339cyclictest23908-21cyclictest11:55:492
239179945634,256cyclictest0-21swapper/709:18:097
2391699456284,84cyclictest698-21ptp4l09:17:256
239169945628,169cyclictest0-21swapper/608:36:026
239149945672,211cyclictest11584-21fschecks_time08:35:184
2391499456115,338cyclictest0-21swapper/408:50:134
2391399456115,338cyclictest698-21ptp4l11:30:113
2391399456115,338cyclictest698-21ptp4l11:30:113
239119945632,211cyclictest0-21swapper/112:06:181
239119945631,168cyclictest0-21swapper/111:25:271
239169945576,84cyclictest0-21swapper/610:23:286
239159945533,3cyclictest0-21swapper/509:21:395
239149945533,256cyclictest0-21swapper/409:32:574
239119945573,84cyclictest27420-21ssh12:45:011
239159945432,126cyclictest0-21swapper/509:49:305
239139945326,126cyclictest0-21swapper/307:16:273
239159945268,211cyclictest0-21swapper/512:24:325
239149945271,126cyclictest121rcu_preempt11:39:034
239139945230,84cyclictest0-21swapper/312:25:333
239159945129,85cyclictest0-21swapper/511:25:415
239149945128,84cyclictest0-21swapper/412:31:004
2391499451283,83cyclictest14513-21cut07:45:234
239139945031,80cyclictest1553-21runrttasks07:23:083
2391399450111,84cyclictest0-21swapper/310:13:353
2391399450111,84cyclictest0-21swapper/310:13:353
239109945029,253cyclictest0-21swapper/012:39:230
239109945028,42cyclictest0-21swapper/008:05:140
2391599449108,338cyclictest0-21swapper/507:43:525
239129944925,126cyclictest0-21swapper/208:05:152
239119944825,177cyclictest0-21swapper/110:23:281
239169944664,84cyclictest0-21swapper/610:32:366
239169944664,84cyclictest0-21swapper/610:32:366
239129944665,84cyclictest0-21swapper/210:32:362
239129944665,84cyclictest0-21swapper/210:32:362
239119944562,380cyclictest0-21swapper/109:45:221
2391699444107,171cyclictest0-21swapper/610:38:206
2391699444106,253cyclictest0-21swapper/612:30:206
239129944362,84cyclictest0-21swapper/212:13:122
239109944321,218cyclictest0-21swapper/007:45:200
239179944262,84cyclictest0-21swapper/712:38:447
2391699442100,127cyclictest121rcu_preempt10:58:476
239159944258,126cyclictest23908-21cyclictest12:03:425
2391599442184,127cyclictest121rcu_preempt11:44:525
2391499442187,253cyclictest64450irq/122-eth012:18:564
2391299442187,253cyclictest0-21swapper/209:32:412
239159944117,84cyclictest121rcu_preempt11:55:105
2391599441100,126cyclictest57-21ksoftirqd/512:38:565
239129944119,46cyclictest0-21swapper/209:25:162
239169944099,338cyclictest0-21swapper/610:27:396
239109944059,84cyclictest0-21swapper/009:03:210
239179943959,84cyclictest0-21swapper/710:57:427
239179943957,209cyclictest0-21swapper/708:14:077
239159943916,126cyclictest121rcu_preempt10:08:115
239119943916,253cyclictest0-21swapper/110:18:401
239159943858,213cyclictest26428-21df_inode09:25:155
239159943816,256cyclictest0-21swapper/507:45:125
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional