You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 20:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Jul 15, 2026 12:58:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
226839980338,762cyclictest0-21swapper/708:54:427
226789978928,127cyclictest0-21swapper/211:42:022
226839974161,677cyclictest0-21swapper/709:57:537
2267699731220,338cyclictest0-21swapper/011:42:020
226839972545,677cyclictest0-21swapper/710:04:447
2267999689181,126cyclictest31974-21rm11:18:013
22680996750,126cyclictest9376-21taskset11:45:144
2267799672163,296cyclictest22674-21cyclictest09:24:151
226809966734,381cyclictest0-21swapper/409:15:224
226809966734,381cyclictest0-21swapper/409:15:224
226789966732,127cyclictest0-21swapper/210:39:562
226819966673,211cyclictest0-21swapper/511:35:115
2268199665112,380cyclictest0-21swapper/510:04:335
226789966428,127cyclictest0-21swapper/209:11:442
226829964756,126cyclictest0-21swapper/610:01:586
22683996469,634cyclictest0-21swapper/712:29:287
2268299635166,126cyclictest121rcu_preempt11:08:006
226839963336,594cyclictest0-21swapper/710:38:187
226829963278,338cyclictest0-21swapper/612:03:186
2268199632294,84cyclictest31334-1kworker/u17:111:08:145
226789963236,338cyclictest1198-21cron12:20:002
2268399631123,126cyclictest0-21swapper/711:27:547
2267999630121,296cyclictest0-21swapper/311:53:303
2267999630121,296cyclictest0-21swapper/311:53:303
2267999630121,296cyclictest0-21swapper/311:53:303
2268099626157,296cyclictest121rcu_preempt07:24:344
2267799624541,4cyclictest241ktimersoftd/112:04:051
226829962272,380cyclictest0-21swapper/607:24:366
2268099620280,338cyclictest64450irq/122-eth010:58:174
2267899619107,381cyclictest0-21swapper/210:00:332
226819961822,380cyclictest0-21swapper/511:27:065
226839961764,550cyclictest0-21swapper/711:19:007
226809961663,253cyclictest24456-21perf11:35:064
226839961459,381cyclictest0-21swapper/709:14:167
226789961421,126cyclictest0-21swapper/209:59:382
226779961258,296cyclictest0-21swapper/111:53:351
226779961258,296cyclictest0-21swapper/111:53:351
226779961258,296cyclictest0-21swapper/111:53:351
2267799612105,126cyclictest0-21swapper/111:31:591
2267699611100,295cyclictest0-21swapper/009:11:580
2267999610311,126cyclictest0-21swapper/310:54:333
226799960754,296cyclictest0-21swapper/312:07:543
226829960551,380cyclictest0-21swapper/612:09:236
226769960411,126cyclictest0-21swapper/011:53:430
226769960411,126cyclictest0-21swapper/011:53:430
226769960411,126cyclictest0-21swapper/011:53:420
226799960349,381cyclictest0-21swapper/309:55:323
2267799596252,338cyclictest31863-1kworker/u17:212:27:101
22676995964,126cyclictest0-21swapper/010:57:090
226839959541,423cyclictest0-21swapper/711:35:147
22679995954,84cyclictest0-21swapper/312:28:533
2268399594126,295cyclictest0-21swapper/711:09:517
22681995930,84cyclictest0-21swapper/512:09:535
2267999593124,254cyclictest8638-21ssh11:44:473
2268199592122,296cyclictest0-21swapper/509:22:435
226819959180,296cyclictest0-21swapper/512:19:255
2267899589503,84cyclictest311rcuc/212:30:102
226809958334,340cyclictest0-21swapper/410:53:354
226809958229,422cyclictest1806-21/usr/sbin/munin12:20:174
226789958228,380cyclictest0-21swapper/211:17:092
226769958271,380cyclictest0-21swapper/012:08:180
226799958170,126cyclictest0-21swapper/310:01:543
2267799579111,295cyclictest0-21swapper/111:17:531
226839957825,550cyclictest0-21swapper/712:08:497
226779957825,342cyclictest0-21swapper/112:44:061
2268099576150,210cyclictest0-21swapper/411:09:294
226819957565,338cyclictest0-21swapper/509:58:205
226819957524,126cyclictest0-21swapper/507:23:405
2268399574104,296cyclictest0-21swapper/710:51:437
226769957462,296cyclictest0-21swapper/012:28:210
2267899570104,126cyclictest121rcu_preempt11:09:152
226779957020,262cyclictest0-21swapper/110:03:011
226809956916,84cyclictest0-21swapper/411:27:534
226779956314,253cyclictest0-21swapper/110:55:001
226829956213,381cyclictest0-21swapper/611:35:156
226769956150,126cyclictest31073-21diskmemload12:03:080
226829955993,84cyclictest0-21swapper/609:25:016
22682995577,126cyclictest0-21swapper/611:53:396
22682995577,126cyclictest0-21swapper/611:53:396
22682995577,126cyclictest0-21swapper/611:53:396
226829955745,338cyclictest0-21swapper/609:59:296
2268099554297,126cyclictest0-21swapper/409:23:194
22682995521,42cyclictest0-21swapper/610:19:326
226799955282,296cyclictest0-21swapper/311:07:043
226839955039,508cyclictest0-21swapper/711:43:067
226799955042,126cyclictest0-21swapper/311:31:583
2267999550122,253cyclictest0-21swapper/309:15:233
2267999550122,253cyclictest0-21swapper/309:15:233
22676995501,126cyclictest0-21swapper/010:27:540
226809954940,2cyclictest0-21swapper/412:07:414
2268299548122,296cyclictest0-21swapper/611:41:156
2268199548465,3cyclictest551rcuc/510:57:005
226789954882,127cyclictest0-21swapper/211:31:582
226779954879,296cyclictest0-21swapper/112:17:011
226819954736,381cyclictest0-21swapper/511:20:175
226779954778,296cyclictest0-21swapper/110:39:551
2267699547208,84cyclictest31325-1kworker/u17:011:45:230
226839954677,211cyclictest31023-21runrttasks10:59:307
226839954635,508cyclictest0-21swapper/712:18:547
2268199546464,3cyclictest551rcuc/511:45:195
226789954634,296cyclictest0-21swapper/212:07:102
226779954677,296cyclictest0-21swapper/110:58:571
226769954681,126cyclictest0-21swapper/009:22:430
2267699546289,126cyclictest0-21swapper/010:54:570
226799954575,296cyclictest0-21swapper/312:16:153
226789954538,254cyclictest0-21swapper/210:56:312
226839954477,127cyclictest0-21swapper/711:31:587
226819954432,338cyclictest17622-21ssh11:10:165
226789954435,127cyclictest29972-21/usr/sbin/munin10:20:222
226769954479,126cyclictest0-21swapper/011:29:460
2268199543289,126cyclictest0-21swapper/509:13:075
226799954376,84cyclictest0-21swapper/309:22:393
226799954374,338cyclictest0-21swapper/308:24:523
226779954334,127cyclictest0-21swapper/110:27:051
2267699543328,84cyclictest0-21swapper/009:56:370
226809954278,84cyclictest0-21swapper/409:12:044
226789954232,127cyclictest0-21swapper/210:17:492
2267899542115,296cyclictest0-21swapper/210:51:252
226769954277,126cyclictest0-21swapper/011:07:490
226809954133,84cyclictest0-21swapper/411:53:314
226809954133,84cyclictest0-21swapper/411:53:314
226809954133,84cyclictest0-21swapper/411:53:304
226769954176,296cyclictest0-21swapper/012:17:370
226769954176,253cyclictest0-21swapper/011:33:080
226839954029,508cyclictest0-21swapper/709:25:237
2268399540114,296cyclictest11862-21ssh12:43:167
226779953971,338cyclictest0-21swapper/109:15:241
226779953971,338cyclictest0-21swapper/109:15:231
2267799539114,253cyclictest0-21swapper/108:55:081
2267699539118,126cyclictest0-21swapper/010:00:380
2268399538151,126cyclictest31449-21kworker/u16:209:24:127
2267999538324,84cyclictest0-21swapper/310:59:143
226789953827,85cyclictest0-21swapper/212:42:412
226779953829,126cyclictest0-21swapper/112:07:081
226779953828,380cyclictest0-21swapper/109:57:391
226839953769,465cyclictest0-21swapper/712:04:267
226829953625,84cyclictest0-21swapper/612:18:466
226789953625,296cyclictest0-21swapper/209:25:262
226789953624,338cyclictest0-21swapper/208:24:342
226769953629,295cyclictest0-21swapper/007:53:480
226839953568,84cyclictest0-21swapper/711:10:167
226799953565,344cyclictest31073-21diskmemload11:29:463
2267899535108,296cyclictest0-21swapper/210:05:132
226829953263,296cyclictest16928-21ssh11:28:356
2268099532236,84cyclictest64450irq/122-eth012:19:514
226799953266,211cyclictest0-21swapper/312:10:253
226819953123,84cyclictest0-21swapper/510:27:415
2267799531148,84cyclictest121rcu_preempt11:09:291
226839953019,508cyclictest0-21swapper/711:53:077
226839953019,508cyclictest0-21swapper/711:53:077
226839953019,508cyclictest0-21swapper/711:53:077
226829953023,84cyclictest0-21swapper/610:39:266
226829953022,338cyclictest0-21swapper/611:35:006
226789952960,296cyclictest22674-21cyclictest09:23:102
226789952921,126cyclictest0-21swapper/207:23:492
226799952821,84cyclictest0-21swapper/310:20:143
2267999528101,296cyclictest0-21swapper/310:27:553
226839952720,126cyclictest0-21swapper/711:20:167
226829952762,381cyclictest0-21swapper/609:14:596
226809952720,126cyclictest0-21swapper/412:29:524
226789952759,254cyclictest0-21swapper/211:52:142
226789952759,254cyclictest0-21swapper/211:52:142
226789952759,254cyclictest0-21swapper/211:52:142
2267699527100,211cyclictest0-21swapper/010:20:220
226839952616,507cyclictest0-21swapper/710:29:457
226789952618,126cyclictest0-21swapper/211:35:162
226769952618,126cyclictest0-21swapper/007:24:340
226799952459,338cyclictest0-21swapper/312:05:033
226769952417,84cyclictest0-21swapper/010:38:390
226799952310,339cyclictest0-21swapper/311:20:273
226829952110,126cyclictest0-21swapper/610:52:326
226819952156,84cyclictest121rcu_preempt11:51:235
226819952156,84cyclictest121rcu_preempt11:51:235
226819952156,84cyclictest121rcu_preempt11:51:235
226799952110,380cyclictest0-21swapper/309:25:093
22676995198,296cyclictest0-21swapper/012:42:360
22682995187,126cyclictest0-21swapper/608:54:426
22680995150,84cyclictest32683-21ssh10:05:014
22680995124,84cyclictest0-21swapper/408:24:354
2267899511127,169cyclictest11645-21sh10:27:482
226779951041,296cyclictest0-21swapper/111:43:431
22682995090,84cyclictest0-21swapper/610:29:576
226809950983,423cyclictest0-21swapper/410:29:414
22680995090,84cyclictest0-21swapper/411:44:224
226799950983,423cyclictest0-21swapper/309:14:163
22676995091,84cyclictest0-21swapper/011:17:530
226839950882,126cyclictest73-21ksoftirqd/710:05:057
226809950878,211cyclictest49-21ksoftirqd/410:39:494
226779950882,211cyclictest25-21ksoftirqd/109:25:221
226819950640,84cyclictest22674-21cyclictest12:42:355
22681995050,80cyclictest0-21swapper/511:44:215
226829950476,296cyclictest0-21swapper/612:28:076
226839950334,466cyclictest0-21swapper/708:24:447
2268099503119,253cyclictest121rcu_preempt07:51:344
226789950338,296cyclictest0-21swapper/211:26:382
2267699503246,123cyclictest22022-21kworker/u16:010:18:010
226839950280,338cyclictest0-21swapper/710:20:227
2268299501244,127cyclictest0-21swapper/611:55:066
2268099501118,126cyclictest49-21ksoftirqd/412:05:024
226779950135,127cyclictest0-21swapper/112:30:121
2268199500119,126cyclictest17212-21ssh12:28:485
226809950077,338cyclictest0-21swapper/412:45:204
226789950035,298cyclictest0-21swapper/208:55:032
226779950031,84cyclictest0-21swapper/111:26:231
226769949830,465cyclictest0-21swapper/009:25:250
226829949773,84cyclictest0-21swapper/610:55:176
226839949672,422cyclictest0-21swapper/710:19:057
226819949673,84cyclictest0-21swapper/510:19:225
226819949628,339cyclictest0-21swapper/508:54:555
226809949632,45cyclictest0-21swapper/409:58:194
226799949668,296cyclictest0-21swapper/311:35:233
2267799496282,84cyclictest29344-1kworker/u17:009:13:071
2267899495110,127cyclictest33-21ksoftirqd/209:15:162
2267899495110,127cyclictest33-21ksoftirqd/209:15:162
226789949326,127cyclictest17368-21ssh12:29:012
226779949367,423cyclictest0-21swapper/111:20:281
226809949228,177cyclictest0-21swapper/409:25:274
226789949024,84cyclictest18475-21taskset12:10:232
226779949025,88cyclictest0-21swapper/110:18:201
226839948924,3cyclictest0-21swapper/707:23:587
226769948966,126cyclictest121rcu_preempt08:54:320
226769948966,126cyclictest0-21swapper/008:24:490
226769948964,295cyclictest0-21swapper/011:35:150
226819948866,84cyclictest0-21swapper/512:45:235
226829948761,211cyclictest10869-21ssh12:42:186
2268299487103,296cyclictest0-21swapper/610:20:166
226809948723,252cyclictest27872-21chrt10:19:434
226809948717,126cyclictest0-21swapper/411:16:414
2267999486100,212cyclictest0-21swapper/308:54:283
226779948622,84cyclictest0-21swapper/107:24:191
226819948419,42cyclictest0-21swapper/511:16:545
2267999484104,85cyclictest0-21swapper/307:25:073
2267999484104,85cyclictest0-21swapper/307:25:073
226839948360,254cyclictest0-21swapper/711:45:187
226819948113,303cyclictest0-21swapper/512:04:535
226839948096,253cyclictest22674-21cyclictest10:30:067
22681994799,85cyclictest0-21swapper/509:15:175
22681994799,85cyclictest0-21swapper/509:15:165
226819947896,90cyclictest0-21swapper/508:25:065
22683994769,126cyclictest0-21swapper/709:15:127
22683994769,126cyclictest0-21swapper/709:15:117
22682994768,84cyclictest121rcu_preempt07:54:256
22681994745,296cyclictest0-21swapper/507:55:005
226819947246,83cyclictest0-21swapper/509:25:155
226809947292,212cyclictest0-21swapper/410:40:034
226829947145,253cyclictest31187-21sh11:17:096
22683994691,465cyclictest0-21swapper/708:25:167
22682994681,211cyclictest0-21swapper/608:24:416
22676994684,84cyclictest3031-21ssh11:20:240
2268199464123,126cyclictest121rcu_preempt10:54:385
226809946341,3cyclictest0-21swapper/412:43:084
226799946377,211cyclictest28211-21ssh10:36:473
226789946341,84cyclictest0-21swapper/212:03:432
226819946281,84cyclictest29802-21ssh10:39:065
226779946240,255cyclictest0-21swapper/108:54:121
226799946178,381cyclictest0-21swapper/312:44:213
2267999460120,338cyclictest0-21swapper/311:45:203
2267799460121,84cyclictest0-21swapper/107:53:111
226809945938,2cyclictest0-21swapper/408:50:514
226809945938,134cyclictest49-21ksoftirqd/412:30:144
2267999459119,90cyclictest0-21swapper/310:17:413
2267799459118,338cyclictest0-21swapper/110:30:121
226839945834,387cyclictest0-21swapper/707:53:267
2268299458117,338cyclictest0-21swapper/612:10:266
2268199458202,253cyclictest31449-21kworker/u16:210:40:035
226789945835,296cyclictest0-21swapper/211:20:072
226779945836,256cyclictest0-21swapper/112:10:221
2267699457119,84cyclictest22463-21runrttasks08:55:070
226809945630,299cyclictest0-21swapper/410:30:074
2267699456115,338cyclictest0-21swapper/012:10:130
226809945529,257cyclictest0-21swapper/412:10:254
226799945533,2cyclictest0-21swapper/311:10:153
226779945533,84cyclictest0-21swapper/111:45:131
226839945474,84cyclictest0-21swapper/707:55:217
2268299454113,338cyclictest22674-21cyclictest11:45:206
2268199453196,126cyclictest30063-21latency10:20:255
226809945331,177cyclictest0-21swapper/411:20:034
226799945230,42cyclictest0-21swapper/307:55:133
2268199450108,127cyclictest57-21ksoftirqd/512:20:265
226809945027,3cyclictest0-21swapper/408:55:174
2267899448110,336cyclictest10147-21fschecks_count11:45:182
226769944868,84cyclictest0-21swapper/011:10:160
226809944724,42cyclictest0-21swapper/410:20:284
226829944623,256cyclictest0-21swapper/611:10:156
226769944619,254cyclictest0-21swapper/007:25:110
226769944619,254cyclictest0-21swapper/007:25:100
226839944566,84cyclictest0-21swapper/708:55:247
226839944519,423cyclictest538-21rm11:00:157
2268199445188,126cyclictest57-21ksoftirqd/510:30:045
226769944518,254cyclictest0-21swapper/010:30:030
226839944422,255cyclictest0-21swapper/712:10:237
226779944422,338cyclictest0-21swapper/110:05:121
226809944317,7cyclictest121rcu_preempt11:00:104
226799944359,130cyclictest0-21swapper/307:24:203
2267699443145,126cyclictest121rcu_preempt07:55:070
226809944221,45cyclictest0-21swapper/408:25:164
2268099442100,254cyclictest19472-21tune2fs07:55:184
226799944258,126cyclictest121rcu_preempt11:00:153
2268099441144,84cyclictest121rcu_preempt07:25:094
2268099441144,84cyclictest121rcu_preempt07:25:094
2267899441102,336cyclictest0-21swapper/208:55:172
2267899439100,126cyclictest0-21swapper/212:45:272
226779943915,126cyclictest0-21swapper/111:55:061
226789943854,211cyclictest0-21swapper/207:25:102
226789943854,211cyclictest0-21swapper/207:25:102
226769943512,84cyclictest121rcu_preempt09:15:160
226769943512,84cyclictest121rcu_preempt09:15:160
22678994349,253cyclictest0-21swapper/207:51:172
226799943210,42cyclictest0-21swapper/310:40:033
22678994328,84cyclictest0-21swapper/210:30:032
226779943210,42cyclictest0-21swapper/111:35:221
226779943050,296cyclictest0-21swapper/110:20:131
2267799429346,3cyclictest241ktimersoftd/108:21:161
22678994284,84cyclictest0-21swapper/211:55:062
22677994286,84cyclictest0-21swapper/111:10:291
22677994284,84cyclictest0-21swapper/107:55:141
226809942742,169cyclictest481ktimersoftd/411:35:154
22682994240,84cyclictest7456-21cstates09:15:136
22682994240,84cyclictest7456-21cstates09:15:136
22681994241,84cyclictest23836-21/usr/sbin/munin08:55:235
22681994241,84cyclictest0-21swapper/508:24:345
22676994241,84cyclictest0-21swapper/012:45:230
226799942382,339cyclictest0-21swapper/307:53:523
226769942383,338cyclictest0-21swapper/012:30:140
226829942141,2cyclictest0-21swapper/607:25:086
226829942141,2cyclictest0-21swapper/607:25:086
226789942140,296cyclictest0-21swapper/211:10:102
226809942035,253cyclictest0-21swapper/411:10:174
226799942040,296cyclictest0-21swapper/312:45:253
226789942039,296cyclictest0-21swapper/207:55:142
226799941737,296cyclictest0-21swapper/308:55:233
226819941678,83cyclictest0-21swapper/512:10:105
226779941676,338cyclictest0-21swapper/107:25:101
226779941676,338cyclictest0-21swapper/107:25:101
226829941576,84cyclictest0-21swapper/611:20:296
226789941536,295cyclictest0-21swapper/212:20:252
226769941536,41cyclictest121rcu_preempt12:20:250
226839941472,339cyclictest0-21swapper/707:25:117
226839941472,339cyclictest0-21swapper/707:25:107
226799941472,339cyclictest0-21swapper/312:20:273
226819941374,84cyclictest25406-21cstates11:35:215
226769941373,338cyclictest0-21swapper/010:40:020
226839941228,127cyclictest0-21swapper/712:30:067
226829941273,84cyclictest0-21swapper/608:55:186
226829941071,84cyclictest0-21swapper/609:25:286
226799941031,376cyclictest0-21swapper/312:30:123
226839940968,338cyclictest0-21swapper/712:45:237
226819940971,83cyclictest0-21swapper/509:35:095
226839940869,84cyclictest0-21swapper/711:55:077
226829940870,83cyclictest0-21swapper/609:35:086
226799940868,338cyclictest14370-21sh10:30:113
226839940726,297cyclictest0-21swapper/712:20:267
226789940728,295cyclictest0-21swapper/208:25:142
226789940626,296cyclictest0-21swapper/211:00:112
226839940467,84cyclictest0-21swapper/709:35:097
226809940424,3cyclictest0-21swapper/409:35:104
226799940422,42cyclictest0-21swapper/308:25:143
226769940464,337cyclictest0-21swapper/010:05:050
226799940361,339cyclictest0-21swapper/310:05:053
226779940223,84cyclictest0-21swapper/111:00:151
226819940117,211cyclictest0-21swapper/507:55:145
226789939956,341cyclictest0-21swapper/210:40:022
226829939798,126cyclictest0-21swapper/607:55:086
226829939616,218cyclictest0-21swapper/610:30:036
226789939556,84cyclictest0-21swapper/209:35:092
226779939555,337cyclictest0-21swapper/112:20:251
226819939414,84cyclictest0-21swapper/511:00:175
226839939252,338cyclictest0-21swapper/710:40:027
226819939215,246cyclictest0-21swapper/512:30:045
22676993867,83cyclictest0-21swapper/009:35:080
2267699381124,126cyclictest9-21ksoftirqd/008:25:060
226819937941,84cyclictest0-21swapper/510:05:075
226769937781,84cyclictest0-21swapper/011:00:030
226829937680,84cyclictest121rcu_preempt12:30:116
226829937678,126cyclictest0-21swapper/608:25:156
226809937640,2cyclictest0-21swapper/410:05:114
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional