You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-12 - 23:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun Jul 12, 2026 12:58:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
292989975432,719cyclictest0-21swapper/709:29:287
292919975128,127cyclictest0-21swapper/010:06:260
292919974564,465cyclictest0-21swapper/011:27:370
292929971073,422cyclictest0-21swapper/109:57:121
2929299703196,126cyclictest31599-1kworker/u17:011:36:561
2929299678166,509cyclictest20760-21fschecks_time12:45:201
292989966325,211cyclictest0-21swapper/708:45:107
2929899662108,381cyclictest0-21swapper/710:52:017
2929699651141,507cyclictest0-21swapper/512:45:205
292919965117,465cyclictest0-21swapper/011:36:530
2929899649139,296cyclictest0-21swapper/710:15:547
29298996446,41cyclictest0-21swapper/710:45:427
29295996392,422cyclictest0-21swapper/412:35:324
292959963283,126cyclictest64450irq/122-eth012:45:204
292949963077,380cyclictest0-21swapper/310:52:563
292959962977,335cyclictest9474-21kworker/4:010:48:554
2929399628117,380cyclictest0-21swapper/210:15:362
292919962528,465cyclictest0-21swapper/010:54:430
2929899624112,381cyclictest0-21swapper/710:06:567
292989962330,513cyclictest0-21swapper/711:50:017
292989962228,591cyclictest0-21swapper/711:30:007
2929499622535,85cyclictest401ktimersoftd/311:06:123
292989962065,338cyclictest0-21swapper/709:20:157
2929599619150,254cyclictest121rcu_preempt10:52:444
292969961565,297cyclictest0-21swapper/511:29:005
292959961562,380cyclictest2565-21ssh11:38:484
292919960712,296cyclictest0-21swapper/010:24:450
292989960610,593cyclictest0-21swapper/711:54:197
292919960395,126cyclictest0-21swapper/012:45:200
292979960247,296cyclictest0-21swapper/610:03:266
292979960247,296cyclictest0-21swapper/610:03:266
292979960247,296cyclictest0-21swapper/610:03:266
292979960247,296cyclictest0-21swapper/610:03:256
2929899601259,339cyclictest13319-21nscd12:39:367
29296996019,126cyclictest0-21swapper/510:36:295
29296995982,126cyclictest0-21swapper/510:00:025
292969959646,126cyclictest0-21swapper/511:46:505
292959959643,380cyclictest0-21swapper/410:08:014
292919959643,338cyclictest121rcu_preempt11:06:300
2929299595551,42cyclictest231rcuc/111:53:151
29294995940,84cyclictest0-21swapper/307:49:343
29297995930,84cyclictest0-21swapper/610:05:526
29296995930,84cyclictest0-21swapper/510:50:325
29293995930,84cyclictest0-21swapper/210:05:522
2929199593124,296cyclictest0-21swapper/008:43:100
29297995920,85cyclictest0-21swapper/610:50:336
292939959241,127cyclictest121rcu_preempt11:23:222
2929299592121,338cyclictest0-21swapper/112:36:571
292919959241,169cyclictest0-21swapper/010:01:090
292919959241,169cyclictest0-21swapper/010:01:080
292919959241,169cyclictest0-21swapper/010:01:080
292919959241,169cyclictest0-21swapper/010:01:080
292989958834,551cyclictest0-21swapper/711:24:307
292959958773,465cyclictest0-21swapper/412:23:454
2929499587288,126cyclictest25266-1kworker/u17:011:54:483
2929399587165,253cyclictest0-21swapper/212:32:392
292929958776,296cyclictest0-21swapper/111:06:471
292929958679,423cyclictest26969-21kworker/1:012:17:051
292929958632,128cyclictest0-21swapper/112:33:311
292929958531,381cyclictest0-21swapper/112:10:141
292939958228,381cyclictest0-21swapper/212:08:312
292929958274,126cyclictest0-21swapper/112:24:541
292959958131,84cyclictest121rcu_preempt12:17:034
292919958169,340cyclictest121rcu_preempt10:49:390
292989958027,550cyclictest0-21swapper/711:36:107
292979957867,380cyclictest0-21swapper/610:23:056
2929799578112,126cyclictest0-21swapper/611:06:336
292959957869,296cyclictest0-21swapper/411:48:114
292949957869,127cyclictest0-21swapper/309:58:263
2929599576112,126cyclictest1553-21runrttasks12:41:504
292919957665,84cyclictest0-21swapper/011:52:270
292919957623,127cyclictest0-21swapper/011:03:050
2929399574317,126cyclictest0-21swapper/212:35:342
292919957323,126cyclictest0-21swapper/011:12:480
292919957320,126cyclictest0-21swapper/010:38:260
292949957120,84cyclictest0-21swapper/312:35:193
292929957058,295cyclictest0-21swapper/110:24:351
2929799569103,211cyclictest0-21swapper/611:52:346
292959956915,339cyclictest0-21swapper/411:07:344
2929899568228,338cyclictest28493-21kworker/u16:210:03:187
2929899568228,338cyclictest28493-21kworker/u16:210:03:187
2929899568228,338cyclictest28493-21kworker/u16:210:03:177
2929899568228,338cyclictest28493-21kworker/u16:210:03:177
292989956817,471cyclictest0-21swapper/710:38:487
292989956814,550cyclictest0-21swapper/708:10:227
2929799568110,119cyclictest0-21swapper/608:56:066
292929956819,303cyclictest0-21swapper/111:46:151
2929799567523,42cyclictest631rcuc/612:42:036
2929299565270,292cyclictest12594-21kworker/u16:311:40:021
292979956457,423cyclictest0-21swapper/610:46:266
292919956453,380cyclictest0-21swapper/012:23:390
2929899563221,339cyclictest15850irq/123-ahci[0009:55:557
292919956296,50cyclictest121rcu_preempt09:55:500
29298995607,41cyclictest0-21swapper/711:11:237
29296995607,338cyclictest31390-21ssh10:17:205
2929399560136,381cyclictest0-21swapper/211:12:492
29293995599,302cyclictest0-21swapper/210:47:592
292949955814,376cyclictest0-21swapper/309:27:203
29297995576,84cyclictest0-21swapper/612:38:406
2929399557173,254cyclictest121rcu_preempt09:30:292
29293995570,84cyclictest0-21swapper/210:50:322
292949955690,84cyclictest121rcu_preempt11:28:133
29293995567,7cyclictest0-21swapper/210:39:552
292929955590,126cyclictest121rcu_preempt10:46:021
292919955343,295cyclictest0-21swapper/011:40:020
29294995521,126cyclictest0-21swapper/312:31:373
292919955183,296cyclictest23147-21ssh12:08:560
2929499550165,127cyclictest121rcu_preempt10:25:113
292929955082,296cyclictest0-21swapper/110:09:131
2929199550128,80cyclictest121rcu_preempt12:32:400
292969954980,295cyclictest0-21swapper/512:10:285
2929299549122,296cyclictest0-21swapper/112:25:271
292969954881,260cyclictest0-21swapper/510:07:505
292949954879,211cyclictest41-21ksoftirqd/311:14:413
292989954740,423cyclictest0-21swapper/707:46:097
2929699547124,84cyclictest0-21swapper/511:36:405
292919954734,127cyclictest0-21swapper/007:49:350
29291995471,123cyclictest0-21swapper/012:35:180
2929599546119,299cyclictest0-21swapper/412:09:184
2929599546119,253cyclictest121rcu_preempt11:04:224
292929954677,342cyclictest0-21swapper/110:16:441
292969954580,211cyclictest0-21swapper/508:43:455
292989954477,127cyclictest0-21swapper/712:33:217
292989954434,507cyclictest0-21swapper/709:30:157
292939954335,126cyclictest16384-21sh11:27:522
292929954377,126cyclictest0-21swapper/109:29:461
2929599542118,169cyclictest264-21jbd2/md0-810:15:364
292979954177,126cyclictest0-21swapper/612:25:096
2929599541120,83cyclictest64450irq/122-eth011:13:124
292949954175,211cyclictest0-21swapper/310:36:183
292919954132,295cyclictest0-21swapper/009:29:270
292989954030,507cyclictest0-21swapper/711:03:577
292919954030,338cyclictest131rcu_sched08:45:190
292989953971,465cyclictest0-21swapper/712:41:077
292989953932,423cyclictest29289-21cyclictest10:23:307
292959953933,218cyclictest0-21swapper/408:42:054
292939953830,126cyclictest0-21swapper/210:03:562
292939953830,126cyclictest0-21swapper/210:03:562
292939953830,126cyclictest0-21swapper/210:03:562
292939953830,126cyclictest0-21swapper/210:03:562
292989953769,465cyclictest29289-21cyclictest11:15:037
292939953727,338cyclictest0-21swapper/211:52:582
2929799535108,295cyclictest0-21swapper/609:28:426
292969953528,127cyclictest0-21swapper/507:46:135
292959953524,508cyclictest0-21swapper/409:57:244
292979953427,84cyclictest0-21swapper/611:11:306
2929799534107,211cyclictest65-21ksoftirqd/607:47:496
2929599534108,253cyclictest0-21swapper/411:28:204
292929953466,126cyclictest0-21swapper/110:01:551
292929953466,126cyclictest0-21swapper/110:01:541
292929953466,126cyclictest0-21swapper/110:01:541
292929953466,126cyclictest0-21swapper/110:01:541
292969953365,296cyclictest0-21swapper/509:15:005
292969953365,296cyclictest0-21swapper/509:15:005
292969953365,296cyclictest0-21swapper/509:15:005
2929599533150,211cyclictest121rcu_preempt11:50:344
292969953226,261cyclictest0-21swapper/512:34:185
292949953266,126cyclictest0-21swapper/308:44:283
292939953262,296cyclictest0-21swapper/211:08:022
292919953062,295cyclictest0-21swapper/010:17:190
292979952921,84cyclictest0-21swapper/609:20:156
2929299529192,169cyclictest704-21nscd10:52:081
292939952819,3cyclictest0-21swapper/211:03:162
292959952769,374cyclictest0-21swapper/410:03:424
292959952769,374cyclictest0-21swapper/410:03:424
292959952769,374cyclictest0-21swapper/410:03:424
292959952769,374cyclictest0-21swapper/410:03:424
292969952518,43cyclictest4466-21diskmemload11:10:545
292989952454,296cyclictest0-21swapper/710:25:117
292979952455,466cyclictest0-21swapper/612:32:186
292959952417,84cyclictest121rcu_preempt08:55:364
292929952413,380cyclictest0-21swapper/107:48:081
292989952211,42cyclictest0-21swapper/712:17:107
292959952114,427cyclictest0-21swapper/409:29:204
292919952115,48cyclictest0-21swapper/010:40:120
292949952011,126cyclictest0-21swapper/310:03:433
292949952011,126cyclictest0-21swapper/310:03:433
292949952011,126cyclictest0-21swapper/310:03:433
292949952011,126cyclictest0-21swapper/310:03:423
292929952093,213cyclictest23030-21/usr/sbin/munin08:45:181
29292995209,169cyclictest0-21swapper/112:07:431
292969951810,84cyclictest0-21swapper/510:24:115
2929299518180,336cyclictest24724-1kworker/u17:011:13:261
29298995154,508cyclictest0-21swapper/709:44:167
292969951548,295cyclictest0-21swapper/512:36:045
292949951446,127cyclictest0-21swapper/312:45:203
29298995121,42cyclictest0-21swapper/711:05:077
2929499512468,42cyclictest391rcuc/310:23:343
29295995115,7cyclictest0-21swapper/410:23:334
292969951012,287cyclictest0-21swapper/512:09:065
29293995100,84cyclictest8966-21ssh10:23:242
29296995091,85cyclictest0-21swapper/511:05:235
29296995090,84cyclictest0-21swapper/512:16:575
29293995090,84cyclictest0-21swapper/212:17:362
29297995081,3cyclictest0-21swapper/611:03:176
2929699508213,84cyclictest121rcu_preempt10:48:385
29295995080,83cyclictest0-21swapper/407:49:344
292989950737,297cyclictest0-21swapper/709:14:597
292989950737,297cyclictest0-21swapper/709:14:597
292989950737,297cyclictest0-21swapper/709:14:597
292929950734,127cyclictest0-21swapper/111:30:061
2929299507123,381cyclictest4225-21ssh10:39:561
2929199507124,126cyclictest9-21ksoftirqd/011:24:430
2929699506423,3cyclictest551rcuc/511:24:395
2929699506122,381cyclictest11962-21chrt11:03:525
292959950681,422cyclictest0-21swapper/410:55:194
292939950680,211cyclictest33-21ksoftirqd/212:10:042
292939950641,3cyclictest0-21swapper/212:45:202
292959950541,261cyclictest0-21swapper/410:25:164
292939950579,211cyclictest33-21ksoftirqd/212:43:082
292959950435,84cyclictest0-21swapper/410:37:064
292929950439,304cyclictest0-21swapper/111:26:261
292939950376,211cyclictest33-21ksoftirqd/209:59:592
292979950279,126cyclictest0-21swapper/611:47:016
292929950136,84cyclictest121rcu_preempt08:44:581
292979950074,211cyclictest0-21swapper/611:38:246
2929499499158,126cyclictest4466-21diskmemload12:10:143
292939949933,84cyclictest0-21swapper/209:29:162
2929299499119,174cyclictest0-21swapper/112:42:241
292919949935,126cyclictest6461-21ssh12:17:020
2929799497156,338cyclictest29289-21cyclictest10:39:076
292959949733,380cyclictest0-21swapper/410:40:184
292949949669,211cyclictest41-21ksoftirqd/310:06:333
292959949525,338cyclictest121rcu_preempt11:22:424
2929299494240,84cyclictest241ktimersoftd/111:03:451
292949949366,339cyclictest0-21swapper/311:40:173
2929699491111,211cyclictest17892-1kworker/u17:111:15:035
292979949024,84cyclictest0-21swapper/612:17:596
2929699490192,295cyclictest28413-21rm11:55:075
2929699490110,296cyclictest0-21swapper/511:51:205
292989948920,211cyclictest25467-21tune2fs12:10:177
292979948919,296cyclictest21257-21grep08:40:286
2929799489105,259cyclictest0-21swapper/611:23:226
292949948967,84cyclictest0-21swapper/311:23:503
292989948819,466cyclictest0-21swapper/710:55:177
292979948861,296cyclictest0-21swapper/611:27:466
292969948862,84cyclictest121rcu_preempt09:15:035
292989948761,211cyclictest0-21swapper/708:56:357
292989948722,385cyclictest0-21swapper/708:43:507
2929499487105,127cyclictest0-21swapper/312:23:493
292929948663,126cyclictest0-21swapper/111:55:061
292969948560,257cyclictest121rcu_preempt12:23:325
292939948567,38cyclictest17787-21ssh12:23:582
2929399485109,203cyclictest0-21swapper/208:55:532
292919948316,127cyclictest0-21swapper/011:48:240
292949948216,211cyclictest0-21swapper/312:16:563
2929199482310,84cyclictest0-21swapper/008:55:550
2929499481437,42cyclictest391rcuc/312:08:313
2929499481225,253cyclictest0-21swapper/310:46:273
292969947955,84cyclictest121rcu_preempt08:10:225
292949947953,211cyclictest41-21ksoftirqd/310:15:313
29293994789,211cyclictest0-21swapper/211:48:172
292989947611,211cyclictest0-21swapper/712:07:257
2929699476221,253cyclictest4888-21kworker/u16:109:29:215
292959947594,84cyclictest0-21swapper/412:10:144
2929699474179,211cyclictest32130-1kworker/u17:110:01:315
2929699474179,211cyclictest32130-1kworker/u17:110:01:305
2929699474179,211cyclictest32130-1kworker/u17:110:01:305
2929699474179,211cyclictest32130-1kworker/u17:110:01:305
29295994749,211cyclictest0-21swapper/409:20:154
29294994748,126cyclictest0-21swapper/312:41:103
29292994737,126cyclictest0-21swapper/111:24:441
292969947287,211cyclictest561ktimersoftd/508:45:135
29291994729,82cyclictest4466-21diskmemload10:25:340
29294994716,302cyclictest0-21swapper/309:15:033
2929299471427,42cyclictest231rcuc/110:25:101
29293994693,84cyclictest715-21rs:main2
292929946781,211cyclictest25-21ksoftirqd/109:30:301
2929799466123,89cyclictest121rcu_preempt12:45:206
292919946480,211cyclictest9-21ksoftirqd/012:10:100
292919946441,3cyclictest0-21swapper/012:40:020
2929899463121,339cyclictest0-21swapper/711:55:117
292979946279,253cyclictest0-21swapper/609:58:226
292969946282,84cyclictest0-21swapper/512:40:585
2929599462123,84cyclictest0-21swapper/410:10:104
292989946180,126cyclictest0-21swapper/712:45:217
292969946178,126cyclictest121rcu_preempt07:50:155
292969946178,126cyclictest121rcu_preempt07:50:145
2929599461121,84cyclictest0-21swapper/412:32:144
292939946134,254cyclictest0-21swapper/211:55:072
2929199460161,126cyclictest121rcu_preempt09:30:150
292959945980,295cyclictest0-21swapper/411:40:134
292979945874,211cyclictest0-21swapper/610:55:166
292969945877,84cyclictest0-21swapper/510:25:055
2929299458118,84cyclictest0-21swapper/110:40:071
2929599457116,338cyclictest0-21swapper/408:10:164
292939945735,2cyclictest0-21swapper/211:38:182
292939945731,128cyclictest25025-21cpuspeed_turbos09:20:152
292959945635,255cyclictest0-21swapper/411:15:174
2929899455114,338cyclictest17188-21ssh10:10:097
2929699455118,126cyclictest13091-21fgrep09:30:305
292949945531,84cyclictest121rcu_preempt10:40:283
292939945533,84cyclictest0-21swapper/211:40:192
292969945473,84cyclictest698-21ptp4l08:56:365
292949945432,2cyclictest0-21swapper/311:04:513
292929945432,177cyclictest0-21swapper/111:15:031
292979945374,295cyclictest0-21swapper/610:16:396
292979945331,256cyclictest0-21swapper/612:24:186
292979945028,256cyclictest0-21swapper/608:45:206
2929499450194,254cyclictest17975-1kworker/u17:211:39:273
292949944964,211cyclictest19392-21chrt12:25:073
2929499449108,338cyclictest0-21swapper/309:20:163
2929199449108,338cyclictest0-21swapper/008:19:120
292979944824,84cyclictest0-21swapper/610:25:116
292969944869,84cyclictest0-21swapper/511:40:285
2929599448110,84cyclictest19405-21sh12:25:094
292949944868,84cyclictest0-21swapper/311:47:503
292949944867,84cyclictest0-21swapper/308:56:293
292989944623,86cyclictest0-21swapper/710:40:237
2929499446104,127cyclictest41-21ksoftirqd/309:30:153
292929944623,217cyclictest0-21swapper/109:20:141
292919944624,256cyclictest0-21swapper/009:20:150
2929699445104,338cyclictest0-21swapper/510:40:185
2929599443103,338cyclictest0-21swapper/409:14:594
2929599443103,338cyclictest0-21swapper/409:14:594
2929599443103,338cyclictest0-21swapper/409:14:594
2929199442101,126cyclictest9-21ksoftirqd/010:55:210
292969944117,127cyclictest0-21swapper/510:55:205
2929599441104,84cyclictest0-21swapper/411:55:094
292939944119,256cyclictest0-21swapper/207:50:002
292929944119,212cyclictest0-21swapper/108:10:221
292989944014,170cyclictest0-21swapper/711:30:127
2929799440140,127cyclictest121rcu_preempt07:50:116
2929799440140,127cyclictest121rcu_preempt07:50:106
292959944018,338cyclictest0-21swapper/409:30:124
2929599440142,126cyclictest121rcu_preempt11:30:104
292969943999,84cyclictest0-21swapper/512:25:365
292959943897,339cyclictest0-21swapper/408:19:134
292939943695,338cyclictest0-21swapper/210:25:242
2929399434350,3cyclictest311rcuc/212:25:072
2929699431143,39cyclictest1553-21runrttasks11:30:145
29291994319,211cyclictest0-21swapper/011:15:040
292939942987,253cyclictest0-21swapper/208:10:252
29298994281,42cyclictest0-21swapper/709:15:037
29293994282,254cyclictest0-21swapper/209:15:022
29291994288,3cyclictest0-21swapper/008:10:250
29292994271,253cyclictest0-21swapper/108:55:441
29291994275,338cyclictest0-21swapper/011:30:050
292969942645,84cyclictest0-21swapper/509:20:015
292989942483,338cyclictest0-21swapper/712:23:287
292939942483,338cyclictest0-21swapper/208:19:132
292919942439,168cyclictest698-21ptp4l09:44:210
292979942382,338cyclictest0-21swapper/609:30:076
292979942382,126cyclictest121rcu_preempt12:07:446
292959942383,338cyclictest0-21swapper/408:45:174
292959942382,338cyclictest0-21swapper/409:15:054
292949942283,84cyclictest0-21swapper/311:30:103
292969942180,338cyclictest0-21swapper/510:10:115
2929399421125,84cyclictest121rcu_preempt10:40:092
292979942081,337cyclictest0-21swapper/611:30:136
292949941980,84cyclictest0-21swapper/308:10:183
292949941978,126cyclictest0-21swapper/311:55:083
292929941977,339cyclictest0-21swapper/110:55:151
292919941980,84cyclictest0-21swapper/012:25:090
292919941978,338cyclictest0-21swapper/007:14:510
292929941879,84cyclictest0-21swapper/107:50:101
292929941879,84cyclictest0-21swapper/107:50:101
292919941877,338cyclictest0-21swapper/010:10:080
292929941777,338cyclictest0-21swapper/110:10:091
292929941777,338cyclictest0-21swapper/109:15:041
292979941676,338cyclictest0-21swapper/610:10:096
2929399416159,126cyclictest121rcu_preempt11:15:182
292989941574,338cyclictest0-21swapper/711:40:287
2929799415116,173cyclictest6127-21ssh10:40:186
292959941534,296cyclictest0-21swapper/407:14:524
292949941576,84cyclictest0-21swapper/311:15:143
292979941474,338cyclictest0-21swapper/611:40:186
292979941433,84cyclictest0-21swapper/611:55:046
292929941433,296cyclictest0-21swapper/107:14:461
292989941372,338cyclictest0-21swapper/707:50:127
292989941372,338cyclictest0-21swapper/707:50:117
292969941273,84cyclictest0-21swapper/509:44:165
292959941272,338cyclictest0-21swapper/407:50:114
292959941272,338cyclictest0-21swapper/407:50:114
292919941232,296cyclictest0-21swapper/007:50:120
292919941232,296cyclictest0-21swapper/007:50:110
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional