You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-13 - 08:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed May 13, 2026 00:57:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
49459987569,803cyclictest0-21swapper/423:30:144
49459986615,84cyclictest0-21swapper/422:47:334
49459983024,803cyclictest9051-21ssh00:35:014
49459982056,633cyclictest0-21swapper/423:14:104
49459978567,634cyclictest4939-21cyclictest21:40:164
49429975978,507cyclictest0-21swapper/123:34:551
4946997220,84cyclictest121rcu_preempt00:24:245
49459970726,634cyclictest0-21swapper/419:24:294
49459969112,676cyclictest0-21swapper/423:25:054
4945996801,676cyclictest0-21swapper/421:30:074
494799672118,126cyclictest4939-21cyclictest00:44:366
49459966931,635cyclictest0-21swapper/422:19:344
494899667112,296cyclictest0-21swapper/722:22:507
49419966672,127cyclictest0-21swapper/000:32:500
49459966225,464cyclictest0-21swapper/400:10:474
49459965821,634cyclictest0-21swapper/421:38:454
49459965518,634cyclictest0-21swapper/422:00:094
49429964894,296cyclictest0-21swapper/100:21:331
494199646305,126cyclictest0-21swapper/000:13:260
49419964511,128cyclictest0-21swapper/022:39:510
494199640299,126cyclictest0-21swapper/000:24:440
49459963842,592cyclictest704-21nscd00:44:324
494199637296,126cyclictest0-21swapper/000:08:150
494299634336,125cyclictest0-21swapper/122:24:461
494399631123,126cyclictest22841-21ssh21:31:072
494499630374,126cyclictest0-21swapper/322:21:143
494899629159,296cyclictest0-21swapper/723:34:137
49479962572,380cyclictest0-21swapper/621:32:586
494299625113,296cyclictest0-21swapper/100:41:511
49429962472,84cyclictest121rcu_preempt23:06:591
49469962369,381cyclictest0-21swapper/500:08:365
49459962328,3cyclictest0-21swapper/421:27:354
49439962272,127cyclictest0-21swapper/200:24:552
494799620109,508cyclictest0-21swapper/622:00:116
49429961966,381cyclictest0-21swapper/122:48:301
49419961763,338cyclictest0-21swapper/021:27:320
494299616104,296cyclictest0-21swapper/121:36:081
49429961417,423cyclictest0-21swapper/123:12:321
49489961215,86cyclictest0-21swapper/700:33:427
494499612101,211cyclictest41-21ksoftirqd/323:12:203
494199612103,471cyclictest0-21swapper/023:33:230
49449960796,508cyclictest0-21swapper/323:33:223
49449960551,381cyclictest0-21swapper/323:28:013
4945996005,169cyclictest0-21swapper/422:20:314
494599600261,337cyclictest64450irq/122-eth022:59:164
49439959788,295cyclictest0-21swapper/223:34:302
494899596127,339cyclictest4939-21cyclictest22:59:517
4944995940,84cyclictest0-21swapper/300:24:253
494299594124,296cyclictest1551-21snmpd22:00:111
4942995930,84cyclictest0-21swapper/123:25:051
49439959178,381cyclictest0-21swapper/223:48:482
49489959082,126cyclictest0-21swapper/723:07:597
49449958876,381cyclictest0-21swapper/322:39:593
49439958876,380cyclictest28821-21runrttasks21:35:282
49469958674,85cyclictest0-21swapper/522:23:265
49449958675,338cyclictest22991-21kworker/u16:021:35:333
49489958572,340cyclictest0-21swapper/722:40:137
494499585119,127cyclictest0-21swapper/323:56:563
494199583114,296cyclictest0-21swapper/023:28:410
494899581115,211cyclictest4939-21cyclictest00:42:407
494499580111,126cyclictest0-21swapper/300:10:513
49469957766,126cyclictest0-21swapper/500:13:085
494799574194,84cyclictest698-21ptp4l23:11:196
49459957324,464cyclictest0-21swapper/422:39:454
49419957219,380cyclictest0-21swapper/000:41:160
49449957163,126cyclictest0-21swapper/322:00:123
49429957161,298cyclictest0-21swapper/100:08:581
49429957017,126cyclictest0-21swapper/100:31:011
49429956860,126cyclictest121rcu_preempt23:48:261
49439956697,84cyclictest121rcu_preempt23:15:072
49419956413,84cyclictest121rcu_preempt22:49:420
49419956356,126cyclictest0-21swapper/023:21:310
4947995567,127cyclictest0-21swapper/621:39:406
4944995567,126cyclictest0-21swapper/323:47:283
4946995550,44cyclictest0-21swapper/523:26:495
4948995541,84cyclictest0-21swapper/722:49:057
4945995531,168cyclictest28142-21runrttasks23:07:364
4941995533,126cyclictest0-21swapper/019:23:370
49419955284,253cyclictest0-21swapper/021:35:210
4943995511,384cyclictest0-21swapper/222:02:322
4942995510,85cyclictest0-21swapper/119:24:281
4941995510,84cyclictest0-21swapper/022:23:280
494399549465,3cyclictest311rcuc/223:21:312
49489954882,84cyclictest121rcu_preempt00:14:137
49449954878,127cyclictest14967-21if_err_enp3s022:05:213
494699547121,211cyclictest0-21swapper/522:58:185
49469954577,465cyclictest0-21swapper/523:31:175
494199545160,126cyclictest0-21swapper/021:40:260
49459954438,210cyclictest0-21swapper/421:59:564
494499544118,127cyclictest0-21swapper/322:47:133
49469954379,338cyclictest0-21swapper/523:11:295
49459954333,507cyclictest0-21swapper/423:56:534
49459954332,508cyclictest0-21swapper/400:35:094
494299543245,126cyclictest704-21nscd22:58:441
49439954234,42cyclictest0-21swapper/222:18:322
494899540155,254cyclictest0-21swapper/721:36:587
49419954071,211cyclictest9-21ksoftirqd/022:00:440
494799539282,127cyclictest721-21nscd22:58:056
494699539199,338cyclictest2144-1kworker/u17:121:59:495
49429953929,338cyclictest14492-21awk22:05:171
49459953871,464cyclictest0-21swapper/422:40:054
49439953869,211cyclictest33-21ksoftirqd/222:58:532
49489953772,84cyclictest1551-21snmpd22:19:517
49479953726,84cyclictest0-21swapper/622:24:086
49459953726,508cyclictest0-21swapper/423:23:464
49449953625,296cyclictest17340-21sh22:25:193
49489953427,41cyclictest0-21swapper/723:10:337
49439953426,84cyclictest0-21swapper/222:49:362
494199534150,211cyclictest0-21swapper/021:30:210
49489953165,211cyclictest0-21swapper/723:47:107
494799531109,338cyclictest1370-21ssh23:35:086
494699531448,4cyclictest561ktimersoftd/500:42:345
49469953061,380cyclictest0-21swapper/523:48:265
49459953019,508cyclictest0-21swapper/422:25:044
494399530146,211cyclictest121rcu_preempt22:38:432
494399529106,126cyclictest121rcu_preempt00:09:472
494399528102,211cyclictest33-21ksoftirqd/200:44:502
49489952716,50cyclictest0-21swapper/700:23:467
49479952662,126cyclictest121rcu_preempt23:50:086
49469952657,211cyclictest0-21swapper/522:37:565
49469952256,84cyclictest121rcu_preempt21:29:435
49439952296,211cyclictest33-21ksoftirqd/221:27:342
49489952155,126cyclictest121rcu_preempt22:39:167
49419952112,84cyclictest0-21swapper/023:11:450
49469952094,293cyclictest0-21swapper/500:25:365
49469952094,293cyclictest0-21swapper/500:25:355
49439952010,380cyclictest0-21swapper/223:08:262
49429952055,84cyclictest1553-21runrttasks23:22:341
49449951951,296cyclictest0-21swapper/323:00:153
49419951810,125cyclictest0-21swapper/022:19:380
49469951711,90cyclictest0-21swapper/523:07:455
49449951752,338cyclictest0-21swapper/321:29:093
4945995143,129cyclictest0-21swapper/423:48:174
4941995121,84cyclictest0-21swapper/023:50:060
4946995090,127cyclictest11023-21ssh23:56:345
4945995093,84cyclictest0-21swapper/400:07:434
4944995090,84cyclictest0-21swapper/321:30:403
4944995090,84cyclictest0-21swapper/300:31:533
4942995091,84cyclictest0-21swapper/121:28:211
4947995080,84cyclictest0-21swapper/600:24:246
49439950881,211cyclictest33-21ksoftirqd/200:10:422
494399507421,84cyclictest311rcuc/222:31:472
49449950637,339cyclictest0-21swapper/300:07:503
49489950583,84cyclictest0-21swapper/723:24:227
49469950578,211cyclictest0-21swapper/500:33:075
49459950583,338cyclictest0-21swapper/400:23:414
494499505123,126cyclictest0-21swapper/322:18:333
494899504123,126cyclictest24619-21ssh21:33:237
494399504120,211cyclictest0-21swapper/200:33:522
49429950440,41cyclictest0-21swapper/121:33:491
494899503123,296cyclictest0-21swapper/721:28:427
49439950377,211cyclictest33-21ksoftirqd/223:29:242
49469950232,295cyclictest0-21swapper/521:32:095
49489950077,85cyclictest0-21swapper/722:03:257
494899500118,127cyclictest0-21swapper/700:25:307
494899500118,127cyclictest0-21swapper/700:25:307
494799500116,381cyclictest0-21swapper/621:40:176
49479949930,338cyclictest0-21swapper/600:34:006
49449949930,126cyclictest0-21swapper/300:15:033
49449949930,126cyclictest0-21swapper/300:15:033
494499498118,296cyclictest0-21swapper/300:43:343
494399497113,211cyclictest33-21ksoftirqd/222:20:082
49429949775,338cyclictest0-21swapper/123:35:081
49489949626,339cyclictest0-21swapper/723:28:147
49479949630,84cyclictest0-21swapper/600:13:256
49429949669,296cyclictest0-21swapper/100:10:431
49419949670,211cyclictest9-21ksoftirqd/021:59:290
49469949531,261cyclictest28951-21unixbench_singl21:35:355
49449949428,84cyclictest0-21swapper/323:07:443
49439949467,296cyclictest0-21swapper/222:50:082
49479949327,126cyclictest0-21swapper/623:34:296
49479949227,84cyclictest0-21swapper/621:29:496
49469949223,253cyclictest0-21swapper/522:03:255
49459949269,126cyclictest0-21swapper/422:31:234
49439949265,381cyclictest0-21swapper/219:25:022
49419949227,261cyclictest0-21swapper/022:57:350
494899491236,253cyclictest721ktimersoftd/723:56:297
49459949123,126cyclictest0-21swapper/422:05:274
49439949169,296cyclictest0-21swapper/223:50:082
494499490451,3cyclictest391rcuc/321:59:553
494299490403,4cyclictest241ktimersoftd/122:37:151
49429949025,127cyclictest0-21swapper/122:19:371
49479948967,126cyclictest0-21swapper/623:07:586
49479948824,42cyclictest0-21swapper/623:49:076
49479948660,296cyclictest0-21swapper/623:27:596
494799486231,253cyclictest641ktimersoftd/622:05:256
49469948664,338cyclictest0-21swapper/523:35:085
49449948621,300cyclictest0-21swapper/322:57:553
494499486188,126cyclictest121rcu_preempt23:22:033
494499486151,247cyclictest1403-21kworker/u16:122:40:123
49469948359,211cyclictest0-21swapper/523:15:185
49459948215,126cyclictest1553-21runrttasks23:50:214
494199481271,84cyclictest7929-21munin-node23:07:310
49419948115,211cyclictest0-21swapper/023:56:300
49439948053,254cyclictest0-21swapper/222:05:212
49429948053,296cyclictest0-21swapper/100:15:061
49429948053,296cyclictest0-21swapper/100:15:061
494199480223,127cyclictest0-21swapper/022:31:340
49429947915,256cyclictest0-21swapper/121:40:161
494799478304,41cyclictest0-21swapper/622:37:286
49459947811,169cyclictest64450irq/122-eth000:25:074
49459947811,169cyclictest64450irq/122-eth000:25:074
49439947713,380cyclictest0-21swapper/222:25:072
4941994768,126cyclictest0-21swapper/023:00:040
49489947452,85cyclictest16012-21apt22:25:127
4943994702,84cyclictest0-21swapper/221:40:152
49479946681,211cyclictest641ktimersoftd/600:09:086
494499466125,338cyclictest0-21swapper/321:40:143
494899465122,340cyclictest0-21swapper/722:31:357
4947994651,43cyclictest0-21swapper/619:25:196
4947994651,338cyclictest0-21swapper/623:23:276
494499465124,338cyclictest0-21swapper/300:35:103
494499465124,338cyclictest0-21swapper/300:25:283
494499465124,338cyclictest0-21swapper/300:25:283
49489946482,84cyclictest121rcu_preempt19:25:017
494899464123,338cyclictest30186-21nscd23:15:097
494899464123,338cyclictest0-21swapper/721:59:087
494899463122,338cyclictest0-21swapper/700:07:417
49469946379,211cyclictest0-21swapper/519:25:025
49439946336,211cyclictest0-21swapper/222:40:132
49429946340,3cyclictest0-21swapper/123:56:321
49479946240,256cyclictest0-21swapper/622:40:106
49469946241,295cyclictest0-21swapper/522:18:465
49419946278,84cyclictest5393-21head23:15:170
49439946138,211cyclictest0-21swapper/223:56:052
49429946140,2cyclictest0-21swapper/123:50:201
494199461120,338cyclictest0-21swapper/000:15:020
494199461120,338cyclictest0-21swapper/000:15:020
494499460118,339cyclictest0-21swapper/322:31:343
49429945937,84cyclictest121rcu_preempt22:31:351
49489945877,85cyclictest0-21swapper/719:25:087
49469945733,84cyclictest0-21swapper/522:50:085
49429945735,255cyclictest0-21swapper/122:40:101
494799456115,338cyclictest0-21swapper/623:56:216
49449945633,7cyclictest0-21swapper/323:15:163
494399456112,126cyclictest33-21ksoftirqd/221:59:402
494299456115,338cyclictest0-21swapper/123:15:131
494899454114,337cyclictest0-21swapper/700:35:117
494799454114,338cyclictest0-21swapper/623:15:136
49469945230,255cyclictest0-21swapper/523:50:205
49479945027,256cyclictest0-21swapper/622:19:136
494899449111,171cyclictest0-21swapper/722:05:037
494699449109,337cyclictest698-21ptp4l21:40:205
49439944964,211cyclictest0-21swapper/223:11:132
49479944826,3cyclictest0-21swapper/619:25:026
49459944722,422cyclictest0-21swapper/400:15:024
49459944722,422cyclictest0-21swapper/400:15:024
494699446147,126cyclictest121rcu_preempt22:05:145
49449944666,84cyclictest0-21swapper/319:25:233
49469944524,255cyclictest0-21swapper/522:46:345
494799444102,127cyclictest0-21swapper/600:15:066
494799444102,127cyclictest0-21swapper/600:15:066
49489944362,84cyclictest0-21swapper/721:40:237
494799443102,126cyclictest0-21swapper/622:47:526
49459944321,341cyclictest0-21swapper/423:15:224
49459944318,422cyclictest0-21swapper/419:25:214
494699442100,126cyclictest121rcu_preempt23:22:265
49439944220,256cyclictest0-21swapper/200:15:052
49439944220,256cyclictest0-21swapper/200:15:042
49469944115,211cyclictest121rcu_preempt22:25:185
49419944117,85cyclictest0-21swapper/022:05:280
49439944097,211cyclictest0-21swapper/200:25:142
49439944097,211cyclictest0-21swapper/200:25:142
49479943917,3cyclictest0-21swapper/622:25:076
49469943714,84cyclictest121rcu_preempt22:31:385
49449943557,84cyclictest0-21swapper/319:22:123
49429943411,84cyclictest0-21swapper/121:58:461
4942994318,126cyclictest27980-21ssh00:25:361
4942994318,126cyclictest27980-21ssh00:25:351
4945994272,126cyclictest0-21swapper/422:50:044
49479942584,338cyclictest0-21swapper/621:59:286
49479942583,338cyclictest12544-21diskmemload00:35:116
49439942483,338cyclictest0-21swapper/219:25:202
49469942383,337cyclictest0-21swapper/500:15:135
49469942383,337cyclictest0-21swapper/500:15:135
49469942382,338cyclictest0-21swapper/519:25:195
49489942283,84cyclictest0-21swapper/723:00:047
49479942180,338cyclictest0-21swapper/600:25:286
49479942180,338cyclictest0-21swapper/600:25:276
49449942182,84cyclictest0-21swapper/323:50:083
49449942182,132cyclictest0-21swapper/322:50:063
49429942180,338cyclictest0-21swapper/119:25:081
4941994211,42cyclictest0-21swapper/000:25:130
4941994211,42cyclictest0-21swapper/000:25:130
49489942082,84cyclictest0-21swapper/723:50:107
49479942079,338cyclictest0-21swapper/622:50:126
49489941879,84cyclictest0-21swapper/700:15:057
49489941879,84cyclictest0-21swapper/700:15:057
494199418119,126cyclictest121rcu_preempt22:40:110
49479941777,338cyclictest0-21swapper/622:31:086
49489941677,84cyclictest0-21swapper/722:50:067
49459941473,338cyclictest0-21swapper/423:00:034
49419941430,84cyclictest0-21swapper/019:25:230
49469941170,338cyclictest7929-21munin-node22:40:125
49469940968,126cyclictest9609-21ssh00:35:115
49429940665,338cyclictest0-21swapper/122:50:061
49419940627,3cyclictest0-21swapper/022:25:070
49419940465,84cyclictest0-21swapper/022:50:080
494699403146,85cyclictest121rcu_preempt23:00:045
49439940361,339cyclictest0-21swapper/200:35:092
49489940262,85cyclictest0-21swapper/723:35:077
49439939962,253cyclictest0-21swapper/223:35:082
49439939656,338cyclictest0-21swapper/223:00:152
494299385255,41cyclictest0-21swapper/122:25:151
49419938041,84cyclictest0-21swapper/000:35:100
49419937838,83cyclictest0-21swapper/023:50:200
49429937637,84cyclictest4939-21cyclictest00:35:151
49429937435,84cyclictest0-21swapper/123:00:131
49479935518,3cyclictest0-21swapper/623:00:156
49459935055,84cyclictest121rcu_preempt23:35:074
49419933741,83cyclictest0-21swapper/023:35:080
49449932729,44cyclictest0-21swapper/323:35:073
4416210347,26sleep70-21swapper/719:08:387
264729994,2sleep40-21swapper/419:05:164
430529785,8sleep10-21swapper/119:07:041
444829163,5sleep20-21swapper/219:09:062
445828746,38sleep30-21swapper/319:09:163
421028655,27sleep00-21swapper/019:05:440
238142860,0sleep10-21swapper/122:10:121
437628555,27sleep60-21swapper/619:08:066
434828352,27sleep50-21swapper/519:07:415
202352760,0sleep10-21swapper/120:25:221
203432720,0sleep00-21swapper/021:50:100
288842690,2sleep4494599cyclictest21:17:244
4942992910,18cyclictest0-21swapper/121:21:531
4941992910,18cyclictest0-21swapper/021:21:540
4941992910,18cyclictest0-21swapper/019:46:580
4948992828,0cyclictest0-21swapper/720:58:537
4948992810,18cyclictest0-21swapper/721:21:437
4948992810,18cyclictest0-21swapper/721:10:077
4948992810,18cyclictest0-21swapper/720:28:057
4947992810,18cyclictest0-21swapper/620:06:466
4947992810,18cyclictest0-21swapper/619:46:536
4946992810,18cyclictest0-21swapper/521:10:045
4944992810,18cyclictest0-21swapper/321:21:583
4944992810,18cyclictest0-21swapper/320:48:423
4944992810,18cyclictest0-21swapper/320:07:083
4944992810,18cyclictest0-21swapper/319:14:113
4944992810,18cyclictest0-21swapper/319:14:103
4943992810,0cyclictest0-21swapper/219:46:542
4943992810,0cyclictest0-21swapper/219:13:292
4943992810,0cyclictest0-21swapper/219:13:292
4941992810,0cyclictest0-21swapper/020:06:410
4948992727,0cyclictest0-21swapper/719:38:377
4948992727,0cyclictest0-21swapper/719:13:337
4948992727,0cyclictest0-21swapper/719:13:337
4948992710,17cyclictest0-21swapper/721:09:347
4948992710,17cyclictest0-21swapper/720:48:147
4948992710,17cyclictest0-21swapper/720:16:267
4948992710,17cyclictest0-21swapper/719:46:327
4948992710,0cyclictest0-21swapper/720:38:257
4948992710,0cyclictest0-21swapper/720:07:097
4947992727,0cyclictest0-21swapper/620:48:156
4947992727,0cyclictest0-21swapper/620:16:116
4947992727,0cyclictest0-21swapper/619:56:596
4947992710,17cyclictest0-21swapper/621:21:336
4947992710,17cyclictest0-21swapper/621:10:066
4947992710,17cyclictest0-21swapper/620:27:276
4947992710,17cyclictest0-21swapper/619:13:306
4947992710,17cyclictest0-21swapper/619:13:296
4947992710,0cyclictest0-21swapper/621:09:506
4947992710,0cyclictest0-21swapper/620:58:556
4947992710,0cyclictest0-21swapper/620:37:596
4947992710,0cyclictest0-21swapper/619:38:346
4946992727,0cyclictest0-21swapper/521:21:385
4946992727,0cyclictest0-21swapper/520:58:325
4946992727,0cyclictest0-21swapper/519:13:315
4946992727,0cyclictest0-21swapper/519:13:305
4946992710,17cyclictest0-21swapper/520:38:205
4946992710,17cyclictest0-21swapper/520:27:465
4946992710,17cyclictest0-21swapper/520:16:285
4946992710,17cyclictest0-21swapper/519:46:335
4946992710,17cyclictest0-21swapper/519:38:355
4946992710,0cyclictest0-21swapper/520:48:095
4946992710,0cyclictest0-21swapper/520:07:085
4945992727,0cyclictest0-21swapper/421:21:474
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional