You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-13 - 09:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Aug 13, 2026 00:55:26)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2054099738104,377cyclictest0-21swapper/423:05:214
205409972082,85cyclictest0-21swapper/422:43:134
205409969415,676cyclictest0-21swapper/422:32:094
205439964511,2cyclictest0-21swapper/721:51:317
20538996351,2cyclictest0-21swapper/221:51:302
2053699623112,508cyclictest0-21swapper/021:57:320
20540996019,3cyclictest0-21swapper/421:13:094
20537995956,332cyclictest0-21swapper/121:59:061
205409958940,512cyclictest0-21swapper/419:26:414
205379958877,338cyclictest0-21swapper/100:07:201
205409958335,468cyclictest0-21swapper/423:04:274
205409958132,166cyclictest0-21swapper/422:45:054
205409958129,549cyclictest0-21swapper/422:35:234
205369957870,126cyclictest704-21nscd23:38:500
2054099576320,253cyclictest0-21swapper/423:19:164
2053899571105,84cyclictest0-21swapper/219:29:492
205409956919,382cyclictest0-21swapper/421:51:314
205419956858,168cyclictest0-21swapper/522:34:515
2053999568228,338cyclictest25286-1kworker/u17:121:34:023
205369956516,296cyclictest0-21swapper/021:36:540
205409956210,549cyclictest0-21swapper/423:30:144
20537995561,381cyclictest0-21swapper/123:19:501
20540995531,549cyclictest0-21swapper/421:32:214
20538995530,84cyclictest0-21swapper/222:14:242
205369955383,211cyclictest0-21swapper/019:19:170
20537995512,44cyclictest0-21swapper/122:33:121
2053999550124,211cyclictest41-21ksoftirqd/323:36:433
205409954737,507cyclictest1553-21runrttasks20:17:004
205409954577,84cyclictest0-21swapper/400:32:384
2053899545163,379cyclictest20534-21cyclictest22:34:312
205409954477,464cyclictest24282-21ssh21:25:384
20540995441,2cyclictest0-21swapper/421:58:384
205409954333,507cyclictest0-21swapper/422:11:404
205409954332,508cyclictest0-21swapper/423:39:494
205379954133,126cyclictest0-21swapper/123:38:501
205369954171,339cyclictest0-21swapper/020:37:090
205409953930,506cyclictest0-21swapper/421:15:434
205379953927,338cyclictest0-21swapper/123:20:021
2054399538110,211cyclictest73-21ksoftirqd/719:16:107
2053999538238,126cyclictest41-21ksoftirqd/321:19:333
205409953734,419cyclictest0-21swapper/423:59:064
205369953730,256cyclictest12619-21sh22:34:340
205369953524,253cyclictest0-21swapper/020:15:510
2053699533112,84cyclictest0-21swapper/000:00:150
205429953123,126cyclictest0-21swapper/621:57:316
205379952921,84cyclictest0-21swapper/121:26:361
2053899526143,381cyclictest12759-21ssh21:57:312
205369952599,211cyclictest9-21ksoftirqd/021:32:580
205369952312,380cyclictest0-21swapper/023:28:240
205369952312,380cyclictest0-21swapper/023:28:240
205369952222,296cyclictest0-21swapper/000:33:270
205439952151,211cyclictest22527-21ls23:50:247
205409952110,508cyclictest0-21swapper/420:39:124
2053899521182,84cyclictest24616-21nscd21:28:022
205409951912,429cyclictest0-21swapper/419:20:054
20537995121,296cyclictest0-21swapper/121:30:351
20539995101,127cyclictest0-21swapper/321:57:323
20541995091,126cyclictest0-21swapper/523:38:505
20541995091,126cyclictest0-21swapper/521:57:315
205369950941,295cyclictest0-21swapper/022:23:110
20540995082,84cyclictest6230-21sh21:36:254
205409950740,464cyclictest0-21swapper/423:49:414
205389950781,211cyclictest33-21ksoftirqd/223:36:582
205389950738,211cyclictest33-21ksoftirqd/219:18:312
205429950680,211cyclictest65-21ksoftirqd/621:15:416
205379950679,126cyclictest121rcu_preempt22:13:501
2053699506338,43cyclictest28517-21diskmemload00:19:410
205409950541,383cyclictest0-21swapper/423:20:224
2054399504385,37cyclictest711rcuc/720:39:057
2054299504120,168cyclictest65-21ksoftirqd/622:34:306
205379950481,126cyclictest25-21ksoftirqd/123:03:271
2053799504163,126cyclictest121rcu_preempt22:35:231
205419950375,296cyclictest0-21swapper/500:07:515
2053999503123,296cyclictest31742-21nscd21:25:373
2053699503119,126cyclictest31197-21ssh22:25:200
205409950238,295cyclictest0-21swapper/419:20:014
205409950134,464cyclictest0-21swapper/423:28:324
205409950134,464cyclictest0-21swapper/423:28:324
205409950134,464cyclictest0-21swapper/422:55:194
2053799501202,126cyclictest19268-21hwlatdetect22:55:161
2053699499413,84cyclictest111rcuc/019:25:350
205419949876,84cyclictest6850-21gltestperf00:00:155
205379949876,84cyclictest0-21swapper/119:26:581
205379949871,296cyclictest0-21swapper/123:29:521
205379949871,296cyclictest0-21swapper/123:29:511
2054399497243,84cyclictest10243-21kworker/u16:221:15:277
2054199497123,372cyclictest0-21swapper/500:19:345
205409949632,383cyclictest0-21swapper/422:23:044
2053699496453,41cyclictest111rcuc/022:44:240
205369949632,291cyclictest22027-21ssh00:08:340
205389949569,211cyclictest0-21swapper/200:20:252
205419949429,255cyclictest0-21swapper/520:17:355
2053999492109,253cyclictest41-21ksoftirqd/300:32:233
205379949223,127cyclictest0-21swapper/121:35:361
205389949126,84cyclictest0-21swapper/222:23:142
205419949022,295cyclictest0-21swapper/522:44:145
2053699490106,84cyclictest121rcu_preempt23:59:190
2054399486145,338cyclictest20534-21cyclictest21:30:147
205409948619,464cyclictest0-21swapper/420:40:154
2054099486107,84cyclictest0-21swapper/400:20:014
2053799486109,374cyclictest0-21swapper/123:57:561
205429948516,169cyclictest0-21swapper/622:44:426
2054199485142,295cyclictest22058-21nscd21:32:095
205379948521,261cyclictest0-21swapper/122:44:301
205379948420,261cyclictest0-21swapper/121:16:501
205369948421,295cyclictest0-21swapper/023:02:540
205439948214,126cyclictest7937-21ssh21:38:347
205369948260,338cyclictest0-21swapper/022:55:290
2053999481101,126cyclictest0-21swapper/322:33:523
2054199477136,338cyclictest2344-1kworker/u17:200:33:065
205389947654,84cyclictest0-21swapper/221:37:532
205439947250,84cyclictest0-21swapper/721:28:597
20536994714,464cyclictest0-21swapper/023:30:190
205429947044,126cyclictest0-21swapper/621:13:526
2054199469383,84cyclictest551rcuc/521:27:415
2053999469425,42cyclictest391rcuc/300:19:453
20536994684,295cyclictest0-21swapper/021:12:570
20536994671,211cyclictest0-21swapper/021:28:030
205439946681,211cyclictest73-21ksoftirqd/722:34:467
20542994662,168cyclictest0-21swapper/622:12:386
2054199466124,126cyclictest721-21nscd23:59:345
205389946680,211cyclictest33-21ksoftirqd/223:19:072
205439946538,296cyclictest0-21swapper/722:11:407
2054199465124,126cyclictest13922-21ssh23:27:305
2054199465124,126cyclictest13922-21ssh23:27:305
205409946540,422cyclictest0-21swapper/400:00:044
205399946538,211cyclictest41-21ksoftirqd/320:16:043
2053699465124,338cyclictest0-21swapper/019:30:110
2054399464420,41cyclictest721ktimersoftd/723:03:067
2054299464124,337cyclictest0-21swapper/623:19:366
2054299464122,339cyclictest0-21swapper/621:37:336
2054199464122,126cyclictest27004-21sendmail19:20:015
2053999464124,338cyclictest19156-21taskset23:49:313
205389946438,127cyclictest121rcu_preempt20:38:382
205379946483,126cyclictest25-21ksoftirqd/123:47:391
205399946379,211cyclictest41-21ksoftirqd/322:12:183
205399946377,84cyclictest0-21swapper/321:37:533
205369946341,170cyclictest0-21swapper/023:05:040
205429946278,126cyclictest698-21ptp4l00:34:306
205389946282,296cyclictest0-21swapper/221:16:362
2053799462121,338cyclictest0-21swapper/123:30:251
205369946279,380cyclictest0-21swapper/023:18:520
205369946240,253cyclictest0-21swapper/022:12:030
205439946176,126cyclictest121rcu_preempt23:05:067
205409946177,380cyclictest0-21swapper/400:07:294
205409946139,341cyclictest0-21swapper/422:25:394
2054099461119,339cyclictest64450irq/122-eth000:35:194
205389946133,126cyclictest0-21swapper/221:14:162
2054399460119,338cyclictest0-21swapper/700:07:517
205429945974,126cyclictest65-21ksoftirqd/621:26:096
2054299459416,41cyclictest641ktimersoftd/620:19:246
205419945974,84cyclictest0-21swapper/521:37:525
205399945937,255cyclictest0-21swapper/323:29:533
205399945937,255cyclictest0-21swapper/323:29:523
205389945937,2cyclictest0-21swapper/223:27:532
205389945937,2cyclictest0-21swapper/223:27:532
205369945937,301cyclictest0-21swapper/021:18:080
2054399458201,127cyclictest121rcu_preempt23:29:417
2054399458201,127cyclictest121rcu_preempt23:29:407
205399945836,255cyclictest0-21swapper/323:58:103
205439945735,256cyclictest0-21swapper/700:20:087
205389945773,126cyclictest32198-21ssh21:32:182
205389945735,2cyclictest5114-21grep23:05:252
2053899457115,126cyclictest33-21ksoftirqd/200:07:402
205369945736,213cyclictest0-21swapper/023:49:410
205439945627,381cyclictest0-21swapper/722:43:147
2053999456115,126cyclictest41-21ksoftirqd/321:44:163
205439945535,82cyclictest0-21swapper/723:20:227
205429945571,211cyclictest65-21ksoftirqd/621:33:316
2054299455334,119cyclictest641ktimersoftd/620:38:236
205399945533,257cyclictest32336-21fschecks_count23:20:153
205369945575,253cyclictest0-21swapper/000:10:340
205369945575,253cyclictest0-21swapper/000:10:340
2053699455114,338cyclictest0-21swapper/000:35:190
2054399454113,338cyclictest0-21swapper/700:19:357
205369945431,3cyclictest0-21swapper/023:20:150
205439945368,211cyclictest0-21swapper/722:23:137
205439945331,3cyclictest0-21swapper/700:34:197
2054299453371,79cyclictest631rcuc/623:29:426
2054299453371,79cyclictest631rcuc/623:29:426
205409945331,341cyclictest0-21swapper/420:26:514
205439945027,2cyclictest0-21swapper/719:25:347
205389945028,2cyclictest0-21swapper/223:59:532
2053799450109,126cyclictest0-21swapper/122:23:461
205409944928,342cyclictest1266-21expr19:30:144
205379944927,219cyclictest0-21swapper/120:38:371
205389944866,84cyclictest0-21swapper/200:35:442
2053799448109,91cyclictest0-21swapper/100:33:531
205389944761,127cyclictest0-21swapper/223:03:372
2053799447110,170cyclictest0-21swapper/121:13:291
205419944624,2cyclictest0-21swapper/521:17:265
205419944624,254cyclictest0-21swapper/523:48:415
205389944624,84cyclictest0-21swapper/223:49:112
2054299445188,254cyclictest19341-21kworker/u16:023:03:226
205389944521,84cyclictest0-21swapper/222:44:332
2054199444105,84cyclictest0-21swapper/523:02:445
205399944461,126cyclictest0-21swapper/322:44:143
205379944418,295cyclictest0-21swapper/100:19:571
205379944416,211cyclictest0-21swapper/122:25:141
205399944317,211cyclictest0-21swapper/319:26:323
205429944220,2cyclictest0-21swapper/623:48:006
2053999442185,254cyclictest401ktimersoftd/323:30:293
205419944119,2cyclictest0-21swapper/522:14:385
205439944018,177cyclictest1553-21runrttasks23:49:427
205419943917,253cyclictest0-21swapper/500:35:355
205419943819,331cyclictest0-21swapper/520:38:205
2053699438101,84cyclictest0-21swapper/020:57:490
205439943714,253cyclictest2774-21runrttasks21:13:137
205419943714,298cyclictest20534-21cyclictest19:54:055
2054199436350,83cyclictest551rcuc/523:30:305
205379943620,254cyclictest0-21swapper/123:05:041
205419943514,2cyclictest0-21swapper/522:22:555
205439943411,256cyclictest0-21swapper/723:37:567
205369943497,126cyclictest9-21ksoftirqd/000:20:250
205419943353,84cyclictest0-21swapper/521:12:155
205379943317,296cyclictest0-21swapper/119:18:541
205419943251,127cyclictest0-21swapper/500:20:085
205439943149,84cyclictest0-21swapper/700:00:097
2054199431175,253cyclictest15523-1kworker/u17:123:19:505
205399943150,84cyclictest0-21swapper/323:18:523
205429943091,42cyclictest0-21swapper/623:05:266
20542994307,256cyclictest0-21swapper/623:37:576
20542994307,256cyclictest0-21swapper/619:15:226
205409942845,380cyclictest0-21swapper/400:10:244
205409942845,380cyclictest0-21swapper/400:10:244
20539994275,247cyclictest0-21swapper/321:13:343
20537994271,126cyclictest0-21swapper/119:20:091
205399942683,340cyclictest0-21swapper/323:02:243
205399942647,126cyclictest0-21swapper/322:55:283
20543994251,169cyclictest0-21swapper/723:30:297
20542994252,3cyclictest0-21swapper/619:26:226
205409942584,253cyclictest0-21swapper/400:20:064
20540994251,36cyclictest0-21swapper/419:14:144
205439942483,338cyclictest0-21swapper/723:57:567
205439942483,338cyclictest0-21swapper/723:19:137
205439942483,338cyclictest0-21swapper/721:57:297
205399942482,211cyclictest0-21swapper/323:05:043
205389942482,126cyclictest0-21swapper/200:34:082
205429942382,84cyclictest0-21swapper/623:59:426
205399942382,338cyclictest0-21swapper/319:18:433
20537994231,2cyclictest0-21swapper/100:20:071
20540994221,255cyclictest0-21swapper/423:50:064
205399942181,84cyclictest0-21swapper/300:07:403
205379942182,84cyclictest0-21swapper/100:35:371
2053699421122,84cyclictest0-21swapper/020:01:380
2054399420121,126cyclictest0-21swapper/700:35:307
205429942081,84cyclictest20534-21cyclictest22:23:456
205429942081,84cyclictest0-21swapper/621:51:396
205399942037,169cyclictest0-21swapper/322:35:153
205389942077,126cyclictest20534-21cyclictest00:00:152
205369942082,84cyclictest0-21swapper/021:51:400
205399941978,338cyclictest0-21swapper/300:35:183
2053799419119,211cyclictest0-21swapper/100:00:161
205429941881,82cyclictest0-21swapper/600:19:496
205419941879,84cyclictest0-21swapper/523:20:335
205409941878,338cyclictest0-21swapper/420:20:034
205389941878,338cyclictest20534-21cyclictest22:25:312
205389941878,338cyclictest0-21swapper/200:19:352
205379941835,48cyclictest0-21swapper/122:45:101
205429941679,84cyclictest18665-21/usr/sbin/munin23:30:316
2054299416159,126cyclictest121rcu_preempt23:20:286
205389941675,338cyclictest19248-21hddtemp_smartct22:55:142
205369941637,2cyclictest0-21swapper/022:35:220
205429941576,84cyclictest0-21swapper/600:20:096
2054199415162,126cyclictest4487-1kworker/u17:223:05:265
205389941577,84cyclictest0-21swapper/223:20:302
2054299414159,48cyclictest19040-21kworker/u16:100:08:066
205389941472,211cyclictest14655-21ssh22:35:192
205389941434,84cyclictest0-21swapper/223:30:222
205439941375,83cyclictest0-21swapper/700:10:237
205439941375,83cyclictest0-21swapper/700:10:237
205419941375,84cyclictest0-21swapper/521:51:405
205399941374,84cyclictest0-21swapper/322:22:563
205399941374,84cyclictest0-21swapper/300:20:093
205419941274,84cyclictest0-21swapper/522:35:065
205389941271,338cyclictest0-21swapper/220:57:482
205369941232,260cyclictest0-21swapper/022:45:100
2053999411111,126cyclictest41-21ksoftirqd/320:39:053
205369941131,255cyclictest31531-21cstates20:20:130
205429941071,84cyclictest0-21swapper/622:35:196
205369941026,295cyclictest0-21swapper/021:44:160
205409940931,164cyclictest0-21swapper/420:57:494
205399940922,84cyclictest0-21swapper/300:10:343
205399940922,84cyclictest0-21swapper/300:10:343
205369940930,295cyclictest0-21swapper/020:40:050
205419940823,211cyclictest0-21swapper/520:40:195
205389940828,3cyclictest0-21swapper/220:19:082
205379940824,169cyclictest0-21swapper/120:19:251
205389940668,254cyclictest0-21swapper/220:40:102
205379940525,254cyclictest0-21swapper/120:20:131
205429940465,84cyclictest0-21swapper/600:35:326
205419940466,84cyclictest0-21swapper/519:27:305
205399940465,84cyclictest0-21swapper/322:25:213
205389940323,85cyclictest0-21swapper/223:50:242
205439940121,213cyclictest0-21swapper/720:17:027
205399940162,84cyclictest0-21swapper/320:57:493
2054399399359,4cyclictest721ktimersoftd/720:40:077
205419939916,295cyclictest0-21swapper/522:45:085
205439939859,44cyclictest721ktimersoftd/719:54:047
205439939857,212cyclictest0-21swapper/722:25:337
205409939814,92cyclictest121rcu_preempt19:54:054
205389939860,171cyclictest0-21swapper/219:54:052
205399939657,84cyclictest0-21swapper/321:51:403
205389939613,124cyclictest0-21swapper/220:01:482
205429939457,171cyclictest698-21ptp4l23:50:236
205429939252,84cyclictest0-21swapper/622:25:216
205419939152,84cyclictest0-21swapper/520:57:495
205379939152,84cyclictest0-21swapper/120:40:151
205399938988,211cyclictest41-21ksoftirqd/320:40:053
205379938950,84cyclictest0-21swapper/123:50:241
205409938847,338cyclictest0-21swapper/421:44:164
205399938747,84cyclictest0-21swapper/320:20:033
205429938548,84cyclictest0-21swapper/622:55:206
205439938445,84cyclictest0-21swapper/722:35:167
205429938343,85cyclictest0-21swapper/620:40:156
2054399382167,212cyclictest721ktimersoftd/722:55:287
205379938240,84cyclictest0-21swapper/119:30:131
205369937941,172cyclictest0-21swapper/019:20:060
2053699379124,253cyclictest22535-21ssh23:50:240
205389937841,2cyclictest0-21swapper/220:20:052
205379937879,126cyclictest27113-21users00:10:221
205379937879,126cyclictest27113-21users00:10:221
2053699378207,126cyclictest121rcu_preempt21:20:020
205419937735,211cyclictest0-21swapper/522:25:185
205429937636,85cyclictest0-21swapper/600:10:246
205429937636,85cyclictest0-21swapper/600:10:236
205429937634,171cyclictest0-21swapper/619:20:076
205419937634,126cyclictest121rcu_preempt00:10:235
205419937634,126cyclictest121rcu_preempt00:10:235
205409937635,260cyclictest0-21swapper/420:07:284
205389937638,2cyclictest0-21swapper/219:30:042
205389937637,3cyclictest0-21swapper/200:10:252
205389937637,3cyclictest0-21swapper/200:10:242
205429937536,84cyclictest0-21swapper/620:20:046
205369937434,338cyclictest0-21swapper/020:49:550
205399937376,84cyclictest0-21swapper/319:20:073
205429937275,125cyclictest0-21swapper/619:30:086
2054199372116,253cyclictest0-21swapper/522:55:305
205399937075,84cyclictest0-21swapper/320:01:383
205399937034,254cyclictest0-21swapper/323:50:073
205419936929,214cyclictest0-21swapper/520:01:475
205439936728,84cyclictest0-21swapper/720:20:037
205439936728,84cyclictest0-21swapper/720:01:397
205389936528,2cyclictest0-21swapper/219:20:072
205369936326,211cyclictest0-21swapper/020:26:510
205369936325,171cyclictest0-21swapper/019:54:050
205419936224,84cyclictest0-21swapper/520:20:055
205429936164,84cyclictest0-21swapper/620:57:486
205419935972,76cyclictest0-21swapper/523:50:055
2054399358190,3cyclictest30862-21taskset22:45:047
205439935799,254cyclictest27389-21taskset19:20:067
205409935512,299cyclictest0-21swapper/419:46:484
205389935417,3cyclictest0-21swapper/222:45:052
205389935214,2cyclictest0-21swapper/219:46:492
205429935157,212cyclictest0-21swapper/600:00:086
205399935151,169cyclictest0-21swapper/320:07:283
205419935094,125cyclictest0-21swapper/519:20:095
205439934110,206cyclictest0-21swapper/719:46:497
20540993411,337cyclictest0-21swapper/420:49:554
20540993411,337cyclictest0-21swapper/420:01:394
205379933840,126cyclictest25-21ksoftirqd/121:51:361
205369933735,253cyclictest0-21swapper/019:14:150
205389933640,85cyclictest0-21swapper/219:14:162
205399933535,169cyclictest0-21swapper/300:00:053
205379933582,84cyclictest121rcu_preempt20:58:061
205439933439,84cyclictest0-21swapper/720:07:287
205389933439,213cyclictest0-21swapper/220:07:292
205419932830,126cyclictest0-21swapper/519:30:135
205429932774,211cyclictest0-21swapper/620:26:516
2053799327249,76cyclictest231rcuc/121:44:111
205389932631,2cyclictest0-21swapper/221:20:012
205439932524,84cyclictest0-21swapper/719:14:107
205439932423,127cyclictest0-21swapper/720:57:497
205429932428,126cyclictest0-21swapper/622:45:066
205409932429,177cyclictest0-21swapper/421:20:024
205439932328,84cyclictest0-21swapper/721:44:167
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional