You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-22 - 02:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri May 22, 2026 00:57:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208709979372,718cyclictest0-21swapper/423:38:024
208709979372,718cyclictest0-21swapper/423:38:024
208709973513,719cyclictest0-21swapper/400:43:034
208709973513,719cyclictest0-21swapper/400:43:034
2086699733178,296cyclictest20334-21nscd23:13:390
2086999712115,423cyclictest0-21swapper/300:43:553
2086999712115,423cyclictest0-21swapper/300:43:543
208709969819,676cyclictest0-21swapper/400:10:204
208709967436,126cyclictest121rcu_preempt00:32:294
208709967378,422cyclictest121rcu_preempt21:42:354
208709967378,422cyclictest121rcu_preempt21:42:354
208709967076,83cyclictest0-21swapper/421:38:144
208709965215,634cyclictest0-21swapper/423:32:494
2087399651145,296cyclictest16246-21tune2fs00:40:227
2087399651145,296cyclictest16246-21tune2fs00:40:217
2086999649138,296cyclictest0-21swapper/300:01:253
208709964693,380cyclictest0-21swapper/423:56:444
208729964394,84cyclictest0-21swapper/622:29:186
20873996360,126cyclictest0-21swapper/720:58:497
2086799633164,296cyclictest0-21swapper/123:13:381
208699962735,380cyclictest0-21swapper/321:39:033
208719962171,296cyclictest0-21swapper/523:56:375
208689962023,380cyclictest0-21swapper/223:39:202
208689962023,380cyclictest0-21swapper/223:39:202
208709961924,592cyclictest27616-21ssh00:07:544
2086899619107,338cyclictest0-21swapper/221:39:032
2086999616104,296cyclictest0-21swapper/322:29:173
208689960956,211cyclictest0-21swapper/221:45:032
208689960956,211cyclictest0-21swapper/221:45:032
208689960795,381cyclictest0-21swapper/222:59:542
208669960312,422cyclictest0-21swapper/022:17:220
208729959786,126cyclictest0-21swapper/623:53:366
20872995960,84cyclictest0-21swapper/600:06:496
20867995961,126cyclictest0-21swapper/100:35:561
20868995950,84cyclictest0-21swapper/220:58:492
20872995940,85cyclictest0-21swapper/620:58:496
2086899594507,84cyclictest321ktimersoftd/200:38:362
20868995940,84cyclictest0-21swapper/200:06:492
20868995930,84cyclictest0-21swapper/223:56:572
2086999592123,296cyclictest1553-21runrttasks23:24:503
208719959180,338cyclictest0-21swapper/500:39:445
208669959183,126cyclictest0-21swapper/023:24:500
20866995910,84cyclictest0-21swapper/023:39:450
20866995910,84cyclictest0-21swapper/023:39:450
208669958978,126cyclictest0-21swapper/023:59:190
2087299588123,211cyclictest0-21swapper/621:41:036
2087299588123,211cyclictest0-21swapper/621:41:026
208709958840,425cyclictest0-21swapper/400:18:174
208709958838,513cyclictest0-21swapper/423:14:524
208699958834,380cyclictest0-21swapper/322:03:383
208709958735,549cyclictest18491-21sh23:22:454
208709958734,550cyclictest0-21swapper/422:05:334
208669958776,84cyclictest0-21swapper/000:19:160
2086899586547,36cyclictest311rcuc/200:43:472
2086899586547,36cyclictest311rcuc/200:43:472
208709958535,466cyclictest0-21swapper/423:40:074
208699958535,380cyclictest0-21swapper/323:55:273
208709958432,549cyclictest0-21swapper/400:36:544
2087199583158,168cyclictest4546-21taskset00:30:435
2086999583156,254cyclictest0-21swapper/300:10:203
208739958131,381cyclictest0-21swapper/700:30:247
208709958129,549cyclictest0-21swapper/423:54:074
208679957928,127cyclictest0-21swapper/123:37:351
208679957928,127cyclictest0-21swapper/123:37:351
208679957769,84cyclictest0-21swapper/123:55:211
208709957223,465cyclictest0-21swapper/422:49:054
2087399571231,338cyclictest21192-21kworker/u16:023:34:217
2086999571230,338cyclictest23289-1kworker/u17:022:18:033
2087399569229,338cyclictest18652-1kworker/u17:221:43:187
2087399569229,338cyclictest18652-1kworker/u17:221:43:187
2086799567226,338cyclictest26742-21kworker/u16:022:27:411
208679956717,41cyclictest0-21swapper/100:07:541
208719956413,84cyclictest121rcu_preempt23:54:115
2086899564180,253cyclictest0-21swapper/223:24:012
208679956453,380cyclictest0-21swapper/121:39:301
20868995609,169cyclictest0-21swapper/222:49:422
20866995599,127cyclictest0-21swapper/022:03:350
208719955852,126cyclictest27105-21ssh21:44:495
208719955852,126cyclictest27105-21ssh21:44:485
2087399556216,338cyclictest31089-1kworker/u17:222:58:347
2087199556473,3cyclictest551rcuc/522:19:215
2086799553213,338cyclictest13597-21sh23:40:161
208739955140,338cyclictest0-21swapper/723:55:207
20866995511,84cyclictest0-21swapper/000:29:400
208669955040,169cyclictest0-21swapper/021:34:460
208729954982,85cyclictest121rcu_preempt23:13:406
208689954983,126cyclictest0-21swapper/200:31:482
2086699547124,84cyclictest121rcu_preempt00:01:170
208669954639,84cyclictest121rcu_preempt23:34:520
2086699546204,126cyclictest13015-21runrttasks00:38:000
2087399545123,338cyclictest0-21swapper/722:20:007
208699954579,126cyclictest0-21swapper/323:36:263
208699954579,126cyclictest0-21swapper/323:36:253
208719954432,381cyclictest1675-21ssh23:13:295
208709954434,507cyclictest0-21swapper/400:27:164
208709954434,507cyclictest0-21swapper/400:02:104
208679954476,295cyclictest0-21swapper/123:23:221
208739954335,296cyclictest0-21swapper/722:05:047
208719954332,126cyclictest0-21swapper/500:09:215
2086999543121,338cyclictest0-21swapper/322:59:313
208689954332,338cyclictest33-21ksoftirqd/200:04:422
208709954233,472cyclictest0-21swapper/422:20:254
208669954231,338cyclictest0-21swapper/021:00:110
208709954030,507cyclictest0-21swapper/422:19:264
208709953930,506cyclictest13897-21rm22:29:394
208719953832,339cyclictest20864-21cyclictest21:38:455
2086799538238,169cyclictest25880-21kworker/u16:100:32:111
208739953522,381cyclictest0-21swapper/723:53:287
2087299535197,83cyclictest961-21kworker/u16:223:24:346
208669953526,89cyclictest121rcu_preempt22:58:180
208729953427,7cyclictest0-21swapper/621:38:446
208689953365,295cyclictest0-21swapper/223:12:392
208669953326,84cyclictest0-21swapper/022:50:110
2087299532104,253cyclictest121rcu_preempt23:40:256
2086999532105,254cyclictest0-21swapper/300:36:213
208679953262,296cyclictest0-21swapper/100:18:121
208679953022,84cyclictest0-21swapper/123:25:061
208719952964,338cyclictest0-21swapper/500:03:325
2086899528228,85cyclictest1551-21snmpd22:17:492
208709952718,253cyclictest0-21swapper/422:57:244
2087199525102,126cyclictest1551-21snmpd00:27:165
208689952559,209cyclictest0-21swapper/200:16:512
2086699525441,3cyclictest111rcuc/022:27:250
2087299524183,338cyclictest704-21nscd23:39:346
2087299524183,338cyclictest704-21nscd23:39:346
208719952416,84cyclictest121rcu_preempt23:39:205
208719952416,84cyclictest121rcu_preempt23:39:205
208689952498,295cyclictest0-21swapper/200:29:402
208689952497,296cyclictest0-21swapper/223:25:062
2086899524225,126cyclictest0-21swapper/223:54:562
208729952314,126cyclictest0-21swapper/600:00:426
208679952315,84cyclictest0-21swapper/122:59:541
208679952315,84cyclictest0-21swapper/100:44:311
208679952315,84cyclictest0-21swapper/100:44:311
208669952354,295cyclictest0-21swapper/000:07:160
208669952317,84cyclictest121rcu_preempt22:05:100
208669952211,380cyclictest0-21swapper/000:32:090
208739952199,84cyclictest11767-21runrttasks23:38:507
208739952199,84cyclictest11767-21runrttasks23:38:507
208739952110,296cyclictest0-21swapper/723:13:397
2087299521478,41cyclictest631rcuc/600:30:266
208699952155,211cyclictest0-21swapper/322:06:373
208699952113,126cyclictest0-21swapper/300:07:233
2086899521223,126cyclictest26742-21kworker/u16:022:30:072
2086699519480,3cyclictest111rcuc/023:00:250
20868995156,85cyclictest0-21swapper/223:33:502
208719951492,126cyclictest0-21swapper/520:59:455
20872995124,84cyclictest0-21swapper/623:55:216
20871995126,83cyclictest0-21swapper/522:03:345
20871995121,339cyclictest0-21swapper/500:19:305
208729951083,211cyclictest65-21ksoftirqd/623:32:516
208709951082,211cyclictest49-21ksoftirqd/422:04:564
20869995102,168cyclictest0-21swapper/321:45:033
20869995102,168cyclictest0-21swapper/321:45:033
20871995090,85cyclictest0-21swapper/523:33:255
20867995091,84cyclictest0-21swapper/121:40:511
20867995091,84cyclictest0-21swapper/121:40:511
2087399508166,339cyclictest18894-1kworker/u17:100:06:117
20873995080,83cyclictest0-21swapper/700:02:027
20869995081,169cyclictest0-21swapper/323:14:033
20866995088,120cyclictest0-21swapper/023:25:090
20868995070,84cyclictest0-21swapper/223:00:302
20866995060,84cyclictest121rcu_preempt21:40:170
20866995060,84cyclictest121rcu_preempt21:40:170
2087399505118,380cyclictest0-21swapper/723:24:577
208689950583,338cyclictest0-21swapper/222:28:592
2086799505210,84cyclictest0-21swapper/100:27:321
20872995041,123cyclictest0-21swapper/600:41:266
20872995041,123cyclictest0-21swapper/600:41:266
208739950380,84cyclictest0-21swapper/722:27:237
208729950332,126cyclictest0-21swapper/600:39:416
208699950333,296cyclictest8985-21awk23:55:023
2086899503464,3cyclictest311rcuc/221:34:232
208669950234,253cyclictest0-21swapper/021:39:200
208739950175,423cyclictest0-21swapper/723:25:097
208709950134,464cyclictest0-21swapper/423:15:314
208699950135,126cyclictest0-21swapper/321:00:113
208719950036,298cyclictest0-21swapper/522:27:425
2087399499118,84cyclictest0-21swapper/700:36:397
2087099499120,83cyclictest0-21swapper/400:20:304
208679949976,211cyclictest0-21swapper/100:01:101
208729949830,84cyclictest0-21swapper/623:15:306
208689949832,3cyclictest0-21swapper/223:15:072
208669949834,84cyclictest0-21swapper/020:32:410
208709949631,386cyclictest0-21swapper/422:50:114
208729949573,256cyclictest30512-21ssh22:20:226
208719949573,84cyclictest0-21swapper/523:00:145
208719949530,126cyclictest0-21swapper/523:40:045
208739949468,211cyclictest1551-21snmpd21:36:397
208699949429,84cyclictest0-21swapper/323:32:503
208729949328,84cyclictest0-21swapper/622:03:336
208709949328,84cyclictest0-21swapper/421:45:114
2086999491118,118cyclictest0-21swapper/321:34:483
208729948923,84cyclictest0-21swapper/622:19:086
2086999489108,84cyclictest0-21swapper/323:15:223
208689948924,298cyclictest0-21swapper/222:06:362
2087099486106,211cyclictest7134-21taskset23:00:124
208699948659,296cyclictest0-21swapper/322:49:423
2086799486102,211cyclictest31119-21memory22:20:271
208709948517,465cyclictest0-21swapper/421:34:094
208679948418,84cyclictest0-21swapper/122:17:411
208669948462,84cyclictest0-21swapper/000:41:560
208669948462,84cyclictest0-21swapper/000:41:560
208699948356,254cyclictest0-21swapper/321:45:113
2086799482100,212cyclictest704-21nscd22:03:271
208719948116,299cyclictest0-21swapper/522:06:365
208699948198,381cyclictest23367-21munin-run21:00:023
208699948015,340cyclictest0-21swapper/300:20:323
208679947953,211cyclictest0-21swapper/120:58:061
20870994768,465cyclictest0-21swapper/420:59:104
208699947610,126cyclictest0-21swapper/300:18:463
20872994756,296cyclictest0-21swapper/621:00:186
20867994735,211cyclictest0-21swapper/123:34:201
20866994693,126cyclictest0-21swapper/023:54:380
20872994683,126cyclictest0-21swapper/621:34:496
208719946782,211cyclictest24519-21users22:50:335
20866994671,84cyclictest0-21swapper/020:57:400
2086999466166,127cyclictest121rcu_preempt23:40:433
208739946583,380cyclictest0-21swapper/723:00:187
208739946580,211cyclictest31631-21ssh00:27:567
20872994651,298cyclictest0-21swapper/622:06:366
2087299465124,338cyclictest1553-21runrttasks00:18:496
2086999465124,339cyclictest0-21swapper/300:30:463
208739946340,256cyclictest0-21swapper/721:00:157
208729946341,3cyclictest0-21swapper/600:27:526
2087299463122,338cyclictest17744-21ssh00:20:256
2087299463121,339cyclictest0-21swapper/623:00:266
2087399462122,338cyclictest0-21swapper/700:19:237
2087299462121,126cyclictest0-21swapper/622:49:436
208719946279,380cyclictest0-21swapper/522:57:205
2086799461120,338cyclictest0-21swapper/122:06:401
208719945937,256cyclictest0-21swapper/500:40:045
208719945937,256cyclictest0-21swapper/500:40:045
2087199459120,337cyclictest0-21swapper/523:15:305
2086999458118,338cyclictest0-21swapper/300:29:313
208669945875,211cyclictest0-21swapper/000:20:350
208719945734,85cyclictest0-21swapper/523:22:015
2086899457115,211cyclictest33-21ksoftirqd/200:20:262
208699945633,256cyclictest0-21swapper/322:20:183
2087199455114,338cyclictest0-21swapper/522:49:115
2086899455113,168cyclictest30478-21tune2fs22:20:192
208739945474,257cyclictest0-21swapper/700:20:027
208739945432,338cyclictest0-21swapper/722:49:277
208739945335,250cyclictest0-21swapper/723:40:407
2087399453112,339cyclictest0-21swapper/721:34:447
2086899453113,338cyclictest0-21swapper/220:30:482
2087399452112,84cyclictest4382-21grep23:15:207
2087399452112,338cyclictest0-21swapper/722:50:117
208679945171,211cyclictest0-21swapper/121:34:491
208679944925,84cyclictest0-21swapper/122:50:231
208669944823,83cyclictest14445-21gltestperf23:40:270
208739944725,2cyclictest0-21swapper/722:20:217
2086699447110,170cyclictest0-21swapper/022:20:190
208729944663,380cyclictest0-21swapper/622:50:126
2086699446191,253cyclictest101ktimersoftd/022:30:050
208699944522,177cyclictest0-21swapper/323:00:133
208679944565,84cyclictest0-21swapper/100:20:211
208679944523,256cyclictest0-21swapper/122:49:471
208739944320,256cyclictest0-21swapper/722:30:077
2087299441185,253cyclictest0-21swapper/622:58:346
208699944116,42cyclictest0-21swapper/322:50:243
208739943998,338cyclictest0-21swapper/722:03:537
208689943898,338cyclictest0-21swapper/223:40:122
2086799438141,84cyclictest121rcu_preempt23:54:191
208709943797,337cyclictest0-21swapper/423:25:064
208709943795,339cyclictest0-21swapper/421:00:054
208699943658,375cyclictest0-21swapper/322:30:073
208719943594,126cyclictest0-21swapper/500:20:195
208669943412,3cyclictest0-21swapper/023:15:090
20867994319,212cyclictest0-21swapper/123:00:281
208739942950,253cyclictest0-21swapper/700:10:227
208709942888,338cyclictest0-21swapper/420:32:164
20870994282,423cyclictest15404-21df_abs22:30:134
208719942610,78cyclictest0-21swapper/500:10:195
208719942382,169cyclictest0-21swapper/522:30:075
208689942383,338cyclictest0-21swapper/221:00:182
208689942281,338cyclictest0-21swapper/222:50:132
208679942182,84cyclictest0-21swapper/122:30:071
208679942182,84cyclictest0-21swapper/121:00:171
208679942182,84cyclictest0-21swapper/100:10:191
208669942183,83cyclictest0-21swapper/022:49:160
208689942037,3cyclictest0-21swapper/222:04:442
208679941980,84cyclictest0-21swapper/123:15:081
208719941878,338cyclictest0-21swapper/522:20:155
208719941676,337cyclictest0-21swapper/521:34:435
208719941574,338cyclictest0-21swapper/523:25:065
208739941473,338cyclictest0-21swapper/720:32:417
208729941434,3cyclictest0-21swapper/600:10:166
208719941474,338cyclictest0-21swapper/521:00:215
208669941476,83cyclictest0-21swapper/000:10:190
208699941232,296cyclictest0-21swapper/323:25:073
208689940463,338cyclictest0-21swapper/200:10:192
208719939312,84cyclictest0-21swapper/521:45:105
208729938243,85cyclictest15374-21ssh22:30:136
208729937941,83cyclictest0-21swapper/620:32:056
208679937882,42cyclictest0-21swapper/120:32:071
208699937331,339cyclictest0-21swapper/320:32:073
208729936727,85cyclictest0-21swapper/623:25:076
208739936468,84cyclictest0-21swapper/721:45:107
208669935356,84cyclictest0-21swapper/021:45:100
2087299346175,83cyclictest0-21swapper/621:45:106
2086799336122,84cyclictest121rcu_preempt21:45:101
208689933173,169cyclictest33-21ksoftirqd/221:45:052
208719932930,126cyclictest0-21swapper/520:32:255
2016929445,27sleep20-21swapper/219:06:132
1945129264,4sleep50-21swapper/519:05:275
2031728352,28sleep70-21swapper/719:08:187
2032928251,28sleep10-21swapper/119:08:281
2020628251,27sleep30-21swapper/319:06:463
2039028049,28sleep40-21swapper/419:09:194
2031628048,28sleep60-21swapper/619:08:176
2032827848,27sleep00-21swapper/019:08:270
56722710,0sleep20-21swapper/222:40:522
259102590,2sleep22086899cyclictest23:45:382
2087399431,27cyclictest0-21swapper/720:35:177
2087199362,3cyclictest9572-21perl20:35:155
2086799327,14cyclictest25-21ksoftirqd/120:35:171
2086699324,18cyclictest9-21ksoftirqd/020:35:180
88802310,1sleep40-21swapper/421:51:024
20872993023,4cyclictest8852-21cut20:35:116
20870992922,4cyclictest8592-21apt20:35:094
20868992922,4cyclictest8523-21dpkg20:35:012
20872992810,18cyclictest0-21swapper/619:13:166
20871992810,18cyclictest0-21swapper/519:13:195
20870992810,0cyclictest0-21swapper/419:13:144
20873992725,2cyclictest0-21swapper/719:57:037
20873992710,17cyclictest0-21swapper/720:13:567
20873992710,17cyclictest0-21swapper/719:41:567
20873992710,0cyclictest0-21swapper/719:28:077
20873992710,0cyclictest0-21swapper/719:13:407
20872992710,0cyclictest0-21swapper/620:14:056
20872992710,0cyclictest0-21swapper/619:42:226
20872992710,0cyclictest0-21swapper/619:27:446
20871992727,0cyclictest0-21swapper/519:56:395
20871992710,17cyclictest0-21swapper/520:14:025
20871992710,17cyclictest0-21swapper/519:27:515
20871992710,0cyclictest0-21swapper/519:42:245
20870992710,17cyclictest0-21swapper/420:13:544
20870992710,17cyclictest0-21swapper/419:42:184
20870992710,17cyclictest0-21swapper/419:27:454
20869992727,0cyclictest0-21swapper/319:27:503
20869992719,5cyclictest9023-21cat20:35:133
20869992710,17cyclictest0-21swapper/320:13:553
20869992710,17cyclictest0-21swapper/319:56:403
20869992710,0cyclictest0-21swapper/319:41:573
20868992727,0cyclictest0-21swapper/219:57:062
20868992710,17cyclictest0-21swapper/220:14:172
20868992710,17cyclictest0-21swapper/219:28:122
20868992710,0cyclictest0-21swapper/219:41:562
20867992727,0cyclictest0-21swapper/119:56:401
20867992710,17cyclictest0-21swapper/119:42:021
20867992710,0cyclictest0-21swapper/120:13:521
20867992710,0cyclictest0-21swapper/119:27:571
20867992710,0cyclictest0-21swapper/119:13:221
20866992710,17cyclictest0-21swapper/020:14:060
20866992710,17cyclictest0-21swapper/019:56:380
20866992710,17cyclictest0-21swapper/019:42:250
20866992710,17cyclictest0-21swapper/019:28:180
20866992710,0cyclictest0-21swapper/019:13:100
20872992626,0cyclictest0-21swapper/619:56:416
20869992626,0cyclictest0-21swapper/319:13:163
2087399259,12cyclictest18833-21ssh22:13:487
20870992525,0cyclictest0-21swapper/419:56:494
327622220,0sleep40-21swapper/421:10:334
2087399229,10cyclictest17804-21ssh21:20:087
2087399211,16cyclictest0-21swapper/721:09:277
2087399209,8cyclictest0-21swapper/721:54:347
2087399207,10cyclictest4866-21chrt20:27:477
2087399201,12cyclictest0-21swapper/720:20:237
20873992010,7cyclictest0-21swapper/721:16:147
20868992020,0cyclictest0-21swapper/219:13:382
20867992020,0cyclictest5045-21perf20:30:001
19022200,0sleep70-21swapper/719:30:127
2087399197,10cyclictest0-21swapper/721:14:537
2086699190,18cyclictest20437-21cut20:55:000
2087399181,10cyclictest17220-21expr23:05:127
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional