You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 09:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Sep 19, 2026 00:53:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2813599740107,631cyclictest28129-21cyclictest21:13:254
281359970871,84cyclictest0-21swapper/422:28:214
2813699702107,126cyclictest3835-21idleruntime23:10:185
281359969819,676cyclictest0-21swapper/421:05:184
281359969658,549cyclictest0-21swapper/421:30:194
281359969658,549cyclictest0-21swapper/421:30:194
281359969360,549cyclictest0-21swapper/400:15:154
28135996811,592cyclictest0-21swapper/400:26:444
281359963743,591cyclictest0-21swapper/422:55:154
2813299637126,296cyclictest28129-21cyclictest23:38:571
28132996350,84cyclictest0-21swapper/122:28:201
2813199635123,84cyclictest121rcu_preempt21:15:040
281359962230,555cyclictest0-21swapper/423:27:044
281359962230,555cyclictest0-21swapper/423:27:044
281359962067,549cyclictest0-21swapper/423:39:314
281359961722,550cyclictest1642-21ssh23:09:414
2813799609140,254cyclictest0-21swapper/623:09:176
281359960715,430cyclictest0-21swapper/423:00:384
28137995941,126cyclictest0-21swapper/623:27:166
28137995941,126cyclictest0-21swapper/623:27:166
281389959381,339cyclictest0-21swapper/722:55:177
28133995930,84cyclictest0-21swapper/222:55:012
28131995930,84cyclictest0-21swapper/023:50:490
2813199590122,380cyclictest121rcu_preempt21:30:190
2813199590122,380cyclictest121rcu_preempt21:30:190
2813199587119,126cyclictest0-21swapper/023:09:400
281349958571,126cyclictest0-21swapper/322:29:263
281329958473,296cyclictest0-21swapper/123:25:541
281329958473,296cyclictest0-21swapper/123:25:541
281319958476,126cyclictest0-21swapper/023:38:160
281359958229,550cyclictest0-21swapper/419:31:054
281349958126,381cyclictest0-21swapper/319:53:343
281339958172,126cyclictest121rcu_preempt21:09:552
281319958172,84cyclictest0-21swapper/022:00:120
2813499579110,296cyclictest0-21swapper/321:11:453
281339957929,338cyclictest0-21swapper/219:30:492
281359957825,549cyclictest3333-21diskmemload23:42:114
281359957624,549cyclictest64450irq/122-eth023:32:354
281339957666,126cyclictest14478-21rm00:09:262
281359957324,465cyclictest0-21swapper/422:35:084
281339957319,381cyclictest0-21swapper/221:12:142
281319957324,338cyclictest0-21swapper/000:15:460
2813899572486,84cyclictest711rcuc/721:05:247
281319957165,85cyclictest121rcu_preempt21:08:340
281349956558,126cyclictest0-21swapper/321:35:193
281349956313,128cyclictest0-21swapper/322:24:173
281329955143,126cyclictest0-21swapper/121:05:181
28136995501,44cyclictest0-21swapper/520:10:145
281359955040,339cyclictest121rcu_preempt23:56:434
2813599549462,84cyclictest0-21swapper/423:50:484
281319954638,126cyclictest0-21swapper/000:37:560
281329954539,83cyclictest121rcu_preempt22:24:091
2813299545118,296cyclictest0-21swapper/123:20:201
2813699544203,338cyclictest1578-21lldpd00:26:385
281329954374,254cyclictest0-21swapper/121:10:341
281349954273,296cyclictest0-21swapper/323:38:173
281389954069,339cyclictest0-21swapper/723:41:047
281359954033,423cyclictest0-21swapper/422:50:184
281329954074,126cyclictest0-21swapper/122:49:231
281329953931,84cyclictest0-21swapper/100:26:281
281379953829,127cyclictest0-21swapper/623:51:016
281319953831,126cyclictest0-21swapper/021:10:040
2813199538113,422cyclictest632-21rpcbind19:34:420
2813499536110,84cyclictest0-21swapper/322:35:063
2813499536110,211cyclictest41-21ksoftirqd/321:05:433
281359953425,506cyclictest0-21swapper/422:24:214
281319953427,338cyclictest0-21swapper/023:41:510
281339953326,296cyclictest0-21swapper/222:35:052
281339953266,126cyclictest0-21swapper/223:19:452
281339953064,211cyclictest0-21swapper/222:29:262
2813399528102,296cyclictest0-21swapper/200:37:562
281359952721,341cyclictest0-21swapper/400:09:214
281319952721,337cyclictest0-21swapper/023:20:040
281379952617,84cyclictest0-21swapper/623:38:576
281369952617,86cyclictest0-21swapper/522:15:225
281359952616,507cyclictest0-21swapper/422:40:154
281359952616,127cyclictest0-21swapper/421:50:164
2813899525100,209cyclictest73-21ksoftirqd/720:10:147
281359952558,464cyclictest0-21swapper/423:20:344
281339952517,8cyclictest0-21swapper/222:40:332
281319952514,296cyclictest0-21swapper/022:40:050
281359952211,507cyclictest0-21swapper/400:10:434
281339952253,296cyclictest0-21swapper/223:56:162
281379952157,298cyclictest0-21swapper/623:10:186
2813299520181,126cyclictest121rcu_preempt23:05:461
281379951647,211cyclictest0-21swapper/600:27:246
28131995121,339cyclictest0-21swapper/022:24:160
2813399510466,42cyclictest311rcuc/222:54:202
28133995101,85cyclictest121rcu_preempt23:41:042
281389950949,37cyclictest0-21swapper/722:15:347
28134995090,84cyclictest27618-21/usr/sbin/munin22:30:213
28134995090,84cyclictest0-21swapper/323:26:453
28134995090,84cyclictest0-21swapper/323:26:453
28134995090,84cyclictest0-21swapper/300:27:133
28133995090,84cyclictest0-21swapper/200:10:172
281339950839,254cyclictest0-21swapper/223:39:032
28131995080,84cyclictest0-21swapper/022:28:210
281339950782,211cyclictest0-21swapper/200:27:312
281369950680,211cyclictest0-21swapper/521:10:185
2813699503122,296cyclictest0-21swapper/523:00:115
2813499503119,126cyclictest41-21ksoftirqd/323:19:453
281369950236,86cyclictest0-21swapper/523:39:205
281369950233,254cyclictest0-21swapper/521:05:435
2813399502242,126cyclictest0-21swapper/221:30:152
2813399502242,126cyclictest0-21swapper/221:30:152
281319950233,254cyclictest30662-21awk22:50:000
2813899501418,3cyclictest721ktimersoftd/723:00:047
2813799501420,79cyclictest631rcuc/600:32:156
2813699501156,168cyclictest2687-21ssh22:00:145
281339950175,211cyclictest0-21swapper/200:20:502
281329950177,84cyclictest121rcu_preempt23:10:181
2813799500115,254cyclictest0-21swapper/621:06:416
281379949930,296cyclictest0-21swapper/600:10:416
281359949975,126cyclictest0-21swapper/423:46:144
281349949972,211cyclictest0-21swapper/300:09:193
281339949733,3cyclictest0-21swapper/223:01:002
2813799496117,295cyclictest0-21swapper/622:35:096
281349949672,84cyclictest0-21swapper/322:49:163
281379949569,211cyclictest0-21swapper/621:14:006
281369949529,50cyclictest0-21swapper/522:54:565
281349949429,41cyclictest0-21swapper/300:15:133
281329949467,211cyclictest25-21ksoftirqd/121:15:071
281359949325,126cyclictest0-21swapper/419:26:554
281329949366,210cyclictest25-21ksoftirqd/123:46:141
281359949266,423cyclictest28129-21cyclictest22:48:524
281339949225,127cyclictest0-21swapper/223:20:532
281319949127,177cyclictest0-21swapper/023:32:350
281319949025,380cyclictest0-21swapper/021:35:200
281319948924,291cyclictest0-21swapper/023:46:180
281369948861,338cyclictest0-21swapper/523:46:225
281359948820,126cyclictest0-21swapper/421:35:184
281319948820,379cyclictest18717-21kernelversion23:00:220
2813899487155,161cyclictest121rcu_preempt21:11:517
281379948720,336cyclictest0-21swapper/622:24:286
2813799486190,8cyclictest0-21swapper/622:40:336
2813699484144,338cyclictest0-21swapper/523:56:255
281359948415,339cyclictest0-21swapper/422:15:234
281329948417,84cyclictest0-21swapper/121:35:191
281379948317,218cyclictest0-21swapper/623:20:116
281369948361,338cyclictest0-21swapper/522:30:185
2813799482103,376cyclictest0-21swapper/622:54:496
281369948218,84cyclictest1551-21snmpd19:31:175
281329948260,84cyclictest0-21swapper/100:09:231
2813899481141,337cyclictest28129-21cyclictest22:30:107
281369948121,329cyclictest0-21swapper/523:09:165
281359948157,338cyclictest0-21swapper/422:14:484
2813399481228,8cyclictest0-21swapper/223:26:222
2813399481228,8cyclictest0-21swapper/223:26:222
281389948010,84cyclictest0-21swapper/723:46:187
28135994779,338cyclictest23027-21kworker/u16:120:05:124
2813499477222,253cyclictest401ktimersoftd/323:50:273
2813199477139,254cyclictest2074-21rm23:26:190
2813199477139,254cyclictest2074-21rm23:26:180
281379947611,177cyclictest0-21swapper/623:46:196
2813599476135,338cyclictest30152-21nscd23:10:184
281339947512,47cyclictest121rcu_preempt22:24:162
281359947287,254cyclictest0-21swapper/420:10:224
28135994715,126cyclictest0-21swapper/400:42:514
28132994704,218cyclictest0-21swapper/119:31:391
28133994681,84cyclictest0-21swapper/200:15:272
28136994661,84cyclictest0-21swapper/523:26:205
28136994661,84cyclictest0-21swapper/523:26:205
28131994660,84cyclictest4741-21ssh00:20:510
281369946580,211cyclictest18741-21expr21:35:225
2813599465125,126cyclictest121rcu_preempt00:20:284
2813399465124,338cyclictest0-21swapper/222:30:102
281339946441,257cyclictest0-21swapper/221:35:172
28133994642,217cyclictest0-21swapper/219:35:162
2813399464124,338cyclictest0-21swapper/222:15:312
281379946341,256cyclictest0-21swapper/623:56:446
281369946341,255cyclictest0-21swapper/500:09:215
281339946341,256cyclictest0-21swapper/222:49:222
281319946341,255cyclictest0-21swapper/000:15:030
281319946341,212cyclictest11958-21ssh22:40:010
281319946336,211cyclictest24309-21ssh23:56:450
281389946240,3cyclictest0-21swapper/723:50:287
281379946239,256cyclictest0-21swapper/619:30:516
2813799462121,338cyclictest0-21swapper/621:35:146
281389946176,211cyclictest73-21ksoftirqd/721:35:237
281379946180,128cyclictest28129-21cyclictest22:28:566
2813799461121,338cyclictest0-21swapper/622:49:146
2813799461121,338cyclictest0-21swapper/622:30:186
2813799461121,338cyclictest0-21swapper/620:10:166
281369946177,211cyclictest16379-21rm22:24:225
281359946176,211cyclictest49-21ksoftirqd/422:30:024
2813299461120,338cyclictest690-21avahi-daemon00:20:281
281319946137,258cyclictest0-21swapper/000:27:240
281379946037,256cyclictest0-21swapper/622:14:446
281369946038,256cyclictest0-21swapper/500:15:155
2813399460121,336cyclictest0-21swapper/223:10:272
2813299460288,84cyclictest24433-21latency_hist00:15:041
281389945936,2cyclictest0-21swapper/722:49:237
2813899459118,338cyclictest0-21swapper/723:20:377
2813499459122,170cyclictest0-21swapper/323:07:293
281329945978,126cyclictest0-21swapper/123:56:491
2813299459415,42cyclictest231rcuc/123:42:581
2813199459119,338cyclictest24269-21ssh00:31:560
281389945883,372cyclictest3333-21diskmemload22:29:197
281369945878,295cyclictest0-21swapper/522:35:095
281369945834,211cyclictest0-21swapper/523:32:575
281349945836,253cyclictest0-21swapper/300:10:103
2813499458201,254cyclictest3848-21ssh23:10:193
2813499458121,170cyclictest0-21swapper/322:40:383
2813499458120,171cyclictest0-21swapper/319:26:563
2813499458117,338cyclictest0-21swapper/320:10:153
2813399458245,82cyclictest0-21swapper/223:05:462
2813199458118,338cyclictest0-21swapper/022:50:160
281379945734,256cyclictest0-21swapper/600:15:416
281349945731,255cyclictest0-21swapper/323:41:103
281339945735,84cyclictest0-21swapper/200:42:482
281319945735,258cyclictest0-21swapper/022:34:540
281389945634,255cyclictest0-21swapper/721:55:227
281389945634,255cyclictest0-21swapper/721:55:227
2813799456116,338cyclictest0-21swapper/623:00:276
2813399456115,338cyclictest0-21swapper/222:14:452
281329945635,41cyclictest121rcu_preempt23:00:121
2813399455115,338cyclictest28129-21cyclictest23:51:292
2813299455372,3cyclictest231rcuc/122:35:041
2813199455116,84cyclictest0-21swapper/022:15:200
281369945474,85cyclictest0-21swapper/523:41:165
281389945331,2cyclictest0-21swapper/721:15:057
2813899453111,126cyclictest0-21swapper/723:26:287
2813899453111,126cyclictest0-21swapper/723:26:287
2813399453332,37cyclictest311rcuc/221:55:222
2813399453332,37cyclictest311rcuc/221:55:212
281379945229,256cyclictest0-21swapper/623:41:416
2813799452110,339cyclictest0-21swapper/623:19:566
2813699452280,84cyclictest0-21swapper/523:19:455
281329945271,126cyclictest0-21swapper/123:32:451
2813799451110,338cyclictest0-21swapper/600:20:476
281369945129,256cyclictest0-21swapper/522:40:245
281369945128,338cyclictest0-21swapper/522:29:275
2813599451112,84cyclictest0-21swapper/419:35:164
2813499451111,85cyclictest1338-21sh22:15:293
281319945168,218cyclictest441-21cstates20:10:140
2813199451112,84cyclictest21044-21sh23:19:540
281369945028,256cyclictest0-21swapper/500:37:455
2813299450109,338cyclictest0-21swapper/123:51:131
281319945023,296cyclictest0-21swapper/000:09:200
2813499449110,84cyclictest0-21swapper/322:50:193
2813599448108,338cyclictest0-21swapper/422:00:164
2813399448109,336cyclictest0-21swapper/200:31:562
281329944826,256cyclictest0-21swapper/119:35:161
2813899447105,339cyclictest0-21swapper/700:15:197
2813899446106,337cyclictest0-21swapper/700:11:057
2813299446108,172cyclictest27436-21rm00:15:411
2813899444103,210cyclictest73-21ksoftirqd/722:40:297
281319944418,254cyclictest0-21swapper/023:10:190
2813899443104,337cyclictest0-21swapper/700:26:467
281369944321,219cyclictest0-21swapper/522:55:205
2813799442101,338cyclictest0-21swapper/600:09:276
281369944220,127cyclictest28129-21cyclictest22:49:385
281369944119,256cyclictest0-21swapper/523:20:545
2813499441105,81cyclictest0-21swapper/323:56:253
2813499441103,84cyclictest0-21swapper/323:20:033
2813499441103,84cyclictest0-21swapper/319:35:163
281389944016,126cyclictest0-21swapper/723:38:577
281369944018,256cyclictest0-21swapper/523:51:255
281349944096,211cyclictest0-21swapper/321:50:183
2813499440101,84cyclictest0-21swapper/323:00:593
281319944098,126cyclictest9188-21if_err_eth022:55:160
281379943915,3cyclictest0-21swapper/622:15:346
281379943896,84cyclictest121rcu_preempt22:55:136
281369943858,84cyclictest0-21swapper/522:14:565
281319943657,253cyclictest29574-21cpuspeed_turbos20:05:120
281329943412,253cyclictest31343-21grep22:15:131
281359943312,342cyclictest0-21swapper/400:37:564
281359943310,168cyclictest0-21swapper/400:31:564
28136994318,257cyclictest0-21swapper/521:55:225
28136994318,257cyclictest0-21swapper/521:55:215
281339943190,338cyclictest1651-21ntpd21:50:172
281339943189,339cyclictest1153-21idleruntime20:10:232
28135994283,340cyclictest0-21swapper/421:55:224
28135994283,340cyclictest0-21swapper/421:55:214
281339942743,211cyclictest33-21ksoftirqd/223:46:342
28132994271,211cyclictest13263-21taskset22:40:151
28138994251,256cyclictest0-21swapper/722:24:177
2813299425125,126cyclictest121rcu_preempt22:54:201
28138994241,3cyclictest0-21swapper/723:55:597
28131994241,84cyclictest16158-21ssh21:50:190
281359942343,338cyclictest3333-21diskmemload23:19:464
281389942281,338cyclictest0-21swapper/723:06:287
28138994221,125cyclictest0-21swapper/700:09:267
281369942282,338cyclictest0-21swapper/500:20:495
281369942282,338cyclictest0-21swapper/500:11:065
281369942282,337cyclictest0-21swapper/521:15:045
281369942281,338cyclictest0-21swapper/521:50:175
28131994221,2cyclictest0-21swapper/019:35:170
281389942180,338cyclictest15850irq/123-ahci[0022:50:177
281369942180,338cyclictest0-21swapper/500:32:155
281329942182,84cyclictest0-21swapper/123:19:411
281329942182,84cyclictest0-21swapper/120:10:131
281389942079,338cyclictest0-21swapper/722:35:097
281369942079,338cyclictest0-21swapper/520:05:335
281379941934,212cyclictest0-21swapper/623:32:356
281329941980,84cyclictest0-21swapper/122:30:161
281389941876,339cyclictest0-21swapper/722:00:127
281369941777,338cyclictest0-21swapper/521:30:165
281369941777,338cyclictest0-21swapper/521:30:165
281329941776,253cyclictest2409-21cstates22:00:131
2813199417118,210cyclictest3333-21diskmemload22:14:390
281389941636,2cyclictest0-21swapper/719:30:437
281349941677,84cyclictest0-21swapper/323:46:333
281349941677,84cyclictest0-21swapper/300:20:493
281349941576,84cyclictest0-21swapper/322:55:263
281349941576,84cyclictest0-21swapper/319:30:173
281329941434,42cyclictest0-21swapper/120:05:121
281329941433,84cyclictest0-21swapper/122:55:171
281319941473,338cyclictest0-21swapper/019:53:340
281359941329,127cyclictest0-21swapper/419:43:064
281369941272,338cyclictest0-21swapper/519:35:145
281339941271,338cyclictest0-21swapper/223:32:422
281339941232,42cyclictest0-21swapper/220:05:122
2813299412243,84cyclictest241ktimersoftd/119:26:551
281349941071,84cyclictest0-21swapper/300:42:513
281369940969,338cyclictest0-21swapper/520:51:245
281369940969,338cyclictest0-21swapper/520:51:245
281319940968,338cyclictest0-21swapper/020:51:240
281319940968,338cyclictest0-21swapper/020:51:230
281389940722,84cyclictest0-21swapper/723:19:477
281339940664,339cyclictest0-21swapper/221:15:042
2813799405107,295cyclictest0-21swapper/622:00:136
281389940463,126cyclictest0-21swapper/700:32:037
281349940364,84cyclictest0-21swapper/322:14:493
281329940323,85cyclictest0-21swapper/121:50:161
2813799402103,126cyclictest121rcu_preempt21:30:176
2813799402103,126cyclictest121rcu_preempt21:30:176
281369940223,42cyclictest0-21swapper/519:53:345
2813499402103,127cyclictest41-21ksoftirqd/322:00:143
281319940262,338cyclictest28129-21cyclictest19:26:560
2813899401103,126cyclictest10067-21memory21:30:197
2813899401103,126cyclictest10067-21memory21:30:197
281349939919,168cyclictest41-21ksoftirqd/300:31:563
2813199399144,84cyclictest121rcu_preempt00:42:510
2813799398142,125cyclictest121rcu_preempt21:15:056
281369939719,212cyclictest0-21swapper/500:04:055
281359939756,338cyclictest0-21swapper/420:51:244
281359939756,338cyclictest0-21swapper/420:51:234
2813899396224,169cyclictest721ktimersoftd/719:53:347
281359939616,296cyclictest0-21swapper/421:15:054
281389939556,84cyclictest0-21swapper/700:42:517
281339939515,168cyclictest0-21swapper/222:00:152
281389939455,84cyclictest0-21swapper/700:37:447
281329939457,84cyclictest0-21swapper/122:14:561
281389939313,256cyclictest0-21swapper/719:35:167
281379939149,211cyclictest641ktimersoftd/619:35:166
281389938648,83cyclictest30309-21ssh22:14:437
281349938386,84cyclictest28129-21cyclictest20:05:333
28132993834,83cyclictest25-21ksoftirqd/100:37:461
281379938186,84cyclictest7947-21chrt19:26:496
281379937940,171cyclictest0-21swapper/600:37:446
2813399378205,83cyclictest0-21swapper/200:04:102
281329937839,42cyclictest0-21swapper/100:42:501
281389937740,3cyclictest0-21swapper/723:10:307
281379937739,254cyclictest0-21swapper/621:50:156
2813799377251,42cyclictest641ktimersoftd/621:56:026
2813799377251,42cyclictest641ktimersoftd/621:56:026
2813499377121,126cyclictest2819-21ssh00:37:553
2813299377162,84cyclictest121rcu_preempt21:30:191
2813299377162,84cyclictest121rcu_preempt21:30:191
281379937531,127cyclictest1651-21ntpd20:05:126
281369937433,338cyclictest0-21swapper/500:42:505
2813399374200,84cyclictest0-21swapper/219:26:502
281389937334,84cyclictest0-21swapper/720:05:477
281329937334,84cyclictest0-21swapper/120:51:241
281329937334,84cyclictest0-21swapper/120:51:241
281389937233,84cyclictest0-21swapper/721:50:177
281379937277,83cyclictest704-21nscd00:42:496
281359937236,170cyclictest0-21swapper/400:04:054
281349937235,7cyclictest0-21swapper/321:30:173
281349937235,7cyclictest0-21swapper/321:30:173
281389937132,84cyclictest0-21swapper/700:20:287
281389937031,84cyclictest0-21swapper/723:32:357
281329936930,84cyclictest0-21swapper/100:31:561
281369936831,41cyclictest0-21swapper/519:26:505
2813499367111,85cyclictest13773-21rm23:33:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional