You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 09:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 30, 2026 00:55:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
235299984277,762cyclictest0-21swapper/300:25:363
235269970928,389cyclictest0-21swapper/000:39:120
23529996821,678cyclictest0-21swapper/321:12:003
23527996802,295cyclictest0-21swapper/123:09:241
235299962125,593cyclictest0-21swapper/323:09:483
235319961663,296cyclictest0-21swapper/500:23:115
235299961461,550cyclictest0-21swapper/300:36:323
235299960415,2cyclictest0-21swapper/321:49:113
235289959647,84cyclictest0-21swapper/221:11:492
23528995954,2cyclictest0-21swapper/223:05:522
235299959482,381cyclictest0-21swapper/300:22:453
2352699591124,211cyclictest9-21ksoftirqd/022:03:520
23533995908,4cyclictest0-21swapper/723:05:537
235299959040,165cyclictest0-21swapper/321:50:073
235299958839,211cyclictest0-21swapper/300:05:023
235299958776,508cyclictest0-21swapper/323:50:083
235329958637,383cyclictest0-21swapper/621:15:386
2352799586118,465cyclictest1553-21runrttasks21:12:311
235269958435,338cyclictest0-21swapper/000:40:080
2353099582244,257cyclictest13849-21kworker/u16:221:12:154
235309958169,126cyclictest0-21swapper/423:09:164
2353099577237,337cyclictest64450irq/122-eth000:15:074
235329957265,126cyclictest121rcu_preempt00:26:086
235299956756,508cyclictest0-21swapper/323:17:323
235289956411,169cyclictest8288-21sed21:15:382
235299956314,126cyclictest0-21swapper/322:41:523
235299956314,126cyclictest0-21swapper/322:41:523
235299956314,126cyclictest0-21swapper/322:41:523
235299956314,126cyclictest0-21swapper/322:41:523
235299956314,126cyclictest0-21swapper/322:41:523
23532995501,2cyclictest0-21swapper/623:05:526
2353099546204,127cyclictest121rcu_preempt23:30:134
235299954635,508cyclictest0-21swapper/300:00:253
235309954577,465cyclictest0-21swapper/400:14:044
2353099542117,422cyclictest0-21swapper/423:48:544
2353099541118,84cyclictest0-21swapper/400:02:214
235279954172,338cyclictest0-21swapper/100:02:201
2352699540200,337cyclictest7925-21sh22:41:480
2352699540200,337cyclictest7925-21sh22:41:480
2352699540200,337cyclictest7925-21sh22:41:470
2352699540200,337cyclictest7925-21sh22:41:470
2352699540200,337cyclictest7925-21sh22:41:470
235299953931,429cyclictest0-21swapper/322:05:243
235339953869,211cyclictest11145-21ssh21:51:487
235299953831,429cyclictest0-21swapper/300:14:213
235329953773,84cyclictest0-21swapper/622:03:166
235329953671,126cyclictest0-21swapper/622:41:476
235329953671,126cyclictest0-21swapper/622:41:476
235329953671,126cyclictest0-21swapper/622:41:476
235329953671,126cyclictest0-21swapper/622:41:466
235329953671,126cyclictest0-21swapper/622:41:466
235289953667,296cyclictest0-21swapper/223:18:082
235289953225,85cyclictest0-21swapper/222:45:022
235289953225,85cyclictest0-21swapper/222:45:022
235289953225,85cyclictest0-21swapper/222:45:012
235289953225,85cyclictest0-21swapper/222:45:012
235299953120,508cyclictest0-21swapper/323:48:493
2352899531147,211cyclictest0-21swapper/222:03:232
235289953060,211cyclictest33-21ksoftirqd/223:48:202
235269953024,340cyclictest26425-21munin-node21:15:230
235339952718,84cyclictest0-21swapper/722:02:007
2353199527148,89cyclictest0-21swapper/522:05:395
235269952720,296cyclictest0-21swapper/021:47:480
2352799526482,42cyclictest231rcuc/100:38:421
2352699522182,338cyclictest26327-1kworker/u17:000:14:490
2353199520221,84cyclictest0-21swapper/521:12:145
235319951549,126cyclictest0-21swapper/522:03:235
23533995131,338cyclictest73-21ksoftirqd/700:26:267
23530995113,84cyclictest0-21swapper/400:26:354
23527995116,3cyclictest0-21swapper/100:25:131
23533995100,84cyclictest0-21swapper/723:17:297
23531995091,126cyclictest11763-21ssh21:52:485
23530995080,84cyclictest0-21swapper/421:50:214
235309950541,298cyclictest0-21swapper/422:42:054
235309950541,298cyclictest0-21swapper/422:42:054
235309950541,298cyclictest0-21swapper/422:42:054
235309950541,298cyclictest0-21swapper/422:42:044
235309950541,298cyclictest0-21swapper/422:42:044
235279950579,211cyclictest25-21ksoftirqd/121:53:591
2353299504205,296cyclictest23524-21cyclictest21:11:106
235269950434,211cyclictest0-21swapper/021:12:430
235269950334,338cyclictest31134-21ssh23:46:460
235339950179,257cyclictest26647-21ssh23:10:227
235309950176,338cyclictest0-21swapper/423:17:324
235269950176,126cyclictest121rcu_preempt00:02:130
235269950175,211cyclictest0-21swapper/000:05:030
235309950032,295cyclictest0-21swapper/421:15:374
2352699500379,37cyclictest101ktimersoftd/023:06:380
235329949977,84cyclictest31150-21diskmemload23:18:056
235329949934,85cyclictest0-21swapper/600:23:116
235289949833,255cyclictest0-21swapper/221:49:232
235299949628,465cyclictest0-21swapper/323:30:133
235299949627,466cyclictest0-21swapper/322:01:533
2353299495451,41cyclictest631rcuc/621:52:306
235299949526,466cyclictest0-21swapper/323:20:053
235279949530,48cyclictest0-21swapper/121:46:011
235339949472,84cyclictest0-21swapper/721:11:057
235309949430,212cyclictest0-21swapper/400:38:154
235299949426,465cyclictest0-21swapper/319:14:233
235289949329,126cyclictest0-21swapper/200:38:042
2353299492112,126cyclictest5255-21sshd21:47:406
235289949221,211cyclictest33-21ksoftirqd/200:25:172
2353399491107,126cyclictest0-21swapper/700:13:387
2353199491371,36cyclictest561ktimersoftd/500:13:055
235279949167,127cyclictest0-21swapper/122:42:381
235279949167,127cyclictest0-21swapper/122:42:381
235279949167,127cyclictest0-21swapper/122:42:381
235279949167,127cyclictest0-21swapper/122:42:381
235279949167,127cyclictest0-21swapper/122:42:381
235289948865,259cyclictest28340-21ssh00:22:212
235279948825,42cyclictest0-21swapper/122:45:161
235329948723,84cyclictest0-21swapper/600:38:576
2352799486111,3cyclictest0-21swapper/122:03:171
235269948618,253cyclictest0-21swapper/021:52:480
235319948521,211cyclictest0-21swapper/521:15:225
2352799485231,84cyclictest241ktimersoftd/100:24:051
235279948319,298cyclictest0-21swapper/123:48:411
235339948117,126cyclictest0-21swapper/700:22:437
235319948154,339cyclictest121rcu_preempt00:03:475
235319948058,84cyclictest0-21swapper/521:46:245
235269948015,297cyclictest0-21swapper/000:28:150
2352899479224,253cyclictest321ktimersoftd/221:53:222
235289947913,42cyclictest0-21swapper/222:43:092
235329947851,211cyclictest0-21swapper/600:02:376
235319947794,127cyclictest30929-21kworker/5:023:07:215
235309947610,84cyclictest0-21swapper/422:05:154
235289947553,84cyclictest0-21swapper/222:45:242
23530994691,465cyclictest0-21swapper/422:02:014
23531994681,210cyclictest0-21swapper/523:10:215
23526994681,169cyclictest0-21swapper/000:22:440
2353199467126,84cyclictest121rcu_preempt23:18:475
2353299465166,126cyclictest121rcu_preempt22:05:376
2353299465124,338cyclictest0-21swapper/623:50:226
2353199465125,337cyclictest808-21ssh23:49:015
2352899464124,338cyclictest0-21swapper/223:59:572
235339946383,84cyclictest0-21swapper/700:39:357
2353399462124,172cyclictest26425-21munin-node23:30:107
235309946241,260cyclictest0-21swapper/421:47:594
235269946240,255cyclictest0-21swapper/023:16:460
235269946140,255cyclictest0-21swapper/023:30:280
235339946075,211cyclictest73-21ksoftirqd/722:44:457
235339946075,211cyclictest73-21ksoftirqd/722:44:457
235339946075,211cyclictest73-21ksoftirqd/722:44:457
235339946075,211cyclictest73-21ksoftirqd/722:44:457
235339946075,211cyclictest73-21ksoftirqd/722:44:457
2353299460119,338cyclictest12357-21rm22:45:246
2352899460121,337cyclictest0-21swapper/200:01:482
2353199458117,338cyclictest0-21swapper/500:38:025
2353199458117,338cyclictest0-21swapper/500:28:235
235309945832,337cyclictest0-21swapper/400:24:094
2352999457117,338cyclictest0-21swapper/321:15:113
235279945734,85cyclictest0-21swapper/122:05:221
2353099456116,338cyclictest0-21swapper/400:05:174
2352799456115,338cyclictest0-21swapper/123:19:391
2353299455160,211cyclictest19829-21kworker/u16:000:13:216
235279945533,42cyclictest0-21swapper/123:10:281
2352699455113,339cyclictest0-21swapper/021:55:050
2353299454408,43cyclictest631rcuc/623:48:136
2353299454113,338cyclictest0-21swapper/621:55:046
235309945475,295cyclictest0-21swapper/419:14:194
2352899454119,251cyclictest0-21swapper/220:32:342
2352899453112,338cyclictest0-21swapper/223:10:282
235329945229,256cyclictest0-21swapper/623:30:096
235279945226,210cyclictest25-21ksoftirqd/121:15:351
235269945231,255cyclictest0-21swapper/022:05:230
235339945166,211cyclictest553-21sed22:05:197
2352699451109,169cyclictest9-21ksoftirqd/023:10:110
235299945027,420cyclictest0-21swapper/322:45:183
2352999450111,84cyclictest0-21swapper/300:40:093
2352899450109,338cyclictest0-21swapper/200:13:182
2353299448106,339cyclictest0-21swapper/600:15:256
235319944867,211cyclictest22890-21ssh00:40:155
235309944827,171cyclictest0-21swapper/423:50:194
2352999448110,84cyclictest15752-21taskset00:15:243
235339944763,211cyclictest0-21swapper/721:48:547
235319944624,84cyclictest0-21swapper/522:44:175
235319944624,84cyclictest0-21swapper/522:44:175
235319944624,84cyclictest0-21swapper/522:44:175
235319944624,84cyclictest0-21swapper/522:44:175
235319944624,84cyclictest0-21swapper/522:44:175
235299944567,82cyclictest0-21swapper/323:10:283
235329944422,256cyclictest0-21swapper/623:10:216
235289944321,41cyclictest0-21swapper/200:40:272
235309944263,295cyclictest0-21swapper/423:28:354
235319944119,126cyclictest121rcu_preempt22:45:195
235289944018,84cyclictest1551-21snmpd22:05:372
2352899439355,3cyclictest311rcuc/223:50:082
235269943812,84cyclictest1578-21lldpd22:45:270
235339943614,169cyclictest0-21swapper/723:48:117
23529994347,127cyclictest0-21swapper/321:55:013
235289943453,84cyclictest0-21swapper/221:55:052
235269943251,169cyclictest0-21swapper/000:15:070
23530994296,256cyclictest0-21swapper/423:10:284
235289942786,253cyclictest28772-21df_inode00:05:222
235339942483,338cyclictest0-21swapper/700:05:227
235279942486,175cyclictest8135-21kworker/1:119:14:241
23527994241,3cyclictest0-21swapper/121:55:121
23533994230,84cyclictest26082-21ssh00:03:137
235309942383,337cyclictest0-21swapper/422:45:164
2352899423124,254cyclictest0-21swapper/200:15:072
235339942283,84cyclictest0-21swapper/722:45:167
235339942181,84cyclictest0-21swapper/723:28:427
235319942180,338cyclictest0-21swapper/523:50:185
235319942180,338cyclictest0-21swapper/500:15:255
235319942180,338cyclictest0-21swapper/500:05:155
235279942182,84cyclictest0-21swapper/123:59:561
235279942182,84cyclictest0-21swapper/123:50:081
235279942182,84cyclictest0-21swapper/100:14:551
235339942081,84cyclictest0-21swapper/700:15:257
235339941980,84cyclictest0-21swapper/723:59:577
235319941979,337cyclictest0-21swapper/523:28:325
235339941879,84cyclictest0-21swapper/721:15:307
235279941879,84cyclictest0-21swapper/100:40:061
235279941733,84cyclictest25-21ksoftirqd/100:15:261
235289941677,84cyclictest0-21swapper/223:20:032
235309941535,84cyclictest64450irq/122-eth021:55:124
2353299414203,167cyclictest0-21swapper/623:20:046
235279941374,82cyclictest0-21swapper/100:30:081
235329941273,84cyclictest0-21swapper/623:28:416
235329941273,84cyclictest0-21swapper/600:40:126
2352999412113,126cyclictest0-21swapper/321:04:533
235339941172,84cyclictest0-21swapper/723:50:097
235329941172,84cyclictest0-21swapper/600:05:096
235269941171,338cyclictest0-21swapper/023:59:570
235309941030,213cyclictest0-21swapper/400:40:064
235269941070,338cyclictest0-21swapper/023:28:490
235289940928,84cyclictest0-21swapper/219:14:282
235269940969,338cyclictest0-21swapper/023:20:050
2353299407113,210cyclictest0-21swapper/620:32:346
235279940721,211cyclictest27941-21taskset00:05:081
235339940667,84cyclictest0-21swapper/700:40:077
235309940665,338cyclictest0-21swapper/400:30:164
235339940566,84cyclictest0-21swapper/723:20:057
235339940465,83cyclictest0-21swapper/721:55:027
235299940462,339cyclictest0-21swapper/320:32:273
235299940221,297cyclictest12799-1kworker/u17:122:35:243
235279940218,126cyclictest0-21swapper/122:14:551
235299940161,338cyclictest0-21swapper/323:28:343
235299940121,296cyclictest0-21swapper/300:30:093
235299940117,211cyclictest0-21swapper/322:14:543
235279939658,84cyclictest0-21swapper/123:30:111
235279939557,84cyclictest0-21swapper/123:28:411
235269939555,338cyclictest0-21swapper/023:50:200
235269939555,338cyclictest0-21swapper/022:14:530
235309938747,337cyclictest0-21swapper/423:59:564
235319938547,83cyclictest0-21swapper/500:30:175
235329938140,338cyclictest0-21swapper/600:30:086
235309938140,338cyclictest0-21swapper/423:20:054
23531993800,3cyclictest0-21swapper/521:55:055
2352899378122,253cyclictest27191-21diskmemload23:28:412
235309937737,338cyclictest0-21swapper/420:32:274
235339937637,84cyclictest0-21swapper/700:30:087
235269937639,171cyclictest0-21swapper/000:30:160
235329937536,84cyclictest0-21swapper/622:14:546
235269937538,212cyclictest0-21swapper/019:14:290
235289937336,172cyclictest0-21swapper/223:30:092
235289937334,84cyclictest0-21swapper/222:14:542
235309937231,338cyclictest0-21swapper/422:14:534
235319937133,84cyclictest0-21swapper/523:20:095
235329937031,85cyclictest0-21swapper/620:24:336
235309937029,84cyclictest0-21swapper/419:47:144
235309937029,84cyclictest0-21swapper/419:47:144
235299937029,338cyclictest0-21swapper/320:14:463
235289937073,84cyclictest0-21swapper/220:14:482
235289936871,84cyclictest0-21swapper/200:30:162
235279936526,84cyclictest0-21swapper/123:20:081
235329936366,84cyclictest0-21swapper/620:14:486
235299935615,338cyclictest204912sleep323:59:573
235269935517,84cyclictest0-21swapper/020:32:270
235319935011,84cyclictest0-21swapper/520:32:285
235339934853,211cyclictest0-21swapper/719:14:197
235329934810,3cyclictest0-21swapper/619:47:156
235329934810,3cyclictest0-21swapper/619:47:156
23531993486,126cyclictest20501-21ssh23:59:565
235269934810,84cyclictest0-21swapper/019:47:140
235269934810,84cyclictest0-21swapper/019:47:140
235299934083,254cyclictest0-21swapper/320:24:343
23533993391,2cyclictest0-21swapper/720:32:327
2352899338123,84cyclictest121rcu_preempt20:24:322
235279933882,253cyclictest0-21swapper/120:32:231
235339933782,84cyclictest0-21swapper/720:14:477
235299933680,254cyclictest0-21swapper/319:47:143
235299933680,254cyclictest0-21swapper/319:47:143
235319933540,2cyclictest0-21swapper/519:14:255
235319933478,253cyclictest0-21swapper/520:14:485
235329933276,253cyclictest0-21swapper/623:59:576
2353199332122,123cyclictest121rcu_preempt22:14:545
235329933033,84cyclictest0-21swapper/619:14:296
235319933035,3cyclictest0-21swapper/522:35:235
235269933073,254cyclictest0-21swapper/020:24:330
235269932931,295cyclictest698-21ptp4l20:14:460
2353099328284,42cyclictest471rcuc/420:24:314
235289932732,85cyclictest0-21swapper/222:35:242
235279932429,85cyclictest0-21swapper/120:24:321
2352799322111,42cyclictest12799-1kworker/u17:122:35:231
235269932272,78cyclictest121rcu_preempt21:04:520
2353299317149,4cyclictest28433-21sed22:35:246
235339931659,254cyclictest0-21swapper/720:24:337
235319931621,84cyclictest0-21swapper/523:30:115
235289931217,3cyclictest0-21swapper/219:47:152
235289931217,3cyclictest0-21swapper/219:47:152
235339931053,127cyclictest28149-21taskset21:04:587
235319930812,84cyclictest0-21swapper/520:24:345
235279930854,250cyclictest0-21swapper/120:14:471
23530993049,83cyclictest0-21swapper/420:14:464
23531993038,211cyclictest0-21swapper/519:47:145
23531993038,211cyclictest0-21swapper/519:47:145
235279930043,126cyclictest8135-21kworker/1:121:04:571
23527992993,211cyclictest0-21swapper/119:47:141
23527992993,211cyclictest0-21swapper/119:47:141
23526992961,126cyclictest28436-21unixbench_multi22:35:230
235319929341,2cyclictest0-21swapper/521:04:535
235339928777,122cyclictest121rcu_preempt22:14:557
235309928672,84cyclictest1551-21snmpd21:04:574
235309928128,169cyclictest28428-21unixbench_multi22:35:244
235339927722,126cyclictest0-21swapper/719:47:137
235339927722,126cyclictest0-21swapper/719:47:137
235289927767,3cyclictest0-21swapper/221:04:592
235329925140,2cyclictest0-21swapper/621:04:526
235339924634,84cyclictest0-21swapper/722:35:247
2275429262,27sleep50-21swapper/519:08:025
2285628856,28sleep60-21swapper/619:09:316
2276728741,43sleep00-21swapper/019:08:130
2283928553,28sleep70-21swapper/719:09:167
2028528149,28sleep20-21swapper/219:05:022
2277028050,27sleep30-21swapper/319:08:153
2282727948,27sleep40-21swapper/419:09:044
2256827949,27sleep10-21swapper/119:05:261
224872770,1sleep1241ktimersoftd/122:50:191
249262730,1sleep70-21swapper/722:18:027
23533992927,1cyclictest0-21swapper/721:42:277
23533992910,18cyclictest0-21swapper/723:01:517
23533992910,18cyclictest0-21swapper/719:32:547
23530992910,18cyclictest0-21swapper/420:58:564
23528992927,1cyclictest0-21swapper/223:38:432
23528992910,18cyclictest0-21swapper/222:54:102
23527992910,18cyclictest0-21swapper/119:26:081
90912280,1sleep50-21swapper/523:00:165
23533992810,18cyclictest0-21swapper/723:39:217
23533992810,18cyclictest0-21swapper/721:33:567
23533992810,18cyclictest0-21swapper/721:33:567
23533992810,18cyclictest0-21swapper/720:51:007
23533992810,18cyclictest0-21swapper/720:02:027
23533992810,17cyclictest0-21swapper/722:24:247
23533992810,17cyclictest0-21swapper/722:24:247
23533992810,0cyclictest0-21swapper/719:26:087
23532992810,17cyclictest0-21swapper/623:38:316
23532992810,17cyclictest0-21swapper/621:34:126
23532992810,17cyclictest0-21swapper/621:34:126
23531992810,17cyclictest0-21swapper/523:38:465
23530992827,1cyclictest0-21swapper/422:34:494
23530992826,2cyclictest0-21swapper/422:24:264
23530992826,2cyclictest0-21swapper/422:24:264
23529992828,0cyclictest0-21swapper/320:02:063
23529992828,0cyclictest0-21swapper/319:19:023
23529992810,18cyclictest0-21swapper/323:38:463
23529992810,18cyclictest0-21swapper/323:01:533
23529992810,18cyclictest0-21swapper/322:54:123
23529992810,18cyclictest0-21swapper/321:33:303
23529992810,18cyclictest0-21swapper/321:33:303
23529992810,18cyclictest0-21swapper/320:50:593
23529992810,18cyclictest0-21swapper/320:41:533
23529992810,18cyclictest0-21swapper/320:08:473
23529992810,18cyclictest0-21swapper/319:54:093
23529992810,0cyclictest0-21swapper/322:34:023
23529992810,0cyclictest0-21swapper/322:23:493
23529992810,0cyclictest0-21swapper/322:23:493
23529992810,0cyclictest0-21swapper/321:42:093
23529992810,0cyclictest0-21swapper/320:58:393
23529992810,0cyclictest0-21swapper/319:39:593
23528992827,1cyclictest0-21swapper/221:42:392
23528992827,1cyclictest0-21swapper/221:24:132
23528992810,18cyclictest0-21swapper/222:23:452
23528992810,18cyclictest0-21swapper/222:23:452
23528992810,18cyclictest0-21swapper/220:51:032
23528992810,18cyclictest0-21swapper/220:41:442
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional