You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 02:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Apr 23, 2026 00:53:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
176679993083,844cyclictest0-21swapper/700:20:387
176679974867,50cyclictest0-21swapper/721:58:327
1766799707585,77cyclictest0-21swapper/721:47:517
1766299699146,338cyclictest17658-21cyclictest22:26:452
17664996350,84cyclictest2182-21ssh23:47:574
1766799632124,126cyclictest0-21swapper/700:37:287
1766499627116,85cyclictest0-21swapper/421:45:284
176679962230,504cyclictest0-21swapper/722:38:057
176679961519,593cyclictest0-21swapper/722:14:007
176679961116,592cyclictest0-21swapper/700:40:327
1766499604183,337cyclictest0-21swapper/422:22:344
17665995940,85cyclictest0-21swapper/522:48:345
17663995940,84cyclictest0-21swapper/322:48:333
17662995940,84cyclictest0-21swapper/222:48:332
17662995940,84cyclictest0-21swapper/221:46:052
17664995930,84cyclictest19134-21ssh22:48:334
1766799586248,84cyclictest12210-21kworker/u16:122:28:437
176619958434,126cyclictest121rcu_preempt22:26:551
1766799581116,83cyclictest121rcu_preempt22:52:407
176609957928,84cyclictest0-21swapper/022:50:300
176679957766,508cyclictest0-21swapper/722:48:337
1766599577108,296cyclictest8734-21ssh22:24:565
176669957160,295cyclictest0-21swapper/622:55:226
176609956315,379cyclictest0-21swapper/022:28:140
176649955792,126cyclictest0-21swapper/422:52:324
17666995541,339cyclictest0-21swapper/621:58:576
17661995547,331cyclictest0-21swapper/100:20:051
17660995521,126cyclictest0-21swapper/022:13:520
17662995490,84cyclictest0-21swapper/222:51:572
17660995491,84cyclictest0-21swapper/022:00:020
176659954634,168cyclictest0-21swapper/521:58:565
176639954576,211cyclictest41-21ksoftirqd/322:27:483
176639954476,211cyclictest41-21ksoftirqd/300:39:503
176609954231,381cyclictest0-21swapper/020:55:120
176609954231,381cyclictest0-21swapper/020:55:120
176619954133,126cyclictest0-21swapper/100:35:321
176669953768,380cyclictest0-21swapper/600:37:296
176619953768,127cyclictest0-21swapper/122:52:001
176619953629,42cyclictest0-21swapper/121:44:531
176669953528,423cyclictest0-21swapper/622:29:336
1766499535109,253cyclictest0-21swapper/422:13:534
1766399535150,127cyclictest1553-21runrttasks22:37:563
176619953322,338cyclictest0-21swapper/120:54:141
176609953225,42cyclictest121rcu_preempt00:38:180
176609953018,380cyclictest0-21swapper/021:45:510
176669952917,338cyclictest0-21swapper/622:47:106
176669952213,84cyclictest0-21swapper/623:47:586
176639952215,84cyclictest303-21systemd-journal22:00:183
17667995186,509cyclictest0-21swapper/720:54:277
17663995189,127cyclictest0-21swapper/323:29:473
17662995187,211cyclictest33-21ksoftirqd/221:59:192
176609951812,380cyclictest0-21swapper/021:44:340
176649951710,295cyclictest0-21swapper/400:35:484
176649951550,126cyclictest0-21swapper/422:29:444
17663995110,84cyclictest2715-21ssh22:40:133
1766499509125,253cyclictest0-21swapper/423:29:484
17663995090,84cyclictest25684-21diskmemload21:46:053
17662995090,84cyclictest0-21swapper/200:37:292
17661995090,84cyclictest0-21swapper/122:48:341
1766199508293,126cyclictest0-21swapper/121:45:071
17660995080,84cyclictest25684-21diskmemload00:20:550
17664995071,341cyclictest0-21swapper/422:55:164
176669950578,296cyclictest0-21swapper/621:46:126
176669950578,211cyclictest0-21swapper/622:23:286
1766599505164,338cyclictest24588-1kworker/u17:022:53:225
1766599504122,380cyclictest0-21swapper/500:38:295
176649950439,3cyclictest0-21swapper/400:34:464
176669950381,256cyclictest30186-21nscd21:43:366
176679950276,423cyclictest17658-21cyclictest00:34:467
176639950181,209cyclictest41-21ksoftirqd/322:52:243
176639950035,3cyclictest0-21swapper/322:22:273
1766599499119,213cyclictest0-21swapper/500:33:455
1766299499114,211cyclictest6649-21sh22:22:262
176679949732,165cyclictest0-21swapper/722:24:507
176639949771,211cyclictest0-21swapper/320:53:353
176659949632,295cyclictest0-21swapper/522:28:165
1766499496155,338cyclictest17658-21cyclictest00:05:574
176619949630,126cyclictest0-21swapper/122:38:161
1766199496201,211cyclictest241ktimersoftd/122:22:341
176609949627,44cyclictest0-21swapper/022:22:590
176649949531,126cyclictest0-21swapper/400:40:314
176639949424,211cyclictest41-21ksoftirqd/300:22:063
176629949468,211cyclictest0-21swapper/221:44:502
1766299494110,253cyclictest121rcu_preempt00:34:232
176619949022,379cyclictest0-21swapper/123:40:331
176629948963,211cyclictest0-21swapper/223:47:592
1766699487232,253cyclictest641ktimersoftd/622:39:286
176659948722,42cyclictest0-21swapper/523:30:105
176629948760,126cyclictest0-21swapper/222:00:082
176679948618,465cyclictest0-21swapper/721:44:557
176619948521,44cyclictest0-21swapper/121:58:081
176669948458,210cyclictest0-21swapper/623:16:036
176639948419,3cyclictest0-21swapper/300:33:463
176679948357,211cyclictest31633-21ssh23:30:097
1766599483142,126cyclictest1056-21seq00:21:595
176679948215,84cyclictest0-21swapper/723:47:477
176609948213,380cyclictest0-21swapper/022:00:160
176629948158,211cyclictest33-21ksoftirqd/222:55:112
176609947951,380cyclictest0-21swapper/022:39:220
176669947752,211cyclictest0-21swapper/622:53:046
176609947448,211cyclictest9-21ksoftirqd/022:49:560
176629947394,126cyclictest0-21swapper/200:21:592
17662994733,296cyclictest0-21swapper/223:40:312
1766399471176,134cyclictest121rcu_preempt22:14:103
17667994702,465cyclictest0-21swapper/700:05:547
17666994705,3cyclictest0-21swapper/622:00:246
17661994701,126cyclictest0-21swapper/122:55:241
1766299469424,42cyclictest311rcuc/220:54:232
176619946988,84cyclictest0-21swapper/122:14:461
17667994672,381cyclictest0-21swapper/722:00:247
17661994671,127cyclictest0-21swapper/100:34:371
176669946581,211cyclictest65-21ksoftirqd/622:15:186
176629946538,295cyclictest0-21swapper/222:39:272
176669946277,211cyclictest65-21ksoftirqd/622:30:086
176669946239,3cyclictest0-21swapper/600:05:496
176669946238,258cyclictest0-21swapper/623:39:086
1766599462121,338cyclictest0-21swapper/521:43:095
176629946240,256cyclictest0-21swapper/222:15:182
176609946240,256cyclictest0-21swapper/000:05:500
176619946139,84cyclictest121rcu_preempt23:39:411
176619946137,258cyclictest0-21swapper/120:55:111
176619946137,258cyclictest0-21swapper/120:55:111
176679946037,257cyclictest0-21swapper/723:39:087
1766599460120,337cyclictest0-21swapper/521:45:485
1766499460118,211cyclictest0-21swapper/422:39:464
176649945980,298cyclictest64450irq/122-eth022:00:074
176679945836,2cyclictest0-21swapper/720:55:117
176679945836,2cyclictest0-21swapper/720:55:117
176659945732,126cyclictest0-21swapper/500:40:285
176679945633,165cyclictest0-21swapper/723:29:497
1766699456115,338cyclictest0-21swapper/623:30:116
1766599456119,170cyclictest0-21swapper/523:47:555
1766599456119,170cyclictest0-21swapper/523:39:095
176649945634,3cyclictest0-21swapper/421:57:334
176669945533,218cyclictest0-21swapper/600:40:166
176659945432,84cyclictest1651-21ntpd22:14:555
1766299454113,338cyclictest21989-21ssh22:14:112
176609945433,42cyclictest0-21swapper/023:30:110
176649945230,3cyclictest0-21swapper/421:44:594
1766499451367,3cyclictest471rcuc/400:19:224
176639945128,3cyclictest0-21swapper/321:44:243
176609945172,168cyclictest0-21swapper/000:34:060
176679945027,256cyclictest0-21swapper/722:15:187
176669944867,250cyclictest0-21swapper/600:21:526
176619944865,126cyclictest121rcu_preempt00:19:361
176649944725,84cyclictest0-21swapper/420:54:014
176649944725,84cyclictest0-21swapper/400:20:294
176659944321,211cyclictest0-21swapper/522:40:135
176609944364,217cyclictest0-21swapper/020:54:540
176639944118,256cyclictest0-21swapper/300:40:313
176629944161,256cyclictest1553-21runrttasks20:55:122
176629944161,256cyclictest1553-21runrttasks20:55:112
176619944119,258cyclictest0-21swapper/123:29:391
176609944195,84cyclictest0-21swapper/022:55:310
176609944114,211cyclictest0-21swapper/000:40:120
176659944015,177cyclictest0-21swapper/522:30:075
176669943916,256cyclictest0-21swapper/623:29:486
176629943911,211cyclictest0-21swapper/200:06:032
176609943917,260cyclictest0-21swapper/023:29:390
176659943816,84cyclictest0-21swapper/520:54:025
176619943816,256cyclictest704-21nscd22:00:241
176609943812,211cyclictest9-21ksoftirqd/000:19:430
176669943715,255cyclictest0-21swapper/620:54:056
176659943715,3cyclictest0-21swapper/522:37:355
176619943695,338cyclictest0-21swapper/122:15:171
176679943555,338cyclictest0-21swapper/723:15:527
176619943410,127cyclictest0-21swapper/100:06:141
17667994337,126cyclictest0-21swapper/722:30:077
176649943150,84cyclictest0-21swapper/422:40:134
17663994303,171cyclictest0-21swapper/322:55:333
17663994260,84cyclictest0-21swapper/323:47:563
17666994241,338cyclictest0-21swapper/622:14:456
17665994243,2cyclictest0-21swapper/522:55:165
176629942483,338cyclictest0-21swapper/200:40:152
176669942282,338cyclictest0-21swapper/600:34:366
176619942283,84cyclictest0-21swapper/123:47:281
176639942181,338cyclictest0-21swapper/321:59:163
176639942180,338cyclictest0-21swapper/300:05:553
1766199421122,84cyclictest704-21nscd22:40:061
176609942183,84cyclictest0-21swapper/023:39:170
176609942183,169cyclictest0-21swapper/023:47:330
176629942079,338cyclictest0-21swapper/223:30:112
1766099420337,47cyclictest111rcuc/022:40:150
176629941979,338cyclictest0-21swapper/223:39:162
176669941877,338cyclictest0-21swapper/623:40:336
176629941876,339cyclictest0-21swapper/222:30:112
1766199418120,127cyclictest17658-21cyclictest00:40:191
176679941776,338cyclictest0-21swapper/723:40:337
176669941776,338cyclictest0-21swapper/622:40:066
176649941736,214cyclictest17658-21cyclictest23:30:114
176639941674,211cyclictest0-21swapper/323:39:483
176619941677,84cyclictest0-21swapper/123:30:141
176669941575,337cyclictest0-21swapper/600:19:216
176669941533,338cyclictest0-21swapper/620:55:126
176669941533,338cyclictest0-21swapper/620:55:126
176679941473,338cyclictest0-21swapper/722:55:127
17664994140,36cyclictest0-21swapper/420:55:024
17664994140,36cyclictest0-21swapper/420:55:024
176649941271,338cyclictest0-21swapper/423:16:074
1766199412156,83cyclictest0-21swapper/122:30:121
1766199410115,41cyclictest0-21swapper/123:15:511
176659940970,84cyclictest0-21swapper/523:16:055
176659940924,211cyclictest5408-21ssh00:06:035
176679940767,338cyclictest0-21swapper/722:40:137
176609940768,84cyclictest0-21swapper/023:16:070
176659940524,83cyclictest121rcu_preempt00:19:335
1766799403274,127cyclictest0-21swapper/700:19:347
176659940263,84cyclictest0-21swapper/520:55:135
176659940263,84cyclictest0-21swapper/520:55:125
176649940262,337cyclictest0-21swapper/422:15:184
176639940261,211cyclictest24870-21ssh22:15:173
176609940223,42cyclictest0-21swapper/023:40:330
176639939919,214cyclictest0-21swapper/323:30:103
176649939495,126cyclictest49-21ksoftirqd/422:30:094
176639938950,84cyclictest0-21swapper/322:30:113
176649938850,83cyclictest0-21swapper/423:39:414
17660993878,48cyclictest24889-21ssh22:15:180
176639938647,84cyclictest0-21swapper/300:19:223
176639938546,84cyclictest0-21swapper/323:15:513
176629937984,124cyclictest33-21ksoftirqd/223:29:592
176629937878,126cyclictest0-21swapper/200:19:342
176659937780,84cyclictest30408-21runrttasks23:29:245
176659937678,126cyclictest57-21ksoftirqd/523:40:315
1766299376125,249cyclictest0-21swapper/223:15:522
176659937334,84cyclictest0-21swapper/522:00:155
176659936422,177cyclictest0-21swapper/522:15:165
176629936122,84cyclictest0-21swapper/222:40:112
176639936021,83cyclictest0-21swapper/323:40:333
176609935820,171cyclictest0-21swapper/022:30:080
176649934810,84cyclictest0-21swapper/423:40:344
176639931821,84cyclictest0-21swapper/320:55:043
176639931821,84cyclictest0-21swapper/320:55:043
16156210197,2sleep00-21swapper/019:05:170
1691929163,5sleep10-21swapper/119:05:351
1701329062,24sleep30-21swapper/319:06:563
1696228857,27sleep60-21swapper/619:06:116
13802850,0sleep00-21swapper/019:35:120
1697628250,28sleep20-21swapper/219:06:242
109842820,0sleep60-21swapper/622:08:336
1692228149,28sleep40-21swapper/419:05:374
1698128049,27sleep70-21swapper/719:06:297
1702627949,27sleep50-21swapper/519:07:065
316082610,0sleep70-21swapper/700:03:307
130572530,4sleep61766699cyclictest00:10:456
17667994620,22cyclictest12958-21ssh00:10:417
17667994520,20cyclictest0-21swapper/723:50:047
17666994518,24cyclictest5702-21ssh00:25:156
17665994318,14cyclictest57-21ksoftirqd/500:10:465
1766099431,27cyclictest11397-21/usr/sbin/munin00:10:190
17665994118,7cyclictest57-21ksoftirqd/523:20:065
17666994010,27cyclictest4861-21rm23:50:066
1766199408,23cyclictest25-21ksoftirqd/123:51:031
17666993911,24cyclictest12002-21cat23:20:136
17665993915,7cyclictest57-21ksoftirqd/500:25:345
17665993817,7cyclictest57-21ksoftirqd/523:50:465
1766199386,23cyclictest25-21ksoftirqd/100:10:161
1766199368,16cyclictest0-21swapper/100:25:201
1766199366,17cyclictest0-21swapper/123:20:241
17667993528,6cyclictest0-21swapper/721:27:217
17664993529,3cyclictest0-21swapper/423:50:194
17662993524,7cyclictest5674-21sed00:25:152
17660993511,15cyclictest9-21ksoftirqd/023:50:120
17660993511,14cyclictest9-21ksoftirqd/000:25:240
17667993410,23cyclictest0-21swapper/721:17:557
17667993410,18cyclictest0-21swapper/721:38:427
17666993410,23cyclictest0-21swapper/621:27:276
1766099349,8cyclictest14463-21awk23:20:320
17664993324,6cyclictest12720-21grep00:10:324
1766399331,3cyclictest6154-21cat23:50:193
17667993224,5cyclictest6123-21ssh00:25:197
17667993210,22cyclictest0-21swapper/720:41:557
17666993226,5cyclictest0-21swapper/621:38:396
17666993225,6cyclictest0-21swapper/621:17:586
17666993210,21cyclictest0-21swapper/620:09:526
1766399321,28cyclictest11959-21ntpq00:10:253
17667993126,4cyclictest0-21swapper/719:39:347
17667993123,5cyclictest12734-21grep23:20:177
17666993126,4cyclictest0-21swapper/620:19:076
17666993026,3cyclictest0-21swapper/620:41:516
17667992910,19cyclictest0-21swapper/719:14:127
17666992925,3cyclictest0-21swapper/620:02:536
17666992924,4cyclictest0-21swapper/619:39:366
17665992910,18cyclictest0-21swapper/521:18:255
17664992923,4cyclictest5439-21expr00:25:144
17664992922,5cyclictest11784-21rm23:20:064
17663992922,4cyclictest5188-21grep00:25:133
17662992923,4cyclictest14349-21ssh23:20:302
17662992923,4cyclictest10725-21expr00:10:142
17662992922,5cyclictest8222-21ssh23:51:082
17661992910,18cyclictest0-21swapper/120:27:351
17667992828,0cyclictest0-21swapper/719:26:367
17667992824,4cyclictest0-21swapper/720:19:117
17666992810,17cyclictest0-21swapper/619:47:596
17665992810,17cyclictest0-21swapper/521:38:335
17665992810,17cyclictest0-21swapper/520:02:275
17665992810,0cyclictest0-21swapper/521:08:495
17664992810,17cyclictest0-21swapper/419:26:464
17663992828,0cyclictest0-21swapper/321:38:583
17663992828,0cyclictest0-21swapper/321:08:543
17663992828,0cyclictest0-21swapper/320:27:093
17663992821,4cyclictest11799-21ssh23:20:053
17663992810,18cyclictest0-21swapper/321:17:383
17663992810,18cyclictest0-21swapper/320:41:573
17663992810,18cyclictest0-21swapper/320:34:073
17663992810,18cyclictest0-21swapper/320:19:043
17663992810,18cyclictest0-21swapper/320:09:293
17663992810,18cyclictest0-21swapper/320:02:303
17663992810,18cyclictest0-21swapper/319:47:223
17663992810,18cyclictest0-21swapper/319:14:083
17663992810,0cyclictest0-21swapper/321:27:323
17662992810,18cyclictest0-21swapper/219:39:152
17662992810,18cyclictest0-21swapper/219:33:242
17662992810,0cyclictest0-21swapper/220:27:382
17662992810,0cyclictest0-21swapper/219:14:022
17661992810,18cyclictest0-21swapper/120:42:181
17661992810,18cyclictest0-21swapper/119:19:451
17661992810,0cyclictest0-21swapper/120:02:531
17660992810,18cyclictest0-21swapper/021:27:470
17660992810,17cyclictest0-21swapper/021:18:240
17667992727,0cyclictest0-21swapper/721:09:167
17667992727,0cyclictest0-21swapper/720:27:037
17667992727,0cyclictest0-21swapper/719:19:397
17667992710,17cyclictest0-21swapper/720:49:537
17667992710,17cyclictest0-21swapper/720:34:087
17667992710,17cyclictest0-21swapper/720:02:217
17667992710,17cyclictest0-21swapper/719:54:287
17667992710,17cyclictest0-21swapper/719:47:297
17667992710,0cyclictest0-21swapper/720:09:247
17667992710,0cyclictest0-21swapper/719:32:567
17667992710,0cyclictest0-21swapper/719:20:067
17666992727,0cyclictest0-21swapper/619:33:216
17666992710,17cyclictest0-21swapper/620:49:526
17666992710,17cyclictest0-21swapper/620:34:356
17666992710,17cyclictest0-21swapper/619:54:266
17666992710,17cyclictest0-21swapper/619:26:166
17666992710,0cyclictest0-21swapper/621:08:466
17666992710,0cyclictest0-21swapper/620:27:286
17666992710,0cyclictest0-21swapper/619:13:586
17665992727,0cyclictest0-21swapper/520:27:045
17665992727,0cyclictest0-21swapper/519:20:025
17665992727,0cyclictest0-21swapper/519:14:055
17665992726,1cyclictest0-21swapper/519:54:315
17665992710,17cyclictest0-21swapper/521:27:275
17665992710,17cyclictest0-21swapper/520:49:455
17665992710,17cyclictest0-21swapper/519:47:555
17665992710,17cyclictest0-21swapper/519:39:095
17665992710,17cyclictest0-21swapper/519:32:595
17665992710,17cyclictest0-21swapper/519:26:245
17665992710,0cyclictest0-21swapper/520:34:125
17665992710,0cyclictest0-21swapper/520:19:165
17665992710,0cyclictest0-21swapper/520:09:255
17665992710,0cyclictest0-21swapper/519:19:345
17664992727,0cyclictest0-21swapper/421:38:264
17664992727,0cyclictest0-21swapper/420:34:114
17664992727,0cyclictest0-21swapper/419:54:234
17664992727,0cyclictest0-21swapper/419:39:244
17664992727,0cyclictest0-21swapper/419:14:084
17664992725,1cyclictest0-21swapper/420:10:014
17664992710,17cyclictest0-21swapper/421:27:284
17664992710,17cyclictest0-21swapper/421:17:384
17664992710,17cyclictest0-21swapper/421:08:524
17664992710,17cyclictest0-21swapper/420:41:494
17664992710,17cyclictest0-21swapper/420:09:504
17664992710,17cyclictest0-21swapper/419:47:234
17664992710,0cyclictest0-21swapper/420:19:054
17664992710,0cyclictest0-21swapper/420:02:374
17664992710,0cyclictest0-21swapper/419:32:504
17664992710,0cyclictest0-21swapper/419:20:074
17663992710,17cyclictest0-21swapper/319:33:243
17663992710,17cyclictest0-21swapper/319:26:203
17663992710,0cyclictest0-21swapper/320:49:513
17663992710,0cyclictest0-21swapper/319:54:243
17663992710,0cyclictest0-21swapper/319:39:223
17663992710,0cyclictest0-21swapper/319:19:293
17662992727,0cyclictest0-21swapper/221:38:182
17662992727,0cyclictest0-21swapper/220:49:472
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional