You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-12 - 19:19
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Mar 12, 2026 12:56:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7081996351,383cyclictest0-21swapper/509:34:035
70839962936,383cyclictest0-21swapper/709:34:037
708099627117,507cyclictest0-21swapper/412:35:594
70789961017,126cyclictest0-21swapper/212:33:042
70839959994,422cyclictest0-21swapper/712:42:507
7080995986,383cyclictest0-21swapper/409:34:034
7081995930,85cyclictest0-21swapper/512:07:405
7077995930,84cyclictest0-21swapper/110:31:311
7076995921,338cyclictest0-21swapper/011:13:160
70799959079,296cyclictest0-21swapper/312:12:183
707699586117,338cyclictest121rcu_preempt10:26:120
70769958575,507cyclictest0-21swapper/012:31:430
708099583115,295cyclictest49-21ksoftirqd/411:24:304
707799583114,380cyclictest0-21swapper/111:06:571
70769958234,46cyclictest0-21swapper/012:15:400
708399579199,296cyclictest643-21nscd12:34:157
70829957667,506cyclictest0-21swapper/612:36:006
707999573529,42cyclictest401ktimersoftd/311:25:083
70789957366,296cyclictest16458-21nscd10:27:592
707699573104,343cyclictest121rcu_preempt09:59:180
70799957218,211cyclictest41-21ksoftirqd/311:12:173
70799956818,297cyclictest0-21swapper/311:05:493
70769956554,211cyclictest29851-21ssh11:33:430
70839956110,126cyclictest0-21swapper/711:06:567
708099559218,338cyclictest68350irq/122-eth012:10:574
7079995598,84cyclictest0-21swapper/312:21:003
7079995598,84cyclictest0-21swapper/312:21:003
7077995510,84cyclictest0-21swapper/112:43:191
707999550378,84cyclictest0-21swapper/310:09:483
70789955080,211cyclictest33-21ksoftirqd/212:43:152
707699548126,219cyclictest828-21cat09:35:400
707799547163,253cyclictest0-21swapper/109:37:581
708399545118,211cyclictest0-21swapper/712:13:087
70799954334,335cyclictest0-21swapper/310:25:593
707799543499,41cyclictest231rcuc/112:08:171
70779954131,295cyclictest0-21swapper/112:00:581
707799540496,42cyclictest241ktimersoftd/111:33:131
70839953666,211cyclictest0-21swapper/710:09:317
70799953625,423cyclictest0-21swapper/312:15:083
70769953627,84cyclictest0-21swapper/012:00:590
70799953124,341cyclictest15313-21diskmemload09:36:463
70769953125,422cyclictest0-21swapper/011:03:570
70779952821,256cyclictest0-21swapper/109:34:031
70799952718,211cyclictest41-21ksoftirqd/311:34:303
70769952716,338cyclictest0-21swapper/011:48:350
70809952616,507cyclictest68350irq/122-eth009:37:024
707799526103,126cyclictest0-21swapper/112:33:141
708099525358,3cyclictest481ktimersoftd/412:18:574
707799523144,83cyclictest30790-21ssh12:12:191
70789952210,211cyclictest33-21ksoftirqd/209:29:512
707699522143,212cyclictest1683-21ntpd11:50:190
70819952119,79cyclictest0-21swapper/509:27:525
7079995208,381cyclictest0-21swapper/311:58:023
7078995176,296cyclictest0-21swapper/209:35:392
70769951711,2cyclictest0-21swapper/009:34:030
70789951646,127cyclictest33-21ksoftirqd/210:09:402
7076995159,337cyclictest0-21swapper/012:43:030
707699515431,4cyclictest111rcuc/011:07:270
708399514470,42cyclictest711rcuc/711:34:007
7081995147,3cyclictest0-21swapper/512:17:355
7082995124,257cyclictest0-21swapper/609:34:036
7078995125,2cyclictest0-21swapper/212:17:352
7083995110,84cyclictest0-21swapper/712:20:167
7083995110,84cyclictest0-21swapper/712:20:167
70819951184,84cyclictest121rcu_preempt09:59:345
7081995104,126cyclictest0-21swapper/511:37:385
7081995104,126cyclictest0-21swapper/511:37:385
707999510131,82cyclictest15255-21kworker/u16:109:33:483
7082995090,84cyclictest0-21swapper/610:27:436
7081995090,84cyclictest0-21swapper/512:11:115
7077995091,3cyclictest0-21swapper/112:17:351
70769950939,339cyclictest0-21swapper/011:38:170
70769950939,339cyclictest0-21swapper/011:38:170
70809950882,210cyclictest0-21swapper/411:40:054
70799950880,169cyclictest41-21ksoftirqd/311:36:473
70799950880,169cyclictest41-21ksoftirqd/311:36:463
7078995081,2cyclictest29630-21ssh09:34:042
7078995080,84cyclictest0-21swapper/212:07:392
708099507167,126cyclictest121rcu_preempt10:25:464
70769950782,422cyclictest0-21swapper/011:23:450
70769950780,211cyclictest9-21ksoftirqd/012:12:490
708399506207,126cyclictest121rcu_preempt11:47:227
708099506123,253cyclictest0-21swapper/411:08:184
70799950680,423cyclictest0-21swapper/311:23:453
70829950582,338cyclictest0-21swapper/611:03:586
70799950539,296cyclictest0-21swapper/312:06:013
70839950478,423cyclictest0-21swapper/711:04:507
70789950474,169cyclictest0-21swapper/211:13:362
707799504117,169cyclictest25580-21rm11:15:001
70769950482,84cyclictest0-21swapper/010:23:100
70819950376,339cyclictest0-21swapper/512:34:545
70839950135,84cyclictest0-21swapper/709:36:437
708299499116,126cyclictest0-21swapper/612:06:016
708399498161,164cyclictest121rcu_preempt10:23:347
708399498113,211cyclictest31940-21pmu-power10:25:257
70829949872,212cyclictest0-21swapper/612:10:226
70819949876,84cyclictest0-21swapper/511:06:465
70799949834,41cyclictest121rcu_preempt12:00:103
707799495196,126cyclictest14269-21kworker/u16:110:23:431
708099493120,118cyclictest0-21swapper/412:44:544
70809949268,338cyclictest0-21swapper/412:21:074
70809949268,338cyclictest0-21swapper/412:21:074
70809949229,41cyclictest0-21swapper/409:27:524
70799949122,84cyclictest0-21swapper/312:44:203
70809949065,84cyclictest0-21swapper/412:07:394
707899490108,126cyclictest121rcu_preempt11:06:212
708099489105,211cyclictest49-21ksoftirqd/410:22:124
707899489105,126cyclictest33-21ksoftirqd/211:58:232
708299488231,169cyclictest10195-21ls12:20:336
708299488231,169cyclictest10195-21ls12:20:336
70819948865,84cyclictest0-21swapper/511:48:495
70779948824,301cyclictest0-21swapper/110:08:571
707899487187,211cyclictest16456-21nscd11:38:582
707899487187,211cyclictest16456-21nscd11:38:582
708099486275,128cyclictest68350irq/122-eth011:04:214
707799485102,380cyclictest4171-21ssh12:35:591
707699485317,42cyclictest15313-21diskmemload10:32:370
70769948521,219cyclictest0-21swapper/011:59:450
707799483142,126cyclictest121rcu_preempt11:04:171
708299482439,41cyclictest641ktimersoftd/612:34:256
70799948217,384cyclictest11318-1kworker/u17:112:26:483
70799948217,212cyclictest0-21swapper/309:28:593
70829948014,42cyclictest0-21swapper/609:27:526
70769948012,465cyclictest0-21swapper/012:35:580
70779947957,84cyclictest0-21swapper/111:48:481
70779947913,127cyclictest0-21swapper/112:21:071
70779947913,127cyclictest0-21swapper/112:21:071
70799947813,253cyclictest0-21swapper/310:24:283
70779947812,84cyclictest0-21swapper/110:27:261
70839947712,126cyclictest0-21swapper/709:27:597
7081994768,210cyclictest2818-21ssh10:10:225
70809947511,126cyclictest30483-21ssh11:34:204
70779947390,131cyclictest121rcu_preempt11:38:051
70779947390,131cyclictest121rcu_preempt11:38:051
707999472133,84cyclictest10026-21munin-node12:37:143
707799472130,211cyclictest1556-21runrttasks11:58:501
7083994704,211cyclictest0-21swapper/711:25:257
7082994695,7cyclictest0-21swapper/611:33:426
708199469390,77cyclictest561ktimersoftd/511:13:245
708099469130,303cyclictest68350irq/122-eth012:00:194
70829946883,127cyclictest65-21ksoftirqd/612:44:066
7083994671,84cyclictest0-21swapper/712:26:487
7082994671,84cyclictest0-21swapper/610:10:146
70789946782,126cyclictest121rcu_preempt12:02:022
708199466124,339cyclictest631-21ptp4l11:33:445
707999466210,254cyclictest401ktimersoftd/311:04:103
70819946581,211cyclictest11471-21sh11:24:145
7078994650,84cyclictest31952-21ssh12:13:512
70779946580,84cyclictest0-21swapper/112:27:061
70819946480,381cyclictest0-21swapper/510:32:185
707999464124,338cyclictest0-21swapper/309:58:243
70829946335,211cyclictest0-21swapper/609:35:266
707799463122,338cyclictest0-21swapper/109:59:241
70829946240,2cyclictest0-21swapper/612:16:056
70809946239,84cyclictest0-21swapper/411:12:374
70769946240,2cyclictest0-21swapper/012:07:380
708299461120,126cyclictest0-21swapper/611:14:476
708299460205,253cyclictest641ktimersoftd/611:25:246
708199460118,339cyclictest0-21swapper/509:36:535
708199460117,339cyclictest0-21swapper/512:44:435
708399459119,338cyclictest0-21swapper/709:58:547
70809945976,380cyclictest0-21swapper/410:32:194
70809945976,168cyclictest49-21ksoftirqd/411:58:174
70789945979,84cyclictest0-21swapper/211:03:582
70789945974,254cyclictest0-21swapper/212:27:212
708399458120,254cyclictest24988-21ssh12:08:407
70779945836,256cyclictest0-21swapper/109:29:371
70829945735,255cyclictest27412-21nscd10:32:276
708299456113,211cyclictest2740-21sh10:45:066
70789945634,2cyclictest0-21swapper/211:33:202
70769945634,3cyclictest0-21swapper/009:27:450
70839945533,255cyclictest623-21nscd10:32:287
708199455114,338cyclictest0-21swapper/512:28:335
70809945529,211cyclictest49-21ksoftirqd/411:15:224
70809945529,211cyclictest49-21ksoftirqd/411:15:214
708099455114,338cyclictest0-21swapper/412:31:304
707999455114,338cyclictest0-21swapper/311:49:543
70789945575,91cyclictest33-21ksoftirqd/210:32:562
70839945432,255cyclictest0-21swapper/710:45:077
708399454196,126cyclictest0-21swapper/712:18:577
70839945369,211cyclictest0-21swapper/712:00:517
707699453112,338cyclictest0-21swapper/010:00:090
708199452108,341cyclictest0-21swapper/510:27:595
70799945225,254cyclictest0-21swapper/312:34:553
70809945172,215cyclictest0-21swapper/411:36:324
70809945172,215cyclictest0-21swapper/411:36:324
707899451407,42cyclictest311rcuc/211:48:472
70779945132,337cyclictest11103-21diskmemload11:23:531
70769945129,3cyclictest0-21swapper/011:40:060
70829945027,256cyclictest0-21swapper/612:03:066
70809944966,84cyclictest24847-21/usr/sbin/munin11:50:184
70819944865,380cyclictest0-21swapper/512:35:595
70799944825,2cyclictest0-21swapper/311:40:063
70819944726,2cyclictest0-21swapper/510:45:065
708199447106,126cyclictest32522-21snmpd10:08:535
70769944768,254cyclictest0-21swapper/010:44:530
70809944620,211cyclictest0-21swapper/411:49:574
70839944523,2cyclictest0-21swapper/712:35:367
70799944564,84cyclictest0-21swapper/310:10:133
70789944563,380cyclictest0-21swapper/212:36:002
70839944460,211cyclictest0-21swapper/711:14:297
708099444188,253cyclictest0-21swapper/411:25:214
70829944055,211cyclictest65-21ksoftirqd/610:09:216
707699440102,84cyclictest16461-21nscd10:10:140
70819943956,210cyclictest0-21swapper/512:00:565
708299438182,253cyclictest641ktimersoftd/611:24:336
70799943816,256cyclictest0-21swapper/310:00:103
70839943715,82cyclictest0-21swapper/711:35:217
70839943715,82cyclictest0-21swapper/711:35:207
70809943715,255cyclictest481ktimersoftd/410:09:104
70769943757,84cyclictest0-21swapper/012:21:360
70769943757,84cyclictest0-21swapper/012:21:360
707899436224,84cyclictest25756-21kworker/u16:312:20:312
707899436224,84cyclictest25756-21kworker/u16:312:20:312
70819943454,84cyclictest0-21swapper/511:03:585
7080994347,301cyclictest0-21swapper/412:27:224
70789943412,261cyclictest0-21swapper/211:50:102
70769943311,2cyclictest0-21swapper/010:09:340
7081994318,126cyclictest8743-21fschecks_count12:20:155
7081994318,126cyclictest8743-21fschecks_count12:20:155
7079994319,2cyclictest0-21swapper/310:32:283
7082994307,42cyclictest0-21swapper/609:58:046
7078994270,211cyclictest33-21ksoftirqd/211:24:452
7082994251,3cyclictest0-21swapper/611:38:116
7082994251,3cyclictest0-21swapper/611:38:116
7083994241,168cyclictest0-21swapper/711:24:347
70829942483,338cyclictest0-21swapper/612:26:586
7082994241,256cyclictest0-21swapper/611:59:066
708199424124,211cyclictest0-21swapper/511:57:315
70809942483,338cyclictest0-21swapper/410:10:144
70829942383,338cyclictest0-21swapper/610:24:226
70829942382,338cyclictest0-21swapper/611:08:076
70809942282,337cyclictest0-21swapper/409:59:234
70789942283,84cyclictest0-21swapper/211:40:182
70789942283,84cyclictest0-21swapper/210:24:492
70829942180,338cyclictest0-21swapper/611:48:066
70769942181,338cyclictest0-21swapper/012:27:400
70769942141,3cyclictest0-21swapper/010:45:060
708199420204,84cyclictest0-21swapper/510:23:235
70839941881,253cyclictest0-21swapper/711:57:447
70839941877,338cyclictest0-21swapper/710:44:277
70819941878,84cyclictest0-21swapper/511:40:075
70819941835,126cyclictest0-21swapper/511:25:165
70799941877,338cyclictest0-21swapper/311:50:173
707799418120,126cyclictest121rcu_preempt10:00:151
70839941776,338cyclictest0-21swapper/711:50:197
70839941775,339cyclictest0-21swapper/710:10:207
70809941738,176cyclictest0-21swapper/410:44:524
70789941739,81cyclictest0-21swapper/211:15:142
70789941739,81cyclictest0-21swapper/211:15:142
70829941676,337cyclictest0-21swapper/611:40:186
70769941474,338cyclictest0-21swapper/011:15:090
70769941474,338cyclictest0-21swapper/011:15:080
70769941473,338cyclictest0-21swapper/011:25:180
70799941271,338cyclictest0-21swapper/310:44:463
70799941232,217cyclictest0-21swapper/310:45:063
70839941170,338cyclictest0-21swapper/711:40:187
70779941173,84cyclictest0-21swapper/111:40:071
70779941071,84cyclictest0-21swapper/110:10:041
708399409153,84cyclictest121rcu_preempt10:00:177
708299409110,126cyclictest0-21swapper/611:15:226
708299409110,126cyclictest0-21swapper/611:15:226
70819940969,84cyclictest0-21swapper/510:00:185
70799940967,211cyclictest41-21ksoftirqd/311:15:093
70799940967,211cyclictest41-21ksoftirqd/311:15:093
707799409110,126cyclictest0-21swapper/111:25:241
70789940420,211cyclictest33-21ksoftirqd/209:59:152
70789940218,211cyclictest0-21swapper/210:44:282
70779940263,84cyclictest0-21swapper/110:45:171
70789939960,84cyclictest0-21swapper/210:00:102
70789939919,3cyclictest0-21swapper/210:45:072
70829939717,85cyclictest0-21swapper/610:44:286
707899393349,42cyclictest311rcuc/210:10:212
70779938485,126cyclictest25-21ksoftirqd/111:50:201
708299379121,255cyclictest641ktimersoftd/610:00:176
707899379126,84cyclictest121rcu_preempt11:25:082
70819937637,83cyclictest0-21swapper/511:15:175
70819937637,83cyclictest0-21swapper/511:15:175
70809937335,171cyclictest0-21swapper/410:45:064
70839937233,84cyclictest0-21swapper/711:15:107
70839937233,84cyclictest0-21swapper/711:15:107
70829936728,84cyclictest0-21swapper/611:50:076
70809936729,3cyclictest0-21swapper/410:00:154
70779936729,84cyclictest0-21swapper/111:15:171
70779936729,84cyclictest0-21swapper/111:15:171
70819936626,84cyclictest0-21swapper/510:44:455
70779936627,125cyclictest0-21swapper/110:44:481
708199315104,130cyclictest26543-21ntpq11:50:195
2491421300,1sleep50-21swapper/509:14:365
627228755,28sleep70-21swapper/707:07:357
628028655,28sleep60-21swapper/607:07:426
627028553,28sleep50-21swapper/507:07:345
628628453,27sleep30-21swapper/307:07:483
623628453,27sleep00-21swapper/007:07:030
638728149,28sleep20-21swapper/207:09:142
628428149,28sleep10-21swapper/107:07:461
628727946,29sleep40-21swapper/407:07:494
32442690,0sleep40-21swapper/409:19:474
7076993310,5cyclictest0-21swapper/008:10:190
7076993125,5cyclictest0-21swapper/009:19:260
7076993110,21cyclictest0-21swapper/009:10:010
7076993026,4cyclictest0-21swapper/007:22:090
7076993010,3cyclictest0-21swapper/008:58:560
7076993010,0cyclictest0-21swapper/008:47:220
254992300,0sleep30-21swapper/309:14:583
7077992910,18cyclictest0-21swapper/109:47:461
7076992926,3cyclictest0-21swapper/008:53:420
7076992923,5cyclictest0-21swapper/008:42:470
7083992828,0cyclictest0-21swapper/709:04:357
7083992810,18cyclictest0-21swapper/710:54:347
7083992810,18cyclictest0-21swapper/709:47:347
7083992810,18cyclictest0-21swapper/709:19:227
7083992810,18cyclictest0-21swapper/709:13:537
7083992810,18cyclictest0-21swapper/708:10:127
7083992810,18cyclictest0-21swapper/708:05:487
7083992810,0cyclictest0-21swapper/709:53:357
7083992810,0cyclictest0-21swapper/708:53:477
7083992810,0cyclictest0-21swapper/707:45:177
7082992810,18cyclictest0-21swapper/608:31:546
7081992826,1cyclictest32191-21kworker/u16:109:54:125
7081992810,17cyclictest0-21swapper/509:47:105
7081992810,17cyclictest0-21swapper/509:24:565
7080992810,18cyclictest0-21swapper/407:25:384
7079992810,18cyclictest0-21swapper/310:53:533
7079992810,18cyclictest0-21swapper/308:22:013
7079992810,18cyclictest0-21swapper/308:10:143
7079992810,0cyclictest0-21swapper/309:54:123
7079992810,0cyclictest0-21swapper/309:46:563
7079992810,0cyclictest0-21swapper/308:43:053
7078992828,0cyclictest0-21swapper/209:13:572
7078992828,0cyclictest0-21swapper/207:37:402
7078992810,18cyclictest0-21swapper/209:19:202
7078992810,18cyclictest0-21swapper/208:53:122
7077992810,18cyclictest0-21swapper/107:15:351
7077992810,17cyclictest0-21swapper/109:04:171
7077992810,0cyclictest0-21swapper/108:32:121
7077992810,0cyclictest0-21swapper/107:45:131
7076992826,2cyclictest0-21swapper/009:10:000
7076992826,2cyclictest0-21swapper/008:02:260
7076992825,3cyclictest0-21swapper/009:47:370
7083992727,0cyclictest0-21swapper/708:58:327
7083992727,0cyclictest0-21swapper/708:47:237
7083992727,0cyclictest0-21swapper/708:21:267
7083992727,0cyclictest0-21swapper/707:58:117
7083992727,0cyclictest0-21swapper/707:33:217
7083992727,0cyclictest0-21swapper/707:33:217
7083992727,0cyclictest0-21swapper/707:15:397
7083992710,17cyclictest0-21swapper/708:42:527
7083992710,17cyclictest0-21swapper/708:37:457
7083992710,17cyclictest0-21swapper/708:31:447
7083992710,17cyclictest0-21swapper/708:26:257
7083992710,17cyclictest0-21swapper/707:41:277
7083992710,17cyclictest0-21swapper/707:37:327
7083992710,17cyclictest0-21swapper/707:25:197
7083992710,0cyclictest0-21swapper/710:19:447
7083992710,0cyclictest0-21swapper/709:09:557
7083992710,0cyclictest0-21swapper/708:02:017
7083992710,0cyclictest0-21swapper/707:22:017
7082992710,17cyclictest0-21swapper/610:53:456
7082992710,17cyclictest0-21swapper/609:53:466
7082992710,17cyclictest0-21swapper/609:13:416
7082992710,17cyclictest0-21swapper/608:58:416
7082992710,17cyclictest0-21swapper/608:47:286
7082992710,17cyclictest0-21swapper/608:42:506
7082992710,17cyclictest0-21swapper/608:26:086
7082992710,17cyclictest0-21swapper/607:41:196
7082992710,17cyclictest0-21swapper/607:37:246
7082992710,17cyclictest0-21swapper/607:33:216
7082992710,17cyclictest0-21swapper/607:33:206
7082992710,17cyclictest0-21swapper/607:15:396
7082992710,0cyclictest0-21swapper/610:19:416
7082992710,0cyclictest0-21swapper/609:46:526
7082992710,0cyclictest0-21swapper/609:24:596
7082992710,0cyclictest0-21swapper/609:18:546
7082992710,0cyclictest0-21swapper/609:09:276
7082992710,0cyclictest0-21swapper/608:53:326
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional