You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-12 - 19:03
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue May 12, 2026 12:56:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
251559974422,719cyclictest0-21swapper/212:17:572
251559967783,84cyclictest0-21swapper/212:10:302
2516099663108,381cyclictest0-21swapper/711:58:537
25160996370,211cyclictest0-21swapper/712:08:177
251559963438,423cyclictest0-21swapper/209:33:382
251559962730,127cyclictest0-21swapper/209:58:322
251559962332,513cyclictest0-21swapper/211:07:262
251559962129,508cyclictest0-21swapper/209:48:492
251539962029,84cyclictest0-21swapper/011:58:370
251559961927,338cyclictest0-21swapper/212:32:542
251549961867,88cyclictest121rcu_preempt11:07:461
251559961721,593cyclictest0-21swapper/210:44:222
2515899610228,84cyclictest723-21nscd12:07:045
251569960710,84cyclictest0-21swapper/312:39:483
251559960712,592cyclictest0-21swapper/211:53:222
251559960712,592cyclictest0-21swapper/211:53:222
251559960712,592cyclictest0-21swapper/211:53:222
251559960712,592cyclictest0-21swapper/211:53:212
251569960512,126cyclictest0-21swapper/311:07:003
251559960147,550cyclictest0-21swapper/211:59:192
25155995972,507cyclictest0-21swapper/212:20:042
2515899596301,84cyclictest0-21swapper/512:41:065
25159995940,84cyclictest0-21swapper/612:07:576
25157995930,84cyclictest0-21swapper/412:07:574
251539959284,126cyclictest0-21swapper/011:09:060
251549958978,296cyclictest18320-21ssh11:19:531
251549958978,296cyclictest18320-21ssh11:19:531
251559958734,465cyclictest0-21swapper/208:49:372
251559958435,382cyclictest0-21swapper/212:09:152
251609958270,423cyclictest0-21swapper/707:44:527
251609958270,423cyclictest0-21swapper/707:44:517
251609958270,423cyclictest0-21swapper/707:44:517
251569957868,296cyclictest0-21swapper/310:59:583
251569957764,254cyclictest0-21swapper/311:19:583
251569957764,254cyclictest0-21swapper/311:19:583
251559957422,550cyclictest0-21swapper/209:12:202
2515899573320,41cyclictest0-21swapper/511:17:015
2515899573320,41cyclictest0-21swapper/511:17:005
251549957365,84cyclictest0-21swapper/109:31:001
251549957225,379cyclictest0-21swapper/112:00:051
2516099571189,126cyclictest121rcu_preempt12:38:067
251569956959,296cyclictest0-21swapper/309:58:023
251579956858,380cyclictest0-21swapper/409:33:414
2515999567187,41cyclictest12983-21kworker/u16:010:42:166
251599956553,381cyclictest0-21swapper/611:07:476
251539956516,295cyclictest0-21swapper/012:17:500
251589956396,464cyclictest29821-21rm09:59:005
251539956212,84cyclictest0-21swapper/011:19:530
251539956212,84cyclictest0-21swapper/011:19:520
25154995617,338cyclictest0-21swapper/109:14:551
25156995597,127cyclictest0-21swapper/311:37:523
25153995597,380cyclictest0-21swapper/012:44:230
25158995510,85cyclictest0-21swapper/511:33:055
251559955141,507cyclictest0-21swapper/211:37:292
251609954936,296cyclictest0-21swapper/712:42:327
251579954741,382cyclictest0-21swapper/412:12:554
251559954740,425cyclictest0-21swapper/212:41:322
251559954678,465cyclictest0-21swapper/209:35:162
2515499546124,253cyclictest121rcu_preempt08:48:221
251539954677,296cyclictest0-21swapper/010:00:110
251539954639,84cyclictest131rcu_sched09:34:550
2515799545253,39cyclictest64450irq/122-eth011:10:014
2515799544500,42cyclictest471rcuc/412:15:204
251559954434,508cyclictest0-21swapper/210:59:272
251589954378,126cyclictest0-21swapper/512:17:185
251589954175,211cyclictest0-21swapper/510:44:085
251569954134,41cyclictest0-21swapper/312:44:073
2515999540241,168cyclictest0-21swapper/611:55:366
251559954030,507cyclictest0-21swapper/212:36:462
251539954073,295cyclictest0-21swapper/011:37:520
251599953970,296cyclictest0-21swapper/609:58:096
2515799539324,127cyclictest0-21swapper/407:45:214
251539953672,126cyclictest0-21swapper/012:39:520
251559953522,84cyclictest0-21swapper/210:20:012
2515499535112,213cyclictest1553-21runrttasks12:39:131
251539953571,42cyclictest0-21swapper/011:54:410
251539953571,42cyclictest0-21swapper/011:54:410
251539953571,42cyclictest0-21swapper/011:54:410
251539953571,42cyclictest0-21swapper/011:54:410
251579953426,42cyclictest0-21swapper/411:33:054
2515899533233,126cyclictest0-21swapper/510:06:335
2515499533111,126cyclictest25-21ksoftirqd/110:34:351
251559953221,508cyclictest0-21swapper/210:00:062
2515999531195,334cyclictest25357-21kworker/u16:011:38:056
2515799531191,337cyclictest64450irq/122-eth009:14:424
251559953120,127cyclictest0-21swapper/210:34:232
251579952923,253cyclictest0-21swapper/410:42:164
251559952919,126cyclictest0-21swapper/207:44:452
251559952919,126cyclictest0-21swapper/207:44:442
251559952919,126cyclictest0-21swapper/207:44:442
251539952918,380cyclictest0-21swapper/009:59:510
2515899526147,295cyclictest4336-1kworker/u17:209:12:115
251579952599,423cyclictest29099-21ssh09:58:094
251549952517,84cyclictest0-21swapper/111:33:541
251549952417,50cyclictest0-21swapper/111:37:441
251559952215,130cyclictest478-21diskmemload11:19:362
251559952215,130cyclictest478-21diskmemload11:19:362
251549952215,253cyclictest25151-21cyclictest12:11:431
251569952112,128cyclictest0-21swapper/310:00:113
251559952156,254cyclictest25151-21cyclictest10:19:352
251539952056,380cyclictest0-21swapper/012:13:270
251569951994,127cyclictest0-21swapper/310:43:523
251569951949,338cyclictest0-21swapper/309:34:283
251549951913,295cyclictest0-21swapper/110:43:541
25156995189,126cyclictest0-21swapper/311:58:533
25155995176,508cyclictest0-21swapper/211:33:382
251549951753,421cyclictest0-21swapper/110:20:181
2515399516263,42cyclictest0-21swapper/012:07:370
251539951610,296cyclictest0-21swapper/009:12:280
25155995131,424cyclictest0-21swapper/211:40:132
2515899512130,132cyclictest0-21swapper/512:00:245
251549951244,295cyclictest0-21swapper/111:54:201
251549951244,295cyclictest0-21swapper/111:54:201
251549951244,295cyclictest0-21swapper/111:54:201
251549951244,295cyclictest0-21swapper/111:54:201
25160995090,84cyclictest0-21swapper/710:19:577
25158995090,84cyclictest0-21swapper/511:54:215
25158995090,84cyclictest0-21swapper/511:54:215
25158995090,84cyclictest0-21swapper/511:54:215
25158995090,84cyclictest0-21swapper/511:54:215
25157995090,84cyclictest0-21swapper/411:54:214
25157995090,84cyclictest0-21swapper/411:54:214
25157995090,84cyclictest0-21swapper/411:54:214
25157995090,84cyclictest0-21swapper/411:54:214
25156995090,84cyclictest8421-21ssh12:07:573
2515999508167,338cyclictest25465-21ssh12:00:046
25159995080,84cyclictest0-21swapper/611:33:066
2515899508129,169cyclictest29849-21kworker/u16:311:09:455
251549950882,253cyclictest121rcu_preempt12:33:501
2515599507252,253cyclictest321ktimersoftd/209:15:092
251609950683,3cyclictest25151-21cyclictest12:19:287
251569950683,84cyclictest0-21swapper/312:13:273
251549950641,84cyclictest121rcu_preempt12:18:331
251549950233,338cyclictest0-21swapper/111:57:201
2515599501115,338cyclictest0-21swapper/212:00:172
251599949934,300cyclictest641ktimersoftd/612:42:436
251549949973,211cyclictest25-21ksoftirqd/109:58:451
251549949931,295cyclictest0-21swapper/110:19:221
251609949834,84cyclictest0-21swapper/709:14:077
2515999497113,256cyclictest0-21swapper/610:19:206
2515699497325,84cyclictest0-21swapper/309:14:043
2515899494191,126cyclictest121rcu_preempt12:39:095
251569949466,296cyclictest0-21swapper/310:34:163
2515799492109,337cyclictest29332-21taskset12:41:054
251539949125,126cyclictest0-21swapper/012:33:250
2515399491106,126cyclictest25151-21cyclictest09:48:500
251559949063,211cyclictest15837-21chrt11:00:142
2516099489275,84cyclictest31704-21kworker/u16:309:33:057
251559948963,296cyclictest121rcu_preempt10:06:572
251549948728,253cyclictest0-21swapper/110:45:111
2515899486230,126cyclictest0-21swapper/509:33:475
2515799486102,253cyclictest19387-21ssh10:45:114
251569948520,295cyclictest0-21swapper/308:49:523
2515699485184,127cyclictest121rcu_preempt12:19:043
251539948521,298cyclictest0-21swapper/010:18:280
2515399482143,84cyclictest16234-21ssh10:42:020
2515899481144,216cyclictest26096-1kworker/u17:210:57:435
251579948014,84cyclictest0-21swapper/411:39:184
251569948053,296cyclictest25151-21cyclictest12:33:193
251569948053,296cyclictest25151-21cyclictest11:33:063
2515799479224,83cyclictest0-21swapper/411:17:074
2515799479224,83cyclictest0-21swapper/411:17:064
251539947911,253cyclictest0-21swapper/008:47:190
251599947853,85cyclictest121rcu_preempt10:34:156
251579947793,253cyclictest49-21ksoftirqd/412:37:184
251589947494,377cyclictest23664-21diskmemload12:20:095
25158994748,84cyclictest0-21swapper/510:18:495
25160994711,296cyclictest73-21ksoftirqd/711:36:567
251579947147,84cyclictest0-21swapper/410:00:364
25156994711,127cyclictest0-21swapper/310:19:223
25159994701,211cyclictest0-21swapper/610:59:216
2515999469426,41cyclictest631rcuc/609:34:566
25158994693,211cyclictest0-21swapper/511:59:325
25159994682,211cyclictest0-21swapper/610:45:106
25157994682,84cyclictest0-21swapper/412:33:204
251549946883,339cyclictest0-21swapper/112:41:051
25153994671,126cyclictest121rcu_preempt11:33:090
25158994661,126cyclictest0-21swapper/510:00:215
2515799465125,337cyclictest16702-21gltestperf09:35:194
2515699465124,338cyclictest0-21swapper/310:35:213
2515699464123,338cyclictest0-21swapper/310:07:193
2516099463125,3cyclictest721ktimersoftd/711:55:037
251579946340,296cyclictest0-21swapper/410:19:204
251609946240,256cyclictest0-21swapper/712:11:507
251599946240,256cyclictest0-21swapper/612:39:586
251599946240,255cyclictest0-21swapper/612:11:116
2515899462209,84cyclictest0-21swapper/511:20:255
2515899462121,338cyclictest0-21swapper/510:35:015
251599946076,254cyclictest0-21swapper/609:13:406
251599945835,84cyclictest0-21swapper/611:53:366
251599945835,84cyclictest0-21swapper/611:53:366
251599945835,84cyclictest0-21swapper/611:53:366
251599945835,84cyclictest0-21swapper/611:53:356
2515899458201,88cyclictest0-21swapper/508:49:375
251579945874,211cyclictest49-21ksoftirqd/408:46:574
2515799458207,3cyclictest0-21swapper/411:55:434
251609945632,257cyclictest0-21swapper/710:34:597
2515799456116,338cyclictest25151-21cyclictest09:48:264
251589945534,2cyclictest0-21swapper/512:10:545
251539945570,211cyclictest0-21swapper/010:59:210
2516099454112,126cyclictest121rcu_preempt09:59:207
251589945432,3cyclictest0-21swapper/507:44:035
251589945432,3cyclictest0-21swapper/507:44:025
251589945432,3cyclictest0-21swapper/507:44:025
251579945433,2cyclictest0-21swapper/410:35:214
251549945474,42cyclictest4526-1kworker/u17:010:59:131
2515999453244,41cyclictest0-21swapper/612:18:426
251589945228,84cyclictest0-21swapper/511:37:565
251539945229,84cyclictest1553-21runrttasks07:45:210
2515399452113,127cyclictest26319-21ssh12:00:170
251579945028,3cyclictest0-21swapper/410:07:094
2515499450195,253cyclictest25151-21cyclictest09:15:091
251609944927,2cyclictest0-21swapper/710:57:427
2516099449108,338cyclictest0-21swapper/711:07:397
2515799449108,338cyclictest0-21swapper/407:44:524
2515799449108,338cyclictest0-21swapper/407:44:514
2515799449108,338cyclictest0-21swapper/407:44:514
251599944826,2cyclictest0-21swapper/610:35:216
251599944825,256cyclictest0-21swapper/611:19:546
251599944825,256cyclictest0-21swapper/611:19:546
251569944868,126cyclictest0-21swapper/311:53:083
251569944868,126cyclictest0-21swapper/311:53:083
251569944868,126cyclictest0-21swapper/311:53:073
251569944868,126cyclictest0-21swapper/311:53:073
251569944825,84cyclictest16680-21grep09:35:183
2515599448108,338cyclictest0-21swapper/210:35:212
2515399448106,127cyclictest0-21swapper/010:34:430
251609944724,3cyclictest25151-21cyclictest10:44:417
2515799447148,126cyclictest121rcu_preempt12:00:174
2515799447105,126cyclictest13571-21ssh10:58:094
251569944724,3cyclictest19299-21ssh10:45:073
2515799446108,172cyclictest31992-21ssh10:33:424
251539944624,217cyclictest0-21swapper/009:35:160
2515699445107,171cyclictest0-21swapper/307:40:423
2515699445107,171cyclictest0-21swapper/307:40:413
2515699445107,171cyclictest0-21swapper/307:40:413
251549944523,3cyclictest0-21swapper/111:20:261
251539944519,126cyclictest0-21swapper/010:20:020
251589944417,251cyclictest0-21swapper/512:33:345
2515899442103,336cyclictest0-21swapper/511:40:195
251589944160,84cyclictest0-21swapper/509:35:095
251609944057,84cyclictest121rcu_preempt12:33:277
2515899440184,254cyclictest561ktimersoftd/510:45:105
251549944014,126cyclictest121rcu_preempt10:00:361
251599943998,338cyclictest19805-21fschecks_count11:20:196
251569943916,177cyclictest0-21swapper/312:20:133
251539943918,255cyclictest0-21swapper/007:40:420
251539943918,255cyclictest0-21swapper/007:40:410
251539943918,255cyclictest0-21swapper/007:40:410
251579943695,338cyclictest0-21swapper/411:40:034
25155994337,127cyclictest18931-21sh11:20:142
251549943311,84cyclictest0-21swapper/112:06:591
25160994318,84cyclictest0-21swapper/708:49:157
251569942945,169cyclictest20618-21/usr/sbin/munin11:20:263
2516099428384,42cyclictest711rcuc/712:00:187
25153994282,126cyclictest0-21swapper/012:20:130
25160994273,84cyclictest0-21swapper/711:20:147
251579942788,337cyclictest0-21swapper/410:20:104
251569942686,125cyclictest41-21ksoftirqd/307:45:173
251609942583,339cyclictest0-21swapper/709:48:177
25155994253,176cyclictest0-21swapper/208:50:082
251549942541,296cyclictest0-21swapper/112:20:141
251589942483,338cyclictest0-21swapper/510:20:165
25153994241,256cyclictest0-21swapper/011:20:270
2516099423124,296cyclictest16904-21ssh11:17:547
2516099423124,296cyclictest16904-21ssh11:17:547
25158994231,42cyclictest0-21swapper/508:50:095
251609942282,338cyclictest0-21swapper/711:34:117
2515999422122,126cyclictest0-21swapper/609:48:206
251589942242,84cyclictest0-21swapper/509:48:205
2515499422208,84cyclictest121rcu_preempt09:48:561
251569942080,85cyclictest0-21swapper/309:48:173
251559942082,84cyclictest15747-21irqstats07:45:212
251549942080,338cyclictest0-21swapper/110:06:331
251599941978,338cyclictest0-21swapper/612:33:076
251569941980,84cyclictest0-21swapper/310:20:113
251549941978,126cyclictest121rcu_preempt11:40:131
251599941737,3cyclictest0-21swapper/607:40:426
251599941737,3cyclictest0-21swapper/607:40:416
251599941737,3cyclictest0-21swapper/607:40:416
2515999417122,168cyclictest24132-21ssh12:20:146
251609941676,338cyclictest0-21swapper/711:55:027
251589941573,339cyclictest28178-1kworker/u17:110:35:235
251549941532,211cyclictest14055-21taskset07:43:421
251549941532,211cyclictest14055-21taskset07:43:411
251549941532,211cyclictest14055-21taskset07:43:411
2515899414162,170cyclictest4526-1kworker/u17:011:10:085
251579941432,126cyclictest0-21swapper/412:20:154
251609941372,338cyclictest0-21swapper/710:20:097
2515999413114,126cyclictest1551-21snmpd08:48:516
2515499413200,126cyclictest3384-21sh10:35:231
2515399413160,42cyclictest22750-21ssh11:40:040
251609941232,296cyclictest0-21swapper/709:15:197
251589941170,338cyclictest12983-21kworker/u16:011:00:135
251579941133,84cyclictest0-21swapper/411:20:114
251609940766,338cyclictest0-21swapper/710:00:117
251609940723,255cyclictest0-21swapper/711:54:157
251609940723,255cyclictest0-21swapper/711:54:157
251539940765,339cyclictest0-21swapper/010:07:190
251539940666,337cyclictest0-21swapper/010:35:210
251539940665,338cyclictest0-21swapper/009:15:080
251609940564,338cyclictest0-21swapper/711:10:077
251609940222,84cyclictest0-21swapper/711:00:257
251599940222,42cyclictest0-21swapper/607:45:166
251599940161,84cyclictest0-21swapper/610:00:036
251599939960,84cyclictest0-21swapper/609:35:266
2515799397225,83cyclictest0-21swapper/411:10:074
251569939758,84cyclictest0-21swapper/312:00:183
251569939715,45cyclictest0-21swapper/311:40:143
251599939556,84cyclictest0-21swapper/610:07:196
251549939413,126cyclictest0-21swapper/111:00:121
251589939212,211cyclictest57-21ksoftirqd/509:15:075
251609939152,84cyclictest0-21swapper/709:35:187
251569939111,84cyclictest0-21swapper/311:00:263
251559938645,338cyclictest0-21swapper/211:10:092
25155993863,126cyclictest19285-21ssh10:45:032
251599938547,83cyclictest0-21swapper/611:40:196
25154993844,42cyclictest0-21swapper/108:50:121
2515499382125,126cyclictest121rcu_preempt09:35:081
2515999381124,254cyclictest15757-21sh11:00:076
2516099380124,253cyclictest1428-21/usr/sbin/munin10:35:217
251549937979,126cyclictest0-21swapper/107:45:241
251569937879,296cyclictest0-21swapper/309:15:103
251609937739,3cyclictest23953-21gltestperf11:40:207
251539937739,171cyclictest0-21swapper/010:45:040
2515399377120,127cyclictest9-21ksoftirqd/011:10:110
2516099376166,130cyclictest28178-1kworker/u17:110:06:497
251579937677,296cyclictest15756-21chrt11:00:064
2515799372119,126cyclictest0-21swapper/409:15:064
251539937031,84cyclictest0-21swapper/011:00:100
251589936932,2cyclictest0-21swapper/507:45:095
251569936767,174cyclictest0-21swapper/308:50:083
251599936627,84cyclictest0-21swapper/610:20:176
251579936630,7cyclictest121rcu_preempt08:50:094
251609936526,84cyclictest19287-21ssh10:45:057
251599936527,41cyclictest0-21swapper/609:15:106
251539936522,84cyclictest0-21swapper/008:50:070
2515999361151,41cyclictest0-21swapper/611:10:116
251609935920,84cyclictest0-21swapper/712:20:117
251549935720,42cyclictest121rcu_preempt11:10:071
251569935397,126cyclictest0-21swapper/311:10:053
251609934911,43cyclictest121rcu_preempt07:45:187
251609932770,254cyclictest0-21swapper/708:50:127
251599932732,84cyclictest65-21ksoftirqd/608:50:126
2212129262,27sleep70-21swapper/707:05:047
72132900,0sleep00-21swapper/012:27:460
2449228660,23sleep10-21swapper/107:06:421
2442328447,34sleep60-21swapper/607:05:446
2459028050,27sleep50-21swapper/507:08:085
2461227847,27sleep00-21swapper/007:08:270
2450427847,27sleep40-21swapper/407:06:534
2446527849,26sleep30-21swapper/307:06:203
2445527849,26sleep20-21swapper/207:06:112
170132700,0sleep10-21swapper/109:51:251
69792670,0sleep40-21swapper/408:25:134
25155993327,5cyclictest0-21swapper/208:37:072
25155993310,22cyclictest0-21swapper/209:29:542
25155993210,0cyclictest0-21swapper/209:01:302
25154992910,18cyclictest0-21swapper/108:28:591
25160992810,0cyclictest0-21swapper/707:13:077
25159992810,17cyclictest0-21swapper/608:36:386
25159992810,17cyclictest0-21swapper/608:10:486
25156992810,18cyclictest0-21swapper/308:11:123
25156992810,0cyclictest0-21swapper/308:28:563
25155992810,0cyclictest0-21swapper/207:13:282
25154992810,18cyclictest0-21swapper/109:29:441
25153992810,18cyclictest0-21swapper/009:29:490
25153992810,18cyclictest0-21swapper/007:13:300
25160992727,0cyclictest0-21swapper/709:29:267
25160992727,0cyclictest0-21swapper/709:01:577
25160992727,0cyclictest0-21swapper/708:37:017
25160992710,17cyclictest0-21swapper/708:29:027
25160992710,17cyclictest0-21swapper/708:11:167
25160992710,17cyclictest0-21swapper/707:29:307
25160992710,0cyclictest0-21swapper/708:18:347
25160992710,0cyclictest0-21swapper/708:02:187
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional