You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-28 - 10:31
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Jul 28, 2026 00:58:34)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2885199748111,84cyclictest0-21swapper/422:21:094
28854997210,126cyclictest0-21swapper/722:05:127
288499969817,127cyclictest0-21swapper/222:10:282
288519969519,507cyclictest121rcu_preempt22:07:534
288519969516,676cyclictest0-21swapper/423:52:404
288519969317,127cyclictest121rcu_preempt00:08:504
288519969316,640cyclictest0-21swapper/423:39:164
2884799675122,380cyclictest0-21swapper/022:47:500
2885499672118,423cyclictest0-21swapper/723:30:237
288499967239,126cyclictest0-21swapper/222:48:542
2884899665112,296cyclictest0-21swapper/122:48:321
288519966330,548cyclictest0-21swapper/422:13:564
2885499659108,385cyclictest0-21swapper/723:36:537
288519965359,591cyclictest0-21swapper/422:52:344
288479963382,211cyclictest0-21swapper/022:03:310
2884799633627,4cyclictest101ktimersoftd/000:35:570
288519963036,591cyclictest13413-21ssh23:24:444
288519963036,591cyclictest13413-21ssh23:24:444
2884799629164,126cyclictest15369-21kworker/u16:321:58:100
288519962632,591cyclictest0-21swapper/421:58:484
288489962674,337cyclictest0-21swapper/100:24:241
288519962531,591cyclictest0-21swapper/423:18:484
288519962329,591cyclictest0-21swapper/400:00:144
288479962332,338cyclictest0-21swapper/020:05:240
288519962169,549cyclictest0-21swapper/400:29:554
288519962126,592cyclictest0-21swapper/423:56:244
288519961825,590cyclictest0-21swapper/400:40:244
2884899618492,43cyclictest241ktimersoftd/100:02:331
288499961769,126cyclictest121rcu_preempt23:13:102
288499961464,338cyclictest0-21swapper/223:23:152
288499961464,338cyclictest0-21swapper/223:23:152
288519961364,467cyclictest0-21swapper/400:24:124
288489960997,296cyclictest0-21swapper/100:10:521
288489960758,84cyclictest0-21swapper/123:55:471
288479960713,85cyclictest0-21swapper/000:06:100
288509960352,381cyclictest0-21swapper/321:57:123
288499960391,296cyclictest0-21swapper/223:17:582
28851996018,42cyclictest0-21swapper/422:49:244
28851995983,592cyclictest0-21swapper/420:30:124
28850995950,84cyclictest0-21swapper/323:37:533
2884899595126,211cyclictest29860-21ssh21:22:051
28854995940,85cyclictest0-21swapper/721:59:007
28854995940,84cyclictest0-21swapper/722:01:567
28854995940,84cyclictest0-21swapper/700:30:327
28854995940,84cyclictest0-21swapper/700:23:047
28850995940,84cyclictest0-21swapper/300:30:083
28849995940,83cyclictest0-21swapper/222:59:292
28851995931,169cyclictest0-21swapper/400:12:204
28849995930,84cyclictest0-21swapper/223:52:412
28847995930,84cyclictest0-21swapper/023:52:400
2884899592250,126cyclictest0-21swapper/122:35:191
288539959040,177cyclictest0-21swapper/623:14:436
2884899590124,211cyclictest0-21swapper/100:46:211
288499958875,381cyclictest0-21swapper/200:23:372
288519958734,550cyclictest0-21swapper/422:26:364
288519958638,464cyclictest0-21swapper/423:00:074
2885099586122,166cyclictest0-21swapper/323:18:073
288519958532,550cyclictest0-21swapper/423:13:374
288509958472,85cyclictest0-21swapper/322:25:413
288499958433,126cyclictest0-21swapper/223:00:202
2885099583497,84cyclictest391rcuc/322:02:353
2885299582115,126cyclictest5193-21ssh22:21:005
288519958232,126cyclictest0-21swapper/419:28:494
2884799582118,211cyclictest121rcu_preempt22:09:570
288519958128,550cyclictest0-21swapper/421:22:484
288519958030,126cyclictest0-21swapper/423:46:004
288479958072,84cyclictest121rcu_preempt23:34:000
2885099578108,254cyclictest8599-21ssh00:25:073
2884899578113,126cyclictest121rcu_preempt22:24:511
2885299577107,296cyclictest4805-21/usr/sbin/munin00:20:355
288519957724,380cyclictest0-21swapper/423:33:294
288509957768,127cyclictest0-21swapper/320:50:223
288519957565,507cyclictest0-21swapper/423:27:284
288499957524,84cyclictest0-21swapper/222:53:362
2884799575148,296cyclictest0-21swapper/020:30:180
2884799575111,84cyclictest9-21ksoftirqd/000:40:300
288539957260,381cyclictest0-21swapper/623:20:426
288539957260,381cyclictest0-21swapper/623:20:426
288479957220,295cyclictest0-21swapper/022:23:530
2884999571492,77cyclictest311rcuc/223:56:362
2885099570102,295cyclictest13027-21ssh00:05:213
288519956920,50cyclictest0-21swapper/422:59:094
2884799569275,84cyclictest0-21swapper/022:51:310
288479956921,42cyclictest8406-21ssh00:01:450
288479956818,85cyclictest0-21swapper/023:36:520
288539956718,338cyclictest0-21swapper/622:48:216
288519956614,169cyclictest0-21swapper/422:04:104
2884899565223,211cyclictest0-21swapper/100:30:131
288539956493,126cyclictest30394-21ssh23:35:216
288499956415,337cyclictest0-21swapper/200:26:262
288539956214,338cyclictest0-21swapper/622:10:576
2884799562136,253cyclictest0-21swapper/000:10:400
288499956112,84cyclictest0-21swapper/222:35:302
288549956052,338cyclictest0-21swapper/720:50:247
2885299560218,339cyclictest1049-1kworker/u17:022:05:195
288509956010,299cyclictest0-21swapper/323:33:303
288499955746,380cyclictest0-21swapper/223:39:432
2885199555129,127cyclictest49-21ksoftirqd/400:36:224
288509955283,338cyclictest4230-21diskmemload23:58:073
28850995521,127cyclictest0-21swapper/323:20:413
28850995521,127cyclictest0-21swapper/323:20:413
2884899552126,253cyclictest4838-21sh22:59:541
288539955180,422cyclictest0-21swapper/600:19:276
28853995511,383cyclictest0-21swapper/623:33:306
28849995511,126cyclictest0-21swapper/222:24:292
28848995510,84cyclictest0-21swapper/123:52:401
28847995511,126cyclictest0-21swapper/000:18:590
2885499550207,254cyclictest28845-21cyclictest23:15:037
28851995501,42cyclictest0-21swapper/420:50:124
288509954980,296cyclictest0-21swapper/323:44:373
2884899548464,4cyclictest241ktimersoftd/122:11:591
2884899548206,126cyclictest0-21swapper/123:37:261
2884899547464,3cyclictest231rcuc/122:30:091
288479954780,125cyclictest121rcu_preempt23:59:450
288489954678,126cyclictest0-21swapper/100:08:461
288499954433,338cyclictest28845-21cyclictest00:19:212
2884999544117,254cyclictest0-21swapper/223:34:082
288509954374,296cyclictest0-21swapper/323:26:263
288489954373,211cyclictest4748-21if_err_eth023:40:161
288499954276,84cyclictest0-21swapper/200:11:552
2884999542116,127cyclictest1551-21snmpd21:58:132
288549954176,84cyclictest0-21swapper/723:45:187
2885499541242,168cyclictest0-21swapper/722:35:257
2885499541200,339cyclictest28845-21cyclictest23:24:397
2885499541200,339cyclictest28845-21cyclictest23:24:397
288539954131,297cyclictest6349-21ssh00:22:376
2885299541200,338cyclictest15209-1kworker/u17:000:11:555
288519954130,508cyclictest0-21swapper/420:42:374
288499954130,126cyclictest1345-21kworker/u16:300:35:582
288479954177,253cyclictest0-21swapper/000:31:120
288549954029,126cyclictest0-21swapper/723:26:097
288509954069,127cyclictest0-21swapper/322:15:063
2884999540114,423cyclictest0-21swapper/222:30:022
288489954032,126cyclictest0-21swapper/122:50:461
288489954029,169cyclictest25-21ksoftirqd/121:56:521
288479954032,126cyclictest0-21swapper/022:11:450
288529953973,126cyclictest0-21swapper/500:08:325
288489953928,84cyclictest0-21swapper/123:00:221
288479953869,211cyclictest9-21ksoftirqd/020:35:320
2884799538197,168cyclictest0-21swapper/023:24:100
2884799538197,168cyclictest0-21swapper/023:24:100
2885499537111,296cyclictest0-21swapper/722:29:527
288499953771,126cyclictest33-21ksoftirqd/223:45:132
2884999537113,85cyclictest28489-1kworker/u17:200:05:452
288489953627,84cyclictest0-21swapper/122:01:141
288489953624,295cyclictest0-21swapper/123:34:181
288529953524,84cyclictest0-21swapper/523:30:085
288509953524,296cyclictest0-21swapper/320:09:473
288539953423,210cyclictest0-21swapper/622:05:236
288539953422,338cyclictest121rcu_preempt23:55:476
288489953466,465cyclictest0-21swapper/123:14:071
2884799533151,84cyclictest14128-21kworker/u16:023:19:440
288519953266,84cyclictest0-21swapper/423:05:154
288529953125,295cyclictest0-21swapper/523:59:515
288509953167,84cyclictest0-21swapper/323:46:503
2884899531486,42cyclictest231rcuc/122:07:011
288489953123,84cyclictest0-21swapper/100:19:421
2885399530233,126cyclictest641ktimersoftd/622:24:026
288489953023,84cyclictest0-21swapper/123:18:391
2885099529103,169cyclictest41-21ksoftirqd/323:14:413
2885199528187,338cyclictest64450irq/122-eth023:44:124
288509952819,84cyclictest0-21swapper/322:53:073
288499952821,295cyclictest0-21swapper/220:09:512
288539952757,338cyclictest121rcu_preempt00:14:426
288529952721,126cyclictest19285-21ssh22:47:505
288499952715,84cyclictest0-21swapper/200:00:212
288509952660,126cyclictest0-21swapper/300:22:263
2885499525229,84cyclictest31851-21kworker/7:122:52:177
288549952458,84cyclictest0-21swapper/722:15:117
288529952460,7cyclictest121rcu_preempt22:53:195
288529952455,338cyclictest11233-21ssh23:44:025
288499952357,84cyclictest121rcu_preempt22:09:122
288549952215,84cyclictest0-21swapper/722:12:197
288479952213,211cyclictest9-21ksoftirqd/000:26:010
288529952113,126cyclictest0-21swapper/520:35:275
288489952056,126cyclictest121rcu_preempt00:26:061
288549951748,296cyclictest19609-21grep00:10:147
2885399517472,42cyclictest631rcuc/620:30:226
288499951748,296cyclictest0-21swapper/220:37:542
28851995143,42cyclictest0-21swapper/420:38:044
2884999514222,290cyclictest1375-21kworker/u16:122:03:372
28851995121,508cyclictest0-21swapper/421:00:274
28852995115,126cyclictest0-21swapper/522:25:135
28849995113,89cyclictest1553-21runrttasks00:30:122
288509951082,211cyclictest0-21swapper/322:07:393
288539950986,85cyclictest698-21ptp4l21:58:146
288539950981,211cyclictest1553-21runrttasks19:59:236
28853995091,84cyclictest0-21swapper/621:00:166
28853995090,84cyclictest0-21swapper/623:52:416
288509950982,211cyclictest0-21swapper/322:14:113
28847995091,126cyclictest0-21swapper/000:45:550
2885399507251,253cyclictest641ktimersoftd/623:45:276
288549950679,211cyclictest73-21ksoftirqd/700:04:047
288509950641,126cyclictest121rcu_preempt22:21:263
288539950541,295cyclictest0-21swapper/600:40:476
288529950541,380cyclictest0-21swapper/522:10:275
288479950579,211cyclictest7602-21ssh00:24:220
288529950478,253cyclictest0-21swapper/523:06:495
288529950334,338cyclictest14481-21taskset20:30:325
288549950234,296cyclictest0-21swapper/700:35:417
288529950278,169cyclictest0-21swapper/523:28:575
2885099502121,339cyclictest0-21swapper/300:14:193
2884899502203,126cyclictest121rcu_preempt23:21:361
2884899502203,126cyclictest121rcu_preempt23:21:361
288529950179,84cyclictest121rcu_preempt21:24:255
288489950140,249cyclictest0-21swapper/123:28:301
2885399500117,211cyclictest10881-21ssh00:04:366
288489950028,43cyclictest0-21swapper/123:06:171
288529949934,219cyclictest0-21swapper/523:11:015
288479949934,126cyclictest0-21swapper/023:12:270
2885299498118,254cyclictest30654-21expr20:05:145
288489949827,83cyclictest0-21swapper/120:05:141
2884799498372,42cyclictest101ktimersoftd/021:23:470
2884999497114,380cyclictest4230-21diskmemload21:44:112
288479949732,42cyclictest121rcu_preempt23:46:390
288479949731,84cyclictest0-21swapper/021:00:170
288519949632,385cyclictest0-21swapper/419:15:234
2885099496410,84cyclictest391rcuc/320:40:253
288499949627,84cyclictest121rcu_preempt20:24:442
288489949630,84cyclictest0-21swapper/122:27:471
288549949568,254cyclictest0-21swapper/719:29:067
288529949532,344cyclictest0-21swapper/521:57:225
288519949526,466cyclictest0-21swapper/421:14:264
288509949572,254cyclictest0-21swapper/322:49:393
288499949572,84cyclictest0-21swapper/222:15:122
288489949530,84cyclictest0-21swapper/120:35:141
288529949428,84cyclictest0-21swapper/500:49:595
2884899494110,254cyclictest0-21swapper/120:40:251
288539949324,339cyclictest698-21ptp4l19:15:246
288519949329,295cyclictest0-21swapper/420:05:244
288519949325,295cyclictest0-21swapper/400:30:324
288489949328,84cyclictest0-21swapper/123:45:591
288479949371,84cyclictest121rcu_preempt22:59:230
288479949366,211cyclictest8577-21kworker/0:022:26:550
2885499492235,127cyclictest0-21swapper/700:40:087
288509949227,381cyclictest0-21swapper/300:40:083
288509949226,126cyclictest18748-21ssh23:06:433
288499949226,84cyclictest121rcu_preempt19:15:242
288539949126,211cyclictest0-21swapper/623:05:456
288499949168,84cyclictest0-21swapper/220:40:262
288549949067,211cyclictest0-21swapper/722:23:177
288549949025,42cyclictest0-21swapper/700:06:217
288529949064,295cyclictest0-21swapper/500:03:065
288489949065,210cyclictest0-21swapper/100:35:561
2884899490106,296cyclictest0-21swapper/121:30:151
288539948925,295cyclictest0-21swapper/620:35:426
288509948862,211cyclictest41-21ksoftirqd/300:01:253
2885099488104,211cyclictest41-21ksoftirqd/322:55:263
288479948866,130cyclictest9-21ksoftirqd/023:07:180
288549948722,43cyclictest0-21swapper/722:47:297
288519948720,168cyclictest0-21swapper/400:46:254
288499948723,253cyclictest0-21swapper/223:44:392
288479948721,84cyclictest0-21swapper/023:27:090
288549948622,46cyclictest0-21swapper/720:43:017
288539948664,84cyclictest121rcu_preempt22:54:156
288539948618,465cyclictest0-21swapper/623:28:386
288539948618,211cyclictest0-21swapper/622:00:436
288539948615,168cyclictest15926-21perf22:30:026
288519948618,210cyclictest0-21swapper/400:15:054
288499948622,126cyclictest0-21swapper/221:24:182
288499948621,84cyclictest0-21swapper/223:28:172
2884999486107,126cyclictest0-21swapper/220:30:392
2884799486277,85cyclictest28971-21unixbench_singl22:35:300
288529948516,296cyclictest0-21swapper/500:30:195
2885499484441,41cyclictest711rcuc/700:19:407
288539948318,254cyclictest0-21swapper/600:30:486
288519948318,169cyclictest0-21swapper/422:35:204
288509948398,211cyclictest41-21ksoftirqd/321:24:443
288499948258,84cyclictest121rcu_preempt23:06:082
288499948216,126cyclictest0-21swapper/219:29:052
288499948215,84cyclictest0-21swapper/220:50:182
288549948157,84cyclictest0-21swapper/700:26:067
288529948152,126cyclictest0-21swapper/522:15:125
288509948011,260cyclictest30236-21seq00:36:273
2885299479139,338cyclictest28845-21cyclictest23:23:245
2885299479139,338cyclictest28845-21cyclictest23:23:245
288509947913,126cyclictest0-21swapper/322:30:053
288499947814,84cyclictest0-21swapper/221:00:172
288479947814,84cyclictest0-21swapper/023:44:320
2885299477358,37cyclictest561ktimersoftd/523:39:035
28847994768,126cyclictest121rcu_preempt19:15:230
28851994696,41cyclictest0-21swapper/421:30:164
28853994672,214cyclictest0-21swapper/620:05:256
28848994670,84cyclictest0-21swapper/120:30:131
2884799466125,253cyclictest0-21swapper/023:00:190
288529946582,380cyclictest0-21swapper/523:45:365
288539946437,296cyclictest0-21swapper/622:59:336
2885299464123,338cyclictest0-21swapper/500:35:485
288499946483,84cyclictest0-21swapper/200:45:542
288549946378,211cyclictest73-21ksoftirqd/700:46:197
2885399463125,84cyclictest0-21swapper/600:05:536
2885299462124,169cyclictest561ktimersoftd/522:59:505
288489946140,83cyclictest121rcu_preempt21:14:211
288549946076,381cyclictest28845-21cyclictest23:07:077
288539946075,211cyclictest1553-21runrttasks00:35:476
288539946038,2cyclictest0-21swapper/622:15:116
288529946037,84cyclictest121rcu_preempt21:44:125
2885299460120,338cyclictest0-21swapper/523:18:545
2884899460203,84cyclictest0-21swapper/120:50:121
2885499459119,338cyclictest0-21swapper/723:00:247
288479945938,2cyclictest0-21swapper/020:40:030
2885499458116,339cyclictest0-21swapper/721:24:027
288509945835,257cyclictest0-21swapper/300:18:503
288479945837,2cyclictest0-21swapper/021:30:120
288479945837,2cyclictest0-21swapper/019:59:290
288539945774,380cyclictest0-21swapper/623:40:176
288519945732,126cyclictest0-21swapper/421:52:214
288529945676,296cyclictest0-21swapper/520:50:235
288529945635,255cyclictest0-21swapper/519:59:305
288519945634,255cyclictest0-21swapper/419:59:294
288519945630,422cyclictest0-21swapper/420:19:244
288549945532,85cyclictest0-21swapper/723:51:457
288529945578,253cyclictest6596-21runrttasks22:01:425
288519945534,295cyclictest0-21swapper/422:15:104
288539945433,253cyclictest0-21swapper/623:15:146
2884899454114,338cyclictest0-21swapper/121:25:031
288529945378,203cyclictest57-21ksoftirqd/520:40:095
288509945330,84cyclictest0-21swapper/321:14:283
2884999453112,338cyclictest0-21swapper/200:40:302
288489945331,261cyclictest0-21swapper/122:15:101
288549945224,253cyclictest17682-21mailstats20:35:327
2885399452156,85cyclictest28905-1kworker/u17:121:24:186
2885299452195,84cyclictest5256-21ps00:40:255
2885299451112,337cyclictest0-21swapper/520:55:195
288549945027,256cyclictest0-21swapper/722:59:337
288529945028,338cyclictest0-21swapper/521:00:255
288509945026,127cyclictest23983-21ssh21:52:213
288519944920,168cyclictest0-21swapper/422:30:044
288539944725,42cyclictest0-21swapper/620:50:196
288489944620,83cyclictest0-21swapper/100:41:041
2885499445104,169cyclictest0-21swapper/723:44:377
2885099445400,42cyclictest391rcuc/323:52:563
288509944417,296cyclictest0-21swapper/320:37:203
288479944321,84cyclictest0-21swapper/020:50:120
288479944321,256cyclictest0-21swapper/022:15:110
2885299442103,84cyclictest0-21swapper/500:29:485
288509944258,211cyclictest0-21swapper/322:35:193
288499944262,177cyclictest0-21swapper/221:52:072
288539944017,83cyclictest121rcu_preempt23:00:246
288529944059,84cyclictest0-21swapper/500:19:275
288529944059,126cyclictest1551-21snmpd22:35:245
288489944018,126cyclictest0-21swapper/121:44:111
288549943916,211cyclictest28845-21cyclictest21:00:187
288539943812,423cyclictest0-21swapper/621:25:036
288529943758,84cyclictest0-21swapper/523:52:265
288509943613,127cyclictest0-21swapper/300:46:063
288549943513,168cyclictest0-21swapper/723:13:017
288499943512,126cyclictest0-21swapper/221:10:052
288549943495,84cyclictest121rcu_preempt20:30:147
288539943190,126cyclictest0-21swapper/621:14:136
288549942988,338cyclictest4230-21diskmemload23:57:447
28848994275,3cyclictest0-21swapper/121:00:321
288539942685,338cyclictest0-21swapper/620:40:256
2885099426127,126cyclictest41-21ksoftirqd/323:00:043
288529942483,337cyclictest16329-21taskset22:30:065
28848994240,2cyclictest0-21swapper/120:19:241
288479942483,338cyclictest0-21swapper/021:25:040
28853994231,253cyclictest0-21swapper/600:25:186
288539942283,84cyclictest0-21swapper/620:19:316
288529942282,338cyclictest0-21swapper/523:00:185
288509942280,126cyclictest0-21swapper/321:04:273
288539942140,177cyclictest0-21swapper/621:30:146
288499942179,339cyclictest0-21swapper/221:25:042
288539942081,84cyclictest0-21swapper/619:28:436
288539942041,295cyclictest0-21swapper/600:46:186
288529942041,295cyclictest0-21swapper/519:48:305
288549941978,338cyclictest0-21swapper/720:19:317
288529941980,84cyclictest0-21swapper/519:28:585
288519941736,300cyclictest0-21swapper/420:24:424
2885299416116,84cyclictest23981-21rm21:52:205
288479941573,339cyclictest0-21swapper/020:55:190
288539941434,296cyclictest0-21swapper/622:35:146
288509941271,338cyclictest0-21swapper/321:44:123
288509941232,42cyclictest0-21swapper/320:30:223
288499941172,84cyclictest0-21swapper/221:30:162
288519941069,338cyclictest0-21swapper/420:55:194
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional