You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-07 - 05:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 07, 2026 00:54:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
246569976442,719cyclictest0-21swapper/421:46:074
246549974262,677cyclictest0-21swapper/222:54:042
24654996833,677cyclictest0-21swapper/219:29:522
24658996781,85cyclictest0-21swapper/600:43:096
246549967782,592cyclictest0-21swapper/222:58:512
246549967782,592cyclictest0-21swapper/222:58:502
246549967782,592cyclictest0-21swapper/222:58:502
2465399673632,38cyclictest231rcuc/121:41:181
2465499667117,547cyclictest0-21swapper/200:12:342
2465899659105,339cyclictest0-21swapper/600:10:136
246549964911,635cyclictest0-21swapper/223:54:072
246549964810,635cyclictest0-21swapper/200:05:332
246549964810,127cyclictest0-21swapper/222:15:102
246559964752,592cyclictest0-21swapper/322:55:183
246559964752,592cyclictest0-21swapper/322:55:183
246559964752,592cyclictest0-21swapper/322:55:183
24654996446,42cyclictest0-21swapper/221:42:442
24655996413,635cyclictest0-21swapper/322:54:323
246529963942,381cyclictest0-21swapper/023:55:130
24658996370,84cyclictest0-21swapper/621:48:496
24652996350,84cyclictest0-21swapper/022:54:050
246569963136,592cyclictest0-21swapper/423:52:124
2465899630119,338cyclictest0-21swapper/622:39:546
246549962832,465cyclictest0-21swapper/221:38:522
246529962777,126cyclictest0-21swapper/022:13:480
246599962672,381cyclictest0-21swapper/721:44:357
246549962428,508cyclictest0-21swapper/222:43:362
246549962368,381cyclictest0-21swapper/222:13:472
246539962330,127cyclictest0-21swapper/122:58:041
246539962330,127cyclictest0-21swapper/122:58:041
246539962330,127cyclictest0-21swapper/122:58:031
2465699618278,338cyclictest64450irq/122-eth000:05:514
246569961763,423cyclictest0-21swapper/421:42:504
2465299614105,126cyclictest0-21swapper/021:40:520
246549961259,550cyclictest0-21swapper/222:45:142
246549960855,550cyclictest0-21swapper/200:44:382
246559960711,593cyclictest0-21swapper/322:40:223
24654996059,592cyclictest10069-21munin-run22:40:022
24658995997,426cyclictest0-21swapper/622:55:336
24658995997,426cyclictest0-21swapper/622:55:336
24658995997,426cyclictest0-21swapper/622:55:326
24654995961,592cyclictest0-21swapper/200:15:172
24653995960,84cyclictest0-21swapper/123:15:131
2465299596127,254cyclictest0-21swapper/022:59:000
2465299596127,254cyclictest0-21swapper/022:59:000
2465299596127,254cyclictest0-21swapper/022:59:000
2465399592125,295cyclictest0-21swapper/100:04:411
2465399592125,295cyclictest0-21swapper/100:04:411
246599959182,126cyclictest121rcu_preempt22:52:377
2465599591250,84cyclictest32237-21diskmemload00:11:523
246539959082,126cyclictest0-21swapper/122:49:191
246589958834,84cyclictest0-21swapper/622:14:436
246599958776,338cyclictest0-21swapper/721:48:087
246549958679,338cyclictest4967-21rm21:45:332
246559958534,126cyclictest0-21swapper/300:44:243
2465399585121,380cyclictest0-21swapper/100:42:581
2465999581498,3cyclictest711rcuc/700:04:087
2465999581498,3cyclictest711rcuc/700:04:077
246529958029,127cyclictest0-21swapper/022:45:280
246569957931,380cyclictest0-21swapper/422:50:164
2465999578494,3cyclictest711rcuc/719:28:367
2465599575193,253cyclictest24650-21cyclictest00:05:433
246579957222,126cyclictest121rcu_preempt00:02:515
246579957222,126cyclictest121rcu_preempt00:02:515
246549957219,550cyclictest0-21swapper/223:14:552
246589957120,126cyclictest0-21swapper/623:52:556
246589957020,127cyclictest28647-21sendmail21:40:016
246569956920,344cyclictest0-21swapper/400:03:044
246569956920,344cyclictest0-21swapper/400:03:044
246529956919,126cyclictest121rcu_preempt21:46:410
246539956756,380cyclictest0-21swapper/121:50:231
2465899564224,338cyclictest20191-21kworker/u16:000:05:456
2465699564223,338cyclictest64450irq/122-eth022:40:374
2465299559178,126cyclictest121rcu_preempt21:50:230
24657995544,126cyclictest0-21swapper/521:49:045
24658995510,85cyclictest0-21swapper/623:14:176
246549955183,465cyclictest0-21swapper/200:29:312
24653995511,42cyclictest121rcu_preempt23:51:321
24653995510,84cyclictest28161-21ssh22:54:051
24653995510,84cyclictest0-21swapper/122:40:491
24653995510,84cyclictest0-21swapper/119:29:531
24652995510,84cyclictest0-21swapper/019:29:530
24653995491,42cyclictest121rcu_preempt23:39:341
246589954475,381cyclictest0-21swapper/622:41:186
246529954333,126cyclictest0-21swapper/000:28:520
2465299543160,168cyclictest9-21ksoftirqd/023:53:010
246589954031,84cyclictest0-21swapper/622:53:416
246569954072,254cyclictest121rcu_preempt00:13:534
2465299539113,253cyclictest0-21swapper/000:06:190
246589953627,133cyclictest0-21swapper/622:46:476
246569953525,507cyclictest0-21swapper/421:50:254
246559953565,381cyclictest0-21swapper/321:48:363
246549953567,465cyclictest0-21swapper/223:00:142
246529953468,84cyclictest0-21swapper/022:42:060
246599953266,211cyclictest0-21swapper/700:43:277
246599953264,465cyclictest0-21swapper/721:39:557
2465999532449,4cyclictest711rcuc/722:39:227
2465799532106,338cyclictest2495-21ssh21:44:365
246579953163,211cyclictest32550-21ssh23:15:135
2465399531190,338cyclictest32237-21diskmemload22:38:591
2465699530190,338cyclictest64450irq/122-eth022:14:224
246539953019,384cyclictest0-21swapper/119:30:131
2465399529103,126cyclictest25-21ksoftirqd/100:06:581
246569952658,253cyclictest0-21swapper/422:39:104
246549952617,126cyclictest0-21swapper/200:03:032
246549952617,126cyclictest0-21swapper/200:03:022
2465599525486,3cyclictest391rcuc/323:51:323
246539952311,84cyclictest0-21swapper/121:49:211
2465299523402,36cyclictest101ktimersoftd/023:00:160
246589952013,127cyclictest0-21swapper/621:50:086
246579952051,295cyclictest0-21swapper/522:42:055
246529952054,84cyclictest121rcu_preempt00:11:090
246529951911,84cyclictest121rcu_preempt00:42:470
246569951894,84cyclictest0-21swapper/422:56:134
246569951894,84cyclictest0-21swapper/422:56:134
246569951894,84cyclictest0-21swapper/422:56:124
24657995165,296cyclictest17259-21cstates22:45:155
24659995156,92cyclictest0-21swapper/723:54:267
24655995121,338cyclictest0-21swapper/300:27:543
246579951188,126cyclictest961-21ssh00:44:295
24657995100,84cyclictest0-21swapper/522:56:575
24657995100,84cyclictest0-21swapper/522:56:565
24657995100,84cyclictest0-21swapper/522:56:565
246599950881,211cyclictest30929-21ntp_kernel_pll_22:55:237
246599950881,211cyclictest30929-21ntp_kernel_pll_22:55:237
246599950881,211cyclictest30929-21ntp_kernel_pll_22:55:237
24657995080,84cyclictest0-21swapper/500:08:095
2465599508253,253cyclictest401ktimersoftd/322:40:033
24652995061,289cyclictest0-21swapper/000:03:530
24652995061,289cyclictest0-21swapper/000:03:530
2465799505121,211cyclictest4272-21ssh00:28:555
246569950541,298cyclictest0-21swapper/400:28:164
2465399505206,126cyclictest121rcu_preempt00:30:001
2465699504164,338cyclictest64450irq/122-eth000:43:274
2465699504121,296cyclictest0-21swapper/422:46:174
246559950482,126cyclictest121rcu_preempt22:13:253
2465999502161,339cyclictest24650-21cyclictest00:07:527
2465799502122,295cyclictest11279-1kworker/u17:023:55:295
246599950174,211cyclictest0-21swapper/722:49:177
246529949935,253cyclictest0-21swapper/021:39:470
246579949670,211cyclictest0-21swapper/522:13:365
246549949675,82cyclictest0-21swapper/223:55:292
246559949568,211cyclictest41-21ksoftirqd/323:47:083
246599949429,298cyclictest0-21swapper/722:41:577
2465699494153,126cyclictest121rcu_preempt23:13:584
246549949426,465cyclictest0-21swapper/223:15:122
246539949324,296cyclictest0-21swapper/100:12:531
246569949266,46cyclictest64450irq/122-eth023:55:284
246559949269,126cyclictest0-21swapper/322:46:403
246559949122,380cyclictest0-21swapper/321:40:543
246549949021,169cyclictest0-21swapper/223:40:022
246569948968,337cyclictest0-21swapper/421:39:454
246569948864,84cyclictest0-21swapper/400:30:164
246599948761,423cyclictest0-21swapper/700:10:337
246529948767,247cyclictest32237-21diskmemload23:39:130
2465899485230,253cyclictest641ktimersoftd/621:40:216
246579948357,211cyclictest57-21ksoftirqd/522:51:325
246559948356,211cyclictest41-21ksoftirqd/323:14:473
2465299483145,127cyclictest121rcu_preempt22:39:370
246579948115,84cyclictest121rcu_preempt00:10:425
246529948117,126cyclictest0-21swapper/023:14:390
246539948016,42cyclictest0-21swapper/121:39:001
246539947813,261cyclictest0-21swapper/100:27:511
2465799477183,210cyclictest561ktimersoftd/523:14:205
2465899473268,203cyclictest641ktimersoftd/600:30:106
24654994712,42cyclictest0-21swapper/221:50:252
2465699470387,4cyclictest471rcuc/423:39:354
24653994701,84cyclictest0-21swapper/123:14:591
2465699469385,3cyclictest471rcuc/419:30:114
24653994691,295cyclictest25-21ksoftirqd/122:13:331
246559946680,169cyclictest41-21ksoftirqd/300:02:003
246559946680,169cyclictest41-21ksoftirqd/300:02:003
2465799465124,338cyclictest0-21swapper/523:52:555
246589946480,211cyclictest65-21ksoftirqd/600:15:086
2465699464124,337cyclictest0-21swapper/423:15:264
246559946479,211cyclictest0-21swapper/323:39:203
246549946438,253cyclictest0-21swapper/200:30:152
2465399464123,338cyclictest0-21swapper/123:55:361
246559946283,295cyclictest0-21swapper/300:15:253
2465599461165,211cyclictest11309-21if_err_eth021:50:273
246589946076,381cyclictest0-21swapper/600:28:276
246589946034,84cyclictest0-21swapper/600:02:206
246589946034,84cyclictest0-21swapper/600:02:196
246559946080,296cyclictest0-21swapper/319:30:063
2465999459203,84cyclictest121rcu_preempt00:15:077
246579945978,84cyclictest10018-21/usr/sbin/munin21:50:195
2465399459118,338cyclictest0-21swapper/100:15:121
246599945735,338cyclictest0-21swapper/722:13:317
246599945735,255cyclictest0-21swapper/723:15:137
246549945732,126cyclictest0-21swapper/223:39:232
246529945739,330cyclictest0-21swapper/019:52:570
2465899456370,84cyclictest631rcuc/619:29:306
246579945628,42cyclictest121rcu_preempt22:37:525
2465699455116,84cyclictest1553-21runrttasks22:15:064
246549945530,422cyclictest0-21swapper/219:30:142
246599945470,211cyclictest11167-21head21:50:227
2465699454155,126cyclictest121rcu_preempt19:55:134
246529945474,84cyclictest0-21swapper/023:15:130
246589945373,296cyclictest0-21swapper/623:55:116
2465599453157,84cyclictest24650-21cyclictest19:53:123
2465999451109,339cyclictest0-21swapper/723:39:237
2465799451110,338cyclictest0-21swapper/523:39:115
2465999450114,211cyclictest0-21swapper/700:27:547
246579945069,84cyclictest0-21swapper/519:54:345
246559945028,255cyclictest0-21swapper/323:15:133
2465299448107,338cyclictest10942-21hwlatdetect00:15:210
2465799445108,170cyclictest0-21swapper/500:15:235
246569944418,380cyclictest0-21swapper/400:15:334
246549944421,343cyclictest0-21swapper/219:54:192
246539944317,211cyclictest25-21ksoftirqd/123:00:131
2465999442100,211cyclictest27896-1kworker/u17:223:14:007
246589944218,211cyclictest0-21swapper/619:54:406
246589944217,84cyclictest0-21swapper/623:46:526
246579944261,211cyclictest0-21swapper/521:39:455
246589943955,126cyclictest65-21ksoftirqd/622:15:096
246559943899,84cyclictest0-21swapper/323:00:153
24654994314,42cyclictest0-21swapper/223:46:522
246569942484,338cyclictest0-21swapper/419:29:564
246599942383,338cyclictest0-21swapper/723:00:217
246589942381,339cyclictest0-21swapper/619:30:116
246569942382,338cyclictest0-21swapper/423:00:164
246559942382,338cyclictest0-21swapper/322:15:043
246559942382,338cyclictest0-21swapper/319:29:143
246559942381,169cyclictest0-21swapper/323:40:043
246539942340,212cyclictest0-21swapper/119:52:551
24652994231,127cyclictest0-21swapper/023:40:030
246599942282,338cyclictest0-21swapper/719:30:067
246589942282,338cyclictest0-21swapper/623:15:256
246589942281,338cyclictest0-21swapper/623:00:176
246559942282,338cyclictest0-21swapper/323:55:093
2465599421122,126cyclictest0-21swapper/321:38:533
246529942182,84cyclictest0-21swapper/019:30:040
246599941979,338cyclictest0-21swapper/719:54:347
246569941978,338cyclictest0-21swapper/419:53:544
24656994191,254cyclictest0-21swapper/423:40:034
246539941981,84cyclictest0-21swapper/119:55:171
246579941879,84cyclictest0-21swapper/500:30:155
246589941778,337cyclictest0-21swapper/623:39:126
246579941778,84cyclictest3849-21cstates23:00:145
2465299417122,211cyclictest0-21swapper/000:30:010
246529941674,84cyclictest0-21swapper/019:55:130
246579941577,84cyclictest0-21swapper/523:47:025
246559941576,84cyclictest0-21swapper/300:30:173
246599941473,338cyclictest0-21swapper/723:55:107
246569941435,295cyclictest0-21swapper/423:46:404
246549941474,338cyclictest0-21swapper/219:55:172
246539941473,126cyclictest0-21swapper/123:46:461
246539941341,83cyclictest24650-21cyclictest23:40:031
246599941273,169cyclictest0-21swapper/722:15:107
246589941169,339cyclictest0-21swapper/619:55:176
246529941071,84cyclictest0-21swapper/022:15:090
246579940927,127cyclictest0-21swapper/523:40:025
2465299409115,253cyclictest0-21swapper/023:47:010
246559940868,338cyclictest0-21swapper/319:55:143
246579940767,84cyclictest0-21swapper/519:55:145
246599940462,339cyclictest0-21swapper/723:47:077
2465799404109,171cyclictest0-21swapper/519:30:135
246599940362,338cyclictest0-21swapper/700:30:037
2465999403359,42cyclictest711rcuc/723:40:047
246599939858,338cyclictest15850irq/123-ahci[0019:55:167
246579939758,84cyclictest0-21swapper/519:28:565
246539937234,84cyclictest0-21swapper/122:15:101
246579937032,84cyclictest0-21swapper/522:15:035
246589936769,127cyclictest65-21ksoftirqd/623:40:036
22840211996,3sleep70-21swapper/719:05:187
2414728747,36sleep10-21swapper/119:08:571
2416928453,27sleep30-21swapper/319:09:153
2391628340,8sleep50-21swapper/519:05:395
2398728150,28sleep20-21swapper/219:06:412
2162528149,28sleep60-21swapper/619:05:086
35292790,1sleep10-21swapper/121:26:341
2394227846,28sleep40-21swapper/419:06:034
150742780,1sleep20-21swapper/223:22:012
2393827746,28sleep00-21swapper/019:05:580
229252770,0sleep00-21swapper/023:09:590
130862690,0sleep70-21swapper/722:07:027
306622580,3sleep22465499cyclictest21:24:522
24656993510,6cyclictest121rcu_preempt21:13:294
296292340,1sleep70-21swapper/723:30:007
79652320,1sleep0111rcuc/020:25:210
24656992927,2cyclictest0-21swapper/421:27:224
24656992926,3cyclictest0-21swapper/420:34:294
24656992924,2cyclictest121rcu_preempt21:03:144
24652992910,18cyclictest0-21swapper/020:54:250
24659992810,18cyclictest0-21swapper/721:02:357
24659992810,18cyclictest0-21swapper/720:54:127
24659992810,18cyclictest0-21swapper/719:42:497
24659992810,18cyclictest0-21swapper/719:19:377
24659992810,18cyclictest0-21swapper/719:14:037
24658992810,0cyclictest0-21swapper/619:14:036
24657992810,0cyclictest0-21swapper/519:14:315
2465699281,18cyclictest30953-21df_inode22:00:134
24656992810,1cyclictest0-21swapper/420:44:014
24656992810,17cyclictest0-21swapper/420:16:394
24656992810,17cyclictest0-21swapper/420:16:384
24655992828,0cyclictest0-21swapper/321:12:563
24655992810,18cyclictest0-21swapper/321:27:223
24655992810,18cyclictest0-21swapper/320:53:503
24655992810,18cyclictest0-21swapper/319:42:343
24655992810,18cyclictest0-21swapper/319:19:363
24655992810,0cyclictest0-21swapper/320:07:583
24655992810,0cyclictest0-21swapper/319:20:013
24654992828,0cyclictest0-21swapper/220:34:512
24653992810,18cyclictest0-21swapper/120:34:471
24659992710,17cyclictest0-21swapper/720:08:047
24659992710,0cyclictest0-21swapper/721:26:567
24659992710,0cyclictest0-21swapper/721:13:027
24659992710,0cyclictest0-21swapper/720:44:027
24659992710,0cyclictest0-21swapper/720:34:267
24659992710,0cyclictest0-21swapper/720:25:577
24659992710,0cyclictest0-21swapper/720:16:457
24659992710,0cyclictest0-21swapper/720:16:457
24659992710,0cyclictest0-21swapper/719:20:047
24658992727,0cyclictest0-21swapper/621:27:016
24658992727,0cyclictest0-21swapper/620:53:416
24658992727,0cyclictest0-21swapper/619:42:466
24658992710,17cyclictest0-21swapper/621:13:026
24658992710,17cyclictest0-21swapper/620:44:006
24658992710,17cyclictest0-21swapper/620:16:476
24658992710,17cyclictest0-21swapper/620:16:466
24658992710,17cyclictest0-21swapper/620:08:356
24658992710,17cyclictest0-21swapper/619:20:006
24658992710,0cyclictest0-21swapper/621:02:466
24658992710,0cyclictest0-21swapper/620:34:326
24658992710,0cyclictest0-21swapper/620:25:556
24658992710,0cyclictest0-21swapper/619:19:376
24657992727,0cyclictest0-21swapper/520:34:475
24657992727,0cyclictest0-21swapper/519:42:505
24657992727,0cyclictest0-21swapper/519:20:005
24657992710,17cyclictest0-21swapper/521:02:385
24657992710,17cyclictest0-21swapper/520:54:105
24657992710,17cyclictest0-21swapper/520:44:335
24657992710,17cyclictest0-21swapper/520:26:015
24657992710,17cyclictest0-21swapper/519:20:045
24657992710,0cyclictest0-21swapper/521:27:055
24657992710,0cyclictest0-21swapper/521:13:215
24657992710,0cyclictest0-21swapper/520:17:095
24657992710,0cyclictest0-21swapper/520:17:085
24657992710,0cyclictest0-21swapper/520:08:265
24656992727,0cyclictest0-21swapper/419:19:294
24656992727,0cyclictest0-21swapper/419:13:594
24656992710,17cyclictest0-21swapper/420:54:094
24656992710,17cyclictest0-21swapper/420:25:584
24656992710,0cyclictest0-21swapper/420:35:014
24656992710,0cyclictest0-21swapper/420:08:004
24656992710,0cyclictest0-21swapper/419:42:464
24655992710,17cyclictest0-21swapper/320:25:563
24655992710,17cyclictest0-21swapper/320:16:473
24655992710,17cyclictest0-21swapper/320:16:463
24655992710,17cyclictest0-21swapper/319:14:313
24655992710,0cyclictest0-21swapper/321:03:003
24655992710,0cyclictest0-21swapper/320:44:263
24654992727,0cyclictest0-21swapper/221:12:582
24654992727,0cyclictest0-21swapper/220:25:532
24654992710,17cyclictest0-21swapper/221:02:432
24654992710,17cyclictest0-21swapper/220:16:392
24654992710,17cyclictest0-21swapper/220:16:392
24654992710,17cyclictest0-21swapper/219:14:122
24654992710,0cyclictest0-21swapper/221:27:012
24654992710,0cyclictest0-21swapper/220:53:522
24654992710,0cyclictest0-21swapper/220:44:282
24654992710,0cyclictest0-21swapper/220:07:572
24654992710,0cyclictest0-21swapper/219:42:132
24654992710,0cyclictest0-21swapper/219:20:022
24654992710,0cyclictest0-21swapper/219:19:342
24653992710,17cyclictest0-21swapper/121:13:261
24653992710,17cyclictest0-21swapper/120:44:031
24653992710,17cyclictest0-21swapper/120:26:341
24653992710,17cyclictest0-21swapper/120:16:461
24653992710,17cyclictest0-21swapper/120:16:461
24653992710,17cyclictest0-21swapper/119:20:051
24653992710,17cyclictest0-21swapper/119:14:281
24653992710,0cyclictest0-21swapper/120:54:181
24653992710,0cyclictest0-21swapper/119:42:091
24652992710,17cyclictest0-21swapper/021:27:290
24652992710,17cyclictest0-21swapper/020:34:420
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional