You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-11 - 14:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Wed Mar 11, 2026 12:55:08)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
293909974565,465cyclictest0-21swapper/510:59:515
29386997210,42cyclictest0-21swapper/112:37:281
2938599665197,295cyclictest0-21swapper/011:52:570
2938799661107,338cyclictest0-21swapper/211:50:372
29387996426,422cyclictest0-21swapper/211:33:122
29387996426,422cyclictest0-21swapper/211:33:122
2938899632332,127cyclictest4814-21diskmemload11:54:173
293859962833,423cyclictest0-21swapper/010:43:280
293869962673,380cyclictest0-21swapper/112:23:381
2938799624202,257cyclictest20219-21nscd11:16:582
293879962373,126cyclictest0-21swapper/210:43:352
2938699619108,296cyclictest0-21swapper/112:14:401
293859961420,126cyclictest0-21swapper/009:28:450
293909960758,380cyclictest0-21swapper/512:05:125
29388995941,3cyclictest0-21swapper/309:29:333
29386995940,84cyclictest0-21swapper/111:35:001
29386995940,84cyclictest0-21swapper/111:35:001
29392995930,84cyclictest0-21swapper/709:27:357
29389995930,84cyclictest0-21swapper/409:59:444
29389995930,84cyclictest0-21swapper/409:25:284
293889959339,381cyclictest0-21swapper/309:30:493
29390995921,428cyclictest0-21swapper/511:16:585
293859958979,168cyclictest0-21swapper/011:26:590
2938899588124,253cyclictest0-21swapper/309:24:013
29392995858,2cyclictest0-21swapper/711:52:277
2938999583284,126cyclictest0-21swapper/411:34:414
2938999583284,126cyclictest0-21swapper/411:34:414
293929958271,127cyclictest0-21swapper/712:35:527
2939199582325,126cyclictest0-21swapper/612:36:266
2938999581239,126cyclictest6136-21kworker/u16:211:53:554
293889958073,253cyclictest0-21swapper/310:18:543
2938599578112,84cyclictest121rcu_preempt12:22:370
293919957765,295cyclictest0-21swapper/611:11:336
293869957664,126cyclictest0-21swapper/109:26:211
293859957522,126cyclictest0-21swapper/012:05:190
293909957323,126cyclictest0-21swapper/512:24:595
2939299571105,84cyclictest121rcu_preempt12:05:057
293909957019,85cyclictest0-21swapper/511:26:145
2938599565143,253cyclictest0-21swapper/011:11:480
2939299564311,41cyclictest0-21swapper/711:32:047
2939299564311,41cyclictest0-21swapper/711:32:047
2939299561265,127cyclictest0-21swapper/710:43:167
293889955888,296cyclictest0-21swapper/311:08:083
2938899558258,127cyclictest0-21swapper/312:33:003
29391995576,126cyclictest0-21swapper/612:23:386
2938699557131,253cyclictest0-21swapper/109:35:371
29391995567,2cyclictest0-21swapper/611:52:266
29385995556,299cyclictest14667-21ssh09:34:230
2938999554170,254cyclictest0-21swapper/412:25:054
2938699554174,84cyclictest12364-1kworker/u17:111:52:191
2938999551294,127cyclictest0-21swapper/411:55:304
29389995500,84cyclictest0-21swapper/412:39:524
2938999549462,85cyclictest471rcuc/409:13:344
293899954838,507cyclictest0-21swapper/409:33:444
293879954842,84cyclictest121rcu_preempt09:32:412
2938699548166,127cyclictest121rcu_preempt12:34:371
2939299547123,169cyclictest0-21swapper/711:08:257
293909954737,507cyclictest0-21swapper/509:33:435
2938999547290,84cyclictest0-21swapper/411:10:314
293919954678,465cyclictest0-21swapper/609:37:146
293909954681,295cyclictest8076-1kworker/u17:209:15:205
293919954538,256cyclictest25406-21ssh12:32:026
2938699545118,296cyclictest0-21swapper/109:14:591
2939199541284,127cyclictest0-21swapper/612:04:336
293909954070,296cyclictest0-21swapper/511:51:455
293909954033,338cyclictest21211-21/usr/sbin/munin10:45:115
293869954032,126cyclictest0-21swapper/111:08:191
293889953928,338cyclictest0-21swapper/309:13:013
2938899539113,211cyclictest0-21swapper/309:35:053
293879953929,84cyclictest0-21swapper/211:21:222
293879953833,82cyclictest0-21swapper/212:12:002
2938599538454,3cyclictest101ktimersoftd/009:15:160
293859953831,84cyclictest0-21swapper/009:38:430
293859953829,42cyclictest0-21swapper/012:13:050
2938599538159,219cyclictest2238-21nscd11:33:290
2938599538159,219cyclictest2238-21nscd11:33:290
2938899536243,162cyclictest41-21ksoftirqd/311:26:303
2938799536322,84cyclictest0-21swapper/212:03:422
293879953628,126cyclictest121rcu_preempt09:28:552
2938799535109,295cyclictest0-21swapper/209:14:452
293899953463,296cyclictest0-21swapper/412:32:284
293869953428,126cyclictest0-21swapper/111:26:031
2939299533280,41cyclictest0-21swapper/710:34:537
2939199532105,296cyclictest29383-21cyclictest09:32:506
293889953165,126cyclictest0-21swapper/312:14:243
2938699530275,253cyclictest241ktimersoftd/111:17:131
2938599530235,8cyclictest0-21swapper/011:08:140
293919952714,338cyclictest0-21swapper/611:16:376
293909952614,338cyclictest0-21swapper/509:39:305
2938799526227,126cyclictest0-21swapper/209:38:422
293879952556,211cyclictest0-21swapper/211:11:082
2938799525271,84cyclictest7453-1kworker/u17:012:24:272
293869952559,211cyclictest0-21swapper/112:03:241
293859952518,84cyclictest12696-21ssh09:13:350
293889952213,84cyclictest121rcu_preempt10:43:553
293929952114,84cyclictest0-21swapper/710:45:067
293909952114,340cyclictest0-21swapper/509:29:335
293859952113,84cyclictest0-21swapper/011:17:130
293899952012,84cyclictest121rcu_preempt09:35:374
29390995198,126cyclictest0-21swapper/510:19:045
293859951854,3cyclictest27284-21ssh11:22:250
293909951592,381cyclictest0-21swapper/509:24:105
29389995147,84cyclictest0-21swapper/411:17:234
29385995131,84cyclictest0-21swapper/012:35:040
29392995124,2cyclictest0-21swapper/709:34:237
29386995114,256cyclictest0-21swapper/109:34:231
2939199510212,126cyclictest13481-1kworker/u17:211:33:146
2939199510212,126cyclictest13481-1kworker/u17:211:33:146
29392995092,256cyclictest0-21swapper/712:32:017
293879950940,126cyclictest0-21swapper/211:08:082
293859950982,254cyclictest29383-21cyclictest10:45:030
293879950878,381cyclictest0-21swapper/211:27:202
293859950839,41cyclictest121rcu_preempt12:03:070
29387995067,125cyclictest0-21swapper/212:39:282
293889950579,126cyclictest0-21swapper/311:16:083
2938899505121,126cyclictest0-21swapper/312:04:003
2938999504163,338cyclictest18995-21ssh10:42:494
2938699504248,126cyclictest0-21swapper/110:33:491
293889950380,126cyclictest0-21swapper/311:33:073
293889950380,126cyclictest0-21swapper/311:33:073
29386995032,3cyclictest0-21swapper/109:15:161
2939099502160,339cyclictest29383-21cyclictest12:02:225
293869950235,127cyclictest121rcu_preempt10:44:531
2939199500242,85cyclictest0-21swapper/609:26:206
293899949930,86cyclictest0-21swapper/412:03:004
293879949933,126cyclictest21985-21entropy10:45:152
2939299498282,85cyclictest0-21swapper/711:48:497
293899949876,256cyclictest481ktimersoftd/412:24:024
293889949872,295cyclictest0-21swapper/312:05:033
293909949731,84cyclictest0-21swapper/510:44:475
293899949728,84cyclictest0-21swapper/408:49:464
293899949670,253cyclictest0-21swapper/412:05:094
293899949627,338cyclictest0-21swapper/410:59:334
2939299495320,43cyclictest0-21swapper/709:59:587
2939299494411,3cyclictest711rcuc/709:36:337
2939199494110,211cyclictest4814-21diskmemload10:35:086
2939199494110,211cyclictest4814-21diskmemload10:35:086
293899949428,84cyclictest0-21swapper/411:27:214
293869949429,42cyclictest0-21swapper/110:59:461
2938599493112,126cyclictest0-21swapper/012:25:050
293869949226,84cyclictest0-21swapper/111:00:161
293929949169,211cyclictest0-21swapper/711:10:287
293899949126,85cyclictest0-21swapper/411:08:054
293929949068,253cyclictest0-21swapper/712:04:047
293889949021,84cyclictest0-21swapper/311:35:093
293879949026,299cyclictest0-21swapper/212:32:022
293909948916,84cyclictest0-21swapper/512:40:075
293879948722,301cyclictest0-21swapper/209:15:152
293859948717,126cyclictest0-21swapper/011:35:100
2939299486228,87cyclictest0-21swapper/712:24:297
293909948622,84cyclictest0-21swapper/512:14:075
293909948622,295cyclictest0-21swapper/511:32:045
293909948622,295cyclictest0-21swapper/511:32:045
2938599486191,126cyclictest13250-21ssh11:49:570
293899948521,42cyclictest0-21swapper/412:14:234
293889948520,84cyclictest0-21swapper/312:38:003
293869948521,47cyclictest121rcu_preempt11:49:011
293919948418,90cyclictest0-21swapper/612:14:176
2938599483141,211cyclictest0-21swapper/010:34:300
293909948295,253cyclictest0-21swapper/512:35:505
293909948116,126cyclictest0-21swapper/511:21:345
293929947914,44cyclictest17178-21cpuspeed_turbos11:35:117
293909947849,126cyclictest0-21swapper/511:11:075
293899947810,295cyclictest0-21swapper/411:21:234
2938899477304,126cyclictest0-21swapper/311:49:013
293869947711,126cyclictest0-21swapper/112:05:031
293919947612,3cyclictest0-21swapper/609:15:166
293919947610,84cyclictest0-21swapper/610:43:406
293879947610,126cyclictest0-21swapper/209:24:242
293859947611,254cyclictest0-21swapper/012:32:290
2938899475227,42cyclictest0-21swapper/310:45:073
29386994759,84cyclictest0-21swapper/109:24:571
293869946845,126cyclictest0-21swapper/111:22:041
2938899467125,339cyclictest0-21swapper/309:58:593
2938799467125,84cyclictest0-21swapper/210:35:082
2938799467125,84cyclictest0-21swapper/210:35:082
29387994671,126cyclictest26279-21ntp_states12:15:202
2938999466124,127cyclictest49-21ksoftirqd/410:34:304
293859946686,82cyclictest121rcu_preempt11:00:000
293909946581,126cyclictest0-21swapper/511:09:485
2938899465294,84cyclictest0-21swapper/310:32:493
2939299464121,211cyclictest17084-21ssh10:59:267
2938999463125,84cyclictest121rcu_preempt12:40:054
293919946278,127cyclictest29383-21cyclictest11:08:456
2938999462246,84cyclictest0-21swapper/409:23:434
293869946240,3cyclictest0-21swapper/110:45:041
29392994619,2cyclictest0-21swapper/709:15:167
293919946139,256cyclictest0-21swapper/609:24:106
2938899461120,338cyclictest0-21swapper/312:22:143
2938899461120,338cyclictest0-21swapper/311:10:203
293919946076,211cyclictest0-21swapper/611:49:546
2939099460204,126cyclictest25304-21ssh12:31:565
293889946074,211cyclictest0-21swapper/310:59:453
293869946038,338cyclictest0-21swapper/110:19:301
2938599460157,176cyclictest631-21ptp4l11:55:280
293909945874,211cyclictest23292-21/usr/sbin/munin11:55:285
293879945835,126cyclictest0-21swapper/210:34:062
293889945735,41cyclictest0-21swapper/312:15:203
293869945774,213cyclictest121rcu_preempt09:59:081
293869945730,296cyclictest0-21swapper/111:55:111
293899945574,84cyclictest0-21swapper/411:49:154
293859945432,256cyclictest0-21swapper/009:24:100
2939299453110,340cyclictest0-21swapper/709:24:267
293879945329,84cyclictest0-21swapper/209:58:412
293929945268,211cyclictest0-21swapper/711:26:047
2939299451108,169cyclictest0-21swapper/712:12:167
2939199451110,338cyclictest6497-21cpuspeed_turbos12:05:146
293899945172,211cyclictest0-21swapper/411:35:174
293899945027,42cyclictest0-21swapper/410:19:054
2939199449196,7cyclictest0-21swapper/611:21:306
293929944865,126cyclictest0-21swapper/711:55:337
2939099448106,211cyclictest19382-21idleruntime11:00:165
293899944868,211cyclictest0-21swapper/410:00:034
293889944824,256cyclictest0-21swapper/309:15:043
293879944820,296cyclictest0-21swapper/211:00:162
2939299447106,338cyclictest0-21swapper/711:16:307
2938799446106,338cyclictest29383-21cyclictest12:05:032
293869944625,337cyclictest0-21swapper/111:11:001
293919944521,133cyclictest2442-21munin-run10:35:016
293909944563,338cyclictest0-21swapper/510:35:015
293889944421,257cyclictest0-21swapper/310:35:173
293889944421,257cyclictest0-21swapper/310:35:173
293879944421,211cyclictest0-21swapper/211:49:462
293899944321,84cyclictest29383-21cyclictest11:00:164
293869944220,256cyclictest0-21swapper/112:40:111
293879944117,126cyclictest10472-21ssh12:25:052
293859944119,84cyclictest0-21swapper/011:00:050
293879944012,296cyclictest0-21swapper/210:59:252
293929943916,84cyclictest0-21swapper/711:00:057
293909943917,2cyclictest0-21swapper/510:35:175
293909943917,2cyclictest0-21swapper/510:35:175
2939199437139,125cyclictest121rcu_preempt10:59:596
293929943613,256cyclictest0-21swapper/711:22:257
293889943651,211cyclictest41-21ksoftirqd/310:00:073
293929943354,295cyclictest0-21swapper/709:13:577
293909943311,2cyclictest0-21swapper/509:14:045
2938799432134,126cyclictest121rcu_preempt11:55:312
293859942947,127cyclictest0-21swapper/008:49:060
29388994284,84cyclictest0-21swapper/311:00:083
29386994275,3cyclictest0-21swapper/110:35:241
29386994275,3cyclictest0-21swapper/110:35:241
29391994264,7cyclictest0-21swapper/609:14:586
293929942483,338cyclictest0-21swapper/712:40:187
293889942440,295cyclictest0-21swapper/311:22:183
293919942382,338cyclictest0-21swapper/609:59:106
29391994235,204cyclictest0-21swapper/612:15:186
29390994231,338cyclictest19443-21kworker/5:209:59:515
29390994231,256cyclictest16925-21ssh11:35:105
293899942382,338cyclictest68350irq/122-eth010:35:084
293899942382,338cyclictest68350irq/122-eth010:35:074
293869942382,338cyclictest0-21swapper/108:48:241
293919942241,297cyclictest0-21swapper/612:25:066
2938599422124,126cyclictest9-21ksoftirqd/012:15:200
293879942180,338cyclictest0-21swapper/208:48:242
293919942080,338cyclictest0-21swapper/611:26:026
293909942041,295cyclictest0-21swapper/511:49:015
2938999420247,84cyclictest0-21swapper/410:45:084
293869942040,48cyclictest18386-21ssh11:35:171
293859942080,338cyclictest0-21swapper/009:58:420
293889941934,211cyclictest41-21ksoftirqd/312:25:063
2939299418118,297cyclictest0-21swapper/708:50:097
293919941776,338cyclictest0-21swapper/611:00:156
293909941734,380cyclictest0-21swapper/512:15:185
293899941779,84cyclictest0-21swapper/409:15:154
293869941734,126cyclictest0-21swapper/110:00:121
293919941633,211cyclictest65-21ksoftirqd/610:45:126
293919941332,42cyclictest0-21swapper/612:40:176
293889941372,338cyclictest0-21swapper/311:55:123
293879941333,84cyclictest0-21swapper/210:00:042
293899941233,7cyclictest121rcu_preempt12:15:024
293909941170,338cyclictest0-21swapper/510:00:035
293919941031,42cyclictest0-21swapper/610:19:316
293879940968,338cyclictest0-21swapper/210:18:522
293879940926,253cyclictest0-21swapper/211:35:162
293869940968,338cyclictest26284-21ssh12:15:201
2938899407193,84cyclictest2972-21grep12:40:153
2938599407193,84cyclictest0-21swapper/010:18:520
293909940626,296cyclictest0-21swapper/512:25:065
293909940525,295cyclictest0-21swapper/508:49:055
293889940565,338cyclictest0-21swapper/308:48:243
293859940219,126cyclictest4263-21irqstats10:35:170
293859940219,126cyclictest4263-21irqstats10:35:170
2939299400144,90cyclictest121rcu_preempt10:18:527
293869940015,127cyclictest0-21swapper/112:25:061
2939299396182,83cyclictest0-21swapper/708:48:207
293919939555,338cyclictest22035-21ssh11:55:196
29387993888,296cyclictest0-21swapper/212:40:182
293859937839,48cyclictest0-21swapper/012:40:060
293919937433,338cyclictest0-21swapper/608:49:206
29385993731,118cyclictest0-21swapper/010:00:050
2938999364108,253cyclictest0-21swapper/409:40:044
293879936423,338cyclictest0-21swapper/209:40:042
293929935817,338cyclictest0-21swapper/712:15:207
2939299356101,253cyclictest0-21swapper/712:25:057
293919935616,84cyclictest0-21swapper/610:00:056
293889935617,84cyclictest0-21swapper/309:40:033
293879935312,126cyclictest0-21swapper/208:50:032
293869935317,133cyclictest0-21swapper/109:40:021
29391993464,339cyclictest0-21swapper/611:35:166
29390993454,338cyclictest0-21swapper/509:40:045
29392993441,84cyclictest0-21swapper/710:00:057
293929933640,171cyclictest0-21swapper/710:35:177
293929933640,171cyclictest0-21swapper/710:35:177
293869933235,169cyclictest121rcu_preempt08:50:071
293859933175,126cyclictest0-21swapper/008:50:100
293899933031,128cyclictest0-21swapper/408:50:094
2938899330204,43cyclictest29383-21cyclictest08:50:073
293909932934,211cyclictest0-21swapper/508:50:095
2939199325200,41cyclictest641ktimersoftd/608:50:036
293929931823,41cyclictest0-21swapper/709:40:037
293919931660,254cyclictest0-21swapper/609:40:046
2938599299126,43cyclictest121rcu_preempt09:40:040
369321140,1sleep50-21swapper/509:05:205
2675929995,2sleep60-21swapper/607:05:146
2889928655,28sleep30-21swapper/307:09:113
2864728342,36sleep40-21swapper/407:05:354
2873328251,27sleep70-21swapper/707:06:517
2628828250,28sleep20-21swapper/207:05:012
2885128150,27sleep10-21swapper/107:08:291
2874028049,27sleep50-21swapper/507:06:575
2882127846,28sleep00-21swapper/007:08:030
48562760,1sleep30-21swapper/309:46:083
22682730,0sleep60-21swapper/610:51:076
276452720,0sleep70-21swapper/707:59:597
2939099551,2cyclictest0-21swapper/510:20:025
2895824744,1sleep40-21swapper/407:10:014
2938999351,31cyclictest0-21swapper/410:20:044
2938799351,2cyclictest0-21swapper/210:20:012
29390993410,23cyclictest0-21swapper/508:39:085
29390993310,17cyclictest0-21swapper/507:53:135
29392993223,6cyclictest7633-21head10:20:167
29390993226,5cyclictest0-21swapper/507:18:075
29390993210,22cyclictest0-21swapper/508:29:045
29390993210,0cyclictest0-21swapper/508:33:415
29388993222,6cyclictest7196-21df10:20:133
29390993126,4cyclictest0-21swapper/510:11:515
29390993110,0cyclictest0-21swapper/508:24:325
29390993110,0cyclictest0-21swapper/507:45:565
29390993027,3cyclictest0-21swapper/510:28:185
29390993010,19cyclictest0-21swapper/508:01:385
29391992923,4cyclictest7958-21cat10:20:196
29388992910,18cyclictest0-21swapper/310:28:183
29388992910,18cyclictest0-21swapper/310:11:573
29388992910,18cyclictest0-21swapper/309:03:313
29388992910,18cyclictest0-21swapper/308:33:583
29388992910,18cyclictest0-21swapper/308:14:343
29388992910,18cyclictest0-21swapper/307:38:093
29388992910,18cyclictest0-21swapper/307:25:133
29385992921,4cyclictest6940-21expr10:20:120
29385992910,18cyclictest0-21swapper/010:28:520
29392992810,18cyclictest0-21swapper/710:28:247
29392992810,18cyclictest0-21swapper/708:39:477
29392992810,18cyclictest0-21swapper/708:24:067
29392992810,18cyclictest0-21swapper/708:05:347
29392992810,18cyclictest0-21swapper/707:25:177
29392992810,0cyclictest0-21swapper/709:03:587
29392992810,0cyclictest0-21swapper/707:42:347
29392992810,0cyclictest0-21swapper/707:42:347
29390992810,17cyclictest0-21swapper/509:51:305
29388992827,1cyclictest0-21swapper/309:51:123
29388992827,0cyclictest0-21swapper/308:05:253
29388992810,18cyclictest0-21swapper/308:24:033
29388992810,18cyclictest0-21swapper/308:19:153
29388992810,18cyclictest0-21swapper/307:49:403
29388992810,17cyclictest0-21swapper/307:42:043
29388992810,17cyclictest0-21swapper/307:42:033
29388992810,17cyclictest0-21swapper/307:15:073
29388992810,0cyclictest0-21swapper/308:01:443
29388992810,0cyclictest0-21swapper/307:21:363
29388992810,0cyclictest0-21swapper/307:14:563
29387992828,0cyclictest0-21swapper/210:11:302
29387992810,18cyclictest0-21swapper/208:28:322
29387992810,0cyclictest0-21swapper/210:28:582
29387992810,0cyclictest0-21swapper/208:58:392
29387992810,0cyclictest0-21swapper/207:14:492
29386992821,4cyclictest6699-21ssh10:20:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional