You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 18:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Jul 14, 2026 12:56:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119369978866,719cyclictest0-21swapper/608:42:116
119369978566,84cyclictest7325-21sh11:09:306
1193699735225,507cyclictest641ktimersoftd/612:23:456
1193399721125,381cyclictest0-21swapper/310:17:373
119349969415,676cyclictest0-21swapper/411:23:514
119379966569,380cyclictest0-21swapper/711:33:007
119319966370,126cyclictest0-21swapper/112:13:401
1193399655190,126cyclictest121rcu_preempt11:24:363
119319965459,338cyclictest121rcu_preempt12:25:501
119329965116,83cyclictest0-21swapper/212:29:092
119369964859,545cyclictest0-21swapper/609:30:386
1193399648140,126cyclictest121rcu_preempt11:43:273
119369964794,341cyclictest0-21swapper/612:28:066
11936996341,630cyclictest0-21swapper/610:06:056
1193299634123,296cyclictest0-21swapper/211:57:192
119309963236,387cyclictest0-21swapper/010:02:530
119369962934,507cyclictest0-21swapper/607:40:426
119349962976,295cyclictest49-21ksoftirqd/410:30:344
119319962836,422cyclictest0-21swapper/110:07:161
119309962833,381cyclictest698-21ptp4l12:25:500
1193299626115,338cyclictest0-21swapper/210:20:162
119369962427,422cyclictest0-21swapper/610:17:056
1193499624116,126cyclictest0-21swapper/410:01:454
1193699623113,507cyclictest0-21swapper/611:57:196
1193599623279,127cyclictest0-21swapper/512:27:425
1193199623112,380cyclictest0-21swapper/111:07:311
119369962126,592cyclictest0-21swapper/611:48:546
1193299621195,296cyclictest0-21swapper/212:21:102
119329962071,126cyclictest121rcu_preempt11:32:122
1193499618110,126cyclictest0-21swapper/411:33:574
1193099617153,84cyclictest121rcu_preempt11:42:220
119359961625,338cyclictest12176-21ssh09:21:455
119369961060,547cyclictest0-21swapper/609:28:156
119379960916,126cyclictest11928-21cyclictest08:12:047
119359960816,419cyclictest0-21swapper/509:25:455
11936996037,127cyclictest0-21swapper/611:43:556
119349960351,380cyclictest0-21swapper/410:09:104
11936995971,507cyclictest0-21swapper/610:37:406
11936995971,507cyclictest0-21swapper/610:37:406
119319959684,339cyclictest131rcu_sched09:29:551
11932995940,84cyclictest0-21swapper/211:24:052
11937995930,83cyclictest0-21swapper/711:58:297
11930995932,3cyclictest0-21swapper/009:30:000
11934995920,84cyclictest0-21swapper/411:42:454
1193299588124,84cyclictest121rcu_preempt10:16:512
119309958833,127cyclictest0-21swapper/010:36:270
119309958833,127cyclictest0-21swapper/010:36:270
119349958777,380cyclictest0-21swapper/412:42:414
1193599586159,338cyclictest11928-21cyclictest10:02:155
1193499585202,211cyclictest19928-21diskmemload09:24:104
119329958476,126cyclictest121rcu_preempt10:03:142
119369958233,126cyclictest0-21swapper/610:27:416
119329958231,126cyclictest0-21swapper/209:26:062
1193299580114,211cyclictest0-21swapper/211:45:422
119309958071,507cyclictest0-21swapper/010:30:340
119329957968,211cyclictest33-21ksoftirqd/211:09:262
1193099579111,380cyclictest121rcu_preempt10:09:380
1193199577151,253cyclictest0-21swapper/111:57:121
119369957626,42cyclictest0-21swapper/609:10:196
119349957667,126cyclictest10181-21systemctl11:10:304
119369957425,127cyclictest0-21swapper/610:03:166
1193199574108,211cyclictest0-21swapper/109:53:511
119309957216,127cyclictest0-21swapper/011:06:570
119319956920,381cyclictest0-21swapper/111:35:091
1193499568482,84cyclictest481ktimersoftd/408:45:184
119329956860,211cyclictest0-21swapper/209:22:012
119329956714,296cyclictest0-21swapper/209:10:202
1193699566226,338cyclictest19410-21kworker/u16:009:22:356
1193499566226,338cyclictest64450irq/122-eth012:23:534
119339956615,84cyclictest0-21swapper/311:57:133
119329956251,338cyclictest25598-21nscd09:54:132
119379956112,382cyclictest0-21swapper/708:43:497
119319956049,380cyclictest0-21swapper/111:42:201
11936995566,514cyclictest0-21swapper/612:44:146
119309955647,126cyclictest0-21swapper/008:44:150
119319955446,84cyclictest121rcu_preempt10:36:371
119319955446,84cyclictest121rcu_preempt10:36:371
1193399553210,211cyclictest28860-1kworker/u17:110:28:243
119319955244,126cyclictest0-21swapper/110:16:211
11931995523,84cyclictest0-21swapper/111:25:031
119369955182,296cyclictest0-21swapper/611:32:156
1193699551125,423cyclictest19928-21diskmemload09:55:066
1193799549122,295cyclictest0-21swapper/710:16:227
119339954982,211cyclictest0-21swapper/310:06:303
119379954878,254cyclictest0-21swapper/711:44:237
119359954836,296cyclictest0-21swapper/511:22:355
119329954778,211cyclictest0-21swapper/207:45:132
119329954778,211cyclictest0-21swapper/207:45:122
1193199546123,380cyclictest0-21swapper/111:45:491
119369954534,127cyclictest0-21swapper/611:10:526
1193599545118,423cyclictest0-21swapper/510:09:475
1193499545120,338cyclictest0-21swapper/410:29:344
119319954433,296cyclictest0-21swapper/110:04:221
119349954335,84cyclictest0-21swapper/409:10:164
1193099543117,127cyclictest9-21ksoftirqd/009:54:470
119349954277,126cyclictest121rcu_preempt08:40:414
1193399542115,253cyclictest0-21swapper/309:25:313
1193599541161,84cyclictest32335-1kworker/u17:011:50:205
119339954132,127cyclictest0-21swapper/311:08:273
1193099541115,340cyclictest0-21swapper/010:16:040
119309954032,127cyclictest698-21ptp4l11:23:370
119369953828,126cyclictest0-21swapper/608:11:406
119329953870,380cyclictest32744-21cstates10:30:152
1193599537115,338cyclictest0-21swapper/511:42:275
119349953769,465cyclictest11928-21cyclictest11:50:314
119339953767,296cyclictest0-21swapper/310:01:453
119319953726,422cyclictest0-21swapper/109:23:451
1193599535151,126cyclictest121rcu_preempt11:10:195
119309953572,126cyclictest0-21swapper/011:50:190
119379953468,84cyclictest0-21swapper/712:28:467
119379953366,464cyclictest0-21swapper/712:13:017
119369953225,338cyclictest0-21swapper/612:14:186
119309953264,338cyclictest121rcu_preempt11:59:240
1193599530148,380cyclictest20326-21ssh11:57:195
1193399530103,296cyclictest0-21swapper/309:54:133
119329953061,295cyclictest0-21swapper/211:43:272
119379952958,380cyclictest0-21swapper/711:23:137
119369952918,508cyclictest0-21swapper/611:25:036
119329952921,84cyclictest0-21swapper/212:13:162
119379952816,296cyclictest0-21swapper/709:26:557
119329952859,210cyclictest33-21ksoftirqd/211:13:512
119319952716,338cyclictest0-21swapper/109:55:111
119359952620,84cyclictest0-21swapper/509:54:305
119309952658,465cyclictest0-21swapper/012:23:120
1193599525102,126cyclictest0-21swapper/511:33:485
119349952513,338cyclictest0-21swapper/408:13:374
119329952517,126cyclictest0-21swapper/210:27:172
119339952413,508cyclictest24642-21kworker/u16:312:30:013
119369952313,507cyclictest0-21swapper/611:50:116
1193499523185,83cyclictest64450irq/122-eth010:18:084
119319952315,126cyclictest0-21swapper/111:33:011
1193199522267,253cyclictest21152-21expr09:10:121
119309952115,253cyclictest19928-21diskmemload11:45:300
1193499520180,338cyclictest64450irq/122-eth010:40:244
119339951953,126cyclictest0-21swapper/312:21:183
11930995157,126cyclictest0-21swapper/011:10:490
11932995121,126cyclictest0-21swapper/207:43:522
119349951142,338cyclictest0-21swapper/409:54:044
11931995111,380cyclictest0-21swapper/110:30:021
11937995100,85cyclictest8715-21users09:55:417
119359951046,295cyclictest0-21swapper/511:08:025
11937995090,84cyclictest0-21swapper/708:15:057
119339950982,211cyclictest41-21ksoftirqd/311:45:093
119339950982,211cyclictest41-21ksoftirqd/308:11:113
11932995090,84cyclictest0-21swapper/210:07:162
1193799508170,167cyclictest121rcu_preempt10:40:077
1193599508252,253cyclictest561ktimersoftd/512:21:345
119379950783,84cyclictest0-21swapper/710:20:277
1193799507166,339cyclictest11928-21cyclictest10:37:497
1193799507166,339cyclictest11928-21cyclictest10:37:497
119359950676,126cyclictest0-21swapper/510:37:415
119359950676,126cyclictest0-21swapper/510:37:415
119339950680,254cyclictest121rcu_preempt07:42:363
119379950579,423cyclictest0-21swapper/711:07:247
1193599504420,4cyclictest551rcuc/507:41:435
119349950482,253cyclictest0-21swapper/411:58:324
119339950482,338cyclictest0-21swapper/310:36:373
119339950482,338cyclictest0-21swapper/310:36:373
119329950438,211cyclictest121rcu_preempt12:43:092
119309950438,211cyclictest23482-21ntpq09:30:340
119349950379,387cyclictest0-21swapper/408:15:164
1193599502119,380cyclictest1553-21runrttasks08:12:235
1193399501202,126cyclictest121rcu_preempt11:32:123
1193199501119,126cyclictest0-21swapper/112:43:321
119349950034,169cyclictest0-21swapper/410:20:054
1193399500120,296cyclictest19928-21diskmemload12:43:193
119309950034,126cyclictest0-21swapper/010:26:310
1193499499159,337cyclictest64450irq/122-eth009:25:584
1193399499118,126cyclictest121rcu_preempt09:55:333
119309949932,338cyclictest0-21swapper/008:14:000
119379949832,211cyclictest0-21swapper/712:44:137
119349949834,170cyclictest0-21swapper/411:46:054
119319949831,464cyclictest0-21swapper/111:12:501
119379949774,84cyclictest0-21swapper/709:21:117
119309949731,84cyclictest0-21swapper/012:42:410
119319949630,84cyclictest0-21swapper/112:21:101
119309949671,210cyclictest0-21swapper/009:10:260
1193799495109,254cyclictest0-21swapper/710:05:147
1193699495111,253cyclictest0-21swapper/611:25:216
1193399495156,84cyclictest28860-1kworker/u17:110:20:253
119379949472,380cyclictest0-21swapper/711:45:437
119329949428,84cyclictest0-21swapper/210:36:092
119329949428,84cyclictest0-21swapper/210:36:092
1193299494198,84cyclictest0-21swapper/208:14:112
119319949468,126cyclictest25-21ksoftirqd/110:29:161
1193599493109,212cyclictest0-21swapper/508:44:255
119319949227,298cyclictest0-21swapper/107:40:211
119359949126,211cyclictest0-21swapper/510:20:155
119379949068,296cyclictest10853-1kworker/7:0H10:29:367
119359949026,334cyclictest19928-21diskmemload11:48:395
119339949066,339cyclictest0-21swapper/312:11:463
1193099490109,126cyclictest121rcu_preempt09:23:580
119379948921,465cyclictest0-21swapper/712:23:467
1193499489104,296cyclictest0-21swapper/411:07:584
119369948819,466cyclictest0-21swapper/608:45:176
119369948718,466cyclictest0-21swapper/609:54:136
119349948764,338cyclictest0-21swapper/409:30:384
119349948519,126cyclictest1651-21ntpd12:27:564
119339948419,127cyclictest0-21swapper/311:11:433
119309948461,126cyclictest9-21ksoftirqd/007:40:290
119379948315,465cyclictest0-21swapper/709:10:127
119359948318,42cyclictest121rcu_preempt09:10:295
119309948115,126cyclictest0-21swapper/011:33:560
1193099478180,126cyclictest121rcu_preempt12:11:370
119349947799,294cyclictest0-21swapper/407:45:134
119349947799,294cyclictest0-21swapper/407:45:124
119379947553,84cyclictest0-21swapper/710:04:527
119379947491,175cyclictest12021-21seq11:12:387
11935994727,338cyclictest0-21swapper/512:14:145
119379947186,296cyclictest0-21swapper/708:33:187
1193199467126,338cyclictest29846-21taskset10:10:051
11930994672,84cyclictest0-21swapper/011:25:190
1193199465125,338cyclictest0-21swapper/108:12:221
119379946480,381cyclictest1728-21ntp_states10:30:347
119359946441,126cyclictest0-21swapper/510:30:335
1193599464124,338cyclictest0-21swapper/510:28:185
1193399464121,84cyclictest41-21ksoftirqd/309:30:213
1193199464123,338cyclictest0-21swapper/112:30:071
119369946380,381cyclictest0-21swapper/610:30:346
1193699463121,127cyclictest0-21swapper/610:10:146
119359946341,256cyclictest0-21swapper/510:16:215
1193599463123,84cyclictest0-21swapper/512:42:495
1193599463122,338cyclictest698-21ptp4l11:25:285
1193499463124,337cyclictest0-21swapper/410:39:124
1193499463124,337cyclictest0-21swapper/410:39:124
1193199463124,84cyclictest0-21swapper/110:40:241
119339946278,381cyclictest0-21swapper/312:30:073
1193199462123,337cyclictest0-21swapper/108:44:151
1193099462119,340cyclictest0-21swapper/010:10:030
119339946135,423cyclictest0-21swapper/310:30:243
119339946133,338cyclictest0-21swapper/309:22:193
1193299461416,42cyclictest311rcuc/208:45:152
1193099460162,126cyclictest121rcu_preempt12:30:080
1193099460119,338cyclictest0-21swapper/008:45:180
1193599459116,340cyclictest0-21swapper/512:30:075
119339945936,256cyclictest0-21swapper/308:40:263
1193599458117,338cyclictest0-21swapper/509:55:265
1193499458118,338cyclictest0-21swapper/412:11:464
1193099458118,338cyclictest0-21swapper/009:55:340
119379945776,83cyclictest0-21swapper/709:53:517
1193499457117,338cyclictest8091-21gunzip09:55:314
1193399457117,338cyclictest0-21swapper/309:10:173
1193199457115,211cyclictest0-21swapper/109:30:171
1193499456117,337cyclictest0-21swapper/407:43:144
1193299456370,84cyclictest4188-21/usr/sbin/munin08:40:212
1193399455115,338cyclictest0-21swapper/311:35:093
1193199455115,338cyclictest0-21swapper/111:50:181
1193599454116,84cyclictest0-21swapper/508:55:195
119309945326,296cyclictest0-21swapper/010:40:400
1193499452110,339cyclictest0-21swapper/410:10:044
1193199452112,338cyclictest0-21swapper/107:45:101
1193199452112,338cyclictest0-21swapper/107:45:101
1193799451112,84cyclictest15850irq/123-ahci[0007:44:487
119329945167,211cyclictest0-21swapper/209:30:222
119379945066,211cyclictest0-21swapper/707:45:107
119379945066,211cyclictest0-21swapper/707:45:107
119369944964,211cyclictest0-21swapper/610:40:096
119309944826,256cyclictest0-21swapper/008:55:200
119379944724,339cyclictest0-21swapper/708:45:157
119369944721,126cyclictest2981-21ls07:45:226
119369944721,126cyclictest2981-21ls07:45:226
1193599446106,337cyclictest0-21swapper/507:45:105
1193599446106,337cyclictest0-21swapper/507:45:095
1193299446104,168cyclictest0-21swapper/209:55:372
119319944519,338cyclictest0-21swapper/111:25:191
119369944321,338cyclictest0-21swapper/610:20:256
119319944224,203cyclictest0-21swapper/108:45:171
119369943816,295cyclictest0-21swapper/612:15:146
1193599437138,126cyclictest121rcu_preempt08:45:185
119359943656,338cyclictest0-21swapper/508:15:165
119359943512,169cyclictest0-21swapper/509:30:335
119369943495,84cyclictest704-21nscd11:35:096
119359943211,255cyclictest0-21swapper/510:40:075
1193199431136,84cyclictest19180-21kworker/1:208:15:071
11930994286,84cyclictest0-21swapper/007:45:160
11930994286,84cyclictest0-21swapper/007:45:160
11933994271,211cyclictest41-21ksoftirqd/308:45:033
119339942642,381cyclictest0-21swapper/311:50:123
119379942544,256cyclictest0-21swapper/711:50:307
119379942483,338cyclictest0-21swapper/711:35:077
119359942483,338cyclictest0-21swapper/508:33:195
119369942382,338cyclictest0-21swapper/608:15:156
119379942282,338cyclictest0-21swapper/709:30:387
119339942282,338cyclictest0-21swapper/308:15:173
119339942280,339cyclictest0-21swapper/310:10:043
119319942278,341cyclictest0-21swapper/108:55:161
119379942182,84cyclictest0-21swapper/710:10:057
119369942181,338cyclictest0-21swapper/608:55:176
119309942176,253cyclictest0-21swapper/008:15:160
119339942080,338cyclictest0-21swapper/310:40:263
119309942080,338cyclictest0-21swapper/010:20:270
119319941939,217cyclictest0-21swapper/110:20:191
119339941877,338cyclictest0-21swapper/311:25:213
119359941776,338cyclictest0-21swapper/510:10:055
119349941777,338cyclictest0-21swapper/408:55:164
119309941733,169cyclictest19188-21ssh12:15:160
119329941678,84cyclictest0-21swapper/211:50:202
119329941678,84cyclictest0-21swapper/210:10:052
119379941574,338cyclictest0-21swapper/712:30:087
119369941535,297cyclictest32704-21kworker/u16:208:00:386
119349941575,338cyclictest64450irq/122-eth011:25:144
119339941575,338cyclictest0-21swapper/307:45:093
119339941575,338cyclictest0-21swapper/307:45:093
119329941531,255cyclictest0-21swapper/210:40:262
119369941473,338cyclictest0-21swapper/612:30:066
119349941475,337cyclictest0-21swapper/412:30:124
119379941372,338cyclictest0-21swapper/708:55:177
119379941131,296cyclictest0-21swapper/708:00:387
119329941169,211cyclictest0-21swapper/211:35:132
119329940668,83cyclictest0-21swapper/208:15:162
119339940464,338cyclictest0-21swapper/308:55:163
119349940263,337cyclictest0-21swapper/412:15:164
119339940259,340cyclictest0-21swapper/312:15:163
119329940220,84cyclictest0-21swapper/208:33:182
119309940220,127cyclictest0-21swapper/007:14:080
119379939818,296cyclictest0-21swapper/711:25:207
119329939611,211cyclictest1750-21ls11:25:282
119309939151,338cyclictest0-21swapper/011:35:100
119329939051,84cyclictest0-21swapper/212:15:152
119359938687,126cyclictest57-21ksoftirqd/512:15:155
119349937839,296cyclictest0-21swapper/411:35:094
119359937332,338cyclictest0-21swapper/511:35:085
119369937232,338cyclictest0-21swapper/608:33:186
119329936522,84cyclictest12288-21cut08:55:162
119379935458,84cyclictest19196-21fschecks_count12:15:167
119319935498,253cyclictest0-21swapper/112:15:151
11931993421,338cyclictest0-21swapper/108:33:191
119309932872,254cyclictest0-21swapper/008:33:190
119339932770,254cyclictest0-21swapper/308:33:193
119329932672,84cyclictest0-21swapper/212:30:112
119349932479,36cyclictest0-21swapper/408:33:204
1193499309103,124cyclictest0-21swapper/407:14:084
11932993022,126cyclictest0-21swapper/208:00:382
11932992991,126cyclictest0-21swapper/207:14:072
119319929638,128cyclictest25-21ksoftirqd/107:14:071
11935992933,3cyclictest0-21swapper/508:00:375
119349929340,42cyclictest0-21swapper/408:00:364
119309929135,41cyclictest121rcu_preempt08:00:380
119359928979,129cyclictest0-21swapper/507:14:085
119339928878,129cyclictest11928-21cyclictest08:00:373
119379928432,85cyclictest73-21ksoftirqd/707:14:087
119319928438,164cyclictest0-21swapper/108:00:381
1193399283109,84cyclictest121rcu_preempt07:14:073
119369925140,129cyclictest0-21swapper/607:14:086
1146629047,27sleep70-21swapper/707:09:317
1146228352,28sleep30-21swapper/307:09:263
1133728352,27sleep20-21swapper/207:07:402
1143528251,27sleep50-21swapper/507:09:055
1131728252,27sleep00-21swapper/007:07:230
1139828170,8sleep40-21swapper/407:08:304
1131828050,27sleep10-21swapper/107:07:241
1128528048,28sleep60-21swapper/607:06:576
21102710,1sleep10-21swapper/109:35:481
11936993427,6cyclictest0-21swapper/607:26:566
11936993310,22cyclictest0-21swapper/607:21:176
11936993310,22cyclictest0-21swapper/607:21:176
11936993226,5cyclictest0-21swapper/610:56:436
11937993110,20cyclictest0-21swapper/707:33:277
11937993010,19cyclictest0-21swapper/708:39:587
11936993025,4cyclictest0-21swapper/607:51:126
11937992927,2cyclictest0-21swapper/710:56:407
11937992910,18cyclictest0-21swapper/709:17:467
11937992910,18cyclictest0-21swapper/709:17:467
11937992910,18cyclictest0-21swapper/709:02:257
11935992911,1cyclictest11928-21cyclictest10:56:315
11930992910,18cyclictest0-21swapper/010:56:300
11930992910,18cyclictest0-21swapper/009:17:400
11930992910,18cyclictest0-21swapper/009:17:400
11930992910,18cyclictest0-21swapper/007:51:300
11930992910,18cyclictest0-21swapper/007:26:390
11930992910,18cyclictest0-21swapper/007:21:250
11930992910,18cyclictest0-21swapper/007:21:240
11937992810,18cyclictest0-21swapper/708:24:057
11937992810,18cyclictest0-21swapper/707:26:587
11937992810,0cyclictest0-21swapper/707:20:547
11937992810,0cyclictest0-21swapper/707:20:537
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional