You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 18:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Jul 30, 2026 12:55:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
266449983167,761cyclictest0-21swapper/212:37:062
266449978159,719cyclictest0-21swapper/209:49:252
266449976584,550cyclictest121rcu_preempt10:30:332
266469975273,676cyclictest0-21swapper/412:23:214
266469975273,676cyclictest0-21swapper/412:23:214
266449973715,719cyclictest0-21swapper/211:31:392
266449972182,84cyclictest0-21swapper/210:08:512
266449971375,635cyclictest0-21swapper/211:41:152
266449971375,635cyclictest0-21swapper/211:41:152
266449971030,677cyclictest0-21swapper/209:25:272
2664299708113,380cyclictest0-21swapper/012:20:520
2664299708113,380cyclictest0-21swapper/012:20:520
266449969457,380cyclictest0-21swapper/212:07:162
266449969315,642cyclictest0-21swapper/211:36:542
26644996878,168cyclictest0-21swapper/209:35:452
2664699678124,424cyclictest0-21swapper/412:16:334
26642996780,84cyclictest0-21swapper/009:40:010
266449967783,592cyclictest0-21swapper/211:24:502
2664399675334,126cyclictest0-21swapper/111:42:031
2664399675334,126cyclictest0-21swapper/111:42:031
266489966831,126cyclictest0-21swapper/611:57:356
2664499661110,126cyclictest0-21swapper/212:16:332
266449965721,127cyclictest0-21swapper/209:30:152
266449965721,127cyclictest0-21swapper/209:30:152
2664299656570,84cyclictest111rcuc/010:11:260
2664899653567,84cyclictest631rcuc/611:31:226
266429965116,126cyclictest0-21swapper/009:22:300
26642996360,84cyclictest0-21swapper/009:49:250
266449963341,428cyclictest0-21swapper/209:22:522
2664899628287,338cyclictest1841-21diskmemload12:37:356
2664299628116,296cyclictest0-21swapper/012:38:310
266449962172,253cyclictest121rcu_preempt12:25:042
266449962172,253cyclictest121rcu_preempt12:25:042
266469962067,380cyclictest0-21swapper/411:31:284
266449961624,508cyclictest0-21swapper/208:55:282
266459961460,381cyclictest0-21swapper/312:18:033
266449961321,508cyclictest0-21swapper/210:11:232
266479960812,380cyclictest0-21swapper/509:22:465
266449959945,168cyclictest704-21nscd11:56:422
266439959645,127cyclictest0-21swapper/109:39:261
26648995950,84cyclictest0-21swapper/609:37:576
266479959545,126cyclictest698-21ptp4l08:55:325
26647995940,84cyclictest0-21swapper/511:58:455
26645995941,126cyclictest0-21swapper/312:20:523
26645995941,126cyclictest0-21swapper/312:20:513
266439959383,295cyclictest0-21swapper/112:31:201
26644995921,126cyclictest0-21swapper/211:53:212
266499959182,127cyclictest0-21swapper/712:37:597
26643995911,42cyclictest121rcu_preempt10:33:541
266449958979,84cyclictest0-21swapper/211:18:312
2664899588123,253cyclictest17773-21ssh10:12:026
266469958781,337cyclictest24258-21ssh11:08:364
266469958738,254cyclictest0-21swapper/411:56:454
266489958674,296cyclictest0-21swapper/610:32:156
2664799586118,295cyclictest24720-21ssh11:09:095
266439958577,126cyclictest1551-21snmpd12:10:211
2664399579111,338cyclictest0-21swapper/112:20:481
2664399579111,338cyclictest0-21swapper/112:20:481
266469957829,296cyclictest0-21swapper/410:15:124
266439957463,296cyclictest0-21swapper/111:20:301
266429957322,126cyclictest0-21swapper/011:57:460
2664699572233,337cyclictest64450irq/122-eth012:09:084
266469957216,338cyclictest0-21swapper/408:49:184
266459957221,84cyclictest0-21swapper/311:56:433
266499957162,126cyclictest0-21swapper/711:25:247
266459957160,508cyclictest0-21swapper/311:42:293
266459957160,508cyclictest0-21swapper/311:42:293
2664399570106,252cyclictest0-21swapper/111:56:461
266439956899,296cyclictest0-21swapper/112:35:351
2664999565266,126cyclictest0-21swapper/712:08:037
2664699563224,337cyclictest64450irq/122-eth010:33:404
266469956310,339cyclictest0-21swapper/409:39:234
266439956253,127cyclictest0-21swapper/111:09:441
26647995588,3cyclictest0-21swapper/511:18:305
2664799558514,41cyclictest551rcuc/512:36:555
26644995584,381cyclictest0-21swapper/212:10:212
26643995561,380cyclictest0-21swapper/112:18:101
26642995564,126cyclictest0-21swapper/010:33:470
26642995556,380cyclictest0-21swapper/011:09:580
266479955343,127cyclictest0-21swapper/510:07:215
26643995534,3cyclictest0-21swapper/111:18:301
266429955346,126cyclictest0-21swapper/010:07:210
26642995534,2cyclictest0-21swapper/011:18:310
26649995510,42cyclictest0-21swapper/711:22:417
26643995510,84cyclictest0-21swapper/110:13:491
266459955041,84cyclictest0-21swapper/311:09:083
266439955084,293cyclictest0-21swapper/111:36:521
266439955041,84cyclictest121rcu_preempt09:23:131
26643995500,84cyclictest7998-21ssh09:49:251
266489954980,211cyclictest65-21ksoftirqd/608:55:436
2664399548123,252cyclictest0-21swapper/107:40:261
266429954884,83cyclictest0-21swapper/011:31:490
266439954738,127cyclictest0-21swapper/110:07:211
266499954681,211cyclictest0-21swapper/709:49:427
2664399546503,41cyclictest231rcuc/111:53:001
2664999545461,3cyclictest711rcuc/711:42:347
2664999545461,3cyclictest711rcuc/711:42:347
266479954580,210cyclictest0-21swapper/509:40:045
266429954580,126cyclictest0-21swapper/012:19:280
2664999544289,253cyclictest721ktimersoftd/711:55:567
266479954476,295cyclictest0-21swapper/509:40:255
2664999542115,211cyclictest26094-21ls08:55:307
2664699541286,253cyclictest64450irq/122-eth010:13:594
266459954134,339cyclictest0-21swapper/309:20:403
266449954071,466cyclictest0-21swapper/212:33:212
266449954030,507cyclictest0-21swapper/207:47:482
266459953969,296cyclictest5351-21ssh12:36:353
266449953928,508cyclictest0-21swapper/211:25:142
266469953831,127cyclictest0-21swapper/409:46:074
266459953830,126cyclictest0-21swapper/310:07:213
266479953772,126cyclictest0-21swapper/510:30:555
266449953727,507cyclictest12946-21ssh09:15:142
266469953628,49cyclictest121rcu_preempt11:38:114
266439953629,42cyclictest121rcu_preempt12:09:531
2664799535114,126cyclictest0-21swapper/510:14:495
266469953527,84cyclictest0-21swapper/411:54:074
266469953527,84cyclictest0-21swapper/409:23:184
266469953527,42cyclictest0-21swapper/410:07:084
266449953524,127cyclictest0-21swapper/211:07:362
266489953465,211cyclictest0-21swapper/612:23:236
266489953465,211cyclictest0-21swapper/612:23:236
2664899534116,334cyclictest8339-21grep12:40:136
2664899534111,126cyclictest7552-21grep09:30:156
2664899534111,126cyclictest7552-21grep09:30:156
266459953423,380cyclictest0-21swapper/311:25:253
266469953368,84cyclictest0-21swapper/412:36:234
2664999532410,37cyclictest711rcuc/711:36:367
266489953163,253cyclictest0-21swapper/607:45:586
266469953020,338cyclictest121rcu_preempt11:19:374
2664699529188,338cyclictest64450irq/122-eth011:23:224
2664899528271,254cyclictest641ktimersoftd/612:32:076
266489952720,341cyclictest0-21swapper/611:18:316
2664599527446,3cyclictest401ktimersoftd/311:31:263
266479952499,126cyclictest704-21nscd11:20:315
266499952316,302cyclictest0-21swapper/711:19:007
266479952217,416cyclictest0-21swapper/511:41:355
266479952217,416cyclictest0-21swapper/511:41:355
266479952110,296cyclictest0-21swapper/507:45:425
266429952055,126cyclictest29934-21sh12:31:210
26645995189,126cyclictest0-21swapper/310:32:173
2664999517222,211cyclictest721ktimersoftd/710:13:277
266469951653,126cyclictest121rcu_preempt08:55:354
26648995157,296cyclictest0-21swapper/609:21:086
266479951548,253cyclictest0-21swapper/507:14:505
26644995143,169cyclictest0-21swapper/209:40:262
26646995113,126cyclictest0-21swapper/411:43:174
26646995113,126cyclictest0-21swapper/411:43:174
2664899509125,381cyclictest0-21swapper/611:42:296
2664899509125,381cyclictest0-21swapper/611:42:296
2664899509124,211cyclictest121rcu_preempt11:22:576
26644995091,42cyclictest0-21swapper/209:50:122
2664599508122,127cyclictest41-21ksoftirqd/309:36:083
266459950679,296cyclictest0-21swapper/311:17:413
2664999505461,42cyclictest711rcuc/710:08:167
2664399505118,126cyclictest0-21swapper/107:48:461
266469950440,219cyclictest0-21swapper/409:40:324
2664499504118,85cyclictest131rcu_sched07:50:052
266429950380,380cyclictest0-21swapper/009:40:120
2664299502118,126cyclictest9-21ksoftirqd/011:43:240
2664299502118,126cyclictest9-21ksoftirqd/011:43:240
2664799501119,338cyclictest9432-21ssh11:39:545
266459950177,85cyclictest121rcu_preempt12:07:163
266459950131,297cyclictest0-21swapper/312:31:313
266459950131,211cyclictest17561-21ssh10:11:453
266449950033,84cyclictest0-21swapper/207:40:262
266489949974,126cyclictest24212-21ssh10:35:126
266449949934,385cyclictest0-21swapper/210:15:122
2664899498117,84cyclictest0-21swapper/609:40:256
266429949830,338cyclictest0-21swapper/007:50:130
266499949632,169cyclictest0-21swapper/712:21:507
266499949632,169cyclictest0-21swapper/712:21:507
266469949628,465cyclictest0-21swapper/412:31:064
266459949631,296cyclictest0-21swapper/309:48:573
266489949569,126cyclictest0-21swapper/611:38:126
266499949468,253cyclictest121rcu_preempt11:52:127
266499949467,211cyclictest73-21ksoftirqd/711:07:217
266479949472,84cyclictest0-21swapper/512:24:375
266479949472,84cyclictest0-21swapper/512:24:365
266459949366,211cyclictest1841-21diskmemload11:37:463
266459949327,169cyclictest0-21swapper/311:23:223
2664399492111,126cyclictest0-21swapper/109:40:281
266429949269,84cyclictest0-21swapper/012:06:150
2664999491407,3cyclictest711rcuc/709:30:217
2664999491407,3cyclictest711rcuc/709:30:217
266469949126,84cyclictest0-21swapper/409:15:144
266429949169,84cyclictest9016-21ssh11:39:160
266459949025,219cyclictest0-21swapper/308:55:313
266479948925,8cyclictest121rcu_preempt11:32:405
266449948925,295cyclictest0-21swapper/210:42:352
266449948925,295cyclictest0-21swapper/210:42:352
2664999486402,3cyclictest711rcuc/709:24:477
266479948663,169cyclictest698-21ptp4l09:30:255
266479948663,169cyclictest698-21ptp4l09:30:255
266459948617,339cyclictest7352-21/usr/sbin/munin09:30:133
266459948617,339cyclictest7352-21/usr/sbin/munin09:30:133
266449948617,127cyclictest0-21swapper/212:25:172
266469948521,83cyclictest121rcu_preempt12:40:224
266429948560,253cyclictest8308-21grep12:40:120
266499948398,211cyclictest29952-21chrt12:31:257
266449948319,3cyclictest0-21swapper/212:00:292
266449948114,87cyclictest0-21swapper/208:44:372
2664299480181,126cyclictest121rcu_preempt09:15:120
266429947953,296cyclictest0-21swapper/011:52:550
2664999477224,83cyclictest0-21swapper/709:35:547
266489947793,210cyclictest0-21swapper/612:25:116
266479947796,126cyclictest57-21ksoftirqd/511:51:155
26642994757,295cyclictest101ktimersoftd/011:22:330
266479947410,295cyclictest0-21swapper/512:31:245
266449947488,211cyclictest33-21ksoftirqd/208:10:202
26644994745,169cyclictest0-21swapper/210:56:442
266489947153,121cyclictest0-21swapper/611:52:106
26648994705,84cyclictest0-21swapper/610:09:136
26642994704,211cyclictest0-21swapper/008:55:360
266479946887,126cyclictest0-21swapper/512:19:015
266479946786,85cyclictest0-21swapper/507:40:265
2664799466124,339cyclictest13058-21df_inode09:15:165
266429946680,84cyclictest0-21swapper/009:25:250
2664399465124,338cyclictest0-21swapper/111:32:141
266499946479,169cyclictest0-21swapper/707:45:337
2664399464123,338cyclictest0-21swapper/109:15:191
266499946382,297cyclictest0-21swapper/710:33:177
2664799462121,338cyclictest0-21swapper/512:06:345
266449946234,126cyclictest27362-21/usr/sbin/munin11:10:162
266489946134,126cyclictest0-21swapper/612:08:336
2664799461120,338cyclictest0-21swapper/510:15:145
266479946034,126cyclictest31331-1kworker/u17:109:46:525
2664699460123,126cyclictest0-21swapper/411:25:044
2664299460119,338cyclictest7609-21cut09:30:160
2664299460119,338cyclictest7609-21cut09:30:160
266499945974,211cyclictest73-21ksoftirqd/712:16:287
266439945935,42cyclictest121rcu_preempt10:56:381
2664399459158,170cyclictest121rcu_preempt09:30:281
2664399459158,170cyclictest121rcu_preempt09:30:281
2664399459118,338cyclictest0-21swapper/111:25:151
266429945932,127cyclictest0-21swapper/012:25:110
266469945831,211cyclictest1551-21snmpd07:40:214
266489945730,296cyclictest0-21swapper/611:08:256
266469945774,295cyclictest0-21swapper/410:35:124
2664599457118,84cyclictest0-21swapper/310:15:123
266469945676,126cyclictest64450irq/122-eth009:25:284
2664699456115,338cyclictest32366-21chrt08:10:264
266459945634,211cyclictest0-21swapper/311:53:203
2664299456115,338cyclictest0-21swapper/010:15:120
266499945533,338cyclictest0-21swapper/709:50:077
2664899454113,338cyclictest31791-21df_abs08:10:166
2664599454115,50cyclictest0-21swapper/310:42:293
2664599454115,50cyclictest0-21swapper/310:42:293
266429945427,84cyclictest0-21swapper/008:10:200
266489945369,381cyclictest0-21swapper/608:32:546
266439945370,126cyclictest0-21swapper/110:15:101
2664699451111,338cyclictest64450irq/122-eth010:42:354
2664699451111,338cyclictest64450irq/122-eth010:42:354
266429945126,126cyclictest0-21swapper/007:48:210
266469945070,295cyclictest0-21swapper/408:00:094
2664899449108,338cyclictest0-21swapper/611:25:056
2664399449108,126cyclictest0-21swapper/112:40:211
266499944826,256cyclictest0-21swapper/709:40:347
266469944825,253cyclictest0-21swapper/408:44:224
266499944724,256cyclictest0-21swapper/712:40:127
2664899445276,84cyclictest641ktimersoftd/612:18:176
2664999444103,338cyclictest0-21swapper/711:31:217
266439944471,84cyclictest0-21swapper/107:50:151
2664799443144,126cyclictest121rcu_preempt11:25:345
266469944317,337cyclictest0-21swapper/407:50:174
266439944216,126cyclictest0-21swapper/108:10:151
266449944118,3cyclictest0-21swapper/212:40:052
266449944114,169cyclictest0-21swapper/210:35:122
266429944056,211cyclictest121rcu_preempt09:50:110
266459943916,256cyclictest0-21swapper/309:40:343
266449943812,168cyclictest0-21swapper/207:14:462
266499943696,338cyclictest0-21swapper/708:10:167
266469943614,2cyclictest0-21swapper/409:30:294
266469943614,2cyclictest0-21swapper/409:30:294
266439943593,126cyclictest0-21swapper/108:55:241
266469943493,338cyclictest0-21swapper/411:45:034
266469943411,42cyclictest0-21swapper/412:10:214
266439943354,169cyclictest121rcu_preempt09:50:081
2664899429132,169cyclictest0-21swapper/609:46:466
26645994291,168cyclictest0-21swapper/307:40:143
266479942813,249cyclictest0-21swapper/509:25:275
266499942785,340cyclictest15850irq/123-ahci[0012:00:287
266469942789,84cyclictest26640-21cyclictest07:14:524
266469942642,211cyclictest18633-21perf07:50:014
266499942541,381cyclictest0-21swapper/712:25:187
2664299425124,169cyclictest0-21swapper/010:56:380
266499942482,339cyclictest0-21swapper/708:44:237
266459942483,338cyclictest0-21swapper/312:40:053
266459942381,339cyclictest0-21swapper/309:15:143
266449942382,338cyclictest0-21swapper/211:45:032
266499942281,338cyclictest0-21swapper/709:25:147
266489942278,85cyclictest0-21swapper/609:15:246
266449942283,84cyclictest0-21swapper/208:00:112
266499942180,339cyclictest0-21swapper/710:56:347
266469942180,338cyclictest0-21swapper/412:25:164
266459942180,338cyclictest0-21swapper/310:35:123
266439942182,84cyclictest0-21swapper/109:25:271
266429942182,84cyclictest18009-21cstates11:25:150
2664899420121,127cyclictest0-21swapper/609:50:126
266479942082,84cyclictest0-21swapper/510:35:115
266459942080,338cyclictest0-21swapper/308:44:233
266499941978,338cyclictest0-21swapper/712:10:217
266439941933,254cyclictest0-21swapper/110:42:341
266439941933,254cyclictest0-21swapper/110:42:341
266499941878,338cyclictest26640-21cyclictest10:15:127
266479941878,84cyclictest0-21swapper/512:40:105
266459941838,296cyclictest0-21swapper/307:46:583
266439941877,126cyclictest25-21ksoftirqd/110:35:091
266499941781,333cyclictest0-21swapper/710:35:107
266479941778,84cyclictest0-21swapper/508:49:185
266489941637,218cyclictest0-21swapper/609:25:266
266469941675,338cyclictest0-21swapper/412:00:274
266479941576,84cyclictest0-21swapper/512:25:155
266429941574,84cyclictest121rcu_preempt07:40:260
2664999414371,41cyclictest711rcuc/707:50:167
266499941435,295cyclictest0-21swapper/711:10:167
2664799414158,126cyclictest121rcu_preempt08:10:205
266499941372,338cyclictest0-21swapper/709:15:157
266459941373,338cyclictest0-21swapper/312:25:203
266459941373,338cyclictest0-21swapper/309:50:083
266459941373,338cyclictest0-21swapper/308:10:153
266459941372,338cyclictest0-21swapper/312:00:283
266489941270,339cyclictest0-21swapper/610:15:116
266479941229,126cyclictest9071-21ssh09:50:095
2664599412117,84cyclictest1551-21snmpd09:25:193
266489941170,338cyclictest0-21swapper/607:40:256
2664799410155,166cyclictest0-21swapper/507:50:155
266469941070,337cyclictest0-21swapper/409:50:094
266459940970,84cyclictest0-21swapper/308:49:183
266489940868,338cyclictest0-21swapper/610:42:296
266489940868,338cyclictest0-21swapper/610:42:296
266429940867,210cyclictest0-21swapper/010:42:280
266429940867,210cyclictest0-21swapper/010:42:280
266459940767,338cyclictest0-21swapper/312:10:163
266499940564,338cyclictest0-21swapper/707:14:527
266479940526,131cyclictest0-21swapper/510:56:455
266439940424,84cyclictest121rcu_preempt12:25:151
266469940362,338cyclictest0-21swapper/410:56:334
266429940264,126cyclictest121rcu_preempt08:32:520
2664799401142,126cyclictest264-21jbd2/md0-812:10:195
266459940160,338cyclictest0-21swapper/310:56:343
266429939813,84cyclictest0-21swapper/012:00:270
266459939555,338cyclictest0-21swapper/307:14:523
266459939554,338cyclictest0-21swapper/311:45:023
266439939515,169cyclictest25-21ksoftirqd/107:14:401
2664999393140,126cyclictest121rcu_preempt07:40:147
26643993938,84cyclictest0-21swapper/111:45:021
266429939310,126cyclictest27493-21ls12:10:210
26648993909,84cyclictest0-21swapper/610:56:346
266429938815,78cyclictest27398-21latency11:10:170
266489938546,84cyclictest0-21swapper/612:10:166
266479938140,84cyclictest0-21swapper/508:44:235
2664799380124,253cyclictest0-21swapper/508:00:105
2664699379124,253cyclictest0-21swapper/408:32:524
266499937476,126cyclictest0-21swapper/708:32:547
266439937435,85cyclictest0-21swapper/111:10:161
266499937334,84cyclictest7222-21sh10:42:287
266499937334,84cyclictest7222-21sh10:42:277
266459937376,84cyclictest121rcu_preempt11:10:163
266459937332,338cyclictest0-21swapper/307:50:063
266439937233,84cyclictest0-21swapper/108:44:231
2664399372116,253cyclictest29643-21munin-node08:00:111
266499937029,338cyclictest0-21swapper/708:49:187
266489937032,171cyclictest11356-21ssh12:00:286
266459937075,211cyclictest1651-21ntpd08:00:093
266469936928,338cyclictest64450irq/122-eth011:10:174
266439936973,84cyclictest0-21swapper/108:49:181
266489936728,84cyclictest0-21swapper/611:10:166
266489936627,84cyclictest0-21swapper/607:14:516
2664799365110,253cyclictest0-21swapper/511:45:025
266489936122,84cyclictest0-21swapper/607:50:066
266489936061,168cyclictest0-21swapper/608:44:236
266489935718,84cyclictest0-21swapper/608:49:186
2664399355100,253cyclictest0-21swapper/108:32:541
2664299352137,127cyclictest121rcu_preempt07:14:400
266489935112,84cyclictest0-21swapper/608:00:106
266429935156,211cyclictest0-21swapper/011:45:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional