You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 22:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Jul 20, 2026 12:56:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
88999977051,296cyclictest0-21swapper/010:05:100
89009975979,422cyclictest131rcu_sched09:10:311
8899997308,719cyclictest0-21swapper/011:37:320
8899997232,718cyclictest0-21swapper/012:31:520
89059969620,2cyclictest0-21swapper/609:28:086
88999969698,84cyclictest0-21swapper/012:16:160
890699684640,42cyclictest721ktimersoftd/711:46:467
8899996801,676cyclictest0-21swapper/009:15:000
889999656104,507cyclictest0-21swapper/011:03:000
88999965463,507cyclictest0-21swapper/010:23:400
88999965021,626cyclictest0-21swapper/011:17:360
8903996416,126cyclictest0-21swapper/409:10:234
8906996406,2cyclictest0-21swapper/709:28:097
890499632122,295cyclictest0-21swapper/511:26:225
89009962932,338cyclictest25-21ksoftirqd/112:20:061
88999962837,84cyclictest121rcu_preempt11:20:560
88999962674,549cyclictest0-21swapper/010:16:120
890199624115,127cyclictest0-21swapper/209:10:232
88999962473,421cyclictest14749-1kworker/u17:209:29:260
890599622111,508cyclictest0-21swapper/611:53:476
890699618107,508cyclictest0-21swapper/711:53:477
89019961423,339cyclictest0-21swapper/212:43:132
89019959688,123cyclictest121rcu_preempt09:28:232
8906995950,84cyclictest0-21swapper/711:27:257
8906995950,84cyclictest0-21swapper/710:54:457
8902995942,43cyclictest0-21swapper/309:28:083
8903995930,84cyclictest11593-21ssh09:25:174
89029958332,339cyclictest0-21swapper/310:16:453
88999958270,339cyclictest0-21swapper/010:54:450
890399581538,41cyclictest471rcuc/411:38:384
88999957871,504cyclictest0-21swapper/012:00:250
89019957526,297cyclictest0-21swapper/212:19:212
890699572231,338cyclictest5015-1kworker/u17:109:22:537
890699572231,338cyclictest5015-1kworker/u17:109:22:527
88999957220,549cyclictest0-21swapper/010:02:220
89029956915,212cyclictest0-21swapper/309:13:093
89029956914,381cyclictest0-21swapper/310:11:183
89009956957,295cyclictest121rcu_preempt09:40:161
89009956798,299cyclictest0-21swapper/110:44:241
88999956657,127cyclictest0-21swapper/011:53:470
88999956613,550cyclictest0-21swapper/012:07:320
890499565522,41cyclictest551rcuc/510:23:075
88999956311,549cyclictest0-21swapper/011:05:170
8900995618,422cyclictest0-21swapper/112:09:361
89009956052,126cyclictest0-21swapper/110:05:101
89049955690,126cyclictest698-21ptp4l11:38:195
890399555214,338cyclictest64450irq/122-eth012:14:074
8901995541,126cyclictest0-21swapper/209:18:362
890299553467,84cyclictest401ktimersoftd/311:09:583
8902995511,127cyclictest0-21swapper/310:21:023
88999955141,422cyclictest121rcu_preempt11:47:590
88999955140,380cyclictest0-21swapper/010:14:390
890699548124,127cyclictest0-21swapper/712:18:557
890099546123,84cyclictest0-21swapper/111:38:271
890199545119,423cyclictest0-21swapper/210:19:142
89009954537,126cyclictest0-21swapper/110:19:151
89019954478,84cyclictest121rcu_preempt12:13:482
89039954336,45cyclictest0-21swapper/410:20:194
89019954332,508cyclictest0-21swapper/209:45:202
88999954376,464cyclictest14842-21diskmemload11:30:320
890399542202,338cyclictest64450irq/122-eth009:45:154
890399540199,338cyclictest64450irq/122-eth012:36:264
89019954070,211cyclictest0-21swapper/212:08:552
89059953930,84cyclictest0-21swapper/611:03:006
890299539158,126cyclictest8897-21cyclictest09:16:543
890299538111,338cyclictest0-21swapper/311:02:323
890099536114,126cyclictest16557-21diskmemload12:36:541
88999953328,122cyclictest30037-21ssh12:37:110
889999532319,83cyclictest9-21ksoftirqd/012:14:350
88999953225,504cyclictest0-21swapper/009:19:500
890699529443,84cyclictest721ktimersoftd/710:20:547
89059952920,127cyclictest0-21swapper/612:09:026
890399528484,42cyclictest481ktimersoftd/410:55:554
89009952820,168cyclictest0-21swapper/110:23:001
890099528101,296cyclictest0-21swapper/112:17:321
890399527148,127cyclictest0-21swapper/411:54:514
89039952661,462cyclictest0-21swapper/410:40:464
89019952514,509cyclictest0-21swapper/211:53:472
89049952417,295cyclictest0-21swapper/512:36:575
89029952111,212cyclictest0-21swapper/312:42:443
89049951913,337cyclictest0-21swapper/510:03:505
890399519179,337cyclictest64450irq/122-eth011:16:074
890699517436,78cyclictest721ktimersoftd/709:10:197
89029951589,126cyclictest19590-21ssh11:54:193
8905995124,126cyclictest0-21swapper/610:19:146
8899995129,334cyclictest0-21swapper/009:23:080
8899995129,334cyclictest0-21swapper/009:23:080
8901995114,126cyclictest0-21swapper/210:24:492
890499510253,84cyclictest0-21swapper/510:44:005
8906995090,84cyclictest0-21swapper/711:21:417
890499509252,126cyclictest7556-21ssh12:42:545
8904995090,84cyclictest0-21swapper/511:01:495
8902995092,296cyclictest0-21swapper/310:40:453
890099509167,126cyclictest121rcu_preempt11:48:551
89059950880,169cyclictest65-21ksoftirqd/611:27:216
890499508168,210cyclictest121rcu_preempt10:34:315
890199506125,126cyclictest0-21swapper/209:21:502
890199506125,126cyclictest0-21swapper/209:21:502
890099506123,380cyclictest0-21swapper/110:54:181
890399504121,168cyclictest13526-21sh10:17:304
89029950480,381cyclictest0-21swapper/312:13:483
89019950477,211cyclictest33-21ksoftirqd/211:39:572
890699502119,381cyclictest0-21swapper/709:45:207
89019950237,297cyclictest0-21swapper/211:03:002
89049950179,256cyclictest8897-21cyclictest12:31:005
88999950133,465cyclictest0-21swapper/010:25:060
89049950034,211cyclictest0-21swapper/512:14:075
89009950078,256cyclictest8897-21cyclictest11:53:401
89009950035,126cyclictest0-21swapper/110:57:321
89069949933,211cyclictest0-21swapper/712:37:317
89049949973,253cyclictest0-21swapper/509:22:525
89049949973,253cyclictest0-21swapper/509:22:525
890499499116,380cyclictest0-21swapper/511:48:405
89019949934,297cyclictest0-21swapper/208:10:252
89019949934,297cyclictest0-21swapper/208:10:242
89069949834,41cyclictest0-21swapper/711:38:327
890699498157,338cyclictest14747-21rm12:28:257
89039949875,84cyclictest0-21swapper/411:30:274
89039949872,253cyclictest0-21swapper/409:40:154
890399498114,211cyclictest1551-21snmpd11:27:164
89029949827,254cyclictest0-21swapper/311:26:503
89019949871,211cyclictest33-21ksoftirqd/210:43:132
890199498413,4cyclictest321ktimersoftd/207:51:052
890199498114,381cyclictest0-21swapper/210:57:322
89039949632,126cyclictest0-21swapper/411:05:104
89029949674,211cyclictest41-21ksoftirqd/311:24:363
890699495195,126cyclictest121rcu_preempt11:16:077
890599495240,84cyclictest5606-21kworker/u16:311:21:416
890599495155,338cyclictest8897-21cyclictest10:56:156
89009949530,83cyclictest15977-21ssh09:28:061
890099495114,126cyclictest0-21swapper/111:05:261
89049949472,256cyclictest8897-21cyclictest09:13:165
89009949472,84cyclictest0-21swapper/111:40:161
89009949427,85cyclictest0-21swapper/112:14:031
890399493249,161cyclictest481ktimersoftd/411:46:034
890299493109,381cyclictest0-21swapper/311:37:193
88999949326,464cyclictest0-21swapper/010:41:530
890699492151,338cyclictest16557-21diskmemload11:40:037
889999492108,253cyclictest121rcu_preempt09:30:150
890299491111,296cyclictest0-21swapper/310:03:463
88999949127,210cyclictest0-21swapper/010:58:220
89029949021,85cyclictest0-21swapper/311:48:243
89019949020,346cyclictest0-21swapper/208:00:162
88999949068,419cyclictest0-21swapper/007:50:360
89049948920,296cyclictest0-21swapper/512:16:235
89039948763,210cyclictest0-21swapper/410:04:264
89039948721,211cyclictest0-21swapper/409:20:464
89039948721,211cyclictest0-21swapper/409:20:464
89029948718,338cyclictest41-21ksoftirqd/311:15:493
890599486318,43cyclictest31627-21missed_timers12:00:236
89019948520,84cyclictest0-21swapper/210:03:572
89019948519,84cyclictest0-21swapper/211:50:002
890099485231,84cyclictest241ktimersoftd/109:19:271
89049948418,84cyclictest0-21swapper/511:22:525
89059948256,253cyclictest0-21swapper/611:36:126
89049948217,296cyclictest0-21swapper/510:17:135
89049948217,219cyclictest0-21swapper/511:53:195
88999948260,84cyclictest0-21swapper/008:10:230
88999948260,84cyclictest0-21swapper/008:10:230
88999948214,126cyclictest0-21swapper/011:25:320
89019948011,296cyclictest0-21swapper/211:05:262
89019947957,41cyclictest121rcu_preempt12:37:172
890599478222,254cyclictest641ktimersoftd/610:41:386
89029947814,126cyclictest0-21swapper/312:33:373
890299478137,126cyclictest121rcu_preempt11:30:403
89029947813,219cyclictest0-21swapper/310:45:083
89059947754,84cyclictest0-21swapper/608:05:166
89059947554,83cyclictest0-21swapper/611:40:166
8906994745,43cyclictest0-21swapper/710:57:507
890399474134,337cyclictest8897-21cyclictest12:00:194
89029947494,211cyclictest0-21swapper/307:51:123
890099474137,171cyclictest0-21swapper/112:31:221
8899994738,296cyclictest0-21swapper/012:28:180
89009947214,296cyclictest0-21swapper/111:01:231
890199471304,41cyclictest0-21swapper/211:17:132
8904994708,332cyclictest15882-21ssh10:54:585
89019946989,126cyclictest0-21swapper/211:30:272
89059946842,337cyclictest0-21swapper/611:46:506
8899994681,464cyclictest31627-21proc_pri10:45:230
89069946783,211cyclictest0-21swapper/711:04:137
890699467125,339cyclictest0-21swapper/710:42:207
89019946740,211cyclictest0-21swapper/211:27:322
8901994671,211cyclictest0-21swapper/212:31:232
89069946681,211cyclictest73-21ksoftirqd/712:08:117
89029946681,169cyclictest15634-21seq10:54:383
890299466124,339cyclictest0-21swapper/309:22:053
890299466124,339cyclictest0-21swapper/309:22:053
89069946586,375cyclictest0-21swapper/712:00:147
890699465124,338cyclictest16709-21grep12:10:197
890699465124,338cyclictest0-21swapper/712:42:427
890699465124,338cyclictest0-21swapper/712:33:147
890699465123,211cyclictest14520-21ssh10:18:337
890699465123,211cyclictest0-21swapper/709:18:127
890499465382,4cyclictest551rcuc/512:07:595
890499465124,338cyclictest0-21swapper/509:15:165
890399465167,126cyclictest8897-21cyclictest12:18:174
890099465124,338cyclictest0-21swapper/112:43:111
890099465124,338cyclictest0-21swapper/110:13:291
8899994651,127cyclictest0-21swapper/011:43:360
890699464124,338cyclictest8897-21cyclictest09:30:167
890699464123,339cyclictest0-21swapper/710:04:587
890499464124,337cyclictest0-21swapper/510:13:375
890499464123,338cyclictest0-21swapper/511:09:505
890499464122,339cyclictest0-21swapper/511:30:285
89019946441,338cyclictest0-21swapper/211:23:162
89009946480,211cyclictest0-21swapper/107:52:591
890099464123,338cyclictest0-21swapper/111:27:051
890699463123,338cyclictest0-21swapper/710:13:297
890499463123,337cyclictest0-21swapper/511:16:065
89059946240,41cyclictest0-21swapper/612:28:476
890499462123,336cyclictest8897-21cyclictest10:28:205
890499462122,338cyclictest0-21swapper/509:29:265
89039946278,169cyclictest0-21swapper/410:14:414
89019946240,219cyclictest0-21swapper/212:28:262
890099462121,338cyclictest0-21swapper/111:16:061
8899994621,457cyclictest0-21swapper/012:20:070
89059946134,84cyclictest0-21swapper/609:45:246
890599460422,2cyclictest631rcuc/610:23:286
890299460118,339cyclictest0-21swapper/310:28:303
890199460120,338cyclictest0-21swapper/210:11:572
890199460119,338cyclictest0-21swapper/208:05:192
890099460119,338cyclictest0-21swapper/111:30:281
89069945937,3cyclictest0-21swapper/712:20:057
89039945979,216cyclictest0-21swapper/409:18:134
89029945936,2cyclictest0-21swapper/312:18:473
890599458117,338cyclictest30517-21taskset12:37:466
890699457117,337cyclictest0-21swapper/709:40:007
890499457117,294cyclictest0-21swapper/508:10:235
890499457117,294cyclictest0-21swapper/508:10:235
88999945634,211cyclictest9130-21proc_pri08:00:270
88999945630,423cyclictest0-21swapper/009:45:210
89059945532,85cyclictest0-21swapper/610:11:286
89039945530,422cyclictest0-21swapper/412:32:124
890299455114,338cyclictest0-21swapper/310:56:023
890099455115,338cyclictest0-21swapper/111:59:591
890699454155,126cyclictest121rcu_preempt11:09:597
890499454112,339cyclictest0-21swapper/507:50:555
89039945473,126cyclictest0-21swapper/412:08:174
890299454113,339cyclictest0-21swapper/312:08:253
890099454115,293cyclictest0-21swapper/108:10:231
890099454115,293cyclictest0-21swapper/108:10:231
89059945325,254cyclictest0-21swapper/612:32:116
890299453113,338cyclictest0-21swapper/312:37:253
89009945330,256cyclictest0-21swapper/110:28:201
88999945374,298cyclictest0-21swapper/012:42:270
890299452111,338cyclictest0-21swapper/312:28:243
890199452111,339cyclictest0-21swapper/210:54:192
89009945272,84cyclictest0-21swapper/108:05:161
890499451110,338cyclictest0-21swapper/512:00:325
89039945167,380cyclictest0-21swapper/410:54:184
890099451111,337cyclictest0-21swapper/111:21:411
89059945065,211cyclictest0-21swapper/612:14:176
890499450151,126cyclictest121rcu_preempt10:57:335
89039945069,84cyclictest0-21swapper/408:05:174
890399450109,338cyclictest0-21swapper/411:01:434
890099450110,338cyclictest0-21swapper/110:45:091
89059944964,296cyclictest0-21swapper/607:54:456
89059944923,294cyclictest0-21swapper/612:19:186
89029944969,377cyclictest0-21swapper/312:00:143
890099449108,338cyclictest0-21swapper/110:03:101
88999944826,253cyclictest11113-21df_abs08:05:180
89039944764,84cyclictest0-21swapper/408:10:234
89039944764,84cyclictest0-21swapper/408:10:234
89019944723,126cyclictest0-21swapper/212:00:082
89039944518,133cyclictest0-21swapper/411:40:044
89019944560,211cyclictest33-21ksoftirqd/210:45:092
89059944320,256cyclictest0-21swapper/609:13:166
89059944262,84cyclictest0-21swapper/610:03:466
89069944059,84cyclictest0-21swapper/708:10:237
89069944059,84cyclictest0-21swapper/708:10:237
89059944055,211cyclictest0-21swapper/610:25:176
89039943959,84cyclictest1735-21ssh11:23:444
89019943816,126cyclictest0-21swapper/212:00:002
89009943858,84cyclictest0-21swapper/109:22:191
89009943858,84cyclictest0-21swapper/109:22:191
89059943715,289cyclictest0-21swapper/609:23:496
89059943715,289cyclictest0-21swapper/609:23:496
89049943710,345cyclictest0-21swapper/509:45:205
890099436224,84cyclictest4217-21kworker/u16:109:30:151
88999943610,422cyclictest11901-21munin-node09:39:580
89039943512,3cyclictest0-21swapper/410:25:134
89069943411,256cyclictest0-21swapper/710:28:207
89049943413,253cyclictest0-21swapper/512:28:065
89069943352,84cyclictest0-21swapper/711:30:407
89069942992,126cyclictest0-21swapper/707:54:197
8899994298,338cyclictest0-21swapper/009:40:140
89039942888,337cyclictest0-21swapper/412:42:334
8900994286,127cyclictest0-21swapper/109:45:211
8905994271,211cyclictest0-21swapper/611:16:506
89059942645,126cyclictest65-21ksoftirqd/609:16:546
8900994266,289cyclictest0-21swapper/112:28:471
8906994241,291cyclictest721ktimersoftd/708:00:227
8900994243,289cyclictest0-21swapper/108:00:141
89059942383,84cyclictest0-21swapper/610:54:376
89029942380,127cyclictest41-21ksoftirqd/308:05:123
89029942280,131cyclictest41-21ksoftirqd/309:30:163
89009942241,85cyclictest0-21swapper/112:00:281
89039942182,84cyclictest0-21swapper/408:00:264
890599420252,3cyclictest631rcuc/611:05:306
89039942082,84cyclictest0-21swapper/412:28:244
890699419162,84cyclictest121rcu_preempt08:05:197
89039941978,168cyclictest49-21ksoftirqd/410:45:224
88999941877,252cyclictest0-21swapper/009:58:210
890499417161,125cyclictest121rcu_preempt08:00:285
89029941775,339cyclictest0-21swapper/308:00:213
89049941636,85cyclictest0-21swapper/509:39:565
89059941576,84cyclictest0-21swapper/612:42:256
89029941534,84cyclictest0-21swapper/311:55:073
89019941575,338cyclictest0-21swapper/210:05:142
89069941434,126cyclictest0-21swapper/710:05:137
89039941476,84cyclictest13715-21fgrep10:35:234
89049941335,126cyclictest29669-21ssh11:40:175
890399412113,127cyclictest0-21swapper/410:05:104
88999941273,84cyclictest0-21swapper/010:35:220
890599411113,295cyclictest0-21swapper/608:00:206
89049941170,84cyclictest0-21swapper/509:40:145
890499411117,211cyclictest11080-21df_abs08:05:165
89019941171,338cyclictest0-21swapper/210:34:302
89019941168,212cyclictest0-21swapper/209:58:212
89039941071,84cyclictest0-21swapper/407:54:354
89019941070,338cyclictest0-21swapper/210:25:052
890199410111,296cyclictest8897-21cyclictest09:39:562
89009941071,84cyclictest0-21swapper/110:35:221
89069940828,84cyclictest0-21swapper/707:55:117
89059940871,84cyclictest14659-21kernelversion08:10:236
89059940871,84cyclictest14659-21kernelversion08:10:236
89049940873,81cyclictest0-21swapper/507:55:095
89059940768,84cyclictest0-21swapper/611:30:206
89029940726,211cyclictest0-21swapper/309:45:143
89059940667,84cyclictest0-21swapper/609:30:226
89039940667,84cyclictest0-21swapper/411:55:074
89009940466,83cyclictest0-21swapper/109:40:001
89059940364,84cyclictest0-21swapper/610:45:176
890299403108,84cyclictest16557-21diskmemload12:20:173
890099402103,126cyclictest25-21ksoftirqd/109:58:211
88999940263,84cyclictest0-21swapper/011:55:070
89019940159,127cyclictest33-21ksoftirqd/211:40:032
89019940020,256cyclictest0-21swapper/212:20:062
89059939960,84cyclictest0-21swapper/610:35:226
89049939961,84cyclictest0-21swapper/511:55:075
89039939915,84cyclictest0-21swapper/409:39:564
89059939859,84cyclictest0-21swapper/609:40:146
89049939899,126cyclictest121rcu_preempt10:05:135
89029939856,339cyclictest0-21swapper/308:10:263
89029939856,339cyclictest0-21swapper/308:10:263
88999939617,295cyclictest0-21swapper/010:34:290
89059939511,210cyclictest0-21swapper/610:05:136
89059939415,83cyclictest0-21swapper/609:39:566
89069939253,84cyclictest0-21swapper/710:45:177
89049939253,84cyclictest0-21swapper/510:45:175
89029939212,84cyclictest0-21swapper/311:40:163
89029938344,84cyclictest0-21swapper/309:58:213
890599380123,126cyclictest65-21ksoftirqd/609:58:216
890499380124,253cyclictest30693-21ssh12:20:045
89029937980,296cyclictest0-21swapper/307:55:123
88999937938,253cyclictest0-21swapper/008:24:260
89069937840,3cyclictest0-21swapper/708:24:267
88999937841,211cyclictest0-21swapper/008:57:490
89069937739,3cyclictest0-21swapper/708:53:027
89009937738,84cyclictest0-21swapper/110:34:301
88999937781,84cyclictest0-21swapper/007:55:110
89069937537,3cyclictest0-21swapper/710:34:307
89059937476,85cyclictest0-21swapper/612:20:176
890299374117,254cyclictest7194-21df_inode09:40:143
89039937335,84cyclictest19787-21sed09:30:154
89059936873,42cyclictest0-21swapper/608:24:266
890599368111,254cyclictest1551-21snmpd11:55:076
890299363106,128cyclictest0-21swapper/310:34:173
89039936122,84cyclictest0-21swapper/409:58:214
89029936123,3cyclictest0-21swapper/308:24:263
89029936122,84cyclictest0-21swapper/310:05:113
89039936064,84cyclictest0-21swapper/412:20:094
89069935813,128cyclictest73-21ksoftirqd/709:40:157
89049935818,84cyclictest0-21swapper/509:30:155
89019935717,337cyclictest0-21swapper/209:30:162
89019935661,126cyclictest33-21ksoftirqd/209:40:152
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional