You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-13 - 22:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Jul 13, 2026 12:57:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16460998470,84cyclictest8923-21ssh11:12:371
164609978322,678cyclictest0-21swapper/111:21:471
1646299757166,126cyclictest121rcu_preempt09:49:593
164609975533,126cyclictest0-21swapper/112:42:351
164609975433,676cyclictest0-21swapper/109:55:441
164609974970,84cyclictest0-21swapper/109:43:541
164609973559,592cyclictest0-21swapper/110:00:391
1646399721338,126cyclictest0-21swapper/411:15:344
164609972183,635cyclictest0-21swapper/112:39:461
164659971434,380cyclictest0-21swapper/611:34:546
1645999713203,380cyclictest121rcu_preempt09:59:280
164609969414,677cyclictest0-21swapper/111:05:071
164639967582,84cyclictest0-21swapper/409:08:074
164639967582,84cyclictest0-21swapper/409:08:064
1646199667114,380cyclictest0-21swapper/212:32:352
164619966469,380cyclictest0-21swapper/210:47:132
164649966368,423cyclictest0-21swapper/512:43:435
1646299663109,381cyclictest0-21swapper/311:48:013
164639966126,126cyclictest121rcu_preempt12:24:144
1646099653101,126cyclictest0-21swapper/111:03:281
164639965053,423cyclictest25986-21sh12:02:574
16460996381,634cyclictest0-21swapper/110:10:031
16460996381,634cyclictest0-21swapper/110:10:031
164609963641,592cyclictest0-21swapper/111:31:431
16460996360,84cyclictest0-21swapper/109:29:491
16463996350,126cyclictest0-21swapper/411:33:534
16460996340,42cyclictest0-21swapper/109:35:011
164599963481,253cyclictest0-21swapper/012:30:470
164669963380,127cyclictest1351-21munin-run09:35:017
1646299633120,296cyclictest0-21swapper/311:01:263
164639962875,381cyclictest0-21swapper/412:40:124
1646199628371,126cyclictest576-21ssh12:06:562
164669962774,380cyclictest0-21swapper/708:35:587
164609962534,126cyclictest0-21swapper/111:51:541
164619962326,378cyclictest0-21swapper/207:56:142
164609962332,126cyclictest0-21swapper/110:08:351
164649962128,50cyclictest121rcu_preempt12:30:565
1646299621108,296cyclictest0-21swapper/311:56:133
1646599617154,294cyclictest0-21swapper/611:53:596
164629961768,126cyclictest0-21swapper/309:31:243
164619961768,295cyclictest0-21swapper/211:46:352
164609961565,126cyclictest121rcu_preempt09:08:361
164609961565,126cyclictest121rcu_preempt09:08:361
164639961061,84cyclictest121rcu_preempt11:03:264
164629960752,381cyclictest0-21swapper/311:14:353
164629960711,380cyclictest0-21swapper/309:44:353
164649960698,126cyclictest19782-21ssh09:25:135
164599960615,84cyclictest0-21swapper/010:17:580
164649960553,380cyclictest0-21swapper/511:01:155
164639960450,338cyclictest16457-21cyclictest10:46:404
164619960411,126cyclictest0-21swapper/211:15:342
1646699603517,84cyclictest711rcuc/709:29:047
164639960396,292cyclictest32544-21rm09:33:414
164619960248,380cyclictest0-21swapper/211:43:232
16460995971,127cyclictest0-21swapper/111:57:201
16465995940,84cyclictest0-21swapper/610:50:136
16461995940,84cyclictest0-21swapper/209:25:132
1646699593293,126cyclictest0-21swapper/709:24:347
16464995930,84cyclictest0-21swapper/509:47:095
16464995930,83cyclictest0-21swapper/510:50:135
16463995930,84cyclictest0-21swapper/409:47:094
16463995930,84cyclictest0-21swapper/409:25:134
16461995921,126cyclictest0-21swapper/208:00:272
164599959284,126cyclictest0-21swapper/012:45:060
1646299590121,296cyclictest0-21swapper/312:32:353
164649958879,85cyclictest121rcu_preempt11:15:385
16460995880,3cyclictest0-21swapper/112:31:051
164659958737,127cyclictest121rcu_preempt12:20:476
164629958732,126cyclictest0-21swapper/311:15:173
1646299587117,381cyclictest28353-21ssh10:26:453
164609958634,549cyclictest0-21swapper/112:05:551
164659958534,84cyclictest0-21swapper/609:49:556
1646299585118,335cyclictest0-21swapper/312:07:023
164609958576,127cyclictest0-21swapper/112:02:231
1645999585119,84cyclictest121rcu_preempt10:00:210
164649958374,127cyclictest0-21swapper/511:55:145
164619958334,84cyclictest0-21swapper/211:23:412
164609958330,507cyclictest0-21swapper/111:46:481
164659958166,296cyclictest0-21swapper/610:59:236
164629958168,296cyclictest0-21swapper/308:37:223
164629958132,126cyclictest0-21swapper/309:22:083
164609958128,550cyclictest0-21swapper/108:39:031
164659958029,126cyclictest0-21swapper/612:43:216
164619957972,127cyclictest0-21swapper/211:52:432
164599957930,338cyclictest0-21swapper/011:34:400
1646599576110,126cyclictest8946-21ssh09:59:576
164649957668,126cyclictest698-21ptp4l11:53:585
1645999575107,295cyclictest0-21swapper/009:49:550
164649957323,84cyclictest0-21swapper/509:41:245
164609957320,84cyclictest0-21swapper/112:24:121
164609957117,423cyclictest0-21swapper/110:34:121
164619957056,296cyclictest0-21swapper/209:56:312
164599957020,84cyclictest0-21swapper/010:49:040
164669956958,296cyclictest0-21swapper/711:23:167
164609956813,466cyclictest0-21swapper/110:45:471
164599956857,296cyclictest0-21swapper/009:41:090
164609956716,127cyclictest0-21swapper/111:42:301
164609956714,126cyclictest0-21swapper/110:17:081
1646199566356,45cyclictest0-21swapper/212:25:292
164629956515,127cyclictest0-21swapper/311:24:123
1646099565141,294cyclictest17274-21kworker/u16:309:49:321
164629956495,296cyclictest0-21swapper/307:58:203
164609956456,126cyclictest704-21nscd11:35:181
164599956397,126cyclictest0-21swapper/011:57:350
16459995639,339cyclictest121rcu_preempt10:27:560
16461995609,84cyclictest0-21swapper/211:56:382
1646299558343,84cyclictest0-21swapper/312:03:113
1646199558305,46cyclictest0-21swapper/211:32:442
164599955746,126cyclictest0-21swapper/011:43:260
16459995566,126cyclictest0-21swapper/011:21:480
16463995550,84cyclictest0-21swapper/410:31:534
164619955587,338cyclictest30558-21nscd10:08:532
164619955283,381cyclictest0-21swapper/211:12:062
1646299551124,211cyclictest0-21swapper/312:45:053
164659954880,295cyclictest0-21swapper/610:08:276
1646299548121,211cyclictest0-21swapper/311:53:093
164599954882,126cyclictest0-21swapper/009:33:180
164659954781,126cyclictest0-21swapper/610:31:266
1646499547252,126cyclictest0-21swapper/511:05:185
1646199546289,84cyclictest0-21swapper/212:37:012
1646199546122,126cyclictest0-21swapper/212:42:372
1646699545288,126cyclictest0-21swapper/711:51:487
164599954581,41cyclictest121rcu_preempt12:43:050
164669954478,84cyclictest0-21swapper/712:32:387
164639954434,507cyclictest64450irq/122-eth012:37:014
164599954436,126cyclictest0-21swapper/012:22:250
164629954334,126cyclictest0-21swapper/310:07:283
164619954332,253cyclictest0-21swapper/210:34:112
164629954234,341cyclictest6178-21kworker/u16:110:49:253
164619954234,126cyclictest0-21swapper/210:16:352
164619954132,127cyclictest0-21swapper/209:46:132
164609954134,423cyclictest0-21swapper/109:20:421
164669954031,211cyclictest1361-21ssh12:08:047
164649954029,295cyclictest0-21swapper/510:48:155
1646399540114,253cyclictest0-21swapper/409:57:514
164669953970,211cyclictest73-21ksoftirqd/707:58:457
1646299539157,85cyclictest121rcu_preempt09:57:223
164619953933,168cyclictest0-21swapper/208:46:262
1645999539494,42cyclictest111rcuc/011:03:320
164599953932,126cyclictest121rcu_preempt10:34:030
164659953870,295cyclictest0-21swapper/607:59:116
164659953725,296cyclictest0-21swapper/611:11:406
164629953767,296cyclictest0-21swapper/309:27:453
1646299537111,211cyclictest1553-21runrttasks09:10:063
1646099537115,338cyclictest0-21swapper/111:15:301
164669953628,42cyclictest121rcu_preempt10:50:157
164629953668,431cyclictest0-21swapper/311:42:033
164629953622,126cyclictest0-21swapper/312:37:563
164619953668,169cyclictest0-21swapper/209:30:542
164669953527,262cyclictest121rcu_preempt10:45:317
1646599535151,295cyclictest0-21swapper/611:47:026
164639953529,260cyclictest0-21swapper/412:31:594
1646399535108,296cyclictest0-21swapper/411:13:364
164659953319,50cyclictest121rcu_preempt12:02:496
1646499533105,381cyclictest11191-1kworker/u17:212:22:585
1646299533193,125cyclictest121rcu_preempt10:30:413
1646699532105,296cyclictest16457-21cyclictest09:47:147
164649953166,210cyclictest0-21swapper/507:55:175
164649953162,295cyclictest0-21swapper/509:59:055
1646399531110,253cyclictest0-21swapper/410:17:404
164619953119,297cyclictest0-21swapper/207:25:192
164659952822,84cyclictest0-21swapper/608:00:316
1646599528102,295cyclictest0-21swapper/611:24:386
164619952898,254cyclictest0-21swapper/209:41:232
164659952720,423cyclictest0-21swapper/609:40:206
164639952762,210cyclictest24239-21diskmemload09:41:564
164639952758,84cyclictest0-21swapper/410:50:134
164599952716,84cyclictest0-21swapper/011:46:480
164649952620,296cyclictest0-21swapper/511:47:145
1646399526274,83cyclictest0-21swapper/411:53:404
164639952617,85cyclictest0-21swapper/407:59:554
1646699525140,297cyclictest0-21swapper/711:34:147
164649952514,380cyclictest0-21swapper/511:31:485
164629952556,261cyclictest0-21swapper/310:17:513
1646199525103,253cyclictest0-21swapper/209:05:302
1646199525103,253cyclictest0-21swapper/209:05:302
164659952354,465cyclictest0-21swapper/611:00:176
164629952355,126cyclictest0-21swapper/312:22:243
164599952318,126cyclictest0-21swapper/009:25:430
164649952110,338cyclictest0-21swapper/509:31:515
164659952054,50cyclictest0-21swapper/609:22:526
164649952054,126cyclictest0-21swapper/510:57:345
164659951951,295cyclictest0-21swapper/612:31:006
164669951550,302cyclictest0-21swapper/711:43:127
16459995158,84cyclictest0-21swapper/009:20:520
16459995157,84cyclictest0-21swapper/011:52:430
16459995154,126cyclictest0-21swapper/009:06:560
16459995154,126cyclictest0-21swapper/009:06:560
164599951347,126cyclictest0-21swapper/010:07:540
164599951183,169cyclictest121rcu_preempt11:13:230
16466995100,84cyclictest0-21swapper/711:11:537
164649951084,211cyclictest57-21ksoftirqd/509:20:165
16462995103,296cyclictest0-21swapper/311:05:183
164669950981,296cyclictest0-21swapper/712:35:587
164659950985,127cyclictest0-21swapper/612:36:486
16465995090,84cyclictest19777-21apt-get09:25:146
16462995090,84cyclictest2958-21df_abs10:50:133
16461995090,84cyclictest2957-21ssh10:50:132
16459995090,42cyclictest1553-21runrttasks08:36:010
16466995081,2cyclictest0-21swapper/711:56:207
1646499507124,253cyclictest0-21swapper/508:39:505
164629950683,254cyclictest0-21swapper/312:43:543
164659950540,84cyclictest121rcu_preempt09:34:116
164649950583,256cyclictest0-21swapper/508:00:275
164629950535,85cyclictest0-21swapper/309:09:433
164629950535,85cyclictest0-21swapper/309:09:433
164669950481,84cyclictest0-21swapper/710:59:297
164599950381,337cyclictest0-21swapper/011:15:380
164669950278,126cyclictest121rcu_preempt12:22:557
164649950279,126cyclictest24747-21ssh09:10:085
164649950274,126cyclictest19364-21ssh12:37:115
1646499502161,126cyclictest0-21swapper/510:31:195
164619950237,42cyclictest121rcu_preempt12:00:482
164669950178,84cyclictest0-21swapper/709:58:147
164649950178,126cyclictest0-21swapper/512:08:285
164599950133,253cyclictest0-21swapper/010:57:400
164669950036,49cyclictest0-21swapper/710:08:537
164659950074,211cyclictest0-21swapper/607:25:196
164649950077,84cyclictest26002-21ssh10:08:535
164609950031,466cyclictest0-21swapper/110:35:101
164609949931,465cyclictest0-21swapper/110:57:111
164649949834,126cyclictest0-21swapper/511:42:425
1646399498121,162cyclictest49-21ksoftirqd/412:25:244
164659949775,50cyclictest121rcu_preempt11:05:126
164639949771,211cyclictest481ktimersoftd/409:20:154
1646199497240,84cyclictest0-21swapper/209:10:152
164619949630,126cyclictest0-21swapper/212:20:412
1646099496112,126cyclictest25-21ksoftirqd/109:10:081
164669949429,3cyclictest0-21swapper/710:00:097
164619949430,126cyclictest3521-21ssh09:35:212
164649949367,253cyclictest0-21swapper/511:22:595
1646399493117,161cyclictest0-21swapper/411:23:234
164649949228,84cyclictest0-21swapper/509:05:305
164649949228,84cyclictest0-21swapper/509:05:305
164639949266,295cyclictest0-21swapper/410:59:374
164599949224,337cyclictest24806-21sh09:10:140
164649949127,42cyclictest121rcu_preempt10:00:335
164659949018,380cyclictest0-21swapper/609:05:246
164659949018,380cyclictest0-21swapper/609:05:246
1646599490110,211cyclictest0-21swapper/611:35:196
1646199490114,246cyclictest121rcu_preempt10:10:102
1646199490114,246cyclictest121rcu_preempt10:10:102
1646299489151,174cyclictest401ktimersoftd/308:59:303
1646599488362,48cyclictest631rcuc/610:47:376
164609948822,211cyclictest0-21swapper/110:26:421
1646199487188,84cyclictest121rcu_preempt09:22:492
164669948621,5cyclictest14406-21ssh09:40:407
1646199486193,162cyclictest0-21swapper/211:00:552
164609948618,126cyclictest0-21swapper/109:35:261
1646099486106,84cyclictest121rcu_preempt07:55:271
164669948562,171cyclictest0-21swapper/711:04:327
164669948519,126cyclictest16457-21cyclictest10:16:187
164669948515,296cyclictest0-21swapper/707:25:237
164649948563,84cyclictest0-21swapper/510:16:445
1646299485101,169cyclictest121rcu_preempt12:25:243
164669948260,84cyclictest0-21swapper/710:34:507
164599948213,126cyclictest0-21swapper/012:03:140
164659948116,254cyclictest0-21swapper/611:15:146
164669947911,253cyclictest0-21swapper/712:43:427
164649947955,210cyclictest14025-21fschecks_count11:35:185
164659947896,209cyclictest65-21ksoftirqd/608:35:306
16463994789,126cyclictest0-21swapper/411:41:454
1646199478225,84cyclictest0-21swapper/210:59:432
16463994778,84cyclictest0-21swapper/411:56:374
164639947713,256cyclictest0-21swapper/408:00:274
16460994779,126cyclictest0-21swapper/112:25:041
164599947710,253cyclictest0-21swapper/012:06:220
16465994767,126cyclictest0-21swapper/610:00:186
164649947612,84cyclictest10636-21ssh11:14:485
16459994767,339cyclictest0-21swapper/010:10:090
16459994767,339cyclictest0-21swapper/010:10:090
164599947611,296cyclictest0-21swapper/012:36:320
164639947511,84cyclictest0-21swapper/411:46:204
16461994758,127cyclictest0-21swapper/210:26:462
164659947189,85cyclictest0-21swapper/611:57:546
16465994711,84cyclictest0-21swapper/612:25:366
16462994693,84cyclictest0-21swapper/311:34:143
16461994691,127cyclictest0-21swapper/210:00:312
16460994691,465cyclictest0-21swapper/110:50:161
1646399468338,84cyclictest0-21swapper/410:08:184
16466994671,84cyclictest0-21swapper/710:26:467
16463994671,84cyclictest0-21swapper/410:26:424
164669946585,296cyclictest29295-21ssh10:10:227
164669946585,296cyclictest29295-21ssh10:10:227
164669946480,381cyclictest24239-21diskmemload12:02:237
164629946482,127cyclictest0-21swapper/310:58:533
1645999463124,337cyclictest0-21swapper/009:50:110
164659946281,126cyclictest121rcu_preempt12:08:126
164639946281,126cyclictest0-21swapper/410:10:024
164639946281,126cyclictest0-21swapper/410:10:024
1646199462166,85cyclictest0-21swapper/212:45:112
164609946240,214cyclictest0-21swapper/108:40:071
1646299461120,338cyclictest0-21swapper/310:10:313
1646299461120,338cyclictest0-21swapper/310:10:313
1646499460160,211cyclictest29406-1kworker/u17:112:25:185
164599945735,255cyclictest1553-21runrttasks07:57:140
164639945677,83cyclictest0-21swapper/412:06:134
164639945631,126cyclictest0-21swapper/409:50:084
1646299456115,338cyclictest0-21swapper/310:00:323
164609945634,256cyclictest0-21swapper/108:59:291
1646299455115,338cyclictest0-21swapper/308:00:313
164669945431,3cyclictest0-21swapper/709:35:187
1646699454113,338cyclictest0-21swapper/712:25:247
164639945474,211cyclictest0-21swapper/408:35:484
164599945428,126cyclictest0-21swapper/012:25:030
164649945330,126cyclictest0-21swapper/512:02:205
164639945230,42cyclictest0-21swapper/412:45:114
1646599451111,338cyclictest0-21swapper/610:10:026
1646599451111,338cyclictest0-21swapper/610:10:026
164639945130,255cyclictest0-21swapper/409:38:304
1646299451111,338cyclictest14020-21fschecks_count11:35:173
1646699450108,339cyclictest16291-21latency08:00:297
1646299450112,84cyclictest0-21swapper/309:35:163
164669944968,169cyclictest0-21swapper/711:46:287
1646499447361,84cyclictest120242sleep508:46:265
164609944722,422cyclictest0-21swapper/110:41:191
1646199446103,340cyclictest0-21swapper/211:25:052
164669944561,210cyclictest0-21swapper/711:15:277
164599944523,338cyclictest0-21swapper/009:38:110
164659944422,256cyclictest0-21swapper/610:18:016
164649944460,253cyclictest24239-21diskmemload10:10:235
164649944460,253cyclictest24239-21diskmemload10:10:235
164649944322,83cyclictest121rcu_preempt10:27:475
164609944321,255cyclictest0-21swapper/112:45:121
164669944216,83cyclictest0-21swapper/711:05:197
164619944057,126cyclictest25156-21ssh09:50:102
164669943916,256cyclictest0-21swapper/712:45:127
164609943916,126cyclictest0-21swapper/108:00:271
164599943954,170cyclictest9-21ksoftirqd/011:05:050
164669943756,84cyclictest15850irq/123-ahci[0009:08:077
164669943756,84cyclictest15850irq/123-ahci[0009:08:077
164629943710,296cyclictest0-21swapper/309:50:083
16465994369,253cyclictest0-21swapper/611:42:376
164669943453,126cyclictest73-21ksoftirqd/707:14:267
16462994333,338cyclictest0-21swapper/308:40:033
16464994285,2cyclictest0-21swapper/509:38:305
16461994271,211cyclictest0-21swapper/208:35:492
16461994253,256cyclictest0-21swapper/211:05:112
1645999425169,84cyclictest121rcu_preempt10:35:060
16465994241,211cyclictest0-21swapper/609:10:126
164629942483,338cyclictest0-21swapper/307:25:123
164599942280,127cyclictest121rcu_preempt07:25:110
164639942185,81cyclictest0-21swapper/411:35:114
164609942140,296cyclictest0-21swapper/108:46:261
164599942180,338cyclictest0-21swapper/008:00:310
164639942081,84cyclictest0-21swapper/407:25:244
164619942039,176cyclictest0-21swapper/211:35:162
164669941981,84cyclictest0-21swapper/711:35:187
164599941880,335cyclictest0-21swapper/011:35:100
164599941877,338cyclictest0-21swapper/008:46:260
164659941777,338cyclictest0-21swapper/610:28:026
164659941776,338cyclictest0-21swapper/610:35:136
164659941737,256cyclictest0-21swapper/609:38:306
1646499417118,126cyclictest57-21ksoftirqd/512:45:155
1646399417203,83cyclictest0-21swapper/411:05:134
1646399417118,127cyclictest121rcu_preempt10:00:294
164629941636,211cyclictest0-21swapper/310:41:193
164609941675,338cyclictest0-21swapper/111:25:051
164639941576,84cyclictest0-21swapper/409:10:124
164659941474,168cyclictest121rcu_preempt11:25:046
164669941374,84cyclictest0-21swapper/709:50:107
164649941376,82cyclictest0-21swapper/510:41:245
164599941372,126cyclictest0-21swapper/010:50:030
1646699412113,126cyclictest0-21swapper/708:59:417
164659941170,338cyclictest0-21swapper/608:46:196
164639941169,126cyclictest49-21ksoftirqd/408:40:074
164639941072,84cyclictest0-21swapper/410:35:134
164609940925,126cyclictest25114-21taskset09:50:081
164629940866,339cyclictest0-21swapper/310:35:133
164619940867,125cyclictest0-21swapper/210:41:232
164659940768,84cyclictest0-21swapper/612:45:156
164669940668,83cyclictest0-21swapper/711:25:057
1646499400105,211cyclictest0-21swapper/508:27:105
164609940019,169cyclictest0-21swapper/107:25:181
164669939758,83cyclictest0-21swapper/710:35:147
164649939714,92cyclictest57-21ksoftirqd/510:35:115
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional