You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-16 - 16:14
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Jun 16, 2026 12:56:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
253069976282,677cyclictest0-21swapper/310:23:383
253069976282,677cyclictest0-21swapper/310:23:383
253069976282,677cyclictest0-21swapper/310:23:383
253069976282,677cyclictest0-21swapper/310:23:373
253069976282,677cyclictest0-21swapper/310:23:373
253069975070,677cyclictest0-21swapper/311:26:593
253069971172,84cyclictest0-21swapper/310:33:533
253049970928,127cyclictest0-21swapper/111:09:561
253039970570,126cyclictest0-21swapper/011:10:080
2530499677123,465cyclictest25301-21cyclictest10:32:191
2530399661192,296cyclictest20929-21sh10:53:490
253069965820,635cyclictest0-21swapper/309:42:323
253069965618,169cyclictest0-21swapper/309:53:143
253089965257,380cyclictest0-21swapper/510:31:405
253099964390,380cyclictest31324-21ssh10:03:316
2531099632121,508cyclictest0-21swapper/711:52:167
2531099632121,508cyclictest0-21swapper/711:52:167
2530999630122,296cyclictest0-21swapper/611:16:256
2530999630122,296cyclictest0-21swapper/611:16:256
2530699630123,296cyclictest0-21swapper/311:17:133
2530699630123,296cyclictest0-21swapper/311:17:133
2531099629206,126cyclictest1098-21kworker/7:010:34:007
2530999628117,508cyclictest0-21swapper/610:21:136
2530999628117,508cyclictest0-21swapper/610:21:136
2530999628117,508cyclictest0-21swapper/610:21:136
2530999628117,508cyclictest0-21swapper/610:21:126
2530999628117,508cyclictest0-21swapper/610:21:126
2530799622112,507cyclictest0-21swapper/411:52:154
2530799622112,507cyclictest0-21swapper/411:52:154
2531099620109,508cyclictest0-21swapper/710:51:287
2530599620197,380cyclictest0-21swapper/211:17:282
2530599620197,380cyclictest0-21swapper/211:17:282
253089961832,333cyclictest0-21swapper/511:10:265
253069961722,592cyclictest0-21swapper/312:12:413
253069961722,592cyclictest0-21swapper/312:12:413
253069961721,593cyclictest0-21swapper/309:46:353
253039961522,84cyclictest0-21swapper/010:17:210
253039961522,84cyclictest0-21swapper/010:17:210
253049961321,126cyclictest0-21swapper/109:13:301
253049961321,126cyclictest0-21swapper/109:13:301
2530399610184,295cyclictest0-21swapper/010:31:530
253069960413,508cyclictest0-21swapper/311:52:503
253069960413,508cyclictest0-21swapper/311:52:493
25307995971,337cyclictest0-21swapper/409:39:534
25306995971,126cyclictest0-21swapper/310:54:533
25309995960,84cyclictest0-21swapper/608:00:016
25310995940,84cyclictest0-21swapper/710:20:417
25310995940,84cyclictest0-21swapper/710:20:417
25310995940,84cyclictest0-21swapper/710:20:417
25310995940,84cyclictest0-21swapper/710:20:417
25310995940,84cyclictest0-21swapper/710:20:407
25306995940,84cyclictest23482-21idleruntime-cro08:00:013
253099959340,380cyclictest0-21swapper/610:17:486
253099959340,380cyclictest0-21swapper/610:17:486
2530899590122,296cyclictest12979-21ssh09:51:465
253069958834,84cyclictest0-21swapper/310:44:583
253069958834,84cyclictest0-21swapper/310:44:573
253089958780,84cyclictest0-21swapper/511:20:135
253089958574,126cyclictest0-21swapper/509:44:575
253039958572,382cyclictest0-21swapper/010:43:350
253039958572,382cyclictest0-21swapper/010:43:350
253069958431,550cyclictest0-21swapper/312:03:463
253049958372,338cyclictest0-21swapper/111:52:451
253049958372,338cyclictest0-21swapper/111:52:451
2530499582116,84cyclictest121rcu_preempt07:58:131
253039958271,296cyclictest0-21swapper/009:53:210
253089958171,507cyclictest0-21swapper/510:21:135
253089958171,507cyclictest0-21swapper/510:21:135
253089958171,507cyclictest0-21swapper/510:21:135
253089958171,507cyclictest0-21swapper/510:21:125
253089958171,507cyclictest0-21swapper/510:21:125
253049958131,126cyclictest0-21swapper/109:51:391
2530399580494,84cyclictest111rcuc/011:28:110
253109957871,253cyclictest73-21ksoftirqd/709:46:137
253089957665,508cyclictest0-21swapper/511:52:165
253089957665,508cyclictest0-21swapper/511:52:165
253069957520,423cyclictest0-21swapper/311:20:133
253109957420,296cyclictest0-21swapper/711:19:017
253109957420,296cyclictest0-21swapper/711:19:017
253079957468,84cyclictest0-21swapper/410:43:454
253079957468,84cyclictest0-21swapper/410:43:444
253099957062,84cyclictest121rcu_preempt12:14:046
253099957062,84cyclictest121rcu_preempt12:14:046
253069957021,3cyclictest0-21swapper/311:09:593
253059957059,296cyclictest0-21swapper/208:25:232
253049957015,507cyclictest0-21swapper/109:38:431
253039956714,127cyclictest9005-21latency_hist09:15:010
253039956714,127cyclictest9005-21latency_hist09:15:000
2530999562523,3cyclictest631rcuc/609:41:436
25309995596,299cyclictest0-21swapper/612:33:436
253089955991,295cyclictest0-21swapper/512:32:505
25304995563,380cyclictest0-21swapper/110:23:331
25304995563,380cyclictest0-21swapper/110:23:331
25304995563,380cyclictest0-21swapper/110:23:331
25304995563,380cyclictest0-21swapper/110:23:321
25304995563,380cyclictest0-21swapper/110:23:321
25303995540,84cyclictest0-21swapper/009:45:280
25305995532,126cyclictest29928-21diskmemload10:01:402
25310995520,296cyclictest121rcu_preempt11:27:457
25305995521,126cyclictest0-21swapper/210:43:092
25305995521,126cyclictest0-21swapper/210:43:082
253079955042,126cyclictest0-21swapper/410:51:294
253069955082,465cyclictest0-21swapper/309:39:363
253109954879,211cyclictest73-21ksoftirqd/709:38:577
253069954735,85cyclictest0-21swapper/310:18:383
253069954735,85cyclictest0-21swapper/310:18:383
253099954677,380cyclictest0-21swapper/611:07:556
253059954677,338cyclictest25351-21cut08:00:202
253059954677,338cyclictest25351-21cut08:00:202
2531099545246,296cyclictest24274-1kworker/u17:109:43:597
253049954436,41cyclictest121rcu_preempt11:43:231
2530399544457,84cyclictest101ktimersoftd/009:39:530
253079954379,84cyclictest25301-21cyclictest07:58:134
2530899541119,84cyclictest25301-21cyclictest09:38:525
253039954131,507cyclictest0-21swapper/010:21:130
253039954131,507cyclictest0-21swapper/010:21:130
253039954131,507cyclictest0-21swapper/010:21:130
253039954131,507cyclictest0-21swapper/010:21:120
253039954131,507cyclictest0-21swapper/010:21:120
253099953932,338cyclictest18420-21df_abs11:10:116
253099953730,423cyclictest0-21swapper/610:52:036
253059953770,84cyclictest0-21swapper/212:32:512
253099953630,211cyclictest0-21swapper/609:54:116
253039953672,253cyclictest0-21swapper/010:55:100
2530999533193,338cyclictest25301-21cyclictest09:14:076
2530999533193,338cyclictest25301-21cyclictest09:14:076
253059953319,127cyclictest0-21swapper/210:24:092
253059953319,127cyclictest0-21swapper/210:24:092
253059953319,127cyclictest0-21swapper/210:24:092
253059953319,127cyclictest0-21swapper/210:24:092
253059953319,127cyclictest0-21swapper/210:24:082
2530899532110,339cyclictest0-21swapper/510:18:125
2530899532110,339cyclictest0-21swapper/510:18:115
253049953225,253cyclictest0-21swapper/109:45:291
253049953120,338cyclictest0-21swapper/112:33:581
2530799530190,337cyclictest64450irq/122-eth009:15:214
2530599530190,338cyclictest17388-21kworker/u16:209:41:582
253059952921,126cyclictest0-21swapper/209:45:452
253039952961,211cyclictest307-21ssh11:17:560
253039952961,211cyclictest307-21ssh11:17:560
253059952821,338cyclictest0-21swapper/211:27:512
2530799527187,338cyclictest64450irq/122-eth009:44:594
253069952713,511cyclictest0-21swapper/309:15:213
253109952618,296cyclictest0-21swapper/707:57:277
253039952657,337cyclictest0-21swapper/010:01:410
253089952516,169cyclictest3542-21ssh10:43:255
253089952516,169cyclictest3542-21ssh10:43:245
253049952518,42cyclictest0-21swapper/110:44:011
253049952518,42cyclictest0-21swapper/110:44:011
253079952416,84cyclictest0-21swapper/411:26:484
253079952416,126cyclictest121rcu_preempt10:18:254
253079952416,126cyclictest121rcu_preempt10:18:244
253049952110,84cyclictest121rcu_preempt12:13:581
253049952110,84cyclictest121rcu_preempt12:13:581
2530499519476,41cyclictest231rcuc/111:25:531
25309995189,126cyclictest0-21swapper/609:46:236
253059951848,170cyclictest650-21diskmemload11:20:332
253059951810,126cyclictest0-21swapper/210:51:292
253049951710,338cyclictest0-21swapper/109:42:521
25303995167,169cyclictest0-21swapper/011:07:250
25310995136,2cyclictest31569-21ssh10:03:547
253099951291,84cyclictest0-21swapper/610:43:456
253099951291,84cyclictest0-21swapper/610:43:456
25306995121,169cyclictest0-21swapper/310:02:023
253059951244,296cyclictest0-21swapper/210:18:252
253059951244,296cyclictest0-21swapper/210:18:242
25305995101,126cyclictest0-21swapper/210:31:542
25305995100,84cyclictest6124-21sshd08:23:482
25304995100,46cyclictest0-21swapper/111:20:331
253099950940,338cyclictest0-21swapper/611:27:196
25304995091,84cyclictest0-21swapper/109:55:201
253089950882,253cyclictest0-21swapper/508:24:155
25307995080,84cyclictest0-21swapper/408:23:494
25304995081,262cyclictest0-21swapper/108:24:181
25304995071,126cyclictest0-21swapper/110:55:101
253079950583,84cyclictest0-21swapper/409:52:444
2530899504122,84cyclictest0-21swapper/511:26:035
253079950480,211cyclictest0-21swapper/411:18:404
253079950480,211cyclictest0-21swapper/411:18:404
2530499503417,84cyclictest231rcuc/110:03:251
2530399503246,254cyclictest31453-21ssh11:52:520
2530399503246,254cyclictest31453-21ssh11:52:520
2530399503163,338cyclictest6385-21kworker/u16:312:13:020
2530399503163,338cyclictest6385-21kworker/u16:312:13:020
253069950232,127cyclictest0-21swapper/309:12:453
253069950232,127cyclictest0-21swapper/309:12:443
2530599502161,126cyclictest121rcu_preempt09:54:262
253039950281,124cyclictest121rcu_preempt09:55:190
253109950132,85cyclictest0-21swapper/710:43:437
253109950132,85cyclictest0-21swapper/710:43:427
253099950178,339cyclictest0-21swapper/610:31:126
2530899501119,338cyclictest0-21swapper/510:54:315
253039950175,211cyclictest0-21swapper/008:25:160
253079950078,126cyclictest121rcu_preempt10:22:284
253079950078,126cyclictest121rcu_preempt10:22:284
253079950078,126cyclictest121rcu_preempt10:22:284
253079950078,126cyclictest121rcu_preempt10:22:274
253079950078,126cyclictest121rcu_preempt10:22:274
253069950034,463cyclictest6055-21taskset08:22:453
253059950032,126cyclictest121rcu_preempt11:08:382
253089949972,253cyclictest0-21swapper/509:45:445
253099949876,84cyclictest0-21swapper/609:39:066
253069949876,338cyclictest0-21swapper/308:25:233
253039949871,211cyclictest9578-21cat09:15:140
253049949731,84cyclictest0-21swapper/111:17:551
253049949731,84cyclictest0-21swapper/111:17:551
253099949674,84cyclictest0-21swapper/609:55:206
2530899495240,253cyclictest561ktimersoftd/509:14:275
2530899495240,253cyclictest561ktimersoftd/509:14:265
2530999494110,381cyclictest0-21swapper/611:52:166
2530999494110,381cyclictest0-21swapper/611:52:166
253089949430,297cyclictest0-21swapper/511:18:335
253089949430,297cyclictest0-21swapper/511:18:335
253079949371,84cyclictest0-21swapper/410:03:004
253049949328,255cyclictest0-21swapper/112:02:421
253079949270,84cyclictest0-21swapper/409:46:084
253059949269,84cyclictest0-21swapper/211:52:442
253059949269,84cyclictest0-21swapper/211:52:442
253079948964,422cyclictest0-21swapper/411:20:344
253069948920,466cyclictest0-21swapper/310:55:123
253039948924,84cyclictest0-21swapper/012:03:090
253079948866,126cyclictest0-21swapper/409:55:194
253079948822,50cyclictest0-21swapper/410:35:054
253059948822,126cyclictest0-21swapper/212:03:272
253109948761,211cyclictest0-21swapper/709:15:327
2531099487191,92cyclictest0-21swapper/711:20:247
253079948768,81cyclictest0-21swapper/412:12:424
253079948768,81cyclictest0-21swapper/412:12:424
253079948722,42cyclictest0-21swapper/410:33:304
253069948765,84cyclictest0-21swapper/309:55:193
253069948617,466cyclictest0-21swapper/312:33:123
2530499486106,84cyclictest0-21swapper/109:15:171
2530399486314,84cyclictest4170-21ssh11:20:230
253079948520,84cyclictest0-21swapper/411:10:094
253039948519,295cyclictest0-21swapper/008:48:560
253089948462,2cyclictest30913-21ssh10:02:545
2530499483100,126cyclictest121rcu_preempt10:17:271
2530499483100,126cyclictest121rcu_preempt10:17:271
253059948255,296cyclictest0-21swapper/209:55:202
2530799481353,126cyclictest471rcuc/409:12:454
2530799481353,126cyclictest471rcuc/409:12:444
25303994759,211cyclictest0-21swapper/009:43:590
25305994745,297cyclictest25301-21cyclictest12:13:432
25305994745,297cyclictest25301-21cyclictest12:13:432
253079947250,255cyclictest0-21swapper/411:09:414
253099947047,169cyclictest0-21swapper/611:20:276
253089946947,3cyclictest25301-21cyclictest09:15:155
253059946782,169cyclictest0-21swapper/207:59:212
25304994671,42cyclictest121rcu_preempt08:48:561
2531099466125,338cyclictest0-21swapper/709:51:187
2530499465124,338cyclictest0-21swapper/112:23:251
2530499465124,338cyclictest0-21swapper/111:10:281
2530499465124,338cyclictest0-21swapper/110:52:111
2530899464123,338cyclictest0-21swapper/511:44:175
253109946336,211cyclictest0-21swapper/708:24:547
2530999462124,296cyclictest0-21swapper/609:15:146
253079946235,209cyclictest49-21ksoftirqd/412:23:074
253069946235,84cyclictest0-21swapper/311:43:373
2530599462164,126cyclictest121rcu_preempt09:39:032
2530899461209,126cyclictest121rcu_preempt09:55:085
2530799461120,253cyclictest0-21swapper/412:03:274
253109946076,211cyclictest0-21swapper/710:18:267
253109946076,211cyclictest0-21swapper/710:18:267
2531099460119,211cyclictest121rcu_preempt09:13:567
2531099460119,211cyclictest121rcu_preempt09:13:557
2530899460121,337cyclictest0-21swapper/512:13:595
2530899460121,337cyclictest0-21swapper/512:13:595
2530499460122,254cyclictest7947-21/usr/sbin/munin08:25:221
2530899459120,84cyclictest0-21swapper/512:23:255
253059945975,211cyclictest33-21ksoftirqd/210:45:062
253109945730,211cyclictest73-21ksoftirqd/712:12:447
253109945730,211cyclictest73-21ksoftirqd/712:12:447
253089945730,253cyclictest0-21swapper/508:25:245
2530599457201,126cyclictest20132-1kworker/u17:212:23:262
253109945630,211cyclictest0-21swapper/711:08:197
2531099456113,340cyclictest13319-21nscd10:45:107
253089945634,252cyclictest0-21swapper/508:00:195
253089945634,252cyclictest0-21swapper/508:00:195
2530699456161,87cyclictest25338-21needreboot08:00:213
2530699456161,87cyclictest25338-21needreboot08:00:203
253079945529,254cyclictest0-21swapper/412:33:044
2530499455115,338cyclictest0-21swapper/110:25:101
253069945432,2cyclictest0-21swapper/310:35:073
253069945428,423cyclictest0-21swapper/308:49:023
253049945432,255cyclictest0-21swapper/110:35:071
2530899453115,83cyclictest0-21swapper/511:09:195
2530899453113,337cyclictest0-21swapper/510:45:135
2530799453112,338cyclictest0-21swapper/410:25:114
2530799453112,338cyclictest0-21swapper/408:25:134
253069945331,338cyclictest0-21swapper/310:25:083
2530599453111,211cyclictest0-21swapper/209:14:472
2530599453111,211cyclictest0-21swapper/209:14:472
253069945272,296cyclictest0-21swapper/311:10:353
253059945028,84cyclictest0-21swapper/211:10:092
253109944964,211cyclictest73-21ksoftirqd/712:32:487
253089944970,295cyclictest0-21swapper/508:48:555
253079944925,210cyclictest0-21swapper/411:44:044
253059944666,84cyclictest0-21swapper/209:15:172
253089944564,211cyclictest0-21swapper/507:59:055
253059944215,211cyclictest0-21swapper/208:48:212
253039944060,41cyclictest121rcu_preempt11:43:350
253039944018,256cyclictest0-21swapper/007:59:510
253059943711,296cyclictest0-21swapper/211:44:112
253109943612,84cyclictest121rcu_preempt08:48:487
25303994348,84cyclictest0-21swapper/012:34:420
25304994339,84cyclictest0-21swapper/110:45:131
253079943192,84cyclictest25301-21cyclictest08:47:194
253039943146,211cyclictest24845-21tail08:00:160
253039943146,211cyclictest24845-21tail08:00:150
25307994286,211cyclictest0-21swapper/410:55:114
25303994275,84cyclictest0-21swapper/008:24:310
253109942583,339cyclictest0-21swapper/711:43:487
253109942483,338cyclictest0-21swapper/710:35:087
253109942482,339cyclictest0-21swapper/712:23:137
253099942483,339cyclictest0-21swapper/608:47:436
253099942483,338cyclictest0-21swapper/608:22:156
2530399424338,83cyclictest101ktimersoftd/012:23:370
253099942383,338cyclictest0-21swapper/610:45:126
253099942383,126cyclictest0-21swapper/612:02:336
253099942381,339cyclictest0-21swapper/608:25:236
253099942283,84cyclictest0-21swapper/612:23:046
253099942282,338cyclictest0-21swapper/611:43:306
253039942282,338cyclictest0-21swapper/010:35:120
253109942181,338cyclictest0-21swapper/711:10:327
253069942181,84cyclictest0-21swapper/312:23:033
253039942182,337cyclictest0-21swapper/010:45:140
253099942040,296cyclictest0-21swapper/610:55:096
253079942037,210cyclictest0-21swapper/408:00:154
253079942037,210cyclictest0-21swapper/408:00:154
253109941978,338cyclictest0-21swapper/710:25:117
253109941877,338cyclictest0-21swapper/710:55:127
253089941838,8cyclictest121rcu_preempt12:03:425
253099941777,338cyclictest0-21swapper/610:35:066
253099941673,211cyclictest65-21ksoftirqd/608:00:156
253099941673,211cyclictest65-21ksoftirqd/608:00:156
253099941637,295cyclictest0-21swapper/610:25:116
253069941675,338cyclictest0-21swapper/310:45:053
253039941675,338cyclictest3134-21apt-get10:25:100
253109941473,338cyclictest0-21swapper/709:55:047
253089941434,295cyclictest0-21swapper/510:55:155
253109941372,338cyclictest0-21swapper/712:03:207
253079941272,84cyclictest0-21swapper/410:45:114
253049941232,296cyclictest0-21swapper/108:00:211
253049941232,296cyclictest0-21swapper/108:00:201
253089940969,338cyclictest0-21swapper/510:25:125
253109940867,338cyclictest0-21swapper/708:25:167
253059940465,84cyclictest0-21swapper/210:55:112
253059939960,84cyclictest0-21swapper/210:25:102
25310993871,42cyclictest0-21swapper/708:00:197
25310993871,42cyclictest0-21swapper/708:00:187
253089938141,338cyclictest0-21swapper/510:35:115
2530599369115,8cyclictest20248-21ssh10:35:052
2476828453,28sleep20-21swapper/207:08:292
2482028351,28sleep70-21swapper/707:09:147
2464028351,28sleep60-21swapper/607:06:406
2456728256,23sleep00-21swapper/007:05:380
2227528252,27sleep30-21swapper/307:05:083
2483728149,28sleep40-21swapper/407:09:264
2472027949,27sleep10-21swapper/107:07:481
2455427948,27sleep50-21swapper/507:05:275
25309996228,22cyclictest0-21swapper/612:36:056
2530699601,31cyclictest0-21swapper/312:36:053
183812530,2sleep70-21swapper/712:40:137
25309995221,27cyclictest8589-21grep12:15:326
25309995119,28cyclictest18496-21expr12:40:136
252072500,4sleep72531099cyclictest12:25:167
25309994818,26cyclictest3692-21awk11:55:256
25308994740,4cyclictest561ktimersoftd/512:36:355
25309994621,21cyclictest26122-21strings12:25:246
25305994616,21cyclictest33-21ksoftirqd/212:25:222
25303994536,6cyclictest10526-21tr12:35:140
25305994413,3cyclictest311rcuc/211:30:052
25308994337,4cyclictest561ktimersoftd/511:30:205
25307994337,3cyclictest136032sleep412:36:094
2530599423,35cyclictest0-21swapper/212:15:022
25305994212,27cyclictest0-21swapper/212:36:082
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional