You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 10:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon Apr 06, 2026 00:57:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
298209987573,718cyclictest0-21swapper/421:13:044
298209979573,84cyclictest0-21swapper/422:37:004
298209979170,718cyclictest0-21swapper/400:17:224
29820997652,760cyclictest0-21swapper/423:32:224
29816997620,126cyclictest16682-21ssh22:49:430
298209972288,549cyclictest0-21swapper/421:32:314
298209972288,549cyclictest0-21swapper/421:32:314
298209972288,549cyclictest0-21swapper/421:32:314
298209972288,549cyclictest0-21swapper/421:32:314
298219971682,84cyclictest121rcu_preempt22:46:495
2982099712118,591cyclictest0-21swapper/422:28:084
2982099712118,591cyclictest0-21swapper/422:28:084
298209970063,634cyclictest0-21swapper/421:18:334
29821996814,84cyclictest24698-1kworker/u17:022:37:005
298229967376,381cyclictest0-21swapper/622:32:556
298209967277,592cyclictest0-21swapper/423:10:164
2982299670116,339cyclictest0-21swapper/600:12:516
2982299670116,339cyclictest0-21swapper/600:12:516
2982299665111,381cyclictest0-21swapper/623:24:246
298209965721,549cyclictest0-21swapper/422:32:554
298209965619,600cyclictest0-21swapper/400:29:594
2981899655104,84cyclictest121rcu_preempt21:33:412
2981899655104,84cyclictest121rcu_preempt21:33:412
2981899655104,84cyclictest121rcu_preempt21:33:412
2981899655104,84cyclictest121rcu_preempt21:33:412
298239964453,126cyclictest0-21swapper/700:29:007
29819996411,386cyclictest0-21swapper/322:31:193
2981799637168,292cyclictest0-21swapper/121:14:521
29817996360,84cyclictest0-21swapper/121:18:331
298189963583,126cyclictest0-21swapper/222:20:132
298179963178,380cyclictest0-21swapper/121:55:381
298189962673,211cyclictest0-21swapper/220:24:522
2982099625157,338cyclictest4962-21diskmemload22:48:454
2981799622113,127cyclictest15555-21ssh00:19:301
298189962171,126cyclictest0-21swapper/222:00:062
298239961364,211cyclictest0-21swapper/723:56:417
298189961099,296cyclictest0-21swapper/221:59:492
298169960858,126cyclictest0-21swapper/022:33:190
29820996002,550cyclictest0-21swapper/423:59:054
29822995940,84cyclictest0-21swapper/621:59:016
29816995930,84cyclictest0-21swapper/021:18:330
298219959284,127cyclictest0-21swapper/500:37:555
29821995920,83cyclictest0-21swapper/522:28:455
29821995920,83cyclictest0-21swapper/522:28:455
2982199591125,211cyclictest0-21swapper/523:58:255
2982299590120,253cyclictest4962-21diskmemload23:57:456
298229958776,338cyclictest121rcu_preempt23:41:496
298219958780,84cyclictest0-21swapper/521:23:245
2982199586117,466cyclictest0-21swapper/523:25:225
298199958633,380cyclictest0-21swapper/321:21:583
2981799583113,296cyclictest0-21swapper/122:19:331
298189958173,126cyclictest0-21swapper/223:43:472
298219958069,380cyclictest0-21swapper/500:18:405
298179958027,380cyclictest0-21swapper/122:35:301
298209957926,550cyclictest0-21swapper/421:21:174
298169957871,211cyclictest0-21swapper/022:50:190
298209957624,549cyclictest0-21swapper/423:49:384
298209957523,549cyclictest0-21swapper/423:25:104
2981999573102,381cyclictest0-21swapper/300:37:553
298199957160,85cyclictest0-21swapper/300:15:233
298189957121,126cyclictest0-21swapper/222:35:042
298209956816,549cyclictest0-21swapper/400:37:084
298199956798,338cyclictest698-21ptp4l21:55:573
298179956713,380cyclictest0-21swapper/123:58:121
298239956611,381cyclictest0-21swapper/721:14:527
298179956516,84cyclictest0-21swapper/122:29:331
298179956516,84cyclictest0-21swapper/122:29:331
2981699565100,126cyclictest121rcu_preempt23:49:190
298169955889,338cyclictest15024-21rm00:18:390
29816995587,84cyclictest0-21swapper/021:14:520
2982099554214,338cyclictest64450irq/122-eth023:41:534
29816995541,126cyclictest0-21swapper/023:35:210
298209955341,464cyclictest0-21swapper/421:56:274
298199955286,84cyclictest0-21swapper/321:33:443
298199955286,84cyclictest0-21swapper/321:33:443
298199955286,84cyclictest0-21swapper/321:33:443
298199955286,84cyclictest0-21swapper/321:33:443
29818995521,84cyclictest0-21swapper/223:49:452
298169955283,253cyclictest23707-21munin-run23:10:040
298169955283,253cyclictest23707-21munin-run23:10:040
2981999551124,296cyclictest4962-21diskmemload23:48:083
29817995511,126cyclictest0-21swapper/123:25:181
29817995510,84cyclictest0-21swapper/120:27:331
2981899548210,83cyclictest1557-1kworker/u17:123:58:252
2981699548124,126cyclictest4962-21diskmemload00:36:560
298189954740,296cyclictest0-21swapper/222:32:422
298169954778,126cyclictest0-21swapper/019:53:430
298189954533,296cyclictest0-21swapper/223:24:472
2982399544461,3cyclictest711rcuc/723:41:517
298179954332,126cyclictest0-21swapper/123:49:561
2982199542120,256cyclictest0-21swapper/523:10:105
298209954232,507cyclictest0-21swapper/422:20:234
298189954276,126cyclictest0-21swapper/221:16:302
298189954274,211cyclictest0-21swapper/222:50:172
2982399541458,3cyclictest711rcuc/720:25:177
298189954131,338cyclictest698-21ptp4l00:29:312
2981899541114,211cyclictest33-21ksoftirqd/200:17:592
2981699541117,128cyclictest0-21swapper/022:27:450
2981699541117,128cyclictest0-21swapper/022:27:450
298229954032,84cyclictest0-21swapper/600:18:396
298209953829,425cyclictest0-21swapper/400:12:554
298209953829,425cyclictest0-21swapper/400:12:554
298189953831,338cyclictest0-21swapper/220:25:492
2981899538114,127cyclictest0-21swapper/200:37:112
2982399537115,338cyclictest0-21swapper/721:21:087
2982299537196,338cyclictest30152-21nscd22:26:456
2982299537196,338cyclictest30152-21nscd22:26:456
298209953726,508cyclictest0-21swapper/422:50:224
2981999536237,296cyclictest704-21nscd21:25:103
2981799536113,256cyclictest0-21swapper/123:10:101
298179953569,169cyclictest0-21swapper/122:49:551
2981899534491,41cyclictest311rcuc/223:35:242
298169953223,126cyclictest0-21swapper/023:58:270
298169953163,338cyclictest0-21swapper/022:35:220
298199953062,465cyclictest0-21swapper/323:23:323
298199953018,84cyclictest121rcu_preempt22:28:383
298199953018,84cyclictest121rcu_preempt22:28:383
2981899529102,256cyclictest121rcu_preempt21:25:022
298179952919,41cyclictest121rcu_preempt00:29:111
2982099528103,422cyclictest64450irq/122-eth023:23:144
298179952819,127cyclictest0-21swapper/122:30:401
298239952718,84cyclictest121rcu_preempt23:50:117
2981899527100,254cyclictest0-21swapper/223:33:482
298169952721,169cyclictest9-21ksoftirqd/000:26:190
2982399525481,41cyclictest711rcuc/723:23:527
298219952514,338cyclictest722-21nscd21:53:375
298209952518,127cyclictest0-21swapper/421:54:364
298209952515,507cyclictest0-21swapper/421:25:144
298199952454,381cyclictest121rcu_preempt21:54:243
298199952415,84cyclictest0-21swapper/300:28:393
2981899524140,126cyclictest121rcu_preempt22:46:142
298179952417,84cyclictest0-21swapper/123:24:411
298209952215,427cyclictest0-21swapper/419:53:394
298179952222,161cyclictest121rcu_preempt21:33:231
298179952222,161cyclictest121rcu_preempt21:33:231
298179952222,161cyclictest121rcu_preempt21:33:231
298179952222,161cyclictest121rcu_preempt21:33:231
298209952111,507cyclictest0-21swapper/420:24:554
298169952155,126cyclictest0-21swapper/021:54:430
298229952051,211cyclictest631rcuc/623:45:306
298169952097,126cyclictest0-21swapper/021:55:470
298169951951,380cyclictest0-21swapper/021:21:180
29819995176,296cyclictest0-21swapper/322:18:323
298239951588,126cyclictest0-21swapper/722:00:057
298189951145,84cyclictest0-21swapper/221:14:562
29822995100,84cyclictest0-21swapper/621:24:576
29823995090,84cyclictest0-21swapper/721:19:057
29816995091,84cyclictest0-21swapper/020:25:130
29816995090,84cyclictest0-21swapper/023:25:210
298239950881,296cyclictest0-21swapper/723:34:267
2982399508168,338cyclictest2833-21kworker/u16:323:47:337
298229950842,211cyclictest29814-21cyclictest21:15:516
29821995081,88cyclictest9427-21ssh21:32:025
29821995081,88cyclictest9427-21ssh21:32:025
29821995081,88cyclictest9427-21ssh21:32:025
29821995081,88cyclictest9427-21ssh21:32:025
2981999508169,84cyclictest29814-21cyclictest22:47:313
29819995081,261cyclictest0-21swapper/322:00:143
298189950882,211cyclictest0-21swapper/219:55:092
29823995071,341cyclictest0-21swapper/721:25:137
29821995071,3cyclictest121rcu_preempt21:56:275
2982199506125,84cyclictest0-21swapper/520:29:015
2981699505117,211cyclictest11254-21ssh21:34:110
2981699505117,211cyclictest11254-21ssh21:34:110
2981699505117,211cyclictest11254-21ssh21:34:110
2981699505117,211cyclictest11254-21ssh21:34:110
298219950381,84cyclictest0-21swapper/522:00:095
298179950280,84cyclictest0-21swapper/123:33:591
298239950073,424cyclictest0-21swapper/700:13:457
298239950073,424cyclictest0-21swapper/700:13:457
2981799500247,50cyclictest0-21swapper/121:23:591
298209949931,127cyclictest0-21swapper/423:50:164
298209949830,465cyclictest0-21swapper/420:29:534
298219949771,211cyclictest0-21swapper/500:26:535
2981999497113,211cyclictest12161-21ssh23:57:533
298219949674,84cyclictest0-21swapper/520:24:065
2981799494321,84cyclictest0-21swapper/100:00:161
2981799494111,380cyclictest0-21swapper/120:23:041
298169949428,84cyclictest0-21swapper/021:35:120
2981699494110,126cyclictest121rcu_preempt20:30:200
2982199493238,253cyclictest561ktimersoftd/523:49:455
2981999493109,126cyclictest0-21swapper/321:14:393
298179949370,211cyclictest0-21swapper/100:14:041
298179949370,211cyclictest0-21swapper/100:14:041
298209949223,466cyclictest64450irq/122-eth023:09:084
298209949223,466cyclictest64450irq/122-eth023:09:084
298239949167,169cyclictest0-21swapper/722:32:297
2982399491148,340cyclictest724-21nscd22:36:127
298219949126,331cyclictest0-21swapper/500:40:145
298209949026,385cyclictest0-21swapper/400:20:244
298229948919,211cyclictest641ktimersoftd/621:13:376
298179948928,164cyclictest0-21swapper/123:43:221
298179948924,50cyclictest19802-21awk21:55:031
298209948820,294cyclictest0-21swapper/422:00:164
298179948765,256cyclictest29814-21cyclictest00:40:131
298199948621,299cyclictest0-21swapper/322:35:183
2981999486101,253cyclictest0-21swapper/323:42:103
298229948561,84cyclictest121rcu_preempt00:20:286
2982199485145,337cyclictest0-21swapper/523:44:135
2982399484440,42cyclictest711rcuc/722:18:327
2981899484143,338cyclictest19777-21awk21:55:012
298189948414,256cyclictest0-21swapper/221:23:592
298179948318,85cyclictest0-21swapper/123:35:231
2982399482141,338cyclictest704-21nscd22:26:477
2982399482141,338cyclictest704-21nscd22:26:477
298219948219,46cyclictest0-21swapper/523:35:345
298209948259,339cyclictest0-21swapper/420:30:214
2981999480396,4cyclictest391rcuc/300:00:163
298239947953,423cyclictest0-21swapper/721:55:007
298169947953,211cyclictest9-21ksoftirqd/023:33:380
298239947856,43cyclictest0-21swapper/723:10:107
298239947749,211cyclictest0-21swapper/700:20:077
298209947710,464cyclictest0-21swapper/400:00:284
2982399476178,296cyclictest15850irq/123-ahci[0022:49:557
29821994756,296cyclictest0-21swapper/522:30:335
298229947351,84cyclictest0-21swapper/621:35:116
2982399472386,84cyclictest711rcuc/700:19:277
298229947249,84cyclictest0-21swapper/623:33:246
29820994714,464cyclictest64450irq/122-eth023:35:144
298239946942,211cyclictest24791-21ssh21:58:237
29822994680,84cyclictest25205-21grep23:10:176
298219946883,211cyclictest18901-21ssh00:20:385
2982199468169,84cyclictest121rcu_preempt00:13:455
2982199468169,84cyclictest121rcu_preempt00:13:455
298189946840,296cyclictest0-21swapper/222:27:452
298189946840,296cyclictest0-21swapper/222:27:452
298199946782,211cyclictest1553-21runrttasks20:24:353
298179946781,211cyclictest0-21swapper/121:35:131
2982399466125,338cyclictest0-21swapper/700:38:137
298229946683,380cyclictest0-21swapper/622:49:276
2981999466210,127cyclictest121rcu_preempt23:33:093
2982299465212,168cyclictest641ktimersoftd/622:50:196
2982199465124,126cyclictest0-21swapper/522:19:225
2981799465124,338cyclictest0-21swapper/122:20:261
2981799465124,338cyclictest0-21swapper/100:37:421
298229946382,211cyclictest0-21swapper/600:29:416
2982199463121,339cyclictest0-21swapper/521:16:145
298189946341,256cyclictest0-21swapper/200:20:392
298179946379,296cyclictest0-21swapper/119:54:521
298169946382,168cyclictest0-21swapper/023:43:440
2982399462207,253cyclictest721ktimersoftd/721:32:137
2982399462207,253cyclictest721ktimersoftd/721:32:127
2982399462207,253cyclictest721ktimersoftd/721:32:127
2982399462207,253cyclictest721ktimersoftd/721:32:127
298229946239,126cyclictest0-21swapper/622:37:076
2982299462121,338cyclictest0-21swapper/620:26:036
298209946283,295cyclictest0-21swapper/421:35:114
298209946240,171cyclictest0-21swapper/400:30:134
2982399461120,338cyclictest0-21swapper/722:50:297
2982199461162,126cyclictest121rcu_preempt21:14:395
2982199461120,338cyclictest0-21swapper/519:52:475
298189946133,253cyclictest0-21swapper/223:08:442
298189946133,253cyclictest0-21swapper/223:08:442
2981999460119,338cyclictest0-21swapper/321:15:363
298229945979,296cyclictest0-21swapper/619:55:026
298199945976,210cyclictest41-21ksoftirqd/300:14:153
298199945976,210cyclictest41-21ksoftirqd/300:14:153
2981999459117,211cyclictest41-21ksoftirqd/320:25:183
298169945978,84cyclictest0-21swapper/000:20:320
298229945874,211cyclictest10276-21ssh21:32:586
298229945874,211cyclictest10276-21ssh21:32:586
298229945874,211cyclictest10276-21ssh21:32:586
298229945874,211cyclictest10276-21ssh21:32:586
2982199458118,336cyclictest0-21swapper/523:31:575
2981699458117,126cyclictest0-21swapper/022:20:030
298229945735,3cyclictest0-21swapper/600:37:476
2981999457115,253cyclictest121rcu_preempt23:09:503
2981999457115,253cyclictest121rcu_preempt23:09:503
298189945773,296cyclictest0-21swapper/221:35:122
2981799457116,338cyclictest0-21swapper/123:10:041
2981799457116,338cyclictest0-21swapper/123:10:041
2981999456115,339cyclictest0-21swapper/322:50:283
298219945571,85cyclictest0-21swapper/521:35:145
298239945428,83cyclictest121rcu_preempt00:40:257
298199945474,296cyclictest0-21swapper/319:55:023
2981999454112,84cyclictest0-21swapper/323:35:343
2981999453116,84cyclictest18432-21sed00:20:323
2982399452408,42cyclictest711rcuc/719:53:407
2982399452111,338cyclictest2216-21diskstats22:20:137
298219945272,84cyclictest0-21swapper/523:24:245
2982099452200,170cyclictest64450irq/122-eth000:40:064
2982199451110,338cyclictest0-21swapper/500:00:115
298169945078,161cyclictest1696-21ssh00:30:130
298239944969,296cyclictest0-21swapper/721:35:117
298219944929,289cyclictest0-21swapper/522:50:295
298189944765,379cyclictest0-21swapper/200:13:452
298189944765,379cyclictest0-21swapper/200:13:452
298209944624,126cyclictest31293-21apt-get22:40:024
2981799444103,126cyclictest25-21ksoftirqd/122:50:161
298219944316,212cyclictest0-21swapper/522:40:055
2981799443102,338cyclictest0-21swapper/100:20:141
2982399442101,338cyclictest0-21swapper/723:35:247
298229944215,211cyclictest14925-21smartctl20:30:176
298179944216,253cyclictest0-21swapper/120:30:131
298199944199,339cyclictest0-21swapper/323:10:163
298199944119,256cyclictest0-21swapper/323:25:203
298179944115,253cyclictest0-21swapper/122:00:051
2981899440268,83cyclictest14864-21fschecks_count00:00:182
298169943958,126cyclictest0-21swapper/022:00:050
298239943814,84cyclictest0-21swapper/700:00:227
298179943897,126cyclictest121rcu_preempt23:50:031
298169943857,83cyclictest0-21swapper/023:50:110
2982299437142,211cyclictest29814-21cyclictest00:00:146
298169943715,46cyclictest0-21swapper/000:13:330
298169943715,46cyclictest0-21swapper/000:13:330
298229943594,339cyclictest29814-21cyclictest22:18:326
298189943511,84cyclictest0-21swapper/223:50:152
298169943450,254cyclictest704-21nscd00:00:270
29819994326,169cyclictest0-21swapper/300:40:143
29816994306,84cyclictest0-21swapper/022:19:330
29818994295,84cyclictest0-21swapper/223:25:322
298189942945,126cyclictest121rcu_preempt22:19:592
29823994285,84cyclictest0-21swapper/723:09:497
29823994285,84cyclictest0-21swapper/723:09:497
298219942889,84cyclictest0-21swapper/522:20:235
29818994271,168cyclictest0-21swapper/219:52:532
298169942713,250cyclictest0-21swapper/023:24:500
29822994252,85cyclictest0-21swapper/623:09:186
29822994252,85cyclictest0-21swapper/623:09:186
298229942483,338cyclictest0-21swapper/622:20:036
298229942483,338cyclictest0-21swapper/621:54:516
298229942382,338cyclictest0-21swapper/600:40:156
298219942382,84cyclictest0-21swapper/521:25:025
298199942381,339cyclictest0-21swapper/321:35:143
2981899423123,127cyclictest33-21ksoftirqd/200:40:132
298229942281,338cyclictest0-21swapper/623:50:086
298219942182,84cyclictest0-21swapper/500:30:135
298179942182,84cyclictest0-21swapper/121:25:121
298169942182,84cyclictest0-21swapper/020:24:370
2982099420334,84cyclictest481ktimersoftd/422:18:484
298229941939,177cyclictest0-21swapper/622:00:226
2981999419121,126cyclictest41-21ksoftirqd/319:55:113
298189941978,338cyclictest0-21swapper/223:10:162
298229941835,168cyclictest0-21swapper/623:25:256
298199941876,339cyclictest0-21swapper/322:20:113
298239941775,339cyclictest0-21swapper/720:24:027
298199941737,299cyclictest0-21swapper/322:40:043
298229941675,338cyclictest0-21swapper/623:35:206
298219941674,211cyclictest0-21swapper/523:09:525
298219941674,211cyclictest0-21swapper/523:09:525
298219941578,168cyclictest57-21ksoftirqd/523:50:115
298199941535,296cyclictest0-21swapper/300:30:093
298209941431,380cyclictest0-21swapper/419:55:124
298199941171,338cyclictest0-21swapper/323:50:193
2981799407108,169cyclictest896-21ssh00:30:051
298239940564,338cyclictest0-21swapper/723:25:117
298189940564,338cyclictest0-21swapper/220:30:212
298229940366,211cyclictest0-21swapper/621:25:026
298219940121,218cyclictest0-21swapper/520:30:085
298179940121,260cyclictest0-21swapper/119:55:091
298199940058,211cyclictest41-21ksoftirqd/320:30:143
298169939755,169cyclictest0-21swapper/023:10:080
298239939616,296cyclictest0-21swapper/700:30:097
298169939556,84cyclictest0-21swapper/000:40:150
298189939495,126cyclictest0-21swapper/222:40:042
298239939353,338cyclictest0-21swapper/720:30:217
298229938445,84cyclictest0-21swapper/620:24:026
29816993845,126cyclictest27103-21ssh21:25:130
2982299379121,253cyclictest1694-21ssh00:30:136
298229937738,124cyclictest121rcu_preempt19:55:086
298169936928,126cyclictest0-21swapper/019:55:120
298239936122,84cyclictest0-21swapper/719:55:107
2982399360273,84cyclictest704-21nscd22:40:057
298169935964,211cyclictest31940-21runrttasks22:40:040
298229935718,84cyclictest0-21swapper/622:40:026
298189934910,84cyclictest0-21swapper/200:30:032
298179934911,84cyclictest0-21swapper/122:40:061
298219931216,47cyclictest0-21swapper/519:55:115
2921028945,40sleep50-21swapper/519:07:305
2935828857,27sleep30-21swapper/319:09:363
2678628553,28sleep40-21swapper/419:05:044
2924328453,28sleep10-21swapper/119:07:581
2917228251,28sleep60-21swapper/619:06:596
2912028250,28sleep20-21swapper/219:06:142
2908928049,27sleep70-21swapper/719:05:477
2679127948,28sleep00-21swapper/019:05:080
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional