You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 06:16
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Mar 21, 2026 00:56:36)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
244959973617,635cyclictest0-21swapper/522:05:345
244959973617,635cyclictest0-21swapper/522:05:345
244959969198,590cyclictest22833-21taskset22:00:075
244949967982,423cyclictest0-21swapper/422:27:594
244959967479,592cyclictest0-21swapper/521:49:255
244959967479,592cyclictest0-21swapper/521:49:245
244959967479,592cyclictest0-21swapper/500:38:365
244959966772,592cyclictest0-21swapper/521:52:215
244959964710,634cyclictest0-21swapper/522:26:075
2449499645139,124cyclictest0-21swapper/421:48:024
2449499645139,124cyclictest0-21swapper/421:48:024
24495996391,422cyclictest1185-21ssh22:30:185
24492996393,340cyclictest0-21swapper/200:20:142
24495996351,551cyclictest0-21swapper/520:27:365
244919962975,126cyclictest0-21swapper/123:54:591
2449599625114,296cyclictest24488-21cyclictest23:34:175
244959962227,88cyclictest0-21swapper/523:53:405
244959962130,507cyclictest0-21swapper/522:18:095
2449299621113,126cyclictest0-21swapper/221:53:042
2449499618278,338cyclictest68050irq/122-eth021:44:184
244919961726,84cyclictest0-21swapper/121:42:511
244959961423,422cyclictest9137-21df_abs20:30:165
244959961423,422cyclictest9137-21df_abs20:30:155
244939961014,126cyclictest24488-21cyclictest21:58:393
2449199610146,211cyclictest0-21swapper/123:23:201
244919960813,125cyclictest121rcu_preempt22:21:241
244979960662,542cyclictest0-21swapper/720:10:037
244979960662,542cyclictest0-21swapper/720:10:037
244979960662,542cyclictest0-21swapper/720:10:027
244979959748,338cyclictest0-21swapper/723:34:177
24490995950,84cyclictest0-21swapper/020:29:270
24496995940,84cyclictest0-21swapper/623:24:236
24494995940,83cyclictest0-21swapper/420:08:554
24494995940,83cyclictest0-21swapper/420:08:554
24494995940,83cyclictest0-21swapper/420:08:554
24494995940,83cyclictest0-21swapper/420:08:554
24494995930,84cyclictest0-21swapper/400:39:074
24492995930,84cyclictest0-21swapper/222:03:312
244939959136,381cyclictest0-21swapper/323:26:093
244979959079,381cyclictest0-21swapper/719:55:217
244939959081,127cyclictest24488-21cyclictest21:52:253
244979958878,380cyclictest0-21swapper/722:22:187
2449299588120,380cyclictest0-21swapper/222:16:392
244979958776,381cyclictest0-21swapper/720:35:197
244959958678,84cyclictest0-21swapper/500:03:545
244959958678,84cyclictest0-21swapper/500:03:545
2449499586247,337cyclictest13841-21kworker/u16:000:02:154
2449499586247,337cyclictest13841-21kworker/u16:000:02:144
2449399585119,251cyclictest22491-21ls23:34:593
244959958476,84cyclictest0-21swapper/521:13:565
2449799583115,338cyclictest0-21swapper/720:32:417
2449799583115,338cyclictest0-21swapper/720:32:417
2449399583117,211cyclictest0-21swapper/322:10:193
244959958133,459cyclictest21617-21ssh21:59:085
244949958127,381cyclictest0-21swapper/422:16:254
244979958067,296cyclictest29962-21ssh22:05:097
244979958067,296cyclictest29962-21ssh22:05:087
244959958027,550cyclictest0-21swapper/523:24:055
2449499580325,253cyclictest68050irq/122-eth023:23:104
244969957930,337cyclictest0-21swapper/623:45:096
244949957972,126cyclictest0-21swapper/420:38:444
244919957967,338cyclictest25-21ksoftirqd/122:18:581
2449699578240,84cyclictest641ktimersoftd/600:39:296
2449499578494,3cyclictest471rcuc/420:31:414
2449499578494,3cyclictest471rcuc/420:31:404
2449199577277,126cyclictest0-21swapper/121:46:541
2449199577277,126cyclictest0-21swapper/121:46:541
244979957669,127cyclictest0-21swapper/719:34:007
244959957669,505cyclictest0-21swapper/523:44:595
244959957521,466cyclictest0-21swapper/523:27:535
244949957565,507cyclictest0-21swapper/421:54:494
244909957565,380cyclictest0-21swapper/020:30:550
244909957565,380cyclictest0-21swapper/020:30:540
2449499573490,3cyclictest471rcuc/421:14:524
244929957323,127cyclictest0-21swapper/223:33:222
2449499571103,380cyclictest0-21swapper/423:30:134
2449599569229,338cyclictest13841-21kworker/u16:023:19:255
244959956816,549cyclictest0-21swapper/500:40:115
244909956759,211cyclictest0-21swapper/022:11:130
244929956613,338cyclictest0-21swapper/221:47:462
244929956613,338cyclictest0-21swapper/221:47:462
244909956658,126cyclictest0-21swapper/022:18:150
244909956555,125cyclictest121rcu_preempt22:09:490
244909956555,125cyclictest121rcu_preempt22:09:490
244909956553,380cyclictest0-21swapper/023:31:140
244959956352,508cyclictest0-21swapper/520:10:035
244959956352,508cyclictest0-21swapper/520:10:025
244959956352,508cyclictest0-21swapper/520:10:025
24495995627,508cyclictest0-21swapper/522:14:315
244909955910,297cyclictest0-21swapper/021:48:170
244909955910,297cyclictest0-21swapper/021:48:170
244959955846,338cyclictest131rcu_sched20:35:165
2449699557258,126cyclictest629-21ptp4l21:55:186
24495995571,466cyclictest0-21swapper/522:22:515
244919955645,84cyclictest0-21swapper/122:05:081
244919955645,84cyclictest0-21swapper/122:05:081
24493995552,83cyclictest121rcu_preempt22:29:393
244929955544,508cyclictest0-21swapper/222:20:522
24493995541,344cyclictest0-21swapper/300:39:283
244939955283,339cyclictest24488-21cyclictest00:04:183
244939955283,339cyclictest24488-21cyclictest00:04:183
244939955241,380cyclictest0-21swapper/322:22:353
24492995520,84cyclictest0-21swapper/200:03:192
24492995520,84cyclictest0-21swapper/200:03:192
24496995510,84cyclictest0-21swapper/600:40:106
24496995510,84cyclictest0-21swapper/600:03:196
24496995510,84cyclictest0-21swapper/600:03:196
244939955182,296cyclictest0-21swapper/320:45:123
2449299551294,85cyclictest0-21swapper/200:40:162
24490995500,83cyclictest0-21swapper/023:44:580
2449699547163,211cyclictest0-21swapper/622:19:386
2449399547124,126cyclictest0-21swapper/300:19:383
244979954633,253cyclictest121rcu_preempt23:24:377
2449299546124,338cyclictest0-21swapper/200:36:102
244959954539,422cyclictest0-21swapper/519:53:195
2449699544162,380cyclictest0-21swapper/620:35:446
244959954433,423cyclictest0-21swapper/520:09:235
2449399544118,423cyclictest0-21swapper/322:06:013
2449399544118,423cyclictest0-21swapper/322:06:013
244929954432,295cyclictest0-21swapper/220:10:012
244929954432,295cyclictest0-21swapper/220:10:012
244929954432,295cyclictest0-21swapper/220:10:012
244929954432,295cyclictest0-21swapper/220:10:002
244979954332,338cyclictest121rcu_preempt22:28:127
2449699543286,126cyclictest0-21swapper/621:44:436
2449699543162,126cyclictest65-21ksoftirqd/621:54:496
2449399543116,424cyclictest0-21swapper/321:16:353
244929954378,42cyclictest0-21swapper/223:52:112
244929954334,126cyclictest0-21swapper/221:58:562
244909954334,85cyclictest0-21swapper/000:20:230
244959954274,465cyclictest0-21swapper/500:20:225
244949954273,338cyclictest0-21swapper/423:54:134
2449699541119,338cyclictest0-21swapper/620:57:166
2449299541370,83cyclictest31996-21diskmemload23:23:322
2449699540285,253cyclictest641ktimersoftd/623:43:596
244919954033,126cyclictest0-21swapper/120:30:451
244919954033,126cyclictest0-21swapper/120:30:441
2449199539155,253cyclictest121rcu_preempt20:10:031
2449199539155,253cyclictest121rcu_preempt20:10:031
244959953870,338cyclictest121rcu_preempt20:41:585
244909953827,338cyclictest0-21swapper/023:26:530
244949953729,126cyclictest0-21swapper/422:03:354
2449099537323,84cyclictest0-21swapper/022:29:290
2449699536452,4cyclictest631rcuc/622:02:596
2449699536195,338cyclictest24488-21cyclictest22:05:246
2449699536195,338cyclictest24488-21cyclictest22:05:246
244909953567,338cyclictest0-21swapper/023:54:190
244979953468,211cyclictest0-21swapper/721:46:577
244979953468,211cyclictest0-21swapper/721:46:577
244959953428,503cyclictest0-21swapper/520:57:565
2449599534111,84cyclictest0-21swapper/520:45:225
2449499534109,422cyclictest0-21swapper/423:35:084
2449299534107,211cyclictest14855-21rm23:28:512
244959953327,503cyclictest0-21swapper/521:43:365
2449299533234,87cyclictest0-21swapper/223:44:512
244919953268,126cyclictest0-21swapper/122:03:531
244959953120,466cyclictest0-21swapper/519:55:125
244939953120,338cyclictest121rcu_preempt00:40:543
244919953162,423cyclictest0-21swapper/121:18:521
244919953021,127cyclictest0-21swapper/120:10:031
244939952922,85cyclictest0-21swapper/322:02:293
244929952920,127cyclictest0-21swapper/221:43:032
244919952964,211cyclictest0-21swapper/123:44:061
2449399527101,296cyclictest0-21swapper/321:43:033
244919952512,129cyclictest0-21swapper/123:25:091
244909952557,295cyclictest0-21swapper/023:19:130
2449499523141,86cyclictest68050irq/122-eth022:06:554
2449499523141,86cyclictest68050irq/122-eth022:06:554
244929952316,127cyclictest1552-21runrttasks20:40:142
2449199523102,165cyclictest121rcu_preempt20:40:201
244979952011,84cyclictest0-21swapper/721:59:567
24495995188,507cyclictest0-21swapper/519:34:055
244919951854,84cyclictest0-21swapper/100:36:101
2449199517134,253cyclictest0-21swapper/122:26:021
244949951346,464cyclictest0-21swapper/423:44:414
2449499513173,337cyclictest68050irq/122-eth022:22:494
24495995125,504cyclictest0-21swapper/500:05:065
24494995121,299cyclictest0-21swapper/423:25:084
2449399512171,126cyclictest10418-21load23:45:203
2449099512170,126cyclictest1552-21runrttasks20:58:560
244939951082,254cyclictest0-21swapper/320:34:013
244939951082,254cyclictest0-21swapper/320:34:013
244979950982,211cyclictest73-21ksoftirqd/722:12:277
24490995091,126cyclictest0-21swapper/022:20:530
24496995080,84cyclictest0-21swapper/623:25:116
2449299508124,296cyclictest0-21swapper/222:10:002
2449299508124,296cyclictest0-21swapper/222:10:002
24497995071,176cyclictest5659-21ssh21:12:157
244949950781,423cyclictest0-21swapper/422:10:334
244919950781,168cyclictest25-21ksoftirqd/123:19:391
244909950781,211cyclictest0-21swapper/021:50:060
2449499506122,84cyclictest0-21swapper/421:17:444
244939950682,211cyclictest0-21swapper/321:47:143
244939950682,211cyclictest0-21swapper/321:47:143
244959950579,211cyclictest0-21swapper/521:20:065
244949950579,423cyclictest0-21swapper/400:19:224
2449299505125,303cyclictest0-21swapper/220:31:332
2449299505125,303cyclictest0-21swapper/220:31:332
244909950536,295cyclictest0-21swapper/021:12:550
244979950482,338cyclictest0-21swapper/723:43:137
2449299504251,84cyclictest30075-21ssh22:28:352
244979950235,211cyclictest0-21swapper/721:15:327
244929950234,127cyclictest0-21swapper/219:54:482
2449099502119,380cyclictest0-21swapper/020:38:440
2449099502119,168cyclictest0-21swapper/021:55:470
244919950135,126cyclictest0-21swapper/121:00:151
244919950135,126cyclictest0-21swapper/121:00:151
2449199501160,127cyclictest121rcu_preempt21:50:121
2449099501118,380cyclictest0-21swapper/022:03:360
2449799500122,340cyclictest31996-21diskmemload00:19:507
244969950034,211cyclictest0-21swapper/621:16:056
2449699500119,126cyclictest6741-21ssh21:48:016
2449699500119,126cyclictest6741-21ssh21:48:016
244939950074,126cyclictest41-21ksoftirqd/321:12:553
244939950034,42cyclictest24488-21cyclictest20:59:593
244919950077,212cyclictest10402-21grep23:45:171
244909950034,84cyclictest0-21swapper/023:23:290
244959949934,462cyclictest0-21swapper/521:17:065
244979949875,126cyclictest0-21swapper/722:18:447
244969949876,256cyclictest24488-21cyclictest00:20:226
244959949831,464cyclictest0-21swapper/500:19:375
2449299498115,380cyclictest0-21swapper/220:35:432
244979949629,89cyclictest0-21swapper/700:04:187
244979949629,89cyclictest0-21swapper/700:04:187
244919949630,126cyclictest0-21swapper/122:11:051
244909949670,211cyclictest9-21ksoftirqd/000:37:050
244929949468,211cyclictest12618-21ssh21:16:292
244979949370,211cyclictest0-21swapper/723:28:057
2449399493109,381cyclictest0-21swapper/319:55:253
2449099493155,169cyclictest0-21swapper/020:40:300
244959949122,254cyclictest0-21swapper/521:00:165
244959949122,254cyclictest0-21swapper/521:00:155
244959949067,84cyclictest10401-21ls23:45:185
2449299490107,380cyclictest0-21swapper/219:33:382
2449199487188,126cyclictest121rcu_preempt23:30:461
244959948621,254cyclictest0-21swapper/523:35:015
2449399486145,338cyclictest13802-21grep22:15:343
244919948658,254cyclictest0-21swapper/100:05:241
244939948499,254cyclictest0-21swapper/321:00:153
244939948499,254cyclictest0-21swapper/321:00:153
244939948418,84cyclictest0-21swapper/320:35:193
244939948314,296cyclictest0-21swapper/320:10:023
244939948314,296cyclictest0-21swapper/320:10:023
244939948314,296cyclictest0-21swapper/320:10:023
244939948314,296cyclictest0-21swapper/320:10:013
244919948317,126cyclictest0-21swapper/123:55:061
244939948217,84cyclictest0-21swapper/323:42:243
244909948155,296cyclictest0-21swapper/000:04:190
244909948155,296cyclictest0-21swapper/000:04:180
244949947956,168cyclictest0-21swapper/400:40:194
2449799478138,338cyclictest646-21nscd00:39:497
244969947854,84cyclictest121rcu_preempt22:23:596
24493994788,127cyclictest0-21swapper/320:40:133
244929947712,211cyclictest0-21swapper/222:11:182
244919947749,84cyclictest0-21swapper/120:29:451
244909947711,211cyclictest0-21swapper/021:19:280
244929947610,84cyclictest0-21swapper/200:18:552
2449699475100,372cyclictest0-21swapper/623:19:266
244949947452,254cyclictest121rcu_preempt21:57:154
24490994738,126cyclictest0-21swapper/020:45:200
24497994722,381cyclictest0-21swapper/720:27:437
244949947146,422cyclictest0-21swapper/419:34:434
244979946740,212cyclictest0-21swapper/722:00:267
2449799467124,340cyclictest0-21swapper/721:52:067
2449799467124,340cyclictest0-21swapper/720:44:107
2449699467123,340cyclictest0-21swapper/623:30:506
24491994670,83cyclictest0-21swapper/100:20:221
2449699466125,338cyclictest0-21swapper/620:45:126
2449699466124,339cyclictest28008-21ssh22:26:026
2449799465123,296cyclictest0-21swapper/721:43:207
24497994650,8cyclictest0-21swapper/723:53:397
2449699465124,339cyclictest0-21swapper/620:43:386
2449299465124,338cyclictest0-21swapper/222:30:152
244979946441,256cyclictest0-21swapper/722:30:187
2449699464124,338cyclictest0-21swapper/621:20:066
2449699464123,338cyclictest28483-21runrttasks20:08:186
2449699464123,338cyclictest28483-21runrttasks20:08:186
2449699464123,338cyclictest28483-21runrttasks20:08:186
2449699464123,338cyclictest28483-21runrttasks20:08:176
2449399464124,338cyclictest0-21swapper/320:27:153
2449399464124,337cyclictest0-21swapper/323:19:133
2449299464123,338cyclictest0-21swapper/223:45:182
2449799463124,84cyclictest0-21swapper/719:53:197
2449699463122,338cyclictest0-21swapper/622:12:106
2449699463119,341cyclictest0-21swapper/620:27:106
2449499463124,84cyclictest0-21swapper/420:57:154
2449399463123,338cyclictest0-21swapper/323:24:003
2449299463419,42cyclictest311rcuc/221:13:392
2449199463419,42cyclictest241ktimersoftd/120:09:461
2449699462120,339cyclictest7565-21runrttasks21:13:546
244949946240,256cyclictest0-21swapper/420:43:344
244939946277,211cyclictest16405-21ssh21:20:123
2449399462121,338cyclictest0-21swapper/323:35:133
244929946240,2cyclictest0-21swapper/220:56:492
2449299462122,338cyclictest24488-21cyclictest21:00:072
2449299462122,338cyclictest24488-21cyclictest21:00:062
244909946281,84cyclictest0-21swapper/021:44:300
2449699461122,336cyclictest0-21swapper/623:55:006
2449299461120,338cyclictest17548-21cpuspeed_turbos20:45:132
244919946139,3cyclictest0-21swapper/100:04:441
244919946139,3cyclictest0-21swapper/100:04:441
2449099461207,84cyclictest101ktimersoftd/022:30:090
2449299460118,126cyclictest0-21swapper/223:35:212
2449699459118,339cyclictest0-21swapper/620:34:236
2449699459118,339cyclictest0-21swapper/620:34:226
2449299459119,338cyclictest0-21swapper/220:29:192
2449299459118,338cyclictest0-21swapper/223:19:552
244949945876,84cyclictest0-21swapper/419:55:224
2449199458115,169cyclictest15804-21ssh21:55:131
2449699457119,335cyclictest0-21swapper/619:54:086
244949945732,422cyclictest0-21swapper/421:00:034
244949945732,422cyclictest0-21swapper/421:00:034
2449799456158,126cyclictest121rcu_preempt23:45:207
244919945634,126cyclictest0-21swapper/120:57:571
2449799455115,338cyclictest0-21swapper/700:40:067
244939945527,127cyclictest0-21swapper/323:54:313
244909945528,211cyclictest16395-21ssh21:20:110
244979945478,373cyclictest0-21swapper/723:19:027
2449699454112,339cyclictest0-21swapper/621:00:156
2449699454112,339cyclictest0-21swapper/621:00:156
2449399454112,339cyclictest0-21swapper/300:20:143
2449399454112,339cyclictest0-21swapper/300:05:333
2449699453113,337cyclictest0-21swapper/623:35:016
244939945331,256cyclictest0-21swapper/319:33:573
244939945330,84cyclictest0-21swapper/322:30:143
244909945331,3cyclictest18170-21runrttasks00:41:200
244949945228,84cyclictest0-21swapper/420:27:434
244909945232,82cyclictest0-21swapper/019:55:200
2449799451113,126cyclictest0-21swapper/720:57:577
244949945129,256cyclictest0-21swapper/423:19:164
244909945166,211cyclictest9-21ksoftirqd/023:55:200
244959945067,211cyclictest0-21swapper/523:55:065
2449099450193,126cyclictest121rcu_preempt19:33:390
244959944933,206cyclictest0-21swapper/519:35:175
244959944933,206cyclictest0-21swapper/519:35:175
244919944965,211cyclictest9937-21idleruntime-cro00:20:011
244919944927,84cyclictest0-21swapper/121:13:411
2449199447109,169cyclictest20012-21taskset19:55:041
244979944661,211cyclictest0-21swapper/720:45:177
244909944621,126cyclictest0-21swapper/000:18:560
2449299445104,338cyclictest0-21swapper/221:20:112
244919944562,380cyclictest0-21swapper/119:33:381
2449199445105,338cyclictest0-21swapper/100:40:331
244949944422,256cyclictest0-21swapper/419:52:494
244929944419,127cyclictest15956-21users00:05:232
2449099444101,169cyclictest0-21swapper/020:08:330
2449099444101,169cyclictest0-21swapper/020:08:330
2449099444101,169cyclictest0-21swapper/020:08:330
2449099444101,169cyclictest0-21swapper/020:08:320
244959944317,422cyclictest7035-21ssh00:34:445
244949944326,215cyclictest0-21swapper/423:55:214
2449699441101,338cyclictest0-21swapper/623:55:186
244929943854,211cyclictest33-21ksoftirqd/223:55:212
244969943512,7cyclictest0-21swapper/619:55:266
244969943310,84cyclictest0-21swapper/600:19:036
244919943352,84cyclictest0-21swapper/100:34:531
244979943190,339cyclictest24488-21cyclictest00:20:137
244979943190,338cyclictest0-21swapper/723:35:147
244979943090,338cyclictest0-21swapper/720:09:077
244949943047,380cyclictest0-21swapper/421:20:054
2449199425168,126cyclictest121rcu_preempt21:20:061
244979942483,338cyclictest0-21swapper/700:34:527
244949942483,338cyclictest0-21swapper/423:45:174
244949942483,338cyclictest0-21swapper/400:34:524
244949942383,338cyclictest0-21swapper/420:45:194
2449299423124,296cyclictest21213-21/usr/sbin/munin19:55:252
244919942382,338cyclictest0-21swapper/123:35:131
2449699422122,127cyclictest65-21ksoftirqd/622:30:196
244919942281,338cyclictest0-21swapper/120:37:411
244909942283,84cyclictest0-21swapper/023:45:180
244979942178,340cyclictest0-21swapper/721:20:057
244949942181,338cyclictest0-21swapper/400:20:154
244949942181,337cyclictest0-21swapper/419:35:184
244949942181,337cyclictest0-21swapper/419:35:184
244909942182,84cyclictest0-21swapper/000:05:320
244979942079,339cyclictest24488-21cyclictest23:55:057
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional