You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 05:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sun May 24, 2026 00:57:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2238299803122,84cyclictest0-21swapper/723:11:317
2238299743105,635cyclictest0-21swapper/722:42:197
2237599705237,295cyclictest0-21swapper/022:13:360
223799967639,464cyclictest0-21swapper/400:19:434
223799967639,464cyclictest0-21swapper/400:19:424
223799967639,464cyclictest0-21swapper/400:19:424
223799967639,464cyclictest0-21swapper/400:19:424
223799967639,464cyclictest0-21swapper/400:19:424
223829967076,42cyclictest6636-21ssh22:21:197
223829966165,593cyclictest0-21swapper/722:10:457
223769964289,380cyclictest0-21swapper/122:43:361
22382996391,635cyclictest0-21swapper/723:39:417
223789963842,381cyclictest0-21swapper/323:27:203
223779963077,210cyclictest33-21ksoftirqd/223:02:302
223829962632,591cyclictest0-21swapper/722:05:117
223829962631,592cyclictest0-21swapper/721:25:107
2237599624113,296cyclictest0-21swapper/023:26:590
2237599621323,84cyclictest0-21swapper/022:41:380
223759961929,2cyclictest26227-21ssh00:29:110
2238299618107,380cyclictest0-21swapper/722:51:567
223829961216,508cyclictest121rcu_preempt22:45:197
2238099609269,126cyclictest0-21swapper/522:53:035
2237899608186,127cyclictest28062-21kworker/u16:100:28:573
2237699602519,3cyclictest231rcuc/122:45:121
223799960089,338cyclictest49-21ksoftirqd/423:28:494
22382995971,593cyclictest0-21swapper/722:04:297
22382995971,593cyclictest0-21swapper/700:02:567
22380995950,85cyclictest0-21swapper/523:46:345
22378995953,126cyclictest0-21swapper/300:01:033
22378995950,84cyclictest0-21swapper/323:46:333
22381995940,84cyclictest0-21swapper/600:37:136
22380995940,84cyclictest0-21swapper/500:28:345
22379995940,84cyclictest0-21swapper/423:35:494
22377995940,84cyclictest0-21swapper/200:37:132
223819959381,127cyclictest22373-21cyclictest23:49:406
22380995930,84cyclictest0-21swapper/523:35:505
22380995930,84cyclictest0-21swapper/500:37:145
2237699593124,296cyclictest0-21swapper/123:11:501
2238199588249,84cyclictest29977-21diskmemload00:10:276
2238199588123,211cyclictest13542-21chrt00:01:096
223759958680,84cyclictest121rcu_preempt22:02:530
2237599586286,126cyclictest9-21ksoftirqd/022:32:310
223779958575,508cyclictest0-21swapper/220:42:442
223819958473,508cyclictest0-21swapper/620:42:456
22381995834,3cyclictest0-21swapper/600:29:126
223819958270,296cyclictest0-21swapper/623:36:486
223789958128,423cyclictest0-21swapper/322:15:193
2237899579112,212cyclictest0-21swapper/322:23:533
223809957768,84cyclictest0-21swapper/522:23:305
223759957767,507cyclictest0-21swapper/020:42:450
223829957668,126cyclictest0-21swapper/700:29:417
223809957363,507cyclictest0-21swapper/520:42:455
223759957224,2cyclictest0-21swapper/023:38:430
2237899571532,37cyclictest391rcuc/300:18:363
2237899571532,37cyclictest391rcuc/300:18:363
2237899571532,37cyclictest391rcuc/300:18:353
2237899571532,37cyclictest391rcuc/300:18:353
2237899571532,37cyclictest391rcuc/300:18:353
223769957017,295cyclictest0-21swapper/123:27:061
223789956961,126cyclictest0-21swapper/320:42:443
223779956958,126cyclictest0-21swapper/222:04:552
223789956254,296cyclictest0-21swapper/322:13:523
223829955812,162cyclictest0-21swapper/723:02:007
223789955644,381cyclictest0-21swapper/322:52:243
22377995567,84cyclictest0-21swapper/223:22:052
22377995556,2cyclictest0-21swapper/200:29:122
22376995555,211cyclictest25-21ksoftirqd/122:13:171
223769955442,380cyclictest0-21swapper/123:04:291
223819955385,295cyclictest0-21swapper/600:17:276
223819955385,295cyclictest0-21swapper/600:17:276
223819955385,295cyclictest0-21swapper/600:17:276
223819955385,295cyclictest0-21swapper/600:17:276
223819955385,295cyclictest0-21swapper/600:17:276
223789955139,381cyclictest0-21swapper/323:39:343
2237599550166,253cyclictest0-21swapper/000:20:270
22380995490,2cyclictest0-21swapper/522:34:055
223829954878,85cyclictest0-21swapper/723:27:257
2238299548122,423cyclictest722-21nscd00:16:517
2238299548122,423cyclictest722-21nscd00:16:517
2238299548122,423cyclictest722-21nscd00:16:517
2238299548122,423cyclictest722-21nscd00:16:517
2238299548122,423cyclictest722-21nscd00:16:517
2237999548207,338cyclictest64450irq/122-eth023:02:414
223779954880,465cyclictest0-21swapper/200:18:572
223779954880,465cyclictest0-21swapper/200:18:562
223779954880,465cyclictest0-21swapper/200:18:562
223779954880,465cyclictest0-21swapper/200:18:562
223779954880,465cyclictest0-21swapper/200:18:562
2237799548121,253cyclictest121rcu_preempt22:05:152
223819954740,84cyclictest0-21swapper/622:11:076
223759954739,170cyclictest0-21swapper/022:15:130
223829954639,422cyclictest0-21swapper/723:50:017
2237899546206,338cyclictest22373-21cyclictest22:44:463
223759954682,132cyclictest0-21swapper/022:22:170
2238099545251,83cyclictest0-21swapper/500:03:255
223799954538,426cyclictest0-21swapper/422:03:214
223779954576,210cyclictest33-21ksoftirqd/223:38:042
223829954331,169cyclictest25931-21/usr/sbin/munin22:15:307
223769954277,126cyclictest0-21swapper/120:45:211
2237699541116,126cyclictest25274-21taskset22:52:491
223809954071,253cyclictest0-21swapper/523:27:045
2238299538112,423cyclictest0-21swapper/721:24:197
2238199538457,78cyclictest631rcuc/622:32:296
223779953870,211cyclictest33-21ksoftirqd/221:24:072
223769953832,255cyclictest0-21swapper/100:18:321
223769953832,255cyclictest0-21swapper/100:18:321
223769953832,255cyclictest0-21swapper/100:18:321
223769953832,255cyclictest0-21swapper/100:18:311
223769953832,255cyclictest0-21swapper/100:18:311
223769953630,124cyclictest0-21swapper/100:29:421
223769953628,126cyclictest0-21swapper/120:42:441
223809953527,84cyclictest22353-21ssh23:30:185
223789953327,295cyclictest0-21swapper/322:34:103
223759953327,84cyclictest0-21swapper/023:30:180
223769953263,380cyclictest0-21swapper/123:30:181
223829953123,7cyclictest0-21swapper/700:36:107
223829953120,126cyclictest0-21swapper/722:34:537
223799953164,464cyclictest0-21swapper/423:30:184
223769953125,84cyclictest0-21swapper/122:03:221
223759953124,296cyclictest0-21swapper/022:54:350
223809953061,211cyclictest57-21ksoftirqd/522:14:545
223769952919,211cyclictest25-21ksoftirqd/100:37:031
223799952859,127cyclictest0-21swapper/422:23:494
223829952717,507cyclictest0-21swapper/700:20:077
223799952615,338cyclictest0-21swapper/422:31:444
223789952560,211cyclictest0-21swapper/323:03:093
223829952413,508cyclictest12498-21grep23:05:177
2237999524185,84cyclictest64450irq/122-eth022:53:504
223779952113,84cyclictest0-21swapper/223:30:192
223759952012,126cyclictest0-21swapper/000:36:470
2237799519138,212cyclictest121rcu_preempt22:45:032
223779951812,345cyclictest8389-21runrttasks22:23:412
223799951610,86cyclictest0-21swapper/423:46:334
22380995156,84cyclictest0-21swapper/500:19:075
22380995156,84cyclictest0-21swapper/500:19:075
22380995156,84cyclictest0-21swapper/500:19:075
22380995156,84cyclictest0-21swapper/500:19:075
22380995156,84cyclictest0-21swapper/500:19:065
2237999515175,338cyclictest64450irq/122-eth022:43:454
22382995124,3cyclictest0-21swapper/720:44:027
223799951245,169cyclictest0-21swapper/400:29:584
22377995121,296cyclictest0-21swapper/222:41:042
22382995103,2cyclictest0-21swapper/700:42:187
22375995104,295cyclictest0-21swapper/023:04:550
223799950983,211cyclictest27096-21ssh22:15:214
2238299507125,297cyclictest0-21swapper/723:15:287
22377995070,2cyclictest0-21swapper/222:34:022
2237699507126,84cyclictest121rcu_preempt00:05:181
2237899505124,296cyclictest9811-21ssh23:22:053
223779950540,2cyclictest21703-21rm23:49:372
2237699505164,126cyclictest121rcu_preempt23:40:111
2237999504421,3cyclictest481ktimersoftd/400:03:434
2237999504124,296cyclictest64450irq/122-eth022:45:204
2237799504163,126cyclictest121rcu_preempt23:29:052
2237599504120,211cyclictest14539-21ssh00:02:310
223799950379,169cyclictest49-21ksoftirqd/423:14:194
223779950377,211cyclictest29977-21diskmemload00:01:092
223769950379,127cyclictest25-21ksoftirqd/122:22:391
223809950276,211cyclictest57-21ksoftirqd/523:21:225
223789950232,296cyclictest0-21swapper/323:13:113
223809950033,210cyclictest57-21ksoftirqd/523:13:565
223799950037,298cyclictest0-21swapper/400:40:434
2237899500120,296cyclictest0-21swapper/323:15:273
2238299499120,295cyclictest0-21swapper/720:45:247
223799949875,84cyclictest121rcu_preempt23:05:254
223759949834,84cyclictest0-21swapper/023:05:190
223759949774,126cyclictest0-21swapper/023:48:350
2238099496111,253cyclictest0-21swapper/523:02:465
223779949670,298cyclictest22373-21cyclictest22:14:522
223779949632,49cyclictest0-21swapper/223:11:052
223769949632,84cyclictest29977-21diskmemload00:03:261
223819949573,84cyclictest8996-21runrttasks22:04:556
2237799495111,126cyclictest121rcu_preempt23:05:122
2237699495196,126cyclictest26755-21ssh21:24:561
223789949474,294cyclictest0-21swapper/300:42:113
223789949429,301cyclictest0-21swapper/300:20:143
223789949370,84cyclictest0-21swapper/322:04:543
223769949327,127cyclictest0-21swapper/123:36:481
223829949228,428cyclictest0-21swapper/700:10:257
2237799491410,37cyclictest311rcuc/222:53:442
223759949167,84cyclictest121rcu_preempt21:25:110
2237999490106,169cyclictest49-21ksoftirqd/422:14:464
223819948922,85cyclictest0-21swapper/623:50:106
223819948922,85cyclictest0-21swapper/623:50:106
223809948925,126cyclictest0-21swapper/522:02:585
223829948722,301cyclictest0-21swapper/723:30:047
223829948719,465cyclictest0-21swapper/723:40:187
2238099487401,84cyclictest551rcuc/521:24:375
2237999486189,295cyclictest5735-21expr23:40:174
223759948659,295cyclictest0-21swapper/023:15:050
2237899485101,219cyclictest0-21swapper/321:25:293
223779948519,211cyclictest0-21swapper/200:42:152
2237899484187,295cyclictest28062-21kworker/u16:100:10:263
223769948459,295cyclictest0-21swapper/122:31:281
223769948457,296cyclictest0-21swapper/123:50:111
223769948457,296cyclictest0-21swapper/123:50:101
223769948420,295cyclictest0-21swapper/123:47:511
223759948416,295cyclictest0-21swapper/021:24:200
223759948318,211cyclictest29977-21diskmemload22:45:050
2237699482104,332cyclictest10310-21kworker/u16:300:30:121
223759948214,295cyclictest0-21swapper/000:30:190
223789948157,339cyclictest0-21swapper/322:05:383
2237899481183,126cyclictest121rcu_preempt21:24:093
223769947711,84cyclictest0-21swapper/100:20:281
223819947595,296cyclictest0-21swapper/622:41:046
223819947494,84cyclictest0-21swapper/622:53:406
223819947351,84cyclictest0-21swapper/600:41:336
2238099471129,339cyclictest22373-21cyclictest00:20:195
22377994717,126cyclictest0-21swapper/222:15:142
2238199469128,338cyclictest22373-21cyclictest22:55:056
2237899469128,126cyclictest121rcu_preempt00:30:083
2237799467126,168cyclictest121rcu_preempt00:20:322
223759946741,253cyclictest0-21swapper/023:21:230
223759946644,84cyclictest0-21swapper/000:19:530
223759946644,84cyclictest0-21swapper/000:19:520
223759946644,84cyclictest0-21swapper/000:19:520
223759946644,84cyclictest0-21swapper/000:19:520
223759946644,84cyclictest0-21swapper/000:19:520
223809946582,253cyclictest0-21swapper/520:45:055
2237899465124,339cyclictest0-21swapper/300:36:533
2237899465124,338cyclictest0-21swapper/323:40:153
2237899465124,338cyclictest0-21swapper/322:45:183
2238299464208,126cyclictest121rcu_preempt23:55:297
2238299464125,84cyclictest0-21swapper/723:21:217
2238199464123,339cyclictest0-21swapper/623:27:126
223819946235,253cyclictest0-21swapper/623:01:206
2238199462162,126cyclictest121rcu_preempt00:20:226
223769946277,84cyclictest121rcu_preempt23:15:221
223819946139,46cyclictest0-21swapper/623:21:306
223799946139,219cyclictest0-21swapper/421:25:294
223829945938,418cyclictest17670-21sh00:05:167
223819945938,2cyclictest0-21swapper/623:11:116
223809945937,2cyclictest0-21swapper/522:43:565
223819945835,41cyclictest121rcu_preempt23:30:236
223799945874,126cyclictest49-21ksoftirqd/400:37:224
223799945833,210cyclictest0-21swapper/423:21:454
223829945731,423cyclictest0-21swapper/722:35:087
2238299457116,339cyclictest0-21swapper/723:50:097
2238299457116,339cyclictest0-21swapper/723:50:097
2237699457115,169cyclictest25-21ksoftirqd/100:40:441
223809945634,3cyclictest0-21swapper/522:55:055
223799945635,255cyclictest0-21swapper/421:24:354
223789945633,256cyclictest0-21swapper/323:50:103
223789945633,256cyclictest0-21swapper/323:50:103
2237899456113,84cyclictest0-21swapper/323:05:203
223759945675,84cyclictest0-21swapper/000:41:450
223799945534,255cyclictest0-21swapper/420:42:454
223799945529,253cyclictest0-21swapper/400:20:384
223779945533,2cyclictest0-21swapper/222:35:122
2237799454411,41cyclictest311rcuc/221:25:172
223759945470,211cyclictest0-21swapper/020:45:170
223809945272,338cyclictest121rcu_preempt22:05:115
2238099452111,126cyclictest57-21ksoftirqd/523:40:145
2237999452111,338cyclictest29977-21diskmemload22:35:054
223809945028,84cyclictest121rcu_preempt22:15:345
2237599450109,338cyclictest0-21swapper/022:05:240
2237799448107,338cyclictest0-21swapper/223:15:192
2237899446106,338cyclictest0-21swapper/300:05:293
223809944421,3cyclictest0-21swapper/500:42:005
223809944220,84cyclictest0-21swapper/500:05:165
2237999440226,41cyclictest0-21swapper/423:55:294
223819943816,176cyclictest0-21swapper/621:24:086
223809943816,3cyclictest0-21swapper/523:05:265
223799943895,339cyclictest698-21ptp4l22:05:244
223829943712,259cyclictest0-21swapper/700:30:197
2238199437354,81cyclictest631rcuc/622:24:216
223789943713,84cyclictest0-21swapper/320:45:153
223779943612,84cyclictest0-21swapper/223:40:112
223799943550,211cyclictest22373-21cyclictest20:45:234
22376994359,254cyclictest27491-21ssh21:25:111
22381994347,211cyclictest16123-21diskstats20:45:166
223809943412,84cyclictest29337-21ssh23:15:285
223819943394,84cyclictest0-21swapper/623:40:216
22381994319,2cyclictest0-21swapper/622:15:136
223819942990,84cyclictest25010-1kworker/u17:021:25:106
22378994294,84cyclictest0-21swapper/323:30:243
223769942687,84cyclictest0-21swapper/123:21:441
223809942584,126cyclictest57-21ksoftirqd/500:30:085
2238099425126,126cyclictest57-21ksoftirqd/521:25:145
2237999425168,84cyclictest121rcu_preempt23:15:224
223809942483,338cyclictest0-21swapper/522:35:125
223779942483,338cyclictest0-21swapper/220:45:042
223789942237,126cyclictest0-21swapper/322:35:123
223819942182,84cyclictest0-21swapper/622:45:206
223809942181,338cyclictest11177-21cstates22:45:235
223779942180,338cyclictest0-21swapper/200:05:232
223769942182,84cyclictest0-21swapper/122:15:411
223759942182,84cyclictest0-21swapper/023:50:130
223759942182,84cyclictest0-21swapper/023:50:130
223819942081,84cyclictest0-21swapper/623:05:216
223799942078,127cyclictest0-21swapper/423:50:144
223799942078,127cyclictest0-21swapper/423:50:134
223769942082,84cyclictest0-21swapper/123:05:081
223759942083,84cyclictest0-21swapper/023:15:230
223759942082,171cyclictest0-21swapper/000:05:140
223799941979,338cyclictest0-21swapper/400:30:164
223799941940,213cyclictest17734-21diskstats00:05:174
223819941879,84cyclictest0-21swapper/623:15:286
223769941879,84cyclictest0-21swapper/122:05:081
223829941776,339cyclictest0-21swapper/722:55:057
223819941778,84cyclictest0-21swapper/600:05:246
223759941778,84cyclictest0-21swapper/022:35:050
223759941634,42cyclictest121rcu_preempt23:40:140
223819941576,84cyclictest0-21swapper/622:05:276
223779941573,211cyclictest33-21ksoftirqd/222:55:032
223779941230,84cyclictest0-21swapper/223:55:302
223789941070,84cyclictest0-21swapper/322:55:063
223809940967,210cyclictest0-21swapper/523:55:285
223799940867,211cyclictest49-21ksoftirqd/422:55:074
2237799407150,127cyclictest0-21swapper/200:30:172
2237599407108,126cyclictest121rcu_preempt22:55:030
223809940665,338cyclictest0-21swapper/523:50:075
223809940665,338cyclictest0-21swapper/523:50:075
223779940423,84cyclictest0-21swapper/223:50:112
223779940423,84cyclictest0-21swapper/223:50:112
223819940263,84cyclictest0-21swapper/622:35:126
223769939421,246cyclictest0-21swapper/122:55:031
223759939455,42cyclictest2736-21diskmemload23:55:290
223789939251,338cyclictest0-21swapper/323:55:303
223819939051,84cyclictest0-21swapper/600:30:106
223799938544,338cyclictest0-21swapper/400:10:264
2237699365112,86cyclictest0-21swapper/122:35:121
223759936427,216cyclictest0-21swapper/000:10:250
223819935412,211cyclictest0-21swapper/623:55:286
223769935121,161cyclictest0-21swapper/100:10:241
22377993458,84cyclictest0-21swapper/200:10:252
223769933780,168cyclictest0-21swapper/123:55:301
223809933439,2cyclictest0-21swapper/500:10:275
1995429647,26sleep70-21swapper/719:05:137
2194228654,28sleep30-21swapper/319:09:583
2174028351,28sleep20-21swapper/219:07:082
2194028047,29sleep10-21swapper/119:09:561
2172728050,27sleep00-21swapper/019:06:580
2162128050,27sleep60-21swapper/619:05:296
2162827848,27sleep40-21swapper/419:05:354
2182227748,26sleep50-21swapper/519:08:165
22378993210,21cyclictest0-21swapper/320:15:593
22381992927,1cyclictest0-21swapper/620:16:256
22378992810,18cyclictest0-21swapper/319:28:533
22378992810,0cyclictest0-21swapper/319:13:173
22375992810,18cyclictest0-21swapper/019:28:250
22382992710,17cyclictest0-21swapper/720:16:007
22382992710,17cyclictest0-21swapper/719:49:097
22382992710,17cyclictest0-21swapper/719:28:307
22381992727,0cyclictest0-21swapper/619:13:096
22381992710,0cyclictest0-21swapper/619:49:396
22380992710,17cyclictest0-21swapper/520:15:545
22380992710,17cyclictest0-21swapper/519:28:245
22380992710,0cyclictest0-21swapper/519:49:065
22379992710,0cyclictest0-21swapper/419:49:114
22379992710,0cyclictest0-21swapper/419:28:294
22378992710,17cyclictest0-21swapper/319:49:103
22377992710,17cyclictest0-21swapper/219:28:232
22377992710,0cyclictest0-21swapper/219:49:102
22376992727,0cyclictest0-21swapper/119:13:161
22376992710,17cyclictest0-21swapper/120:16:011
22376992710,17cyclictest0-21swapper/119:49:161
22376992710,17cyclictest0-21swapper/119:28:301
22375992710,17cyclictest0-21swapper/020:16:000
22375992710,17cyclictest0-21swapper/019:13:260
22375992710,0cyclictest0-21swapper/019:49:050
68642260,0sleep70-21swapper/720:30:127
22381992610,0cyclictest0-21swapper/619:28:246
22380992626,0cyclictest0-21swapper/519:13:165
22379992626,0cyclictest0-21swapper/420:15:564
22377992626,0cyclictest0-21swapper/220:16:032
22377992626,0cyclictest0-21swapper/219:13:102
103072260,0sleep20-21swapper/221:32:182
77282250,1sleep00-21swapper/021:15:000
22382992424,0cyclictest0-21swapper/719:13:207
22379992323,0cyclictest0-21swapper/419:13:134
22378992110,10cyclictest0-21swapper/321:46:533
140822210,0sleep00-21swapper/021:34:470
299972200,1sleep70-21swapper/721:41:517
2237999190,18cyclictest0-21swapper/419:15:184
22378991910,8cyclictest0-21swapper/321:10:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional