You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 11:51
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Thu Mar 26, 2026 00:55:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170499972283,381cyclictest0-21swapper/323:45:383
170499972283,381cyclictest0-21swapper/323:45:383
1704699697441,253cyclictest0-21swapper/023:14:410
170519966774,127cyclictest0-21swapper/523:10:475
170489965824,2cyclictest0-21swapper/200:15:292
17050996370,84cyclictest0-21swapper/400:34:274
1705399635251,381cyclictest25233-21diskmemload23:29:077
170469962533,85cyclictest0-21swapper/023:44:180
170519962070,84cyclictest121rcu_preempt22:55:255
1705299617109,126cyclictest0-21swapper/600:25:046
170489960653,126cyclictest0-21swapper/222:29:582
170479960410,84cyclictest0-21swapper/123:10:291
1704699603393,88cyclictest31283-21cat23:45:140
1704699603393,88cyclictest31283-21cat23:45:140
1704699603266,217cyclictest0-21swapper/022:54:180
17052995940,84cyclictest8158-21ssh00:42:596
17052995930,84cyclictest0-21swapper/600:33:156
1704899590121,211cyclictest33-21ksoftirqd/223:12:122
170509958977,88cyclictest121rcu_preempt20:52:324
170509958977,88cyclictest121rcu_preempt20:52:324
170509958977,88cyclictest121rcu_preempt20:52:324
170499958676,127cyclictest0-21swapper/322:30:023
1705399580112,465cyclictest0-21swapper/723:30:207
1704699580240,338cyclictest20779-1kworker/u17:123:16:520
170489957564,508cyclictest0-21swapper/223:30:202
1705199574108,463cyclictest0-21swapper/521:35:175
170489957130,295cyclictest0-21swapper/222:55:102
170479956958,338cyclictest0-21swapper/100:08:111
170479956920,84cyclictest0-21swapper/123:30:201
170529956616,84cyclictest0-21swapper/623:30:196
170469956554,380cyclictest0-21swapper/023:53:330
1704699564436,126cyclictest0-21swapper/000:34:340
170479956313,84cyclictest0-21swapper/123:28:081
170519956154,126cyclictest121rcu_preempt22:27:375
170489956111,126cyclictest0-21swapper/200:33:362
170539955443,508cyclictest0-21swapper/721:37:227
170509955145,84cyclictest17767-21cat23:20:294
170469955182,84cyclictest121rcu_preempt00:11:240
17046995501,84cyclictest0-21swapper/023:20:290
1704999544117,211cyclictest41-21ksoftirqd/323:11:223
170469954377,84cyclictest0-21swapper/022:44:050
170509954234,126cyclictest0-21swapper/421:37:224
1704799541119,296cyclictest0-21swapper/100:10:301
170499953971,465cyclictest0-21swapper/323:20:283
170479953830,127cyclictest13725-21ssh23:18:491
1705199535108,211cyclictest57-21ksoftirqd/523:18:565
170479953525,380cyclictest0-21swapper/121:36:561
170479953425,84cyclictest0-21swapper/121:08:541
1704699533278,253cyclictest0-21swapper/000:23:590
170499953221,508cyclictest0-21swapper/321:37:223
1705399530108,126cyclictest0-21swapper/723:09:037
1705199527104,253cyclictest12644-21ssh00:09:175
170529952658,210cyclictest65-21ksoftirqd/600:11:106
1705099526187,337cyclictest68050irq/122-eth000:14:374
1705099524184,338cyclictest68050irq/122-eth021:10:144
1704699524270,211cyclictest0-21swapper/022:55:240
1704699522186,210cyclictest8729-21taskset00:43:340
170499952013,295cyclictest0-21swapper/323:44:213
170529951912,44cyclictest0-21swapper/621:37:036
170469951811,169cyclictest0-21swapper/022:28:180
1705099516218,295cyclictest25233-21diskmemload23:09:034
1705099515261,252cyclictest68050irq/122-eth000:15:214
17053995147,3cyclictest0-21swapper/723:17:457
17047995147,254cyclictest0-21swapper/122:54:401
17050995133,337cyclictest49-21ksoftirqd/423:30:184
1704899510168,126cyclictest121rcu_preempt23:09:492
17049995090,84cyclictest0-21swapper/300:33:153
17048995090,84cyclictest0-21swapper/223:53:512
17050995080,83cyclictest0-21swapper/423:53:514
170519950681,422cyclictest0-21swapper/522:19:095
1704699505211,176cyclictest0-21swapper/021:10:160
170539950332,296cyclictest17044-21cyclictest00:35:207
170509950178,84cyclictest0-21swapper/422:54:594
1705099500116,212cyclictest49-21ksoftirqd/422:45:124
1705199498118,213cyclictest25233-21diskmemload00:14:305
170469949832,88cyclictest121rcu_preempt21:08:220
170509949730,84cyclictest0-21swapper/423:27:414
170529949632,84cyclictest0-21swapper/623:20:296
170529949627,338cyclictest20774-21ssh22:29:556
170489949669,211cyclictest0-21swapper/223:17:042
1704699496114,125cyclictest9-21ksoftirqd/021:40:110
170509949574,92cyclictest49-21ksoftirqd/400:09:094
1705299494109,169cyclictest4366-21ssh23:10:476
170509949470,126cyclictest0-21swapper/422:18:284
170539949123,465cyclictest0-21swapper/722:19:357
170539949063,211cyclictest7445-21ssh23:14:177
170529948967,84cyclictest0-21swapper/622:54:106
1705099489360,126cyclictest0-21swapper/421:08:124
170499948963,126cyclictest41-21ksoftirqd/322:19:593
1704999486102,211cyclictest3585-21ssh22:54:413
170469948558,253cyclictest0-21swapper/023:29:550
1704699485143,210cyclictest23069-21timerwakeupswit00:15:280
1705199484186,126cyclictest20779-1kworker/u17:123:27:555
1705099484356,126cyclictest481ktimersoftd/400:24:384
170489948420,127cyclictest0-21swapper/221:40:132
170529948317,211cyclictest0-21swapper/623:53:126
170519948317,84cyclictest0-21swapper/522:54:585
170509948216,168cyclictest7555-21ssh23:14:224
170469948117,84cyclictest0-21swapper/021:39:130
1705199480396,4cyclictest561ktimersoftd/522:20:165
1704799479225,84cyclictest241ktimersoftd/100:33:091
170489947856,84cyclictest0-21swapper/200:14:392
170469947815,218cyclictest0-21swapper/000:09:510
170539947661,247cyclictest4719-1kworker/7:1H00:24:557
1705299476136,337cyclictest25233-21diskmemload23:18:196
17049994767,211cyclictest401ktimersoftd/322:44:343
170529947452,84cyclictest0-21swapper/620:55:166
170509947352,83cyclictest0-21swapper/420:55:174
170479947347,295cyclictest0-21swapper/100:35:121
170539947288,295cyclictest0-21swapper/722:30:027
1705199471177,84cyclictest57-21ksoftirqd/523:20:045
170529947048,84cyclictest0-21swapper/600:07:566
170499946987,84cyclictest892-21awk23:30:013
170499946945,84cyclictest0-21swapper/320:55:013
170499946945,84cyclictest0-21swapper/320:55:013
170499946945,84cyclictest0-21swapper/320:55:003
170479946947,84cyclictest0-21swapper/123:43:491
1705099468127,126cyclictest49-21ksoftirqd/423:16:524
170499946782,253cyclictest121rcu_preempt00:09:093
170499946782,211cyclictest41-21ksoftirqd/300:24:203
1704699466125,338cyclictest0-21swapper/023:09:320
170499946538,211cyclictest0-21swapper/323:16:483
1705199464205,127cyclictest26825-21gltestperf21:10:155
170489946480,211cyclictest17016-21ssh21:37:542
170479946480,127cyclictest25-21ksoftirqd/100:23:321
170469946481,126cyclictest121rcu_preempt20:54:490
170469946481,126cyclictest121rcu_preempt20:54:490
170469946481,126cyclictest121rcu_preempt20:54:490
1704699464119,342cyclictest0-21swapper/022:30:240
170539946341,256cyclictest0-21swapper/722:29:407
1704799463123,337cyclictest0-21swapper/122:27:191
170539946276,211cyclictest73-21ksoftirqd/700:11:347
170519946240,256cyclictest0-21swapper/500:24:535
1705199462122,338cyclictest1751-21ntpd23:45:145
1705199462122,338cyclictest1751-21ntpd23:45:145
1704999462125,126cyclictest0-21swapper/300:35:233
170489946240,255cyclictest0-21swapper/200:24:532
1704799462206,253cyclictest0-21swapper/122:44:261
1704799462122,338cyclictest0-21swapper/123:08:501
170539946138,126cyclictest121rcu_preempt00:33:237
1705399461120,338cyclictest1751-21ntpd23:45:257
1705399461120,338cyclictest1751-21ntpd23:45:257
170519946182,295cyclictest0-21swapper/520:55:175
1704899461121,338cyclictest0-21swapper/200:08:122
170479946139,84cyclictest0-21swapper/122:55:241
1704799461120,338cyclictest0-21swapper/123:20:311
1705299460289,169cyclictest641ktimersoftd/600:23:016
170519946039,256cyclictest0-21swapper/500:32:055
1704799460119,338cyclictest0-21swapper/122:20:091
170539945936,256cyclictest17044-21cyclictest00:15:297
170509945979,134cyclictest30579-21taskset23:45:044
170509945979,134cyclictest30579-21taskset23:45:044
1705099459118,338cyclictest0-21swapper/422:20:154
170489945937,256cyclictest0-21swapper/222:44:322
170469945934,253cyclictest0-21swapper/022:19:560
17052994580,77cyclictest0-21swapper/621:10:146
170539945734,257cyclictest0-21swapper/723:53:557
170519945735,256cyclictest0-21swapper/521:07:555
170489945673,339cyclictest23485-21sh22:30:242
170539945531,257cyclictest0-21swapper/723:20:307
1705399455113,211cyclictest73-21ksoftirqd/722:53:227
170529945532,3cyclictest0-21swapper/622:44:326
170499945532,256cyclictest0-21swapper/300:44:563
170489945575,296cyclictest0-21swapper/223:43:482
170539945432,256cyclictest0-21swapper/721:07:547
170539945431,255cyclictest0-21swapper/721:10:267
170539945373,296cyclictest6311-21rm22:55:257
170539945330,256cyclictest0-21swapper/700:08:457
170479945230,2cyclictest0-21swapper/123:45:561
170479945230,2cyclictest0-21swapper/123:45:561
1705099451108,127cyclictest18452-21ssh22:27:244
170489945170,296cyclictest0-21swapper/222:54:102
170519945066,210cyclictest57-21ksoftirqd/520:54:165
170519945066,210cyclictest57-21ksoftirqd/520:54:165
170519945066,210cyclictest57-21ksoftirqd/520:54:155
1704899450109,338cyclictest0-21swapper/200:25:172
1705399449405,41cyclictest711rcuc/722:43:457
170529944927,84cyclictest0-21swapper/623:43:486
170529944927,84cyclictest0-21swapper/622:18:496
1705099449109,338cyclictest0-21swapper/400:44:104
170499944927,2cyclictest0-21swapper/300:14:053
170489944966,253cyclictest0-21swapper/221:08:542
170479944927,2cyclictest0-21swapper/122:30:211
1705399448106,211cyclictest25233-21diskmemload23:43:557
170519944864,210cyclictest57-21ksoftirqd/523:09:175
1704899448108,338cyclictest0-21swapper/222:45:112
1704899448107,338cyclictest629-21ptp4l00:35:052
1704999447110,3cyclictest18080-21kworker/u16:000:25:053
170489944725,2cyclictest0-21swapper/223:45:522
170489944725,2cyclictest0-21swapper/223:45:522
170469944767,85cyclictest0-21swapper/023:30:190
170509944666,217cyclictest0-21swapper/423:44:104
170519944519,211cyclictest57-21ksoftirqd/522:43:535
170499944518,169cyclictest25233-21diskmemload22:55:113
170489944522,256cyclictest0-21swapper/223:30:022
1705399444186,174cyclictest646-21nscd21:40:127
170499944421,259cyclictest0-21swapper/321:06:593
170499944420,84cyclictest0-21swapper/322:27:243
1705199443101,211cyclictest22058-21ssh00:15:195
170489944320,2cyclictest0-21swapper/223:20:142
170479944262,296cyclictest0-21swapper/120:55:171
170519944119,3cyclictest0-21swapper/500:25:045
170509944158,84cyclictest0-21swapper/422:44:324
170499944118,3cyclictest0-21swapper/300:15:063
1704799441141,127cyclictest121rcu_preempt23:53:161
170529944018,255cyclictest0-21swapper/623:29:546
170519943999,338cyclictest0-21swapper/500:44:045
170499943953,211cyclictest41-21ksoftirqd/321:40:093
1704799439105,161cyclictest25-21ksoftirqd/120:52:091
1704799439105,161cyclictest25-21ksoftirqd/120:52:091
1704799439105,161cyclictest25-21ksoftirqd/120:52:091
170539943814,126cyclictest0-21swapper/722:20:087
170529943866,118cyclictest0-21swapper/600:15:296
170509943817,84cyclictest6310-21seq22:55:254
170539943714,256cyclictest0-21swapper/700:25:047
170509943716,41cyclictest0-21swapper/422:30:494
170499943715,256cyclictest0-21swapper/323:53:553
170489943655,296cyclictest0-21swapper/220:55:172
170539943555,296cyclictest0-21swapper/720:55:177
170529943512,84cyclictest0-21swapper/622:55:256
170469943521,76cyclictest0-21swapper/020:55:200
170519943494,338cyclictest0-21swapper/500:35:185
170489943494,126cyclictest33-21ksoftirqd/222:19:062
17047994325,126cyclictest0-21swapper/100:43:331
1705199430132,126cyclictest121rcu_preempt22:45:045
17049994307,3cyclictest2793-21/usr/sbin/munin22:20:103
170509942891,83cyclictest0-21swapper/400:35:124
170529942786,338cyclictest24490-21ssh00:35:126
17051994270,85cyclictest0-21swapper/522:30:225
17049994273,126cyclictest0-21swapper/321:10:173
170529942646,84cyclictest0-21swapper/622:20:076
170499942683,340cyclictest17044-21cyclictest22:45:053
170469942645,84cyclictest0-21swapper/000:35:220
170519942382,338cyclictest0-21swapper/523:52:165
170479942381,169cyclictest25-21ksoftirqd/122:45:051
17047994231,84cyclictest0-21swapper/122:18:481
170489942282,338cyclictest17044-21cyclictest20:52:102
170489942282,338cyclictest17044-21cyclictest20:52:102
170489942282,338cyclictest17044-21cyclictest20:52:092
170489942282,338cyclictest0-21swapper/200:43:202
170539942180,338cyclictest0-21swapper/720:54:307
170539942180,338cyclictest0-21swapper/720:54:307
170539942180,338cyclictest0-21swapper/720:54:297
170529942141,2cyclictest0-21swapper/621:07:556
170529942040,2cyclictest0-21swapper/620:53:476
170529942040,2cyclictest0-21swapper/620:53:476
170529942040,2cyclictest0-21swapper/620:53:476
170519942041,214cyclictest2858-21missed_timers23:30:195
170479942040,3cyclictest0-21swapper/100:25:041
170469942081,84cyclictest0-21swapper/000:25:150
170529941978,338cyclictest0-21swapper/623:08:476
170469941980,84cyclictest0-21swapper/022:20:160
1704999418203,127cyclictest2808-21ls23:30:173
170479941877,338cyclictest0-21swapper/121:10:031
170529941776,338cyclictest0-21swapper/623:45:296
170529941776,338cyclictest0-21swapper/623:45:286
170539941676,338cyclictest0-21swapper/700:44:597
170499941631,169cyclictest0-21swapper/323:08:513
170469941677,84cyclictest0-21swapper/022:45:050
170519941473,338cyclictest0-21swapper/523:44:175
1704799412117,126cyclictest25-21ksoftirqd/121:35:001
1705299411113,295cyclictest24499-21sh22:30:546
170499941131,296cyclictest0-21swapper/320:55:153
170539941070,338cyclictest0-21swapper/722:45:117
170489940867,338cyclictest25233-21diskmemload21:10:172
170529940566,84cyclictest0-21swapper/622:45:036
170479939395,126cyclictest121rcu_preempt21:40:131
170479939212,3cyclictest0-21swapper/100:15:291
170519938240,126cyclictest57-21ksoftirqd/521:35:005
1705199379122,127cyclictest0-21swapper/521:40:105
170489937941,172cyclictest0-21swapper/222:20:082
170499937638,212cyclictest0-21swapper/321:34:593
170509936830,41cyclictest0-21swapper/421:40:144
170509936366,84cyclictest0-21swapper/400:25:034
170539935113,84cyclictest0-21swapper/721:34:597
17050993519,126cyclictest0-21swapper/421:34:594
17052993445,84cyclictest0-21swapper/621:40:136
170529933438,3cyclictest0-21swapper/621:34:596
17048993320,2cyclictest11643-21ssh21:34:592
170469931823,134cyclictest0-21swapper/021:34:590
1463521210,4sleep40-21swapper/419:05:124
1463521210,4sleep40-21swapper/419:05:124
182032930,1sleep60-21swapper/623:55:156
1659128653,29sleep50-21swapper/519:09:395
1659128653,29sleep50-21swapper/519:09:395
1660528451,29sleep10-21swapper/119:09:511
1660528451,29sleep10-21swapper/119:09:501
1660128351,28sleep60-21swapper/619:09:486
1660128351,28sleep60-21swapper/619:09:476
1644828249,29sleep20-21swapper/219:07:362
1644828249,29sleep20-21swapper/219:07:352
1642628249,29sleep00-21swapper/019:07:180
1642628249,29sleep00-21swapper/019:07:170
1654628149,28sleep70-21swapper/719:09:017
1654628149,28sleep70-21swapper/719:09:017
1645828149,28sleep30-21swapper/319:07:453
1645828149,28sleep30-21swapper/319:07:453
286182740,0sleep20-21swapper/221:26:502
286182740,0sleep20-21swapper/221:26:502
233452730,2sleep51705199cyclictest21:25:005
223002690,0sleep00-21swapper/023:57:170
17048992910,18cyclictest0-21swapper/220:42:262
17048992910,18cyclictest0-21swapper/220:42:262
17053992828,0cyclictest0-21swapper/722:02:047
17053992828,0cyclictest0-21swapper/721:52:397
17053992810,18cyclictest0-21swapper/722:10:497
17053992810,18cyclictest0-21swapper/720:35:457
17053992810,18cyclictest0-21swapper/720:28:287
17053992810,18cyclictest0-21swapper/720:21:447
17053992810,18cyclictest0-21swapper/719:52:327
17053992810,18cyclictest0-21swapper/719:52:327
17053992810,18cyclictest0-21swapper/719:15:267
17050992810,18cyclictest0-21swapper/422:11:174
17049992828,0cyclictest0-21swapper/320:14:073
17049992810,18cyclictest0-21swapper/322:11:263
17049992810,18cyclictest0-21swapper/321:52:523
17049992810,18cyclictest0-21swapper/320:49:393
17049992810,18cyclictest0-21swapper/319:59:293
17049992810,18cyclictest0-21swapper/319:46:493
17049992810,18cyclictest0-21swapper/319:38:483
17049992810,0cyclictest0-21swapper/321:22:553
17048992810,0cyclictest0-21swapper/222:02:302
17048992810,0cyclictest0-21swapper/219:15:292
17048992810,0cyclictest0-21swapper/219:14:502
17047992827,1cyclictest0-21swapper/121:22:411
17047992827,0cyclictest0-21swapper/122:01:591
17047992810,18cyclictest0-21swapper/120:35:361
17047992810,17cyclictest0-21swapper/121:52:371
17046992828,0cyclictest0-21swapper/019:15:160
17046992810,18cyclictest0-21swapper/019:32:440
17053992727,0cyclictest0-21swapper/721:22:097
17053992727,0cyclictest0-21swapper/719:38:347
17053992710,17cyclictest0-21swapper/721:04:387
17053992710,17cyclictest0-21swapper/720:14:217
17053992710,17cyclictest0-21swapper/719:58:457
17053992710,17cyclictest0-21swapper/719:46:137
17053992710,17cyclictest0-21swapper/719:32:157
17053992710,17cyclictest0-21swapper/719:25:377
17053992710,17cyclictest0-21swapper/719:15:017
17053992710,0cyclictest0-21swapper/720:42:097
17053992710,0cyclictest0-21swapper/720:42:097
17053992710,0cyclictest0-21swapper/720:06:447
17052992726,0cyclictest0-21swapper/621:52:306
17052992710,17cyclictest0-21swapper/622:10:446
17052992710,17cyclictest0-21swapper/622:02:186
17052992710,17cyclictest0-21swapper/621:22:046
17052992710,17cyclictest0-21swapper/621:04:536
17052992710,17cyclictest0-21swapper/620:49:456
17052992710,17cyclictest0-21swapper/620:36:086
17052992710,17cyclictest0-21swapper/620:28:206
17052992710,17cyclictest0-21swapper/620:07:196
17052992710,17cyclictest0-21swapper/619:58:406
17052992710,17cyclictest0-21swapper/619:52:156
17052992710,17cyclictest0-21swapper/619:52:156
17052992710,17cyclictest0-21swapper/619:46:336
17052992710,17cyclictest0-21swapper/619:25:546
17052992710,17cyclictest0-21swapper/619:15:146
17052992710,17cyclictest0-21swapper/619:14:496
17052992710,0cyclictest0-21swapper/620:42:266
17052992710,0cyclictest0-21swapper/620:42:256
17052992710,0cyclictest0-21swapper/620:21:316
17052992710,0cyclictest0-21swapper/620:14:106
17052992710,0cyclictest0-21swapper/619:38:596
17052992710,0cyclictest0-21swapper/619:32:056
17051992727,0cyclictest0-21swapper/519:31:475
17051992710,17cyclictest0-21swapper/521:04:345
17051992710,17cyclictest0-21swapper/520:36:055
17051992710,17cyclictest0-21swapper/520:29:005
17051992710,17cyclictest0-21swapper/520:21:345
17051992710,17cyclictest0-21swapper/520:14:215
17051992710,17cyclictest0-21swapper/520:06:435
17051992710,17cyclictest0-21swapper/519:59:155
17051992710,17cyclictest0-21swapper/519:39:025
17051992710,17cyclictest0-21swapper/519:15:155
17051992710,17cyclictest0-21swapper/519:14:545
17051992710,0cyclictest0-21swapper/522:11:135
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional