You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-13 - 05:38
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Sat Jun 13, 2026 00:57:20)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319779975276,84cyclictest0-21swapper/423:58:194
319779975272,550cyclictest121rcu_preempt22:11:214
319779974725,719cyclictest0-21swapper/419:51:454
319779973354,83cyclictest64450irq/122-eth023:48:104
31977996801,676cyclictest0-21swapper/421:42:514
319759967477,338cyclictest0-21swapper/222:05:152
3197499671165,41cyclictest1022-21kworker/u16:322:53:381
319779966873,84cyclictest0-21swapper/422:21:444
319779966526,551cyclictest0-21swapper/420:50:024
3197699664119,542cyclictest0-21swapper/322:22:043
319779966026,555cyclictest0-21swapper/400:00:164
3197599637166,85cyclictest121rcu_preempt22:48:442
31974996360,84cyclictest0-21swapper/100:03:571
319759963379,380cyclictest0-21swapper/223:46:512
3198099629116,510cyclictest0-21swapper/722:22:057
3197899629118,508cyclictest17884-21sh22:22:045
319779962634,469cyclictest0-21swapper/422:52:004
3197499622538,3cyclictest241ktimersoftd/122:49:481
319779961866,549cyclictest0-21swapper/423:50:534
319779961831,584cyclictest0-21swapper/423:36:504
319759961670,288cyclictest121rcu_preempt22:44:132
3197499613144,253cyclictest0-21swapper/122:44:181
3197499613102,296cyclictest1152-21runrttasks22:13:011
319779960813,592cyclictest0-21swapper/423:09:524
319749960812,422cyclictest0-21swapper/123:54:391
319759960393,507cyclictest0-21swapper/222:12:332
319809960252,339cyclictest0-21swapper/700:00:507
31978996026,423cyclictest0-21swapper/522:53:385
319739959848,126cyclictest0-21swapper/022:48:220
31977995951,591cyclictest0-21swapper/422:04:034
31980995940,84cyclictest0-21swapper/723:51:007
31976995940,84cyclictest0-21swapper/323:09:203
31976995940,84cyclictest0-21swapper/322:13:093
31973995930,84cyclictest0-21swapper/022:21:450
31973995930,84cyclictest0-21swapper/022:11:520
319749958877,381cyclictest0-21swapper/122:05:121
319779958735,549cyclictest0-21swapper/422:15:034
319779958636,466cyclictest0-21swapper/400:33:324
319779958432,549cyclictest0-21swapper/422:45:444
319759958431,338cyclictest0-21swapper/223:09:282
319779958228,507cyclictest121rcu_preempt00:20:014
319739958271,380cyclictest0-21swapper/023:59:070
319759957622,381cyclictest0-21swapper/223:58:412
319799957466,126cyclictest0-21swapper/622:22:056
319739957264,126cyclictest26108-21kworker/u16:300:19:090
319779957119,549cyclictest0-21swapper/423:10:084
319779957119,549cyclictest0-21swapper/423:10:084
319779956718,384cyclictest0-21swapper/400:35:234
319779956715,549cyclictest0-21swapper/422:05:184
319759956761,211cyclictest22911-21ssh23:39:222
319749956714,295cyclictest0-21swapper/123:28:381
319799956515,2cyclictest0-21swapper/600:17:556
319769956351,296cyclictest0-21swapper/323:55:143
3197499562305,84cyclictest0-21swapper/123:39:381
319759955945,338cyclictest121rcu_preempt21:44:022
3197899556345,127cyclictest561ktimersoftd/522:47:365
31977995531,168cyclictest16278-21ssh21:14:564
31977995531,168cyclictest16278-21ssh21:14:554
31976995521,84cyclictest121rcu_preempt22:46:083
31976995500,84cyclictest0-21swapper/323:36:483
319799954983,84cyclictest0-21swapper/623:58:196
3197899549121,126cyclictest57-21ksoftirqd/522:12:345
319789954878,126cyclictest0-21swapper/523:40:025
319779954838,507cyclictest0-21swapper/422:44:514
319769954840,126cyclictest0-21swapper/320:49:533
3197499548213,125cyclictest0-21swapper/123:59:071
319739954882,211cyclictest7374-21diskmemload23:38:510
319789954779,465cyclictest0-21swapper/522:32:415
319799954234,126cyclictest0-21swapper/620:49:546
319769954231,295cyclictest0-21swapper/323:53:023
319759954235,211cyclictest0-21swapper/200:00:132
3197499542464,2cyclictest241ktimersoftd/119:53:281
319809953973,126cyclictest0-21swapper/700:17:407
319779953929,507cyclictest0-21swapper/423:28:414
319779953929,507cyclictest0-21swapper/400:43:354
3197899538197,338cyclictest7374-21diskmemload00:04:385
319789953731,297cyclictest0-21swapper/521:43:125
319739953668,295cyclictest0-21swapper/000:05:160
319779953568,465cyclictest31971-21cyclictest22:55:164
3197999534194,338cyclictest31971-21cyclictest22:33:556
319789953424,126cyclictest0-21swapper/520:49:545
319799953265,127cyclictest0-21swapper/623:48:176
319739953224,84cyclictest0-21swapper/023:49:180
319739953161,211cyclictest0-21swapper/021:15:160
319779952822,422cyclictest0-21swapper/423:30:214
319759952859,211cyclictest33-21ksoftirqd/222:25:242
319789952619,83cyclictest121rcu_preempt00:05:355
3197499526141,211cyclictest0-21swapper/122:25:111
319799952418,295cyclictest0-21swapper/623:07:176
3197899524103,211cyclictest19033-21rm00:17:205
319759952357,126cyclictest121rcu_preempt22:52:132
3197499523270,84cyclictest0-21swapper/121:14:261
3197499523270,84cyclictest0-21swapper/121:14:251
319799952113,126cyclictest698-21ptp4l19:51:286
319769952156,84cyclictest0-21swapper/322:54:213
319779952010,127cyclictest0-21swapper/422:25:214
319769952013,260cyclictest0-21swapper/323:28:113
319749952054,211cyclictest0-21swapper/122:23:241
319739952094,125cyclictest713-21in:imuxsock19:55:040
319809951950,296cyclictest0-21swapper/723:59:497
319789951810,84cyclictest0-21swapper/521:13:355
319789951810,84cyclictest0-21swapper/521:13:345
3197799518178,338cyclictest64450irq/122-eth000:20:304
319749951891,253cyclictest121rcu_preempt22:32:291
3197499513128,169cyclictest121rcu_preempt22:04:031
31976995125,341cyclictest0-21swapper/300:17:563
31975995125,84cyclictest0-21swapper/223:53:512
3197599512128,253cyclictest0-21swapper/200:19:082
3197699511169,339cyclictest1022-21kworker/u16:322:33:303
319759951186,260cyclictest6517-1kworker/u17:100:32:582
31978995091,211cyclictest0-21swapper/523:57:345
3197699509124,254cyclictest22115-21ssh22:44:383
319749950982,343cyclictest121rcu_preempt00:32:401
31973995091,84cyclictest0-21swapper/022:53:380
31974995082,42cyclictest7374-21diskmemload21:42:101
3197899507250,254cyclictest10844-21ls23:50:275
31977995071,127cyclictest0-21swapper/422:31:404
3197499507423,4cyclictest241ktimersoftd/100:20:121
319739950681,126cyclictest9-21ksoftirqd/023:51:000
319809950380,85cyclictest0-21swapper/722:34:517
319749950336,2cyclictest0-21swapper/123:07:431
319809950232,211cyclictest0-21swapper/722:52:217
3197599502121,84cyclictest121rcu_preempt22:34:122
319739950277,295cyclictest31971-21cyclictest19:52:250
319739950234,211cyclictest0-21swapper/000:32:410
319809950179,84cyclictest0-21swapper/720:49:307
319769950135,127cyclictest0-21swapper/321:14:533
319769950135,127cyclictest0-21swapper/321:14:533
319759950174,211cyclictest33-21ksoftirqd/222:23:142
319769950073,296cyclictest0-21swapper/322:03:373
319789949929,338cyclictest0-21swapper/522:04:545
319739949934,126cyclictest29823-21ssh23:08:500
3198099498117,295cyclictest15913-21ssh21:14:297
3198099498117,295cyclictest15913-21ssh21:14:287
3197699498157,126cyclictest121rcu_preempt00:42:343
3197399498115,126cyclictest0-21swapper/020:46:330
319799949728,296cyclictest0-21swapper/623:30:206
319789949733,253cyclictest0-21swapper/500:31:145
319779949669,339cyclictest121rcu_preempt00:05:274
319759949673,42cyclictest121rcu_preempt19:52:252
319759949630,126cyclictest25182-21uniq23:40:172
3197599496155,126cyclictest121rcu_preempt21:13:282
3197599496155,126cyclictest121rcu_preempt21:13:272
3198099495156,166cyclictest121rcu_preempt22:04:307
319739949529,84cyclictest0-21swapper/000:20:180
319809949369,126cyclictest73-21ksoftirqd/722:49:557
3197599493110,380cyclictest0-21swapper/220:49:532
3197699491107,126cyclictest41-21ksoftirqd/300:01:263
3198099490235,84cyclictest721ktimersoftd/723:30:187
319789948966,338cyclictest0-21swapper/522:05:235
319789948923,84cyclictest0-21swapper/500:20:075
319749948919,50cyclictest0-21swapper/121:45:061
319789948861,339cyclictest6963-21ssh23:48:425
319759948862,126cyclictest33-21ksoftirqd/223:28:322
3197699487106,126cyclictest41-21ksoftirqd/323:49:193
319759948659,296cyclictest0-21swapper/200:20:172
3198099484398,84cyclictest7374-21diskmemload22:44:217
319739948419,210cyclictest0-21swapper/022:42:360
319799948216,211cyclictest0-21swapper/600:00:526
319759948256,338cyclictest121rcu_preempt22:03:592
3197599482399,3cyclictest321ktimersoftd/200:05:122
319749948214,252cyclictest0-21swapper/123:48:131
3197399482268,126cyclictest0-21swapper/021:42:570
319749947913,84cyclictest0-21swapper/100:05:161
319739947913,126cyclictest0-21swapper/021:14:550
319739947913,126cyclictest0-21swapper/021:14:550
319739947812,126cyclictest0-21swapper/022:03:540
319809947794,380cyclictest0-21swapper/722:12:327
319799947653,127cyclictest0-21swapper/622:54:536
319749947594,126cyclictest0-21swapper/120:45:271
31980994727,3cyclictest0-21swapper/723:39:147
31978994716,292cyclictest0-21swapper/522:25:125
31974994691,126cyclictest0-21swapper/100:18:001
31980994671,211cyclictest0-21swapper/722:05:157
31979994671,211cyclictest0-21swapper/623:50:266
3197399467211,126cyclictest26108-21kworker/u16:300:42:550
3198099466124,339cyclictest0-21swapper/723:47:127
3197699466125,338cyclictest0-21swapper/322:55:163
3197699466125,338cyclictest0-21swapper/321:42:393
3198099465123,339cyclictest23993-21mailstats00:20:287
31976994651,90cyclictest0-21swapper/323:40:213
3198099464125,336cyclictest0-21swapper/723:10:027
31979994640,84cyclictest0-21swapper/623:36:486
319789946437,296cyclictest0-21swapper/522:55:035
3197999463163,126cyclictest121rcu_preempt22:44:376
3197399463207,126cyclictest9-21ksoftirqd/000:04:430
319799946282,84cyclictest0-21swapper/600:42:526
319799946235,210cyclictest0-21swapper/622:04:206
319799946177,212cyclictest0-21swapper/600:05:266
3197699461121,337cyclictest0-21swapper/319:53:443
319759946033,254cyclictest0-21swapper/221:15:112
319739946077,126cyclictest0-21swapper/022:31:570
3197699459161,126cyclictest121rcu_preempt00:20:173
319809945878,83cyclictest0-21swapper/721:44:137
3198099458117,338cyclictest0-21swapper/700:33:167
3197999458119,171cyclictest0-21swapper/621:43:496
319789945875,210cyclictest561ktimersoftd/522:42:475
3197899458118,338cyclictest7374-21diskmemload21:15:165
319779945831,85cyclictest0-21swapper/423:40:074
3197499458117,338cyclictest0-21swapper/100:43:501
3197999457119,170cyclictest0-21swapper/600:20:276
319789945729,212cyclictest0-21swapper/500:43:165
3197899457117,338cyclictest0-21swapper/523:10:255
3197899457117,338cyclictest0-21swapper/523:10:255
3197699457116,339cyclictest0-21swapper/300:33:573
3197699457116,338cyclictest0-21swapper/319:55:193
3198099456118,335cyclictest3614-21ssh23:28:257
3197999456161,253cyclictest0-21swapper/622:46:216
319749945632,84cyclictest121rcu_preempt21:15:191
3198099455114,338cyclictest3165-21ssh22:55:177
319799945571,211cyclictest0-21swapper/600:31:526
3197999455118,170cyclictest0-21swapper/622:14:536
319759945533,256cyclictest0-21swapper/200:43:422
319759945527,296cyclictest0-21swapper/223:30:232
319749945531,3cyclictest0-21swapper/122:35:051
319769945432,253cyclictest0-21swapper/322:25:063
3197999453112,211cyclictest17695-21ssh21:15:156
319779945328,422cyclictest0-21swapper/422:35:134
3198099452113,336cyclictest0-21swapper/719:55:207
319789945272,296cyclictest0-21swapper/521:45:205
319789945130,2cyclictest0-21swapper/523:28:265
3197899451157,210cyclictest2300-1kworker/u17:222:35:155
319749945127,169cyclictest0-21swapper/123:10:201
319749945127,169cyclictest0-21swapper/123:10:201
319799945028,85cyclictest0-21swapper/622:15:036
319789944969,296cyclictest0-21swapper/522:15:135
319809944826,255cyclictest0-21swapper/700:43:157
319769944865,126cyclictest41-21ksoftirqd/323:10:093
319769944865,126cyclictest41-21ksoftirqd/323:10:093
319749944825,256cyclictest0-21swapper/122:15:141
319799944768,83cyclictest0-21swapper/621:14:296
319799944768,83cyclictest0-21swapper/621:14:296
319789944666,84cyclictest0-21swapper/523:09:525
319739944624,255cyclictest0-21swapper/023:28:250
3197399446185,84cyclictest121rcu_preempt23:40:240
319779944322,164cyclictest64450irq/122-eth021:15:164
319739944370,84cyclictest0-21swapper/022:35:150
319739944321,219cyclictest0-21swapper/021:45:110
3197899442103,84cyclictest0-21swapper/519:54:035
319779944216,127cyclictest27312-21/usr/sbin/munin19:55:174
3197699442104,171cyclictest0-21swapper/322:15:143
319739944220,256cyclictest0-21swapper/022:15:130
319799944017,135cyclictest0-21swapper/600:35:256
319759944014,211cyclictest33-21ksoftirqd/222:35:142
319759943917,84cyclictest0-21swapper/221:45:202
319759943714,256cyclictest0-21swapper/222:15:142
319779943611,84cyclictest0-21swapper/421:45:204
31974994369,338cyclictest0-21swapper/122:55:161
31975994315,211cyclictest0-21swapper/220:50:112
319739943152,248cyclictest0-21swapper/022:25:140
31974994306,84cyclictest121rcu_preempt23:40:071
31975994275,84cyclictest32293-21gltestperf23:10:152
31975994275,84cyclictest32293-21gltestperf23:10:142
3197999426126,126cyclictest65-21ksoftirqd/623:10:156
3197999426126,126cyclictest65-21ksoftirqd/623:10:146
319809942544,84cyclictest0-21swapper/721:45:117
3197499425172,132cyclictest0-21swapper/123:30:201
3197699424129,253cyclictest0-21swapper/323:30:233
3198099423123,126cyclictest121rcu_preempt22:15:037
319789942383,85cyclictest31971-21cyclictest23:40:275
319809942242,169cyclictest0-21swapper/700:05:137
3198099422165,254cyclictest721ktimersoftd/723:10:197
3198099422165,254cyclictest721ktimersoftd/723:10:197
3198099421165,253cyclictest721ktimersoftd/722:25:257
319769942139,177cyclictest0-21swapper/322:35:143
3197999420250,168cyclictest641ktimersoftd/619:55:076
319809941978,84cyclictest0-21swapper/719:51:207
319799941980,84cyclictest0-21swapper/623:40:176
319769941737,169cyclictest0-21swapper/321:45:213
319759941675,338cyclictest0-21swapper/222:55:162
3197499416115,127cyclictest0-21swapper/119:55:201
319799941576,84cyclictest0-21swapper/623:28:096
319799941576,84cyclictest0-21swapper/622:55:156
319789941574,338cyclictest0-21swapper/520:50:105
319739941475,84cyclictest0-21swapper/022:05:190
319799941374,84cyclictest0-21swapper/622:25:086
319789941333,295cyclictest0-21swapper/519:55:155
319759941328,296cyclictest0-21swapper/219:55:062
319799941273,84cyclictest0-21swapper/622:05:126
319739941273,84cyclictest0-21swapper/023:30:180
319739941270,126cyclictest0-21swapper/022:55:130
319789941071,84cyclictest0-21swapper/523:30:235
319769941025,127cyclictest0-21swapper/322:05:313
319779940930,297cyclictest0-21swapper/400:26:174
319739940768,84cyclictest0-21swapper/023:10:200
319739940768,84cyclictest0-21swapper/023:10:190
319799940424,84cyclictest0-21swapper/622:35:056
319769940116,211cyclictest26505-21rm00:05:123
319799940061,84cyclictest0-21swapper/621:45:266
319779939453,338cyclictest0-21swapper/420:50:104
319759939255,169cyclictest0-21swapper/200:35:282
319739939253,84cyclictest0-21swapper/000:26:240
319769939050,84cyclictest0-21swapper/300:35:283
31980993888,126cyclictest0-21swapper/720:50:107
319809938547,84cyclictest0-21swapper/700:35:287
3198099381124,253cyclictest25104-21fschecks_time23:40:147
319769938039,127cyclictest41-21ksoftirqd/300:26:243
3198099376123,42cyclictest16832-21ssh21:15:057
319789937537,254cyclictest0-21swapper/500:35:265
319739937433,126cyclictest0-21swapper/020:50:090
319749937336,3cyclictest0-21swapper/100:35:231
319749937334,84cyclictest0-21swapper/120:50:091
319789937033,253cyclictest0-21swapper/500:26:225
319809936426,50cyclictest0-21swapper/722:35:147
319769936221,338cyclictest0-21swapper/321:15:163
319769935658,84cyclictest0-21swapper/320:50:103
319759935112,84cyclictest0-21swapper/200:26:242
3197499348178,82cyclictest0-21swapper/100:26:231
319739934345,126cyclictest0-21swapper/000:35:280
319799932832,170cyclictest0-21swapper/600:26:186
319809932064,253cyclictest0-21swapper/700:26:247
319799928223,177cyclictest0-21swapper/620:50:096
123642930,0sleep60-21swapper/621:28:526
3130129262,7sleep50-21swapper/519:06:335
2900229186,2sleep30-21swapper/319:05:123
3148729062,24sleep40-21swapper/419:09:134
3126228959,27sleep60-21swapper/619:06:026
3124728656,27sleep00-21swapper/019:05:480
3152828251,27sleep70-21swapper/719:09:487
3151328251,28sleep10-21swapper/119:09:351
3124928151,27sleep20-21swapper/219:05:512
19282790,0sleep20-21swapper/220:05:152
111782680,0sleep00-21swapper/000:13:420
111782680,0sleep00-21swapper/000:13:420
31978993210,21cyclictest0-21swapper/519:29:405
31978993210,21cyclictest0-21swapper/519:29:405
31977993227,4cyclictest0-21swapper/420:26:494
31977993226,5cyclictest0-21swapper/419:21:514
31978993124,6cyclictest0-21swapper/520:06:515
31977993110,0cyclictest0-21swapper/420:06:544
31978993026,4cyclictest0-21swapper/519:21:485
31978993024,5cyclictest0-21swapper/520:26:495
31977992925,3cyclictest0-21swapper/419:29:434
31977992925,3cyclictest0-21swapper/419:29:424
31976992910,18cyclictest0-21swapper/320:27:053
31980992828,0cyclictest0-21swapper/721:32:487
31980992810,18cyclictest0-21swapper/721:03:487
31980992810,18cyclictest0-21swapper/720:16:047
31979992810,18cyclictest0-21swapper/619:49:536
31978992810,18cyclictest0-21swapper/521:32:385
31976992810,18cyclictest0-21swapper/319:21:543
31976992810,0cyclictest0-21swapper/321:32:233
31975992810,18cyclictest0-21swapper/219:21:492
31974992810,18cyclictest0-21swapper/119:13:471
31980992727,0cyclictest0-21swapper/719:13:417
31980992710,17cyclictest0-21swapper/720:44:557
31980992710,17cyclictest0-21swapper/720:26:507
31980992710,17cyclictest0-21swapper/720:06:577
31980992710,17cyclictest0-21swapper/719:49:447
31980992710,17cyclictest0-21swapper/719:39:147
31980992710,17cyclictest0-21swapper/719:21:517
31980992710,0cyclictest0-21swapper/720:36:487
31980992710,0cyclictest0-21swapper/719:29:197
31980992710,0cyclictest0-21swapper/719:29:187
31979992727,0cyclictest0-21swapper/620:27:056
31979992710,17cyclictest0-21swapper/620:44:586
31979992710,17cyclictest0-21swapper/619:39:086
31979992710,17cyclictest0-21swapper/619:29:216
31979992710,17cyclictest0-21swapper/619:29:216
31979992710,17cyclictest0-21swapper/619:14:066
31979992710,0cyclictest0-21swapper/621:32:176
31979992710,0cyclictest0-21swapper/621:03:416
31979992710,0cyclictest0-21swapper/620:36:506
31979992710,0cyclictest0-21swapper/620:06:366
31978992710,17cyclictest0-21swapper/520:44:505
31978992710,17cyclictest0-21swapper/520:37:215
31978992710,17cyclictest0-21swapper/520:16:085
31978992710,17cyclictest0-21swapper/519:39:385
31978992710,17cyclictest0-21swapper/519:13:475
31978992710,0cyclictest0-21swapper/521:03:215
31978992710,0cyclictest0-21swapper/519:49:515
31977992710,17cyclictest0-21swapper/421:32:114
31977992710,17cyclictest0-21swapper/420:37:234
31977992710,17cyclictest0-21swapper/420:16:354
31977992710,0cyclictest0-21swapper/421:03:224
31977992710,0cyclictest0-21swapper/419:49:514
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional