You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-15 - 02:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Sep 15, 2026 00:53:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30560999320,84cyclictest0-21swapper/022:32:400
305679975633,720cyclictest15404-21ssh22:21:457
305679969818,677cyclictest0-21swapper/723:42:067
305619969662,84cyclictest0-21swapper/122:10:051
3056399679209,296cyclictest0-21swapper/300:00:513
30562996760,126cyclictest0-21swapper/223:19:162
305649966471,507cyclictest0-21swapper/423:03:454
3056699655187,338cyclictest121rcu_preempt22:37:456
30561996350,84cyclictest0-21swapper/122:38:281
30560996350,84cyclictest0-21swapper/019:39:300
30560996350,41cyclictest0-21swapper/023:55:250
30564996340,84cyclictest0-21swapper/423:19:174
30564996282,36cyclictest0-21swapper/422:24:534
305629962574,211cyclictest0-21swapper/222:38:202
305609962126,592cyclictest0-21swapper/022:53:460
305629961562,380cyclictest0-21swapper/222:53:552
305679961418,169cyclictest0-21swapper/723:14:167
3056099613106,126cyclictest9-21ksoftirqd/023:52:270
3056199612100,296cyclictest0-21swapper/123:54:241
305619961056,423cyclictest0-21swapper/123:17:341
3056099598130,295cyclictest0-21swapper/000:00:580
305649959685,338cyclictest121rcu_preempt22:53:544
305669959582,380cyclictest0-21swapper/600:00:506
30564995950,84cyclictest0-21swapper/419:39:494
30565995940,84cyclictest0-21swapper/523:35:125
30564995940,85cyclictest0-21swapper/423:35:134
30564995940,84cyclictest0-21swapper/421:55:174
30563995940,84cyclictest0-21swapper/321:55:183
30563995940,84cyclictest0-21swapper/321:52:263
30562995940,84cyclictest0-21swapper/221:52:252
30565995930,84cyclictest0-21swapper/521:52:255
30565995930,83cyclictest0-21swapper/522:51:485
30565995930,83cyclictest0-21swapper/521:55:175
30564995930,84cyclictest0-21swapper/421:52:254
3056599590121,296cyclictest0-21swapper/500:22:325
3056699586122,126cyclictest0-21swapper/622:26:506
3056799584116,466cyclictest0-21swapper/723:03:457
3056099584118,464cyclictest0-21swapper/023:03:450
305629958168,296cyclictest0-21swapper/223:47:422
3056799577112,127cyclictest0-21swapper/722:47:237
305679957623,169cyclictest0-21swapper/720:18:537
305669956756,338cyclictest121rcu_preempt23:13:426
305649956756,338cyclictest49-21ksoftirqd/421:37:544
305609956715,549cyclictest0-21swapper/023:20:510
305629956498,89cyclictest121rcu_preempt00:22:162
305679955845,84cyclictest0-21swapper/723:48:307
30562995589,92cyclictest0-21swapper/223:50:582
30562995589,338cyclictest0-21swapper/222:26:512
30567995541,126cyclictest0-21swapper/721:37:297
305679955242,507cyclictest0-21swapper/722:30:167
30567995521,42cyclictest0-21swapper/722:25:207
30567995521,41cyclictest0-21swapper/720:08:227
30561995510,84cyclictest0-21swapper/122:28:401
30560995510,84cyclictest0-21swapper/022:09:000
30561995501,42cyclictest0-21swapper/122:24:301
305649954779,380cyclictest0-21swapper/423:49:134
305639954576,296cyclictest0-21swapper/322:24:523
305609954173,465cyclictest16214-21ssh23:19:470
305679953931,429cyclictest0-21swapper/700:33:577
305659953830,126cyclictest0-21swapper/500:00:585
305669953726,380cyclictest0-21swapper/623:53:026
305629953730,84cyclictest121rcu_preempt22:20:592
3056099537111,423cyclictest0-21swapper/022:40:030
305679953422,509cyclictest0-21swapper/700:04:447
305669953468,126cyclictest0-21swapper/622:54:176
3056099534107,211cyclictest0-21swapper/022:28:050
305669953220,340cyclictest0-21swapper/622:07:036
305639953265,126cyclictest0-21swapper/322:30:153
305629953124,338cyclictest0-21swapper/222:45:362
305619953066,126cyclictest0-21swapper/121:38:041
3056199529188,211cyclictest30557-21cyclictest22:45:281
305679952715,509cyclictest0-21swapper/723:05:167
305629952518,127cyclictest0-21swapper/222:34:232
305619952516,84cyclictest0-21swapper/100:21:031
3056199525100,295cyclictest0-21swapper/123:41:551
305679952211,381cyclictest12548-21grep19:30:177
305649952257,210cyclictest0-21swapper/419:47:054
305649952253,211cyclictest49-21ksoftirqd/423:20:104
305619952295,297cyclictest0-21swapper/100:04:321
305609952216,8cyclictest0-21swapper/021:40:020
3056299520181,84cyclictest264-21jbd2/md0-821:37:572
305649951956,82cyclictest0-21swapper/400:33:564
30567995187,41cyclictest0-21swapper/700:36:087
305619951811,338cyclictest0-21swapper/120:09:071
305619951694,84cyclictest0-21swapper/123:46:151
30563995156,85cyclictest0-21swapper/300:11:323
3056299515428,84cyclictest321ktimersoftd/200:05:022
30567995141,42cyclictest0-21swapper/700:05:117
30563995145,126cyclictest0-21swapper/319:30:193
30563995135,126cyclictest0-21swapper/322:45:213
30563995123,126cyclictest0-21swapper/300:21:473
30562995121,296cyclictest14195-21ssh22:40:282
30562995113,126cyclictest0-21swapper/222:07:422
30566995102,84cyclictest16766-21latency_hist19:40:016
3056399510169,338cyclictest704-21nscd23:15:163
30565995090,84cyclictest0-21swapper/520:00:065
30564995090,84cyclictest0-21swapper/420:00:064
3056399509257,7cyclictest0-21swapper/323:41:503
30563995090,84cyclictest0-21swapper/322:51:493
30563995090,84cyclictest0-21swapper/320:00:063
305679950884,254cyclictest0-21swapper/723:50:597
305649950883,422cyclictest0-21swapper/422:28:364
3056499508208,126cyclictest0-21swapper/422:47:294
30562995081,43cyclictest121rcu_preempt23:35:452
305619950781,211cyclictest0-21swapper/119:49:451
3056099506207,126cyclictest0-21swapper/021:38:420
305629950581,169cyclictest0-21swapper/223:02:322
305659950437,210cyclictest57-21ksoftirqd/519:50:155
305609950477,254cyclictest30557-21cyclictest23:13:120
3056799503117,211cyclictest23829-21df_inode19:50:187
305629950335,295cyclictest0-21swapper/200:04:222
3056199503204,126cyclictest121rcu_preempt22:50:241
305609950339,384cyclictest0-21swapper/023:46:390
3056699502419,3cyclictest631rcuc/622:21:506
305609950281,337cyclictest0-21swapper/000:10:510
3056699501121,127cyclictest0-21swapper/619:45:506
305659950137,84cyclictest21456-21runrttasks22:25:205
3056699499120,338cyclictest0-21swapper/622:32:186
3056299499241,85cyclictest0-21swapper/222:10:152
305609949977,126cyclictest0-21swapper/021:55:270
305679949830,465cyclictest0-21swapper/719:58:537
305649949877,84cyclictest0-21swapper/422:40:104
305649949834,380cyclictest0-21swapper/422:33:314
3056399498115,380cyclictest21305-21ssh23:03:453
305609949829,126cyclictest0-21swapper/022:55:070
3056599497157,125cyclictest121rcu_preempt22:07:295
305649949775,84cyclictest0-21swapper/400:01:484
305609949674,84cyclictest0-21swapper/020:19:480
3056599495414,3cyclictest551rcuc/522:49:085
305629949573,3cyclictest30557-21cyclictest00:44:362
305609949527,126cyclictest8992-21runrttasks22:38:010
305659949428,126cyclictest0-21swapper/523:48:265
305649949470,84cyclictest0-21swapper/420:09:034
305649949370,84cyclictest0-21swapper/422:37:474
305609949325,465cyclictest0-21swapper/022:45:320
3056499492240,84cyclictest0-21swapper/423:15:004
3056699491108,380cyclictest0-21swapper/623:03:466
3056599491107,253cyclictest10383-21taskset23:50:475
305609949165,295cyclictest0-21swapper/000:22:160
3056799490234,253cyclictest721ktimersoftd/722:40:277
305659949070,288cyclictest0-21swapper/523:15:025
305669948921,380cyclictest0-21swapper/619:50:146
305649948963,211cyclictest49-21ksoftirqd/423:42:064
305619948965,211cyclictest0-21swapper/119:59:031
3056099489149,126cyclictest121rcu_preempt23:40:240
305669948764,126cyclictest121rcu_preempt20:10:186
305609948618,465cyclictest101ktimersoftd/022:10:040
305669948562,169cyclictest0-21swapper/622:40:116
3056499485355,84cyclictest0-21swapper/423:55:254
305649948522,49cyclictest0-21swapper/419:59:444
305639948559,126cyclictest0-21swapper/322:37:093
305659948462,211cyclictest57-21ksoftirqd/523:18:035
3056399484188,126cyclictest121rcu_preempt21:40:033
305679948318,2cyclictest0-21swapper/722:50:257
305679948314,42cyclictest0-21swapper/700:11:367
305639948357,211cyclictest0-21swapper/322:26:483
305629948357,211cyclictest33-21ksoftirqd/219:28:422
305679948213,41cyclictest0-21swapper/722:09:177
3056699482102,249cyclictest0-21swapper/621:55:226
3056599482226,126cyclictest27126-1kworker/u17:000:36:065
3056399482142,338cyclictest30557-21cyclictest23:48:003
305669948198,127cyclictest121rcu_preempt20:00:136
305659948154,126cyclictest0-21swapper/522:34:505
305659948115,211cyclictest0-21swapper/522:39:245
305629948011,423cyclictest0-21swapper/223:14:002
3056699478305,83cyclictest0-21swapper/621:39:096
305609947899,167cyclictest0-21swapper/022:21:590
305669947712,211cyclictest23386-21ssh23:05:116
305649947798,88cyclictest0-21swapper/423:54:244
305679947649,338cyclictest0-21swapper/723:29:557
305619947654,84cyclictest0-21swapper/122:40:101
30560994768,338cyclictest0-21swapper/000:33:400
305609947612,253cyclictest0-21swapper/000:35:560
305679947551,126cyclictest0-21swapper/723:20:187
305639947560,119cyclictest0-21swapper/323:05:193
3056299475172,84cyclictest121rcu_preempt20:09:442
30563994747,85cyclictest0-21swapper/323:52:273
30567994722,42cyclictest1553-21runrttasks21:52:267
30562994717,3cyclictest0-21swapper/223:05:112
30560994715,84cyclictest0-21swapper/000:44:170
30566994701,338cyclictest0-21swapper/623:48:426
305619947086,127cyclictest25-21ksoftirqd/123:00:311
3056199469385,2cyclictest231rcuc/120:19:111
305639946882,211cyclictest1553-21runrttasks23:55:383
305629946885,380cyclictest16765-21turbostat.cron19:40:002
3056699466123,340cyclictest0-21swapper/600:44:356
30562994661,173cyclictest0-21swapper/219:50:162
305619946681,126cyclictest25-21ksoftirqd/123:13:381
305669946582,210cyclictest65-21ksoftirqd/623:19:176
3056699465166,126cyclictest121rcu_preempt19:59:526
3056699465124,338cyclictest0-21swapper/622:49:596
3056699465123,339cyclictest0-21swapper/623:41:316
3056399465123,212cyclictest0-21swapper/320:08:543
3056299465124,338cyclictest0-21swapper/200:12:262
3056199465208,127cyclictest16642-21chrt19:38:231
3056799464122,126cyclictest73-21ksoftirqd/700:19:067
3056699464124,338cyclictest0-21swapper/622:55:076
3056699464122,339cyclictest27018-21rm21:54:406
30566994641,126cyclictest0-21swapper/623:30:126
3056499463123,338cyclictest0-21swapper/422:09:364
305609946339,84cyclictest121rcu_preempt21:53:460
305679946279,380cyclictest0-21swapper/700:20:057
305659946282,296cyclictest0-21swapper/519:49:265
305659946238,257cyclictest1343-21rm00:05:045
305659946235,210cyclictest57-21ksoftirqd/500:19:435
3056799461119,339cyclictest0-21swapper/722:37:487
305669946132,211cyclictest0-21swapper/600:22:216
3056699461120,338cyclictest0-21swapper/620:09:126
3056299461118,340cyclictest0-21swapper/219:58:002
305619946180,126cyclictest121rcu_preempt23:55:361
305619946176,211cyclictest0-21swapper/119:28:001
3056699460165,84cyclictest641ktimersoftd/620:19:476
305649946079,84cyclictest30557-21cyclictest19:50:184
305629946080,296cyclictest0-21swapper/219:49:272
305629946075,211cyclictest33-21ksoftirqd/223:42:462
3056299460120,338cyclictest0-21swapper/221:55:182
305609946031,380cyclictest698-21ptp4l23:05:150
3056099460121,84cyclictest1553-21runrttasks19:59:220
305679945936,177cyclictest0-21swapper/722:10:077
3056699459118,339cyclictest0-21swapper/600:12:266
3056099459118,126cyclictest9-21ksoftirqd/019:49:450
305639945835,84cyclictest0-21swapper/320:18:403
3056399458201,84cyclictest0-21swapper/323:12:203
305619945873,169cyclictest0-21swapper/123:21:291
305679945735,338cyclictest0-21swapper/723:18:367
305679945731,423cyclictest0-21swapper/719:49:457
3056699457116,338cyclictest0-21swapper/623:35:176
305659945734,254cyclictest17967-21sh22:23:565
305639945776,211cyclictest0-21swapper/319:28:223
3056299457242,84cyclictest0-21swapper/200:28:232
305649945473,84cyclictest64450irq/122-eth000:11:314
305639945373,169cyclictest0-21swapper/323:20:453
305619945370,168cyclictest0-21swapper/100:18:551
305679945229,212cyclictest0-21swapper/723:35:057
3056699452110,169cyclictest0-21swapper/619:30:186
305649945271,84cyclictest0-21swapper/400:21:094
305639945267,211cyclictest41-21ksoftirqd/321:38:083
3056399452110,126cyclictest41-21ksoftirqd/323:35:183
3056299452112,338cyclictest0-21swapper/223:21:362
3056199452110,126cyclictest29537-21ssh00:36:351
3056199452107,84cyclictest121rcu_preempt22:31:081
305609945272,169cyclictest9-21ksoftirqd/000:05:150
3056699451110,338cyclictest0-21swapper/600:18:566
305639945167,211cyclictest0-21swapper/319:58:413
305649945067,211cyclictest0-21swapper/419:27:334
3056399450111,126cyclictest22441-21taskset19:45:513
3056299450109,339cyclictest0-21swapper/221:45:242
305619945026,84cyclictest121rcu_preempt23:35:061
305649944968,84cyclictest0-21swapper/400:19:024
3056399449109,338cyclictest30557-21cyclictest00:05:163
305619944927,84cyclictest1551-21snmpd00:11:551
3056799448108,338cyclictest0-21swapper/722:55:077
3056199448192,126cyclictest25-21ksoftirqd/100:33:561
305659944724,170cyclictest0-21swapper/521:35:325
3056599446365,79cyclictest551rcuc/523:34:565
305619944519,177cyclictest0-21swapper/122:07:291
305609944522,86cyclictest0-21swapper/020:09:290
305649944463,84cyclictest0-21swapper/400:05:044
3056699443102,338cyclictest0-21swapper/621:45:236
3056599442100,126cyclictest121rcu_preempt00:33:405
305659944155,296cyclictest0-21swapper/523:05:205
305619944120,289cyclictest0-21swapper/123:30:101
305609944118,126cyclictest0-21swapper/023:35:460
305659944019,255cyclictest0-21swapper/519:29:565
305649944058,84cyclictest0-21swapper/400:44:544
3056399440100,338cyclictest0-21swapper/321:45:233
305669943999,338cyclictest0-21swapper/619:29:116
305619943917,2cyclictest0-21swapper/100:44:361
305619943798,84cyclictest0-21swapper/100:05:141
305649943513,84cyclictest0-21swapper/420:18:414
3056399435262,84cyclictest0-21swapper/322:55:083
305639943512,84cyclictest29581-21kworker/u16:000:36:343
305629943513,84cyclictest0-21swapper/220:19:472
30560994358,253cyclictest0-21swapper/000:19:020
305679943412,256cyclictest0-21swapper/719:29:557
305659943494,338cyclictest0-21swapper/523:03:455
305659943412,256cyclictest0-21swapper/523:44:185
305679943310,2cyclictest0-21swapper/700:28:247
305649943352,83cyclictest0-21swapper/423:05:104
30567994326,87cyclictest0-21swapper/719:37:477
30567994293,41cyclictest0-21swapper/700:44:467
305649942992,171cyclictest0-21swapper/400:28:234
30565994275,84cyclictest0-21swapper/520:08:545
3056299427170,84cyclictest121rcu_preempt00:19:032
30561994275,253cyclictest0-21swapper/121:53:451
30566994263,256cyclictest0-21swapper/600:05:056
30565994263,84cyclictest0-21swapper/519:58:535
305679942483,338cyclictest0-21swapper/723:34:537
305679942481,211cyclictest73-21ksoftirqd/721:55:257
305629942441,338cyclictest0-21swapper/222:55:062
30565994231,84cyclictest0-21swapper/520:18:415
305649942382,338cyclictest0-21swapper/422:10:134
305669942237,84cyclictest121rcu_preempt00:28:146
30560994221,255cyclictest0-21swapper/019:29:550
305669942181,338cyclictest0-21swapper/623:20:116
305679942080,338cyclictest0-21swapper/723:55:247
305669941978,338cyclictest0-21swapper/621:40:046
3056599419245,85cyclictest0-21swapper/500:11:195
305639941977,339cyclictest0-21swapper/322:10:143
305679941675,338cyclictest0-21swapper/719:40:137
305659941634,84cyclictest0-21swapper/519:40:145
305609941675,338cyclictest0-21swapper/000:28:230
305649941577,83cyclictest0-21swapper/400:36:234
305659941477,334cyclictest0-21swapper/522:55:065
305649941375,84cyclictest0-21swapper/421:40:034
3056199413245,3cyclictest241ktimersoftd/123:29:561
305669941272,338cyclictest0-21swapper/623:55:186
305659941272,337cyclictest0-21swapper/500:44:355
305659941232,255cyclictest0-21swapper/523:20:115
305639941270,339cyclictest0-21swapper/322:07:283
305609941273,84cyclictest0-21swapper/020:00:130
305629941169,126cyclictest28842-21ssh00:35:582
3056599410164,85cyclictest11522-21ssh22:40:045
305609941070,337cyclictest0-21swapper/019:40:130
305669940972,83cyclictest65-21ksoftirqd/622:10:156
305659940968,338cyclictest0-21swapper/523:55:185
305609940968,338cyclictest0-21swapper/023:30:090
305679940767,338cyclictest0-21swapper/721:40:037
305659940767,338cyclictest0-21swapper/521:45:245
305659940765,339cyclictest0-21swapper/519:38:405
3056399406148,169cyclictest0-21swapper/322:40:183
3056399405233,84cyclictest0-21swapper/300:44:273
305609940525,128cyclictest2804-21ssh23:29:560
305659940463,338cyclictest0-21swapper/500:28:235
305649940466,84cyclictest0-21swapper/419:40:144
305649940364,84cyclictest0-21swapper/423:30:094
305619940362,253cyclictest0-21swapper/123:05:111
305619940362,126cyclictest30196-21/usr/sbin/munin21:55:251
305609940261,338cyclictest0-21swapper/019:50:140
305629940160,338cyclictest0-21swapper/223:30:082
3056399400105,211cyclictest0-21swapper/319:37:103
3056299400184,127cyclictest121rcu_preempt20:00:052
3056699399104,217cyclictest0-21swapper/600:36:096
305659939861,42cyclictest0-21swapper/522:10:305
305609939899,126cyclictest121rcu_preempt20:10:180
305649939757,84cyclictest0-21swapper/419:30:184
305649939653,84cyclictest0-21swapper/422:55:064
305649939617,2cyclictest0-21swapper/420:10:094
305639939556,84cyclictest0-21swapper/300:19:043
3056299393181,81cyclictest27730-1kworker/u17:100:33:392
305629939150,338cyclictest0-21swapper/223:55:122
30561993909,84cyclictest0-21swapper/119:50:141
305639938747,84cyclictest0-21swapper/323:29:553
305649938690,84cyclictest121rcu_preempt23:29:564
305629938645,338cyclictest0-21swapper/221:40:052
30561993833,84cyclictest5093-21ssh22:55:061
305639938240,84cyclictest0-21swapper/319:40:143
305619938244,172cyclictest1553-21runrttasks00:28:231
305669938140,338cyclictest0-21swapper/623:29:556
30567993801,40cyclictest0-21swapper/720:10:137
305609937634,253cyclictest0-21swapper/019:30:180
305629937533,256cyclictest30557-21cyclictest19:30:192
305669937433,338cyclictest0-21swapper/600:33:376
305669937430,89cyclictest0-21swapper/619:40:136
305639937336,171cyclictest13140-21sh00:28:243
305659937134,171cyclictest0-21swapper/520:10:095
305639937132,83cyclictest0-21swapper/300:33:383
305629937133,215cyclictest121rcu_preempt20:10:132
305619937075,134cyclictest0-21swapper/121:40:121
305639936929,127cyclictest0-21swapper/320:10:123
305679936729,253cyclictest0-21swapper/720:00:107
3056399367110,84cyclictest23829-21df_inode19:50:153
305659936628,83cyclictest0-21swapper/521:40:045
305639936526,84cyclictest0-21swapper/323:30:083
305659936123,3cyclictest0-21swapper/519:30:185
305619935823,247cyclictest0-21swapper/120:00:131
305619935719,169cyclictest0-21swapper/120:10:131
305619935096,84cyclictest12568-21missed_timers19:30:181
30560993509,338cyclictest0-21swapper/021:45:230
30562993434,84cyclictest0-21swapper/223:29:552
30565993391,84cyclictest0-21swapper/523:29:565
305619932772,211cyclictest0-21swapper/119:40:121
305619931762,253cyclictest0-21swapper/121:45:241
305679931660,253cyclictest637-21kworker/u16:221:45:247
305649931659,254cyclictest0-21swapper/421:45:244
305629927822,253cyclictest0-21swapper/219:40:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional