You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-11 - 04:30
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Mon May 11, 2026 00:57:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
517499677124,338cyclictest13739-1kworker/u17:021:14:032
51769967336,634cyclictest0-21swapper/400:24:114
51749965862,381cyclictest0-21swapper/222:21:002
51749965358,380cyclictest0-21swapper/221:54:392
51749965259,126cyclictest0-21swapper/221:55:242
5175996401,636cyclictest0-21swapper/300:39:473
51749962128,126cyclictest11384-21kworker/u16:121:15:322
517999615570,42cyclictest711rcuc/700:26:407
517399613315,126cyclictest0-21swapper/122:21:351
5175996069,381cyclictest0-21swapper/321:13:363
51759960513,512cyclictest1926-21/usr/sbin/munin21:40:243
51749960511,127cyclictest0-21swapper/222:48:562
517399603177,211cyclictest0-21swapper/100:37:331
5173995961,84cyclictest0-21swapper/122:49:141
51729959441,126cyclictest121rcu_preempt22:47:330
51769959139,549cyclictest0-21swapper/422:20:494
51729959040,84cyclictest121rcu_preempt23:14:450
51729959040,84cyclictest121rcu_preempt23:14:440
51759958734,550cyclictest0-21swapper/322:38:513
517599585116,338cyclictest5170-21cyclictest22:47:353
51769957930,470cyclictest0-21swapper/400:38:584
51769957869,507cyclictest5170-21cyclictest23:02:274
51759957828,470cyclictest0-21swapper/321:53:343
51769957565,338cyclictest0-21swapper/400:15:274
51759957521,465cyclictest0-21swapper/300:12:573
517299575111,126cyclictest26181-21ssh00:39:090
51779957423,84cyclictest0-21swapper/523:03:525
517799574105,84cyclictest9959-1kworker/u17:022:47:285
51769956921,464cyclictest0-21swapper/423:22:154
51769956921,464cyclictest0-21swapper/423:22:154
517299569104,126cyclictest7360-21ssh00:26:060
51769956718,422cyclictest0-21swapper/421:53:024
51749956798,296cyclictest13195-21diskmemload22:50:092
51789956654,296cyclictest0-21swapper/622:50:206
5173995629,126cyclictest0-21swapper/100:14:091
51749956010,127cyclictest5170-21cyclictest21:25:192
517699559136,256cyclictest64450irq/122-eth022:39:564
51729955893,211cyclictest121rcu_preempt00:11:270
5175995571,42cyclictest0-21swapper/323:13:253
5175995571,42cyclictest0-21swapper/323:13:253
5173995541,126cyclictest0-21swapper/121:23:361
51729955182,253cyclictest0-21swapper/021:10:500
51769955039,508cyclictest0-21swapper/400:29:204
517299549123,210cyclictest0-21swapper/022:50:070
517299548333,85cyclictest0-21swapper/021:41:340
51729954736,380cyclictest0-21swapper/023:15:250
51749954635,338cyclictest0-21swapper/223:04:042
51759954534,508cyclictest0-21swapper/322:50:093
51759954534,508cyclictest0-21swapper/300:26:093
51759954534,423cyclictest0-21swapper/323:02:523
51729954535,422cyclictest5170-21cyclictest23:45:070
517399543202,126cyclictest0-21swapper/100:27:161
51729954333,84cyclictest0-21swapper/021:22:520
51769954232,507cyclictest11361-21ssh23:15:124
51769954232,507cyclictest0-21swapper/400:04:474
51759954230,126cyclictest0-21swapper/321:45:083
517499542243,127cyclictest9959-1kworker/u17:023:15:222
51749954134,338cyclictest0-21swapper/221:37:512
51739954130,126cyclictest0-21swapper/121:37:591
51769954028,508cyclictest0-21swapper/421:15:324
517299534489,42cyclictest101ktimersoftd/021:55:150
51749953262,253cyclictest0-21swapper/221:44:562
51749953221,126cyclictest0-21swapper/200:22:222
517999530105,253cyclictest0-21swapper/722:22:137
51789953018,84cyclictest0-21swapper/622:39:186
51789952960,210cyclictest0-21swapper/623:41:216
517799529446,4cyclictest561ktimersoftd/522:22:225
51759952920,84cyclictest0-21swapper/321:38:333
51789952899,84cyclictest16819-21ssh21:11:286
51789952860,211cyclictest65-21ksoftirqd/600:23:546
51769952816,381cyclictest0-21swapper/400:15:034
51769952718,168cyclictest0-21swapper/422:47:474
51789952613,254cyclictest0-21swapper/621:55:046
51769952616,169cyclictest0-21swapper/423:34:494
51739952615,84cyclictest0-21swapper/121:53:461
51799952516,84cyclictest0-21swapper/721:14:027
51729952417,211cyclictest0-21swapper/022:39:270
51749952312,381cyclictest0-21swapper/223:33:542
51799952257,210cyclictest0-21swapper/723:14:107
51799952257,210cyclictest0-21swapper/723:14:097
51799952256,210cyclictest0-21swapper/723:34:067
51769952110,42cyclictest0-21swapper/423:14:434
51769952110,42cyclictest0-21swapper/423:14:434
51749952195,257cyclictest121rcu_preempt00:13:112
517399521140,126cyclictest12691-21ssh23:15:241
51769952052,295cyclictest0-21swapper/421:40:424
51769952010,42cyclictest0-21swapper/421:13:374
51749951850,127cyclictest0-21swapper/200:38:312
5172995179,84cyclictest0-21swapper/023:34:000
5174995157,341cyclictest0-21swapper/223:14:372
5174995157,341cyclictest0-21swapper/223:14:362
5176995137,41cyclictest0-21swapper/423:44:114
5173995132,42cyclictest0-21swapper/121:08:281
51739951243,296cyclictest0-21swapper/121:14:301
517799509168,126cyclictest121rcu_preempt00:37:505
51739950679,211cyclictest25-21ksoftirqd/122:40:151
517399506123,126cyclictest0-21swapper/100:03:501
51729950637,253cyclictest0-21swapper/022:21:370
51739950579,211cyclictest241ktimersoftd/123:41:511
51789950478,253cyclictest0-21swapper/621:38:226
517599504124,84cyclictest0-21swapper/323:21:413
517599504124,84cyclictest0-21swapper/323:21:403
51749950435,254cyclictest0-21swapper/200:05:042
51749950435,254cyclictest0-21swapper/200:05:042
51729950477,211cyclictest0-21swapper/021:53:380
51799950381,256cyclictest5170-21cyclictest23:44:217
517599503122,83cyclictest0-21swapper/321:22:573
517299503460,41cyclictest101ktimersoftd/023:35:230
517399502162,126cyclictest121rcu_preempt22:39:441
517299502160,211cyclictest0-21swapper/021:25:200
51779950074,126cyclictest0-21swapper/500:22:345
51729950031,84cyclictest0-21swapper/000:03:290
51759949930,127cyclictest0-21swapper/300:24:353
51749949972,296cyclictest0-21swapper/222:19:442
51749949972,296cyclictest0-21swapper/222:19:442
51799949870,211cyclictest721ktimersoftd/721:24:537
51789949875,127cyclictest0-21swapper/600:13:116
517499498115,253cyclictest698-21ptp4l21:23:442
51769949628,465cyclictest0-21swapper/421:24:434
51759949627,126cyclictest0-21swapper/323:43:313
51739949673,211cyclictest25-21ksoftirqd/123:04:091
51789949571,126cyclictest0-21swapper/621:43:516
51769949531,219cyclictest0-21swapper/421:25:174
5174994951,242cyclictest0-21swapper/222:37:482
51749949429,84cyclictest0-21swapper/200:27:492
517899493108,211cyclictest65-21ksoftirqd/623:04:346
51779949325,465cyclictest3649-21ssh21:41:145
51799949272,417cyclictest0-21swapper/721:10:017
51769949228,385cyclictest0-21swapper/421:37:294
51749949223,127cyclictest0-21swapper/223:41:262
517599490149,126cyclictest41-21ksoftirqd/300:04:403
517499489190,126cyclictest121rcu_preempt21:45:142
51799948763,84cyclictest0-21swapper/722:39:477
517499487111,292cyclictest0-21swapper/223:35:132
51789948621,2cyclictest0-21swapper/600:38:476
517899486147,42cyclictest26202-21nscd21:24:456
51759948617,259cyclictest0-21swapper/322:20:243
51779948560,210cyclictest0-21swapper/523:35:015
51749948314,338cyclictest0-21swapper/223:51:462
51729948217,84cyclictest0-21swapper/021:37:590
51779948160,210cyclictest0-21swapper/521:07:445
51779948117,381cyclictest5170-21cyclictest22:39:265
51799948096,381cyclictest0-21swapper/721:25:167
51789948057,291cyclictest0-21swapper/623:51:176
51779948052,126cyclictest0-21swapper/500:11:235
51769948012,465cyclictest0-21swapper/421:10:034
51799947910,127cyclictest0-21swapper/700:21:057
517299477223,84cyclictest101ktimersoftd/000:30:090
51779947653,126cyclictest0-21swapper/523:12:205
51779947653,126cyclictest0-21swapper/523:12:205
517599475133,211cyclictest23879-1kworker/u17:100:05:533
517599475133,211cyclictest23879-1kworker/u17:100:05:533
5173994759,126cyclictest0-21swapper/121:42:221
51799947497,374cyclictest0-21swapper/721:42:367
51729947410,296cyclictest0-21swapper/022:40:160
5178994727,2cyclictest0-21swapper/623:32:576
5175994721,42cyclictest0-21swapper/321:15:213
5174994723,296cyclictest0-21swapper/223:45:132
51729947148,126cyclictest0-21swapper/022:25:090
5175994701,42cyclictest0-21swapper/322:19:573
5175994701,42cyclictest0-21swapper/322:19:573
517599469123,343cyclictest17180-21sh22:25:083
51779946888,126cyclictest57-21ksoftirqd/523:42:575
517799468131,295cyclictest0-21swapper/521:14:035
517799468128,337cyclictest715-21rs:main5
517399467125,211cyclictest0-21swapper/123:14:441
517399467125,211cyclictest0-21swapper/123:14:441
5179994661,381cyclictest15850irq/123-ahci[0021:55:007
51779946681,84cyclictest0-21swapper/523:15:195
5174994662,2cyclictest0-21swapper/200:04:422
51729946681,211cyclictest9-21ksoftirqd/023:22:100
51729946681,211cyclictest9-21ksoftirqd/023:22:100
51789946582,89cyclictest121rcu_preempt23:14:156
51789946582,89cyclictest121rcu_preempt23:14:156
5175994651,41cyclictest0-21swapper/321:55:233
51739946479,211cyclictest25-21ksoftirqd/100:21:261
51779946341,338cyclictest21364-21ls21:15:285
51779946278,211cyclictest0-21swapper/521:55:235
517799462290,169cyclictest25350-21rm23:21:295
517799462290,169cyclictest25350-21rm23:21:295
5175994621,458cyclictest0-21swapper/323:35:233
517799461417,42cyclictest561ktimersoftd/500:03:395
51749946181,84cyclictest0-21swapper/223:21:412
51749946181,84cyclictest0-21swapper/223:21:412
51749946138,3cyclictest0-21swapper/200:30:202
517499461120,338cyclictest0-21swapper/222:25:112
51739946176,84cyclictest121rcu_preempt23:21:411
51739946176,84cyclictest121rcu_preempt23:21:411
51739946134,84cyclictest21364-21ls21:15:341
51729946174,295cyclictest0-21swapper/023:41:300
51799946080,84cyclictest0-21swapper/723:21:417
51799946080,84cyclictest0-21swapper/723:21:417
51789946080,84cyclictest0-21swapper/623:21:416
51789946080,84cyclictest0-21swapper/623:21:416
51789946038,256cyclictest0-21swapper/621:54:416
51789946038,256cyclictest0-21swapper/600:30:206
51769946038,343cyclictest0-21swapper/421:55:224
51749946041,252cyclictest0-21swapper/221:07:272
517499460120,338cyclictest0-21swapper/222:40:172
51739946076,211cyclictest25-21ksoftirqd/121:45:031
517599459118,339cyclictest0-21swapper/300:40:213
51739945975,211cyclictest25-21ksoftirqd/122:19:461
51739945975,211cyclictest25-21ksoftirqd/122:19:451
517399459118,126cyclictest31682-21head22:50:211
51799945831,84cyclictest0-21swapper/723:02:547
517599458117,338cyclictest0-21swapper/321:25:163
51779945773,211cyclictest0-21swapper/500:27:135
51759945735,338cyclictest21657-21runrttasks00:15:253
51729945734,44cyclictest0-21swapper/000:22:350
51799945634,255cyclictest0-21swapper/700:12:207
517999456160,211cyclictest704-21nscd21:15:047
51789945633,3cyclictest0-21swapper/622:23:186
51779945634,255cyclictest32741-21ssh21:40:045
517799455114,338cyclictest31842-21ssh23:45:165
517799455114,338cyclictest0-21swapper/500:40:205
51739945571,211cyclictest0-21swapper/123:33:281
51799945473,83cyclictest0-21swapper/700:40:207
51769945430,421cyclictest0-21swapper/423:51:504
51759945432,211cyclictest0-21swapper/321:08:303
51789945331,84cyclictest121rcu_preempt22:49:146
51789945268,211cyclictest23855-21kworker/u16:100:26:306
51789945230,84cyclictest21384-21sh21:15:316
517699452366,84cyclictest471rcuc/422:50:064
517599451112,85cyclictest9959-1kworker/u17:023:15:203
51799944927,256cyclictest0-21swapper/700:30:207
517599449110,84cyclictest0-21swapper/323:33:373
51729944926,42cyclictest0-21swapper/021:10:020
517699448107,339cyclictest0-21swapper/423:45:134
517999446105,338cyclictest0-21swapper/721:55:247
517299446107,295cyclictest27492-21/usr/sbin/munin00:40:210
51779944524,344cyclictest0-21swapper/521:54:145
51739944522,169cyclictest25-21ksoftirqd/123:35:061
51769944316,177cyclictest49-21ksoftirqd/421:45:104
51729944321,3cyclictest0-21swapper/023:03:380
517799442101,126cyclictest121rcu_preempt22:50:235
51769944013,423cyclictest0-21swapper/400:05:134
51769944013,423cyclictest0-21swapper/400:05:134
51729944014,211cyclictest0-21swapper/021:45:120
51749943897,338cyclictest0-21swapper/200:15:172
51799943612,84cyclictest121rcu_preempt23:35:117
51739943610,295cyclictest0-21swapper/100:15:271
51729943610,253cyclictest0-21swapper/021:15:310
51799943412,50cyclictest0-21swapper/700:35:527
51799943394,84cyclictest13195-21diskmemload22:48:547
517399430173,84cyclictest0-21swapper/123:45:151
5172994295,126cyclictest0-21swapper/000:15:270
51789942846,126cyclictest1704-21ssh00:03:356
51759942843,212cyclictest31831-21apt-get23:45:143
517999427254,84cyclictest14346-21kworker/u16:321:45:027
5176994261,42cyclictest0-21swapper/422:19:474
5176994261,42cyclictest0-21swapper/422:19:464
517399426127,126cyclictest187-21md0_raid100:30:181
51789942386,171cyclictest0-21swapper/623:15:266
5177994231,256cyclictest0-21swapper/500:05:095
5177994231,256cyclictest0-21swapper/500:05:095
51769942382,338cyclictest0-21swapper/422:40:184
5173994231,256cyclictest0-21swapper/100:05:091
5173994231,256cyclictest0-21swapper/100:05:091
51779942281,338cyclictest0-21swapper/522:40:095
51799942082,83cyclictest0-21swapper/700:04:437
51789942082,82cyclictest0-21swapper/600:15:326
51799941978,84cyclictest0-21swapper/700:05:147
51799941978,84cyclictest0-21swapper/700:05:147
51789941980,84cyclictest0-21swapper/600:05:526
51789941980,84cyclictest0-21swapper/600:05:526
51779941934,254cyclictest0-21swapper/523:51:155
51769941939,296cyclictest0-21swapper/400:40:204
51799941880,83cyclictest0-21swapper/723:15:197
51799941879,84cyclictest0-21swapper/722:50:137
51789941879,84cyclictest0-21swapper/621:06:586
51729941835,211cyclictest0-21swapper/022:19:500
51729941835,211cyclictest0-21swapper/022:19:500
51799941780,82cyclictest0-21swapper/723:51:497
51789941778,84cyclictest0-21swapper/622:25:106
51769941777,338cyclictest0-21swapper/422:25:124
51769941734,127cyclictest11779-21ssh00:30:174
51759941734,380cyclictest0-21swapper/323:51:093
51779941676,338cyclictest0-21swapper/521:45:145
51779941632,338cyclictest0-21swapper/521:25:205
51799941577,83cyclictest0-21swapper/723:45:087
51799941374,84cyclictest0-21swapper/722:25:107
51749941334,295cyclictest0-21swapper/200:40:192
51779941233,295cyclictest0-21swapper/523:35:255
51779941172,251cyclictest0-21swapper/500:30:175
51739941069,338cyclictest0-21swapper/123:51:171
51789940869,84cyclictest0-21swapper/623:35:126
517899408110,126cyclictest0-21swapper/621:45:086
51739940829,84cyclictest0-21swapper/121:55:181
51799940566,84cyclictest0-21swapper/721:39:527
517799404318,84cyclictest551rcuc/522:25:115
51729940466,171cyclictest0-21swapper/000:05:090
51729940466,171cyclictest0-21swapper/000:05:090
517399403104,126cyclictest0-21swapper/121:25:161
51759940260,339cyclictest0-21swapper/300:30:093
51799940019,85cyclictest0-21swapper/722:40:167
51729940061,84cyclictest12844-21ssh23:51:160
51789939757,126cyclictest0-21swapper/623:45:176
51739939716,84cyclictest0-21swapper/100:40:191
51739939655,338cyclictest0-21swapper/122:25:121
5176993929,380cyclictest0-21swapper/423:35:054
51799939010,84cyclictest121rcu_preempt00:15:067
5177993845,41cyclictest0-21swapper/500:15:195
51779937736,338cyclictest0-21swapper/522:19:465
51779937736,338cyclictest0-21swapper/522:19:455
51799937479,174cyclictest0-21swapper/722:19:467
51799937479,174cyclictest0-21swapper/722:19:457
51759937335,88cyclictest0-21swapper/322:40:123
51789937232,84cyclictest121rcu_preempt21:25:206
517899364110,84cyclictest698-21ptp4l22:19:496
517899364110,84cyclictest698-21ptp4l22:19:486
51789935662,84cyclictest5170-21cyclictest00:40:206
51789934444,84cyclictest0-21swapper/622:40:146
5177993015,42cyclictest0-21swapper/523:05:045
5172993004,211cyclictest0-21swapper/023:05:030
5175992971,42cyclictest0-21swapper/323:05:033
51749927926,172cyclictest0-21swapper/223:05:042
5176992541,42cyclictest0-21swapper/423:05:034
51739924978,87cyclictest25-21ksoftirqd/123:05:031
51789923824,126cyclictest0-21swapper/623:05:036
5179992100,127cyclictest0-21swapper/723:05:037
469529666,27sleep50-21swapper/519:09:185
471329182,5sleep30-21swapper/319:09:333
442828555,27sleep20-21swapper/219:05:312
457228443,27sleep10-21swapper/119:07:291
467928151,27sleep70-21swapper/719:09:047
466928150,27sleep60-21swapper/619:08:566
461628049,27sleep00-21swapper/019:08:080
459328051,26sleep40-21swapper/419:07:484
205322800,0sleep0111rcuc/020:25:220
323502490,2sleep50-21swapper/523:25:505
517899381,5cyclictest29358-21ssh23:25:086
517699382,4cyclictest0-21swapper/423:25:034
5174993731,3cyclictest29300-21ssh23:25:052
5172993730,4cyclictest0-21swapper/023:25:110
517999367,16cyclictest73-21ksoftirqd/723:55:207
517999361,4cyclictest30193-21fschecks_count23:25:137
517599361,31cyclictest0-21swapper/323:25:073
517299367,19cyclictest9-21ksoftirqd/023:55:290
5178993416,14cyclictest20370-21ssh23:55:456
517399341,30cyclictest30890-21memory23:25:181
5176993324,5cyclictest17789-21tr23:55:124
5177993224,5cyclictest18278-21df23:55:165
5173993123,5cyclictest17769-21cut23:55:131
5175992922,4cyclictest17866-21cat23:55:133
5174992922,4cyclictest19006-21ssh23:55:212
5179992810,18cyclictest0-21swapper/720:48:357
5179992810,18cyclictest0-21swapper/720:31:087
5179992810,18cyclictest0-21swapper/719:13:327
5179992810,0cyclictest0-21swapper/719:58:487
5178992810,0cyclictest0-21swapper/619:27:576
5177992827,0cyclictest0-21swapper/520:31:255
5175992810,18cyclictest0-21swapper/320:48:083
5175992810,18cyclictest0-21swapper/320:31:033
5175992810,18cyclictest0-21swapper/320:14:223
5175992810,18cyclictest0-21swapper/319:27:523
5175992810,0cyclictest0-21swapper/319:13:043
5174992810,18cyclictest0-21swapper/220:48:332
5172992810,18cyclictest0-21swapper/020:48:380
5172992810,18cyclictest0-21swapper/019:13:290
5179992727,0cyclictest0-21swapper/719:27:517
5179992710,17cyclictest0-21swapper/719:43:327
5179992710,17cyclictest0-21swapper/719:43:327
5179992710,0cyclictest0-21swapper/720:14:227
5178992710,17cyclictest0-21swapper/620:48:176
5178992710,17cyclictest0-21swapper/620:31:416
5178992710,17cyclictest0-21swapper/620:14:426
5178992710,17cyclictest0-21swapper/619:43:036
5178992710,17cyclictest0-21swapper/619:43:026
5178992710,0cyclictest0-21swapper/621:05:016
5177992710,17cyclictest0-21swapper/520:48:115
5177992710,17cyclictest0-21swapper/519:58:475
5177992710,17cyclictest0-21swapper/519:27:245
5177992710,0cyclictest0-21swapper/519:42:575
5177992710,0cyclictest0-21swapper/519:42:575
5176992727,0cyclictest0-21swapper/419:13:104
5176992710,17cyclictest0-21swapper/420:14:244
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional