You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-02 - 08:46
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Jun 02, 2026 00:57:00)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190099986558,804cyclictest0-21swapper/723:33:287
190099974968,678cyclictest0-21swapper/722:41:137
190099970667,84cyclictest0-21swapper/722:24:467
190099968710,598cyclictest0-21swapper/723:00:407
190099967579,84cyclictest0-21swapper/700:12:297
190099966728,636cyclictest0-21swapper/723:39:477
190089966231,123cyclictest121rcu_preempt22:13:356
190089964046,127cyclictest0-21swapper/621:26:446
190089964046,127cyclictest0-21swapper/621:26:436
189999963179,127cyclictest0-21swapper/300:15:073
190099963035,592cyclictest0-21swapper/700:04:467
190099962934,592cyclictest0-21swapper/723:24:287
19005996281,340cyclictest0-21swapper/422:35:524
1900599625118,84cyclictest0-21swapper/422:50:274
189949962130,304cyclictest0-21swapper/223:46:492
190099961763,346cyclictest0-21swapper/723:46:277
190099961721,593cyclictest0-21swapper/722:35:507
189999961619,261cyclictest41-21ksoftirqd/323:21:153
190099961317,593cyclictest0-21swapper/700:32:497
190099961317,593cyclictest0-21swapper/700:32:497
190099961317,593cyclictest0-21swapper/700:32:497
190099961317,593cyclictest0-21swapper/700:32:487
189999961216,380cyclictest0-21swapper/300:25:493
189949960916,127cyclictest0-21swapper/221:27:122
189949960916,127cyclictest0-21swapper/221:27:112
1899499608139,296cyclictest0-21swapper/222:13:152
19007995994,338cyclictest1443-21perf22:24:545
19009995930,84cyclictest15850irq/123-ahci[0000:36:097
19009995930,84cyclictest15850irq/123-ahci[0000:36:097
19008995931,84cyclictest0-21swapper/600:32:316
19008995931,84cyclictest0-21swapper/600:32:316
19008995931,84cyclictest0-21swapper/600:32:316
19008995931,84cyclictest0-21swapper/600:32:306
19007995930,84cyclictest0-21swapper/523:05:135
189949959339,381cyclictest0-21swapper/222:41:292
189829959239,380cyclictest0-21swapper/022:23:480
190059958979,295cyclictest0-21swapper/400:13:084
189949958977,381cyclictest0-21swapper/223:03:382
1899499589123,126cyclictest0-21swapper/200:25:552
189949958837,423cyclictest0-21swapper/222:24:552
190099958734,550cyclictest0-21swapper/722:52:577
1898799583284,126cyclictest0-21swapper/122:35:571
189999958239,161cyclictest0-21swapper/322:53:543
189949958172,127cyclictest0-21swapper/200:32:132
189949958172,127cyclictest0-21swapper/200:32:132
189949958172,127cyclictest0-21swapper/200:32:132
189949958172,127cyclictest0-21swapper/200:32:122
190089958069,338cyclictest0-21swapper/600:25:546
1898299580112,379cyclictest0-21swapper/022:53:020
189829957930,338cyclictest0-21swapper/023:33:130
190099957724,550cyclictest0-21swapper/721:29:477
190099957724,550cyclictest0-21swapper/721:29:477
190079957728,126cyclictest0-21swapper/500:04:545
190079957627,84cyclictest121rcu_preempt23:38:315
190099957522,127cyclictest0-21swapper/721:02:217
190099957218,551cyclictest0-21swapper/700:26:447
189999957222,126cyclictest0-21swapper/322:13:143
189829957160,380cyclictest0-21swapper/023:04:240
190099957059,296cyclictest0-21swapper/700:15:117
189949956817,126cyclictest26609-21diskmemload22:31:162
190099956718,465cyclictest0-21swapper/723:05:087
1898799567222,126cyclictest5791-21nscd22:41:021
189879956612,381cyclictest0-21swapper/123:39:181
190099956392,296cyclictest28697-21munin-node22:55:127
189999956110,126cyclictest0-21swapper/300:14:333
189829955848,126cyclictest0-21swapper/000:34:570
189829955848,126cyclictest0-21swapper/000:34:570
189829955848,126cyclictest0-21swapper/000:34:570
189829955848,126cyclictest0-21swapper/000:34:570
1900799553296,84cyclictest0-21swapper/523:04:135
1899999553169,126cyclictest41-21ksoftirqd/300:30:533
1899999553169,126cyclictest41-21ksoftirqd/300:30:533
1899999553169,126cyclictest41-21ksoftirqd/300:30:533
1899999553169,126cyclictest41-21ksoftirqd/300:30:523
1899499552212,126cyclictest0-21swapper/200:15:112
1899499552168,211cyclictest0-21swapper/223:35:572
190099954678,84cyclictest0-21swapper/700:20:507
189949954637,126cyclictest0-21swapper/223:23:252
1898799546162,253cyclictest0-21swapper/122:55:181
1898799545462,2cyclictest231rcuc/122:23:251
189829954538,338cyclictest0-21swapper/000:04:300
189949954475,127cyclictest18973-21cyclictest00:01:452
1900899543120,84cyclictest0-21swapper/622:43:216
1900899543118,295cyclictest26434-21ssh22:52:086
189999954378,84cyclictest0-21swapper/300:35:563
189999954378,84cyclictest0-21swapper/300:35:563
189999954373,211cyclictest10011-21sh22:41:323
189949954236,296cyclictest0-21swapper/222:53:582
189829954135,296cyclictest704-21nscd22:35:290
190089954072,465cyclictest0-21swapper/623:47:286
190079954072,338cyclictest0-21swapper/521:28:525
190079954072,338cyclictest0-21swapper/521:28:515
189829953969,211cyclictest9-21ksoftirqd/000:15:050
1899499538196,126cyclictest21354-21ls00:05:182
189879953876,122cyclictest0-21swapper/123:45:491
189879953871,168cyclictest10527-21ssh23:03:121
189879953869,211cyclictest17818-21rm00:02:481
190059953470,84cyclictest0-21swapper/400:03:574
189949953327,83cyclictest121rcu_preempt00:35:582
189949953327,83cyclictest121rcu_preempt00:35:572
1898299532110,126cyclictest1553-21runrttasks00:13:320
189949953060,211cyclictest33-21ksoftirqd/221:30:092
1898799528106,169cyclictest0-21swapper/123:22:131
1898799528101,296cyclictest0-21swapper/100:14:551
189829952658,126cyclictest0-21swapper/022:31:050
1898299526270,253cyclictest26609-21diskmemload21:26:540
1898299526270,253cyclictest26609-21diskmemload21:26:530
190089952598,296cyclictest0-21swapper/623:34:226
190079952513,84cyclictest121rcu_preempt00:12:315
190059952556,338cyclictest0-21swapper/423:23:404
189829952517,84cyclictest0-21swapper/021:02:080
190059952417,212cyclictest0-21swapper/400:27:184
190089952354,127cyclictest0-21swapper/623:02:346
190079952355,295cyclictest0-21swapper/500:35:585
190079952355,295cyclictest0-21swapper/500:35:585
190079952113,126cyclictest0-21swapper/522:53:185
18999995219,127cyclictest0-21swapper/323:02:353
190059951953,85cyclictest0-21swapper/400:35:584
190059951953,85cyclictest0-21swapper/400:35:574
1900799518303,126cyclictest0-21swapper/522:43:545
18994995168,126cyclictest0-21swapper/200:13:512
19007995155,422cyclictest0-21swapper/500:33:135
19007995155,422cyclictest0-21swapper/500:33:135
19007995155,422cyclictest0-21swapper/500:33:125
19007995155,422cyclictest0-21swapper/500:33:125
19008995149,295cyclictest0-21swapper/623:22:496
189949951388,423cyclictest0-21swapper/223:05:152
18994995112,126cyclictest0-21swapper/223:34:062
189879950983,296cyclictest0-21swapper/100:35:411
189879950983,296cyclictest0-21swapper/100:35:411
18987995090,84cyclictest0-21swapper/122:13:091
18982995090,42cyclictest0-21swapper/023:24:210
1900599508422,84cyclictest471rcuc/423:02:504
1900799505295,7cyclictest0-21swapper/500:05:195
190059950479,422cyclictest0-21swapper/421:28:424
190059950479,422cyclictest0-21swapper/421:28:424
189879950477,211cyclictest25-21ksoftirqd/100:31:261
189879950477,211cyclictest25-21ksoftirqd/100:31:261
189879950477,211cyclictest25-21ksoftirqd/100:31:261
189879950477,211cyclictest25-21ksoftirqd/100:31:251
190089950339,126cyclictest0-21swapper/623:36:046
190099950237,386cyclictest0-21swapper/721:30:097
190059950280,84cyclictest0-21swapper/422:24:044
189999950275,296cyclictest0-21swapper/300:02:203
189829950035,126cyclictest0-21swapper/000:35:540
189829950035,126cyclictest0-21swapper/000:35:540
190059949934,42cyclictest0-21swapper/423:31:544
1899999498204,121cyclictest121rcu_preempt23:31:333
189879949876,84cyclictest0-21swapper/122:53:361
190059949532,290cyclictest0-21swapper/400:21:034
1899999495117,205cyclictest0-21swapper/323:36:283
190059949472,84cyclictest0-21swapper/423:36:404
1900899493113,295cyclictest1553-21runrttasks21:03:236
190059949370,253cyclictest0-21swapper/422:31:244
190059949062,296cyclictest0-21swapper/400:06:064
189879949063,211cyclictest23612-21cron21:04:591
1898799490110,302cyclictest30736-21sh21:28:231
1898799490110,302cyclictest30736-21sh21:28:231
189999948924,210cyclictest0-21swapper/321:05:163
1898299489190,126cyclictest121rcu_preempt00:25:300
190059948820,295cyclictest0-21swapper/423:46:224
190079948762,422cyclictest0-21swapper/521:05:025
189999948415,253cyclictest32089-21ssh22:35:363
189829948457,211cyclictest0-21swapper/022:43:200
189829948416,253cyclictest0-21swapper/023:37:440
190079948315,254cyclictest0-21swapper/522:25:155
1899999483103,83cyclictest0-21swapper/321:27:193
1899999483103,83cyclictest0-21swapper/321:27:193
190099948217,262cyclictest0-21swapper/721:05:237
189999948217,3cyclictest0-21swapper/300:05:143
190089948014,84cyclictest0-21swapper/622:22:086
190089947914,255cyclictest0-21swapper/622:25:106
190059947952,253cyclictest23576-21kworker/u16:022:44:304
189999947913,126cyclictest0-21swapper/323:05:163
189829947814,301cyclictest20913-21tune2fs00:05:140
18994994757,84cyclictest6429-21sh23:40:022
19008994729,4cyclictest384-21ssh00:11:506
18987994728,417cyclictest0-21swapper/100:27:021
1900799471218,83cyclictest0-21swapper/523:34:105
18999994714,127cyclictest0-21swapper/322:55:123
189879947113,289cyclictest0-21swapper/123:31:211
189829947145,211cyclictest0-21swapper/022:55:210
190079946884,211cyclictest0-21swapper/523:45:495
189949946782,382cyclictest0-21swapper/200:21:122
19008994661,301cyclictest0-21swapper/600:05:146
1900899464124,338cyclictest0-21swapper/600:37:076
1900899464124,338cyclictest0-21swapper/600:37:076
1900899463123,338cyclictest11904-21apt23:05:136
1899999463122,338cyclictest0-21swapper/323:45:533
189879946378,211cyclictest21674-21sed00:05:241
190099946138,338cyclictest0-21swapper/722:31:237
1899499461120,338cyclictest28828-21ssh22:55:142
189829946180,126cyclictest121rcu_preempt22:13:070
190079946039,2cyclictest0-21swapper/522:35:465
189829946080,211cyclictest0-21swapper/023:05:110
190089945835,256cyclictest0-21swapper/600:03:106
190079945836,256cyclictest0-21swapper/523:21:495
189999945878,211cyclictest0-21swapper/322:22:293
190059945772,211cyclictest0-21swapper/400:31:004
190059945772,211cyclictest0-21swapper/400:31:004
190059945772,211cyclictest0-21swapper/400:31:004
190059945772,211cyclictest0-21swapper/400:30:594
1899499457118,336cyclictest0-21swapper/221:03:322
189879945772,211cyclictest0-21swapper/123:25:141
1900799455156,296cyclictest18973-21cyclictest00:26:295
190059945576,84cyclictest0-21swapper/421:03:234
189999945573,84cyclictest0-21swapper/300:21:183
1900999453113,338cyclictest18973-21cyclictest22:13:267
190089945332,255cyclictest0-21swapper/600:21:136
1900899453112,338cyclictest0-21swapper/600:15:076
189949945336,205cyclictest33-21ksoftirqd/222:35:222
190099945023,127cyclictest0-21swapper/722:25:087
1900799450193,84cyclictest121rcu_preempt00:15:285
190059944925,84cyclictest0-21swapper/421:05:184
1900599449108,168cyclictest26609-21diskmemload22:55:264
189829944927,168cyclictest20585-21ssh23:47:040
190059944827,168cyclictest0-21swapper/423:05:084
189879944662,126cyclictest0-21swapper/123:05:281
190079944463,84cyclictest0-21swapper/522:31:245
1898799444102,211cyclictest25-21ksoftirqd/123:40:011
190089944317,380cyclictest0-21swapper/622:55:016
190099944215,424cyclictest0-21swapper/700:05:517
1899999440100,84cyclictest0-21swapper/322:31:163
190089943959,296cyclictest0-21swapper/622:36:006
1899999432387,42cyclictest401ktimersoftd/323:40:023
19008994264,84cyclictest698-21ptp4l23:25:026
18987994253,2cyclictest0-21swapper/100:21:091
18982994241,211cyclictest0-21swapper/021:05:120
190079942383,338cyclictest0-21swapper/523:25:155
1898799423123,169cyclictest0-21swapper/100:15:171
189829942383,338cyclictest0-21swapper/022:25:100
19007994221,338cyclictest0-21swapper/522:55:225
19005994220,256cyclictest0-21swapper/400:15:114
189999942283,84cyclictest0-21swapper/321:02:223
189829942281,338cyclictest0-21swapper/022:45:100
189949942181,338cyclictest0-21swapper/221:05:242
189879942181,84cyclictest0-21swapper/122:25:101
190099942080,338cyclictest0-21swapper/723:25:027
189949942079,338cyclictest0-21swapper/222:25:102
190089941978,338cyclictest0-21swapper/621:05:236
1898299419163,134cyclictest15710-21sh00:20:580
189879941879,84cyclictest0-21swapper/122:31:131
189879941879,84cyclictest0-21swapper/121:05:231
190079941738,2cyclictest0-21swapper/522:12:335
190079941675,338cyclictest0-21swapper/522:45:135
190059941677,84cyclictest0-21swapper/422:25:104
190079941578,171cyclictest15918-21ssh00:21:095
190079941270,339cyclictest0-21swapper/521:05:235
189829941271,338cyclictest0-21swapper/023:25:140
190089941030,214cyclictest0-21swapper/622:31:126
190089940969,338cyclictest0-21swapper/622:45:066
190059940971,84cyclictest0-21swapper/422:12:574
190059940868,337cyclictest0-21swapper/421:30:084
189879940870,84cyclictest0-21swapper/121:30:091
189829940829,295cyclictest0-21swapper/021:30:050
1899999403113,37cyclictest0-21swapper/322:45:073
1899999402112,79cyclictest0-21swapper/323:25:153
190099940064,333cyclictest0-21swapper/722:45:107
190059940059,253cyclictest0-21swapper/422:45:094
189999939960,84cyclictest0-21swapper/322:25:093
190059939312,177cyclictest17636-21ssh23:25:154
1899499392224,42cyclictest0-21swapper/223:25:032
190079937983,169cyclictest0-21swapper/523:40:025
190099937634,340cyclictest0-21swapper/723:40:027
1898299374117,127cyclictest6430-21ssh23:40:000
190079937334,84cyclictest0-21swapper/521:30:105
190089937233,254cyclictest0-21swapper/621:30:056
189999937276,211cyclictest0-21swapper/321:30:113
189949936629,171cyclictest0-21swapper/222:45:102
189879936425,84cyclictest0-21swapper/122:45:051
190089932728,42cyclictest0-21swapper/623:40:016
190059931418,211cyclictest0-21swapper/423:40:024
1835129560,32sleep60-21swapper/619:06:526
1850729062,5sleep10-21swapper/119:09:021
1831429059,28sleep70-21swapper/719:06:217
1832028682,2sleep40-21swapper/419:06:264
1839728555,27sleep30-21swapper/319:07:283
1855528049,28sleep20-21swapper/219:09:432
1844927950,26sleep00-21swapper/019:08:140
1849327848,27sleep50-21swapper/519:08:515
309092750,1sleep30-21swapper/323:14:493
1900999602,54cyclictest0-21swapper/722:15:067
1899999509,14cyclictest0-21swapper/322:15:113
1900599431,15cyclictest0-21swapper/422:15:104
1898799362,3cyclictest0-21swapper/122:15:111
1898299351,31cyclictest24641-21diskmemload22:15:020
1899499331,3cyclictest0-21swapper/222:15:022
19007993022,5cyclictest26891-21ssh22:15:275
19008992922,4cyclictest28219-21ssh22:16:146
19007992810,18cyclictest0-21swapper/519:13:125
19007992810,18cyclictest0-21swapper/519:13:125
1899999287,16cyclictest0-21swapper/300:40:153
18999992810,18cyclictest0-21swapper/319:12:573
18999992810,18cyclictest0-21swapper/319:12:573
18994992810,18cyclictest0-21swapper/219:13:092
18994992810,18cyclictest0-21swapper/219:13:082
19009992727,0cyclictest0-21swapper/719:13:017
19009992727,0cyclictest0-21swapper/719:13:017
19009992710,0cyclictest0-21swapper/719:39:267
19008992727,0cyclictest0-21swapper/619:39:186
19008992710,17cyclictest0-21swapper/620:59:566
19008992710,17cyclictest0-21swapper/619:12:566
19008992710,17cyclictest0-21swapper/619:12:566
19007992710,17cyclictest0-21swapper/519:39:275
19005992710,0cyclictest0-21swapper/419:39:194
18999992710,17cyclictest0-21swapper/319:39:203
18987992727,0cyclictest0-21swapper/119:13:131
18987992727,0cyclictest0-21swapper/119:13:131
18987992710,17cyclictest0-21swapper/119:39:221
18982992710,17cyclictest0-21swapper/019:39:490
18982992710,17cyclictest0-21swapper/019:13:000
18982992710,17cyclictest0-21swapper/019:13:000
18982992710,0cyclictest0-21swapper/020:59:570
19005992626,0cyclictest0-21swapper/419:12:594
19005992626,0cyclictest0-21swapper/419:12:584
18994992626,0cyclictest0-21swapper/219:39:462
18987992626,0cyclictest0-21swapper/120:59:581
19009992525,0cyclictest0-21swapper/720:59:577
18999992524,0cyclictest0-21swapper/320:59:553
13972240,1sleep21899499cyclictest21:46:012
1900599228,8cyclictest19222-21sh21:21:264
19005992121,0cyclictest0-21swapper/420:59:574
1899999219,7cyclictest41-21ksoftirqd/319:40:223
1899999219,6cyclictest41-21ksoftirqd/321:37:463
1899999209,7cyclictest41-21ksoftirqd/319:25:003
1899999209,7cyclictest41-21ksoftirqd/319:15:023
1899999209,6cyclictest41-21ksoftirqd/323:56:433
1899999209,6cyclictest41-21ksoftirqd/320:45:003
1899999209,6cyclictest41-21ksoftirqd/319:25:203
1899999209,6cyclictest0-21swapper/321:55:013
1899999208,7cyclictest41-21ksoftirqd/319:50:013
18999992018,1cyclictest401ktimersoftd/321:20:153
18999992017,2cyclictest401ktimersoftd/323:54:183
18999992017,2cyclictest401ktimersoftd/322:05:153
18999992012,2cyclictest41-21ksoftirqd/320:25:103
18999992011,5cyclictest41-21ksoftirqd/321:56:123
18999992010,6cyclictest41-21ksoftirqd/322:01:283
18999992010,6cyclictest41-21ksoftirqd/321:47:153
18994992020,0cyclictest0-21swapper/220:59:562
1898799201,18cyclictest0-21swapper/122:06:221
1900599194,11cyclictest0-21swapper/421:10:144
1899999199,6cyclictest41-21ksoftirqd/321:40:043
1899999199,6cyclictest41-21ksoftirqd/320:45:203
1899999198,7cyclictest41-21ksoftirqd/321:15:083
1899999198,6cyclictest41-21ksoftirqd/320:15:123
1899999198,6cyclictest0-21swapper/321:10:113
1899999197,7cyclictest41-21ksoftirqd/323:15:583
18999991910,5cyclictest41-21ksoftirqd/320:50:113
18999991910,4cyclictest41-21ksoftirqd/320:35:003
62542180,0sleep60-21swapper/623:56:036
19007991818,0cyclictest0-21swapper/521:00:005
1900599187,8cyclictest0-21swapper/421:58:404
1900599183,11cyclictest0-21swapper/421:15:304
1900599181,16cyclictest0-21swapper/400:40:154
1899999188,6cyclictest41-21ksoftirqd/319:50:143
1899999187,7cyclictest41-21ksoftirqd/320:00:153
1899999187,6cyclictest41-21ksoftirqd/320:20:243
18999991816,1cyclictest401ktimersoftd/319:30:193
18999991816,1cyclictest401ktimersoftd/319:30:193
18999991810,5cyclictest41-21ksoftirqd/319:55:203
19009991712,3cyclictest23042-21cpuspeed_turbos19:15:117
1900599175,6cyclictest271081cstates20:15:124
1900599174,8cyclictest26609-21diskmemload23:11:204
1899999178,6cyclictest41-21ksoftirqd/320:10:153
1899999177,5cyclictest41-21ksoftirqd/320:35:153
18999991710,4cyclictest41-21ksoftirqd/320:05:123
1898799171,14cyclictest0-21swapper/100:40:141
19005991613,2cyclictest481ktimersoftd/422:08:064
1900599161,11cyclictest0-21swapper/421:50:124
1900799150,13cyclictest422-21sshd21:12:265
1900599153,6cyclictest0-21swapper/421:35:224
19005991511,3cyclictest18973-21cyclictest20:53:254
19005991510,4cyclictest481ktimersoftd/423:53:084
1898299151,7cyclictest0-21swapper/020:20:010
18982991513,1cyclictest0-21swapper/019:15:010
1898299150,7cyclictest0-21swapper/020:44:590
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional