You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-12 - 09:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Jun 12, 2026 00:54:27)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
126449983671,84cyclictest0-21swapper/522:07:515
126449975273,84cyclictest0-21swapper/523:58:215
12640997250,169cyclictest0-21swapper/100:42:131
126449969457,634cyclictest0-21swapper/500:31:005
126419968554,415cyclictest0-21swapper/223:25:222
126449966974,592cyclictest0-21swapper/500:42:135
126439965518,507cyclictest8847-21ssh22:29:324
126439965518,507cyclictest8847-21ssh22:29:324
126399965419,169cyclictest0-21swapper/022:07:590
1264399627287,338cyclictest64450irq/122-eth023:24:034
1264199626118,126cyclictest0-21swapper/223:37:052
126449962472,549cyclictest0-21swapper/500:22:265
126449961863,295cyclictest0-21swapper/523:37:135
1264499614146,253cyclictest121rcu_preempt22:17:045
126409961116,382cyclictest0-21swapper/100:25:361
126449960716,510cyclictest0-21swapper/522:34:065
12644996037,593cyclictest0-21swapper/522:27:175
12644996037,593cyclictest0-21swapper/522:27:175
12646995940,84cyclictest0-21swapper/723:23:457
12644995940,84cyclictest0-21swapper/520:59:335
12642995940,84cyclictest0-21swapper/320:59:333
12641995940,84cyclictest0-21swapper/220:59:322
126449959383,295cyclictest0-21swapper/500:14:135
126439959080,338cyclictest0-21swapper/400:21:264
126399958776,126cyclictest0-21swapper/023:10:200
126449958535,465cyclictest0-21swapper/522:20:115
126399958274,126cyclictest21478-21ssh22:16:320
126399958271,340cyclictest0-21swapper/000:23:260
126439957971,84cyclictest0-21swapper/422:09:054
126409957871,84cyclictest0-21swapper/123:19:441
126439957766,126cyclictest0-21swapper/422:19:404
126409957668,126cyclictest6484-21sh22:09:451
126449956919,470cyclictest0-21swapper/523:06:385
126439956959,380cyclictest0-21swapper/421:00:224
126419956915,381cyclictest0-21swapper/223:18:392
1263999569143,211cyclictest0-21swapper/023:07:300
1263999567227,338cyclictest16091-21kworker/u16:321:59:520
1263999567140,254cyclictest121rcu_preempt23:23:570
126449956513,549cyclictest0-21swapper/523:48:485
126429956511,381cyclictest0-21swapper/300:42:123
126439955385,465cyclictest0-21swapper/421:47:424
126439955081,295cyclictest121rcu_preempt23:08:244
12639995500,84cyclictest0-21swapper/000:41:130
12646995490,84cyclictest0-21swapper/723:10:057
126439954981,465cyclictest0-21swapper/400:42:424
1264099548122,169cyclictest0-21swapper/122:17:001
126409954581,253cyclictest0-21swapper/122:33:591
126409954475,295cyclictest0-21swapper/122:27:071
126409954475,295cyclictest0-21swapper/122:27:071
126409954433,84cyclictest0-21swapper/100:36:381
126429954270,126cyclictest0-21swapper/300:24:293
1264199542115,127cyclictest0-21swapper/222:00:232
126409954278,84cyclictest0-21swapper/120:57:271
126409954075,126cyclictest0-21swapper/119:32:551
126469953874,84cyclictest0-21swapper/700:26:197
1264099538241,84cyclictest0-21swapper/122:20:051
1264599537196,339cyclictest20858-21diskmemload23:20:516
1264399537451,84cyclictest64450irq/122-eth022:00:214
1264499536113,127cyclictest0-21swapper/522:00:045
126459953571,84cyclictest0-21swapper/600:41:136
1264399535111,387cyclictest11151-21fschecks_count23:25:184
126449953428,422cyclictest0-21swapper/523:17:345
126439953423,380cyclictest0-21swapper/422:33:314
1264699533113,336cyclictest0-21swapper/700:22:197
126449953264,465cyclictest0-21swapper/500:25:125
126409953120,296cyclictest9041-21runrttasks23:23:551
126399953165,126cyclictest121rcu_preempt22:34:490
126399953120,87cyclictest0-21swapper/023:18:030
126449952720,423cyclictest0-21swapper/521:58:465
126429952455,296cyclictest0-21swapper/323:10:053
126419952498,296cyclictest33-21ksoftirqd/223:22:542
126409952358,296cyclictest0-21swapper/100:23:481
1263999519475,41cyclictest111rcuc/022:28:030
1263999519475,41cyclictest111rcuc/022:28:020
126449951811,381cyclictest0-21swapper/521:28:105
126409951810,126cyclictest0-21swapper/121:28:471
126399951710,126cyclictest6391-21ssh00:15:010
1264599516221,211cyclictest641ktimersoftd/600:22:196
126429951592,128cyclictest0-21swapper/322:33:593
1264399512171,338cyclictest12637-21cyclictest21:28:474
1264199512213,126cyclictest0-21swapper/222:19:232
126409951285,211cyclictest241ktimersoftd/100:30:431
1264599511467,42cyclictest631rcuc/600:25:536
12644995111,507cyclictest0-21swapper/521:47:475
12642995101,84cyclictest121rcu_preempt22:28:433
12642995101,84cyclictest121rcu_preempt22:28:433
12643995090,83cyclictest0-21swapper/400:25:494
12641995090,84cyclictest0-21swapper/200:42:212
12643995081,84cyclictest0-21swapper/423:18:214
126469950783,167cyclictest0-21swapper/722:27:337
126469950783,167cyclictest0-21swapper/722:27:337
1264299507166,169cyclictest401ktimersoftd/322:07:583
1264299506206,211cyclictest0-21swapper/300:36:373
1263999506169,84cyclictest121rcu_preempt21:00:130
126419950439,218cyclictest0-21swapper/221:58:362
126439950338,41cyclictest0-21swapper/422:41:154
126419950279,84cyclictest0-21swapper/200:24:032
126429950179,84cyclictest26576-1kworker/u17:123:22:013
1263999501160,84cyclictest121rcu_preempt23:48:100
126429950028,126cyclictest0-21swapper/322:17:313
126469949975,211cyclictest0-21swapper/722:00:037
126459949973,423cyclictest65-21ksoftirqd/622:07:596
126459949934,296cyclictest0-21swapper/622:27:446
126459949934,296cyclictest0-21swapper/622:27:446
126419949871,211cyclictest33-21ksoftirqd/222:20:272
1264699497113,211cyclictest11104-21ssh23:25:147
126459949770,339cyclictest0-21swapper/621:59:486
126439949770,424cyclictest0-21swapper/422:10:084
126469949572,84cyclictest0-21swapper/723:10:257
126459949531,298cyclictest17186-1kworker/u17:223:09:336
126449949425,466cyclictest0-21swapper/523:23:155
126439949430,261cyclictest0-21swapper/421:00:014
1264199494240,84cyclictest321ktimersoftd/221:28:072
1264199494152,169cyclictest321ktimersoftd/222:07:592
126399949468,211cyclictest26780-21ssh00:25:500
1264699493152,126cyclictest121rcu_preempt23:58:537
126409949328,3cyclictest0-21swapper/123:37:231
126429949275,247cyclictest0-21swapper/323:37:053
1264099492324,48cyclictest0-21swapper/100:14:011
126449948921,465cyclictest17545-21sh22:35:165
1264699488279,82cyclictest274512sleep721:29:157
1264699488151,172cyclictest721ktimersoftd/722:32:217
1264199487146,126cyclictest121rcu_preempt00:26:352
126429948457,296cyclictest0-21swapper/323:16:223
1264199484101,126cyclictest33-21ksoftirqd/223:48:432
126429948315,212cyclictest12637-21cyclictest23:59:123
126449948213,466cyclictest0-21swapper/500:36:205
126439948157,422cyclictest0-21swapper/400:15:134
126429948197,126cyclictest6829-21wc00:15:123
12639994778,126cyclictest0-21swapper/022:20:050
1263999476308,7cyclictest0-21swapper/020:57:270
12641994756,295cyclictest0-21swapper/222:59:322
126469947452,84cyclictest0-21swapper/723:17:307
12640994748,84cyclictest1553-21runrttasks23:58:301
126399947448,211cyclictest30195-21ssh22:41:160
12643994738,211cyclictest0-21swapper/400:30:594
12641994726,126cyclictest0-21swapper/200:14:132
1264699469127,168cyclictest121rcu_preempt23:36:437
12645994695,340cyclictest0-21swapper/622:34:496
1264599469129,338cyclictest12637-21cyclictest23:36:546
12640994692,296cyclictest0-21swapper/123:07:511
12639994671,84cyclictest0-21swapper/021:28:570
1264699466250,84cyclictest0-21swapper/722:20:127
126429946681,211cyclictest41-21ksoftirqd/300:25:363
1264699465124,338cyclictest0-21swapper/721:59:527
1264699464123,338cyclictest0-21swapper/700:42:327
126459946480,211cyclictest0-21swapper/623:17:356
1264499464124,337cyclictest0-21swapper/522:59:055
1264299464124,337cyclictest0-21swapper/321:59:523
1264199464124,337cyclictest0-21swapper/223:06:472
1264599463123,338cyclictest16091-21kworker/u16:322:18:056
126449946382,84cyclictest0-21swapper/523:10:225
1264499463122,338cyclictest0-21swapper/522:41:145
12641994633,298cyclictest0-21swapper/223:59:102
12640994631,330cyclictest0-21swapper/123:25:061
1263999463122,338cyclictest0-21swapper/000:36:020
1264699462119,340cyclictest0-21swapper/700:36:427
126419946180,84cyclictest0-21swapper/200:15:072
126399946176,126cyclictest0-21swapper/023:59:040
126469946080,84cyclictest0-21swapper/722:18:397
1264699460119,338cyclictest0-21swapper/722:07:077
1264399460377,3cyclictest471rcuc/423:58:104
126459945941,3cyclictest0-21swapper/621:29:006
1264399459118,338cyclictest0-21swapper/422:20:394
1264099459119,337cyclictest0-21swapper/122:10:071
126459945871,338cyclictest6934-21ssh00:15:156
1264299458117,338cyclictest17541-21if_enp3s022:35:153
126419945836,256cyclictest0-21swapper/222:32:212
126419945834,42cyclictest0-21swapper/200:36:382
1264599457373,3cyclictest631rcuc/623:57:456
1264399456377,3cyclictest471rcuc/423:48:534
1264399456372,3cyclictest471rcuc/421:58:504
126429945634,84cyclictest0-21swapper/323:49:103
126419945634,84cyclictest0-21swapper/200:31:382
126409945633,84cyclictest0-21swapper/121:59:331
1264099456120,42cyclictest0-21swapper/123:49:061
126469945533,84cyclictest0-21swapper/700:15:197
126439945573,210cyclictest49-21ksoftirqd/400:14:474
1264299455114,338cyclictest0-21swapper/321:27:363
1264699454114,338cyclictest0-21swapper/700:31:437
1264299454113,338cyclictest0-21swapper/322:59:423
1264299454113,338cyclictest0-21swapper/322:20:143
1264499453154,126cyclictest121rcu_preempt23:25:255
1264199453198,253cyclictest321ktimersoftd/222:29:282
1264199453198,253cyclictest321ktimersoftd/222:29:282
1264699452111,338cyclictest30191-21rm22:41:157
1264299452109,340cyclictest0-21swapper/300:31:363
1263999452112,338cyclictest12637-21cyclictest23:36:530
1264099449108,338cyclictest0-21swapper/100:15:121
126399944969,296cyclictest0-21swapper/000:31:380
126429944826,3cyclictest0-21swapper/323:31:323
126409944867,84cyclictest0-21swapper/122:41:211
126399944864,211cyclictest0-21swapper/022:59:470
1264399447107,338cyclictest0-21swapper/423:10:224
126399944773,162cyclictest22614-21cstates22:00:170
1264399446402,42cyclictest471rcuc/400:36:024
126429944624,42cyclictest0-21swapper/322:00:123
126409944664,85cyclictest121rcu_preempt22:59:311
1264099446105,338cyclictest22592-21sh22:00:181
126409944519,84cyclictest0-21swapper/122:35:161
1264399444103,338cyclictest0-21swapper/423:36:204
126419944463,84cyclictest0-21swapper/223:10:222
1264099443102,338cyclictest0-21swapper/123:10:221
1264699442101,338cyclictest0-21swapper/723:48:467
1264099442356,84cyclictest241ktimersoftd/121:47:511
126409944220,8cyclictest0-21swapper/121:00:241
126439943857,84cyclictest0-21swapper/422:59:064
126429943811,84cyclictest0-21swapper/300:13:573
126459943715,41cyclictest0-21swapper/623:25:256
12641994359,211cyclictest0-21swapper/221:47:512
126399943553,211cyclictest9-21ksoftirqd/021:48:020
126469943418,120cyclictest0-21swapper/721:47:417
12643994338,422cyclictest0-21swapper/419:32:364
12644994307,45cyclictest0-21swapper/521:00:215
126399943046,211cyclictest9-21ksoftirqd/022:35:080
12645994271,423cyclictest0-21swapper/619:32:376
126449942647,84cyclictest8054-21taskset00:15:195
126449942542,380cyclictest0-21swapper/519:32:375
126459942483,338cyclictest0-21swapper/623:49:066
126459942482,339cyclictest0-21swapper/622:35:166
126459942383,338cyclictest0-21swapper/623:10:226
126459942383,338cyclictest0-21swapper/622:10:066
126459942383,338cyclictest0-21swapper/622:00:056
1264599423124,126cyclictest0-21swapper/600:31:386
126469942283,84cyclictest0-21swapper/721:00:067
126459942282,338cyclictest0-21swapper/623:31:266
126439942282,337cyclictest0-21swapper/422:35:094
126429942282,84cyclictest0-21swapper/323:25:193
126429942282,84cyclictest0-21swapper/321:00:063
126419942283,84cyclictest0-21swapper/221:00:142
1264199422127,169cyclictest33-21ksoftirqd/222:41:172
126459942181,338cyclictest0-21swapper/622:20:386
126459942080,338cyclictest0-21swapper/622:59:086
126459942040,296cyclictest0-21swapper/600:36:026
126449941979,84cyclictest0-21swapper/523:31:325
126429941980,84cyclictest0-21swapper/321:48:013
126469941780,84cyclictest0-21swapper/720:57:167
126459941776,338cyclictest0-21swapper/621:47:316
1264199417118,42cyclictest121rcu_preempt22:35:082
126409941778,84cyclictest0-21swapper/123:31:261
126469941475,84cyclictest0-21swapper/722:35:167
126459941472,339cyclictest0-21swapper/600:14:586
126439941373,337cyclictest0-21swapper/423:31:064
126429941375,84cyclictest0-21swapper/322:10:073
126459941272,338cyclictest0-21swapper/622:41:186
126459941272,338cyclictest0-21swapper/621:00:006
126429941172,84cyclictest0-21swapper/322:41:213
126429941071,84cyclictest0-21swapper/323:10:243
126419940970,84cyclictest0-21swapper/222:10:072
1264199409109,126cyclictest33-21ksoftirqd/223:31:262
1264699408324,3cyclictest711rcuc/700:14:177
126399940867,338cyclictest0-21swapper/022:10:060
126399940665,296cyclictest0-21swapper/000:15:190
126449940463,338cyclictest0-21swapper/522:10:065
126399940362,338cyclictest0-21swapper/023:25:100
126469939211,84cyclictest0-21swapper/722:59:567
126449939010,343cyclictest0-21swapper/523:00:035
1264699380125,253cyclictest0-21swapper/719:32:377
1263999377121,41cyclictest23845-21sh23:31:080
126469937572,84cyclictest0-21swapper/723:31:277
126459937431,126cyclictest0-21swapper/621:00:126
126469937133,83cyclictest0-21swapper/722:10:057
126429936667,85cyclictest0-21swapper/319:32:373
126399935155,126cyclictest0-21swapper/019:32:370
12641993415,247cyclictest0-21swapper/219:33:012
1264399336165,42cyclictest1553-21runrttasks23:00:034
1263999326115,132cyclictest16091-21kworker/u16:323:00:020
126419931313,84cyclictest121rcu_preempt23:00:032
12645993078,126cyclictest20858-21diskmemload23:00:036
126409930047,169cyclictest1356-21taskset23:00:031
126469927522,42cyclictest1355-21ssh23:00:037
126429926895,127cyclictest0-21swapper/323:00:033
1212529546,27sleep10-21swapper/119:08:461
1216428860,24sleep40-21swapper/419:09:214
1205628857,28sleep60-21swapper/619:07:456
1192928654,28sleep50-21swapper/519:06:015
1188928553,28sleep20-21swapper/219:05:262
1206228352,28sleep30-21swapper/319:07:513
1196328352,27sleep00-21swapper/019:06:280
1205728250,28sleep70-21swapper/719:07:477
51512800,0sleep60-21swapper/622:45:156
247392760,0sleep10-21swapper/121:44:141
120422520,3sleep11264099cyclictest00:00:201
1264499511,34cyclictest0-21swapper/521:30:035
12644995020,26cyclictest10694-21sh00:00:115
1264499501,23cyclictest0-21swapper/523:50:025
1264199504,36cyclictest0-21swapper/223:50:052
12644994722,21cyclictest4709-21grep21:50:195
12646994636,4cyclictest121rcu_preempt23:50:047
1264299465,14cyclictest41-21ksoftirqd/323:50:063
1264499451,30cyclictest28949-21expr19:35:145
1264199432,27cyclictest33-21ksoftirqd/221:50:122
1264199423,29cyclictest33-21ksoftirqd/223:40:182
1264699416,23cyclictest73-21ksoftirqd/721:50:137
12644994119,19cyclictest6844-21sh23:40:165
1264099417,23cyclictest25-21ksoftirqd/123:50:261
1264099415,25cyclictest25-21ksoftirqd/121:50:321
1264699403,23cyclictest73-21ksoftirqd/723:40:147
1264299408,21cyclictest41-21ksoftirqd/319:35:233
1264199408,21cyclictest33-21ksoftirqd/200:00:132
1264099404,25cyclictest25-21ksoftirqd/119:35:151
1264699395,26cyclictest73-21ksoftirqd/700:00:167
1264599392,33cyclictest0-21swapper/621:30:116
1264299396,22cyclictest41-21ksoftirqd/323:40:273
1264299392,26cyclictest41-21ksoftirqd/321:30:363
1264199395,24cyclictest33-21ksoftirqd/221:30:312
1264099397,24cyclictest25-21ksoftirqd/123:40:101
1264099394,25cyclictest25-21ksoftirqd/121:30:271
12646993810,17cyclictest73-21ksoftirqd/721:30:567
1264299386,20cyclictest41-21ksoftirqd/300:00:513
1264299385,19cyclictest0-21swapper/321:50:123
1264699374,25cyclictest73-21ksoftirqd/719:35:297
1264399372,31cyclictest0-21swapper/421:30:114
1264199366,23cyclictest0-21swapper/219:35:172
1263999362,4cyclictest0-21swapper/021:30:040
1264599351,3cyclictest20858-21diskmemload23:40:136
1263999342,4cyclictest0-21swapper/023:50:090
12643993323,7cyclictest11860-21which00:00:184
12643993322,8cyclictest5003-21uname21:50:224
1264399331,29cyclictest0-21swapper/423:40:134
12639993325,4cyclictest10876-21grep00:00:130
1264399321,29cyclictest0-21swapper/423:50:104
1263999321,2cyclictest0-21swapper/023:40:100
12645993123,5cyclictest25176-21expr23:50:136
12644993124,3cyclictest121rcu_preempt21:21:585
12639993122,6cyclictest6085-21ssh21:50:390
12645993023,4cyclictest30739-21taskset19:35:446
12645993022,5cyclictest12212-21ssh00:00:216
12645993021,5cyclictest3473-21tr21:50:136
12644992910,18cyclictest0-21swapper/519:57:565
12639992920,6cyclictest28753-21expr19:35:130
12646992810,18cyclictest0-21swapper/719:13:387
12644992827,1cyclictest0-21swapper/520:19:545
12644992825,3cyclictest0-21swapper/519:46:085
12642992810,18cyclictest0-21swapper/321:21:403
12642992810,18cyclictest0-21swapper/319:21:073
12642992810,0cyclictest0-21swapper/320:19:583
12641992828,0cyclictest0-21swapper/219:20:452
12641992810,0cyclictest0-21swapper/219:13:452
12640992810,18cyclictest0-21swapper/121:21:491
12639992827,1cyclictest0-21swapper/019:21:160
12639992810,18cyclictest0-21swapper/020:09:030
12646992727,0cyclictest0-21swapper/721:44:597
12646992710,17cyclictest0-21swapper/721:21:477
12646992710,17cyclictest0-21swapper/720:43:277
12646992710,17cyclictest0-21swapper/719:46:007
12646992710,0cyclictest0-21swapper/720:31:537
12646992710,0cyclictest0-21swapper/720:31:537
12646992710,0cyclictest0-21swapper/719:21:067
12645992727,0cyclictest0-21swapper/620:55:006
12645992727,0cyclictest0-21swapper/619:13:456
12645992710,17cyclictest0-21swapper/621:45:006
12645992710,17cyclictest0-21swapper/621:21:296
12645992710,17cyclictest0-21swapper/620:43:306
12645992710,17cyclictest0-21swapper/620:32:226
12645992710,17cyclictest0-21swapper/620:32:226
12645992710,17cyclictest0-21swapper/620:09:226
12645992710,17cyclictest0-21swapper/619:20:496
12645992710,0cyclictest0-21swapper/620:19:286
12645992710,0cyclictest0-21swapper/619:45:496
12644992727,0cyclictest0-21swapper/520:43:235
12644992710,17cyclictest0-21swapper/520:31:585
12644992710,17cyclictest0-21swapper/520:31:585
12644992710,17cyclictest0-21swapper/520:08:565
12644992710,17cyclictest0-21swapper/519:13:525
12644992710,0cyclictest0-21swapper/519:20:535
12643992710,17cyclictest0-21swapper/420:19:574
12643992710,0cyclictest0-21swapper/421:21:384
12642992727,0cyclictest0-21swapper/320:20:033
12642992727,0cyclictest0-21swapper/319:58:123
12642992727,0cyclictest0-21swapper/319:45:543
12642992710,17cyclictest0-21swapper/320:43:313
12642992710,17cyclictest0-21swapper/320:32:173
12642992710,17cyclictest0-21swapper/320:32:173
12642992710,0cyclictest0-21swapper/319:13:413
12641992710,17cyclictest0-21swapper/220:43:522
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional