You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-13 - 22:34
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Mar 13, 2026 00:56:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
175779974768,126cyclictest33-21ksoftirqd/223:37:462
175779970729,466cyclictest0-21swapper/223:54:362
1757699703234,338cyclictest121rcu_preempt00:44:161
1757599674206,338cyclictest121rcu_preempt23:34:300
175799967282,126cyclictest0-21swapper/421:48:574
175789967236,211cyclictest0-21swapper/323:25:173
175799966974,380cyclictest0-21swapper/400:23:104
175799966974,380cyclictest0-21swapper/400:23:104
175779966974,380cyclictest0-21swapper/222:06:592
175799966329,8cyclictest121rcu_preempt22:09:504
175819964411,382cyclictest0-21swapper/620:24:596
17579996418,2cyclictest0-21swapper/420:24:594
17582996406,383cyclictest0-21swapper/720:24:597
1757899633206,296cyclictest0-21swapper/323:10:303
1757899628116,296cyclictest0-21swapper/322:39:103
1758299623328,49cyclictest0-21swapper/722:17:057
175799961725,42cyclictest0-21swapper/423:41:264
175799961725,42cyclictest0-21swapper/423:41:264
175779961764,380cyclictest0-21swapper/221:47:222
1758099612106,83cyclictest121rcu_preempt23:10:525
1757899612101,296cyclictest0-21swapper/323:34:053
17576996009,383cyclictest0-21swapper/120:24:581
17580995987,3cyclictest0-21swapper/520:24:585
17576995985,84cyclictest121rcu_preempt21:49:051
175769959642,85cyclictest0-21swapper/123:37:541
175789959587,126cyclictest26575-21ssh21:25:183
17575995941,84cyclictest121rcu_preempt23:12:070
17575995941,126cyclictest0-21swapper/000:02:510
17575995933,382cyclictest0-21swapper/020:24:590
1758299592252,338cyclictest24169-1kworker/u17:000:44:037
17579995921,42cyclictest0-21swapper/423:31:444
1757999590170,84cyclictest1215-21kworker/u16:023:10:094
1757799590509,78cyclictest311rcuc/222:16:282
175769959079,381cyclictest0-21swapper/100:04:311
175819958776,126cyclictest0-21swapper/621:46:046
175799958574,296cyclictest0-21swapper/422:19:454
175789958577,126cyclictest18704-21ssh23:41:493
175789958577,126cyclictest18704-21ssh23:41:493
175779958573,296cyclictest0-21swapper/219:33:232
1757999584115,295cyclictest0-21swapper/420:25:074
175779958431,50cyclictest0-21swapper/200:14:312
1757899582160,124cyclictest21623-21kworker/u16:322:17:303
175759958171,380cyclictest0-21swapper/022:18:230
1757999579239,124cyclictest0-21swapper/422:13:384
175809957829,3cyclictest0-21swapper/522:18:455
1758099578279,126cyclictest0-21swapper/500:05:205
1757599578110,338cyclictest20106-21ssh23:43:300
1757599578110,338cyclictest20106-21ssh23:43:300
175829957668,126cyclictest0-21swapper/723:13:287
175779957522,338cyclictest0-21swapper/222:40:032
175759957120,126cyclictest0-21swapper/022:08:280
175779956957,381cyclictest0-21swapper/220:01:202
175779956915,296cyclictest0-21swapper/223:23:032
175769956919,126cyclictest0-21swapper/100:25:581
175819956554,381cyclictest0-21swapper/622:16:036
1757999565100,211cyclictest0-21swapper/400:33:114
175769956554,295cyclictest0-21swapper/122:10:141
175769956355,85cyclictest0-21swapper/122:08:191
175759956313,126cyclictest0-21swapper/021:49:210
17580995617,380cyclictest0-21swapper/523:34:055
175799956151,296cyclictest0-21swapper/423:25:294
17581995566,3cyclictest0-21swapper/622:13:316
17581995566,126cyclictest0-21swapper/623:43:306
17581995566,126cyclictest0-21swapper/623:43:306
17576995554,127cyclictest0-21swapper/122:55:031
17578995543,126cyclictest0-21swapper/323:55:003
1757799554474,77cyclictest311rcuc/223:33:522
17582995534,2cyclictest0-21swapper/722:13:307
175819955283,296cyclictest0-21swapper/622:39:276
1757999552253,126cyclictest49-21ksoftirqd/400:43:544
17575995511,84cyclictest0-21swapper/000:24:320
17575995511,84cyclictest0-21swapper/000:24:320
1758299550334,84cyclictest0-21swapper/723:44:147
1758299550334,84cyclictest0-21swapper/723:44:147
1757799547291,126cyclictest623-21nscd22:20:082
1757799547123,126cyclictest0-21swapper/200:23:542
1757799547123,126cyclictest0-21swapper/200:23:542
175809954374,380cyclictest0-21swapper/500:25:105
175769954331,464cyclictest0-21swapper/122:20:111
1757999542117,295cyclictest0-21swapper/423:53:464
175769954235,84cyclictest0-21swapper/122:39:111
175769954134,383cyclictest0-21swapper/123:34:161
175799954071,296cyclictest0-21swapper/422:37:474
175769953928,84cyclictest0-21swapper/123:52:141
175759953933,126cyclictest0-21swapper/020:44:130
175779953567,84cyclictest121rcu_preempt22:10:422
175779953428,126cyclictest0-21swapper/223:26:042
175759953423,126cyclictest0-21swapper/022:20:080
175769953165,126cyclictest0-21swapper/123:14:231
175819953061,127cyclictest0-21swapper/623:23:536
1757899529185,296cyclictest623-21nscd22:20:113
1757999528100,296cyclictest0-21swapper/423:39:154
175759952817,338cyclictest0-21swapper/000:44:020
175829952659,85cyclictest121rcu_preempt20:00:027
175819952699,127cyclictest28991-21wc00:05:316
175789952699,297cyclictest0-21swapper/322:10:583
175769952618,126cyclictest0-21swapper/122:17:431
175819952516,127cyclictest17573-21cyclictest23:35:266
1757899525317,83cyclictest0-21swapper/323:37:043
1757699525101,293cyclictest0-21swapper/123:44:431
1757699525101,293cyclictest0-21swapper/123:44:431
1757599524183,338cyclictest623-21nscd00:25:570
175759952312,296cyclictest1556-21runrttasks23:36:210
175779952214,296cyclictest15408-21taskset19:58:322
175779951910,84cyclictest0-21swapper/223:10:302
175759951911,211cyclictest0-21swapper/000:15:310
17578995178,127cyclictest0-21swapper/323:22:583
175789951548,127cyclictest0-21swapper/320:45:083
1757999513468,42cyclictest471rcuc/419:58:204
175769951343,85cyclictest0-21swapper/123:15:111
175769951045,126cyclictest0-21swapper/122:40:071
17579995081,86cyclictest0-21swapper/400:05:214
175799950744,295cyclictest11164-21ssh00:14:004
17579995071,84cyclictest0-21swapper/422:29:384
1757599507124,169cyclictest0-21swapper/023:54:210
175799950642,84cyclictest0-21swapper/420:04:194
175809950478,295cyclictest30548-21ssh00:24:565
175809950478,295cyclictest30548-21ssh00:24:565
1757999503162,338cyclictest68350irq/122-eth000:03:434
175769950336,219cyclictest0-21swapper/100:24:471
175769950336,219cyclictest0-21swapper/100:24:471
1757899502120,126cyclictest0-21swapper/321:48:493
175779950278,126cyclictest0-21swapper/200:04:232
175819950034,169cyclictest0-21swapper/622:09:026
175809950034,84cyclictest0-21swapper/523:23:035
175799950077,339cyclictest0-21swapper/400:25:184
175779949930,338cyclictest0-21swapper/200:05:222
1757899497324,90cyclictest0-21swapper/320:00:253
175759949631,126cyclictest0-21swapper/020:02:540
1758299495237,84cyclictest0-21swapper/700:05:357
1757799495111,211cyclictest32298-21ssh22:55:042
175769949531,85cyclictest0-21swapper/120:44:331
175759949530,84cyclictest0-21swapper/021:35:430
175819949429,3cyclictest0-21swapper/600:05:026
175819949329,127cyclictest0-21swapper/600:32:446
175779949367,126cyclictest33-21ksoftirqd/222:29:152
175829949270,338cyclictest0-21swapper/723:23:507
175809949265,296cyclictest0-21swapper/522:29:085
1758099492239,84cyclictest0-21swapper/500:14:355
175789949266,211cyclictest0-21swapper/319:59:423
1758299491109,210cyclictest28917-1kworker/7:1H23:25:237
1757599490234,126cyclictest0-21swapper/023:09:420
1758199488316,85cyclictest0-21swapper/623:25:516
175809948819,253cyclictest0-21swapper/500:05:015
175769948820,126cyclictest0-21swapper/123:25:401
175759948824,259cyclictest0-21swapper/000:12:440
1757899487277,47cyclictest0-21swapper/300:02:413
1758299486312,84cyclictest0-21swapper/722:09:137
1758199486317,41cyclictest0-21swapper/623:32:476
1757899485103,338cyclictest0-21swapper/300:05:333
175769948517,216cyclictest0-21swapper/123:55:071
175759948521,296cyclictest121rcu_preempt23:25:090
175759948518,127cyclictest0-21swapper/022:38:150
1757699484144,338cyclictest10657-21kworker/u16:200:15:301
175829948317,211cyclictest0-21swapper/700:25:577
1758099481185,211cyclictest561ktimersoftd/522:07:335
175809948116,210cyclictest0-21swapper/520:00:255
1758099481140,253cyclictest24169-1kworker/u17:000:44:175
175769948111,126cyclictest0-21swapper/100:36:101
175799947913,84cyclictest0-21swapper/400:36:544
17578994789,296cyclictest0-21swapper/300:25:003
17578994789,296cyclictest0-21swapper/300:25:003
175779947810,295cyclictest0-21swapper/200:44:262
175759947810,295cyclictest0-21swapper/022:29:370
17577994778,85cyclictest0-21swapper/222:37:522
17576994778,127cyclictest0-21swapper/100:13:391
1758299476431,42cyclictest711rcuc/700:32:517
1758299476137,84cyclictest0-21swapper/722:37:447
1757899476393,4cyclictest401ktimersoftd/300:44:233
175759947653,126cyclictest121rcu_preempt22:10:350
17576994759,84cyclictest0-21swapper/123:23:111
175769947411,83cyclictest121rcu_preempt22:29:351
17576994727,42cyclictest0-21swapper/119:59:211
1758299470425,42cyclictest711rcuc/720:01:187
17581994683,84cyclictest0-21swapper/600:42:546
17578994683,84cyclictest0-21swapper/300:13:273
17577994672,299cyclictest0-21swapper/200:15:142
1757799467125,127cyclictest33-21ksoftirqd/220:24:372
175829946640,126cyclictest0-21swapper/722:20:167
17582994661,84cyclictest0-21swapper/723:37:397
1758199466166,127cyclictest0-21swapper/623:53:586
17580994661,127cyclictest0-21swapper/522:20:125
17582994651,297cyclictest17573-21cyclictest20:43:487
1758099465124,338cyclictest0-21swapper/523:44:505
1758099465124,338cyclictest0-21swapper/523:44:505
175829946480,168cyclictest73-21ksoftirqd/700:24:587
175829946480,168cyclictest73-21ksoftirqd/700:24:587
1757799464249,84cyclictest0-21swapper/223:08:502
1758299463123,127cyclictest73-21ksoftirqd/721:45:597
175809946277,211cyclictest57-21ksoftirqd/522:40:075
175789946278,126cyclictest0-21swapper/320:44:363
175779946279,294cyclictest0-21swapper/223:42:212
175779946279,294cyclictest0-21swapper/223:42:212
175779946278,253cyclictest17573-21cyclictest00:33:112
175789946138,212cyclictest14535-21ssh22:09:163
175759946134,84cyclictest0-21swapper/023:23:020
175829946075,211cyclictest0-21swapper/700:36:097
1757799460246,84cyclictest10294-21taskset20:43:272
175819945979,377cyclictest0-21swapper/621:50:036
175809945933,84cyclictest0-21swapper/520:42:375
175829945874,296cyclictest121rcu_preempt00:03:157
175809945877,84cyclictest4398-21kworker/u16:021:49:435
1758099457243,83cyclictest0-21swapper/522:13:235
175829945633,256cyclictest0-21swapper/723:53:007
175819945579,373cyclictest0-21swapper/620:44:226
175809945572,210cyclictest0-21swapper/523:45:115
1758199454114,338cyclictest0-21swapper/600:24:326
1758199454114,338cyclictest0-21swapper/600:24:326
175769945431,3cyclictest0-21swapper/119:33:321
175809945339,42cyclictest0-21swapper/523:38:545
175799945330,84cyclictest0-21swapper/423:24:064
175789945331,3cyclictest0-21swapper/322:30:173
175819945230,84cyclictest0-21swapper/600:36:376
175819945228,169cyclictest0-21swapper/623:12:046
1757599452154,84cyclictest32004-21fschecks_count20:25:160
175809945129,42cyclictest0-21swapper/523:53:245
1758099451153,125cyclictest0-21swapper/519:33:495
175809945028,126cyclictest14584-21switchtime00:15:255
175799945027,83cyclictest0-21swapper/422:55:044
1757999450109,338cyclictest1556-21runrttasks20:40:364
175779945026,126cyclictest0-21swapper/200:25:522
175829944926,256cyclictest0-21swapper/700:14:327
1757599449108,126cyclictest4605-21ssh22:40:210
175819944825,256cyclictest0-21swapper/600:14:316
1758199448235,89cyclictest0-21swapper/622:30:106
175799944825,83cyclictest0-21swapper/422:30:284
175779944824,126cyclictest0-21swapper/200:36:202
175769944826,256cyclictest0-21swapper/122:30:171
175769944822,127cyclictest29009-21runrttasks23:10:001
175809944725,255cyclictest0-21swapper/522:30:115
1757999447149,126cyclictest121rcu_preempt00:15:084
175769944718,254cyclictest0-21swapper/123:45:021
175829944664,126cyclictest121rcu_preempt22:28:107
1757599446320,43cyclictest101ktimersoftd/000:32:350
175819944519,338cyclictest0-21swapper/600:15:116
175819944458,125cyclictest0-21swapper/620:02:296
175829944359,381cyclictest0-21swapper/723:34:427
175809944261,84cyclictest0-21swapper/500:33:075
175809944219,84cyclictest0-21swapper/522:55:175
175789944258,211cyclictest15530-21taskset22:29:493
175779944215,254cyclictest0-21swapper/222:30:272
175819944114,296cyclictest0-21swapper/622:29:156
1758099441101,337cyclictest20839-21sh00:36:045
175789944118,8cyclictest0-21swapper/321:50:033
175769944117,84cyclictest0-21swapper/100:33:111
175829944056,211cyclictest0-21swapper/723:45:007
175789943916,43cyclictest0-21swapper/320:24:013
175789943912,85cyclictest0-21swapper/319:35:043
175779943916,3cyclictest0-21swapper/222:54:492
175779943916,3cyclictest0-21swapper/222:54:482
175819943713,126cyclictest0-21swapper/620:25:066
175789943752,254cyclictest8880-21ssh23:55:153
1758299434221,84cyclictest0-21swapper/700:15:277
175819943412,84cyclictest0-21swapper/623:09:596
17575994349,169cyclictest0-21swapper/021:50:030
17581994339,211cyclictest0-21swapper/600:25:596
175809943211,83cyclictest0-21swapper/522:37:475
17581994307,256cyclictest0-21swapper/619:59:426
175759942894,131cyclictest121rcu_preempt22:30:180
175759942887,338cyclictest0-21swapper/023:45:100
17578994275,2cyclictest0-21swapper/319:33:313
17580994264,85cyclictest0-21swapper/523:55:145
175829942541,84cyclictest121rcu_preempt22:55:247
17578994251,84cyclictest0-21swapper/300:32:503
17581994240,84cyclictest0-21swapper/622:55:246
17575994241,126cyclictest0-21swapper/000:35:290
175779942390,121cyclictest0-21swapper/223:55:122
175759942340,168cyclictest121rcu_preempt19:35:110
1757599423209,84cyclictest0-21swapper/020:00:000
175799942282,337cyclictest0-21swapper/422:55:024
175789942283,84cyclictest0-21swapper/320:25:053
175829942180,338cyclictest0-21swapper/722:55:027
175829942180,338cyclictest0-21swapper/722:55:027
175789942182,84cyclictest0-21swapper/300:25:163
1757999420290,43cyclictest0-21swapper/419:34:314
1757899420290,84cyclictest0-21swapper/300:15:253
175779942081,84cyclictest0-21swapper/220:25:062
175779942079,339cyclictest0-21swapper/223:45:132
1758299419120,126cyclictest0-21swapper/722:30:257
175819941977,339cyclictest0-21swapper/623:45:076
175759941979,210cyclictest29052-21ls00:05:360
175829941877,338cyclictest0-21swapper/721:50:037
175799941877,338cyclictest10788-21awk23:55:284
175769941834,126cyclictest0-21swapper/100:05:311
175819941776,338cyclictest0-21swapper/622:40:206
1758099417203,126cyclictest121rcu_preempt23:25:105
175799941675,338cyclictest68350irq/122-eth023:45:074
175789941677,84cyclictest0-21swapper/322:40:213
175789941633,47cyclictest0-21swapper/300:36:033
175759941675,338cyclictest0-21swapper/020:05:020
175769941575,338cyclictest0-21swapper/120:00:261
175789941434,127cyclictest41-21ksoftirqd/322:55:123
175759941471,338cyclictest0-21swapper/022:55:030
175819941334,2cyclictest0-21swapper/619:33:446
175799941333,212cyclictest0-21swapper/419:35:114
175779941232,296cyclictest0-21swapper/221:35:372
175769941271,338cyclictest0-21swapper/122:55:021
175769941233,298cyclictest0-21swapper/121:35:421
175759941228,211cyclictest0-21swapper/023:15:040
175759941174,126cyclictest121rcu_preempt20:45:200
175829941068,339cyclictest0-21swapper/720:25:167
175829940968,338cyclictest0-21swapper/723:55:287
1758099409237,83cyclictest0-21swapper/520:25:155
175779940969,338cyclictest0-21swapper/221:50:022
175769940969,338cyclictest0-21swapper/120:25:161
175759940929,260cyclictest0-21swapper/023:55:160
175829940728,83cyclictest0-21swapper/723:09:437
175819940766,338cyclictest0-21swapper/623:55:076
175799940724,211cyclictest0-21swapper/422:40:074
1758299406107,126cyclictest73-21ksoftirqd/719:34:277
175819940666,338cyclictest0-21swapper/622:55:026
175819940666,338cyclictest0-21swapper/622:55:016
175809940524,46cyclictest0-21swapper/519:58:035
175789940523,84cyclictest0-21swapper/323:45:003
175829940463,338cyclictest0-21swapper/721:35:437
175819940423,169cyclictest65-21ksoftirqd/623:15:156
175789940364,84cyclictest0-21swapper/323:09:553
1757999402107,211cyclictest0-21swapper/423:09:424
175779940264,83cyclictest0-21swapper/221:25:192
175799940117,127cyclictest49-21ksoftirqd/422:20:114
175779940160,338cyclictest0-21swapper/219:35:032
175759940117,127cyclictest32289-21cut22:55:020
175789940059,168cyclictest0-21swapper/323:15:113
175779939818,296cyclictest0-21swapper/223:15:102
1757699398141,254cyclictest17573-21cyclictest20:05:031
175809939456,84cyclictest0-21swapper/521:50:035
175819939252,338cyclictest0-21swapper/622:20:126
175829939150,126cyclictest0-21swapper/720:05:027
17578993909,86cyclictest0-21swapper/322:54:503
17578993909,86cyclictest0-21swapper/322:54:503
175769939049,338cyclictest0-21swapper/122:54:491
1757599383126,127cyclictest121rcu_preempt19:33:050
175829938182,296cyclictest0-21swapper/723:15:097
17580993811,85cyclictest0-21swapper/523:09:435
17577993811,296cyclictest0-21swapper/220:45:202
175819938082,296cyclictest0-21swapper/620:45:186
1758099379164,85cyclictest0-21swapper/520:45:085
1758099379125,84cyclictest25763-21diskmemload22:55:015
175799937940,84cyclictest68350irq/122-eth022:54:504
175789937981,84cyclictest121rcu_preempt20:05:023
175769937634,253cyclictest0-21swapper/120:45:071
175829937175,211cyclictest0-21swapper/722:40:227
175799937133,84cyclictest0-21swapper/421:35:444
175759936831,253cyclictest0-21swapper/021:25:180
175759936731,254cyclictest0-21swapper/022:54:500
175809936625,126cyclictest121rcu_preempt20:05:025
175819936326,42cyclictest0-21swapper/621:35:436
175809935515,85cyclictest0-21swapper/522:54:505
175769935215,42cyclictest0-21swapper/121:25:181
175809935050,133cyclictest0-21swapper/521:35:485
175769934991,128cyclictest597-21irqbalance21:50:031
17581993447,85cyclictest0-21swapper/620:05:036
17579993436,41cyclictest0-21swapper/421:50:034
17578993432,126cyclictest0-21swapper/321:35:433
17579993401,84cyclictest0-21swapper/420:45:084
1758299339166,84cyclictest0-21swapper/719:35:117
175779933983,254cyclictest0-21swapper/220:05:022
175799933642,4cyclictest0-21swapper/423:15:154
1758299334161,84cyclictest0-21swapper/720:45:087
175819933076,8cyclictest121rcu_preempt19:35:036
175809932932,84cyclictest4259-21ssh23:15:125
175799932529,42cyclictest0-21swapper/421:25:194
175769932526,296cyclictest0-21swapper/119:35:011
175809932429,84cyclictest32522-21snmpd19:35:095
1758299322108,126cyclictest0-21swapper/721:25:187
175809931519,42cyclictest0-21swapper/521:25:185
175799929946,84cyclictest18526-21apt-get20:05:024
175819925040,129cyclictest0-21swapper/621:25:196
1690029644,29sleep70-21swapper/719:06:317
1685029445,27sleep40-21swapper/419:05:494
1704028756,28sleep20-21swapper/219:08:282
1683328351,28sleep50-21swapper/519:05:345
1684028249,29sleep30-21swapper/319:05:403
1695728149,28sleep60-21swapper/619:07:186
241172800,0sleep10-21swapper/121:05:141
1683828049,27sleep10-21swapper/119:05:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional