You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-03 - 08:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Fri Jul 03, 2026 00:56:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
200629979027,126cyclictest0-21swapper/122:25:151
20061997630,42cyclictest0-21swapper/023:56:490
20063997220,84cyclictest0-21swapper/222:06:452
200619971275,634cyclictest0-21swapper/022:38:180
200649971129,507cyclictest0-21swapper/321:14:363
200649971129,507cyclictest0-21swapper/321:14:363
200619969819,557cyclictest0-21swapper/000:04:080
200669968996,126cyclictest0-21swapper/523:55:395
2006299673332,126cyclictest0-21swapper/122:39:531
2006399668326,126cyclictest23677-21rm23:14:362
2006399667114,126cyclictest0-21swapper/221:10:372
2006399667114,126cyclictest0-21swapper/221:10:372
2006499666196,296cyclictest0-21swapper/300:14:223
200619966630,168cyclictest0-21swapper/023:14:430
2006299660110,126cyclictest0-21swapper/122:21:381
200619965820,507cyclictest0-21swapper/000:17:310
200679965559,381cyclictest0-21swapper/600:18:126
200639965416,423cyclictest0-21swapper/222:21:542
200659964512,2cyclictest0-21swapper/400:37:094
200669963033,340cyclictest0-21swapper/522:11:455
20061996300,3cyclictest0-21swapper/021:11:250
20061996300,3cyclictest0-21swapper/021:11:250
20064996252,3cyclictest0-21swapper/300:37:093
2006199624114,380cyclictest2126-21sh22:25:150
2006599622114,126cyclictest0-21swapper/400:27:544
200679962070,338cyclictest0-21swapper/621:10:146
200679962070,338cyclictest0-21swapper/621:10:146
2006799619109,507cyclictest0-21swapper/622:04:296
2006399619111,294cyclictest0-21swapper/223:15:112
200669961764,210cyclictest131rcu_sched21:15:185
200689961418,127cyclictest0-21swapper/700:28:037
2006599614145,296cyclictest0-21swapper/400:03:394
2006199613104,507cyclictest0-21swapper/022:04:290
200619960913,338cyclictest0-21swapper/019:44:390
200639960896,296cyclictest0-21swapper/219:44:512
200669960795,380cyclictest0-21swapper/522:02:425
200649960796,508cyclictest0-21swapper/322:04:293
200639960513,84cyclictest0-21swapper/223:59:092
200679960353,126cyclictest121rcu_preempt22:08:276
200679960311,383cyclictest0-21swapper/600:37:096
200649960210,2cyclictest0-21swapper/300:17:193
20063996026,380cyclictest0-21swapper/222:14:022
20065995986,3cyclictest0-21swapper/400:17:194
200649959785,297cyclictest0-21swapper/323:03:443
200649959785,297cyclictest0-21swapper/323:03:443
20066995965,382cyclictest0-21swapper/500:17:195
200649959583,296cyclictest0-21swapper/323:53:003
200649959583,296cyclictest0-21swapper/323:53:003
20063995942,2cyclictest0-21swapper/200:37:092
20068995930,84cyclictest0-21swapper/722:05:177
200619959381,296cyclictest704-21nscd00:40:360
20061995932,382cyclictest0-21swapper/000:37:090
20061995900,3cyclictest0-21swapper/023:53:050
20061995900,3cyclictest0-21swapper/023:53:050
2006799587164,335cyclictest121rcu_preempt22:35:406
2006199587118,168cyclictest4389-21ssh23:02:460
2006199587118,168cyclictest4389-21ssh23:02:460
200619958637,127cyclictest0-21swapper/022:06:050
2006799584115,299cyclictest28349-21ssh23:33:226
2006299584241,126cyclictest4281-21sh00:18:591
2006899583114,295cyclictest0-21swapper/723:13:207
200639958376,84cyclictest0-21swapper/222:31:472
200629958334,126cyclictest0-21swapper/122:06:341
2006899582114,253cyclictest0-21swapper/700:12:117
200669958172,378cyclictest0-21swapper/500:12:225
200629958030,85cyclictest0-21swapper/121:11:421
200629958030,85cyclictest0-21swapper/121:11:421
200649957972,84cyclictest29202-21taskset23:34:323
2006499578152,295cyclictest0-21swapper/300:02:273
200629957829,210cyclictest0-21swapper/123:15:021
2006499577109,338cyclictest121rcu_preempt00:20:163
200649957667,127cyclictest0-21swapper/322:39:363
200649957667,127cyclictest0-21swapper/322:05:203
200619957624,465cyclictest0-21swapper/000:27:150
2006699574106,295cyclictest0-21swapper/500:03:555
200629957461,296cyclictest0-21swapper/123:52:581
200629957461,296cyclictest0-21swapper/123:52:581
2006399573105,295cyclictest0-21swapper/200:17:402
200619957117,465cyclictest0-21swapper/023:34:460
200629957062,127cyclictest0-21swapper/100:05:081
200639956958,508cyclictest0-21swapper/222:04:292
2006299569100,296cyclictest121rcu_preempt20:39:251
200669956756,338cyclictest0-21swapper/519:44:115
200619956714,550cyclictest0-21swapper/020:37:380
200649956566,118cyclictest20059-21cyclictest23:35:053
200659956453,380cyclictest0-21swapper/422:23:014
200639956352,338cyclictest0-21swapper/222:54:402
200629956310,126cyclictest0-21swapper/123:43:371
20061995618,550cyclictest0-21swapper/021:35:160
20068995585,338cyclictest698-21ptp4l20:38:217
200669955847,338cyclictest0-21swapper/500:30:045
200679955548,296cyclictest0-21swapper/620:50:216
20063995541,380cyclictest0-21swapper/200:03:362
20062995540,380cyclictest0-21swapper/100:28:391
200679955183,465cyclictest0-21swapper/622:32:086
2006399551383,84cyclictest321ktimersoftd/223:54:132
2006399551383,84cyclictest321ktimersoftd/223:54:132
200649955080,296cyclictest0-21swapper/322:14:203
2006899546162,254cyclictest0-21swapper/700:20:297
200619954639,423cyclictest0-21swapper/022:13:230
200679954576,296cyclictest0-21swapper/600:41:486
200669954577,295cyclictest0-21swapper/523:42:445
2006699545164,127cyclictest27848-21diskmemload00:27:545
200629954434,126cyclictest0-21swapper/123:33:431
200689954271,254cyclictest0-21swapper/721:13:057
200689954271,254cyclictest0-21swapper/721:13:057
200669954273,296cyclictest121rcu_preempt22:54:305
200629954236,126cyclictest27848-21diskmemload00:37:401
200629954234,127cyclictest121rcu_preempt23:59:001
200619954232,126cyclictest121rcu_preempt19:20:220
200689954134,41cyclictest0-21swapper/723:53:437
200689954134,41cyclictest0-21swapper/723:53:437
200629954133,126cyclictest20059-21cyclictest19:43:441
200629954074,84cyclictest0-21swapper/100:11:391
2006499539201,83cyclictest0-21swapper/320:38:383
200679953725,126cyclictest0-21swapper/622:12:286
200619953727,507cyclictest0-21swapper/020:50:190
200669953668,126cyclictest20059-21cyclictest23:32:535
2006499535113,253cyclictest0-21swapper/322:25:193
2006899534319,126cyclictest27848-21diskmemload00:01:367
2006399534108,211cyclictest28632-21ssh23:33:452
200679953270,122cyclictest11105-21sh00:01:586
200659953263,253cyclictest0-21swapper/423:43:564
200649953161,254cyclictest121rcu_preempt00:31:123
200659953024,127cyclictest0-21swapper/423:52:424
200659953024,127cyclictest0-21swapper/423:52:424
2006499530315,126cyclictest0-21swapper/323:13:053
200619953021,464cyclictest0-21swapper/022:54:390
2006699529190,84cyclictest5870-21ssh00:39:335
200669952918,338cyclictest0-21swapper/522:36:175
2006599529277,84cyclictest0-21swapper/422:33:554
200659952923,255cyclictest0-21swapper/422:11:024
200639952960,211cyclictest0-21swapper/222:35:192
2006799527186,339cyclictest187-21md0_raid122:24:556
2006799525188,133cyclictest23673-21ssh23:14:346
200649952558,127cyclictest0-21swapper/323:43:493
200619952560,126cyclictest0-21swapper/000:14:220
200669952416,84cyclictest0-21swapper/522:07:445
200649952460,253cyclictest0-21swapper/300:28:413
2006599523270,8cyclictest0-21swapper/400:30:324
200659952317,2cyclictest0-21swapper/422:07:144
200689952214,126cyclictest0-21swapper/722:04:297
2006699522183,85cyclictest20059-21cyclictest00:20:305
200659952297,125cyclictest0-21swapper/423:58:344
2006599522266,253cyclictest481ktimersoftd/400:15:004
200639952215,41cyclictest121rcu_preempt00:12:332
2006199522441,79cyclictest111rcuc/023:43:260
20061995219,423cyclictest0-21swapper/022:33:240
2006699520434,84cyclictest551rcuc/521:14:305
2006699520434,84cyclictest551rcuc/521:14:305
200639952012,42cyclictest0-21swapper/200:28:032
200629952094,253cyclictest121rcu_preempt21:35:141
200659951994,295cyclictest0-21swapper/423:04:044
200659951994,295cyclictest0-21swapper/423:04:044
200629951911,126cyclictest0-21swapper/122:04:291
200679951852,297cyclictest0-21swapper/600:29:246
200639951810,126cyclictest0-21swapper/220:38:322
20068995175,296cyclictest0-21swapper/722:35:307
2006799512130,211cyclictest121rcu_preempt23:05:126
2006799512130,211cyclictest121rcu_preempt23:05:126
20065995101,50cyclictest0-21swapper/422:02:464
2006199510171,84cyclictest20484-1kworker/u17:122:55:200
200639950940,380cyclictest0-21swapper/200:30:532
20062995091,84cyclictest0-21swapper/122:54:201
200639950884,381cyclictest0-21swapper/200:20:182
2006699507208,126cyclictest20484-1kworker/u17:122:55:255
200629950743,126cyclictest0-21swapper/100:01:491
200669950680,211cyclictest57-21ksoftirqd/522:24:515
200629950680,295cyclictest0-21swapper/123:04:351
200629950680,295cyclictest0-21swapper/123:04:351
200679950540,338cyclictest0-21swapper/623:02:116
200679950540,338cyclictest0-21swapper/623:02:116
200649950578,211cyclictest41-21ksoftirqd/322:55:123
200639950577,212cyclictest33-21ksoftirqd/223:03:552
200639950577,212cyclictest33-21ksoftirqd/223:03:552
200679950439,127cyclictest0-21swapper/623:57:586
200669950380,126cyclictest31003-21ssh23:53:035
200669950380,126cyclictest31003-21ssh23:53:035
20061995038,287cyclictest0-21swapper/000:31:470
200689950175,211cyclictest27848-21diskmemload22:54:327
200679950135,126cyclictest9731-21kworker/6:122:15:066
200659950133,253cyclictest0-21swapper/422:39:384
2006599500116,253cyclictest0-21swapper/423:14:104
200629950031,85cyclictest0-21swapper/122:34:501
200669949935,261cyclictest0-21swapper/522:33:275
200659949977,168cyclictest0-21swapper/400:05:244
200649949934,127cyclictest0-21swapper/319:20:203
200679949834,297cyclictest0-21swapper/621:15:096
2006599498114,126cyclictest49-21ksoftirqd/400:40:344
200689949772,126cyclictest0-21swapper/722:11:017
2006599497115,127cyclictest0-21swapper/421:14:044
2006599497115,127cyclictest0-21swapper/421:14:044
2006299497117,211cyclictest10754-21interrupts22:10:201
200689949627,338cyclictest9636-1kworker/u17:221:35:117
200649949670,211cyclictest0-21swapper/322:35:013
200629949669,211cyclictest10068-21chrt00:41:371
200619949531,135cyclictest0-21swapper/000:20:180
200689949367,211cyclictest4132-21ssh23:02:217
200689949367,211cyclictest4132-21ssh23:02:217
200659949368,422cyclictest9467-21cron19:45:004
200689949270,84cyclictest0-21swapper/723:34:077
200619948924,381cyclictest0-21swapper/021:15:130
200619948820,465cyclictest0-21swapper/023:15:120
200649948722,84cyclictest0-21swapper/323:59:583
200619948720,464cyclictest0-21swapper/022:22:070
200679948516,253cyclictest0-21swapper/623:53:066
200679948516,253cyclictest0-21swapper/623:53:066
200669948520,304cyclictest0-21swapper/523:04:035
200669948520,304cyclictest0-21swapper/523:04:035
200659948563,253cyclictest0-21swapper/419:20:174
200649948519,126cyclictest0-21swapper/300:40:363
200639948516,211cyclictest0-21swapper/223:43:082
200619948560,422cyclictest0-21swapper/020:40:190
200639948314,85cyclictest0-21swapper/221:15:252
200679948297,211cyclictest27848-21diskmemload00:12:426
2006599481184,84cyclictest64450irq/122-eth023:05:124
2006599481184,84cyclictest64450irq/122-eth023:05:124
200649948112,84cyclictest0-21swapper/320:40:163
200679948056,127cyclictest0-21swapper/600:20:196
200629947953,211cyclictest11502-21if_eth020:40:211
200689947712,84cyclictest0-21swapper/722:31:327
2006799477221,253cyclictest641ktimersoftd/622:54:486
200679947696,303cyclictest0-21swapper/620:37:106
200669947416,162cyclictest0-21swapper/500:41:155
20064994749,2cyclictest0-21swapper/321:15:093
200669947345,211cyclictest57-21ksoftirqd/520:50:155
20064994739,126cyclictest0-21swapper/322:40:173
20064994739,126cyclictest0-21swapper/322:40:173
2006499471214,84cyclictest0-21swapper/322:24:503
20062994691,126cyclictest0-21swapper/100:30:451
20065994672,3cyclictest0-21swapper/420:37:374
20062994671,84cyclictest0-21swapper/122:15:031
20062994670,42cyclictest0-21swapper/100:20:171
20062994661,8cyclictest0-21swapper/120:50:141
20067994651,255cyclictest0-21swapper/600:31:476
2006599464123,338cyclictest4569-21ssh21:15:254
2006499464124,126cyclictest0-21swapper/319:43:363
200689946379,253cyclictest0-21swapper/723:55:487
200649946340,84cyclictest0-21swapper/320:50:243
200659946189,288cyclictest698-21ptp4l22:55:114
2006499461119,339cyclictest27848-21diskmemload22:54:383
200619946178,210cyclictest0-21swapper/019:45:110
2006799460122,82cyclictest0-21swapper/623:42:296
2006399459117,127cyclictest0-21swapper/200:40:562
200659945834,84cyclictest0-21swapper/422:55:044
200689945730,296cyclictest1551-21snmpd21:15:277
200679945734,297cyclictest0-21swapper/619:40:416
200669945629,85cyclictest0-21swapper/521:35:165
200659945634,42cyclictest0-21swapper/421:35:064
200669945529,253cyclictest22441-21ssh23:12:505
2006899454112,254cyclictest0-21swapper/700:18:357
2006699454200,84cyclictest561ktimersoftd/522:25:155
2006399454112,169cyclictest0-21swapper/219:20:222
200679945028,245cyclictest21708-21/usr/sbin/munin22:55:116
2006499449192,126cyclictest121rcu_preempt23:05:103
2006499449192,126cyclictest121rcu_preempt23:05:103
2006899448106,168cyclictest0-21swapper/720:50:137
2006599448107,168cyclictest121rcu_preempt00:20:304
200679944725,256cyclictest0-21swapper/622:25:426
200689944666,84cyclictest0-21swapper/722:23:587
200689944663,254cyclictest0-21swapper/723:43:387
2006399445149,84cyclictest0-21swapper/222:25:172
2006599444234,42cyclictest0-21swapper/423:34:394
200669944316,211cyclictest6904-21ssh23:05:155
200669944316,211cyclictest6904-21ssh23:05:155
200649944219,3cyclictest0-21swapper/322:15:133
200689944018,4cyclictest9841-21diskmemload00:41:107
200639944023,248cyclictest6925-21rm23:05:152
200639944023,248cyclictest6925-21rm23:05:152
200669943917,42cyclictest0-21swapper/520:39:565
200659943613,84cyclictest24396-21diskmemload23:15:114
200689943511,86cyclictest0-21swapper/719:40:417
200659943513,84cyclictest0-21swapper/422:25:174
200669943355,42cyclictest121rcu_preempt19:20:135
20064994339,84cyclictest0-21swapper/323:15:053
20068994318,126cyclictest0-21swapper/700:39:457
2006899426127,84cyclictest121rcu_preempt22:55:097
20062994264,84cyclictest0-21swapper/123:05:101
20062994264,84cyclictest0-21swapper/123:05:101
20068994231,2cyclictest0-21swapper/723:35:067
200679942382,339cyclictest0-21swapper/621:35:066
20062994231,84cyclictest24344-21sh23:15:071
200669942282,338cyclictest0-21swapper/522:15:105
200689942182,84cyclictest0-21swapper/700:31:457
200659942142,295cyclictest0-21swapper/420:50:204
2006599421122,126cyclictest0-21swapper/419:45:104
200679942037,126cyclictest30049-21ssh23:35:076
200659942040,296cyclictest0-21swapper/423:35:054
200689941980,84cyclictest0-21swapper/720:40:177
200689941979,84cyclictest0-21swapper/722:25:307
200639941939,84cyclictest0-21swapper/220:50:152
2006299419121,127cyclictest3926-21fschecks_time21:15:181
200619941939,296cyclictest0-21swapper/023:05:070
200619941939,296cyclictest0-21swapper/023:05:070
200689941778,84cyclictest0-21swapper/723:45:037
200639941775,339cyclictest0-21swapper/221:35:062
200629941677,84cyclictest0-21swapper/119:20:221
200689941535,262cyclictest0-21swapper/722:15:137
200619941575,337cyclictest0-21swapper/022:15:050
200619941532,295cyclictest0-21swapper/000:05:080
200689941475,84cyclictest0-21swapper/723:05:147
200689941475,84cyclictest0-21swapper/723:05:147
200629941434,168cyclictest21704-21ssh22:55:091
200669941334,170cyclictest0-21swapper/519:45:125
200629941374,84cyclictest0-21swapper/119:45:071
200619941271,84cyclictest121rcu_preempt22:40:170
200619941271,84cyclictest121rcu_preempt22:40:170
200669941070,338cyclictest0-21swapper/523:15:085
200639940968,338cyclictest0-21swapper/222:55:192
200679940727,296cyclictest0-21swapper/619:20:146
200669940565,337cyclictest0-21swapper/520:40:075
200669940463,338cyclictest0-21swapper/522:40:165
200669940463,338cyclictest0-21swapper/522:40:165
200649940217,212cyclictest9848-21munin-node19:45:113
200639940019,42cyclictest0-21swapper/223:35:052
200679939814,254cyclictest0-21swapper/619:45:126
200669939616,297cyclictest0-21swapper/523:35:065
200619939515,296cyclictest0-21swapper/023:35:050
200659939453,338cyclictest0-21swapper/422:15:044
200639939398,127cyclictest0-21swapper/222:40:172
200639939398,127cyclictest0-21swapper/222:40:172
200679939111,296cyclictest0-21swapper/623:15:076
20064993841,169cyclictest10560-21apt-get21:35:173
200639938042,254cyclictest0-21swapper/220:40:112
200679937633,212cyclictest0-21swapper/622:40:176
200679937633,212cyclictest0-21swapper/622:40:176
200639937029,126cyclictest0-21swapper/219:45:112
200689936725,126cyclictest0-21swapper/700:05:027
200679936628,84cyclictest0-21swapper/620:40:046
200659936220,84cyclictest0-21swapper/420:40:164
200689936165,85cyclictest0-21swapper/719:45:077
200689936021,215cyclictest0-21swapper/719:20:207
200639936018,84cyclictest15607-21ssh22:15:032
200629936026,84cyclictest121rcu_preempt22:40:161
200629936026,84cyclictest121rcu_preempt22:40:161
200639935717,84cyclictest0-21swapper/223:45:032
200689935619,171cyclictest0-21swapper/723:15:137
200629935418,168cyclictest25-21ksoftirqd/123:35:061
200689935315,84cyclictest26480-21sed22:40:177
200689935315,84cyclictest26480-21sed22:40:177
200629935155,127cyclictest0-21swapper/120:11:301
200639934710,217cyclictest0-21swapper/200:05:242
200669932732,42cyclictest0-21swapper/500:05:025
200679932469,253cyclictest0-21swapper/600:05:086
200659932265,84cyclictest0-21swapper/423:45:034
200679931616,207cyclictest0-21swapper/623:45:036
200659931660,253cyclictest64450irq/122-eth022:40:174
200659931660,253cyclictest64450irq/122-eth022:40:174
2006499314103,130cyclictest6454-1kworker/u17:000:05:083
20064992981,42cyclictest0-21swapper/323:45:033
200639929784,84cyclictest121rcu_preempt20:11:292
20066992961,42cyclictest0-21swapper/520:11:295
200669929079,130cyclictest15635-21rm23:45:035
200679928981,126cyclictest0-21swapper/620:11:306
200619928876,127cyclictest9-21ksoftirqd/020:11:290
200619928831,127cyclictest0-21swapper/023:45:030
200659928128,42cyclictest0-21swapper/420:11:304
200649927761,84cyclictest121rcu_preempt20:11:293
200689927459,84cyclictest73-21ksoftirqd/720:11:307
200629925953,43cyclictest0-21swapper/123:45:031
1956728945,28sleep60-21swapper/619:09:066
1960428654,28sleep70-21swapper/719:09:397
1957228654,28sleep20-21swapper/219:09:102
1957128150,8sleep10-21swapper/119:09:091
1947227949,27sleep50-21swapper/519:07:455
1943527950,26sleep00-21swapper/019:07:160
1960127846,28sleep40-21swapper/419:09:364
1932627848,27sleep30-21swapper/319:05:423
181642670,0sleep10-21swapper/123:28:001
20068992928,1cyclictest721ktimersoftd/721:58:577
20068992910,18cyclictest0-21swapper/721:34:087
20068992828,0cyclictest0-21swapper/721:51:067
20068992810,18cyclictest0-21swapper/721:42:007
20068992810,18cyclictest0-21swapper/721:03:287
20068992810,18cyclictest0-21swapper/720:49:317
20068992810,0cyclictest0-21swapper/720:56:367
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional