You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-14 - 06:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot3.osadl.org (updated Tue Apr 14, 2026 00:55:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
102349967234,635cyclictest0-21swapper/722:06:397
1022799669120,332cyclictest30152-21nscd21:37:180
102349966628,635cyclictest0-21swapper/723:28:287
102349966531,550cyclictest0-21swapper/720:39:007
102329964852,380cyclictest0-21swapper/522:20:175
102329964611,126cyclictest0-21swapper/523:30:255
10228996391,508cyclictest0-21swapper/122:43:071
10234996351,2cyclictest0-21swapper/722:42:517
10233996351,2cyclictest0-21swapper/621:35:556
10228996355,81cyclictest0-21swapper/100:44:501
10233996331,2cyclictest0-21swapper/622:59:096
102329963281,127cyclictest0-21swapper/523:28:245
1023199632122,338cyclictest121rcu_preempt00:18:484
1023199632122,338cyclictest121rcu_preempt00:18:484
1023199630119,338cyclictest32340-21runrttasks23:52:324
1023099626164,246cyclictest25128-21kworker/u16:122:42:533
102319962130,380cyclictest0-21swapper/421:35:174
1023199621153,338cyclictest0-21swapper/422:21:324
1023499620113,126cyclictest10225-21cyclictest00:18:407
1023499620113,126cyclictest10225-21cyclictest00:18:407
102319961664,338cyclictest121rcu_preempt00:44:464
102329961418,339cyclictest0-21swapper/521:31:195
1023499613102,381cyclictest0-21swapper/723:30:267
1022899611273,83cyclictest18019-21diskmemload23:30:191
102319961018,42cyclictest0-21swapper/423:45:184
102329960998,380cyclictest0-21swapper/521:40:295
102299960958,126cyclictest0-21swapper/221:39:312
10234995994,592cyclictest0-21swapper/721:36:577
10234995961,41cyclictest0-21swapper/721:29:477
10232995921,423cyclictest0-21swapper/522:59:105
10232995920,83cyclictest0-21swapper/522:09:375
1022899589121,342cyclictest0-21swapper/122:23:061
102329958882,126cyclictest0-21swapper/500:28:505
1022899587121,84cyclictest121rcu_preempt22:32:061
1022899587121,84cyclictest121rcu_preempt22:32:061
1023199586503,3cyclictest471rcuc/422:05:304
102289958537,338cyclictest0-21swapper/123:28:191
102289958335,126cyclictest18019-21diskmemload23:54:231
102279958130,127cyclictest0-21swapper/000:20:330
102279958130,127cyclictest0-21swapper/000:20:330
1023399579116,125cyclictest121rcu_preempt21:33:126
102329957828,126cyclictest0-21swapper/521:47:275
102349957421,550cyclictest0-21swapper/723:15:177
1023499574105,253cyclictest0-21swapper/700:36:237
1022899574152,253cyclictest415-21kworker/u16:021:27:561
102349957322,127cyclictest0-21swapper/722:59:277
102349957116,381cyclictest0-21swapper/700:29:587
102279957163,126cyclictest0-21swapper/023:28:360
102309956859,211cyclictest0-21swapper/323:51:483
102299956799,258cyclictest121rcu_preempt22:24:412
1022899566139,296cyclictest6097-1kworker/u17:200:20:331
1022899566139,296cyclictest6097-1kworker/u17:200:20:321
102279956659,338cyclictest0-21swapper/022:59:390
102329956512,126cyclictest0-21swapper/523:54:475
102319956315,2cyclictest0-21swapper/422:42:524
102279955850,126cyclictest0-21swapper/023:54:480
102279955716,330cyclictest0-21swapper/020:39:020
1023099556214,339cyclictest18275-21kworker/u16:322:23:383
10228995541,126cyclictest0-21swapper/100:09:191
102349955040,507cyclictest0-21swapper/723:55:117
102299954982,126cyclictest0-21swapper/221:33:102
1022999549462,85cyclictest311rcuc/200:09:592
102349954635,127cyclictest0-21swapper/700:10:237
102289954635,380cyclictest4155-21rm21:36:041
102279954682,126cyclictest0-21swapper/021:33:170
102349954534,508cyclictest0-21swapper/723:14:407
102309954534,126cyclictest0-21swapper/300:09:283
1022799545124,295cyclictest9-21ksoftirqd/022:34:380
1022799545124,295cyclictest9-21ksoftirqd/022:34:380
102299954478,126cyclictest121rcu_preempt23:54:322
102339954337,84cyclictest121rcu_preempt22:31:406
102339954337,84cyclictest121rcu_preempt22:31:396
1023399543239,42cyclictest22688-21ssh22:23:496
1022999542119,212cyclictest0-21swapper/221:28:322
102289954236,337cyclictest0-21swapper/121:40:281
102339954173,380cyclictest0-21swapper/623:28:466
1023399541115,295cyclictest14789-21ssh00:17:516
1023399541115,295cyclictest14789-21ssh00:17:516
1022899541162,294cyclictest24287-21kworker/u16:000:17:401
1022899541162,294cyclictest24287-21kworker/u16:000:17:401
102349953932,428cyclictest0-21swapper/721:32:437
102329953933,126cyclictest0-21swapper/521:28:365
102289953932,127cyclictest10133-21/usr/sbin/munin22:35:141
1023399538111,295cyclictest0-21swapper/623:45:266
102329953870,338cyclictest0-21swapper/520:38:515
102299953628,127cyclictest15603-21ssh00:18:542
102299953628,127cyclictest15603-21ssh00:18:532
102279953529,126cyclictest0-21swapper/000:27:520
102339953364,211cyclictest0-21swapper/622:04:356
102319953222,295cyclictest0-21swapper/422:32:444
102319953222,295cyclictest0-21swapper/422:32:444
102299953261,211cyclictest0-21swapper/221:48:382
102279953225,127cyclictest15495-21runrttasks23:43:470
102279953225,127cyclictest15495-21runrttasks23:43:470
102349953120,126cyclictest0-21swapper/723:52:117
102349953117,380cyclictest0-21swapper/722:33:157
102349953117,380cyclictest0-21swapper/722:33:157
1023399531108,126cyclictest23929-21ssh21:47:486
102329953123,126cyclictest0-21swapper/521:37:565
102279953166,88cyclictest121rcu_preempt22:21:460
1023099529104,127cyclictest415-21kworker/u16:021:49:393
1022899529107,84cyclictest25114-21ssh21:49:141
102279952964,126cyclictest0-21swapper/023:55:170
1023099528100,127cyclictest41-21ksoftirqd/321:33:003
102349952720,342cyclictest0-21swapper/721:47:497
1022899527104,126cyclictest0-21swapper/100:10:191
102279952720,126cyclictest15545-21sh22:18:360
102289952615,84cyclictest0-21swapper/122:09:591
102319952514,260cyclictest0-21swapper/423:15:044
102279952516,127cyclictest0-21swapper/000:41:520
1022899524144,218cyclictest16226-21rm22:19:241
102309952397,253cyclictest9476-21basename21:40:213
1022899523355,42cyclictest18019-21diskmemload00:37:261
1023099522436,84cyclictest391rcuc/300:29:533
102349952110,422cyclictest10225-21cyclictest22:20:207
1023399519262,126cyclictest0-21swapper/622:09:086
102279951913,260cyclictest0-21swapper/022:42:520
102309951810,126cyclictest0-21swapper/322:33:363
102309951810,126cyclictest0-21swapper/322:33:363
102319951648,84cyclictest0-21swapper/422:17:204
10229995164,85cyclictest0-21swapper/200:27:172
102279951610,83cyclictest31005-21ssh00:10:010
10234995142,42cyclictest0-21swapper/720:00:177
10227995143,338cyclictest0-21swapper/023:15:060
10229995135,126cyclictest0-21swapper/222:18:432
1023399512129,171cyclictest0-21swapper/621:29:196
10232995121,380cyclictest26740-21ssh00:42:505
1023299511340,83cyclictest10225-21cyclictest23:55:055
102309951187,127cyclictest23705-21ssh23:15:093
102319950983,423cyclictest0-21swapper/421:34:474
10231995091,84cyclictest18275-21kworker/u16:322:25:174
10230995090,84cyclictest0-21swapper/322:09:373
102319950839,254cyclictest0-21swapper/400:36:504
1022899508209,168cyclictest26421-21kworker/1:021:34:111
102339950784,380cyclictest0-21swapper/623:52:336
1023199507124,126cyclictest49-21ksoftirqd/400:09:294
10228995071,422cyclictest0-21swapper/100:29:591
102319950638,465cyclictest10225-21cyclictest23:44:414
102319950638,465cyclictest10225-21cyclictest23:44:414
10233995041,45cyclictest0-21swapper/600:20:226
10233995041,45cyclictest0-21swapper/600:20:226
102329950477,255cyclictest0-21swapper/523:45:275
102349950338,386cyclictest14063-21ssh22:17:007
102319950377,253cyclictest121rcu_preempt21:49:074
102299950239,83cyclictest121rcu_preempt22:10:162
1022799502202,127cyclictest0-21swapper/023:45:180
102349950175,423cyclictest0-21swapper/720:40:237
102319950178,84cyclictest121rcu_preempt20:40:144
102309950113,485cyclictest0-21swapper/300:18:133
102309950113,485cyclictest0-21swapper/300:18:133
102349950077,84cyclictest0-21swapper/719:57:597
102339950073,296cyclictest0-21swapper/623:55:306
102279950034,85cyclictest0-21swapper/020:00:150
102339949934,44cyclictest27766-21ssh22:44:486
1022899499158,168cyclictest2840-21cpuspeed_turbos23:55:171
102319949732,380cyclictest0-21swapper/400:27:514
102279949733,84cyclictest0-21swapper/023:30:170
102279949727,380cyclictest0-21swapper/021:29:430
1023399496410,84cyclictest631rcuc/600:29:016
1023299496324,42cyclictest0-21swapper/522:43:225
102279949669,211cyclictest0-21swapper/022:05:410
102319949467,211cyclictest0-21swapper/423:55:074
102279949426,83cyclictest0-21swapper/023:00:200
102339949226,83cyclictest121rcu_preempt00:37:046
102309949270,84cyclictest0-21swapper/321:40:033
102289949228,295cyclictest0-21swapper/122:25:161
102279949268,42cyclictest121rcu_preempt00:19:370
102279949268,42cyclictest121rcu_preempt00:19:370
102329949123,295cyclictest0-21swapper/500:37:505
102329949063,253cyclictest0-21swapper/522:17:265
102279949026,84cyclictest0-21swapper/021:47:450
102349948824,386cyclictest0-21swapper/700:42:527
102299948760,296cyclictest1553-21runrttasks22:33:452
102299948760,296cyclictest1553-21runrttasks22:33:442
102299948760,296cyclictest0-21swapper/222:43:542
102299948721,126cyclictest0-21swapper/223:29:482
102329948621,84cyclictest0-21swapper/522:34:055
102329948621,84cyclictest0-21swapper/522:34:055
1023099486233,84cyclictest0-21swapper/300:43:443
102279948519,84cyclictest0-21swapper/022:04:460
102309948414,296cyclictest0-21swapper/323:55:183
102289948419,84cyclictest121rcu_preempt23:00:201
102319948318,84cyclictest0-21swapper/421:40:094
102329948218,340cyclictest0-21swapper/523:14:225
102299948118,81cyclictest121rcu_preempt23:44:072
102299948118,81cyclictest121rcu_preempt23:44:072
102319948016,169cyclictest0-21swapper/421:28:154
102299948057,211cyclictest0-21swapper/222:05:432
102299948053,211cyclictest33-21ksoftirqd/200:43:452
102319947915,381cyclictest0-21swapper/422:59:104
102309947915,219cyclictest0-21swapper/323:45:213
102349947852,169cyclictest0-21swapper/700:20:117
102349947852,169cyclictest0-21swapper/700:20:117
102339947855,211cyclictest1551-21snmpd22:25:176
102279947814,295cyclictest0-21swapper/021:40:080
102349947712,126cyclictest0-21swapper/700:09:137
102309947796,84cyclictest0-21swapper/300:30:193
10234994766,42cyclictest0-21swapper/723:45:097
10230994749,84cyclictest0-21swapper/323:00:263
10229994713,126cyclictest0-21swapper/223:55:142
10234994701,466cyclictest0-21swapper/723:00:267
102309947085,127cyclictest22295-21ntp_states23:30:233
1022999466167,126cyclictest33-21ksoftirqd/222:59:072
10228994661,382cyclictest0-21swapper/122:59:101
102349946438,423cyclictest0-21swapper/721:40:217
102309946483,84cyclictest0-21swapper/321:29:293
102309946382,84cyclictest0-21swapper/323:28:103
102299946382,84cyclictest0-21swapper/223:15:052
1022799462120,339cyclictest0-21swapper/000:37:270
102289946076,296cyclictest0-21swapper/123:14:041
1022999459204,253cyclictest10225-21cyclictest21:40:112
102299945836,84cyclictest0-21swapper/220:39:022
102329945728,211cyclictest57-21ksoftirqd/500:10:015
1023299457116,127cyclictest0-21swapper/520:40:125
102309945734,256cyclictest0-21swapper/322:17:153
1022899457118,84cyclictest23733-21ssh23:15:111
1022799457120,168cyclictest0-21swapper/022:10:150
102319945634,210cyclictest0-21swapper/420:39:244
102309945677,83cyclictest0-21swapper/323:14:303
102309945629,85cyclictest0-21swapper/300:20:243
102309945629,85cyclictest0-21swapper/300:20:243
102279945673,211cyclictest0-21swapper/019:58:360
1023399455115,338cyclictest0-21swapper/600:44:216
102329945528,84cyclictest0-21swapper/523:00:265
1023299455114,338cyclictest23734-21/usr/sbin/munin23:15:125
102299945574,84cyclictest0-21swapper/219:57:582
1023399454282,84cyclictest0-21swapper/620:00:166
1023399452110,340cyclictest10225-21cyclictest23:44:316
1023399452110,340cyclictest10225-21cyclictest23:44:316
102299945271,84cyclictest0-21swapper/200:30:192
102339945128,256cyclictest0-21swapper/622:17:166
1022999451156,171cyclictest0-21swapper/222:35:172
102279945129,49cyclictest0-21swapper/023:14:220
102319945067,212cyclictest19816-21ssh23:29:504
1022899450111,84cyclictest0-21swapper/123:44:591
1022899450111,84cyclictest0-21swapper/123:44:581
102329944826,84cyclictest0-21swapper/522:10:105
102319944721,253cyclictest18090-21smartctl00:20:164
102319944721,253cyclictest18090-21smartctl00:20:154
102339944671,372cyclictest0-21swapper/600:09:546
102339944624,256cyclictest0-21swapper/623:14:226
102329944623,7cyclictest0-21swapper/500:20:245
102329944623,7cyclictest0-21swapper/500:20:235
1022899446190,84cyclictest121rcu_preempt22:04:521
102299944565,177cyclictest0-21swapper/200:38:032
102279944522,48cyclictest10213-21cpuspeed_turbos22:35:170
102299944464,126cyclictest10225-21cyclictest00:10:172
102329944317,84cyclictest0-21swapper/500:17:515
102329944317,84cyclictest0-21swapper/500:17:505
102279944358,211cyclictest981-21expr20:40:150
1022799443101,211cyclictest9-21ksoftirqd/000:10:180
102329944120,3cyclictest0-21swapper/522:35:175
102319943917,338cyclictest0-21swapper/400:30:184
102309943915,218cyclictest0-21swapper/300:37:443
102299943916,254cyclictest0-21swapper/223:45:172
102339943715,84cyclictest0-21swapper/621:40:196
102339943715,255cyclictest9949-21rm22:35:086
102339943695,338cyclictest0-21swapper/623:30:286
102319943614,256cyclictest0-21swapper/423:14:464
102299943249,126cyclictest33-21ksoftirqd/222:25:142
102349943147,169cyclictest73-21ksoftirqd/723:43:487
102349943147,169cyclictest73-21ksoftirqd/723:43:487
10231994281,254cyclictest0-21swapper/422:04:554
10234994271,42cyclictest15850irq/123-ahci[0022:10:107
1023199427130,125cyclictest121rcu_preempt23:00:124
10234994241,84cyclictest0-21swapper/722:25:067
102339942484,337cyclictest0-21swapper/623:15:246
10228994231,256cyclictest0-21swapper/122:10:131
102329942243,295cyclictest0-21swapper/522:25:135
102309942283,83cyclictest0-21swapper/323:44:013
102309942283,83cyclictest0-21swapper/323:44:013
102349942181,338cyclictest0-21swapper/722:04:587
102349942180,338cyclictest0-21swapper/722:35:197
102289942180,338cyclictest0-21swapper/123:45:261
102289942141,296cyclictest0-21swapper/119:59:291
1022899421377,41cyclictest241ktimersoftd/120:40:101
102309942081,84cyclictest0-21swapper/322:59:393
102299942082,84cyclictest0-21swapper/223:30:172
102329941980,126cyclictest0-21swapper/500:10:175
10232994191,173cyclictest0-21swapper/519:59:485
1023199419120,168cyclictest49-21ksoftirqd/422:35:064
102309941880,83cyclictest0-21swapper/322:04:503
102299941778,126cyclictest0-21swapper/223:00:262
102289941737,296cyclictest0-21swapper/120:38:241
1023299416246,46cyclictest0-21swapper/523:44:505
1023299416246,46cyclictest0-21swapper/523:44:495
102319941372,338cyclictest0-21swapper/400:10:044
102289941372,338cyclictest0-21swapper/100:30:181
102339941230,84cyclictest0-21swapper/623:00:016
102329941069,338cyclictest0-21swapper/500:30:195
102319940971,133cyclictest0-21swapper/423:30:014
102309940970,84cyclictest0-21swapper/320:40:143
102299940967,84cyclictest121rcu_preempt23:14:402
102349940828,296cyclictest3908-21sed00:30:177
102329940767,337cyclictest0-21swapper/522:04:535
102319940666,338cyclictest64450irq/122-eth022:10:144
102309940665,211cyclictest121rcu_preempt21:50:083
102339940565,338cyclictest0-21swapper/622:10:126
102309940562,169cyclictest0-21swapper/319:59:423
102289940568,84cyclictest0-21swapper/121:50:091
102319940423,126cyclictest0-21swapper/419:59:304
102309940465,84cyclictest0-21swapper/320:39:283
102329940319,215cyclictest0-21swapper/521:50:115
102319940318,296cyclictest0-21swapper/420:00:184
102279940364,84cyclictest0-21swapper/022:25:180
102339940263,84cyclictest0-21swapper/619:59:026
102339940116,254cyclictest0-21swapper/620:40:176
102309940160,84cyclictest41-21ksoftirqd/322:25:143
102299940121,259cyclictest0-21swapper/200:20:102
102299940121,259cyclictest0-21swapper/200:20:102
102309939960,84cyclictest0-21swapper/322:10:103
102309939654,211cyclictest0-21swapper/300:10:183
102339939051,84cyclictest0-21swapper/600:10:166
10227993899,169cyclictest9-21ksoftirqd/021:50:110
102309938546,83cyclictest0-21swapper/322:35:193
102279937840,48cyclictest3891-21sed00:30:180
102299937777,86cyclictest10225-21cyclictest21:50:112
1023399375119,126cyclictest0-21swapper/600:30:196
102339937437,2cyclictest0-21swapper/620:39:026
102299937031,84cyclictest0-21swapper/220:40:172
102349936931,254cyclictest0-21swapper/721:50:107
102329936931,83cyclictest0-21swapper/520:00:165
102299936831,171cyclictest0-21swapper/222:04:512
1023199367112,253cyclictest26272-21ssh21:50:104
102289936570,84cyclictest10169-21cat20:00:171
1023399364196,46cyclictest0-21swapper/621:50:096
102309933132,126cyclictest0-21swapper/320:00:173
102299933134,84cyclictest0-21swapper/220:00:182
7303210196,2sleep20-21swapper/219:05:122
957329163,5sleep40-21swapper/419:06:514
720029049,28sleep30-21swapper/319:05:053
682928756,27sleep70-21swapper/719:05:017
957928553,28sleep10-21swapper/119:06:561
947428552,9sleep60-21swapper/619:05:246
966228454,27sleep50-21swapper/519:08:045
976728351,28sleep00-21swapper/019:09:350
10228993326,6cyclictest0-21swapper/121:17:051
10228993310,6cyclictest0-21swapper/121:08:551
10228993210,5cyclictest0-21swapper/120:11:231
10228993210,22cyclictest0-21swapper/119:48:441
10228993210,22cyclictest0-21swapper/119:48:431
10228993210,22cyclictest0-21swapper/119:43:211
10228993210,21cyclictest0-21swapper/119:37:121
10228993210,21cyclictest0-21swapper/119:31:491
10228993210,21cyclictest0-21swapper/119:18:191
10228993126,5cyclictest0-21swapper/119:27:061
10228993125,5cyclictest0-21swapper/120:19:091
10228993110,20cyclictest0-21swapper/120:35:001
10228993010,19cyclictest0-21swapper/121:01:231
10228993010,19cyclictest0-21swapper/119:22:251
10230992910,18cyclictest0-21swapper/319:31:253
10234992810,18cyclictest0-21swapper/721:16:467
10234992810,18cyclictest0-21swapper/721:08:377
10234992810,18cyclictest0-21swapper/719:48:567
10234992810,18cyclictest0-21swapper/719:48:567
10232992810,17cyclictest0-21swapper/521:16:465
10231992810,0cyclictest0-21swapper/419:14:454
10230992810,18cyclictest0-21swapper/321:17:103
10230992810,18cyclictest0-21swapper/320:19:003
10230992810,18cyclictest0-21swapper/320:11:553
10230992810,18cyclictest0-21swapper/319:14:353
10230992810,0cyclictest0-21swapper/319:43:193
10229992828,0cyclictest0-21swapper/220:53:472
10229992810,18cyclictest0-21swapper/220:11:382
10229992810,0cyclictest0-21swapper/220:26:322
10234992727,0cyclictest0-21swapper/719:14:347
10234992710,17cyclictest0-21swapper/721:01:207
10234992710,17cyclictest0-21swapper/720:26:357
10234992710,17cyclictest0-21swapper/720:19:057
10234992710,17cyclictest0-21swapper/720:11:337
10234992710,17cyclictest0-21swapper/719:26:407
10234992710,17cyclictest0-21swapper/719:22:147
10234992710,17cyclictest0-21swapper/719:18:037
10234992710,0cyclictest0-21swapper/720:34:527
10234992710,0cyclictest0-21swapper/719:43:197
10234992710,0cyclictest0-21swapper/719:36:507
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional