You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 09:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Apr 27, 2026 00:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52289912859,62cyclictest297-21systemd-logind00:17:220
52289912655,63cyclictest298-21in:imuxsock23:12:210
52289912158,55cyclictest0-21swapper/019:07:350
52289912158,55cyclictest0-21swapper/019:07:350
52289912042,12cyclictest0-21swapper/021:37:590
52289911847,9cyclictest0-21swapper/022:42:430
52289911847,9cyclictest0-21swapper/022:42:430
52289911741,12cyclictest0-21swapper/021:32:540
52289911741,12cyclictest0-21swapper/021:32:540
5241991165,95cyclictest25205-21apt-get22:17:371
52509911259,45cyclictest0-21swapper/220:07:492
52509911052,11cyclictest0-21swapper/200:27:382
5241991103,73cyclictest16051-21sh21:07:511
5228991104,33cyclictest352-21runrttasks00:05:210
5228991104,33cyclictest30352-21latency_hist00:12:240
5241991098,90cyclictest3264-21apt-get23:27:391
5241991093,84cyclictest1290-21kworker/u19:3+ext4-rsv-conversion00:18:211
52509910853,8cyclictest0-21swapper/220:17:512
52509910841,19cyclictest0-21swapper/219:37:222
52509910457,40cyclictest567-21kworker/u17:3-xprtiod22:57:482
52509910444,12cyclictest0-21swapper/223:37:242
52509910444,12cyclictest0-21swapper/223:37:242
52419910486,10cyclictest0-21swapper/122:47:561
484821037,79sleep00-21swapper/018:59:180
52509910248,12cyclictest0-21swapper/221:27:492
5241991003,71cyclictest22801-21fschecks_time19:53:401
39262989,58sleep13956-21fschecks_count18:57:491
5250999749,10cyclictest298-21in:imuxsock20:27:212
5228999758,8cyclictest181rcu_preempt22:02:370
5228999758,8cyclictest181rcu_preempt22:02:370
5228999667,20cyclictest28637-21latency_hist22:22:240
5228999574,15cyclictest27128-21latency_hist20:07:230
5228999574,15cyclictest27128-21latency_hist20:07:230
5250999357,8cyclictest181rcu_preempt22:02:482
5250999357,8cyclictest181rcu_preempt22:02:482
5228999378,9cyclictest6143-21apt-key23:32:230
524199928,58cyclictest18168-21munin-run23:52:211
5250999170,10cyclictest0-21swapper/219:47:252
5250999170,10cyclictest0-21swapper/219:47:252
5228999167,19cyclictest5219-21cyclictest23:02:440
5250999070,10cyclictest0-21swapper/221:57:242
5250999070,10cyclictest0-21swapper/221:57:242
5250998868,9cyclictest0-21swapper/219:02:262
5250998767,10cyclictest0-21swapper/221:09:132
5250998766,11cyclictest0-21swapper/200:22:452
5250998766,11cyclictest0-21swapper/200:22:452
5228998758,13cyclictest181rcu_preempt19:12:330
5241998610,53cyclictest6526-21apt-get23:32:381
5241998610,53cyclictest6526-21apt-get23:32:381
5250998567,12cyclictest19676-21snmpd21:48:422
5250998539,11cyclictest181rcu_preempt23:57:352
5228998570,8cyclictest0-21swapper/022:02:250
5250998430,12cyclictest181rcu_preempt22:51:042
5228998463,10cyclictest0-21swapper/023:47:230
5228998463,10cyclictest0-21swapper/023:47:230
5228998460,16cyclictest5128-21latency_hist22:37:240
5241998362,13cyclictest15484-21cron19:32:211
5241998361,15cyclictest5219-21cyclictest23:47:251
5241998361,15cyclictest5219-21cyclictest23:47:251
5228998364,10cyclictest0-21swapper/020:27:530
5241998261,14cyclictest0-21swapper/119:02:431
5228998266,9cyclictest0-21swapper/021:22:200
5228998266,9cyclictest0-21swapper/021:22:200
5228998249,26cyclictest0-21swapper/023:17:240
5228998249,26cyclictest0-21swapper/023:17:240
151072820,8sleep30-21swapper/319:27:583
5250998167,8cyclictest0-21swapper/200:08:002
5250998165,10cyclictest5094-21ntp_offset21:42:522
5250998163,13cyclictest5219-21cyclictest19:57:432
5250998154,21cyclictest4163-21sh21:42:212
5241998133,35cyclictest17073-21sshd22:57:061
5241998123,35cyclictest0-21swapper/123:08:571
5228998162,14cyclictest26684-21kworker/u19:1+events_unbound21:32:220
5228998160,9cyclictest181rcu_preempt19:47:580
5250998055,17cyclictest0-21swapper/219:52:252
5250998052,11cyclictest181rcu_preempt19:27:372
5228998056,18cyclictest2374-21systemd-journal20:12:230
5250997957,12cyclictest0-21swapper/219:22:242
5250997956,11cyclictest0-21swapper/220:12:572
5241997928,18cyclictest12390-21diskmemload22:40:321
5241997928,18cyclictest12390-21diskmemload22:40:321
5228997965,7cyclictest0-21swapper/022:07:370
5228997961,11cyclictest25545-21apt-key22:17:250
5228997961,11cyclictest25545-21apt-key22:17:250
5228997958,14cyclictest21652-21sh21:17:210
5250997864,8cyclictest0-21swapper/220:52:572
5250997863,9cyclictest0-21swapper/200:02:542
5250997849,7cyclictest181rcu_preempt23:38:432
5250997844,25cyclictest23824-21modprobe19:57:222
5250997844,11cyclictest5219-21cyclictest21:06:562
5241997863,10cyclictest5219-21cyclictest20:42:411
5241997857,13cyclictest1-21systemd19:12:221
5241997857,13cyclictest1-21systemd19:12:221
5250997760,10cyclictest0-21swapper/219:22:452
5250997758,11cyclictest0-21swapper/220:42:452
5250997723,8cyclictest0-21swapper/220:27:432
5241997753,16cyclictest5219-21cyclictest00:31:321
5228997763,7cyclictest0-21swapper/020:52:570
5228997734,26cyclictest9981-21rm21:51:530
5250997659,10cyclictest0-21swapper/219:08:072
5250997659,10cyclictest0-21swapper/219:08:072
5250997657,13cyclictest2996-21sendmail_mailqu22:32:552
5250997643,17cyclictest0-21swapper/223:07:492
5250997630,10cyclictest181rcu_preempt20:02:572
5250997630,10cyclictest181rcu_preempt20:02:572
5241997655,14cyclictest277-21dbus-daemon00:17:221
5241997636,15cyclictest181rcu_preempt21:42:451
5241997624,17cyclictest9408-21sh22:43:061
5241997624,17cyclictest9408-21sh22:43:061
5228997657,13cyclictest14478-21/usr/sbin/munin22:52:400
5228997656,14cyclictest18744-21idleruntime-cro19:42:220
5228997656,10cyclictest0-21swapper/021:47:220
5228997653,16cyclictest31592-21latency_hist22:27:240
5257997515,46cyclictest0-21swapper/322:47:363
5250997559,11cyclictest365-21ntpd20:37:542
5250997559,11cyclictest365-21ntpd20:37:542
5250997555,14cyclictest3010-21latency_hist23:27:252
5250997537,11cyclictest0-21swapper/222:25:362
5250997535,10cyclictest181rcu_preempt22:17:592
5241997550,15cyclictest12390-21diskmemload22:06:491
5241997550,15cyclictest12390-21diskmemload22:06:491
5241997548,18cyclictest24316-21cut19:57:431
5241997530,31cyclictest352-21runrttasks00:11:101
5228997557,13cyclictest5219-21cyclictest23:02:220
5228997557,13cyclictest4852-21ntp_kernel_pll_00:22:520
5228997557,13cyclictest4852-21ntp_kernel_pll_00:22:520
5228997556,13cyclictest12390-21diskmemload22:37:430
5228997556,13cyclictest12390-21diskmemload22:37:430
522899754,58cyclictest1273-21apt-get00:17:380
522899754,40cyclictest2938-21/usr/sbin/munin20:32:570
522899754,40cyclictest2938-21/usr/sbin/munin20:32:570
5250997457,9cyclictest0-21swapper/221:17:552
5250997457,9cyclictest0-21swapper/221:17:552
5250997456,12cyclictest19950-21diskmemload21:12:592
5250997451,12cyclictest0-21swapper/222:13:002
5250997451,12cyclictest0-21swapper/222:13:002
5250997448,10cyclictest181rcu_preempt23:47:342
5241997455,12cyclictest15648-21kworker/u19:0-nfsiod23:02:211
5241997418,39cyclictest5227-21timerwakeupswit00:22:591
5241997418,39cyclictest5227-21timerwakeupswit00:22:591
5228997441,12cyclictest58-21kcompactd020:47:220
5228997437,8cyclictest181rcu_preempt21:52:380
5228997437,8cyclictest181rcu_preempt21:52:380
525799735,35cyclictest0-21swapper/322:17:393
5257997312,45cyclictest0-21swapper/300:18:213
5250997355,10cyclictest0-21swapper/219:02:472
5250997351,11cyclictest0-21swapper/200:12:312
5241997348,14cyclictest0-21swapper/123:22:561
5241997347,16cyclictest19535-21awk23:53:001
5241997347,16cyclictest19535-21awk23:53:001
524199733,48cyclictest13424-21grep21:02:551
5241997321,21cyclictest0-21swapper/121:37:421
5228997358,11cyclictest5219-21cyclictest23:50:300
5228997357,9cyclictest15527-21ssh21:07:240
5228997355,12cyclictest18504-21/usr/sbin/munin23:52:400
5228997355,12cyclictest18504-21/usr/sbin/munin23:52:400
5250997254,11cyclictest0-21swapper/220:32:552
5250997254,11cyclictest0-21swapper/220:32:552
525099721,32cyclictest22393-21sshd23:05:142
5241997244,21cyclictest0-21swapper/119:52:241
5241997216,25cyclictest308122fschecks_time20:17:451
522899726,55cyclictest14224-21sh22:52:220
525099718,28cyclictest0-21swapper/223:52:372
525099718,28cyclictest0-21swapper/223:52:372
5250997141,9cyclictest181rcu_preempt00:21:542
5250997137,8cyclictest0-21swapper/223:15:142
5250997137,8cyclictest0-21swapper/223:15:142
5250997131,12cyclictest6297-21sed23:32:242
5250997116,14cyclictest181rcu_preempt21:58:002
5241997152,13cyclictest365-21ntpd21:52:511
5241997152,13cyclictest365-21ntpd21:52:511
5228997136,8cyclictest0-21swapper/019:42:480
5228997136,8cyclictest0-21swapper/019:42:480
5250997053,10cyclictest0-21swapper/222:57:242
5250997047,18cyclictest5219-21cyclictest22:12:222
525099704,36cyclictest1171-21idleruntime-cro21:37:212
525099704,36cyclictest1171-21idleruntime-cro21:37:212
5250997037,7cyclictest0-21swapper/221:23:262
5241997053,10cyclictest28253-21fschecks_time21:27:441
5241997044,17cyclictest2374-21systemd-journal22:27:061
5228997055,8cyclictest0-21swapper/022:27:550
5228997052,12cyclictest30450-21timerwakeupswit23:17:590
5228997050,11cyclictest0-21swapper/021:22:460
5228997049,14cyclictest32062-21latency_hist20:22:240
5228997048,12cyclictest0-21swapper/019:57:240
5228997030,26cyclictest0-21swapper/023:59:030
5257996916,38cyclictest0-21swapper/323:32:383
5257996916,38cyclictest0-21swapper/323:32:383
5250996953,11cyclictest5219-21cyclictest22:39:072
5250996953,11cyclictest5219-21cyclictest22:39:072
5250996949,10cyclictest0-21swapper/220:57:372
524199693,47cyclictest31724-21grep21:32:551
524199693,47cyclictest31724-21grep21:32:551
524199693,37cyclictest10042-21find20:52:551
5228996955,7cyclictest0-21swapper/019:17:460
5228996954,7cyclictest0-21swapper/020:47:460
5228996953,7cyclictest0-21swapper/021:09:240
5228996928,14cyclictest13170-21wc19:22:550
5257996843,20cyclictest0-21swapper/323:27:533
5250996848,14cyclictest10935-21latency_hist22:47:252
5250996848,14cyclictest10935-21latency_hist22:47:252
5241996851,10cyclictest5219-21cyclictest23:37:381
5241996849,13cyclictest25329-21gpgv22:17:251
5241996849,13cyclictest25329-21gpgv22:17:251
5241996847,17cyclictest5219-21cyclictest21:47:511
5241996825,32cyclictest29719-21diskstats23:17:441
524199682,46cyclictest1067-21awk20:27:221
5228996851,10cyclictest8020-21ssh00:27:560
525799674,43cyclictest0-21swapper/321:07:553
5250996749,13cyclictest58-21kcompactd023:43:282
5250996749,13cyclictest58-21kcompactd023:43:282
5250996735,7cyclictest0-21swapper/220:47:562
5250996733,8cyclictest0-21swapper/219:37:432
524199674,32cyclictest1634150cat22:02:241
5241996739,21cyclictest0-21swapper/120:07:211
5241996739,21cyclictest0-21swapper/120:07:211
524199673,47cyclictest20428-21grep22:07:571
5228996748,9cyclictest0-21swapper/023:32:290
5228996748,9cyclictest0-21swapper/023:32:290
5228996746,12cyclictest0-21swapper/019:57:470
5228996745,12cyclictest0-21swapper/019:27:430
522899673,31cyclictest2887-21apt-config23:27:240
5228996733,12cyclictest0-21swapper/020:22:470
522899672,34cyclictest11126-21runrttasks20:57:380
5250996649,7cyclictest0-21swapper/223:17:482
5250996636,21cyclictest10089-21threads19:12:572
5241996645,11cyclictest0-21swapper/119:42:591
5241996645,11cyclictest0-21swapper/119:42:591
5241996641,16cyclictest0-21swapper/121:12:571
5241996635,22cyclictest0-21swapper/121:22:591
524199662,48cyclictest11317-21cut19:17:481
5241996619,35cyclictest32661-21expr22:27:581
5228996648,7cyclictest0-21swapper/020:12:560
5228996630,12cyclictest0-21swapper/023:37:310
5257996519,31cyclictest0-21swapper/319:53:403
5257996511,33cyclictest0-21swapper/323:52:213
524199652,41cyclictest11287-21grep20:57:431
522899654,45cyclictest15773-21/usr/sbin/munin19:32:490
5250996443,15cyclictest981-21sh22:29:432
5241996447,12cyclictest5219-21cyclictest20:27:421
5241996444,10cyclictest0-21swapper/119:12:591
524199643,45cyclictest25276-21mailstats00:02:551
524199643,43cyclictest6042-21latency_hist20:42:241
524199643,43cyclictest6042-21latency_hist20:42:241
522899643,45cyclictest5633-21fschecks_count19:02:430
525799633,44cyclictest0-21swapper/319:07:383
525799633,44cyclictest0-21swapper/319:07:383
524199633,45cyclictest20990-21latency23:02:481
524199633,39cyclictest17644-21fschecks_time19:37:421
524199633,28cyclictest26564-21ssh23:12:401
524199633,28cyclictest26564-21ssh23:12:401
5241996313,39cyclictest1-21systemd19:37:231
522899633,43cyclictest5298-21switchtime20:37:560
522899633,43cyclictest5298-21switchtime20:37:560
5241996244,13cyclictest5219-21cyclictest20:32:441
5241996244,13cyclictest5219-21cyclictest20:32:441
5241996243,13cyclictest352-21runrttasks21:17:471
5241996243,13cyclictest352-21runrttasks21:17:471
5241996230,23cyclictest13209-21systemctl19:22:561
5241996214,30cyclictest22186-21ssh23:57:541
524199613,36cyclictest30340-21latency_hist20:17:231
5241996037,13cyclictest0-21swapper/120:12:251
5241996032,20cyclictest0-21swapper/122:32:451
525799595,37cyclictest4375-21chrt21:42:253
525799594,43cyclictest17130-21taskset19:37:223
513225912,26sleep30-21swapper/319:02:233
525799583,43cyclictest5838-21chrt19:02:473
524199582,36cyclictest9093-21sshd20:52:061
525799578,33cyclictest20343-21taskset21:13:463
525799572,42cyclictest29838-21taskset23:17:453
525799553,37cyclictest19471-21chrt23:52:593
525799553,37cyclictest19471-21chrt23:52:593
525799553,33cyclictest27507-21chrt20:07:433
525799552,42cyclictest26896-21taskset00:06:373
525799552,40cyclictest28039-21taskset23:14:093
525799552,40cyclictest28039-21taskset23:14:093
525799552,40cyclictest22585-21chrt23:57:583
525799552,38cyclictest15028-21taskset21:06:243
525799543,39cyclictest31920-21taskset20:22:213
525799543,35cyclictest12574-21chrt23:42:383
525799543,35cyclictest12574-21chrt23:42:383
525799542,43cyclictest30978-21taskset22:26:103
525799542,37cyclictest24346-21chrt23:07:573
525799536,29cyclictest837-21chrt23:22:563
525799533,40cyclictest816-21taskset00:17:233
525799533,35cyclictest22124-21chrt21:17:403
525799533,35cyclictest22124-21chrt21:17:403
525799533,34cyclictest19694-21chrt19:42:573
525799533,34cyclictest19694-21chrt19:42:573
525799532,34cyclictest15463-21chrt22:52:573
525799524,36cyclictest23284-21taskset23:07:243
525799523,37cyclictest30157-21taskset00:12:203
525799523,37cyclictest20582-21chrt22:07:593
525799523,33cyclictest31261-21chrt21:32:443
525799523,33cyclictest31261-21chrt21:32:443
525799523,33cyclictest10976-21chrt20:57:253
525799522,36cyclictest7575-21chrt00:27:443
525799522,36cyclictest24307-21taskset19:57:433
525799522,34cyclictest9692-21chrt23:37:393
5257995210,29cyclictest12897-21chrt19:22:483
525799513,34cyclictest8771-21taskset21:48:293
525799513,33cyclictest32060-21chrt22:27:443
525799513,33cyclictest10930-21chrt19:17:333
525799513,32cyclictest21126-21chrt19:47:513
525799503,33cyclictest1122-21chrt20:27:243
525799502,36cyclictest17615-21taskset19:37:423
525799502,33cyclictest13096-21chrt21:57:083
525799502,33cyclictest13096-21chrt21:57:083
525799493,37cyclictest16777-21taskset22:02:443
525799493,37cyclictest16777-21taskset22:02:443
525799493,36cyclictest16234-21taskset22:02:233
525799493,34cyclictest4486-21chrt20:37:243
525799493,34cyclictest4486-21chrt20:37:243
525799493,30cyclictest5796-21chrt22:37:503
525799493,30cyclictest5796-21chrt22:37:503
525799492,32cyclictest8015-21chrt20:47:453
525799483,34cyclictest4963-21chrt22:37:213
525799483,32cyclictest30342-21taskset20:17:233
525799483,30cyclictest18105-21taskset22:57:523
525799482,35cyclictest26167-21taskset21:23:193
525799482,34cyclictest30483-21chrt21:32:033
525799482,31cyclictest5284-21taskset21:42:573
525799473,34cyclictest8680-21chrt22:42:483
525799473,34cyclictest8680-21chrt22:42:483
525799473,33cyclictest25174-21chrt22:17:183
525799473,33cyclictest25174-21chrt22:17:183
525799472,34cyclictest7733-21chrt20:47:253
525799463,30cyclictest1790-21chrt20:27:483
525799463,30cyclictest10899-21chrt19:17:253
525799463,28cyclictest7083-21chrt00:27:243
525799463,28cyclictest7083-21chrt00:27:243
525799463,28cyclictest5114-21chrt20:37:533
525799463,28cyclictest5114-21chrt20:37:533
525799452,29cyclictest25858-21chrt20:02:413
525799452,29cyclictest25858-21chrt20:02:413
525799408,21cyclictest11013-21chrt20:57:293
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional