You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 20:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Jun 07, 2026 12:44:29)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4692214211,83sleep04712-21sed06:59:380
4792991243,89cyclictest10028-21apt-get09:49:502
4792991243,89cyclictest10028-21apt-get09:49:502
3005421160,22sleep130057-21kernelversion12:09:591
4792991113,82cyclictest25254-21ssh10:14:492
4792991073,81cyclictest25943-21apt-get11:09:532
47849910453,44cyclictest14460-21/usr/sbin/munin10:50:071
47929910255,39cyclictest16016-21sh09:05:092
47929910214,61cyclictest17634-21apt-get11:49:502
47929910214,61cyclictest17634-21apt-get11:49:502
47849910150,46cyclictest4762-21cyclictest11:19:361
479299992,28cyclictest16726-21taskset07:34:422
4784999942,8cyclictest0-21swapper/110:19:541
4792999633,40cyclictest0-21swapper/209:57:412
478499963,37cyclictest3108-21/usr/sbin/munin12:19:561
4784999632,20cyclictest23478-21fschecks_time07:54:571
4774999576,13cyclictest2374-21systemd-journal09:49:340
478499944,37cyclictest6335-21latency_hist07:04:361
478499944,37cyclictest6335-21latency_hist07:04:361
4792999344,41cyclictest0-21swapper/211:00:122
4792999344,41cyclictest0-21swapper/211:00:122
479299933,6cyclictest0-21swapper/209:39:492
478499933,37cyclictest9193-21grep08:49:551
478499932,41cyclictest32045-21timerandwakeup08:20:081
4792999239,45cyclictest0-21swapper/209:24:522
4784999237,15cyclictest298-21in:imuxsock07:14:351
479299913,61cyclictest712-21modprobe08:25:132
4784999140,15cyclictest24008-21sh10:12:441
4784999140,15cyclictest24008-21sh10:12:441
384929115,39sleep10-21swapper/106:55:151
479299903,37cyclictest755-21ssh12:15:042
479299903,30cyclictest15965-21/usr/sbin/munin09:59:512
479299902,31cyclictest10364-21latency_hist08:54:372
4774999068,14cyclictest18080-21latency_hist09:09:360
42942906,60sleep20-21swapper/206:55:242
479299893,74cyclictest31443-21cut10:24:562
479299893,6cyclictest0-21swapper/207:16:242
4784998941,13cyclictest11987-21diskmemload11:31:211
4784998939,13cyclictest22318-21switchtime07:50:091
478499893,72cyclictest25943-21apt-get11:10:001
479299883,35cyclictest11644-21fschecks_count11:39:552
4784998841,14cyclictest18028-21sh10:02:471
479999877,60cyclictest26021-21taskset11:09:583
479299873,6cyclictest0-21swapper/208:40:422
479299873,30cyclictest31813-21ntpq08:20:012
479299873,28cyclictest18336-21/usr/sbin/munin07:39:502
479299863,37cyclictest8783-21/usr/sbin/munin07:09:522
479299863,33cyclictest1925-21/usr/sbin/munin09:35:132
479299863,22cyclictest14417-21sh11:44:482
479299863,22cyclictest14417-21sh11:44:482
479299853,8cyclictest0-21swapper/211:29:452
479299853,36cyclictest14837-21kworker/u19:207:29:342
479299853,36cyclictest14837-21kworker/u19:207:29:342
479299853,33cyclictest19094-21seq09:10:072
479299853,29cyclictest23056-21latency_hist07:54:372
479299853,26cyclictest30815-21ssh12:10:262
479299852,34cyclictest2769-21/usr/sbin/munin08:30:012
4784998567,11cyclictest416-21ssh11:20:101
4784998564,15cyclictest745-21latency_hist09:34:381
4784998558,20cyclictest5430-21latency_hist08:39:361
478499853,40cyclictest8444-21latency_hist07:09:361
4774998528,47cyclictest6281-21cron07:04:340
4774998528,47cyclictest6281-21cron07:04:340
4792998460,18cyclictest21357-21journal-offline07:49:352
4792998443,33cyclictest0-21swapper/208:49:362
479299844,29cyclictest21263-21/usr/sbin/munin09:15:012
479299843,34cyclictest1-21systemd11:24:342
479299843,33cyclictest7242-21/usr/sbin/munin09:44:592
4774998461,16cyclictest17418-21apt-key11:49:380
4774998461,16cyclictest17418-21apt-key11:49:380
4774998423,26cyclictest181rcu_preempt07:09:460
479299834,30cyclictest16692-21/usr/sbin/munin10:55:152
479299833,8cyclictest0-21swapper/207:29:502
479299833,8cyclictest0-21swapper/207:29:502
479299833,6cyclictest0-21swapper/208:04:512
479299833,32cyclictest3660-21/usr/sbin/munin12:20:022
479299833,32cyclictest29108-21ssh11:14:532
479299833,31cyclictest3969-21ssh10:33:202
479299833,31cyclictest3969-21ssh10:33:202
4784998363,15cyclictest4762-21cyclictest10:59:341
479299824,36cyclictest15013-21ssh09:04:352
479299824,36cyclictest15013-21ssh09:04:352
479299824,35cyclictest24362-21ssh12:00:072
479299823,8cyclictest0-21swapper/210:09:482
479299823,8cyclictest0-21swapper/210:09:482
479299823,7cyclictest0-21swapper/207:54:502
4792998237,39cyclictest0-21swapper/211:09:332
479299823,40cyclictest7913-21df_inode10:39:532
479299823,40cyclictest7913-21df_inode10:39:532
479299823,33cyclictest3302-21/usr/sbin/munin11:25:092
479299823,33cyclictest19188-21/usr/sbin/munin10:04:542
479299823,32cyclictest26681-21/usr/sbin/munin12:04:502
479299823,31cyclictest9148-21/usr/sbin/munin11:35:072
479299823,31cyclictest28581-21/usr/sbin/munin08:10:032
479299823,30cyclictest5531-21grep07:00:062
479299823,30cyclictest5531-21grep07:00:062
479299823,29cyclictest25405-21grep08:00:072
479299823,29cyclictest25405-21grep08:00:072
479299823,23cyclictest6782-21grep12:25:062
479299822,6cyclictest0-21swapper/208:34:462
479299822,33cyclictest11317-21/usr/sbin/munin08:55:082
479299822,31cyclictest7084-21/usr/sbin/munin07:04:542
479299814,30cyclictest31627-21sh09:30:522
479299813,34cyclictest28222-21runrttasks10:19:462
479299813,31cyclictest4917-21sh10:34:522
479299813,31cyclictest12348-21/usr/sbin/munin07:20:012
479299813,29cyclictest16626-21date10:54:382
479299813,23cyclictest11413-21processes10:45:072
478499813,34cyclictest352-21runrttasks10:32:051
478499813,34cyclictest352-21runrttasks10:32:051
478499812,26cyclictest24672-21apt-get10:14:501
4784998119,27cyclictest18116-21cat09:09:371
479299803,33cyclictest21363-21/usr/sbin/munin11:55:082
479299802,32cyclictest29875-21/usr/sbin/munin08:14:552
4774998062,12cyclictest24888-21ntp_states09:20:030
4774998062,12cyclictest24888-21ntp_states09:20:030
479299793,30cyclictest24270-21/usr/sbin/munin09:19:442
479299793,30cyclictest24270-21/usr/sbin/munin09:19:442
478499783,65cyclictest668-21apt-get08:25:171
4784997760,9cyclictest0-21swapper/109:25:401
4774997762,11cyclictest4762-21cyclictest09:36:500
4784997656,14cyclictest15189-21latency_hist09:04:381
4784997656,14cyclictest15189-21latency_hist09:04:381
4784997627,38cyclictest11967-21netstat11:40:011
478499762,49cyclictest9463-21apt-get09:49:491
478499762,49cyclictest9463-21apt-get09:49:491
4774997654,16cyclictest19303-21fschecks_time10:04:560
479999753,30cyclictest3134-21chrt11:25:063
4784997559,11cyclictest4762-21cyclictest12:14:561
4784997556,12cyclictest277-21dbus-daemon08:59:351
4774997557,13cyclictest4762-21cyclictest10:49:170
4774997555,13cyclictest2374-21systemd-journal10:59:360
4774997543,9cyclictest15-21ksoftirqd/007:23:540
479999748,41cyclictest0-21swapper/310:14:523
4784997457,12cyclictest28360-21idleruntime08:09:581
477499749,37cyclictest7706-21/usr/sbin/munin10:40:080
477499749,37cyclictest7706-21/usr/sbin/munin10:40:080
4774997458,11cyclictest4762-21cyclictest10:28:400
4774997457,11cyclictest11987-21diskmemload11:19:530
4774997453,15cyclictest5115-21sh11:29:330
4774997444,8cyclictest181rcu_preempt10:09:480
4774997444,8cyclictest181rcu_preempt10:09:480
477499744,37cyclictest19676-21snmpd11:14:490
4784997355,12cyclictest3530-21kworker/u17:1-xprtiod11:05:081
4784997351,16cyclictest3269-21switchtime11:25:081
477499737,39cyclictest17663-21ssh11:49:490
477499737,39cyclictest17663-21ssh11:49:490
4774997360,9cyclictest16752-21kworker/u17:1+xprtiod09:25:030
4774997355,11cyclictest2651-21ssh10:30:100
4774997355,11cyclictest2651-21ssh10:30:100
4774997354,12cyclictest8219-21ssh11:34:360
477499734,37cyclictest32323-21chrt12:14:350
479999722,28cyclictest28995-21chrt08:10:113
4784997252,15cyclictest2822-21kworker/u17:2+events_unbound07:29:351
4784997252,15cyclictest2822-21kworker/u17:2+events_unbound07:29:351
4774997256,10cyclictest30420-21ssh09:29:510
4774997253,12cyclictest803-21sendmail-mta07:09:340
4774997251,14cyclictest22840-21ssh09:16:260
4774997250,16cyclictest18085-21latency_hist07:39:370
477499724,40cyclictest5826-21head10:35:120
4784997150,15cyclictest352-21runrttasks08:15:081
4784997150,11cyclictest0-21swapper/109:44:551
4784997127,30cyclictest7053-21sort12:25:101
478499712,47cyclictest17068-21apt-get11:49:541
478499712,47cyclictest17068-21apt-get11:49:541
4774997148,16cyclictest25872-21latency_hist11:09:380
150172713,56sleep00-21swapper/009:04:370
150172713,56sleep00-21swapper/009:04:370
4784997052,13cyclictest21350-21sh11:01:441
4784997052,13cyclictest21350-21sh11:01:441
4784997050,10cyclictest0-21swapper/107:44:361
477499707,52cyclictest25943-21apt-get11:09:480
4774997053,12cyclictest4762-21cyclictest12:08:490
4774997050,14cyclictest11987-21diskmemload12:00:030
477499703,47cyclictest8996-21/usr/sbin/munin08:49:440
477499702,57cyclictest6221-21rm12:24:510
4774997020,37cyclictest352-21runrttasks11:02:240
4774997020,37cyclictest352-21runrttasks11:02:240
479999692,31cyclictest0-21swapper/311:49:503
479999692,31cyclictest0-21swapper/311:49:503
479999692,20cyclictest3132-21chrt12:19:453
4784996954,11cyclictest24748-21kworker/u17:0-rpciod10:28:191
478499695,13cyclictest26431-21apt-get08:04:511
4784996947,9cyclictest181rcu_preempt11:45:091
4784996947,9cyclictest181rcu_preempt11:45:091
4784996947,16cyclictest26216-21runrttasks12:04:241
4784996930,20cyclictest11987-21diskmemload11:55:061
4774996948,12cyclictest2374-21systemd-journal11:56:530
4774996946,15cyclictest10028-21apt-get09:49:540
4774996946,15cyclictest10028-21apt-get09:49:540
4774996942,20cyclictest11330-21latency_hist11:39:370
4774996939,21cyclictest26152-21modprobe08:04:330
4774996939,21cyclictest26152-21modprobe08:04:330
477499693,56cyclictest4678-21threads08:35:080
479999683,28cyclictest6379-21chrt11:30:093
4784996854,9cyclictest21056-21latency_hist09:14:361
4784996851,10cyclictest11156-21latency10:45:001
4784996850,12cyclictest27696-21head12:05:111
4784996847,15cyclictest10381-21latency_hist10:44:361
4784996847,15cyclictest10381-21latency_hist10:44:361
4774996848,14cyclictest2472-21entropy08:29:540
4774996846,17cyclictest4762-21cyclictest11:39:560
477499684,33cyclictest18726-21latency_hist10:04:360
477499683,49cyclictest6547-21munin-node09:54:440
477499683,33cyclictest7365-21/usr/sbin/munin08:44:540
477499683,25cyclictest26683-21tune2fs08:04:580
477499682,28cyclictest14220-21memory10:49:590
479999673,24cyclictest4498-21chrt08:35:063
479999673,22cyclictest15883-21chrt09:05:043
479999672,29cyclictest1585-21chrt08:26:113
479999672,22cyclictest29104-21chrt11:14:533
4799996720,30cyclictest0-21swapper/309:49:503
4799996720,30cyclictest0-21swapper/309:49:503
4784996753,8cyclictest0-21swapper/107:29:571
4784996753,8cyclictest0-21swapper/107:29:571
4784996748,10cyclictest3904-21/usr/sbin/munin09:39:511
4784996746,15cyclictest23258-21sh09:17:371
4784996731,8cyclictest181rcu_preempt07:59:511
4784996731,8cyclictest181rcu_preempt07:59:511
477499675,39cyclictest23115-21latency_hist07:54:370
4774996752,9cyclictest6800-21unixbench_singl08:41:030
477499674,53cyclictest16078-21unixbench_singl07:30:110
477499674,53cyclictest16078-21unixbench_singl07:30:110
477499674,50cyclictest6477-21latency_hist09:44:360
477499673,35cyclictest25220-21apt-get10:14:460
4774996721,34cyclictest28182-21/usr/sbin/munin10:19:490
479999663,21cyclictest5562-21chrt10:35:093
479999663,21cyclictest19989-21chrt10:05:103
479999662,24cyclictest24698-21chrt10:14:343
479999662,24cyclictest24698-21chrt10:14:343
4784996652,10cyclictest58-21kcompactd010:06:591
4784996634,11cyclictest181rcu_preempt09:59:371
477499666,38cyclictest1174-21unixbench_singl12:15:100
4774996646,11cyclictest0-21swapper/012:19:510
4774996632,11cyclictest181rcu_preempt07:44:490
479999653,29cyclictest28317-21chrt10:19:493
479999653,27cyclictest9443-21chrt09:49:343
479999653,24cyclictest17077-21chrt11:49:343
479999653,24cyclictest17077-21chrt11:49:343
4784996545,11cyclictest0-21swapper/109:39:361
477499653,50cyclictest31266-21/usr/sbin/munin08:19:490
477499653,46cyclictest15107-21latency_hist07:29:380
477499653,42cyclictest19319-21unixbench_multi09:10:100
479999644,24cyclictest13020-21chrt09:54:453
479999644,22cyclictest14879-21chrt10:50:213
479999643,25cyclictest16676-21taskset10:54:423
479999643,24cyclictest14971-21taskset07:29:373
479999643,24cyclictest14971-21taskset07:29:373
479999643,23cyclictest4245-21chrt10:34:083
479999643,23cyclictest4245-21chrt10:34:083
479999643,22cyclictest26292-21chrt08:04:363
479999643,22cyclictest26292-21chrt08:04:363
479999643,21cyclictest10461-21chrt11:37:463
479999642,27cyclictest26618-21chrt09:23:403
479999642,27cyclictest26618-21chrt09:23:403
479999642,26cyclictest23304-21chrt09:17:443
479999642,25cyclictest27255-21chrt12:05:063
479999642,25cyclictest1582-21chrt12:16:083
479999642,24cyclictest20663-21chrt11:54:493
479999642,23cyclictest13955-21chrt11:44:153
4784996448,10cyclictest12391-21ntp_kernel_pll_07:20:021
4784996446,12cyclictest8783-21unin-run08:49:351
477499648,37cyclictest11151-21grep07:15:100
477499644,49cyclictest31017-21idleruntime-cro08:19:340
477499644,26cyclictest649-21/usr/sbin/munin08:26:040
477499643,44cyclictest14406-21unixbench_multi07:25:110
477499643,41cyclictest19886-21latency_hist07:44:370
477499643,41cyclictest11538-21unixbench_multi08:55:100
479999633,26cyclictest7743-21chrt10:39:473
479999633,26cyclictest7743-21chrt10:39:473
479999633,24cyclictest5804-21taskset08:40:043
479999633,23cyclictest6247-21chrt07:04:103
479999633,23cyclictest6247-21chrt07:04:103
479999633,23cyclictest10637-21chrt08:54:463
479999633,22cyclictest22497-21chrt07:50:103
479999633,22cyclictest18310-21chrt07:39:373
479999632,23cyclictest11877-21chrt10:45:223
479999632,22cyclictest21521-21chrt11:02:123
479999632,22cyclictest21521-21chrt11:02:123
479999632,21cyclictest17494-21chrt10:01:173
479999632,20cyclictest20737-21chrt09:13:553
478499639,8cyclictest181rcu_preempt07:14:561
4784996342,7cyclictest181rcu_preempt07:45:531
479999623,24cyclictest602-21chrt11:20:203
479999623,24cyclictest25407-21chrt12:02:063
479999623,21cyclictest7228-21chrt07:04:593
479999623,21cyclictest30248-21chrt12:10:053
479999622,23cyclictest30804-21chrt09:30:003
479999622,22cyclictest10261-21chrt08:53:253
479999622,20cyclictest6254-21chrt09:43:583
4784996226,11cyclictest181rcu_preempt08:29:551
478499622,11cyclictest11153-21cat11:39:351
4774996238,8cyclictest181rcu_preempt08:10:070
131432620,2sleep3451rcuc/309:00:093
131432620,2sleep3451rcuc/309:00:093
479999613,23cyclictest21000-21chrt07:45:493
479999613,22cyclictest19566-21chrt07:43:063
479999612,23cyclictest9942-21chrt07:14:223
479999612,23cyclictest8445-21taskset08:46:083
479999612,23cyclictest27689-21chrt08:08:373
479999612,22cyclictest32349-21chrt08:21:093
479999612,22cyclictest30015-21chrt08:14:573
479999612,21cyclictest8085-21chrt12:27:393
479999612,21cyclictest32356-21chrt10:25:203
479999612,21cyclictest23785-21chrt11:05:123
4784996127,25cyclictest25707-21seq09:21:061
4784996127,25cyclictest25707-21seq09:21:061
479999603,22cyclictest12947-21chrt07:20:583
479999603,20cyclictest24531-21chrt07:59:303
479999602,21cyclictest2591-21chrt09:37:063
479999602,21cyclictest2453-21taskset08:29:513
479999602,20cyclictest11394-21chrt07:16:413
4784996040,14cyclictest7572-21latency_hist10:39:361
4784996040,13cyclictest6500-21mailstats08:41:001
478499602,12cyclictest181rcu_preempt07:35:111
4774996029,11cyclictest181rcu_preempt07:55:090
479999592,21cyclictest28510-21chrt09:25:353
479999592,21cyclictest16140-21chrt07:30:183
479999592,21cyclictest16140-21chrt07:30:183
41592448,21sleep30-21swapper/306:55:213
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional