You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-09 - 23:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Mon Mar 09, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
165389913462,64cyclictest19249-21latency_hist10:45:390
165389911759,52cyclictest277-21dbus-daemon08:35:370
165389911429,26cyclictest0-21swapper/009:10:380
165389911139,9cyclictest0-21swapper/012:25:380
165389911134,20cyclictest25050-21modprobe07:30:350
16267211014,69sleep216278-21munin-run07:05:362
16538991083,36cyclictest5763-21/usr/sbin/munin08:11:120
16538991073,50cyclictest352-21runrttasks10:53:390
165389910714,27cyclictest30902-21taskset07:46:090
165389910641,14cyclictest4851-21mailstats08:06:100
16538991053,46cyclictest352-21runrttasks09:38:030
1618921056,78sleep00-21swapper/007:04:450
16538991043,41cyclictest11879-21fschecks_time11:26:380
16538991042,41cyclictest18394-21switchtime11:36:120
16538991042,41cyclictest18394-21switchtime11:36:120
2024121030,5sleep10-21swapper/112:33:511
16538991033,34cyclictest11276-21apt-config11:25:400
16538991012,42cyclictest32694-21/usr/sbin/munin12:00:550
38482980,8sleep13851-21kernelversion09:26:011
16538999840,10cyclictest0-21swapper/009:00:350
16560999763,28cyclictest10033-21ntp_kernel_pll_09:36:042
16560999553,36cyclictest23540-21diskmemload10:20:512
16538999539,19cyclictest2105-21kworker/u17:2+nfsiod11:12:580
16560999441,45cyclictest23540-21diskmemload10:35:582
16560999433,52cyclictest0-21swapper/211:26:102
16551999463,22cyclictest14124-21apt-key11:30:381
1625129412,57sleep116266-21modprobe07:05:351
16560999217,30cyclictest30512-21sh10:10:472
16560999217,30cyclictest30512-21sh10:10:472
16551999170,14cyclictest22328-21/usr/sbin/munin10:51:031
16538999171,14cyclictest1893-21sh11:10:380
16538999171,14cyclictest1893-21sh11:10:380
1656099903,43cyclictest3157-21unin-run09:25:372
1656099903,43cyclictest3157-21unin-run09:25:372
1653899903,27cyclictest352-21runrttasks08:54:010
16560998935,47cyclictest0-21swapper/211:45:512
1656099893,36cyclictest20321-21awk08:55:352
16560998920,27cyclictest1-21systemd08:20:372
1656099883,44cyclictest7071-21/usr/sbin/munin10:25:452
1656099883,44cyclictest7071-21/usr/sbin/munin10:25:452
1656099873,42cyclictest11663-21latency_hist12:20:392
1656099873,28cyclictest24543-21timerwakeupswit07:26:102
1656099864,41cyclictest8526-21fschecks_time11:20:592
1656099864,33cyclictest6060-21tune2fs08:10:592
1656099864,32cyclictest22517-21if_eth009:00:592
1656099864,32cyclictest22517-21if_eth009:00:592
16560998634,42cyclictest0-21swapper/211:01:092
1656099863,30cyclictest18653-21tune2fs07:10:442
1656099863,30cyclictest18653-21tune2fs07:10:442
1656099863,29cyclictest25400-21latency_hist10:55:392
1656099854,31cyclictest31614-21/usr/sbin/munin11:06:052
1656099854,31cyclictest31614-21/usr/sbin/munin11:06:052
1656099853,33cyclictest5966-21mailstats11:16:092
1656099853,29cyclictest18169-21latency_hist07:10:382
1656099852,31cyclictest12484-21ssh09:40:512
16560998518,22cyclictest21924-21latency_hist09:00:352
16560998510,33cyclictest16966-21seq12:28:032
16560998510,33cyclictest16966-21seq12:28:032
1656099844,37cyclictest2930-21kernelversion08:00:592
1656099844,37cyclictest2930-21kernelversion08:00:592
16560998441,36cyclictest0-21swapper/209:06:142
1656099843,37cyclictest21889-21latency_hist07:20:372
1656099843,37cyclictest21889-21latency_hist07:20:372
1656099843,32cyclictest1542-21kernelversion10:16:012
1656099843,32cyclictest12622-21grep12:21:482
1656099843,28cyclictest298-21in:imuxsock08:40:362
1656099843,28cyclictest298-21in:imuxsock08:40:362
1656099843,27cyclictest18395-21/usr/sbin/munin12:30:562
1656099843,26cyclictest13590-21munin-run08:35:362
16560998432,45cyclictest0-21swapper/212:00:582
16560998429,47cyclictest0-21swapper/211:10:492
1656099842,30cyclictest27819-21sed09:11:112
1656099842,30cyclictest27819-21sed09:11:112
1656099842,30cyclictest1164-21fschecks_count07:55:592
1656099842,30cyclictest1164-21fschecks_count07:55:592
1656099834,37cyclictest27443-21ntp_kernel_err07:36:042
1656099833,37cyclictest9326-21latency_hist09:35:392
1656099833,30cyclictest29999-21cpuspeed09:15:522
1656099833,30cyclictest24727-21fschecks_count10:00:572
1656099833,29cyclictest6117-21latency_hist09:30:382
1656099833,28cyclictest27773-21fschecks_count10:05:582
1656099833,27cyclictest20497-21/usr/sbin/munin11:41:072
1656099832,28cyclictest23440-21modprobe07:25:352
16560998317,24cyclictest15081-21fschecks_time11:31:472
1656099824,36cyclictest352-21runrttasks11:58:022
1656099824,36cyclictest352-21runrttasks11:58:022
1656099824,23cyclictest5970-21/usr/sbin/munin12:11:132
16560998236,40cyclictest0-21swapper/210:46:062
1656099823,31cyclictest3470-21cat12:06:002
1656099823,31cyclictest12139-21ssh10:33:502
1656099823,26cyclictest11475-21timerwakeupswit08:26:082
1656099823,25cyclictest18145-21/usr/sbin/munin11:36:062
1656099823,25cyclictest18145-21/usr/sbin/munin11:36:062
1656099823,24cyclictest25615-21apt-get10:55:492
16560998229,45cyclictest0-21swapper/208:50:362
16560998229,45cyclictest0-21swapper/208:50:362
16560998225,50cyclictest0-21swapper/210:44:572
1656099822,36cyclictest15701-21/usr/sbin/munin08:41:032
1656099822,36cyclictest15701-21/usr/sbin/munin08:41:032
1656099822,33cyclictest26260-21unixbench_singl07:31:122
16551998261,13cyclictest200-21systemd-journal07:07:201
1656099813,35cyclictest16334-21timerandwakeup09:46:102
1656099813,29cyclictest30522-21kernelversion07:46:002
1656099813,29cyclictest22496-21grep09:56:122
1656099813,28cyclictest19293-21switchtime09:51:102
1656099813,28cyclictest19293-21switchtime09:51:102
1656099812,33cyclictest29432-21latency_hist11:55:382
16538998159,16cyclictest21475-21grep07:16:120
16538998159,16cyclictest21475-21grep07:16:120
16538998156,21cyclictest16514-21cyclictest10:32:200
1656099804,34cyclictest352-21runrttasks07:52:172
1656099803,27cyclictest352-21runrttasks07:40:482
1656099803,25cyclictest9011-21/usr/sbin/munin08:20:592
1656099802,20cyclictest4179-21apt-get08:05:482
16538998055,18cyclictest21764-21fschecks_time09:55:570
1655199796,31cyclictest0-21swapper/109:19:351
16538997961,12cyclictest170-21jbd2/mmcblk2p2-810:10:520
16538997961,12cyclictest170-21jbd2/mmcblk2p2-810:10:520
16538997951,22cyclictest21319-21ssh11:41:100
1655199782,56cyclictest13996-21apt-get11:30:501
16538997860,11cyclictest23540-21diskmemload10:00:570
16538997853,18cyclictest15219-21ssh12:25:500
16538997853,18cyclictest15219-21ssh12:25:500
16551997654,14cyclictest5494-21fschecks_time11:15:571
16551997650,19cyclictest29532-21kworker/u17:3-ext4-rsv-conversion12:20:401
1655199762,38cyclictest7119-21modprobe08:15:351
16551997621,23cyclictest8327-21cstates11:20:531
16538997660,10cyclictest29216-21systemd-run11:55:350
16551997560,10cyclictest16514-21cyclictest10:04:231
16551997549,19cyclictest352-21runrttasks08:21:101
16538997559,10cyclictest9872-21rm10:30:380
16538997559,10cyclictest9872-21rm10:30:380
16538997556,13cyclictest352-21runrttasks10:35:590
16538997556,13cyclictest18679-21idleruntime-cro08:50:350
16538997556,13cyclictest18679-21idleruntime-cro08:50:350
16538997552,17cyclictest23540-21diskmemload11:55:580
16538997552,17cyclictest23540-21diskmemload11:55:580
1653899754,37cyclictest22168-21latency_hist10:50:380
16538997525,37cyclictest8823-21latency_hist12:15:380
16551997461,8cyclictest0-21swapper/112:21:451
16551997456,12cyclictest23480-21/usr/sbin/munin11:46:121
16551997410,32cyclictest2031-21sort11:10:381
16551997410,32cyclictest2031-21sort11:10:381
16538997457,11cyclictest23540-21diskmemload11:31:290
16538997455,13cyclictest28847-21rm10:06:520
16538997442,24cyclictest0-21swapper/011:50:380
16551997350,16cyclictest297-21systemd-logind07:50:361
16551997343,20cyclictest23534-21sh09:05:361
16551997343,20cyclictest23534-21sh09:05:361
1655199733,35cyclictest3644-21ssh12:06:061
16538997357,10cyclictest1545-21ssh10:16:010
16551997254,12cyclictest32571-21cpuspeed12:00:511
16551997254,12cyclictest13016-21rm09:41:031
16551997251,14cyclictest6914-21latency_hist10:25:381
16551997248,16cyclictest0-21swapper/107:31:101
1655199723,36cyclictest878-21latency_hist07:55:391
16551997219,26cyclictest2206-21diskmemload09:23:041
16551997219,26cyclictest2206-21diskmemload09:23:041
16538997258,10cyclictest16514-21cyclictest12:35:090
16538997258,10cyclictest16514-21cyclictest09:29:390
16538997253,13cyclictest13131-21ssh09:41:080
16538997243,11cyclictest181rcu_preempt09:47:550
16551997153,11cyclictest31293-21cron11:05:351
16551997148,17cyclictest27985-21latency10:06:021
1655199704,39cyclictest29042-21ntp_kernel_err07:41:031
16551997030,12cyclictest181rcu_preempt09:00:381
1655199702,57cyclictest26204-21ls10:57:101
16538997056,10cyclictest16514-21cyclictest11:20:270
16538997052,13cyclictest18365-21latency_hist07:10:390
16538997052,12cyclictest28812-21ssh09:13:330
16538997052,12cyclictest28812-21ssh09:13:330
16538997050,13cyclictest7481-21ssh09:31:130
16538997045,18cyclictest26112-21timerandwakeup07:31:110
16538997045,12cyclictest181rcu_preempt08:25:480
1653899704,35cyclictest18872-21/usr/sbin/munin09:51:000
1653899704,35cyclictest18872-21/usr/sbin/munin09:51:000
16538997031,17cyclictest181rcu_preempt12:20:380
16551996949,14cyclictest15739-21fschecks_time09:45:571
16551996927,13cyclictest181rcu_preempt08:40:521
16551996927,13cyclictest181rcu_preempt08:40:521
1655199692,31cyclictest30845-21fschecks_time10:11:001
1655199692,31cyclictest30845-21fschecks_time10:11:001
16538996954,11cyclictest16514-21cyclictest09:16:090
16551996847,14cyclictest22202-21sh11:42:501
16551996842,16cyclictest0-21swapper/109:10:381
16551996837,22cyclictest0-21swapper/110:41:001
1655199683,37cyclictest1052-21cstates07:55:541
1655199683,37cyclictest1052-21cstates07:55:541
1655199683,35cyclictest23540-21diskmemload09:30:421
1655199681,38cyclictest0-21swapper/111:50:471
1655199681,29cyclictest18283-21grep08:46:121
1655199681,29cyclictest18283-21grep08:46:121
16538996854,10cyclictest16514-21cyclictest07:12:330
16538996854,10cyclictest16514-21cyclictest07:12:330
1653899684,33cyclictest3131-21cstates12:05:510
1653899683,51cyclictest23437-21cron07:25:350
1653899683,30cyclictest15701-21/usr/sbin/munin08:41:100
1653899683,30cyclictest15701-21/usr/sbin/munin08:41:100
16538996832,11cyclictest181rcu_preempt07:40:580
1653899682,55cyclictest13583-21apt-get08:35:500
1653899682,55cyclictest13583-21apt-get08:35:500
1630426810,35sleep30-21swapper/307:05:373
16574996731,28cyclictest0-21swapper/310:35:563
16574996722,30cyclictest0-21swapper/312:20:553
16551996745,12cyclictest0-21swapper/108:55:351
16538996738,22cyclictest0-21swapper/010:55:500
1653899673,55cyclictest8309-21grep08:16:100
1653899672,54cyclictest31947-21fschecks_count07:50:550
16551996647,13cyclictest6613-21sh12:11:061
16551996647,11cyclictest0-21swapper/108:36:371
16551996647,11cyclictest0-21swapper/108:36:371
16551996640,19cyclictest32070-21sh12:00:201
16551996640,19cyclictest32070-21sh12:00:201
1655199662,45cyclictest12793-21apt-get10:35:501
1655199662,42cyclictest19597-21wc07:11:131
1655199662,42cyclictest19597-21wc07:11:131
16551996619,22cyclictest19780-21sh11:39:261
16551996619,22cyclictest19780-21sh11:39:261
1653899664,31cyclictest26938-21/usr/sbin/munin07:36:120
16538996639,20cyclictest0-21swapper/009:23:320
16538996639,20cyclictest0-21swapper/009:23:320
1653899663,44cyclictest4237-21cstates10:20:520
1655199658,13cyclictest181rcu_preempt10:31:101
16551996545,14cyclictest16279-21sh12:26:121
16551996545,14cyclictest16279-21sh12:26:121
16551996540,18cyclictest0-21swapper/107:40:351
1653899653,33cyclictest2832-21fschecks_time08:00:560
1653899653,33cyclictest2832-21fschecks_time08:00:560
1653899652,52cyclictest28650-21ssh11:00:510
1655199645,42cyclictest29555-21sh09:15:351
1655199645,42cyclictest29555-21sh09:15:351
16551996447,11cyclictest13807-21latency_hist08:35:391
1655199644,44cyclictest22387-21timerandwakeup09:56:111
16551996437,19cyclictest352-21runrttasks07:20:381
16551996437,19cyclictest352-21runrttasks07:20:381
1655199643,42cyclictest25057-21latency_hist07:30:391
16551996345,12cyclictest7413-21uniq10:25:571
16551996345,12cyclictest7413-21uniq10:25:571
16551996344,12cyclictest0-21swapper/110:46:031
16551996334,24cyclictest0-21swapper/111:11:101
16551996324,27cyclictest2802-21fschecks_time08:00:551
16551996324,27cyclictest2802-21fschecks_time08:00:551
16538996339,16cyclictest0-21swapper/009:01:010
16538996339,16cyclictest0-21swapper/009:01:010
1653899633,34cyclictest9038-21cpu08:20:510
16551996244,7cyclictest0-21swapper/108:25:491
16551996238,14cyclictest1813-21diskmemload10:16:091
1655199623,40cyclictest4271-21cstates08:05:541
1653899623,23cyclictest937-21/usr/sbin/munin07:56:100
1653899623,23cyclictest937-21/usr/sbin/munin07:56:100
1655199612,46cyclictest12251-21ssh09:40:371
1657499603,47cyclictest13997-21chrt11:30:353
1655199603,36cyclictest23102-21awk07:21:131
1655199602,38cyclictest18964-21latency09:51:011
1655199602,38cyclictest18964-21latency09:51:011
1657499594,40cyclictest17087-21chrt08:45:353
1657499594,40cyclictest17087-21chrt08:45:353
1657499592,38cyclictest917-21kworker/3:1+events11:40:573
1657499584,40cyclictest4046-21taskset08:05:383
1657499584,40cyclictest4046-21taskset08:05:383
1657499584,37cyclictest4894-21taskset11:15:353
1657499583,40cyclictest7497-21chrt10:25:593
1657499583,40cyclictest7497-21chrt10:25:593
1655199583,33cyclictest8883-21latency_hist08:20:381
1657499573,39cyclictest17594-21taskset11:35:533
1657499573,39cyclictest17594-21taskset11:35:533
1657499573,38cyclictest917-21kworker/3:1+events09:29:323
1657499573,37cyclictest30394-21chrt09:16:013
1657499564,38cyclictest9145-21taskset08:20:533
1657499563,37cyclictest11024-21chrt10:31:103
1657499553,41cyclictest25944-21taskset10:02:093
1657499553,39cyclictest12632-21taskset08:31:013
1657499553,38cyclictest29885-21taskset11:56:003
1657499553,38cyclictest29885-21taskset11:56:003
1657499553,37cyclictest1051-21chrt07:55:543
1657499553,37cyclictest1051-21chrt07:55:543
1657499552,38cyclictest31494-21chrt07:50:353
1657499544,41cyclictest0-21swapper/310:55:503
1657499544,37cyclictest7055-21chrt12:11:123
1657499544,37cyclictest12255-21chrt09:40:373
1657499543,38cyclictest531-21chrt09:20:523
1657499543,38cyclictest531-21chrt09:20:523
1657499543,37cyclictest20324-21chrt08:55:353
1657499543,36cyclictest7663-21chrt09:31:343
1657499543,35cyclictest30618-21chrt10:10:523
1657499543,35cyclictest30618-21chrt10:10:523
1657499543,33cyclictest6391-21chrt08:11:093
1657499534,35cyclictest4292-21chrt08:05:543
1657499534,35cyclictest28607-21chrt07:40:523
1657499534,34cyclictest22631-21taskset07:21:033
1657499533,39cyclictest14553-21chrt11:30:473
1657499533,36cyclictest20571-21taskset10:46:323
1657499533,35cyclictest20733-21taskset07:15:573
1657499533,35cyclictest20733-21taskset07:15:573
1657499533,34cyclictest22969-21chrt09:01:103
1657499533,34cyclictest22969-21chrt09:01:103
16574995323,23cyclictest0-21swapper/308:30:363
16574995311,28cyclictest0-21swapper/308:35:503
16574995311,28cyclictest0-21swapper/308:35:503
1657499524,36cyclictest4409-21chrt10:20:573
1657499523,37cyclictest21022-21taskset09:55:163
1657499523,37cyclictest21022-21taskset09:55:163
1657499523,36cyclictest401-21chrt12:00:583
1657499523,34cyclictest18022-21chrt10:42:473
1657499522,39cyclictest18820-21chrt12:31:063
1657499515,34cyclictest27245-21chrt09:10:593
1657499515,34cyclictest27245-21chrt09:10:593
1657499515,31cyclictest21193-21chrt08:56:083
1657499514,34cyclictest16442-21chrt12:26:363
1657499514,34cyclictest16442-21chrt12:26:363
1657499512,35cyclictest21752-21taskset09:55:573
1657499505,34cyclictest8033-21taskset11:20:383
1657499503,37cyclictest9790-21chrt12:16:103
1657499503,36cyclictest29700-21chrt11:01:123
1657499503,35cyclictest32005-21chrt07:50:563
1657499503,35cyclictest26124-21taskset11:50:283
1657499503,34cyclictest8966-21taskset11:21:103
1657499503,34cyclictest1550-21chrt11:09:473
1657499503,34cyclictest1550-21chrt11:09:473
1657499494,29cyclictest25288-21chrt07:30:393
1657499493,35cyclictest917-21kworker/3:1+events09:43:263
1657499493,33cyclictest7946-21chrt08:16:033
1657499493,32cyclictest17490-21chrt09:48:483
1657499492,34cyclictest2614-21chrt10:17:203
1657499492,32cyclictest17400-21chrt07:07:183
1657499483,35cyclictest19503-21chrt07:11:113
1657499483,35cyclictest19503-21chrt07:11:113
1657499483,34cyclictest28006-21chrt10:06:023
1657499483,32cyclictest24110-21chrt10:53:013
1657499483,29cyclictest25666-21chrt07:30:593
1657499474,29cyclictest28528-21chrt07:40:393
1657499472,32cyclictest18746-21chrt08:50:373
1657499472,32cyclictest18746-21chrt08:50:373
1657499464,32cyclictest27115-21taskset11:51:053
1657499452,30cyclictest3030-21taskset12:05:493
1657499443,27cyclictest25157-21chrt09:06:453
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional