You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-05 - 20:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Aug 05, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34439911847,19cyclictest0-21swapper/210:10:542
314321115,15sleep00-21swapper/006:53:480
34439910849,15cyclictest9588-21gpgv11:30:352
34439910742,11cyclictest0-21swapper/211:25:352
34439910742,11cyclictest0-21swapper/211:25:352
34289910726,50cyclictest0-21swapper/008:57:580
3443999575,14cyclictest352-21runrttasks11:05:322
3428999040,22cyclictest6267-21rm09:40:340
3443998510,10cyclictest0-21swapper/209:51:032
3438998565,10cyclictest8379-21/usr/sbin/munin10:36:061
3428998555,21cyclictest4124-21latency_hist07:00:360
3428998555,21cyclictest4124-21latency_hist07:00:360
3443998455,20cyclictest28343-21kernelversion12:00:592
3428998459,16cyclictest19849-21kworker/u19:1-ext4-rsv-conversion09:51:020
3428998453,21cyclictest10513-21latency_hist10:40:350
3438998359,14cyclictest10744-21cpuspeed10:40:491
3438998256,19cyclictest5253-21latency_hist07:05:361
3438998243,30cyclictest405-21sshd11:15:271
3428998260,15cyclictest58-21kcompactd011:55:340
3428998257,17cyclictest4593-21sh12:15:520
344399813,68cyclictest10054-21ssh11:30:572
3443998128,31cyclictest7774-21latency_hist07:25:362
3438998149,22cyclictest19400-21diskmemload11:36:061
3438998149,22cyclictest19400-21diskmemload11:36:061
342899812,33cyclictest31830-21timerandwakeup12:06:070
327028111,45sleep13284-21modprobe06:55:321
3443998055,18cyclictest3416-21cyclictest10:21:592
3443998055,18cyclictest3416-21cyclictest10:21:592
3438998019,8cyclictest181rcu_preempt10:20:321
3428998061,13cyclictest2374-21systemd-journal12:05:320
3438997961,9cyclictest6620-21ssh12:19:221
3438997956,14cyclictest21893-21kworker/u17:2-nfsiod11:08:161
3438997956,14cyclictest21893-21kworker/u17:2-nfsiod11:08:161
3438997952,18cyclictest23551-21latency_hist09:05:351
342899796,21cyclictest0-21swapper/009:41:080
342899796,21cyclictest0-21swapper/009:41:080
3428997960,10cyclictest0-21swapper/010:47:080
3443997863,9cyclictest19253-21kworker/u17:1-nfsiod10:10:322
3443997857,15cyclictest298-21in:imuxsock09:47:172
3443997842,10cyclictest181rcu_preempt12:13:042
3438997853,18cyclictest14223-21latency_hist08:15:351
3438997853,16cyclictest0-21swapper/108:45:341
3438997848,20cyclictest16529-21sh09:56:041
3438997848,20cyclictest16529-21sh09:56:041
3428997854,14cyclictest9833-21ssh11:30:360
3443997754,16cyclictest15105-21ssh10:46:122
3443997750,19cyclictest15590-21munin-plugin-st11:40:342
3443997750,19cyclictest15590-21munin-plugin-st11:40:342
3438997756,13cyclictest0-21swapper/110:01:571
3438997752,16cyclictest277-21dbus-daemon09:20:331
3443997650,19cyclictest19400-21diskmemload11:54:492
3443997640,9cyclictest181rcu_preempt10:05:332
3438997654,15cyclictest3416-21cyclictest12:11:081
3428997640,31cyclictest14139-21kworker/u19:108:20:350
344399752,32cyclictest15908-21ssh11:40:432
3443997523,20cyclictest31184-21ssh11:11:092
343899754,28cyclictest10087-21sendmail07:45:321
3428997554,14cyclictest3416-21cyclictest10:28:460
3443997427,13cyclictest181rcu_preempt12:20:352
3438997448,19cyclictest544-21cron08:55:331
3438997448,19cyclictest544-21cron08:55:331
3428997448,18cyclictest24381-21ssh11:00:530
3428997419,30cyclictest0-21swapper/010:58:010
3428997417,28cyclictest3037-21sh12:12:350
3428997417,25cyclictest17355-21rm11:42:090
344399735,44cyclictest27680-21latency_hist12:00:342
3443997354,13cyclictest9140-21munin-run09:45:322
3443997354,13cyclictest9140-21munin-run09:45:322
3443997352,15cyclictest4182-21latency_hist07:00:362
3443997352,15cyclictest4182-21latency_hist07:00:362
343899732,15cyclictest16190-21fschecks_time11:40:531
3438997319,25cyclictest3059-21sh09:35:211
3438997319,25cyclictest3059-21sh09:35:211
3428997351,15cyclictest3416-21cyclictest10:22:550
3428997351,15cyclictest3416-21cyclictest10:22:550
3428997337,28cyclictest31848-21kworker/u17:3+nfsiod09:34:410
3428997337,28cyclictest31848-21kworker/u17:3+nfsiod09:34:410
342899733,36cyclictest352-21runrttasks09:47:580
3428997333,30cyclictest0-21swapper/012:20:570
3443997249,13cyclictest0-21swapper/211:05:492
3443997249,13cyclictest0-21swapper/211:05:492
3443997247,7cyclictest181rcu_preempt12:20:492
3443997233,12cyclictest181rcu_preempt09:09:382
344399722,20cyclictest16631-21latency_hist08:35:322
3438997254,10cyclictest23423-21rm11:52:171
3438997250,16cyclictest21455-21sh10:55:541
3438997249,15cyclictest3416-21cyclictest12:05:361
3438997247,16cyclictest297-21systemd-logind08:35:331
343899722,33cyclictest5660-21cron07:10:321
3438997218,21cyclictest719-21sh09:29:271
3438997215,16cyclictest31-21ksoftirqd/111:01:041
3438997212,23cyclictest30180-21seq09:21:451
3428997255,11cyclictest11396-21systemd-run07:55:350
3428997245,17cyclictest0-21swapper/008:10:340
342899723,36cyclictest1091-21fschecks_time11:15:550
342899722,24cyclictest137972sshd08:11:310
344399714,41cyclictest31537-21ntp_states12:06:032
3443997142,22cyclictest19849-21kworker/u19:1+nfsiod09:30:202
3443997142,12cyclictest181rcu_preempt10:56:082
3443997141,12cyclictest28372-21fschecks_count10:15:552
344399711,38cyclictest19313-21unixbench_singl10:51:102
3438997149,12cyclictest0-21swapper/107:15:361
3438997145,17cyclictest23197-21unixbench_singl10:06:091
3438997112,20cyclictest12881-21seq09:50:401
342899712,26cyclictest23062-21rm09:04:290
3443997056,9cyclictest3416-21cyclictest11:18:562
3443997046,16cyclictest11684-21unixbench_multi10:41:092
344399702,47cyclictest5042-21idleruntime-cro07:05:322
3438997051,10cyclictest0-21swapper/111:56:071
3438997049,11cyclictest0-21swapper/111:25:551
3438997012,22cyclictest5383-21ssh09:38:271
342899701,29cyclictest14032-21ssh11:36:090
342899701,29cyclictest14032-21ssh11:36:090
3438996952,11cyclictest4806-21sh10:30:501
3438996951,12cyclictest1-21systemd10:30:331
342899697,36cyclictest22564-21chrt10:05:570
3428996942,19cyclictest27550-21fschecks_time11:05:540
3428996942,19cyclictest27550-21fschecks_time11:05:540
342899693,47cyclictest11686-21unixbench_multi10:41:090
342899691,35cyclictest27827-21idleruntime-cro10:15:320
184492690,7sleep30-21swapper/311:45:073
3443996851,10cyclictest12552-21kworker/u17:4-ext4-rsv-conversion08:05:362
3443996835,8cyclictest1318-21kworker/u17:4-rpciod10:38:562
344399683,46cyclictest18998-21ssh11:45:502
344399683,27cyclictest5678-21idleruntime-cro07:10:322
3438996850,12cyclictest10976-21mailstats11:31:451
3438996839,20cyclictest25364-21fschecks_count10:10:531
343899683,36cyclictest12652-21latency_hist09:50:351
3428996814,36cyclictest0-21swapper/009:11:290
3428996814,36cyclictest0-21swapper/009:11:290
3443996745,12cyclictest0-21swapper/210:25:572
3443996735,23cyclictest0-21swapper/208:20:352
344399673,41cyclictest31586-21modprobe09:25:322
3438996748,12cyclictest3416-21cyclictest12:25:051
3438996746,13cyclictest21612-21cron11:50:311
343899672,42cyclictest4200-21latency_hist07:00:371
343899672,42cyclictest4200-21latency_hist07:00:371
3428996750,10cyclictest3834-21ssh11:20:490
3428996750,10cyclictest3834-21ssh11:20:490
3428996749,13cyclictest30562-21sh09:22:500
3428996747,12cyclictest31118-21ssh11:11:090
3428996746,12cyclictest0-21swapper/011:31:480
342899674,52cyclictest17404-21runrttasks09:57:170
342899674,52cyclictest17404-21runrttasks09:57:170
3428996738,20cyclictest18259-21latency_hist08:45:350
342899673,53cyclictest6140-21ssh10:32:100
342899673,50cyclictest19184-21fschecks_count11:45:550
345199663,39cyclictest0-21swapper/309:50:503
344399669,35cyclictest28909-21kworker/u18:3+flush-179:007:56:022
344399669,35cyclictest28909-21kworker/u18:3+flush-179:007:56:022
344399664,40cyclictest352-21runrttasks07:15:272
3443996643,15cyclictest39-21ksoftirqd/207:31:482
3443996643,15cyclictest39-21ksoftirqd/207:31:482
3443996640,13cyclictest0-21swapper/208:30:352
3443996640,13cyclictest0-21swapper/208:30:352
3443996640,10cyclictest181rcu_preempt09:33:152
3443996640,10cyclictest181rcu_preempt09:33:152
344399663,37cyclictest17484-21modprobe08:40:322
344399663,20cyclictest6926-21munin-run07:20:332
344399662,45cyclictest6232-21latency_hist09:40:342
3438996650,10cyclictest3416-21cyclictest10:22:041
3438996650,10cyclictest3416-21cyclictest10:22:041
3438996642,17cyclictest19400-21diskmemload09:41:021
3438996642,17cyclictest19400-21diskmemload09:41:021
3438996641,13cyclictest0-21swapper/107:20:361
3438996628,12cyclictest181rcu_preempt09:10:351
3428996625,31cyclictest0-21swapper/009:09:550
3443996549,10cyclictest20658-21runrttasks08:58:242
3443996549,10cyclictest1-21systemd07:55:332
3443996545,12cyclictest5166-21ssh10:30:582
3443996544,10cyclictest0-21swapper/209:55:422
3443996544,10cyclictest0-21swapper/209:55:422
344399654,35cyclictest19524-21ssh08:55:352
344399654,35cyclictest19524-21ssh08:55:352
3443996536,20cyclictest544-21cron08:45:322
344399653,37cyclictest9562-21latency_hist07:40:352
344399653,37cyclictest9562-21latency_hist07:40:352
343899654,13cyclictest181rcu_preempt09:15:321
343899654,13cyclictest181rcu_preempt09:15:321
343899653,35cyclictest19400-21diskmemload10:47:561
3438996510,24cyclictest9103-21seq07:36:121
3438996510,24cyclictest9103-21seq07:36:121
342899654,43cyclictest10251-21latency_hist07:45:350
342899653,31cyclictest16628-21latency_hist08:35:350
3428996532,27cyclictest19676-21snmpd07:03:150
342899652,35cyclictest20024-21ntpq10:01:570
3428996520,36cyclictest21004-21latency_hist10:55:340
342899651,21cyclictest28409-21rm09:17:250
3438996448,8cyclictest0-21swapper/111:25:321
3438996448,8cyclictest0-21swapper/111:25:321
343899643,40cyclictest17608-21latency_hist08:40:351
3438996426,31cyclictest18673-21tr10:50:581
3428996448,10cyclictest32094-21ssh09:26:230
3443996344,13cyclictest0-21swapper/208:06:312
344399633,39cyclictest352-21runrttasks08:45:422
344399633,34cyclictest352-21runrttasks08:23:332
344399632,43cyclictest352-21runrttasks09:18:012
343899633,40cyclictest755-21/usr/sbin/munin11:16:051
3438996319,32cyclictest11515-21cut07:55:351
342899634,38cyclictest28746-21ntp_states10:16:040
342899633,46cyclictest17499-21awk08:40:320
342899633,35cyclictest352-21runrttasks08:47:020
3428996333,22cyclictest0-21swapper/011:55:540
345199624,37cyclictest22530-21chrt10:05:563
3443996244,12cyclictest19676-21snmpd09:15:332
3443996244,12cyclictest19676-21snmpd09:15:332
3443996243,8cyclictest0-21swapper/206:55:372
3438996247,9cyclictest3416-21cyclictest12:07:401
3438996245,12cyclictest19400-21diskmemload08:57:351
342899625,29cyclictest19395-21modprobe08:55:320
342899625,29cyclictest19395-21modprobe08:55:320
3428996239,15cyclictest300-21rs:main0
3428996239,15cyclictest300-21rs:main0
342899621,23cyclictest0-21swapper/007:59:570
342899621,23cyclictest0-21swapper/007:59:570
344399614,37cyclictest352-21runrttasks07:41:322
3443996135,10cyclictest21682-21modprobe09:00:362
3438996142,11cyclictest0-21swapper/107:50:321
3438996139,13cyclictest0-21swapper/107:35:351
3438996139,13cyclictest0-21swapper/107:35:351
3438996137,10cyclictest0-21swapper/108:30:341
3438996137,10cyclictest0-21swapper/108:30:341
343899612,40cyclictest18928-21latency_hist08:50:351
342899613,40cyclictest10717-21latency_hist07:50:350
342899613,24cyclictest15362-21sendmail08:25:320
344399603,31cyclictest352-21runrttasks08:14:132
344399602,37cyclictest352-21runrttasks07:46:222
3438996038,11cyclictest0-21swapper/108:01:181
3438996038,11cyclictest0-21swapper/108:01:181
3438996037,11cyclictest0-21swapper/108:10:361
3438996034,13cyclictest0-21swapper/108:05:351
3438996033,21cyclictest15448-21latency_hist08:25:351
342899602,31cyclictest6910-21modprobe07:20:320
342899601,24cyclictest0-21swapper/007:23:360
31112606,37sleep30-21swapper/306:53:223
3451995931,19cyclictest1348-21chrt09:30:363
3451995919,26cyclictest0-21swapper/311:30:593
344399593,29cyclictest352-21runrttasks07:28:202
344399593,29cyclictest352-21runrttasks07:28:202
3438995936,13cyclictest0-21swapper/108:20:351
342899592,43cyclictest12916-21latency_hist08:05:340
342899591,21cyclictest5893-21latency_hist07:10:360
137992590,5sleep30-21swapper/308:11:313
345199583,36cyclictest15382-21taskset08:25:333
3428995830,19cyclictest6292-21modprobe07:15:320
345199574,36cyclictest7109-21chrt07:20:363
345199574,36cyclictest7025-21chrt11:25:533
345199573,40cyclictest21756-21taskset10:55:583
345199573,40cyclictest0-21swapper/309:46:013
345199573,37cyclictest16681-21taskset08:35:333
343899573,40cyclictest7702-21latency_hist07:25:351
3428995734,19cyclictest3416-21cyclictest08:30:340
3428995734,19cyclictest3416-21cyclictest08:30:340
342899573,40cyclictest352-21runrttasks07:37:160
342899573,40cyclictest352-21runrttasks07:37:160
345199563,39cyclictest30464-21taskset09:22:333
342899562,42cyclictest8204-21awk07:30:330
342899562,42cyclictest8204-21awk07:30:330
345199553,38cyclictest18934-21chrt08:50:353
345199553,38cyclictest18200-21chrt10:50:393
345199552,40cyclictest27091-21taskset11:05:353
345199552,36cyclictest13530-21chrt08:10:343
3438995536,13cyclictest8221-21sh07:30:341
3438995536,13cyclictest8221-21sh07:30:341
345199543,38cyclictest5745-21chrt10:31:103
345199543,34cyclictest7605-21chrt12:20:553
345199534,29cyclictest0-21swapper/310:00:533
345199533,38cyclictest21691-21chrt11:50:343
345199533,35cyclictest4597-21chrt12:15:523
345199533,35cyclictest11825-21chrt07:55:433
345199533,35cyclictest11825-21chrt07:55:433
345199532,37cyclictest25166-21chrt09:09:403
345199524,34cyclictest2358-21taskset09:33:233
345199524,34cyclictest2358-21taskset09:33:233
345199523,39cyclictest17075-21chrt10:48:123
345199514,34cyclictest3923-21chrt11:20:503
345199514,34cyclictest3923-21chrt11:20:503
345199514,34cyclictest11462-21chrt10:41:073
345199513,38cyclictest8908-21chrt07:35:343
345199513,38cyclictest8908-21chrt07:35:343
345199513,35cyclictest23536-21taskset09:05:353
345199513,34cyclictest29278-21chrt10:16:183
345199513,31cyclictest8388-21taskset07:30:363
345199513,31cyclictest8388-21taskset07:30:363
345199512,36cyclictest19791-21chrt08:55:583
345199512,34cyclictest24889-21chrt11:55:413
3451995121,11cyclictest0-21swapper/309:45:323
3451995121,11cyclictest0-21swapper/309:45:323
345199503,38cyclictest29625-21chrt09:20:343
345199503,33cyclictest13273-21taskset11:35:543
345199503,33cyclictest13273-21taskset11:35:543
345199503,31cyclictest4990-21chrt09:37:213
345199502,31cyclictest21900-21taskset11:50:423
345199495,32cyclictest25941-21chrt09:11:103
345199495,32cyclictest25941-21chrt09:11:103
345199493,37cyclictest4011-21chrt10:29:363
345199493,33cyclictest11478-21chrt07:55:353
345199493,32cyclictest31919-21taskset10:21:093
345199493,32cyclictest31919-21taskset10:21:093
345199493,32cyclictest25951-21taskset10:11:073
345199492,38cyclictest17856-21chrt09:58:333
345199492,38cyclictest17856-21chrt09:58:333
345199492,32cyclictest30648-21chrt11:10:583
345199484,34cyclictest27774-21chrt11:05:593
345199484,34cyclictest27774-21chrt11:05:593
345199482,32cyclictest7692-21chrt10:35:483
345199463,35cyclictest917-21kworker/3:1+events11:15:413
345199463,30cyclictest27854-21chrt12:00:403
345199462,30cyclictest1584-21chrt12:10:493
345199454,27cyclictest31250-21chrt12:05:553
345199454,26cyclictest19437-21chrt08:55:333
345199454,26cyclictest19437-21chrt08:55:333
345199453,31cyclictest15761-21taskset08:27:273
345199453,31cyclictest15761-21taskset08:27:273
345199443,30cyclictest5857-21chrt07:10:363
345199443,27cyclictest12857-21chrt08:05:323
345199432,30cyclictest14793-21chrt08:20:353
3451994313,22cyclictest0-21swapper/308:35:463
345199422,25cyclictest10174-21chrt07:45:343
3451994212,15cyclictest0-21swapper/307:00:363
3451994212,15cyclictest0-21swapper/307:00:363
345199403,23cyclictest10452-21chrt07:47:083
345199402,27cyclictest6256-21taskset07:15:093
345199402,26cyclictest4303-21taskset07:00:393
3451993912,14cyclictest0-21swapper/308:45:323
345199383,25cyclictest9183-21taskset07:37:163
345199383,25cyclictest9183-21taskset07:37:163
345199372,26cyclictest7198-21taskset07:21:053
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional