You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-24 - 20:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackbslot7.osadl.org (updated Sun May 24, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
100379911725,13cyclictest0-21swapper/007:00:350
100379911448,59cyclictest32118-21acpi08:05:420
100379911445,58cyclictest0-21swapper/007:25:340
100509910551,47cyclictest8921-21timerandwakeup12:21:062
100379910553,46cyclictest5192-21ssh09:33:340
100379910538,60cyclictest0-21swapper/011:35:540
10037991053,41cyclictest22052-21fschecks_count10:55:530
100379910438,59cyclictest10211-21/usr/sbin/munin07:00:460
100379910433,8cyclictest0-21swapper/011:55:590
100379910426,8cyclictest0-21swapper/011:45:340
10037991034,45cyclictest27040-21/usr/sbin/munin07:50:580
100379910336,8cyclictest0-21swapper/007:56:070
100379910328,11cyclictest0-21swapper/012:11:070
295421020,5sleep22921-21ssh12:11:062
100379910235,8cyclictest0-21swapper/011:11:080
10037991023,34cyclictest23965-21fschecks_count09:10:530
10037991023,34cyclictest23965-21fschecks_count09:10:530
100379910230,64cyclictest0-21swapper/010:15:140
977521016,16sleep10-21swapper/106:58:581
100379910137,54cyclictest0-21swapper/010:45:520
10037991013,33cyclictest11175-21/usr/sbin/munin08:40:540
100379910126,11cyclictest0-21swapper/012:25:530
100379910120,19cyclictest0-21swapper/010:35:470
100509910042,9cyclictest0-21swapper/210:31:062
10037991004,33cyclictest3868-21acpi10:25:410
10037991004,33cyclictest3868-21acpi10:25:410
10037991003,33cyclictest10900-21latency_hist12:25:340
10037991003,32cyclictest24780-21/usr/sbin/munin11:01:040
1005099996,40cyclictest24352-21/usr/sbin/munin10:05:552
1005099993,36cyclictest24071-21fschecks_time07:40:542
1004199993,65cyclictest32121-21apt-get08:05:531
1003799994,13cyclictest0-21swapper/011:16:160
10037999934,57cyclictest0-21swapper/010:30:400
1003799993,35cyclictest352-21runrttasks08:35:520
1003799993,32cyclictest6452-21seq12:17:040
1003799993,30cyclictest19746-21grep09:57:040
10050999837,12cyclictest0-21swapper/210:40:532
10050999834,17cyclictest0-21swapper/210:36:082
1005099981,47cyclictest30489-21fschecks_count08:00:532
1003799984,33cyclictest24101-21fschecks_time07:40:550
10037999839,52cyclictest13142-21fschecks_time10:40:530
1003799983,36cyclictest352-21runrttasks11:33:540
1003799983,36cyclictest352-21runrttasks11:33:540
1003799983,36cyclictest20682-21/usr/sbin/munin09:06:050
1003799983,29cyclictest18136-21latency_hist09:55:340
10037999831,61cyclictest0-21swapper/009:41:070
10037999830,8cyclictest0-21swapper/008:15:430
10037999830,8cyclictest0-21swapper/008:15:430
1003799982,42cyclictest16491-21grep07:16:050
1003799982,29cyclictest6516-21grep09:35:530
1003799982,29cyclictest6516-21grep09:35:530
10050999742,13cyclictest17402-21diskmemload12:04:492
10050999736,13cyclictest0-21swapper/212:20:332
10037999740,51cyclictest16900-21timerwakeupswit08:56:070
1003799973,38cyclictest26902-21taskset09:15:520
1003799973,36cyclictest7746-21latency_hist08:30:330
1003799973,24cyclictest29363-21taskset11:07:250
1003799972,37cyclictest352-21runrttasks10:05:440
1003799972,36cyclictest352-21runrttasks09:26:270
1005099964,39cyclictest352-21runrttasks11:22:052
1005099964,39cyclictest352-21runrttasks11:22:052
1005099963,39cyclictest4101-21grep10:25:522
1005099963,39cyclictest4101-21grep10:25:522
1003799964,34cyclictest28499-21apt-get12:00:480
1003799963,37cyclictest22440-21grep07:35:520
1003799963,34cyclictest8504-21taskset11:26:220
1003799963,31cyclictest19383-21sh11:45:480
1003799963,31cyclictest19383-21sh11:45:480
10037999632,7cyclictest0-21swapper/007:11:590
10037999627,9cyclictest0-21swapper/009:24:550
1003799962,36cyclictest8331-21sed08:30:560
1003799962,20cyclictest20609-21sshd07:30:420
1005099954,34cyclictest12168-21/usr/sbin/munin09:45:592
1005099952,38cyclictest25702-21timerandwakeup11:01:072
10037999540,48cyclictest0-21swapper/008:20:450
1003799953,33cyclictest352-21runrttasks12:07:200
1003799953,32cyclictest352-21runrttasks08:50:510
1003799953,32cyclictest352-21runrttasks08:50:510
1003799953,32cyclictest21663-21fschecks_time10:00:520
1003799953,29cyclictest12252-21/usr/sbin/munin07:05:570
10037999524,21cyclictest20634-21sh10:53:040
1003799952,36cyclictest22706-21chrt11:50:580
10037999520,11cyclictest0-21swapper/009:49:040
10050999437,11cyclictest0-21swapper/208:55:562
1003799944,35cyclictest13647-21timerwakeupswit08:46:080
1003799943,33cyclictest1345-21grep10:20:560
1003799942,36cyclictest25439-21cpu07:45:480
996429313,44sleep20-21swapper/207:00:342
10050999365,22cyclictest1-21systemd07:24:572
10041999374,11cyclictest20895-21ssh09:05:511
1003799934,32cyclictest17695-21/usr/sbin/munin09:00:580
10037999337,51cyclictest10028-21cyclictest10:19:480
10037999337,51cyclictest10028-21cyclictest10:19:480
1003799933,33cyclictest4598-21fschecks_count11:20:520
1003799933,33cyclictest4598-21fschecks_count11:20:520
10037999329,7cyclictest0-21swapper/008:11:070
10037999329,7cyclictest0-21swapper/008:11:070
1005099924,33cyclictest352-21runrttasks10:59:272
1005099922,31cyclictest352-21runrttasks11:19:112
1003799923,35cyclictest30371-21cstates08:00:480
1005099915,34cyclictest352-21runrttasks11:46:222
1005099915,34cyclictest352-21runrttasks11:46:222
1005099914,37cyclictest3974-21ls08:17:062
1005099914,37cyclictest3974-21ls08:17:062
1005099914,36cyclictest28401-21unixbench_multi10:11:082
10050999131,15cyclictest0-21swapper/207:34:492
1005099904,34cyclictest26958-21fschecks_count09:15:532
1005099903,37cyclictest27778-21/usr/sbin/munin11:06:082
1003799902,31cyclictest19246-21fschecks_time07:25:540
1003799902,31cyclictest19246-21fschecks_time07:25:540
10041998865,15cyclictest21960-21runrttasks11:50:301
10041998865,15cyclictest21960-21runrttasks11:50:301
1005099874,35cyclictest22407-21fschecks_count07:35:522
1005099873,37cyclictest15024-21processes08:51:052
1005099873,37cyclictest15024-21processes08:51:052
1005099864,34cyclictest26079-21cut07:46:052
10050998439,17cyclictest2949-21kworker/u18:2-events_unbound07:11:522
1005099843,37cyclictest12850-21wc07:06:062
10041998267,10cyclictest10028-21cyclictest12:01:481
10041998255,18cyclictest17402-21diskmemload09:55:361
10041998215,58cyclictest18438-21sh09:55:461
10041998161,13cyclictest1-21systemd09:26:561
10050998056,16cyclictest1-21systemd07:15:572
10041998057,17cyclictest3090-21unixbench_singl12:11:081
10050997956,15cyclictest373-21lldpd12:26:522
10041997959,12cyclictest19676-21snmpd07:30:561
10041997952,18cyclictest2374-21systemd-journal09:35:311
10041997911,47cyclictest20327-21idleruntime-cro07:30:311
10041997911,47cyclictest20327-21idleruntime-cro07:30:311
10041997863,11cyclictest10028-21cyclictest12:17:271
10041997826,9cyclictest301ktimers/109:01:041
10050997756,15cyclictest298-21in:imuxsock08:10:312
10050997753,15cyclictest2811-21apt-key08:15:332
10050997753,15cyclictest2811-21apt-key08:15:332
10041997753,10cyclictest181rcu_preempt07:20:561
10041997750,18cyclictest352-21runrttasks09:15:551
10041997750,15cyclictest0-21swapper/112:21:051
1005499768,33cyclictest0-21swapper/312:00:523
10050997647,20cyclictest17402-21diskmemload09:55:062
10041997648,20cyclictest27525-21kworker/u19:2+events_unbound12:00:301
1004199763,54cyclictest1-21systemd08:35:321
10041997559,10cyclictest17402-21diskmemload11:00:471
10041997558,10cyclictest10028-21cyclictest10:26:171
10041997558,10cyclictest10028-21cyclictest10:26:171
10041997549,19cyclictest19917-21kworker/u19:3+events_unbound10:50:311
10041997515,35cyclictest3158-21apt-get08:16:041
10041997515,35cyclictest3158-21apt-get08:16:041
10050997456,13cyclictest27071-21cpu07:50:482
10050997456,13cyclictest10028-21cyclictest11:58:192
1004199749,47cyclictest10926-21cron08:40:311
10041997454,14cyclictest24134-21kernelversion09:10:571
10041997454,14cyclictest24134-21kernelversion09:10:571
10050997352,15cyclictest6347-21cpu08:25:472
10050997347,20cyclictest12976-21fschecks_count08:45:542
10041997350,12cyclictest0-21swapper/109:36:071
10041997350,12cyclictest0-21swapper/109:36:071
1004199733,48cyclictest13621-21fschecks_time11:35:531
1004199733,37cyclictest14145-21apt-get07:10:461
1004199728,44cyclictest30484-21sendmail11:10:311
10041997256,10cyclictest31745-21systemd08:05:321
10041997254,12cyclictest0-21swapper/108:41:061
10041997249,17cyclictest14860-21idleruntime-cro09:50:311
10041997246,16cyclictest0-21swapper/108:21:021
1004199723,34cyclictest12772-21latency_hist10:40:351
10041997229,31cyclictest21837-21cut10:00:561
10041997149,12cyclictest0-21swapper/109:00:321
10041997147,13cyclictest0-21swapper/112:25:461
10041997144,17cyclictest352-21runrttasks10:57:351
123032700,7sleep30-21swapper/310:39:533
10050997052,14cyclictest10028-21cyclictest11:30:582
10050997052,14cyclictest10028-21cyclictest11:30:582
1005099703,52cyclictest20707-21diskmemload10:53:172
10041997044,17cyclictest1653-21sendmail_mailtr10:21:051
10041997026,33cyclictest9617-21latency_hist10:35:321
10041997012,41cyclictest21514-21munin-plugin-st10:55:301
10050996951,13cyclictest17402-21diskmemload12:10:332
10050996947,14cyclictest15004-21kworker/u17:0-rpciod11:50:562
10050996943,20cyclictest18031-21sh10:49:142
1005099692,48cyclictest11060-21timerwakeupswit07:01:052
88292689,31sleep30-21swapper/306:55:593
10054996819,44cyclictest0-21swapper/309:56:273
10050996846,15cyclictest6597-21sh09:35:542
10050996846,15cyclictest6597-21sh09:35:542
10050996815,28cyclictest5352-21grep08:21:022
10041996823,9cyclictest301ktimers/110:06:561
10050996746,11cyclictest0-21swapper/207:55:532
10050996741,20cyclictest17402-21diskmemload11:26:052
1005099673,46cyclictest18503-21mailstats09:01:052
1005099673,46cyclictest1091-21timerandwakeup09:26:062
1005099672,48cyclictest26443-21latency_hist09:15:332
1005099672,48cyclictest26443-21latency_hist09:15:332
10041996748,13cyclictest11885-21idleruntime-cro09:45:301
10041996743,13cyclictest0-21swapper/111:25:311
10041996743,13cyclictest0-21swapper/111:25:311
1004199672,27cyclictest10068-21ssh11:30:321
10050996641,15cyclictest0-21swapper/209:21:062
1005099663,48cyclictest11385-21fschecks_count08:40:522
1005099663,45cyclictest19617-21timerandwakeup09:57:022
1005099663,43cyclictest3709-21latency09:30:572
1005099663,43cyclictest30826-21sshd10:15:572
1005099663,43cyclictest30826-21sshd10:15:572
1005099663,42cyclictest1339-21latency10:20:562
10050996622,31cyclictest8047-21cat08:30:472
10041996648,12cyclictest1-21systemd11:15:321
1004199664,45cyclictest352-21runrttasks08:00:341
1004199664,44cyclictest23553-21sh07:40:311
10041996641,14cyclictest0-21swapper/111:30:521
10041996641,14cyclictest0-21swapper/111:30:521
10041996639,18cyclictest0-21swapper/111:16:031
1004199663,46cyclictest13615-21cron07:10:311
1004199663,46cyclictest11570-21idleruntime-cro07:05:311
1004199663,42cyclictest352-21runrttasks08:28:001
1004199663,33cyclictest16346-21proc_pri07:16:031
10041996621,10cyclictest301ktimers/110:15:311
10050996539,13cyclictest0-21swapper/209:05:552
1005099652,46cyclictest10793-21ssh09:42:312
10041996548,9cyclictest0-21swapper/111:40:591
10041996546,13cyclictest15120-21sh10:44:241
1004199654,46cyclictest25157-21apt07:45:311
1004199653,44cyclictest2095-21timerandwakeup08:11:061
1004199653,44cyclictest2095-21timerandwakeup08:11:061
1004199653,44cyclictest14677-21fschecks_time08:50:541
1004199653,44cyclictest14677-21fschecks_time08:50:541
10041996521,8cyclictest291rcuc/111:50:441
10054996412,33cyclictest0-21swapper/308:05:523
10050996445,13cyclictest0-21swapper/211:40:562
1005099643,38cyclictest14034-21mailstats11:36:042
10041996448,11cyclictest2374-21systemd-journal09:24:571
1004199642,46cyclictest27965-21unixbench_multi07:51:071
10041996417,37cyclictest26770-21modprobe07:50:311
1004199634,38cyclictest31455-21/usr/sbin/munin12:06:041
10041996338,15cyclictest0-21swapper/110:16:481
10041996338,15cyclictest0-21swapper/110:16:481
10054996248,9cyclictest451rcuc/311:57:513
1005099623,41cyclictest10366-21sed08:36:062
1005099622,39cyclictest19772-21timerandwakeup07:26:062
1005099622,39cyclictest19772-21timerandwakeup07:26:062
10054996149,8cyclictest451rcuc/307:11:173
10054996143,11cyclictest451rcuc/310:04:103
10050996146,8cyclictest0-21swapper/210:00:532
10041996138,15cyclictest0-21swapper/108:50:331
10050996041,15cyclictest10028-21cyclictest11:15:302
1005499582,43cyclictest11959-21chrt08:41:063
10054995745,8cyclictest451rcuc/308:29:453
1005499567,36cyclictest22280-21chrt11:50:413
10054995639,10cyclictest451rcuc/310:44:523
10054995611,32cyclictest0-21swapper/308:16:073
10054995611,32cyclictest0-21swapper/308:16:073
10054995542,9cyclictest451rcuc/310:57:493
10054995542,9cyclictest451rcuc/309:07:403
10054995540,10cyclictest451rcuc/311:27:203
10054995442,8cyclictest451rcuc/309:53:403
10054995441,8cyclictest451rcuc/308:54:193
10054995441,8cyclictest451rcuc/308:54:193
10054995440,9cyclictest451rcuc/307:57:503
10054995439,10cyclictest451rcuc/308:56:423
1005499543,41cyclictest2010-21chrt09:28:063
1005499543,38cyclictest7103-21chrt11:25:323
1005499543,38cyclictest7103-21chrt11:25:323
1005499543,37cyclictest27478-21chrt07:50:573
1005499543,37cyclictest19200-21taskset11:45:343
1005499543,35cyclictest18650-21chrt07:24:573
1005499534,35cyclictest9035-21chrt09:40:343
1005499534,35cyclictest9035-21chrt09:40:343
10054995340,9cyclictest451rcuc/310:21:503
10054995340,9cyclictest451rcuc/307:32:483
10054995339,10cyclictest451rcuc/308:14:113
10054995339,10cyclictest451rcuc/308:14:113
10054995338,10cyclictest451rcuc/309:14:093
10054995338,10cyclictest451rcuc/309:14:093
1005499533,38cyclictest854-21taskset11:15:033
1005499533,37cyclictest20363-21chrt07:30:323
1005499533,37cyclictest20363-21chrt07:30:323
1005499532,35cyclictest6420-21chrt10:30:123
1005499532,35cyclictest6420-21chrt10:30:123
10054995319,29cyclictest0-21swapper/307:40:313
10054995318,18cyclictest0-21swapper/311:10:313
10054995239,9cyclictest451rcuc/307:08:173
10054995239,8cyclictest451rcuc/309:03:313
10054995237,9cyclictest451rcuc/312:05:373
1005499523,38cyclictest13268-21taskset09:46:093
1005499523,35cyclictest31145-21chrt10:16:053
1005499523,35cyclictest31145-21chrt10:16:053
1005499523,34cyclictest19655-21chrt10:51:083
1005499522,36cyclictest18522-21chrt10:50:313
10054995139,8cyclictest451rcuc/310:06:253
10054995138,9cyclictest451rcuc/311:40:003
10054995137,10cyclictest451rcuc/308:36:583
10054995137,10cyclictest451rcuc/308:04:433
1005499513,36cyclictest10611-21taskset07:00:553
1005499512,37cyclictest29976-21chrt09:20:533
1005499512,35cyclictest7220-21chrt12:19:133
1005499512,34cyclictest29716-21taskset10:14:353
1005499504,35cyclictest28946-21taskset09:19:233
10054995039,7cyclictest451rcuc/310:33:543
10054995037,9cyclictest451rcuc/307:46:453
10054995036,9cyclictest451rcuc/311:05:193
1005499503,33cyclictest12769-21chrt12:28:013
1005499494,34cyclictest3906-21chrt11:20:133
10054994936,9cyclictest451rcuc/307:18:303
1005499493,36cyclictest5628-21chrt08:21:053
1005499493,34cyclictest10482-21chrt11:30:473
1005499493,34cyclictest10482-21chrt11:30:473
10054994834,10cyclictest451rcuc/307:42:523
10054994734,8cyclictest451rcuc/308:34:393
1005499472,37cyclictest21073-21chrt11:48:053
1005499472,37cyclictest21073-21chrt11:48:053
1005499472,36cyclictest8166-21chrt12:20:473
1005499464,33cyclictest3214-21chrt12:11:193
1005499463,34cyclictest4751-21chrt09:32:203
1005499463,31cyclictest9155-21chrt09:40:383
1005499413,26cyclictest12802-21chrt08:45:433
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional