You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-03 - 19:42
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackbslot7.osadl.org (updated Fri Apr 03, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
70459912641,50cyclictest22909-21ssh11:59:070
70459912641,50cyclictest22909-21ssh11:59:070
7054991173,89cyclictest6310-21apt-get09:44:122
7054991173,89cyclictest6310-21apt-get09:44:122
690421119,73sleep06935-21munin-run07:03:560
690421119,73sleep06935-21munin-run07:03:560
70549910719,37cyclictest18990-21seq07:39:112
70549910719,37cyclictest18990-21seq07:39:112
1946221000,20sleep014209-21diskmemload10:59:110
7054999959,34cyclictest18029-21ssh10:03:562
7051999975,18cyclictest10455-21kworker/u19:2-ext4-rsv-conversion12:24:131
705199956,45cyclictest27823-21journal-offline10:19:251
705199956,45cyclictest27823-21journal-offline10:19:251
7051999555,9cyclictest6243-21runrttasks11:30:131
7051999555,9cyclictest6243-21runrttasks11:30:131
7045999567,19cyclictest11459-21latency_hist12:33:570
7045999557,28cyclictest17397-21ssh09:08:590
7045999524,45cyclictest2952-21systemd-journal11:32:000
7045999524,45cyclictest2952-21systemd-journal11:32:000
7045999464,19cyclictest8570-21latency_hist12:28:580
7045999423,29cyclictest19904-21apt-get11:54:060
7051999250,34cyclictest30309-21kworker/u18:3+nfsiod12:23:361
7054999173,10cyclictest2952-21systemd-journal11:08:552
705499904,32cyclictest22280-21latency_hist07:48:582
7054999038,45cyclictest297-21systemd-logind12:23:562
61322907,57sleep16139-21awk06:59:371
61322907,57sleep16139-21awk06:59:371
705499894,31cyclictest27739-21/usr/sbin/munin10:20:202
705499894,31cyclictest27739-21/usr/sbin/munin10:20:202
705499894,29cyclictest352-21runrttasks12:04:092
7054998937,43cyclictest0-21swapper/211:24:322
705499893,30cyclictest1017-21modprobe08:23:562
7054998923,11cyclictest0-21swapper/212:29:112
705499892,29cyclictest13406-21cpuspeed10:49:112
7045998961,19cyclictest9214-21apt-key08:48:580
7045998961,19cyclictest9214-21apt-key08:48:580
705499883,32cyclictest22584-21latency_hist11:58:592
7054998827,10cyclictest0-21swapper/209:39:132
705499882,36cyclictest9545-21fschecks_time07:09:202
705499882,35cyclictest5895-21grep11:29:322
705499882,35cyclictest5895-21grep11:29:322
705499882,34cyclictest21282-21/usr/sbin/munin10:09:212
7054998820,22cyclictest28522-21expr11:14:122
7054998814,27cyclictest30479-21sort09:29:322
705499873,34cyclictest16873-21/usr/sbin/munin11:49:332
705499873,33cyclictest4120-21latency_hist10:33:582
705499873,33cyclictest11045-21find10:44:282
705499873,31cyclictest27984-21rm11:13:502
705499872,33cyclictest19388-21wc10:59:112
705199873,57cyclictest6382-21ssh09:44:191
705199873,57cyclictest6382-21ssh09:44:191
7045998713,51cyclictest2764-21latency_hist09:38:580
705499865,32cyclictest17502-21ssh09:09:062
7054998640,40cyclictest0-21swapper/212:14:172
705499863,35cyclictest31342-21/usr/sbin/munin11:19:122
705499863,35cyclictest14866-21timerwakeupswit11:44:312
705499863,34cyclictest7037-21cyclictest07:04:002
705499863,34cyclictest7037-21cyclictest07:04:002
705499863,32cyclictest9935-21fschecks_time08:49:592
705499862,38cyclictest13764-21unixbench_multi08:59:322
7045998664,15cyclictest7037-21cyclictest12:06:290
7045998657,22cyclictest29076-21df_inode12:09:140
7045998657,22cyclictest29076-21df_inode12:09:140
704599863,56cyclictest6287-21/usr/sbin/munin09:44:280
704599863,56cyclictest6287-21/usr/sbin/munin09:44:280
7045998619,24cyclictest25031-21grep07:54:310
7045998619,24cyclictest25031-21grep07:54:310
7045998610,39cyclictest26462-21latency_hist09:23:590
705499854,31cyclictest27227-21latency_hist08:03:592
705499853,34cyclictest6472-21kernelversion12:25:212
705499853,34cyclictest25533-21latency_hist07:58:582
705499853,34cyclictest25533-21latency_hist07:58:582
705499853,33cyclictest5235-21cat08:34:302
705499853,33cyclictest14397-21fschecks_time07:24:162
705499853,33cyclictest1279-21/usr/sbin/munin08:24:122
705499853,31cyclictest28183-21grep08:04:322
705499853,30cyclictest18762-21kernelversion10:04:232
7054998525,9cyclictest0-21swapper/211:34:322
705499852,33cyclictest17382-21tail10:54:332
705499852,24cyclictest11206-21grep11:39:162
704599859,47cyclictest0-21swapper/007:04:170
7045998550,29cyclictest300-21rs:main0
7045998550,29cyclictest300-21rs:main0
705499844,34cyclictest30551-21cpu08:14:122
705499844,33cyclictest20990-21kernelversion09:14:212
705499844,33cyclictest20990-21kernelversion09:14:212
705499844,32cyclictest12467-21latency_hist07:18:592
705499843,35cyclictest26786-21ssh10:17:452
705499843,35cyclictest11222-21runrttasks09:51:482
705499843,33cyclictest7530-21latency_hist08:43:572
705499843,31cyclictest959-21threads09:34:312
705499843,31cyclictest11431-21fschecks_count08:54:172
705499843,29cyclictest26278-21latency_hist09:23:572
705499843,27cyclictest15934-21tune2fs07:29:172
705499843,27cyclictest15934-21tune2fs07:29:172
7054998432,45cyclictest0-21swapper/210:43:582
7054998432,44cyclictest0-21swapper/210:24:292
705499843,23cyclictest26523-21/usr/sbin/munin09:24:122
705499843,23cyclictest26523-21/usr/sbin/munin09:24:122
7051998446,29cyclictest5672-21kworker/u18:1+nfsiod10:40:151
704599849,38cyclictest10319-21acpi10:44:050
7045998418,28cyclictest18855-21netstat10:04:250
7045998415,31cyclictest17647-21awk11:49:290
705499834,34cyclictest12803-21fschecks_time07:19:172
705499834,33cyclictest28878-21/usr/sbin/munin08:09:052
705499833,34cyclictest3731-21wc08:29:302
705499833,32cyclictest15100-21awk09:04:242
705499832,36cyclictest18886-21latency_hist07:38:592
705499832,36cyclictest18886-21latency_hist07:38:592
7054998322,53cyclictest0-21swapper/212:09:282
7054998322,53cyclictest0-21swapper/212:09:282
7045998321,23cyclictest30380-21cat09:29:310
7045998318,31cyclictest3039-21ntpq12:19:250
7045998311,34cyclictest32202-21grep12:14:170
705499824,33cyclictest23325-21kernelversion11:59:212
705499824,33cyclictest23325-21kernelversion11:59:212
705499823,32cyclictest4456-21ssh10:34:122
7054998222,10cyclictest0-21swapper/207:49:122
7051998261,15cyclictest3085-21sh11:24:451
7051998260,15cyclictest14209-21diskmemload09:14:181
7051998260,15cyclictest14209-21diskmemload09:14:181
7045998215,23cyclictest0-21swapper/007:59:060
7045998210,47cyclictest14444-21latency_hist09:04:000
705499813,23cyclictest7825-21sort08:44:122
705499813,23cyclictest7825-21sort08:44:122
7054998129,45cyclictest0-21swapper/209:54:102
7051998162,12cyclictest7037-21cyclictest09:58:551
7051998157,15cyclictest12296-21systemd-run07:18:571
7051998152,20cyclictest32190-21cron09:33:551
7045998117,30cyclictest32005-21open_files11:19:270
7045998116,22cyclictest0-21swapper/009:49:170
7045998110,35cyclictest2947-21chrt11:24:320
705499803,26cyclictest7521-21fschecks_time07:04:182
7051998055,16cyclictest31892-21/usr/sbin/munin12:14:241
705199803,43cyclictest22838-21latency_hist11:58:591
7045998018,18cyclictest14209-21diskmemload11:09:300
7045998014,28cyclictest27465-21sed09:24:320
7045998014,28cyclictest27465-21sed09:24:320
7051997958,15cyclictest15655-21latency_hist07:28:591
7045997944,12cyclictest28404-21cpu11:14:110
7045997921,23cyclictest30773-21latency_hist10:24:140
7045997921,23cyclictest30773-21latency_hist10:24:140
7045997917,25cyclictest9901-21ssh10:43:380
7045997911,28cyclictest22061-21mailstats10:09:290
7045997911,26cyclictest16011-21cut07:29:180
7045997911,26cyclictest16011-21cut07:29:180
7045997854,14cyclictest1314-21apt-get10:29:120
7045997820,23cyclictest11099-21ssh11:39:130
7045997817,26cyclictest14583-21sh09:57:470
7051997738,21cyclictest17522-21ssh11:49:271
7045997753,15cyclictest25174-21ssh11:08:580
7045997717,24cyclictest3055-21ssh09:39:040
7045997712,29cyclictest14929-21grep11:44:320
7045997711,29cyclictest13977-21ntp_states10:49:300
7051997657,12cyclictest13582-21latency_hist11:43:571
7051997655,12cyclictest0-21swapper/109:19:341
7045997649,20cyclictest25773-21apt-get10:15:250
7045997619,44cyclictest0-21swapper/009:09:180
7045997619,22cyclictest352-21runrttasks08:43:590
7045997612,25cyclictest18731-21awk07:38:560
7045997612,25cyclictest18731-21awk07:38:560
7045997611,29cyclictest23874-21latency_hist07:53:580
706899752,32cyclictest22489-21chrt11:04:133
705199753,34cyclictest9102-21munin-run08:48:551
705199753,34cyclictest9102-21munin-run08:48:551
7045997554,14cyclictest19773-21timerandwakeup07:39:300
7045997554,14cyclictest19773-21timerandwakeup07:39:300
7045997551,16cyclictest29160-21fschecks_time08:09:170
7045997550,13cyclictest10919-21apt-get07:14:100
7045997522,20cyclictest0-21swapper/010:24:310
7045997519,18cyclictest13228-21switchtime07:19:290
7045997516,25cyclictest18497-21rm10:57:260
7045997513,28cyclictest15925-21/usr/sbin/munin09:59:260
7068997410,10cyclictest0-21swapper/309:39:063
7051997460,10cyclictest7037-21cyclictest11:18:161
7051997456,13cyclictest20488-21kworker/u19:0-rpciod11:04:151
7051997445,20cyclictest8576-21modprobe07:08:551
7045997434,27cyclictest32150-21chrt08:19:080
7045997416,22cyclictest22192-21systemd-run07:48:560
7045997412,26cyclictest2834-21date08:28:590
7045997411,29cyclictest4348-21latency_hist08:33:590
7051997346,18cyclictest0-21swapper/110:24:261
7051997344,20cyclictest15490-21timerwakeupswit09:04:321
7051997341,12cyclictest181rcu_preempt08:39:161
7045997348,17cyclictest352-21runrttasks11:38:550
7045997312,24cyclictest9278-21apt-get07:09:140
7051997245,11cyclictest181rcu_preempt10:13:581
7045997222,22cyclictest0-21swapper/007:24:270
7045997214,27cyclictest0-21swapper/008:54:240
7045997212,23cyclictest28733-21latency_hist08:08:580
706899713,31cyclictest27888-21taskset10:19:273
706899713,31cyclictest27888-21taskset10:19:273
7051997156,9cyclictest11702-21ssh10:45:161
7051997152,12cyclictest994-21ssh09:34:311
7051997148,7cyclictest181rcu_preempt08:53:571
7051997146,15cyclictest0-21swapper/111:19:181
7051997125,34cyclictest19933-21ssh09:13:121
7051997120,41cyclictest16480-21switchtime07:29:301
7051997120,41cyclictest16480-21switchtime07:29:301
7045997124,38cyclictest9599-21apt-get08:49:460
7045997114,27cyclictest5344-21sed10:34:310
706899703,27cyclictest15969-21chrt07:29:173
706899703,27cyclictest15969-21chrt07:29:173
706899703,24cyclictest9622-21chrt09:49:193
706899702,31cyclictest12949-21chrt08:59:133
7051997047,16cyclictest5878-21munin-plugin-st08:38:571
7051997036,24cyclictest10002-21switchtime07:09:321
706899693,30cyclictest16349-21taskset09:06:343
706899693,29cyclictest22538-21chrt09:17:003
706899693,29cyclictest22538-21chrt09:17:003
706899693,23cyclictest31076-21chrt08:14:253
7051996947,16cyclictest20322-21latency_hist07:43:581
7051996947,16cyclictest20322-21latency_hist07:43:581
7051996945,15cyclictest11990-21sendmail09:53:551
7045996912,24cyclictest30876-21interrupts08:14:190
7045996911,26cyclictest5879-21idleruntime-cro08:38:550
706899684,25cyclictest28507-21chrt09:26:573
706899684,25cyclictest28507-21chrt09:26:573
706899683,31cyclictest23479-21taskset11:59:243
706899683,31cyclictest23479-21taskset11:59:243
706899683,24cyclictest3286-21chrt10:31:593
706899683,24cyclictest22589-21chrt11:58:553
7051996854,9cyclictest7037-21cyclictest12:31:201
7051996852,10cyclictest25416-21latency_hist07:58:551
7051996852,10cyclictest25416-21latency_hist07:58:551
7051996851,11cyclictest14209-21diskmemload10:50:121
7051996848,15cyclictest32371-21fschecks_time08:19:171
7051996847,7cyclictest181rcu_preempt08:29:181
705199684,44cyclictest1295-21/usr/sbin/munin10:29:321
705199683,46cyclictest22345-21latency_hist07:48:591
7051996834,11cyclictest0-21swapper/111:38:571
705199683,40cyclictest26070-21taskset10:15:461
705199682,33cyclictest20363-21ssh10:59:311
706899673,31cyclictest26753-21chrt12:04:303
706899673,20cyclictest11451-21chrt11:39:223
706899672,24cyclictest23563-21chrt09:19:073
7051996753,10cyclictest7037-21cyclictest10:03:271
7051996752,11cyclictest7037-21cyclictest10:04:321
7051996752,10cyclictest7037-21cyclictest08:24:301
7051996745,13cyclictest0-21swapper/108:54:121
7051996739,14cyclictest0-21swapper/107:38:581
7051996739,14cyclictest0-21swapper/107:38:581
705199673,44cyclictest13292-21latency08:59:211
7051996711,12cyclictest181rcu_preempt07:49:291
706899663,26cyclictest16902-21chrt10:54:243
706899663,23cyclictest7024-21chrt11:32:253
706899663,23cyclictest7024-21chrt11:32:253
706899663,23cyclictest17791-21chrt09:09:183
706899663,20cyclictest31400-21chrt11:19:123
706899662,22cyclictest18493-21chrt10:04:153
705199664,41cyclictest4625-21fschecks_time10:34:171
7051996644,12cyclictest0-21swapper/108:04:181
7051996643,17cyclictest300-21rs:main1
7051996641,13cyclictest0-21swapper/109:24:321
7051996641,13cyclictest0-21swapper/109:24:321
705199663,45cyclictest30465-21latency_hist08:13:591
7051996631,10cyclictest0-21swapper/108:16:001
706899653,24cyclictest25954-21chrt11:09:233
706899652,24cyclictest23954-21chrt10:13:513
7051996549,11cyclictest803-21sendmail-mta12:11:081
7051996549,11cyclictest803-21sendmail-mta12:11:081
705199653,33cyclictest23285-21if_eth011:59:191
705199653,33cyclictest23285-21if_eth011:59:191
7051996532,10cyclictest181rcu_preempt09:39:181
7051996530,12cyclictest8831-21munin-node12:04:191
705199652,43cyclictest26624-21unixbench_singl07:59:311
706899644,22cyclictest4636-21chrt12:22:343
706899643,26cyclictest11526-21taskset08:54:193
706899643,24cyclictest14658-21chrt10:50:113
706899643,23cyclictest9120-21chrt08:48:563
706899643,23cyclictest9120-21chrt08:48:563
706899643,23cyclictest30146-21chrt08:12:513
706899643,23cyclictest1743-21chrt08:24:223
706899643,21cyclictest31121-21chrt09:30:543
706899643,21cyclictest11425-21chrt12:33:563
706899643,20cyclictest31554-21chrt12:13:543
706899643,20cyclictest31554-21chrt12:13:543
706899642,27cyclictest17209-21chrt10:01:433
706899642,24cyclictest21231-21chrt07:45:013
706899642,24cyclictest12835-21chrt10:48:283
706899642,23cyclictest18736-21taskset11:51:383
706899642,22cyclictest9610-21chrt08:49:123
706899642,22cyclictest28887-21chrt11:14:223
7051996422,8cyclictest1327-21kworker/u17:1+xprtiod11:10:021
706899633,23cyclictest28508-21chrt08:07:333
706899633,23cyclictest27349-21chrt10:18:583
706899633,23cyclictest15518-21chrt11:45:583
706899633,21cyclictest1215-21chrt09:34:353
706899633,20cyclictest8242-21chrt09:46:523
706899633,20cyclictest8242-21chrt09:46:523
706899633,20cyclictest19546-21chrt10:59:143
706899632,25cyclictest657-21chrt10:28:023
706899632,24cyclictest14511-21chrt09:57:343
706899632,23cyclictest31943-21chrt12:14:113
706899632,23cyclictest13823-21chrt07:23:343
706899632,22cyclictest9040-21chrt11:34:363
706899632,22cyclictest8515-21chrt10:39:453
706899632,21cyclictest3534-21taskset08:29:283
706899624,21cyclictest15198-21chrt07:25:333
706899623,20cyclictest22589-21chrt07:49:143
706899622,23cyclictest32154-21chrt08:19:113
706899622,23cyclictest25177-21chrt07:55:583
706899622,23cyclictest25177-21chrt07:55:583
706899622,20cyclictest5705-21chrt08:36:533
705199623,29cyclictest14150-21fschecks_count11:44:171
705199623,29cyclictest12973-21/usr/sbin/munin07:19:211
706899613,33cyclictest0-21swapper/312:24:213
706899613,21cyclictest5448-21chrt10:34:343
706899613,20cyclictest26961-21chrt08:03:193
706899613,19cyclictest20012-21chrt07:40:033
706899613,19cyclictest20012-21chrt07:40:033
706899612,22cyclictest12044-21chrt07:16:173
706899612,22cyclictest10472-21chrt07:12:083
706899602,23cyclictest7230-21chrt08:40:423
706899602,21cyclictest3679-21chrt11:26:253
706899598,12cyclictest0-21swapper/307:34:213
706899598,12cyclictest0-21swapper/307:34:213
706899594,25cyclictest8346-21taskset07:06:053
55632458,22sleep30-21swapper/306:59:063
55632458,22sleep30-21swapper/306:59:063
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional