You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-20 - 20:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sun Sep 20, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
13593213810,20sleep10-21swapper/107:04:261
13593213810,20sleep10-21swapper/107:04:261
14633991172,94cyclictest21555-21apt-get11:49:100
14633991172,94cyclictest21555-21apt-get11:49:100
146339911549,57cyclictest26726-21latency_hist07:43:530
14638991142,32cyclictest21607-21runrttasks11:49:101
14638991142,32cyclictest21607-21runrttasks11:49:101
146339911250,55cyclictest26694-21ssh10:09:180
14633991122,6cyclictest0-21swapper/010:24:030
146339911221,61cyclictest0-21swapper/012:09:260
146339911221,61cyclictest0-21swapper/012:09:260
146339910744,56cyclictest20756-21diskmemload09:59:190
146339910646,54cyclictest29177-21cpu10:14:070
146339910646,54cyclictest29177-21cpu10:14:070
146339910646,52cyclictest0-21swapper/010:04:000
146339910646,52cyclictest0-21swapper/010:04:000
146339910629,68cyclictest4576-21latency_hist09:33:530
146339910541,55cyclictest2655-21fschecks_time08:09:130
146339910442,54cyclictest11750-21latency09:44:380
146339910442,54cyclictest11750-21latency09:44:380
14633991034,88cyclictest17420-21apt-get08:54:370
146339910346,53cyclictest14625-21cyclictest09:34:140
146339910346,53cyclictest14625-21cyclictest09:34:140
14633991033,89cyclictest13345-21grep11:34:260
14642991015,41cyclictest12308-21taskset11:34:002
146389910153,38cyclictest0-21swapper/110:09:231
146339910139,53cyclictest0-21swapper/010:38:520
14633991012,60cyclictest17549-21seq11:42:330
1463399993,7cyclictest0-21swapper/011:19:020
14633999937,54cyclictest0-21swapper/007:29:120
37882980,6sleep30-21swapper/310:24:283
1463399984,87cyclictest0-21swapper/007:08:540
1463399984,87cyclictest0-21swapper/007:08:540
1463399983,58cyclictest16062-21seq07:12:410
14633999743,48cyclictest0-21swapper/011:11:400
14633999742,49cyclictest0-21swapper/011:04:270
1463399973,78cyclictest12364-21apt-get08:39:030
1463399973,78cyclictest12364-21apt-get08:39:030
1463399973,6cyclictest0-21swapper/011:44:050
1463399972,83cyclictest0-21swapper/010:54:010
14633999646,45cyclictest14625-21cyclictest07:44:170
14633999640,44cyclictest0-21swapper/012:24:150
1463399954,77cyclictest17726-21apt-get10:49:030
1463399954,77cyclictest17726-21apt-get10:49:030
14633999540,47cyclictest0-21swapper/011:33:520
1463399952,6cyclictest0-21swapper/012:29:040
14633999443,47cyclictest0-21swapper/010:44:180
14633999443,44cyclictest0-21swapper/012:19:130
14633999443,44cyclictest0-21swapper/012:19:130
14633999439,48cyclictest0-21swapper/009:39:010
14633999431,51cyclictest0-21swapper/010:33:520
14638999353,34cyclictest7326-21unixbench_multi11:24:261
14638999351,36cyclictest18121-21timerwakeupswit09:54:261
14638999346,41cyclictest12069-21latency_hist08:38:531
1463399933,7cyclictest0-21swapper/009:49:040
1463399933,70cyclictest20671-21apt-get09:04:010
14633999334,51cyclictest0-21swapper/008:28:530
14633999314,70cyclictest22545-21sshd09:09:100
14642999247,38cyclictest3585-21threads10:24:262
14642999245,39cyclictest0-21swapper/212:14:122
14638999249,36cyclictest0-21swapper/111:04:201
1463399923,74cyclictest17129-21apt-get09:54:000
14633999237,44cyclictest0-21swapper/007:13:570
1463399923,72cyclictest28410-21apt-get07:49:050
1463399922,81cyclictest31632-21fschecks_count09:24:140
1463399922,6cyclictest0-21swapper/008:49:050
1463399922,6cyclictest0-21swapper/008:49:050
14642999136,48cyclictest14122-21unixbench_multi12:29:282
14642999123,24cyclictest3238-21latency_hist11:18:532
14633999138,46cyclictest0-21swapper/007:24:160
14633999138,46cyclictest0-21swapper/007:24:160
1463399913,74cyclictest0-21swapper/007:59:020
1463399913,73cyclictest13966-21apt-get08:44:010
1463399913,62cyclictest23565-21seq07:34:030
14633999130,54cyclictest0-21swapper/012:34:090
1463399912,77cyclictest9134-21taskset08:29:030
1464299904,37cyclictest545-21munin-run08:03:492
14642999035,47cyclictest0-21swapper/210:44:132
1464299903,36cyclictest2069-21ssh09:29:082
14638999047,37cyclictest22014-21diskmemload09:15:231
1463399903,77cyclictest8575-21ssh11:27:410
14633999037,46cyclictest7249-21latency_hist08:23:530
1463399903,61cyclictest25067-21ssh11:00:030
1463399903,61cyclictest25067-21ssh11:00:030
14642998938,43cyclictest0-21swapper/211:54:252
14642998931,49cyclictest0-21swapper/212:03:522
14642998930,9cyclictest0-21swapper/211:50:272
14642998930,9cyclictest0-21swapper/211:50:272
14642998929,8cyclictest0-21swapper/209:34:262
14642998929,8cyclictest0-21swapper/209:34:262
14638998938,44cyclictest26458-21sh11:03:511
14638998938,44cyclictest26458-21sh11:03:511
1463399893,76cyclictest19059-21apt-get08:59:060
1464299884,32cyclictest18818-21sendmail12:38:492
14638998864,13cyclictest0-21swapper/108:18:521
14638998846,35cyclictest21993-21cron09:08:491
14638998845,36cyclictest4809-21diskmemload12:14:221
14638998844,36cyclictest0-21swapper/111:34:261
14638998835,46cyclictest343-21runrttasks12:06:001
1463399885,69cyclictest18508-21apt-get07:19:030
1463399884,77cyclictest28355-21apt-get09:19:050
1463399883,63cyclictest30582-21ssh12:04:030
1463399882,7cyclictest0-21swapper/008:14:060
1463399882,79cyclictest27534-21ssh09:17:300
1463399882,6cyclictest0-21swapper/007:54:060
1463399882,6cyclictest0-21swapper/007:54:060
1464299874,33cyclictest14225-21/usr/sbin/munin08:44:132
14642998729,8cyclictest0-21swapper/209:24:092
1463899873,26cyclictest9022-21/usr/sbin/munin09:39:291
1463899873,25cyclictest17944-21/usr/sbin/munin10:49:121
1463899873,25cyclictest17944-21/usr/sbin/munin10:49:121
1463399873,58cyclictest834-21ntpq11:14:160
1464299864,28cyclictest29999-21/usr/sbin/munin07:54:232
1464299864,28cyclictest29999-21/usr/sbin/munin07:54:232
1464299863,35cyclictest28829-21idleruntime-cro10:13:492
14642998633,45cyclictest0-21swapper/210:53:492
14642998633,45cyclictest0-21swapper/210:53:492
1464299863,32cyclictest19138-21ls11:44:242
14642998631,50cyclictest0-21swapper/209:09:122
14638998645,34cyclictest0-21swapper/112:09:251
14638998645,34cyclictest0-21swapper/112:09:251
1463399863,75cyclictest30068-21seq12:03:200
14633998622,46cyclictest0-21swapper/010:39:340
230152850,8sleep30-21swapper/311:50:313
230152850,8sleep30-21swapper/311:50:313
1464299854,29cyclictest12057-21/usr/sbin/munin09:44:462
1464299854,29cyclictest12057-21/usr/sbin/munin09:44:462
1464299854,28cyclictest3281-21/usr/sbin/munin11:19:172
1464299854,27cyclictest17402-21fschecks_time09:54:112
1464299853,33cyclictest23002-21latency_hist10:03:522
1464299853,30cyclictest6751-21kernelversion11:24:152
1464299853,28cyclictest7905-21sh09:39:012
14642998527,10cyclictest0-21swapper/210:08:512
14642998527,10cyclictest0-21swapper/210:08:512
14642998523,9cyclictest0-21swapper/209:49:182
14638998567,12cyclictest1648-21ssh11:15:101
1463899853,26cyclictest16189-21/usr/sbin/munin12:34:061
1463399855,73cyclictest4100-21apt-get12:14:000
1464299843,33cyclictest21589-21unixbench_multi09:04:262
1464299843,33cyclictest1103-21/usr/sbin/munin12:09:242
1464299843,33cyclictest1103-21/usr/sbin/munin12:09:242
1464299843,31cyclictest13163-21sort08:39:272
1464299843,31cyclictest13163-21sort08:39:272
1464299843,27cyclictest3754-21modprobe08:13:492
14638998467,8cyclictest0-21swapper/109:24:291
14638998445,33cyclictest22014-21diskmemload11:11:511
1463899842,25cyclictest18666-21/usr/sbin/munin07:19:111
1463399843,6cyclictest0-21swapper/008:04:030
1463399843,56cyclictest5907-21apt-get08:19:020
14633998428,49cyclictest0-21swapper/010:19:120
1464299834,31cyclictest343-21runrttasks07:36:302
1464299834,28cyclictest799-21/usr/sbin/munin08:04:072
1464299834,28cyclictest25315-21/usr/sbin/munin09:14:192
1464299834,28cyclictest19991-21latency_hist07:23:532
14642998338,37cyclictest0-21swapper/210:21:032
1464299833,35cyclictest18276-21timerandwakeup08:55:082
1464299833,34cyclictest12296-21grep08:38:532
1464299833,30cyclictest6541-21sh10:29:252
1464299833,30cyclictest28392-21/usr/sbin/munin07:49:082
1464299833,28cyclictest21449-21latency_hist07:28:522
1464299833,28cyclictest21449-21latency_hist07:28:522
14642998325,8cyclictest0-21swapper/211:29:072
14642998324,7cyclictest0-21swapper/207:39:232
1464299832,26cyclictest30723-21taskset10:15:482
1464299832,26cyclictest30723-21taskset10:15:482
14638998366,8cyclictest0-21swapper/110:14:131
14638998366,8cyclictest0-21swapper/110:14:131
14638998365,11cyclictest17307-21kworker/u17:3-rpciod11:59:221
1463899833,38cyclictest20484-21ssh09:59:131
1463899833,35cyclictest6135-21ssh11:23:521
1463899833,34cyclictest14628-21mailstats08:44:241
14638998331,47cyclictest0-21swapper/110:39:141
14638998325,50cyclictest0-21swapper/109:34:081
14638998325,50cyclictest0-21swapper/109:34:081
1463399832,65cyclictest25821-21ssh11:54:560
14642998266,10cyclictest6570-21wc08:20:202
14642998266,10cyclictest6570-21wc08:20:202
1464299825,30cyclictest343-21runrttasks10:42:242
1464299824,28cyclictest20620-21latency_hist09:03:532
1464299823,32cyclictest343-21runrttasks12:06:352
1464299823,31cyclictest8149-21mailstats08:24:242
1464299823,29cyclictest23174-21apt-key07:33:512
1464299823,28cyclictest7314-21df_inode12:19:082
1464299823,28cyclictest7314-21df_inode12:19:082
14642998231,44cyclictest9110-21/usr/sbin/munin08:29:212
14642998224,8cyclictest0-21swapper/210:54:072
14642998223,9cyclictest0-21swapper/211:09:052
14642998223,8cyclictest0-21swapper/212:24:112
14642998220,8cyclictest0-21swapper/211:39:232
1463899823,35cyclictest8948-21ssh10:34:131
1463899823,34cyclictest1-21systemd11:33:501
14638998233,41cyclictest0-21swapper/111:48:521
1463899822,19cyclictest1933-21ssh09:29:051
1463399822,6cyclictest0-21swapper/008:34:050
1464299814,29cyclictest24848-21taskset10:59:292
1464299814,29cyclictest24848-21taskset10:59:292
1464299813,33cyclictest28336-21/usr/sbin/munin09:19:142
1464299813,28cyclictest4299-21fschecks_time08:14:132
14642998127,9cyclictest0-21swapper/211:04:162
1464299812,29cyclictest28142-21idleruntime-cro07:48:492
14642998116,22cyclictest16454-21cstates07:13:562
1463899814,34cyclictest2610-21latency_hist10:23:531
1463899814,33cyclictest12877-21cat12:28:511
1463899813,39cyclictest9287-21diskstats08:29:131
1463899813,37cyclictest16419-21munin-node07:13:571
1463899813,33cyclictest3392-21grep10:24:231
14638998133,39cyclictest0-21swapper/109:49:001
1463899813,24cyclictest19118-21/usr/sbin/munin08:59:071
1463899813,22cyclictest10597-21apt-get09:44:051
1463899813,22cyclictest10597-21apt-get09:44:051
14638998128,45cyclictest0-21swapper/112:31:131
14638998113,30cyclictest25181-21sort07:38:591
14638998110,29cyclictest1-21systemd10:33:491
1464299804,30cyclictest8952-21fschecks_count10:34:122
1464299803,31cyclictest15448-21sendmail_mailqu07:09:232
1464299803,27cyclictest15833-21fschecks_time08:49:122
1464299803,27cyclictest15833-21fschecks_time08:49:122
14638998040,8cyclictest181rcu_preempt08:04:261
1463899803,37cyclictest23064-21basename07:33:491
1463899803,33cyclictest22625-21fschecks_time09:09:121
1463899803,33cyclictest14712-21/usr/sbin/munin10:44:071
1463899803,27cyclictest15842-21/usr/sbin/munin11:39:161
1463899803,22cyclictest7568-21/usr/sbin/munin12:19:141
1463899803,22cyclictest7568-21/usr/sbin/munin12:19:141
1463899802,34cyclictest2599-21fschecks_count08:09:131
1463899802,24cyclictest31052-21idleruntime-cro09:23:501
1464299794,26cyclictest14625-21cyclictest07:08:542
1464299794,26cyclictest14625-21cyclictest07:08:542
14638997959,11cyclictest0-21swapper/108:49:121
14638997959,11cyclictest0-21swapper/108:49:121
1463899793,37cyclictest25311-21sendmail_mailqu11:54:311
1463899793,36cyclictest26886-21/usr/sbin/munin07:44:071
1463899793,31cyclictest21455-21/usr/sbin/munin07:28:501
1463899793,31cyclictest21455-21/usr/sbin/munin07:28:501
1463899792,33cyclictest28612-21fschecks_count07:49:111
1463899792,33cyclictest23156-21runrttasks10:04:021
1463899792,33cyclictest23156-21runrttasks10:04:021
1463899792,24cyclictest23853-21fschecks_count07:35:101
14638997834,38cyclictest17746-21fschecks_time08:54:551
1463899783,30cyclictest359-21snmpd08:24:021
1463899783,23cyclictest20717-21apt-get10:54:061
14638997730,40cyclictest0-21swapper/108:39:151
14638997730,40cyclictest0-21swapper/108:39:151
14638997725,44cyclictest0-21swapper/107:54:201
14638997725,44cyclictest0-21swapper/107:54:201
1463899772,36cyclictest6214-21fschecks_time08:20:091
1463899772,36cyclictest6214-21fschecks_time08:20:091
143122776,14sleep30-21swapper/307:06:283
143122776,14sleep30-21swapper/307:06:283
1463899762,29cyclictest31810-21diskstats07:59:111
1463899762,24cyclictest15727-21grep07:09:271
1465299742,31cyclictest23537-21taskset07:33:583
1465299712,41cyclictest32190-21taskset10:19:053
1465299673,27cyclictest11802-21taskset08:35:303
1465299672,31cyclictest3926-21taskset11:19:183
1465299672,26cyclictest20606-21chrt07:24:183
1465299672,26cyclictest20606-21chrt07:24:183
1465299672,25cyclictest7082-21taskset12:18:553
1465299672,25cyclictest7082-21taskset12:18:553
1465299672,25cyclictest11113-21chrt09:43:583
1465299672,25cyclictest11113-21chrt09:43:583
1465299672,24cyclictest14918-21chrt07:09:083
1465299663,28cyclictest22865-21taskset09:09:163
305732650,7sleep30-21swapper/309:22:343
1465299653,28cyclictest25872-21taskset10:08:523
1465299653,28cyclictest25872-21taskset10:08:523
1465299653,27cyclictest8119-21chrt10:33:073
1465299653,25cyclictest15361-21chrt10:44:213
1465299653,24cyclictest20079-21chrt07:23:543
1465299653,23cyclictest25204-21chrt07:39:053
1465299652,27cyclictest9299-21chrt09:40:143
1465299652,26cyclictest26987-21chrt11:58:133
1465299652,23cyclictest5368-21chrt08:18:503
1465299643,28cyclictest26160-21taskset10:09:043
1465299643,28cyclictest21842-21chrt10:54:303
1465299643,28cyclictest14165-21taskset09:49:053
1465299643,26cyclictest29258-21chrt12:01:053
1465299642,26cyclictest1458-21chrt12:09:153
1465299642,26cyclictest1458-21chrt12:09:153
1465299642,24cyclictest14934-21chrt12:31:273
1465299633,25cyclictest21987-21chrt10:01:303
1465299633,24cyclictest5718-21chrt12:15:513
1465299633,22cyclictest26830-21chrt09:15:333
1465299632,29cyclictest31394-21chrt11:11:003
1465299632,27cyclictest19341-21taskset09:57:333
1465299632,27cyclictest13032-21taskset10:40:003
1465299632,26cyclictest9387-21taskset08:29:153
1465299632,26cyclictest22764-21chrt07:30:143
1465299632,25cyclictest9466-21taskset10:34:253
1465299632,25cyclictest6648-21taskset11:24:133
1465299632,25cyclictest18300-21taskset11:43:583
1465299622,26cyclictest30433-21chrt10:15:003
1465299622,26cyclictest30433-21chrt10:15:003
1465299622,25cyclictest21812-21chrt09:06:253
1465299622,25cyclictest18026-21chrt07:16:373
1465299622,24cyclictest2512-21taskset09:29:193
1465299622,24cyclictest14250-21chrt08:44:133
1465299622,24cyclictest13940-21taskset11:35:563
1465299622,23cyclictest17397-21chrt08:53:573
1465299622,21cyclictest10315-21chrt12:24:103
1465299613,26cyclictest18721-21taskset12:38:413
1465299613,22cyclictest3421-21chrt08:09:303
1465299612,27cyclictest31804-21chrt07:59:093
1465299612,25cyclictest1316-21chrt09:28:053
1465299612,24cyclictest27902-21chrt11:04:353
1465299612,24cyclictest19064-21chrt08:59:043
1465299612,23cyclictest8215-21chrt08:24:253
1465299612,23cyclictest28109-21taskset07:48:363
1465299612,23cyclictest17700-21chrt10:48:593
1465299612,23cyclictest17700-21chrt10:48:593
1465299612,23cyclictest13378-21chrt08:39:483
1465299612,23cyclictest13378-21chrt08:39:483
1465299603,25cyclictest5885-21taskset08:18:583
1465299603,25cyclictest5885-21taskset08:18:583
1465299603,23cyclictest16622-21chrt08:50:093
1465299603,23cyclictest16622-21chrt08:50:093
1465299603,21cyclictest25594-21chrt11:01:313
1465299603,21cyclictest25594-21chrt11:01:313
1465299602,25cyclictest9284-21chrt11:28:593
1465299602,22cyclictest31316-21chrt07:58:333
1465299602,22cyclictest31316-21chrt07:58:333
1465299602,21cyclictest28973-21chrt07:49:213
1465299593,25cyclictest31907-21chrt12:05:063
1465299593,21cyclictest6546-21chrt09:36:003
1465299593,21cyclictest6546-21chrt09:36:003
1465299593,21cyclictest2102-21chrt08:08:173
1465299583,22cyclictest15847-21chrt11:39:163
1465299583,21cyclictest2480-21chrt11:17:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional