You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 15:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackbslot7.osadl.org (updated Sat May 02, 2026 12:44:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16809991124,32cyclictest16734-21ntp_kernel_pll_11:32:290
16809991124,32cyclictest16734-21ntp_kernel_pll_11:32:290
16809991113,34cyclictest1561-21apt-get12:02:100
168299911066,37cyclictest544-21cron08:56:592
168299911066,37cyclictest544-21cron08:56:592
168099910949,12cyclictest23899-21runrttasks10:50:210
16809991094,49cyclictest3600-21/usr/sbin/munin09:22:290
16809991094,33cyclictest27482-21idleruntime-cro10:56:590
168219910451,46cyclictest13742-21sh10:32:331
16829991004,77cyclictest32195-21apt-get07:47:122
73162990,8sleep20-21swapper/212:12:022
16809999659,11cyclictest31639-21ssh10:07:390
16809999659,11cyclictest31639-21ssh10:07:390
16829999518,31cyclictest18496-21unixbench_singl08:42:362
16821999549,40cyclictest29503-21threads07:37:351
16821999549,40cyclictest29503-21threads07:37:351
16821999542,44cyclictest0-21swapper/111:57:021
16821999541,47cyclictest16685-21sh10:37:351
16821999539,49cyclictest0-21swapper/108:47:021
16821999341,45cyclictest8865-21sh09:31:031
16821999335,8cyclictest0-21swapper/111:22:231
16829999248,7cyclictest181rcu_preempt08:17:352
16821999243,43cyclictest17058-21timerandwakeup11:32:361
16821999243,43cyclictest17058-21timerandwakeup11:32:361
153642929,58sleep015393-21cpu06:57:190
16821999128,9cyclictest0-21swapper/109:18:111
16821999128,9cyclictest0-21swapper/109:18:111
16821999116,25cyclictest23391-21sh10:48:551
16821999043,42cyclictest0-21swapper/112:32:011
16821999043,42cyclictest0-21swapper/112:32:011
16821999035,8cyclictest0-21swapper/110:02:321
16821999035,10cyclictest0-21swapper/109:15:371
16821999032,8cyclictest0-21swapper/109:47:131
16821999031,8cyclictest0-21swapper/109:57:111
16829998938,44cyclictest0-21swapper/212:17:282
1682999893,28cyclictest1460-21if_eth010:12:232
16829998920,27cyclictest10000-21cut11:22:022
16821998940,42cyclictest0-21swapper/107:27:021
16821998938,42cyclictest0-21swapper/107:42:221
16821998935,8cyclictest0-21swapper/110:42:261
16821998931,8cyclictest0-21swapper/110:22:351
16829998837,43cyclictest0-21swapper/211:41:582
16829998822,30cyclictest22733-21cat10:47:352
16829998813,19cyclictest27675-21kworker/u17:2+xprtiod09:12:362
16821998841,41cyclictest23738-21diskmemload11:29:501
16821998829,8cyclictest0-21swapper/111:02:201
16821998826,21cyclictest17583-21wc07:02:321
16821998826,21cyclictest17583-21wc07:02:321
1682199882,39cyclictest1099-21ssh10:12:131
16821998821,18cyclictest23738-21diskmemload09:37:251
1682999873,29cyclictest3869-21fschecks_count09:22:232
1682999873,25cyclictest1539-21/usr/sbin/munin07:52:212
1682199873,60cyclictest32195-21apt-get07:47:171
16821998730,10cyclictest0-21swapper/112:07:551
16821998729,8cyclictest0-21swapper/108:17:221
16821998728,8cyclictest0-21swapper/108:27:251
16821998728,8cyclictest0-21swapper/108:27:251
16829998637,41cyclictest0-21swapper/212:27:212
16829998637,41cyclictest0-21swapper/212:27:212
1682999863,35cyclictest8428-21taskset10:23:312
1682999863,24cyclictest13908-21/usr/sbin/munin11:27:332
16829998629,44cyclictest0-21swapper/211:44:062
1682999862,27cyclictest5437-21ls08:02:362
1682999862,27cyclictest5437-21ls08:02:362
16829998620,17cyclictest0-21swapper/212:02:152
16829998617,27cyclictest5421-21seq10:18:242
16829998617,27cyclictest5421-21seq10:18:242
16821998634,11cyclictest0-21swapper/107:27:371
16821998633,9cyclictest0-21swapper/111:17:221
16821998631,10cyclictest0-21swapper/111:10:391
16829998536,43cyclictest29750-21sendmail09:12:002
16829998536,43cyclictest29750-21sendmail09:12:002
1682999853,30cyclictest13185-21/usr/sbin/munin09:37:322
1682999853,22cyclictest623-21apt-get09:17:162
1682999853,22cyclictest623-21apt-get09:17:162
16829998526,50cyclictest30629-21cpuspeed10:07:172
16829998526,50cyclictest30629-21cpuspeed10:07:172
16829998525,52cyclictest0-21swapper/209:57:152
16829998522,6cyclictest0-21swapper/211:02:102
16821998568,8cyclictest0-21swapper/107:52:161
16821998539,10cyclictest16798-21cyclictest10:53:591
1682199853,33cyclictest4120-21cpu10:17:171
1682199853,33cyclictest4120-21cpu10:17:171
1682199853,32cyclictest3600-21/usr/sbin/munin09:22:281
1682199853,31cyclictest23106-21tail11:42:361
16821998519,20cyclictest3872-21cat07:57:391
16821998519,20cyclictest3872-21cat07:57:391
16829998437,39cyclictest0-21swapper/212:22:182
16829998437,39cyclictest0-21swapper/212:22:182
16829998437,39cyclictest0-21swapper/210:37:352
1682999843,29cyclictest31306-21sort11:57:212
1682999843,27cyclictest12409-21idleruntime-cro08:26:592
1682999843,26cyclictest27249-21ls07:32:182
16829998423,50cyclictest0-21swapper/208:52:032
1682999842,28cyclictest9202-21awk08:16:592
16821998463,14cyclictest0-21swapper/110:07:261
16821998463,14cyclictest0-21swapper/110:07:261
1682199843,30cyclictest22590-21timerwakeupswit09:52:351
1682199843,30cyclictest22590-21timerwakeupswit09:52:351
16821998431,8cyclictest0-21swapper/109:02:161
16821998430,7cyclictest0-21swapper/111:37:381
16821998429,9cyclictest0-21swapper/112:02:091
16821998429,8cyclictest0-21swapper/108:02:231
16821998429,8cyclictest0-21swapper/108:02:231
16821998427,9cyclictest0-21swapper/110:27:341
16821998426,23cyclictest28760-21timerwakeupswit10:57:371
16821998426,23cyclictest28760-21timerwakeupswit10:57:371
1682199842,34cyclictest15663-21ssh09:42:181
1682199842,34cyclictest15663-21ssh09:42:181
1682199842,28cyclictest25017-21/usr/sbin/munin11:47:231
16809998466,13cyclictest25927-21kworker/u18:1+events_unbound11:01:590
16809998466,13cyclictest25927-21kworker/u18:1+events_unbound11:01:590
16829998364,13cyclictest1-21systemd07:47:002
1682999833,32cyclictest10347-21grep12:17:022
1682999833,32cyclictest10347-21grep12:17:022
1682999833,27cyclictest352-21runrttasks10:05:132
1682999833,27cyclictest12961-21ssh10:32:102
1682999833,26cyclictest12200-21latency_hist09:37:032
1682999833,26cyclictest12200-21latency_hist09:37:032
1682999833,25cyclictest6905-21latency_hist11:17:022
1682999833,25cyclictest18851-21/usr/sbin/munin10:42:292
16829998322,44cyclictest23738-21diskmemload09:45:102
16829998322,44cyclictest23738-21diskmemload09:45:102
16821998365,10cyclictest0-21swapper/107:37:031
16821998330,8cyclictest0-21swapper/111:12:151
16829998237,37cyclictest0-21swapper/209:27:182
1682999823,32cyclictest27781-21/usr/sbin/munin10:57:372
1682999823,32cyclictest27781-21/usr/sbin/munin10:57:372
1682999823,27cyclictest10236-21fschecks_count10:27:222
1682999823,26cyclictest16487-21/usr/sbin/munin11:32:242
1682999823,26cyclictest16487-21/usr/sbin/munin11:32:242
1682199824,26cyclictest10463-21/usr/sbin/munin12:17:341
1682199823,26cyclictest16114-21cut08:37:211
16821998230,10cyclictest0-21swapper/109:10:071
16821998230,10cyclictest0-21swapper/109:10:071
16809998263,13cyclictest298-21in:imuxsock10:41:590
1539528229,28sleep10-21swapper/106:57:201
16829998133,40cyclictest0-21swapper/211:47:252
1682999813,27cyclictest24827-21ssh10:52:102
1682999813,27cyclictest24098-21fschecks_count07:22:222
1682999812,36cyclictest58-21kcompactd011:52:282
1682999812,29cyclictest21637-21/usr/sbin/munin09:52:342
1682999812,29cyclictest21637-21/usr/sbin/munin09:52:342
1682999812,29cyclictest18139-21apt-get09:47:152
1682999812,25cyclictest23811-21latency_hist09:02:022
16821998163,10cyclictest0-21swapper/107:17:341
16821998133,7cyclictest0-21swapper/109:32:351
16821998133,7cyclictest0-21swapper/109:32:351
16821998129,15cyclictest6451-21cut08:07:211
1682999809,23cyclictest3729-21wc07:57:372
1682999809,23cyclictest3729-21wc07:57:372
1682999805,25cyclictest23693-21latency_hist07:22:022
16829998033,40cyclictest16985-21/usr/sbin/munin07:02:162
16829998033,40cyclictest16985-21/usr/sbin/munin07:02:162
1682999803,27cyclictest24082-21taskset09:02:142
1682999803,25cyclictest19035-21acpi07:07:122
1682999803,24cyclictest12670-21apt-get08:27:152
1682999803,24cyclictest12670-21apt-get08:27:152
1682999803,22cyclictest20682-21apt-get07:12:122
1682999803,18cyclictest16798-21cyclictest07:02:032
16829998029,45cyclictest0-21swapper/211:07:312
1682999802,29cyclictest29448-21wc07:37:342
1682999802,29cyclictest29448-21wc07:37:342
1682199802,28cyclictest13724-21fschecks_time12:22:211
1682199802,28cyclictest13724-21fschecks_time12:22:211
16821998018,22cyclictest22718-21if_eth008:57:241
16809998056,18cyclictest6089-21ssh10:20:180
16809998056,18cyclictest6089-21ssh10:20:180
1682999793,31cyclictest6188-21/usr/sbin/munin08:07:162
1682999793,25cyclictest15657-21awk08:36:592
16829997928,28cyclictest25773-21fschecks_time07:27:232
1682999792,25cyclictest10297-21/usr/sbin/munin11:22:162
1682999783,26cyclictest16772-21timerwakeupswit08:37:352
1682199783,28cyclictest21273-21cut07:12:331
1682199782,32cyclictest14463-21/usr/sbin/munin08:32:191
16821997815,23cyclictest9812-21diskmemload12:16:001
16821997815,23cyclictest9812-21diskmemload12:16:001
1683399763,30cyclictest31168-21chrt10:07:323
1683399763,30cyclictest31168-21chrt10:07:323
16821997662,10cyclictest16798-21cyclictest11:57:101
16809997660,10cyclictest419-21sh11:59:390
16809997657,13cyclictest2374-21systemd-journal11:22:000
16809997654,15cyclictest18426-21apt-key09:47:040
16809997654,15cyclictest18426-21apt-key09:47:040
1682199753,27cyclictest20329-21runrttasks07:11:251
16809997560,9cyclictest19967-21timerwakeupswit08:47:350
16809997559,10cyclictest29860-21ssh11:54:220
16809997559,10cyclictest23738-21diskmemload11:27:280
16809997557,12cyclictest2374-21systemd-journal10:07:000
16809997554,15cyclictest298-21in:imuxsock11:23:120
16821997441,8cyclictest181rcu_preempt08:52:141
16821997441,8cyclictest181rcu_preempt08:52:141
1682199733,29cyclictest19900-21timerandwakeup08:47:341
16809997358,8cyclictest0-21swapper/010:31:590
16809997346,20cyclictest32756-21kworker/u17:1+nfsiod12:15:590
16809997346,20cyclictest32756-21kworker/u17:1+nfsiod12:15:590
16809997255,12cyclictest14024-21ntp_kernel_pll_12:22:280
16809997255,12cyclictest14024-21ntp_kernel_pll_12:22:280
16809997252,14cyclictest544-21cron12:21:580
16809997251,15cyclictest300-21rs:main0
1682199713,27cyclictest12608-21latency_hist08:27:041
16809997141,22cyclictest0-21swapper/011:42:020
16809997138,23cyclictest21874-21fschecks_count09:52:210
16809997138,23cyclictest21874-21fschecks_count09:52:210
16809997123,34cyclictest28088-21grep07:32:370
16809997054,9cyclictest0-21swapper/009:37:000
16809997054,9cyclictest0-21swapper/009:37:000
16809997053,11cyclictest7347-21ssh09:27:350
16809997050,14cyclictest19684-21ssh10:42:340
16809997045,19cyclictest23406-21kworker/u17:1+nfsiod09:02:550
16809997044,19cyclictest31368-21kworker/u17:4+nfsiod11:03:460
155172708,35sleep30-21swapper/306:57:263
16809996948,15cyclictest1934-21sh09:18:120
16809996948,15cyclictest1934-21sh09:18:120
16809996947,16cyclictest3976-21latency_hist10:17:030
16809996943,20cyclictest27675-21kworker/u17:2+nfsiod09:10:200
16809996943,20cyclictest27675-21kworker/u17:2+nfsiod09:10:200
16809996852,10cyclictest15901-21acpi08:37:100
16809996841,21cyclictest24227-21kworker/u17:2+nfsiod11:10:110
16809996838,20cyclictest18663-21cat07:07:070
16821996751,11cyclictest352-21runrttasks08:12:331
1680999673,28cyclictest7157-21latency_hist11:17:030
16809996652,8cyclictest0-21swapper/009:49:060
16809996651,8cyclictest0-21swapper/010:22:130
16809996651,8cyclictest0-21swapper/007:37:360
16809996651,8cyclictest0-21swapper/007:37:360
1680999664,32cyclictest28011-21apt-key11:52:030
16809996639,20cyclictest32756-21kworker/u17:1+nfsiod12:30:350
16809996639,20cyclictest32756-21kworker/u17:1+nfsiod12:30:350
16809996639,20cyclictest18903-21kworker/u17:1+nfsiod10:36:450
1680999663,32cyclictest24620-21apt09:57:100
262292652,52sleep026320-21sed07:27:360
16809996548,9cyclictest0-21swapper/008:12:360
16809996548,11cyclictest4699-21ssh12:07:170
1680999654,33cyclictest22259-21df_inode11:42:180
16809996542,16cyclictest31095-21grep09:12:380
1680999643,33cyclictest31709-21awk07:46:590
1680999643,33cyclictest15382-21latency_hist09:42:030
16809996433,21cyclictest2243-21sort07:52:360
16809996330,25cyclictest58-21kcompactd008:32:170
16809996329,25cyclictest17397-21ls07:02:250
16809996329,25cyclictest17397-21ls07:02:250
16809996310,46cyclictest7543-21cron08:11:590
1680999624,39cyclictest12565-21latency_hist08:27:040
1680999624,33cyclictest58-21kcompactd008:42:310
1680999624,32cyclictest20663-21/usr/sbin/munin07:12:320
1680999613,43cyclictest4671-21cpuspeed08:02:170
1680999613,43cyclictest4671-21cpuspeed08:02:170
1680999613,41cyclictest23236-21grep07:17:370
1680999613,31cyclictest12650-21/usr/sbin/munin08:27:180
1680999613,31cyclictest12650-21/usr/sbin/munin08:27:180
16809996130,21cyclictest24277-21cut07:22:260
1680999603,41cyclictest20985-21fschecks_count08:52:220
1680999603,41cyclictest20985-21fschecks_count08:52:220
1680999603,36cyclictest32530-21tune2fs07:48:220
16809996031,20cyclictest23715-21modprobe09:01:590
1680999593,40cyclictest4335-21sh08:02:000
1680999593,40cyclictest4335-21sh08:02:000
255852560,6sleep30-21swapper/307:27:173
188862560,7sleep30-21swapper/309:47:463
1683399502,33cyclictest30234-21chrt10:06:593
1683399494,31cyclictest26843-21taskset10:55:123
1683399494,31cyclictest2280-21taskset11:07:373
1683399493,31cyclictest28286-21taskset11:52:123
1683399483,31cyclictest25629-21taskset11:47:303
1683399483,30cyclictest3538-21taskset12:05:063
1683399483,30cyclictest19992-21taskset10:42:393
1683399482,32cyclictest6334-21chrt12:09:363
1683399474,31cyclictest17059-21taskset09:43:563
1683399474,31cyclictest17059-21taskset09:43:563
1683399474,30cyclictest7847-21taskset08:12:103
1683399473,31cyclictest5861-21chrt11:14:013
1683399473,31cyclictest12175-21taskset12:19:173
1683399473,30cyclictest24226-21taskset11:45:353
1683399473,29cyclictest16162-21taskset11:32:133
1683399473,29cyclictest16162-21taskset11:32:133
1683399473,29cyclictest12977-21chrt10:32:133
1683399463,30cyclictest11515-21taskset09:35:043
1683399463,30cyclictest11515-21taskset09:35:043
1683399463,29cyclictest27756-21taskset10:57:063
1683399463,29cyclictest27756-21taskset10:57:063
1683399463,29cyclictest21823-21taskset10:47:093
1683399453,31cyclictest16561-21chrt10:37:323
1683399453,30cyclictest5972-21taskset08:07:003
1683399453,30cyclictest5972-21taskset08:07:003
1683399453,30cyclictest3683-21chrt07:57:363
1683399453,30cyclictest3683-21chrt07:57:363
1683399453,30cyclictest32223-21chrt07:47:233
1683399453,30cyclictest23429-21taskset09:54:313
1683399453,30cyclictest23429-21taskset09:54:313
1683399453,30cyclictest16458-21chrt12:27:153
1683399453,30cyclictest16458-21chrt12:27:153
1683399453,30cyclictest1107-21chrt10:12:143
1683399453,29cyclictest27251-21taskset09:07:193
1683399453,29cyclictest27251-21taskset09:07:193
1683399453,29cyclictest25213-21taskset07:26:533
1683399453,29cyclictest1829-21taskset09:17:533
1683399453,29cyclictest1829-21taskset09:17:533
1683399453,29cyclictest12525-21chrt09:37:113
1683399453,28cyclictest31932-21taskset11:02:503
1683399453,24cyclictest9577-21chrt11:21:113
1683399452,32cyclictest28753-21chrt07:37:143
1683399452,32cyclictest28753-21chrt07:37:143
1683399452,29cyclictest4066-21taskset10:17:133
1683399452,29cyclictest4066-21taskset10:17:133
1683399444,29cyclictest6791-21chrt09:27:223
1683399444,26cyclictest5216-21taskset09:24:063
1683399443,30cyclictest22639-21chrt07:17:253
1683399443,30cyclictest18489-21chrt08:42:363
1683399443,29cyclictest9804-21taskset08:17:253
1683399443,29cyclictest7604-21taskset12:12:153
1683399443,29cyclictest7604-21taskset12:12:153
1683399443,29cyclictest30886-21taskset07:42:283
1683399443,29cyclictest30060-21taskset09:12:103
1683399443,29cyclictest21135-21chrt07:12:273
1683399443,29cyclictest18375-21taskset07:07:003
1683399443,29cyclictest18375-21taskset07:07:003
1683399443,29cyclictest13406-21taskset12:22:043
1683399443,29cyclictest13406-21taskset12:22:043
1683399443,29cyclictest11218-21taskset08:22:193
1683399442,29cyclictest14211-21taskset08:32:033
1683399442,29cyclictest14211-21taskset08:32:033
1683399442,28cyclictest19125-21taskset11:37:123
1683399433,30cyclictest13535-21chrt11:27:233
1683399433,29cyclictest25947-21taskset09:58:163
1683399433,29cyclictest10774-21taskset10:27:353
1683399433,28cyclictest23385-21taskset08:57:433
1683399433,28cyclictest19143-21chrt08:47:143
1683399433,27cyclictest18593-21chrt07:07:043
1683399432,31cyclictest26206-21taskset09:05:333
1683399432,29cyclictest8223-21taskset10:22:573
1683399432,29cyclictest6180-21taskset08:07:043
1683399432,29cyclictest27300-21chrt07:32:203
1683399432,28cyclictest15888-21taskset08:37:053
1683399432,28cyclictest10316-21taskset11:22:163
1683399423,28cyclictest14317-21chrt08:32:153
1683399423,28cyclictest1385-21taskset07:52:133
1683399423,27cyclictest20782-21taskset08:52:163
1683399423,27cyclictest20782-21taskset08:52:163
1683399413,28cyclictest31111-21chrt11:57:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional