You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 18:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 29, 2026 12:44:30)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8991214812,91sleep09009-21latency_hist06:56:040
9080991183,77cyclictest22774-21apt-get07:36:502
9080991073,79cyclictest26743-21apt-get11:01:202
90779910340,9cyclictest0-21swapper/108:36:041
9077991003,70cyclictest3747-21apt-get11:16:171
9077999855,36cyclictest16968-21kworker/u17:3-rpciod11:56:341
9077999855,36cyclictest16968-21kworker/u17:3-rpciod11:56:341
9077999840,8cyclictest0-21swapper/107:56:231
908099975,68cyclictest4043-21cstates11:16:472
9080999755,35cyclictest28370-21latency_hist09:16:052
9080999755,35cyclictest28370-21latency_hist09:16:052
82952948,58sleep28346-21sed06:51:462
9077999241,13cyclictest4195-21unixbench_multi08:16:381
9080999153,31cyclictest352-21runrttasks09:06:392
9069999153,26cyclictest19711-21kworker/u18:1+flush-179:011:01:280
908099903,29cyclictest4819-21ssh12:11:342
908099902,26cyclictest14782-21tune2fs07:11:242
9080999018,30cyclictest7001-21fschecks_time11:21:242
9077999041,12cyclictest16837-21latency_hist09:51:041
9069998954,14cyclictest14549-21ssh11:33:390
908099884,27cyclictest29984-21/usr/sbin/munin11:06:402
908099883,35cyclictest20294-21unixbench_multi07:26:382
908099883,32cyclictest352-21runrttasks07:44:142
908099883,32cyclictest352-21runrttasks07:44:142
908099883,29cyclictest29551-21ssh10:11:282
908099883,29cyclictest29551-21ssh10:11:282
9077998839,14cyclictest15974-21diskmemload10:21:361
908099874,29cyclictest19689-21sh09:01:422
908099874,29cyclictest19689-21sh09:01:422
908099873,23cyclictest2348-21/usr/sbin/munin08:11:352
9069998758,23cyclictest297-21systemd-logind09:31:010
908099863,27cyclictest6751-21fschecks_count08:26:252
908099862,26cyclictest19579-21timerandwakeup11:41:382
9080998616,7cyclictest0-21swapper/209:34:042
9080998616,7cyclictest0-21swapper/209:34:042
908099853,39cyclictest3547-21fschecks_time08:16:242
908099853,38cyclictest12047-21awk07:01:382
9080998533,45cyclictest0-21swapper/211:36:402
908099853,30cyclictest15034-21ssh09:46:382
908099853,29cyclictest11308-21cat10:36:032
9080998517,27cyclictest4714-21sh09:30:572
9080998469,10cyclictest9061-21cyclictest11:56:192
9080998469,10cyclictest9061-21cyclictest11:56:192
9080998458,18cyclictest352-21runrttasks08:36:362
9080998458,18cyclictest352-21runrttasks08:36:362
9080998437,39cyclictest0-21swapper/207:31:182
908099843,40cyclictest8906-21find09:36:372
908099843,28cyclictest3487-21timerwakeupswit10:21:372
908099843,26cyclictest365-21/usr/sbin/munin08:06:242
908099843,26cyclictest365-21/usr/sbin/munin08:06:242
908099843,24cyclictest17872-21grep10:46:252
9080998430,47cyclictest0-21swapper/211:00:592
9080998430,47cyclictest0-21swapper/211:00:592
9080998430,46cyclictest0-21swapper/212:06:122
908099842,38cyclictest3489-21latency_hist11:16:042
892028413,42sleep18941-21munin-run06:56:011
9080998340,33cyclictest0-21swapper/210:06:322
908099833,39cyclictest10748-21ntp_states12:21:312
908099833,33cyclictest17353-21grep09:51:252
908099833,29cyclictest1059-21ls12:06:042
908099833,28cyclictest31372-21netstat08:01:282
908099833,28cyclictest31372-21netstat08:01:282
9080998325,48cyclictest0-21swapper/208:56:032
9080998325,48cyclictest0-21swapper/208:56:032
908099832,27cyclictest13155-21fschecks_time07:06:242
908099832,25cyclictest14909-21if_eth010:41:252
9077998364,14cyclictest29254-21latency_hist07:56:051
9069998352,24cyclictest8182-21ssh09:36:190
45182830,10sleep0211rcuc/011:16:590
908099823,31cyclictest25170-21ssh11:51:262
908099823,25cyclictest29505-21grep09:16:392
908099823,25cyclictest15401-21sh11:36:002
9080998232,43cyclictest0-21swapper/210:01:242
908099823,13cyclictest0-21swapper/211:48:402
908099823,13cyclictest0-21swapper/211:48:402
9080998229,45cyclictest0-21swapper/209:21:202
9080998229,45cyclictest0-21swapper/209:21:202
9080998229,44cyclictest0-21swapper/211:26:382
908099822,25cyclictest30070-21timerandwakeup07:56:362
9080998218,29cyclictest5757-21ssh10:26:222
9069998225,29cyclictest0-21swapper/012:10:050
908099813,29cyclictest352-21runrttasks07:24:372
908099813,26cyclictest21560-21unixbench_multi10:51:382
908099813,23cyclictest11780-21/usr/sbin/munin08:41:252
9080998125,48cyclictest0-21swapper/209:56:302
9080998124,47cyclictest0-21swapper/212:21:042
9080998124,47cyclictest0-21swapper/212:21:042
908099812,28cyclictest16401-21fschecks_time07:16:242
908099812,27cyclictest12535-21unixbench_multi10:36:382
908099812,27cyclictest12535-21unixbench_multi10:36:382
9069998144,26cyclictest18023-21fschecks_time07:21:240
906999813,49cyclictest26653-21latency_hist11:01:060
906999813,49cyclictest26653-21latency_hist11:01:060
908099803,31cyclictest32589-21ssh10:16:312
908099803,22cyclictest5058-21/usr/sbin/munin08:21:192
908099802,29cyclictest28620-21unixbench_multi07:51:392
908099802,28cyclictest13822-21runrttasks08:46:382
908099802,26cyclictest13915-21latency_hist09:46:042
908099802,26cyclictest13915-21latency_hist09:46:042
908099793,36cyclictest26181-21ls07:46:192
908099793,23cyclictest17182-21cat08:56:392
908099792,26cyclictest9458-21fschecks_count06:56:232
9077997960,13cyclictest9879-21mailstats06:56:341
9077997956,15cyclictest6043-21sh09:31:391
9077997956,15cyclictest6043-21sh09:31:391
908099783,26cyclictest8598-21/usr/sbin/munin08:31:282
907799783,53cyclictest26743-21apt-get11:01:281
9069997855,16cyclictest7078-21latency_hist12:16:040
9077997750,15cyclictest0-21swapper/111:41:031
907799773,63cyclictest22895-21taskset07:36:501
9069997761,11cyclictest9061-21cyclictest12:21:330
9069997761,11cyclictest9061-21cyclictest10:02:100
908599763,35cyclictest27182-21chrt11:01:583
9077997657,14cyclictest1319-21kworker/u19:2+events_unbound08:46:011
9077997655,15cyclictest17663-21latency_hist07:21:041
9077997628,16cyclictest0-21swapper/107:01:311
9077997558,11cyclictest23102-21ntp_kernel_pll_09:06:301
9077997550,14cyclictest181rcu_preempt08:21:231
9077997550,10cyclictest20192-21sshd09:02:381
9077997550,10cyclictest20192-21sshd09:02:381
9069997556,12cyclictest1-21systemd12:21:020
9069997556,12cyclictest1-21systemd12:21:020
9069997554,15cyclictest8730-21processes08:31:330
908599745,39cyclictest0-21swapper/307:36:493
9077997460,7cyclictest0-21swapper/112:17:141
9077997460,7cyclictest0-21swapper/112:17:141
9077997455,14cyclictest32417-21latency_hist08:06:041
9077997455,14cyclictest32417-21latency_hist08:06:041
9069997458,11cyclictest9061-21cyclictest11:50:080
9069997458,11cyclictest9061-21cyclictest11:50:080
9069997456,12cyclictest2374-21systemd-journal07:36:070
9069997456,11cyclictest17455-21kernelversion09:51:280
9069997455,13cyclictest25217-21sh11:51:280
908599733,28cyclictest26921-21taskset07:46:383
908599733,27cyclictest19509-21taskset09:01:113
908599733,27cyclictest19509-21taskset09:01:113
9077997356,11cyclictest912-21systemd-run12:06:021
9077997349,9cyclictest181rcu_preempt09:46:051
9077997349,9cyclictest181rcu_preempt09:46:051
9069997324,39cyclictest30956-21grep12:01:250
906999731,34cyclictest23112-21tune2fs07:37:050
9077997257,8cyclictest0-21swapper/112:11:301
9077997254,9cyclictest0-21swapper/110:11:371
9077997254,9cyclictest0-21swapper/110:11:371
9077997254,12cyclictest23221-21fschecks_count10:01:231
9077997251,8cyclictest181rcu_preempt08:11:251
9077997248,17cyclictest31818-21fschecks_time09:21:251
9077997248,17cyclictest31818-21fschecks_time09:21:251
9069997252,14cyclictest2374-21systemd-journal07:15:000
9077997152,13cyclictest12424-21timerandwakeup10:36:371
9077997152,13cyclictest12424-21timerandwakeup10:36:371
9077997151,14cyclictest18968-21munin-run09:01:011
9077997149,13cyclictest0-21swapper/107:46:031
9077997149,13cyclictest0-21swapper/107:46:031
9077997148,15cyclictest15118-21ntp_offset10:41:301
9077997145,11cyclictest181rcu_preempt09:53:541
9069997155,12cyclictest9061-21cyclictest11:43:190
9069997155,11cyclictest9061-21cyclictest07:16:310
9069997149,15cyclictest15974-21diskmemload10:51:270
906999714,57cyclictest2656-21cstates10:21:190
906999714,37cyclictest19000-21apt-config09:01:020
906999714,37cyclictest16744-21modprobe09:51:010
9069997124,23cyclictest181rcu_preempt11:21:290
9077997055,9cyclictest8669-21diskmemload10:31:181
9077997055,9cyclictest27431-21munin-run07:51:011
9077997047,13cyclictest0-21swapper/110:26:231
9069997054,10cyclictest352-21runrttasks10:46:360
9069997054,10cyclictest32703-21ssh10:16:350
9069997051,13cyclictest17810-21ssh11:39:250
9069997044,20cyclictest6319-21ssh10:26:340
9069997031,30cyclictest21086-21grep09:56:390
81792700,7sleep30-21swapper/309:36:193
908599693,25cyclictest32503-21chrt09:21:393
908599693,25cyclictest32503-21chrt09:21:393
908599692,31cyclictest29626-21taskset11:59:063
908599692,31cyclictest29626-21taskset11:59:063
908599692,27cyclictest4359-21chrt10:23:403
9077996954,8cyclictest0-21swapper/109:16:011
9077996954,8cyclictest0-21swapper/109:16:011
9077996948,15cyclictest17539-21acpi10:46:131
906999698,35cyclictest12478-21latency_hist11:31:020
9069996953,11cyclictest9061-21cyclictest10:46:040
906999694,54cyclictest27657-21acpi11:56:130
906999694,54cyclictest27657-21acpi11:56:130
908599683,24cyclictest14559-21chrt09:46:283
9085996811,31cyclictest0-21swapper/311:16:203
9077996851,10cyclictest0-21swapper/112:21:111
9077996849,14cyclictest20053-21ssh09:56:171
9069996851,9cyclictest0-21swapper/011:06:400
9069996851,11cyclictest9061-21cyclictest07:01:050
9069996849,11cyclictest13754-21ssh10:39:480
9069996849,11cyclictest13754-21ssh10:39:480
9069996848,14cyclictest28980-21/usr/sbin/munin10:11:270
9069996848,14cyclictest28980-21/usr/sbin/munin10:11:270
9069996834,27cyclictest0-21swapper/008:16:130
9077996748,12cyclictest23510-21/usr/sbin/munin10:56:251
9077996748,12cyclictest23510-21/usr/sbin/munin10:56:251
9077996744,16cyclictest11085-21ntpd11:08:241
9077996744,15cyclictest2374-21systemd-journal11:28:381
9077996739,20cyclictest1425-21modprobe08:11:001
9077996739,20cyclictest1425-21modprobe08:11:001
9069996750,11cyclictest26133-21ssh10:06:170
906999674,34cyclictest11218-21sh10:36:000
9069996735,25cyclictest0-21swapper/009:16:240
906999673,46cyclictest27787-21ls07:51:190
9077996649,9cyclictest0-21swapper/110:51:221
9077996645,15cyclictest14512-21latency_hist08:51:041
9077996645,11cyclictest0-21swapper/107:31:231
9077996641,15cyclictest9061-21cyclictest11:31:401
9077996632,14cyclictest170-21jbd2/mmcblk2p2-811:44:481
9077996627,15cyclictest0-21swapper/111:56:041
9077996620,26cyclictest7728-21sh11:21:391
906999668,28cyclictest32295-21sendmail-msp08:06:020
906999668,28cyclictest32295-21sendmail-msp08:06:020
9069996644,16cyclictest1591-21latency_hist08:11:040
9069996644,16cyclictest1591-21latency_hist08:11:040
9069996637,8cyclictest181rcu_preempt09:31:180
9069996637,8cyclictest181rcu_preempt09:31:180
906999663,41cyclictest1539-21grep11:11:390
906999663,35cyclictest18955-21apt-get09:01:150
906999663,35cyclictest18955-21apt-get09:01:150
9077996550,10cyclictest9061-21cyclictest11:13:551
9077996528,25cyclictest4755-21basename09:31:001
9069996548,9cyclictest181rcu_preempt07:01:180
906999654,48cyclictest15963-21latency_hist08:56:050
906999654,48cyclictest15963-21latency_hist08:56:050
906999654,44cyclictest6788-21fschecks_time08:26:260
906999654,31cyclictest11006-21/usr/sbin/munin09:41:290
906999654,31cyclictest11006-21/usr/sbin/munin09:41:290
906999654,29cyclictest26294-21mailstats09:11:350
906999654,29cyclictest26294-21mailstats09:11:350
906999653,50cyclictest19369-21/usr/sbin/munin07:26:220
906999653,47cyclictest26271-21fschecks_count07:46:230
906999653,47cyclictest14363-21idleruntime-cro08:51:010
906999653,44cyclictest3048-21modprobe08:16:010
906999653,26cyclictest30634-21modprobe08:01:010
282472650,5sleep30-21swapper/309:16:033
282472650,5sleep30-21swapper/309:16:033
908599643,27cyclictest18087-21chrt08:58:363
9077996451,9cyclictest58-21kcompactd009:16:391
9077996448,10cyclictest3307-21kworker/u17:3-nfsiod09:36:271
9077996447,8cyclictest0-21swapper/108:51:271
9077996447,8cyclictest0-21swapper/108:51:271
9077996447,7cyclictest0-21swapper/112:06:351
9077996447,12cyclictest277-21dbus-daemon10:21:021
9077996429,10cyclictest0-21swapper/111:50:551
9077996429,10cyclictest0-21swapper/111:50:551
906999643,45cyclictest22847-21fschecks_time09:06:250
9069996424,16cyclictest181rcu_preempt08:21:370
9077996348,8cyclictest0-21swapper/107:11:351
9077996344,8cyclictest0-21swapper/107:26:241
907799634,22cyclictest10613-21sshd08:36:381
907799634,22cyclictest10613-21sshd08:36:381
9077996342,14cyclictest6807-21fschecks_time08:26:261
906999634,40cyclictest9746-21/usr/sbin/munin08:36:300
906999634,40cyclictest9746-21/usr/sbin/munin08:36:300
9069996319,32cyclictest2017-21cat09:26:050
9069996313,9cyclictest181rcu_preempt07:06:240
908599624,27cyclictest25922-21chrt11:52:003
9077996230,8cyclictest181rcu_preempt07:06:361
906999622,49cyclictest31545-21ssh09:21:140
149842620,6sleep30-21swapper/311:34:543
9077996145,12cyclictest9061-21cyclictest07:23:131
906999613,32cyclictest24709-21fschecks_time07:41:250
906999613,32cyclictest24709-21fschecks_time07:41:250
9077996045,9cyclictest27106-21/usr/sbin/munin10:06:371
906999603,32cyclictest11355-21/usr/sbin/munin08:41:250
834725913,29sleep30-21swapper/306:51:473
908599583,35cyclictest5374-21taskset09:31:243
908599583,35cyclictest5374-21taskset09:31:243
908599573,38cyclictest23813-21chrt11:49:293
908599573,38cyclictest23813-21chrt11:49:293
908599553,35cyclictest22210-21chrt07:34:383
908599552,35cyclictest9676-21chrt12:20:383
908599552,35cyclictest9676-21chrt12:20:383
908599552,34cyclictest22060-21chrt09:59:173
908599543,34cyclictest917-21kworker/3:1+events11:42:003
908599542,35cyclictest13761-21taskset10:39:493
908599542,35cyclictest13761-21taskset10:39:493
908599532,34cyclictest30277-21taskset07:56:383
908599532,34cyclictest15339-21taskset10:41:363
908599523,33cyclictest1705-21chrt08:11:163
908599523,32cyclictest27874-21taskset07:51:233
908599523,31cyclictest8182-21taskset08:31:173
908599522,34cyclictest7972-21chrt10:30:213
908599522,34cyclictest3126-21chrt12:08:593
908599522,33cyclictest23505-21chrt10:01:283
908599522,33cyclictest20128-21chrt10:50:473
908599522,32cyclictest4307-21taskset08:16:473
9085995135,9cyclictest239142sleep310:56:273
9085995135,9cyclictest239142sleep310:56:273
908599512,30cyclictest17097-21chrt11:37:253
908599503,34cyclictest21063-21chrt10:51:283
908599503,31cyclictest30481-21taskset09:19:083
908599493,29cyclictest12708-21chrt07:06:033
908599492,33cyclictest10849-21taskset11:26:393
908599492,30cyclictest602-21taskset11:11:193
908599492,30cyclictest5495-21taskset12:12:153
908599482,31cyclictest32141-21taskset12:02:463
908599472,34cyclictest6746-21chrt11:21:163
908599463,29cyclictest17763-21chrt07:21:183
908599462,33cyclictest13118-21taskset09:44:253
908599462,33cyclictest13118-21taskset09:44:253
908599453,30cyclictest29032-21taskset10:11:163
908599453,30cyclictest29032-21taskset10:11:163
908599453,29cyclictest31054-21taskset08:01:203
908599453,29cyclictest31054-21taskset08:01:203
908599453,29cyclictest10300-21taskset08:36:323
908599453,29cyclictest10300-21taskset08:36:323
908599453,28cyclictest4894-21chrt09:31:043
908599453,26cyclictest16336-21chrt07:16:243
908599453,25cyclictest9395-21chrt06:56:193
9085994528,9cyclictest451rcuc/311:06:493
908599452,27cyclictest28871-21chrt10:11:043
908599443,30cyclictest25422-21taskset07:41:393
908599443,30cyclictest25422-21taskset07:41:393
908599443,29cyclictest23115-21taskset09:06:313
908599443,27cyclictest10111-21chrt10:32:563
908599442,29cyclictest19008-21chrt09:54:063
908599442,29cyclictest10315-21chrt12:21:193
908599433,31cyclictest6208-21chrt08:25:383
908599433,27cyclictest12901-21chrt08:46:043
908599432,29cyclictest19649-21taskset07:26:243
908599423,27cyclictest32551-21chrt08:06:143
908599423,27cyclictest32551-21chrt08:06:143
908599413,27cyclictest1044-21chrt10:17:493
908599412,26cyclictest15244-21chrt08:51:353
908599412,26cyclictest15244-21chrt08:51:353
908599403,24cyclictest14512-21taskset07:11:053
908599402,28cyclictest14325-21taskset08:50:503
908599402,26cyclictest6553-21chrt08:26:153
908599392,26cyclictest12940-21taskset07:06:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional