You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-15 - 15:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Wed Jul 15, 2026 12:44:31)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1229226670,38sleep30-21swapper/306:56:583
11166214913,92sleep211217-21fschecks_time06:52:502
12385991134,95cyclictest30338-21apt-get11:02:140
1219921136,86sleep00-21swapper/006:56:150
12385991052,84cyclictest19755-21kworker/u19:1+ext4-rsv-conversion09:07:280
12388999961,21cyclictest6462-21taskset10:22:281
12388999961,21cyclictest6462-21taskset10:22:281
12385999972,17cyclictest277-21dbus-daemon07:27:000
274542960,8sleep30-21swapper/307:41:343
1238599963,74cyclictest10127-21runrttasks08:27:230
1238599963,74cyclictest10127-21runrttasks08:27:230
1238599961,56cyclictest21525-21ssh11:42:010
1238599961,56cyclictest21525-21ssh11:42:010
1238599949,66cyclictest5803-21apt-get10:22:140
1238599949,66cyclictest5803-21apt-get10:22:140
12392999171,14cyclictest9826-21latency_hist08:27:012
12392999171,14cyclictest9826-21latency_hist08:27:012
1238599883,64cyclictest13931-21apt07:01:590
1238599883,64cyclictest13931-21apt07:01:590
12392998767,14cyclictest26966-21latency_hist10:57:002
1238599873,41cyclictest23968-21grep09:57:200
12392998667,13cyclictest10694-21sh12:17:422
12392998667,13cyclictest10694-21sh12:17:422
12388998620,28cyclictest0-21swapper/110:10:321
12388998523,23cyclictest7632-21seq08:17:491
12388998523,23cyclictest7632-21seq08:17:491
12388998521,27cyclictest30970-21seq09:14:051
12388998521,27cyclictest30970-21seq09:14:051
1091328514,45sleep110433-21apt-get06:52:121
12388998423,22cyclictest9095-21ssh11:20:591
12388998422,25cyclictest25710-21seq07:34:431
1238599845,60cyclictest16801-21apt-get08:47:130
12388998361,15cyclictest32485-21latency_hist07:57:011
12388998355,19cyclictest17735-21sh09:47:051
12388998333,39cyclictest0-21swapper/110:17:111
12388998329,23cyclictest20651-21seq10:46:191
1239299822,53cyclictest10100-21apt-get08:27:142
1239299822,53cyclictest10100-21apt-get08:27:142
12388998232,37cyclictest0-21swapper/107:12:131
12388998221,24cyclictest352-21runrttasks08:38:181
12385998229,11cyclictest181rcu_preempt08:53:000
12392998163,12cyclictest2850-21/usr/sbin/munin09:22:182
12392998163,12cyclictest2850-21/usr/sbin/munin09:22:182
12388998125,22cyclictest20701-21ssh11:40:121
12388998125,22cyclictest20701-21ssh11:40:121
12388998123,22cyclictest14522-21seq11:29:281
12385998159,14cyclictest14627-21ssh09:42:010
12385998138,16cyclictest181rcu_preempt12:07:080
12385998125,30cyclictest8525-21kworker/0:1-cgroup_destroy10:17:000
12388998042,8cyclictest181rcu_preempt11:22:321
12388998042,8cyclictest181rcu_preempt11:22:321
12388998038,16cyclictest181rcu_preempt08:57:211
12388998019,26cyclictest0-21swapper/112:03:401
12388998019,26cyclictest0-21swapper/112:03:401
12385998029,10cyclictest181rcu_preempt08:12:300
12392997956,15cyclictest20851-21sort09:52:162
12392997956,15cyclictest20851-21sort09:52:162
12388997923,26cyclictest352-21runrttasks12:13:291
12388997921,26cyclictest0-21swapper/108:50:051
12388997921,24cyclictest23010-21seq07:27:501
12385997955,15cyclictest17664-21ssh11:35:010
12385997945,11cyclictest181rcu_preempt09:32:130
12385997945,11cyclictest181rcu_preempt09:32:130
12385997944,14cyclictest181rcu_preempt09:47:240
12385997940,21cyclictest181rcu_preempt10:56:130
12385997936,20cyclictest12377-21cyclictest08:22:220
12385997936,20cyclictest12377-21cyclictest08:22:220
1238599793,38cyclictest9625-21fschecks_time10:27:210
1238599792,47cyclictest16015-21sendmail-msp07:06:580
12392997860,12cyclictest19771-21diskmemload09:19:562
12388997858,14cyclictest16953-21apt-config09:45:411
12388997858,14cyclictest16953-21apt-config09:45:411
12388997824,43cyclictest0-21swapper/108:22:101
12388997824,43cyclictest0-21swapper/108:22:101
12385997859,13cyclictest27339-21latency_hist11:52:000
12385997858,13cyclictest12377-21cyclictest09:27:210
12385997855,14cyclictest31275-21ssh10:09:010
1238599785,15cyclictest13374-21ntp_states11:27:280
12385997849,12cyclictest181rcu_preempt09:17:100
12385997843,12cyclictest181rcu_preempt07:57:160
1238599783,45cyclictest23114-21ssh09:02:120
12385997833,10cyclictest181rcu_preempt07:30:120
12392997762,11cyclictest12377-21cyclictest11:55:202
12392997762,11cyclictest12377-21cyclictest11:55:202
12392997758,12cyclictest300-21rs:main2
12392997755,15cyclictest18431-21latency_hist11:37:002
12392997746,9cyclictest181rcu_preempt07:32:342
12388997753,16cyclictest19771-21diskmemload10:57:371
12388997728,44cyclictest0-21swapper/112:17:121
12388997728,44cyclictest0-21swapper/112:17:121
12388997720,24cyclictest23151-21runrttasks09:56:181
12388997720,24cyclictest23151-21runrttasks09:56:181
12388997718,27cyclictest20390-21unixbench_multi07:17:361
12385997753,8cyclictest181rcu_preempt09:15:320
12385997753,8cyclictest181rcu_preempt09:15:320
12385997752,9cyclictest181rcu_preempt08:02:210
12385997748,9cyclictest181rcu_preempt11:15:520
12385997748,9cyclictest181rcu_preempt11:15:520
12385997747,13cyclictest181rcu_preempt07:07:120
12385997738,12cyclictest181rcu_preempt08:32:550
1238599773,47cyclictest20419-21fschecks_time08:57:210
12392997660,9cyclictest0-21swapper/211:07:282
12392997656,14cyclictest12377-21cyclictest07:07:362
12392997655,15cyclictest27264-21sh11:51:582
12392997650,10cyclictest181rcu_preempt08:12:312
12388997632,33cyclictest0-21swapper/112:22:141
12388997630,35cyclictest0-21swapper/108:12:111
12388997626,38cyclictest0-21swapper/108:07:141
12385997662,10cyclictest12377-21cyclictest12:02:540
12385997662,10cyclictest12377-21cyclictest12:02:540
12385997657,14cyclictest12377-21cyclictest10:37:230
12385997645,9cyclictest181rcu_preempt09:52:370
12385997645,9cyclictest181rcu_preempt09:52:370
60392750,8sleep30-21swapper/309:27:183
12392997554,15cyclictest32123-21latency_hist09:17:012
12392997554,15cyclictest32123-21latency_hist09:17:012
12388997555,14cyclictest1831-21sh09:19:591
1238899754,47cyclictest31025-21ssh11:03:401
12388997529,40cyclictest0-21swapper/111:32:111
12385997558,11cyclictest19676-21snmpd09:42:310
12385997558,11cyclictest19676-21snmpd09:42:310
12385997545,8cyclictest181rcu_preempt07:17:360
12385997541,12cyclictest181rcu_preempt10:20:110
12385997541,12cyclictest181rcu_preempt07:47:240
12385997537,28cyclictest0-21swapper/011:17:370
12385997535,13cyclictest181rcu_preempt10:47:200
1238599752,37cyclictest29828-21apt-config11:01:590
1238599752,37cyclictest16289-21systemctl08:46:580
12392997460,10cyclictest12377-21cyclictest09:51:582
12392997458,10cyclictest9620-21ssh12:16:572
12392997456,12cyclictest2374-21systemd-journal10:31:122
12392997454,14cyclictest15403-21netstat08:42:262
12392997453,14cyclictest19771-21diskmemload12:07:022
12392997451,16cyclictest15564-21fschecks_time10:37:212
1239299742,48cyclictest30381-21ssh11:02:152
12388997435,25cyclictest16270-21apt-get07:07:141
12388997427,38cyclictest4247-21ssh11:12:211
12388997427,38cyclictest4247-21ssh11:12:211
12388997423,39cyclictest0-21swapper/107:47:141
1238599749,40cyclictest15-21ksoftirqd/010:02:230
1238599749,40cyclictest15-21ksoftirqd/010:02:230
12385997450,9cyclictest181rcu_preempt11:22:280
12385997450,9cyclictest181rcu_preempt11:22:280
12385997445,15cyclictest181rcu_preempt11:08:270
12385997444,8cyclictest181rcu_preempt07:37:010
1238599743,58cyclictest12960-21sshd12:22:140
12385997424,10cyclictest181rcu_preempt12:12:150
12392997355,11cyclictest277-21dbus-daemon08:11:592
12388997352,14cyclictest425-21sh10:12:211
12388997328,35cyclictest14434-21munin-run09:41:571
12388997325,40cyclictest27497-21modprobe07:41:581
12385997352,16cyclictest4107-21ssh09:22:590
12385997352,16cyclictest4107-21ssh09:22:590
1238599733,55cyclictest18595-21switchtime07:12:320
12392997252,13cyclictest11032-21sh09:35:482
12392997252,13cyclictest11032-21sh09:35:482
12392997248,15cyclictest12377-21cyclictest08:22:002
12392997248,15cyclictest12377-21cyclictest08:22:002
12392997247,17cyclictest22728-21apt-key07:27:032
1239299723,50cyclictest30094-21ssh11:02:012
12392997234,24cyclictest12625-21grep11:27:012
12392997234,24cyclictest12625-21grep11:27:012
12392997218,35cyclictest15753-21mktemp12:27:002
12388997227,38cyclictest0-21swapper/109:02:111
12388997225,36cyclictest30732-21ssh11:57:161
12385997249,8cyclictest181rcu_preempt08:17:170
12385997249,8cyclictest181rcu_preempt08:17:170
12385997249,17cyclictest4857-21latency_hist08:12:010
12385997239,12cyclictest181rcu_preempt10:42:030
12385997238,13cyclictest181rcu_preempt07:37:280
12385997236,17cyclictest181rcu_preempt08:37:200
12385997236,13cyclictest181rcu_preempt10:32:270
12392997155,9cyclictest0-21swapper/209:27:162
12392997151,14cyclictest24736-21unixbench_multi09:57:352
12392997151,10cyclictest0-21swapper/208:32:542
12392997131,31cyclictest2693-21sh10:16:362
12388997154,11cyclictest21201-21/usr/sbin/munin10:47:151
1238899713,53cyclictest3491-21ntp_states09:22:291
1238899713,53cyclictest3491-21ntp_states09:22:291
12388997135,21cyclictest11715-21apt-get08:32:101
12388997128,33cyclictest6433-21ntp_kernel_pll_09:27:281
12388997125,41cyclictest0-21swapper/108:02:151
12388997122,35cyclictest11661-21latency_hist09:37:021
12388997122,35cyclictest11661-21latency_hist09:37:021
12388997120,22cyclictest0-21swapper/107:26:041
12388997119,27cyclictest14961-21modprobe10:36:581
12385997152,13cyclictest12377-21cyclictest07:52:170
12385997136,21cyclictest181rcu_preempt11:42:120
1239299703,56cyclictest26979-21/usr/sbin/munin09:08:302
12392997035,25cyclictest0-21swapper/212:07:352
1239299703,35cyclictest2031-21fschecks_time08:02:212
12392997015,12cyclictest181rcu_preempt11:12:332
12392997015,12cyclictest181rcu_preempt11:12:332
1238899704,45cyclictest352-21runrttasks07:06:461
12388997018,27cyclictest0-21swapper/111:52:581
12388997018,27cyclictest0-21swapper/111:52:581
12388997018,27cyclictest0-21swapper/108:55:481
12385997037,11cyclictest181rcu_preempt11:52:210
12385997037,11cyclictest181rcu_preempt11:52:210
1239999692,57cyclictest26414-21chrt09:07:193
12392996954,10cyclictest12377-21cyclictest07:17:172
12392996951,12cyclictest6712-21cpuspeed10:23:012
12392996951,12cyclictest6712-21cpuspeed10:23:012
12392996951,12cyclictest12073-21sh09:37:222
1239299694,56cyclictest14750-21ssh09:42:092
1239299694,56cyclictest14750-21ssh09:42:092
12392996945,12cyclictest0-21swapper/210:22:022
12392996936,24cyclictest20819-21wc08:57:322
12388996954,10cyclictest12377-21cyclictest08:42:361
12388996949,15cyclictest12377-21cyclictest07:42:461
12388996929,34cyclictest0-21swapper/110:52:151
12388996928,36cyclictest0-21swapper/111:07:131
12385996936,8cyclictest181rcu_preempt12:22:010
12385996936,8cyclictest181rcu_preempt12:22:010
12385996932,16cyclictest181rcu_preempt11:59:500
1239299688,14cyclictest181rcu_preempt06:57:212
1239299688,14cyclictest181rcu_preempt06:57:212
1239299685,47cyclictest352-21runrttasks12:03:112
12392996850,11cyclictest2374-21systemd-journal10:10:122
12392996849,11cyclictest0-21swapper/207:56:582
12392996841,21cyclictest25619-21kworker/u19:0+nfsiod10:47:232
12388996822,33cyclictest25690-21ssh10:00:061
1239999678,40cyclictest0-21swapper/310:22:203
1239999678,40cyclictest0-21swapper/310:22:203
1239999676,37cyclictest0-21swapper/311:02:213
12392996748,11cyclictest31125-21ntp_kernel_pll_11:57:262
12392996747,15cyclictest0-21swapper/208:52:362
12392996747,10cyclictest0-21swapper/207:12:232
12392996745,14cyclictest0-21swapper/210:42:372
12392996743,14cyclictest0-21swapper/208:37:342
12388996751,10cyclictest19676-21snmpd10:03:361
12388996751,10cyclictest19676-21snmpd10:03:361
12388996747,9cyclictest0-21swapper/112:07:341
1238899673,44cyclictest12120-21latency_hist10:32:001
12388996730,33cyclictest0-21swapper/111:47:101
12388996729,27cyclictest0-21swapper/107:57:101
1238599673,46cyclictest27819-21cpu07:42:160
12392996648,10cyclictest0-21swapper/207:51:582
12392996646,14cyclictest19771-21diskmemload10:02:352
12392996646,14cyclictest19771-21diskmemload10:02:352
12392996642,17cyclictest25786-21latency_hist09:07:032
12388996646,11cyclictest0-21swapper/111:42:131
1238899663,46cyclictest26322-21ssh09:07:081
226022650,3sleep3451rcuc/309:01:313
12392996548,11cyclictest6943-21diskmemload11:17:172
12392996543,12cyclictest0-21swapper/211:42:212
12392996538,20cyclictest15982-21cut07:07:002
12388996547,12cyclictest25619-21kworker/u19:0-nfsiod10:42:001
12392996445,12cyclictest0-21swapper/207:28:462
12392996441,17cyclictest0-21swapper/207:47:012
1239299643,23cyclictest16277-21apt-get08:47:122
12392996418,27cyclictest19771-21diskmemload11:30:532
1238899644,40cyclictest10331-21fschecks_count08:27:411
1238899644,40cyclictest10331-21fschecks_count08:27:411
1239299633,39cyclictest1672-21latency_hist08:02:012
12392996320,33cyclictest27556-21latency_hist07:42:002
1239999623,44cyclictest1963-21chrt08:02:203
1238899623,39cyclictest12579-21acpi06:57:091
1238899623,39cyclictest12579-21acpi06:57:091
1239299604,44cyclictest19605-21timerwakeupswit11:37:342
1239299604,44cyclictest19605-21timerwakeupswit11:37:342
1239999586,37cyclictest0-21swapper/308:27:233
1239999586,37cyclictest0-21swapper/308:27:233
50522570,5sleep30-21swapper/311:12:533
50522570,5sleep30-21swapper/311:12:533
12399995740,10cyclictest0-21swapper/308:47:433
1239999563,38cyclictest31155-21taskset11:57:273
1239999552,38cyclictest14664-21chrt08:41:583
1239999544,29cyclictest0-21swapper/307:27:133
1239999543,38cyclictest30917-21chrt10:08:003
1239999543,34cyclictest12967-21chrt12:22:153
1239999542,39cyclictest24303-21chrt11:46:573
1239999533,38cyclictest15479-21taskset10:37:183
1239999533,37cyclictest7565-21taskset12:12:273
1239999533,36cyclictest6575-21taskset12:11:413
1239999533,36cyclictest5822-21taskset10:21:583
1239999523,39cyclictest1278-21taskset09:18:263
1239999523,37cyclictest29946-21taskset07:47:303
1239999523,36cyclictest14014-21chrt11:28:013
1239999523,35cyclictest17388-21taskset09:46:523
1239999523,35cyclictest17388-21taskset09:46:523
1239999523,34cyclictest15243-21chrt07:02:333
1239999514,35cyclictest4302-21taskset08:07:353
1239999513,37cyclictest30270-21taskset11:02:033
1239999513,34cyclictest19212-21chrt09:48:303
1239999513,34cyclictest18457-21chrt10:42:213
1239999513,33cyclictest11459-21chrt11:24:163
1239999513,33cyclictest11459-21chrt11:24:163
1239999512,35cyclictest5686-21chrt09:27:013
1239999512,35cyclictest5686-21chrt09:27:013
1239999512,35cyclictest27705-21chrt10:02:373
1239999512,35cyclictest27705-21chrt10:02:373
1239999503,34cyclictest25272-21taskset10:52:383
1239999503,34cyclictest11748-21taskset10:31:193
1239999503,32cyclictest2549-21chrt12:03:433
1239999503,32cyclictest2549-21chrt12:03:433
1239999502,38cyclictest31363-21chrt07:52:243
1239999502,37cyclictest969-21chrt10:12:343
1239999502,35cyclictest12214-21chrt12:20:533
1239999502,35cyclictest12214-21chrt12:20:533
1239999493,36cyclictest20664-21chrt07:20:113
1239999493,35cyclictest20652-21chrt11:40:043
1239999493,35cyclictest20652-21chrt11:40:043
1239999493,32cyclictest18684-21taskset08:52:233
1239999492,35cyclictest10378-21chrt09:33:553
1239999492,35cyclictest10378-21chrt09:33:553
1239999492,33cyclictest30631-21chrt09:13:073
1239999492,33cyclictest30631-21chrt09:13:073
1239999492,33cyclictest29262-21chrt07:47:013
1239999483,32cyclictest25491-21chrt11:47:343
1239999482,33cyclictest16317-21chrt07:07:153
1239999482,33cyclictest1546-21chrt08:02:003
1239999482,33cyclictest12684-21chrt09:37:363
1239999482,32cyclictest23554-21chrt10:51:043
1239999482,29cyclictest20704-21chrt09:52:033
1239999482,29cyclictest20704-21chrt09:52:033
1239999473,28cyclictest16915-21chrt11:32:513
1239999472,32cyclictest13107-21chrt06:57:273
1239999472,32cyclictest13107-21chrt06:57:273
1239999464,33cyclictest18435-21chrt07:12:303
1239999462,32cyclictest29552-21chrt11:55:043
1239999462,32cyclictest29552-21chrt11:55:043
1239999462,30cyclictest13568-21chrt10:33:013
1239999453,29cyclictest8499-21taskset08:22:213
1239999453,29cyclictest8499-21taskset08:22:213
1239999452,30cyclictest25101-21chrt09:05:083
1239999452,30cyclictest24726-21chrt07:32:193
12399994411,24cyclictest25857-21taskset10:00:343
1239999432,30cyclictest22502-21chrt07:27:003
1239999422,26cyclictest2287-21chrt11:08:273
1239999413,25cyclictest6779-21taskset08:17:153
1239999413,25cyclictest6779-21taskset08:17:153
12399994118,15cyclictest0-21swapper/308:12:343
1239999392,27cyclictest7153-21taskset11:17:233
1239999383,26cyclictest12082-21chrt08:32:423
1239999383,25cyclictest14936-21chrt08:42:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional