You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 01:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackbslot7.osadl.org (updated Sun Apr 05, 2026 12:44:28)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
145539912163,52cyclictest277-21dbus-daemon10:13:490
145619910965,37cyclictest27441-21sh11:54:102
145619910965,37cyclictest27441-21sh11:54:102
14553991094,31cyclictest2330-21cat10:18:510
14553991094,31cyclictest2330-21cat10:18:510
145539910552,47cyclictest28522-21rm09:14:090
994321040,9sleep30-21swapper/310:30:273
145539910441,55cyclictest0-21swapper/007:38:490
145539910238,57cyclictest0-21swapper/009:19:110
14553991003,41cyclictest26569-21cpuspeed10:59:040
14553991002,27cyclictest18259-21sort11:38:570
145539910010,34cyclictest22782-21/usr/sbin/munin09:59:240
1455399993,31cyclictest352-21runrttasks11:18:280
1455399993,31cyclictest352-21runrttasks11:18:280
1455399993,27cyclictest26243-21runrttasks09:09:230
14553999917,28cyclictest18146-21rm09:50:020
14561999853,37cyclictest0-21swapper/212:19:212
1455399984,15cyclictest20395-21awk09:54:160
1455399983,33cyclictest17882-21grep10:44:090
14558999737,36cyclictest19460-21kworker/u17:0-rpciod11:02:411
1455399974,34cyclictest8347-21cp10:28:500
1455399974,30cyclictest31415-21latency_hist07:53:510
1455399973,31cyclictest23493-21/usr/sbin/munin10:54:100
1455399973,21cyclictest14266-21cron10:38:470
1455399972,20cyclictest17978-21/usr/sbin/munin08:50:070
14561999656,34cyclictest19676-21snmpd11:08:512
1455399967,11cyclictest0-21swapper/012:04:010
1455399967,11cyclictest0-21swapper/012:04:010
1455399964,30cyclictest12487-21latency_hist12:23:510
1455399964,29cyclictest24877-21uname11:49:200
14553999615,23cyclictest15524-21sh12:28:560
14561999549,39cyclictest28072-21idleruntime-cro07:43:482
1455399954,37cyclictest352-21runrttasks10:04:040
1455399953,35cyclictest20600-21/usr/sbin/munin08:59:210
1455399953,31cyclictest29766-21grep11:04:100
1455399953,30cyclictest352-21runrttasks11:27:000
1455399953,26cyclictest8635-21apt-get10:29:060
1455399952,13cyclictest3657-21ssh12:09:010
1455899942,33cyclictest15074-21apt-get11:34:101
1455399945,30cyclictest23154-21latency_hist07:28:500
1455399945,30cyclictest23154-21latency_hist07:28:500
1455399944,29cyclictest19762-21threads08:54:220
1455399944,28cyclictest20930-21unixbench_multi07:19:240
1455399944,28cyclictest20930-21unixbench_multi07:19:240
14553999441,46cyclictest21970-21diskmemload11:34:450
1455399943,27cyclictest87-21kswapd007:03:520
1455399943,22cyclictest4776-21latency_hist09:28:520
14553999427,60cyclictest0-21swapper/010:23:500
14553999427,60cyclictest0-21swapper/009:34:230
14553999427,60cyclictest0-21swapper/009:34:230
1455399942,35cyclictest6865-21cut12:14:090
1455399942,23cyclictest27174-21/usr/sbin/munin11:54:040
1455399942,23cyclictest27174-21/usr/sbin/munin11:54:040
14553999410,13cyclictest0-21swapper/008:29:020
14561999348,37cyclictest0-21swapper/209:24:252
14558999349,38cyclictest30098-21open_files11:04:201
1455399934,29cyclictest21218-21/usr/sbin/munin11:44:250
1455399933,31cyclictest22731-21/usr/sbin/munin09:04:150
1455399933,29cyclictest16851-21modprobe08:48:480
14553999323,60cyclictest29679-21latency_hist07:48:510
14558999242,32cyclictest2765-21latency08:04:151
1455399924,31cyclictest4395-21apt-get09:29:030
1455399924,31cyclictest4395-21apt-get09:29:030
1455399924,24cyclictest2183-21latency_hist08:03:500
1455399923,33cyclictest7461-21fschecks_time08:19:090
1455399923,33cyclictest7461-21fschecks_time08:19:090
1455399923,30cyclictest31810-21grep07:54:090
1455399923,30cyclictest23237-21/usr/sbin/munin07:29:110
1455399923,27cyclictest13900-21apt-get08:39:110
1455399923,21cyclictest22779-21ssh10:52:410
1455399923,13cyclictest1-21systemd07:18:490
14553999228,57cyclictest10155-21munin-plugin-st08:28:490
1455399922,23cyclictest13353-21swap12:24:220
1455399922,23cyclictest13353-21swap12:24:220
14561999148,37cyclictest7585-21idleruntime-cro09:33:482
14561999148,37cyclictest7585-21idleruntime-cro09:33:482
14558999150,34cyclictest0-21swapper/110:04:231
1455399914,32cyclictest6234-21ssh11:19:080
1455399914,29cyclictest30152-21/usr/sbin/munin11:59:130
1455399913,32cyclictest32393-21/usr/sbin/munin11:09:050
1455399913,32cyclictest19676-21snmpd07:13:030
1455399913,31cyclictest19676-21snmpd09:48:510
1455399913,30cyclictest5825-21grep08:14:100
1455399913,30cyclictest5825-21grep08:14:100
1455399912,19cyclictest2356-21apt-get08:04:000
1456199903,76cyclictest0-21swapper/207:18:592
1456199903,76cyclictest0-21swapper/207:18:592
1455399904,31cyclictest27755-21unixbench_singl07:40:230
1455399903,29cyclictest11852-21acpi11:29:000
14561998944,39cyclictest15947-21sh10:40:062
14561998944,39cyclictest15947-21sh10:40:062
14561998942,41cyclictest0-21swapper/209:44:192
1455399893,28cyclictest16134-21ssh10:40:380
1455399893,28cyclictest16134-21ssh10:40:380
14561998868,13cyclictest895-21timerwakeupswit11:09:242
14558998847,34cyclictest3513-21latency_hist12:08:511
14558998847,34cyclictest3513-21latency_hist12:08:511
14558998845,37cyclictest16347-21munin-node11:14:261
14558998845,37cyclictest16347-21munin-node11:14:261
14558998830,33cyclictest0-21swapper/110:55:471
1455399884,28cyclictest14740-21/usr/sbin/munin07:04:060
1455399883,29cyclictest12278-21fschecks_count08:34:090
1455399883,27cyclictest11281-21sh09:39:120
14553998829,53cyclictest4306-21kernelversion08:09:110
14561998766,15cyclictest13780-21journal-offline08:38:522
14561998745,35cyclictest11996-21latency_hist08:33:512
14561998664,12cyclictest0-21swapper/209:09:082
14558998645,35cyclictest6503-21unixbench_singl10:24:261
14558998640,40cyclictest11637-21latency_hist11:28:501
14558998636,45cyclictest0-21swapper/111:33:511
14561998561,14cyclictest0-21swapper/207:34:102
14561998560,13cyclictest0-21swapper/208:18:502
14561998560,13cyclictest0-21swapper/208:18:502
1456199854,74cyclictest15074-21apt-get11:34:192
14561998544,33cyclictest0-21swapper/210:34:052
1456199853,68cyclictest16828-21apt-get09:49:022
14558998545,34cyclictest544-21cron08:28:511
14558998525,34cyclictest3996-21kworker/u17:1-xprtiod09:45:361
114672850,7sleep20-21swapper/210:33:512
14561998467,9cyclictest0-21swapper/207:53:512
1456199843,7cyclictest0-21swapper/209:34:002
1456199843,7cyclictest0-21swapper/209:34:002
14558998447,31cyclictest19949-21cstates09:54:051
14558998444,33cyclictest0-21swapper/111:39:491
14561998359,14cyclictest0-21swapper/207:08:512
14561998342,35cyclictest352-21runrttasks12:08:172
14561998342,35cyclictest352-21runrttasks12:08:172
14558998341,35cyclictest23032-21mailstats09:04:231
14558998338,38cyclictest31788-21latency_hist10:13:501
1409428310,48sleep114097-21/usr/sbin/munin06:59:361
14561998262,11cyclictest0-21swapper/208:58:502
14561998248,29cyclictest28227-21/usr/sbin/munin09:14:082
14561998244,32cyclictest2468-21/usr/sbin/munin10:19:082
14561998235,37cyclictest0-21swapper/207:29:202
14561998234,40cyclictest0-21swapper/209:59:232
1456199822,36cyclictest18309-21taskset11:39:032
1456199822,34cyclictest11845-21/usr/sbin/munin11:29:092
14561998134,41cyclictest0-21swapper/210:44:162
1456199812,8cyclictest0-21swapper/208:08:572
1456199812,27cyclictest7624-21cat08:19:132
1456199812,27cyclictest7624-21cat08:19:132
14558998141,34cyclictest21970-21diskmemload11:47:441
14561998062,9cyclictest0-21swapper/209:23:502
14561998043,30cyclictest0-21swapper/211:24:042
14561998042,31cyclictest0-21swapper/212:09:222
1456199802,6cyclictest0-21swapper/207:13:592
1456199802,32cyclictest26286-21/usr/sbin/munin10:04:162
1456199802,32cyclictest16283-21sendmail_mailtr12:29:202
14558998039,35cyclictest15170-21sh12:28:411
14558998039,35cyclictest15170-21sh12:28:411
14561997955,16cyclictest6722-21cpu12:14:042
14561997954,16cyclictest6313-21threads10:24:242
14561997938,32cyclictest0-21swapper/211:14:202
14561997938,32cyclictest0-21swapper/211:14:202
1456199792,70cyclictest0-21swapper/210:58:582
1456199792,6cyclictest0-21swapper/212:24:022
1456199792,6cyclictest0-21swapper/212:24:022
14558997941,31cyclictest22782-21/usr/sbin/munin09:59:211
1456199783,6cyclictest0-21swapper/208:44:002
1456199783,65cyclictest0-21swapper/209:04:042
1456199783,30cyclictest24391-21/usr/sbin/munin11:49:072
1456199782,32cyclictest2952-21systemd-journal08:02:072
14558997839,33cyclictest19460-21kworker/u17:0-xprtiod10:17:101
14558997839,33cyclictest19460-21kworker/u17:0-xprtiod10:17:101
14558997838,33cyclictest0-21swapper/108:28:491
14561997759,8cyclictest0-21swapper/208:50:012
14561997737,30cyclictest6207-21grep11:19:082
1456199773,61cyclictest8811-21apt-get08:23:582
1456199772,6cyclictest0-21swapper/209:53:592
1456199772,34cyclictest28927-21/usr/sbin/munin10:10:022
1456199772,33cyclictest3724-21unin-run08:08:492
1456199772,31cyclictest17134-21/usr/sbin/munin07:09:142
14558997742,29cyclictest4000-21sh10:20:361
14558997739,31cyclictest3995-21sh09:27:421
14558997738,33cyclictest8667-21kworker/u17:2-xprtiod10:30:481
14558997737,33cyclictest0-21swapper/108:09:221
14558997735,33cyclictest0-21swapper/108:40:111
1456199763,63cyclictest30171-21apt-get11:59:002
1456199763,33cyclictest23147-21latency_hist07:28:502
1456199763,33cyclictest23147-21latency_hist07:28:502
1456199762,33cyclictest21395-21cat10:49:232
1456199762,30cyclictest24365-21cat10:54:222
1456199762,30cyclictest11428-21netstat09:39:162
14558997641,29cyclictest20162-21kworker/u17:3-nfsiod09:10:241
14558997639,31cyclictest23872-21kworker/u17:1-nfsiod12:01:511
14558997637,32cyclictest0-21swapper/112:29:161
14558997634,37cyclictest0-21swapper/112:18:111
14558997634,34cyclictest0-21swapper/109:34:131
14558997634,34cyclictest0-21swapper/109:34:131
1456199753,66cyclictest0-21swapper/207:44:002
1456199752,29cyclictest429-21/usr/sbin/munin10:14:232
1456199752,29cyclictest429-21/usr/sbin/munin10:14:232
14558997557,13cyclictest14950-21idleruntime10:39:111
14558997557,13cyclictest14950-21idleruntime10:39:111
14558997555,14cyclictest2083-21idleruntime-cro08:03:481
14558997540,29cyclictest17724-21kworker/u17:2-nfsiod11:53:171
14558997537,32cyclictest5615-21cpu08:14:041
14558997537,32cyclictest5615-21cpu08:14:041
14558997531,37cyclictest6312-21latency_hist12:13:511
1455899752,68cyclictest0-21swapper/109:49:001
1456199742,34cyclictest15473-21latency_hist08:43:512
1455899743,63cyclictest0-21swapper/109:19:031
14558997436,31cyclictest0-21swapper/107:04:091
14558997432,35cyclictest0-21swapper/108:49:431
74812730,14sleep1291rcuc/111:20:441
14561997351,11cyclictest0-21swapper/211:44:202
1456199733,64cyclictest14544-21cyclictest07:03:522
1456199733,31cyclictest21139-21ntpq08:59:172
14558997341,26cyclictest19460-21kworker/u17:0-xprtiod10:35:251
14558997340,27cyclictest17253-21kworker/u17:3-rpciod10:45:171
14558997340,12cyclictest181rcu_preempt08:19:051
14558997340,12cyclictest181rcu_preempt08:19:051
14558997331,32cyclictest0-21swapper/109:18:511
1455899732,66cyclictest0-21swapper/107:09:061
1456199723,20cyclictest32137-21chrt07:54:192
14558997230,36cyclictest0-21swapper/107:14:051
14558997229,34cyclictest0-21swapper/108:59:171
14558997150,14cyclictest20442-21latency_hist08:58:501
14558997139,26cyclictest17724-21kworker/u17:2-rpciod11:58:221
14558997139,26cyclictest17724-21kworker/u17:2-rpciod11:58:221
14558997133,29cyclictest0-21swapper/107:54:201
14558997130,34cyclictest0-21swapper/112:23:501
14558997124,27cyclictest0-21swapper/109:31:421
14558997124,27cyclictest0-21swapper/109:31:421
14558997053,11cyclictest300-21rs:main1
14558997050,13cyclictest277-21dbus-daemon08:48:491
14558997031,32cyclictest0-21swapper/111:09:131
14558997030,33cyclictest0-21swapper/110:49:111
1455899694,53cyclictest13577-21ssh09:43:491
1455899693,60cyclictest0-21swapper/107:19:001
1455899693,60cyclictest0-21swapper/107:19:001
14558996931,31cyclictest0-21swapper/107:44:051
14558996930,32cyclictest0-21swapper/107:40:091
312192680,3sleep30-21swapper/311:59:263
1455899671,58cyclictest301ktimers/107:49:041
14566996629,25cyclictest16322-21taskset10:41:093
14566996629,25cyclictest16322-21taskset10:41:093
14566996526,26cyclictest21931-21taskset09:03:383
1455899652,55cyclictest23256-21apt-get07:28:591
1455899652,52cyclictest22992-21munin-run07:28:471
1455899652,52cyclictest22992-21munin-run07:28:471
14566996429,21cyclictest5496-21chrt11:18:313
14566996429,21cyclictest5496-21chrt11:18:313
14566996426,24cyclictest29602-21taskset11:58:083
14566996426,24cyclictest29602-21taskset11:58:083
14566996330,20cyclictest20363-21chrt08:58:483
14566996326,25cyclictest3757-21taskset12:09:023
14566996323,26cyclictest25733-21taskset10:03:573
14558996322,34cyclictest0-21swapper/107:34:061
14566996129,20cyclictest18668-21chrt07:14:103
14566996128,22cyclictest32096-21taskset07:54:163
14566996128,21cyclictest9431-21taskset11:24:153
14566996127,22cyclictest31060-21chrt11:05:503
14566996127,21cyclictest28324-21taskset09:14:043
14566996028,20cyclictest5333-21taskset08:13:483
14566996028,20cyclictest13815-21chrt09:43:553
14566996026,22cyclictest8234-21chrt11:22:533
14566996026,22cyclictest25036-21chrt07:34:073
14566996024,24cyclictest26945-21taskset09:11:043
14566996023,26cyclictest21510-21taskset07:23:503
14566996023,26cyclictest21510-21taskset07:23:503
14566995926,22cyclictest21841-21chrt09:57:003
14566995926,20cyclictest21879-21chrt10:50:053
14566995925,23cyclictest3758-21taskset08:08:503
14566995925,22cyclictest25591-21chrt11:50:143
14566995925,21cyclictest23760-21taskset09:05:243
14566995925,20cyclictest11932-21chrt09:39:253
14566995924,23cyclictest7184-21chrt10:26:143
14566995923,25cyclictest2663-21taskset12:06:563
14566995923,25cyclictest2663-21taskset12:06:563
14566995923,24cyclictest2864-21taskset09:24:293
14566995922,24cyclictest5328-21taskset10:23:513
14566995827,20cyclictest24228-21chrt10:00:203
14566995827,19cyclictest31189-21chrt09:18:583
14566995825,22cyclictest15976-21taskset11:34:413
14566995825,21cyclictest8390-21chrt12:16:163
14566995825,21cyclictest31136-21chrt07:52:013
14566995825,21cyclictest16002-21chrt07:07:463
14566995825,19cyclictest15752-21chrt08:44:103
14566995824,21cyclictest8279-21chrt08:20:283
14566995824,21cyclictest8279-21chrt08:20:283
14566995823,22cyclictest28483-21taskset11:01:573
14566995822,24cyclictest671-21chrt10:14:353
14566995822,24cyclictest671-21chrt10:14:353
14566995822,22cyclictest6817-21chrt08:17:203
14566995822,22cyclictest6817-21chrt08:17:203
14566995726,21cyclictest31168-21chrt10:12:323
14566995726,20cyclictest809-21chrt07:59:063
14566995726,20cyclictest14106-21chrt12:25:403
14566995726,20cyclictest14106-21chrt12:25:403
14566995726,19cyclictest10891-21chrt12:19:563
14566995725,21cyclictest23657-21chrt11:48:113
14566995724,21cyclictest17944-21chrt07:11:233
14566995724,21cyclictest14211-21chrt08:39:573
14566995724,21cyclictest12061-21chrt11:29:093
14566995724,20cyclictest24453-21chrt07:32:083
14566995723,22cyclictest20375-21chrt11:42:153
14566995720,25cyclictest25718-21taskset10:57:313
14566995626,19cyclictest8819-21chrt08:24:013
14566995625,20cyclictest17833-21taskset12:32:493
14566995624,20cyclictest18466-21chrt09:50:563
14566995624,20cyclictest17557-21chrt10:43:573
14566995624,20cyclictest14046-21chrt10:38:093
14566995623,21cyclictest26742-21taskset07:39:053
14566995623,21cyclictest11427-21chrt08:29:363
14566995526,20cyclictest18417-21chrt08:50:133
14566995524,20cyclictest5012-21chrt09:29:113
14566995524,20cyclictest5012-21chrt09:29:113
14566995524,20cyclictest1247-21chrt11:09:563
14566995523,21cyclictest9348-21chrt09:35:203
14566995523,21cyclictest9348-21chrt09:35:203
14566995522,21cyclictest13114-21chrt08:35:153
14566995422,20cyclictest22856-21chrt07:27:143
14566995422,20cyclictest22856-21chrt07:27:143
14566995323,19cyclictest29394-21chrt07:45:133
137232459,22sleep30-21swapper/306:59:303
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional