You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-08-21 - 18:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Thu Aug 21, 2025 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
187152334302,20sleep20-21swapper/207:09:512
184012281248,21sleep10-21swapper/107:05:471
186532278243,22sleep30-21swapper/307:09:043
186202267233,22sleep00-21swapper/007:08:350
59062570,0sleep10-21swapper/109:35:151
209642550,0sleep00-21swapper/009:20:120
234682510,0sleep30-21swapper/312:25:413
133312180,0sleep20-21swapper/209:41:102
310652170,1sleep20-21swapper/210:55:132
1884699160,12cyclictest15017-21mailstats11:35:173
68812150,0sleep20-21swapper/211:01:382
242952140,0sleep00-21swapper/011:16:090
1884699143,8cyclictest27809-21sh09:54:283
1884699141,10cyclictest0-21swapper/309:42:413
1884699140,12cyclictest5428-21ssh09:35:143
1884699140,11cyclictest16352-21wc12:00:153
1884699131,9cyclictest21372-21ssh09:48:463
1884699130,8cyclictest5697-21timerwakeupswit11:00:203
1884699130,8cyclictest4964-21ssh11:52:063
1884699130,8cyclictest28700-21ssh09:25:553
1884699130,8cyclictest26774-21grep10:50:183
1884699130,8cyclictest13022-21ssh11:06:513
1884699130,8cyclictest11110-21ssh10:35:533
1884699130,7cyclictest8204-21sh11:30:173
1884699130,7cyclictest30709-21rm09:56:043
1884699130,10cyclictest9986-21ssh12:39:053
1884699130,10cyclictest586-21ssh12:32:303
1884699130,10cyclictest5859-21ssh10:31:213
1884699130,10cyclictest27082-21ssh10:22:233
1884699130,10cyclictest24196-21ssh11:42:333
1884699130,10cyclictest24050-21ssh10:48:023
1884699130,10cyclictest19532-21ssh09:18:513
1884699130,10cyclictest1952-21ssh09:31:093
1884699130,10cyclictest1832-21ssh10:28:413
1884699130,10cyclictest17061-21ssh11:10:173
1884699130,10cyclictest14013-21ssh09:14:213
1884699122,6cyclictest31509-21rm11:48:273
1884699120,9cyclictest24702-21ssh11:16:353
1884699120,9cyclictest18113-21ssh10:42:283
1884699120,9cyclictest16013-21ssh12:20:473
1884699120,8cyclictest6662-21awk12:15:143
1884699120,8cyclictest31973-21/usr/sbin/munin07:35:213
1884699120,8cyclictest11168-21awk08:00:213
1884699120,7cyclictest4305-21ssh11:26:363
1884699120,7cyclictest31408-21ssh11:22:273
1884699120,7cyclictest30569-21ssh12:09:543
1884699120,7cyclictest23810-21ssh09:21:503
1884699120,7cyclictest19671-21ssh10:15:193
1884699120,7cyclictest16707-21grep08:15:143
1884699120,7cyclictest16594-21ssh10:12:593
1884699120,7cyclictest13036-21ssh11:57:393
1884699120,7cyclictest10874-21ssh10:07:513
1884699110,8cyclictest9711-21chrt07:59:473
1884699110,8cyclictest30572-21taskset07:34:553
1884699110,7cyclictest26628-21open_inodes08:35:183
1884699110,7cyclictest24103-21irqstats08:30:173
1884699110,7cyclictest2165-21grep08:55:143
1884699110,7cyclictest15691-21wc08:10:193
1884699110,6cyclictest3720-21ssh10:00:393
1884699110,6cyclictest30933-21ssh12:10:023
1884699110,6cyclictest30630-21ssh10:55:003
1884699110,6cyclictest28400-21perl08:40:163
1884699100,9cyclictest48992sleep307:45:313
1884699100,9cyclictest23146-21cron08:30:003
1884699100,6cyclictest28314-21chrt07:29:363
1884699100,5cyclictest22514-21seq07:15:163
188469992,6cyclictest19535-21fschecks_time07:10:153
188469991,7cyclictest8615-21idleruntime-cro09:10:003
188469991,7cyclictest5080-21cat09:00:153
188469990,8cyclictest30694-21tail08:45:163
188469990,8cyclictest1782-21sed07:40:183
188469990,7cyclictest19982-21systemd-journal07:20:093
188469990,7cyclictest0-21swapper/307:50:133
188469990,7cyclictest0-21swapper/307:50:123
188469990,5cyclictest0-21swapper/308:53:293
188469990,1cyclictest12253-21apt-get08:05:133
188419994,3cyclictest19982-21systemd-journal10:09:582
188389994,3cyclictest19982-21systemd-journal07:58:081
188389993,5cyclictest0-21swapper/112:05:571
188339994,3cyclictest19982-21systemd-journal12:10:330
27598280,0sleep00-21swapper/009:54:100
188469980,7cyclictest19244-21cstates08:20:133
188419984,3cyclictest19982-21systemd-journal11:30:212
188419983,3cyclictest19982-21systemd-journal12:28:042
188419983,3cyclictest19982-21systemd-journal12:15:002
188419983,3cyclictest19982-21systemd-journal07:51:022
188419983,3cyclictest19982-21systemd-journal07:51:022
188389984,3cyclictest508-21dbus-daemon10:56:171
188389984,3cyclictest19982-21systemd-journal09:48:161
188389983,5cyclictest22-21ksoftirqd/108:25:001
188389982,3cyclictest32113-21perf08:49:591
188339983,3cyclictest19982-21systemd-journal09:11:590
188339983,3cyclictest19982-21systemd-journal07:55:130
188339983,1cyclictest0-21swapper/012:36:230
15109280,3sleep122-21ksoftirqd/109:43:211
21506270,0sleep20-21swapper/209:20:152
188419976,1cyclictest28-21ksoftirqd/210:25:012
188419974,2cyclictest6221-21apt-get12:15:122
188419974,2cyclictest508-21dbus-daemon11:15:292
188419974,2cyclictest3842-21uniq10:30:162
188419973,3cyclictest19982-21systemd-journal08:08:592
188419973,3cyclictest19982-21systemd-journal07:22:212
188419973,3cyclictest1-21systemd09:05:182
188419973,3cyclictest0-21swapper/212:33:052
188419973,2cyclictest19982-21systemd-journal08:34:512
188419973,1cyclictest0-21swapper/210:11:042
188419973,1cyclictest0-21swapper/209:26:562
188419972,3cyclictest19982-21systemd-journal07:34:462
188419970,5cyclictest19982-21systemd-journal09:32:002
188389974,2cyclictest11736-21in:imuxsock11:48:511
188389974,2cyclictest11736-21in:imuxsock11:02:331
188389973,3cyclictest508-21dbus-daemon09:32:251
188389973,3cyclictest508-21dbus-daemon08:51:561
188389973,3cyclictest508-21dbus-daemon08:11:291
188389973,3cyclictest30654-21snmpd10:28:171
188389973,3cyclictest19982-21systemd-journal12:05:011
188389973,3cyclictest19982-21systemd-journal08:18:201
188389973,3cyclictest19982-21systemd-journal08:01:211
188389973,3cyclictest19982-21systemd-journal07:49:211
188389973,3cyclictest0-21swapper/110:45:481
188389973,1cyclictest0-21swapper/111:30:451
188339974,2cyclictest508-21dbus-daemon08:41:560
188339974,2cyclictest19982-21systemd-journal11:54:420
188339973,3cyclictest31323-21cat10:25:200
188339973,3cyclictest30654-21snmpd10:49:570
188339973,3cyclictest19982-21systemd-journal12:22:120
188339973,3cyclictest0-21swapper/011:49:460
188339973,1cyclictest0-21swapper/010:20:360
188339973,1cyclictest0-21swapper/009:56:320
188339972,3cyclictest19982-21systemd-journal11:11:210
188339972,3cyclictest19982-21systemd-journal10:13:220
188339972,3cyclictest19982-21systemd-journal07:21:000
188339971,4cyclictest19982-21systemd-journal11:58:270
31039260,0sleep10-21swapper/112:30:461
188419964,1cyclictest28-21ksoftirqd/208:40:002
188419963,2cyclictest5247-21sh09:35:022
188419963,2cyclictest508-21dbus-daemon11:52:352
188419963,2cyclictest30654-21snmpd12:22:082
188419963,2cyclictest30654-21snmpd10:04:012
188419963,2cyclictest30654-21snmpd09:59:492
188419963,2cyclictest29867-21dump-pmu-power08:49:542
188419963,2cyclictest20744-21taskset07:11:362
188419963,2cyclictest18960-21apt-get08:20:122
188419963,2cyclictest0-21swapper/209:50:092
188419962,3cyclictest9729-21cat11:55:152
188419962,3cyclictest8537-21cat07:55:152
188419962,3cyclictest31385-21expr07:35:172
188419962,3cyclictest30654-21snmpd11:10:122
188419962,3cyclictest30654-21snmpd11:08:272
188419962,3cyclictest30654-21snmpd10:53:172
188419962,3cyclictest30654-21snmpd09:03:222
188419962,3cyclictest30654-21snmpd07:27:022
188419962,3cyclictest21849-21cat08:25:182
188419962,3cyclictest20702-21expr10:45:122
188419962,3cyclictest19982-21systemd-journal07:45:212
188419962,3cyclictest18318-21sshd08:15:542
188419962,3cyclictest15179-21expr09:15:132
188419962,3cyclictest1129-21sensors_temp08:50:192
188419962,3cyclictest0-21swapper/211:41:052
188419962,3cyclictest0-21swapper/210:40:122
188419962,2cyclictest19982-21systemd-journal11:25:042
188419962,1cyclictest1327-21perf11:25:012
188419962,1cyclictest0-21swapper/210:37:492
188419961,3cyclictest19982-21systemd-journal09:45:212
188419960,6cyclictest0-21swapper/211:35:072
188419960,6cyclictest0-21swapper/207:15:172
188419960,4cyclictest19982-21systemd-journal10:26:402
188419960,3cyclictest23857-21expr12:05:102
188419960,3cyclictest16193-21rm12:00:152
188419960,0cyclictest0-21swapper/212:36:482
188389963,2cyclictest5695-21find09:00:201
188389963,2cyclictest508-21dbus-daemon08:39:001
188389963,2cyclictest508-21dbus-daemon07:11:001
188389963,2cyclictest32510-1kworker/u9:009:25:121
188389963,2cyclictest25041-21sshd08:30:561
188389963,2cyclictest23643-21ntp_kernel_pll_09:50:211
188389963,2cyclictest23296-21expr11:15:211
188389963,2cyclictest22-21ksoftirqd/111:40:121
188389963,2cyclictest1415-21sshd12:11:131
188389963,2cyclictest11988-21rm11:05:381
188389962,3cyclictest6213-21cat07:50:161
188389962,3cyclictest6213-21cat07:50:151
188389962,3cyclictest4088-21cat10:30:161
188389962,3cyclictest30654-21snmpd12:36:491
188389962,3cyclictest30654-21snmpd11:21:011
188389962,3cyclictest30654-21snmpd10:39:081
188389962,3cyclictest30654-21snmpd10:11:051
188389962,3cyclictest30654-21snmpd08:43:361
188389962,3cyclictest30654-21snmpd07:33:261
188389962,3cyclictest15626-21cat09:15:151
188389962,3cyclictest15226-21wc12:20:211
188389962,3cyclictest14495-21cat11:35:131
188389962,3cyclictest1-21systemd07:37:411
188389962,3cyclictest0-21swapper/111:57:291
188389962,3cyclictest0-21swapper/107:22:211
188389962,1cyclictest0-21swapper/111:51:321
188389962,1cyclictest0-21swapper/110:20:461
188389962,1cyclictest0-21swapper/110:15:221
188389962,1cyclictest0-21swapper/109:55:171
188389962,1cyclictest0-21swapper/109:20:211
188389962,1cyclictest0-21swapper/109:11:481
188389961,3cyclictest19982-21systemd-journal12:16:231
188389961,3cyclictest19982-21systemd-journal11:10:011
188389961,3cyclictest19982-21systemd-journal10:02:281
188389961,3cyclictest19982-21systemd-journal08:55:421
188389961,2cyclictest9557-21ssh10:06:221
188389960,6cyclictest0-21swapper/107:26:011
188389960,5cyclictest0-21swapper/111:25:161
188389960,1cyclictest21431-21ssh12:25:131
188389960,0cyclictest0-21swapper/110:41:291
188339963,2cyclictest9996-21sh11:05:070
188339963,2cyclictest8625-21diskmemload12:00:530
188339963,2cyclictest6632-21rt-features09:35:190
188339963,2cyclictest5083-21cat09:00:160
188339963,2cyclictest4452-21sh11:26:490
188339963,2cyclictest31530-21if_err_enp4s010:55:160
188339963,2cyclictest30654-21snmpd11:20:060
188339963,2cyclictest26652-21cpuspeed_turbos09:25:110
188339963,2cyclictest19591-21mailstats10:15:180
188339963,2cyclictest19435-21df07:10:140
188339963,2cyclictest19122-21sh10:43:430
188339963,2cyclictest18489-21grep09:45:220
188339963,2cyclictest17479-21cat08:15:170
188339963,2cyclictest16160-21grep09:15:190
188339963,2cyclictest12624-21sh10:37:520
188339962,3cyclictest8157-21needreboot11:30:150
188339962,3cyclictest6534-21sed07:50:190
188339962,3cyclictest6534-21sed07:50:190
188339962,3cyclictest5184-21ntpq11:00:180
188339962,3cyclictest3417-21grep10:00:250
188339962,3cyclictest3307-21apt-get07:45:150
188339962,3cyclictest30654-21snmpd12:06:020
188339962,3cyclictest30654-21snmpd10:33:140
188339962,3cyclictest30654-21snmpd08:53:290
188339962,3cyclictest30654-21snmpd08:25:000
188339962,3cyclictest30654-21snmpd07:17:380
188339962,3cyclictest27069-21cat07:25:170
188339962,3cyclictest2703-21sshd07:40:480
188339962,3cyclictest26350-21expr10:50:150
188339962,3cyclictest19982-21systemd-journal12:15:320
188339962,3cyclictest19982-21systemd-journal11:35:040
188339962,3cyclictest19982-21systemd-journal09:05:180
188339962,3cyclictest19982-21systemd-journal08:05:570
188339962,3cyclictest14687-21expr08:10:120
188339962,3cyclictest10502-21cut08:00:170
188339962,3cyclictest0-21swapper/010:06:220
188339962,1cyclictest0-21swapper/009:40:230
188339962,1cyclictest0-21swapper/009:31:490
188339961,3cyclictest19982-21systemd-journal12:31:490
188339961,3cyclictest19982-21systemd-journal12:26:090
188339961,3cyclictest19982-21systemd-journal08:30:140
188419952,2cyclictest508-21dbus-daemon07:40:022
188419952,2cyclictest30654-21snmpd09:10:022
188419952,2cyclictest28190-21expr08:40:142
188419952,2cyclictest2160-21apt-get08:55:132
188419952,2cyclictest18970-21cut10:15:152
188419952,2cyclictest15011-21head08:10:152
188419952,2cyclictest10229-21cstates08:00:162
188419951,3cyclictest27632-21cat11:45:142
188389952,2cyclictest30654-21snmpd10:50:121
188389952,2cyclictest21396-21cstates08:25:151
188389951,4cyclictest1-21systemd08:05:201
188389951,3cyclictest7080-21cut09:05:141
188389951,2cyclictest19982-21systemd-journal07:40:001
188389950,2cyclictest21884-21sshd07:15:091
188339953,1cyclictest20896-21fschecks_time11:40:150
188339952,2cyclictest30900-21cpu07:35:150
188339952,2cyclictest30414-21expr08:45:140
188339952,2cyclictest18957-21awk08:20:110
188339951,3cyclictest30654-21snmpd07:30:070
188339951,3cyclictest2541-21df_inode08:55:150
188339950,4cyclictest25855-21cstates08:35:130
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional