You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-15 - 09:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Tue Jul 15, 2025 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
241122283250,20sleep30-21swapper/319:09:593
239632277244,22sleep00-21swapper/019:08:030
240932273238,23sleep10-21swapper/119:09:451
237752264230,21sleep20-21swapper/219:05:522
304722650,0sleep20-21swapper/200:02:242
211672640,0sleep20-21swapper/200:19:222
285872610,0sleep20-21swapper/221:43:452
217342600,0sleep30-21swapper/323:32:423
176962600,0sleep20-21swapper/223:53:192
118062600,0sleep30-21swapper/300:37:403
118062600,0sleep30-21swapper/300:37:403
173072570,0sleep00-21swapper/023:30:020
228372550,0sleep00-21swapper/023:56:370
252702540,0sleep00-21swapper/023:12:200
38052530,0sleep20-21swapper/221:49:302
178882210,0sleep20-21swapper/223:30:122
73332190,0sleep20-21swapper/222:36:312
13962190,0sleep10-21swapper/122:32:491
68562180,0sleep00-21swapper/021:27:200
99632160,1sleep39962-21users00:10:223
301312160,0sleep00-21swapper/000:02:020
144182160,0sleep10-21swapper/121:33:261
207612120,0sleep10-21swapper/123:31:471
238192110,0sleep10-21swapper/122:03:061
242189994,3cyclictest19982-21systemd-journal23:01:423
242189994,3cyclictest19982-21systemd-journal20:17:053
242149994,3cyclictest19982-21systemd-journal22:12:162
242149994,3cyclictest19982-21systemd-journal21:32:192
242149990,8cyclictest30701-21sh23:15:422
242099994,3cyclictest19982-21systemd-journal20:14:111
242099992,4cyclictest8589-21awk20:55:011
242049994,3cyclictest19982-21systemd-journal23:30:000
242049994,3cyclictest19982-21systemd-journal23:15:070
242189985,2cyclictest11736-21in:imuxsock20:40:283
242189983,3cyclictest19982-21systemd-journal22:10:013
242189983,3cyclictest19982-21systemd-journal21:17:013
242189983,3cyclictest19982-21systemd-journal00:07:423
242189983,1cyclictest34-21ksoftirqd/300:20:183
242189981,6cyclictest30088-21grep19:20:173
242149984,3cyclictest5808-21ntp_kernel_pll_21:50:202
242149983,3cyclictest19982-21systemd-journal21:23:012
242149983,3cyclictest19982-21systemd-journal20:54:392
242149983,3cyclictest19982-21systemd-journal20:23:222
242149980,7cyclictest22277-21apt-get21:15:102
242099984,3cyclictest508-21dbus-daemon23:41:571
242099984,3cyclictest23230-21ntpq00:20:191
242099983,3cyclictest19982-21systemd-journal19:49:341
242099982,2cyclictest22862-21awk21:40:011
242099981,3cyclictest19982-21systemd-journal19:55:001
242049982,1cyclictest0-21swapper/022:53:590
31452270,0chrt0-21swapper/223:40:052
24926270,0sleep10-21swapper/121:40:201
242189974,2cyclictest11736-21in:imuxsock19:32:033
242189973,3cyclictest22845-21smartctl23:10:223
242189973,3cyclictest19982-21systemd-journal21:12:003
242189973,3cyclictest0-21swapper/322:58:433
242189973,3cyclictest0-21swapper/322:40:023
242189973,3cyclictest0-21swapper/322:01:473
242189973,2cyclictest19982-21systemd-journal22:12:113
242189973,1cyclictest0-21swapper/300:29:553
242189972,3cyclictest19982-21systemd-journal23:48:383
242189972,3cyclictest19982-21systemd-journal23:15:153
242189972,3cyclictest19982-21systemd-journal21:30:063
242189972,3cyclictest19982-21systemd-journal19:27:533
242189972,3cyclictest19982-21systemd-journal00:31:113
242189972,1cyclictest0-21swapper/320:00:003
242189971,4cyclictest19982-21systemd-journal21:47:393
242189970,3cyclictest10531-21sshd19:46:393
242149974,2cyclictest508-21dbus-daemon19:37:282
242149974,2cyclictest23795-21systemctl22:25:232
242149974,2cyclictest1-21systemd20:27:572
242149973,3cyclictest8372-21ntpq23:00:172
242149973,3cyclictest30654-21snmpd23:56:002
242149973,3cyclictest304-21irqstats19:25:172
242149973,3cyclictest29929-21diskstats19:20:162
242149973,3cyclictest19982-21systemd-journal23:37:472
242149973,3cyclictest1-21systemd22:45:192
242149973,3cyclictest11515-21/usr/sbin/munin22:40:132
242149973,3cyclictest0-21swapper/223:25:092
242149973,3cyclictest0-21swapper/222:51:282
242149973,1cyclictest0-21swapper/222:07:082
242149973,1cyclictest0-21swapper/200:29:372
242149973,1cyclictest0-21swapper/200:11:402
242149973,1cyclictest0-21swapper/200:05:252
242149972,3cyclictest7661-21lldpd20:49:322
242149972,3cyclictest19982-21systemd-journal00:22:412
242149971,5cyclictest26641-21ntp_states19:15:022
242099974,2cyclictest9828-21idleruntime-cro23:25:001
242099973,3cyclictest8052-21sshd19:42:061
242099973,3cyclictest5201-21sshd00:07:321
242099973,3cyclictest508-21dbus-daemon20:27:081
242099973,3cyclictest19982-21systemd-journal21:27:281
242099973,3cyclictest19982-21systemd-journal00:00:001
242099973,3cyclictest12807-21sshd21:02:121
242099973,3cyclictest0-21swapper/121:46:121
242099973,3cyclictest0-21swapper/100:17:511
242099973,1cyclictest0-21swapper/123:03:101
242099973,1cyclictest0-21swapper/121:13:431
242099972,3cyclictest19982-21systemd-journal22:56:041
242099970,3cyclictest5564-21head22:35:201
242099970,2cyclictest7661-21lldpd00:10:141
242049974,2cyclictest11736-21in:imuxsock21:55:090
242049974,2cyclictest11736-21in:imuxsock20:30:010
242049973,3cyclictest7661-21lldpd21:39:040
242049973,3cyclictest508-21dbus-daemon00:29:310
242049973,3cyclictest31595-21sshd20:32:420
242049973,3cyclictest27047-21turbostat20:25:010
242049973,3cyclictest15272-21diskmemload22:28:010
242049973,3cyclictest13210-21sed21:05:010
242049973,3cyclictest12753-21sshd19:51:400
242049973,3cyclictest1-21systemd22:03:050
242049973,3cyclictest1-21systemd00:13:150
242049973,3cyclictest0-21swapper/021:40:350
242049973,1cyclictest0-21swapper/021:53:000
242049973,1cyclictest0-21swapper/000:07:410
242049972,3cyclictest7661-21lldpd23:44:390
242049972,3cyclictest19982-21systemd-journal22:59:420
242189964,1cyclictest13691-21diskstats21:05:133
242189963,2cyclictest508-21dbus-daemon22:30:363
242189963,2cyclictest5019-21awk20:45:193
242189963,2cyclictest30654-21snmpd20:25:063
242189963,2cyclictest25046-21rm22:26:103
242189963,2cyclictest18340-21cat20:05:133
242189963,2cyclictest16496-21sendmail_mailqu00:15:193
242189963,2cyclictest11103-21ssh22:16:253
242189962,3cyclictest9518-21cat20:55:153
242189962,3cyclictest4279-21cstates19:35:133
242189962,3cyclictest31514-21sshd20:31:513
242189962,3cyclictest30654-21snmpd23:35:023
242189962,3cyclictest30654-21snmpd23:05:073
242189962,3cyclictest30654-21snmpd21:50:183
242189962,3cyclictest30654-21snmpd20:21:153
242189962,3cyclictest30081-21ntpq21:20:173
242189962,3cyclictest26273-21cat22:50:163
242189962,3cyclictest24914-21grep19:10:153
242189962,3cyclictest24317-21ntpq21:40:173
242189962,3cyclictest20749-21tune2fs20:10:173
242189962,3cyclictest20286-21expr23:55:183
242189962,3cyclictest16532-21ls21:35:143
242189962,3cyclictest16199-21sed22:20:173
242189962,3cyclictest14067-21cut23:50:203
242189962,3cyclictest11487-21awk19:50:173
242189962,1cyclictest0-21swapper/323:25:113
242189961,4cyclictest32723-21pmu-power23:40:183
242189961,4cyclictest0-21swapper/322:45:103
242189961,3cyclictest19982-21systemd-journal21:02:083
242189961,3cyclictest19982-21systemd-journal00:00:003
242189961,1cyclictest3261-21apt-get21:25:173
242189960,5cyclictest508-21dbus-daemon22:40:013
242189960,5cyclictest3830-21head23:20:173
242189960,2cyclictest11908-21/usr/sbin/munin21:55:213
242149966,0cyclictest0-21swapper/223:10:102
242149963,2cyclictest4312-21ntpq21:25:222
242149963,2cyclictest3692-21latency_hist22:35:012
242149963,2cyclictest23996-21grep20:15:212
242149963,2cyclictest22088-21sh22:01:262
242149963,2cyclictest21242-21ntpq20:10:202
242149962,3cyclictest80132sleep223:45:342
242149962,3cyclictest764-21cat22:55:172
242149962,3cyclictest508-21dbus-daemon21:04:152
242149962,3cyclictest32365-21cat20:35:162
242149962,3cyclictest30654-21snmpd22:15:392
242149962,3cyclictest30654-21snmpd21:10:552
242149962,3cyclictest30654-21snmpd20:41:582
242149962,3cyclictest30654-21snmpd19:50:082
242149962,3cyclictest30654-21snmpd19:46:292
242149962,3cyclictest16482-21ntp_kernel_pll_20:00:202
242149962,3cyclictest0-21swapper/219:31:382
242149962,1cyclictest0-21swapper/221:36:082
242149962,1cyclictest0-21swapper/200:39:372
242149962,1cyclictest0-21swapper/200:39:372
242149962,1cyclictest0-21swapper/200:30:062
242149961,3cyclictest19982-21systemd-journal20:31:172
242149960,5cyclictest16223-21memory22:20:172
242149960,4cyclictest19982-21systemd-journal23:07:202
242149960,4cyclictest19982-21systemd-journal20:09:112
242149960,3cyclictest3029-21ssh23:20:022
242099966,0cyclictest18750irq/134-ahci[0022:50:011
242099963,2cyclictest8477-21sh23:46:011
242099963,2cyclictest30654-21snmpd20:36:391
242099963,2cyclictest30329-21systemctl21:20:191
242099963,2cyclictest28394-21sh22:05:301
242099963,2cyclictest23554-21systemctl21:15:181
242099963,2cyclictest16400-21sh23:52:031
242099963,2cyclictest1507-21expr22:10:131
242099963,2cyclictest13169-21sendmail_mailqu21:55:211
242099962,3cyclictest8856-21expr00:35:151
242099962,3cyclictest8856-21expr00:35:151
242099962,3cyclictest5625-21unixbench_singl19:35:211
242099962,3cyclictest508-21dbus-daemon20:57:341
242099962,3cyclictest508-21dbus-daemon20:25:011
242099962,3cyclictest32506-21tune2fs19:25:151
242099962,3cyclictest31977-21latency_hist20:35:011
242099962,3cyclictest30654-21snmpd22:21:071
242099962,3cyclictest30654-21snmpd21:50:031
242099962,3cyclictest30654-21snmpd21:05:581
242099962,3cyclictest30654-21snmpd20:47:031
242099962,3cyclictest30654-21snmpd20:09:111
242099962,3cyclictest30654-21snmpd20:00:291
242099962,3cyclictest29959-21cut19:20:161
242099962,3cyclictest29416-21cut23:15:181
242099962,3cyclictest2546-21cat20:40:181
242099962,3cyclictest23132-21grep22:25:191
242099962,3cyclictest22861-21awk23:10:221
242099962,3cyclictest19982-21systemd-journal22:51:431
242099962,3cyclictest14620-21cat19:55:201
242099962,3cyclictest11014-21cat23:25:161
242099962,1cyclictest0-21swapper/123:39:441
242099962,1cyclictest0-21swapper/123:05:021
242099962,1cyclictest0-21swapper/122:15:141
242099962,1cyclictest0-21swapper/100:26:371
242099961,4cyclictest0-21swapper/122:42:441
242099961,3cyclictest19982-21systemd-journal20:17:561
242099960,2cyclictest26707-21/usr/sbin/munin00:00:191
242099960,0cyclictest0-21swapper/100:30:231
242049966,0cyclictest0-21swapper/021:10:540
242049966,0cyclictest0-21swapper/000:20:140
242049964,1cyclictest10126-21cstates21:30:150
242049963,2cyclictest8809-21gdbus19:45:010
242049963,2cyclictest7001-21df_inode20:50:160
242049963,2cyclictest668-21runrttasks19:10:310
242049963,2cyclictest5996-21ssh23:45:060
242049963,2cyclictest508-21dbus-daemon19:33:180
242049963,2cyclictest4995-21tail22:35:160
242049963,2cyclictest4478-21diskstats20:45:150
242049963,2cyclictest3634-21sshd20:42:430
242049963,2cyclictest31929-21ssh21:21:320
242049963,2cyclictest30654-21snmpd00:17:180
242049963,2cyclictest2577-21rm00:30:140
242049963,2cyclictest12-21ksoftirqd/023:00:020
242049963,2cyclictest11736-21in:imuxsock20:05:010
242049963,2cyclictest11736-21in:imuxsock20:02:090
242049963,2cyclictest0-21swapper/023:06:400
242049962,3cyclictest8770-21expr00:35:150
242049962,3cyclictest8770-21expr00:35:150
242049962,3cyclictest8707-21expr22:15:180
242049962,3cyclictest7514-21cat19:40:200
242049962,3cyclictest508-21dbus-daemon20:12:060
242049962,3cyclictest508-21dbus-daemon19:17:520
242049962,3cyclictest30654-21snmpd23:50:200
242049962,3cyclictest30654-21snmpd21:15:160
242049962,3cyclictest30654-21snmpd20:58:340
242049962,3cyclictest30654-21snmpd19:55:050
242049962,3cyclictest30654-21snmpd19:27:470
242049962,3cyclictest30654-21snmpd19:23:070
242049962,3cyclictest30302-21cat22:30:160
242049962,3cyclictest19982-21systemd-journal23:22:310
242049962,3cyclictest12905-21cat22:40:200
242049962,1cyclictest0-21swapper/022:45:580
242049961,2cyclictest18184-21ssh22:21:250
242049960,3cyclictest3200-21rm22:10:410
242049960,3cyclictest30745-21rm21:45:150
242049960,3cyclictest28242-21sed22:05:220
242049960,3cyclictest25025-21/usr/sbin/munin23:35:150
242049960,2cyclictest1315-21sshd20:36:540
242189952,2cyclictest6337-21apt-get19:40:143
242189952,2cyclictest30654-21snmpd20:50:043
242189952,2cyclictest30654-21snmpd20:35:153
242189951,3cyclictest26661-21df_inode19:15:023
242189951,3cyclictest15529-21/usr/sbin/munin20:00:163
242149953,1cyclictest668-21runrttasks19:40:112
242149952,2cyclictest30654-21snmpd20:55:072
242149952,2cyclictest13287-21cat21:05:112
242149952,2cyclictest11681-21ssh21:55:022
242149951,3cyclictest24411-21/usr/sbin/munin19:10:132
242149951,3cyclictest13596-21cat19:55:132
242099952,2cyclictest30654-21snmpd19:30:081
242099952,2cyclictest26838-21grep19:15:021
242099952,2cyclictest24661-21expr19:10:141
242049952,2cyclictest30654-21snmpd21:05:070
242049952,2cyclictest22517-21apt20:15:130
242049951,3cyclictest4745-21cat19:35:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional