You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 07:26
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri Apr 26, 2024 00:44:25)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
258572333301,20sleep20-21swapper/219:05:302
259672292256,23sleep10-21swapper/119:06:541
259202275241,20sleep30-21swapper/319:06:213
259122254220,22sleep00-21swapper/019:06:130
111492770,0sleep20-21swapper/221:55:022
91912610,0sleep20-21swapper/223:07:302
84462580,0sleep00-21swapper/022:17:150
255822560,0sleep10-21swapper/123:45:011
62592230,0sleep30-21swapper/300:20:433
294412210,3sleep334-21ksoftirqd/322:33:343
183252190,0sleep00-21swapper/022:25:110
10342170,0sleep30-21swapper/322:11:133
31412160,0sleep00-21swapper/023:51:530
138162160,0sleep20-21swapper/219:50:252
185162150,0sleep30-21swapper/300:32:203
275312140,0sleep00-21swapper/021:42:100
2633899119,2cyclictest34-21ksoftirqd/322:00:023
2633399104,4cyclictest19982-21systemd-journal19:21:052
2632599109,1cyclictest12-21ksoftirqd/000:15:000
2632599108,1cyclictest12-21ksoftirqd/000:25:010
263389996,2cyclictest31185-21ssh23:24:433
263389995,3cyclictest508-21dbus-daemon21:03:433
263389994,3cyclictest19982-21systemd-journal21:32:503
263339994,3cyclictest19982-21systemd-journal21:24:592
263339992,4cyclictest24232-21ls22:30:012
263309993,1cyclictest18963-21awk23:40:001
25887290,0sleep30-21swapper/323:45:063
263389985,2cyclictest34-21ksoftirqd/320:10:013
263389984,3cyclictest508-21dbus-daemon23:53:303
263389984,3cyclictest19982-21systemd-journal23:06:233
263339984,3cyclictest19982-21systemd-journal21:07:502
263339983,3cyclictest19982-21systemd-journal22:17:582
263339983,3cyclictest19982-21systemd-journal20:21:502
263339983,3cyclictest19982-21systemd-journal19:36:572
263339982,4cyclictest19982-21systemd-journal20:16:572
263339982,4cyclictest19982-21systemd-journal20:16:572
263339980,7cyclictest3991-21ssh22:39:022
263309986,1cyclictest22-21ksoftirqd/121:40:021
263309986,1cyclictest22-21ksoftirqd/119:15:011
263309986,1cyclictest22-21ksoftirqd/100:00:011
263309986,1cyclictest22-21ksoftirqd/100:00:011
263309984,3cyclictest19982-21systemd-journal22:33:251
263309984,3cyclictest11375-21cron22:45:011
263259985,2cyclictest508-21dbus-daemon20:18:150
263259985,2cyclictest508-21dbus-daemon20:18:150
263259985,2cyclictest12-21ksoftirqd/020:05:000
263259984,3cyclictest19982-21systemd-journal21:50:010
263259983,3cyclictest19982-21systemd-journal20:42:510
263259983,3cyclictest19982-21systemd-journal19:23:350
263259983,3cyclictest19982-21systemd-journal19:16:540
10914280,0sleep00-21swapper/023:09:150
7047270,0chrt0-21swapper/100:21:401
2963270,0sleep3331rcuc/300:18:423
28650270,1chrt28651-21cat19:15:002
263389974,2cyclictest508-21dbus-daemon19:25:403
263389974,2cyclictest25956-21basename00:40:003
263389974,2cyclictest19858-21systemctl23:15:203
263389974,2cyclictest18893-21hddtemp_smartct22:50:153
263389973,3cyclictest6116-21vmstat21:25:263
263389973,3cyclictest508-21dbus-daemon23:36:253
263389973,3cyclictest508-21dbus-daemon22:21:443
263389973,3cyclictest508-21dbus-daemon21:40:003
263389973,3cyclictest508-21dbus-daemon20:15:193
263389973,3cyclictest508-21dbus-daemon20:15:183
263389973,3cyclictest29741-11brltty19:51:083
263389973,3cyclictest19982-21systemd-journal19:47:193
263389973,3cyclictest19982-21systemd-journal19:12:223
263389973,3cyclictest19982-21systemd-journal00:13:583
263389973,3cyclictest13388-21snmpd19:37:333
263389973,3cyclictest0-21swapper/321:16:263
263389973,2cyclictest19982-21systemd-journal22:04:383
263389973,1cyclictest0-21swapper/322:26:163
263389972,3cyclictest19982-21systemd-journal21:50:023
263389972,3cyclictest19982-21systemd-journal21:40:513
263389972,3cyclictest19982-21systemd-journal21:05:483
263389970,1cyclictest0-21swapper/300:04:383
263339975,1cyclictest29741-11brltty19:30:162
263339974,2cyclictest23487-21sshd21:39:512
263339973,3cyclictest508-21dbus-daemon23:20:082
263339973,3cyclictest508-21dbus-daemon20:00:012
263339973,3cyclictest508-21dbus-daemon00:00:122
263339973,3cyclictest19982-21systemd-journal23:56:012
263339973,3cyclictest19982-21systemd-journal23:56:012
263339973,3cyclictest19982-21systemd-journal23:17:382
263339973,3cyclictest19982-21systemd-journal00:39:232
263339973,3cyclictest13388-21snmpd20:41:352
263339973,3cyclictest13388-21snmpd19:45:482
263339973,3cyclictest13388-21snmpd19:16:382
263339973,3cyclictest0-21swapper/223:03:262
263339973,3cyclictest0-21swapper/200:11:502
263339973,1cyclictest0-21swapper/200:08:572
263339972,3cyclictest19982-21systemd-journal21:48:222
263339972,3cyclictest19982-21systemd-journal21:13:432
263339970,7cyclictest0-21swapper/221:40:282
263309975,2cyclictest22-21ksoftirqd/123:50:011
263309974,2cyclictest508-21dbus-daemon00:36:531
263309973,3cyclictest19982-21systemd-journal19:20:011
263309973,3cyclictest13388-21snmpd23:21:511
263309973,3cyclictest13388-21snmpd21:30:061
263309973,3cyclictest13385-21memory19:50:191
263309973,3cyclictest0-21swapper/123:16:331
263309973,3cyclictest0-21swapper/123:12:331
263309973,3cyclictest0-21swapper/122:58:521
263309973,3cyclictest0-21swapper/122:23:251
263309973,3cyclictest0-21swapper/120:18:501
263309973,3cyclictest0-21swapper/120:18:501
263309973,1cyclictest0-21swapper/123:27:321
263309972,3cyclictest19982-21systemd-journal23:01:461
263309972,3cyclictest19982-21systemd-journal20:15:001
263309970,1cyclictest52050irq/138-enp4s0-20:30:121
263259974,2cyclictest11736-21in:imuxsock23:42:400
263259973,3cyclictest6234-21ntpq20:45:220
263259973,3cyclictest508-21dbus-daemon23:15:000
263259973,3cyclictest508-21dbus-daemon20:54:590
263259973,3cyclictest19982-21systemd-journal23:35:010
263259973,3cyclictest19982-21systemd-journal22:36:200
263259973,3cyclictest19982-21systemd-journal22:02:500
263259973,3cyclictest19982-21systemd-journal19:59:020
263259973,3cyclictest0-21swapper/000:33:010
263259973,2cyclictest19982-21systemd-journal22:42:370
263259973,1cyclictest0-21swapper/023:35:450
263259973,1cyclictest0-21swapper/022:32:510
263259973,1cyclictest0-21swapper/000:16:450
263259972,3cyclictest19982-21systemd-journal21:29:350
263259972,3cyclictest19982-21systemd-journal20:10:440
263259972,3cyclictest19982-21systemd-journal20:07:250
263259970,0cyclictest141rcu_preempt00:25:200
25054270,0sleep00-21swapper/000:38:540
263389966,0cyclictest0-21swapper/321:50:033
263389965,1cyclictest13776-21kworker/3:123:25:503
263389963,2cyclictest668-21runrttasks22:40:173
263389963,2cyclictest6622-21cat20:45:283
263389963,2cyclictest508-21dbus-daemon23:00:573
263389963,2cyclictest508-21dbus-daemon20:30:003
263389963,2cyclictest4816-21systemctl19:30:243
263389963,2cyclictest31767-21cut19:20:123
263389963,2cyclictest1532-21uname20:35:173
263389963,2cyclictest13388-21snmpd23:55:303
263389963,2cyclictest13388-21snmpd23:55:303
263389963,1cyclictest0-21swapper/321:12:123
263389962,3cyclictest508-21dbus-daemon22:55:073
263389962,3cyclictest31285-21expr20:30:123
263389962,3cyclictest30623-21expr21:20:103
263389962,3cyclictest27429-21sed20:20:173
263389962,3cyclictest21536-21apt-get20:10:023
263389962,3cyclictest19982-21systemd-journal20:50:473
263389962,3cyclictest19982-21systemd-journal19:16:293
263389962,3cyclictest17911-21expr20:00:173
263389962,3cyclictest13388-21snmpd23:31:433
263389962,3cyclictest13388-21snmpd22:46:263
263389962,3cyclictest13388-21snmpd22:37:323
263389962,3cyclictest13388-21snmpd19:41:573
263389962,3cyclictest13388-21snmpd00:05:173
263389962,3cyclictest0-21swapper/323:40:083
263389961,3cyclictest19982-21systemd-journal22:05:283
263389960,5cyclictest7215-21chrt22:15:543
263389960,5cyclictest4046-21ntp_states20:40:323
263389960,5cyclictest14952-21grep19:55:123
263389960,5cyclictest12096-21apt-get23:10:113
263339966,0cyclictest0-21swapper/223:36:532
263339963,2cyclictest28366-21rm22:32:292
263339963,2cyclictest22852-21latency20:10:172
263339963,2cyclictest1590-21rm23:25:472
263339963,2cyclictest15382-21apt-get00:30:122
263339963,2cyclictest14033-21sshd21:02:312
263339963,2cyclictest1-21systemd19:26:062
263339963,2cyclictest12153-21seq00:25:592
263339963,2cyclictest0-21swapper/222:45:212
263339963,1cyclictest0-21swapper/223:45:302
263339962,3cyclictest7717-21seq20:50:132
263339962,3cyclictest508-21dbus-daemon20:25:192
263339962,3cyclictest5075-21cat21:25:152
263339962,3cyclictest25133-21expr22:55:142
263339962,3cyclictest17303-21packagekitd20:05:072
263339962,3cyclictest13388-21snmpd23:31:032
263339962,3cyclictest13388-21snmpd22:50:152
263339962,3cyclictest13388-21snmpd22:10:162
263339962,3cyclictest13388-21snmpd22:00:142
263339962,3cyclictest13388-21snmpd21:15:382
263339962,3cyclictest11174-21expr21:30:102
263339962,3cyclictest11007-21ntpq20:55:212
263339962,3cyclictest0-21swapper/223:10:512
263339962,1cyclictest0-21swapper/222:41:232
263339962,1cyclictest0-21swapper/222:05:012
263339962,1cyclictest0-21swapper/200:15:482
263339961,3cyclictest19982-21systemd-journal21:50:522
263339961,3cyclictest19982-21systemd-journal20:39:062
263339961,3cyclictest19982-21systemd-journal20:02:232
263339961,3cyclictest19982-21systemd-journal00:20:372
263339961,2cyclictest32303-21ssh23:50:032
263339960,6cyclictest0-21swapper/223:41:202
263339960,6cyclictest0-21swapper/222:23:522
263339960,4cyclictest19982-21systemd-journal20:45:222
263309966,0cyclictest0-21swapper/121:13:461
263309963,2cyclictest970-21ssh22:11:091
263309963,2cyclictest8121-21sh21:27:341
263309963,2cyclictest7178-21sshd22:15:501
263309963,2cyclictest25528-21sh22:05:191
263309963,2cyclictest22121-21sh22:52:401
263309963,2cyclictest19561-21sh00:05:101
263309963,2cyclictest15878-21cut00:30:161
263309963,2cyclictest13388-21snmpd21:40:491
263309963,2cyclictest13388-21snmpd19:31:341
263309963,2cyclictest12522-21tr21:55:171
263309963,2cyclictest0-21swapper/123:31:101
263309963,1cyclictest0-21swapper/122:27:111
263309962,3cyclictest31114-21df21:45:151
263309962,3cyclictest2201-21cat20:35:241
263309962,3cyclictest21023-21grep20:05:241
263309962,3cyclictest15197-21unixbench_multi00:00:221
263309962,3cyclictest13388-21snmpd20:45:311
263309962,3cyclictest13388-21snmpd20:40:291
263309962,3cyclictest13388-21snmpd19:43:411
263309962,3cyclictest13388-21snmpd19:25:501
263309962,3cyclictest1-21systemd20:00:001
263309962,3cyclictest11772-21awk22:45:131
263309962,3cyclictest0-21swapper/123:05:131
263309962,3cyclictest0-21swapper/121:53:591
263309962,2cyclictest16969-21lldpd21:04:291
263309962,1cyclictest0-21swapper/121:23:001
263309962,1cyclictest0-21swapper/100:16:161
263309961,2cyclictest24370-21irqstats21:15:181
263309960,6cyclictest0-21swapper/122:00:061
263309960,6cyclictest0-21swapper/100:25:231
263309960,5cyclictest32415-21/usr/sbin/munin23:50:241
263309960,5cyclictest29768-21ntp_states20:25:181
263309960,4cyclictest9281-21sshd20:52:371
263309960,2cyclictest31170-21/usr/sbin/munin22:35:181
263309960,2cyclictest19982-21systemd-journal00:15:001
263259963,2cyclictest668-21runrttasks19:34:340
263259963,2cyclictest30189-21sed20:25:210
263259963,2cyclictest25316-21sh23:20:140
263259963,2cyclictest2203-21wc20:35:230
263259963,2cyclictest12023-21ls21:30:190
263259962,3cyclictest32308-21ls20:30:260
263259962,3cyclictest31958-21fw_packets23:00:150
263259962,3cyclictest27952-21cat19:10:240
263259962,3cyclictest27241-21cat20:20:170
263259962,3cyclictest24183-21head21:15:170
263259962,3cyclictest14277-21cat00:00:130
263259962,3cyclictest13388-21snmpd22:50:470
263259962,3cyclictest13388-21snmpd21:55:250
263259962,3cyclictest13388-21snmpd21:35:090
263259962,3cyclictest13388-21snmpd21:24:300
263259962,3cyclictest13388-21snmpd21:05:200
263259962,3cyclictest13388-21snmpd20:57:190
263259962,3cyclictest13388-21snmpd19:42:560
263259962,3cyclictest13388-21snmpd00:08:250
263259962,3cyclictest12963-21cat21:00:150
263259962,3cyclictest12314-21cat22:20:170
263259962,1cyclictest0-21swapper/023:45:510
263259962,1cyclictest0-21swapper/023:18:260
263259962,1cyclictest0-21swapper/022:55:130
263259962,1cyclictest0-21swapper/022:46:030
263259962,1cyclictest0-21swapper/022:05:340
263259962,1cyclictest0-21swapper/021:10:220
263259961,3cyclictest19982-21systemd-journal19:26:510
263259960,5cyclictest30852-21/usr/sbin/munin22:10:120
263259960,4cyclictest19982-21systemd-journal21:52:410
263259960,2cyclictest6879-21cstates23:55:120
263259960,2cyclictest6879-21cstates23:55:120
263389953,1cyclictest10629-21gltestperf20:55:163
263389953,1cyclictest10441-21fschecks_time00:25:153
263339952,2cyclictest8343-21cstates19:40:142
263339952,2cyclictest32733-21seq20:31:552
263309952,2cyclictest6269-21df19:35:111
263309952,2cyclictest508-21dbus-daemon20:00:011
263309952,2cyclictest31664-21cpu19:20:131
263309952,2cyclictest14915-21forks21:05:121
263309952,2cyclictest13388-21snmpd20:20:071
263309951,3cyclictest13388-21snmpd20:55:071
263309951,3cyclictest10746-21df19:45:151
263259952,2cyclictest6128-21expr19:35:110
263259952,2cyclictest32047-21expr23:25:120
263259952,2cyclictest13397-21missed_timers19:50:190
263259951,3cyclictest11127-21cat19:45:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional