You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-01 - 02:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Thu Feb 29, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
71472297265,20sleep20-21swapper/207:09:362
71172262228,21sleep30-21swapper/307:09:133
71572261228,20sleep00-21swapper/007:09:430
68322260226,22sleep10-21swapper/107:05:371
210282690,0sleep10-21swapper/110:06:011
264582600,0sleep30-21swapper/309:40:013
206812590,0sleep20-21swapper/207:35:342
28682580,0sleep20-21swapper/209:48:482
297952140,0sleep00-21swapper/012:15:220
305602130,0sleep30-21swapper/309:44:453
166302120,7sleep316641-21ssh09:29:203
114652100,0sleep30-21swapper/307:15:323
73009994,3cyclictest11325-21sh08:30:002
72969997,1cyclictest22-21ksoftirqd/112:20:001
72969991,1cyclictest141rcu_preempt09:05:241
72919994,3cyclictest19982-21systemd-journal10:05:320
73059985,2cyclictest34-21ksoftirqd/307:15:013
73059985,2cyclictest34-21ksoftirqd/307:15:013
73059984,2cyclictest19982-21systemd-journal10:25:013
73059983,3cyclictest19982-21systemd-journal12:39:283
73059983,3cyclictest19982-21systemd-journal11:41:543
73059980,7cyclictest31031-21ssh11:47:533
73009985,2cyclictest508-21dbus-daemon10:17:132
73009985,2cyclictest29072-21munin-plugin-st10:15:012
73009984,3cyclictest19982-21systemd-journal07:25:012
73009983,3cyclictest19982-21systemd-journal11:26:312
73009983,3cyclictest19982-21systemd-journal09:14:372
73009982,3cyclictest23642-21grep07:45:002
73009982,3cyclictest16190-21munin-plugin-st11:35:002
73009982,3cyclictest12364-21dump-pmu-power07:20:012
73009981,4cyclictest28369-21ls10:45:012
72969986,1cyclictest22-21ksoftirqd/112:05:001
72969986,1cyclictest0-21swapper/110:52:321
72969985,2cyclictest508-21dbus-daemon08:45:011
72969983,3cyclictest19982-21systemd-journal11:39:241
72969983,3cyclictest19982-21systemd-journal11:08:561
72969983,3cyclictest19982-21systemd-journal08:40:001
72969982,3cyclictest3661-21munin-run09:50:011
72969982,3cyclictest13739-21munin-run10:00:011
72919984,1cyclictest32591-21perf08:05:000
72919982,3cyclictest2611-21munin-run09:15:010
72919980,5cyclictest6839-21apt08:20:000
72919980,5cyclictest3666-21awk09:50:010
73059974,2cyclictest508-21dbus-daemon07:44:063
73059974,2cyclictest11736-21in:imuxsock08:53:213
73059973,3cyclictest3758-21snmpd11:19:113
73059973,3cyclictest3758-21snmpd08:04:323
73059973,3cyclictest3758-21snmpd07:52:143
73059973,3cyclictest3758-21snmpd07:38:053
73059973,3cyclictest3758-21snmpd07:31:083
73059973,3cyclictest30199-21sshd07:58:463
73059973,3cyclictest29987-21ntp_states10:45:343
73059973,3cyclictest0-21swapper/309:56:143
73059973,1cyclictest0-21swapper/310:43:183
73059973,1cyclictest0-21swapper/310:30:233
73059971,3cyclictest3758-21snmpd10:51:073
73059970,6cyclictest19116-21gdbus10:30:013
73009975,1cyclictest25201-21ssh11:42:102
73009974,2cyclictest4750-21smartctl09:50:252
73009974,2cyclictest14126-21ntp_states09:25:242
73009973,3cyclictest508-21dbus-daemon12:31:072
73009973,3cyclictest508-21dbus-daemon11:53:102
73009973,3cyclictest3950-21cat12:20:332
73009973,3cyclictest3758-21snmpd10:23:162
73009973,3cyclictest19982-21systemd-journal11:06:512
73009973,3cyclictest19982-21systemd-journal10:45:352
73009973,3cyclictest0-21swapper/210:35:202
73009973,1cyclictest0-21swapper/211:11:192
73009972,3cyclictest19982-21systemd-journal12:15:162
73009972,3cyclictest19982-21systemd-journal08:52:472
73009972,3cyclictest19982-21systemd-journal08:00:472
73009972,3cyclictest19982-21systemd-journal07:59:572
73009970,1cyclictest0-21swapper/212:37:452
72969975,1cyclictest0-21swapper/112:28:311
72969974,2cyclictest508-21dbus-daemon11:42:441
72969974,2cyclictest19982-21systemd-journal08:55:001
72969973,3cyclictest7499-21/usr/sbin/munin07:10:421
72969973,3cyclictest7499-21/usr/sbin/munin07:10:421
72969973,3cyclictest3758-21snmpd10:13:511
72969973,3cyclictest3758-21snmpd09:34:491
72969973,3cyclictest3758-21snmpd07:23:011
72969973,3cyclictest19982-21systemd-journal11:55:311
72969973,3cyclictest19982-21systemd-journal10:27:381
72969973,3cyclictest1684-21ntpq11:50:271
72969973,1cyclictest0-21swapper/112:34:551
72969971,5cyclictest12827-21gltestperf11:00:231
72969971,3cyclictest6830-21sh08:20:001
72969970,1cyclictest0-21swapper/112:05:171
72919975,2cyclictest12-21ksoftirqd/009:10:010
72919974,2cyclictest51950irq/137-enp4s0-11:50:270
72919973,3cyclictest7858-21apt-get12:25:210
72919973,3cyclictest4220-21sshd12:20:410
72919973,3cyclictest3758-21snmpd08:44:270
72919973,3cyclictest23428-21sshd07:42:470
72919973,3cyclictest10197-21ntpq09:55:270
72919973,3cyclictest0-21swapper/011:24:030
72919973,2cyclictest19982-21systemd-journal12:36:580
72919973,1cyclictest0-21swapper/010:54:030
72919973,1cyclictest0-21swapper/010:02:160
72919972,3cyclictest19982-21systemd-journal12:33:120
72919972,3cyclictest19982-21systemd-journal08:33:450
72919972,3cyclictest19982-21systemd-journal08:15:000
72919972,3cyclictest19982-21systemd-journal07:38:470
72919972,3cyclictest16969-21lldpd07:21:530
72919970,4cyclictest25017-21latency_hist09:00:000
72919970,4cyclictest17257-21awk12:05:000
22931270,0sleep10-21swapper/109:35:211
73059966,0cyclictest0-21swapper/312:26:443
73059964,1cyclictest4412-21expr09:50:233
73059963,2cyclictest9274-21systemctl09:20:333
73059963,2cyclictest668-21runrttasks07:45:433
73059963,2cyclictest629-21ssh11:50:203
73059963,2cyclictest16512-21sh11:35:063
73059963,2cyclictest15229-21cstates07:25:233
73059963,2cyclictest14509-21head12:30:293
73059963,2cyclictest11736-21in:imuxsock09:07:563
73059962,3cyclictest508-21dbus-daemon08:55:013
73059962,3cyclictest3758-21snmpd12:23:253
73059962,3cyclictest3758-21snmpd12:00:383
73059962,3cyclictest3758-21snmpd11:55:183
73059962,3cyclictest3758-21snmpd11:07:083
73059962,3cyclictest3758-21snmpd11:00:233
73059962,3cyclictest3758-21snmpd09:30:433
73059962,3cyclictest3758-21snmpd09:17:013
73059962,3cyclictest3758-21snmpd08:49:093
73059962,3cyclictest3758-21snmpd08:25:183
73059962,3cyclictest3758-21snmpd08:22:453
73059962,3cyclictest3758-21snmpd08:10:193
73059962,3cyclictest31013-21cat09:10:263
73059962,3cyclictest24266-21expr10:10:193
73059962,3cyclictest23238-21expr11:10:283
73059962,3cyclictest19982-21systemd-journal12:10:013
73059962,3cyclictest19883-21tail10:35:303
73059962,3cyclictest17739-21cpu12:05:183
73059962,3cyclictest1527-21ls11:20:233
73059962,3cyclictest12932-21expr07:20:193
73059962,3cyclictest0-21swapper/312:16:593
73059962,2cyclictest19982-21systemd-journal08:39:353
73059962,1cyclictest0-21swapper/311:30:143
73059962,1cyclictest0-21swapper/311:26:493
73059962,1cyclictest0-21swapper/310:05:283
73059962,1cyclictest0-21swapper/310:04:443
73059960,6cyclictest0-21swapper/310:55:563
73059960,0cyclictest0-21swapper/308:40:213
73009966,0cyclictest0-21swapper/207:10:342
73009966,0cyclictest0-21swapper/207:10:342
73009964,1cyclictest28194-21hddtemp_smartct11:45:252
73009964,1cyclictest24841-21ntp_states12:10:302
73009963,2cyclictest6716-21ssh10:55:122
73009963,2cyclictest3758-21snmpd10:31:162
73009963,2cyclictest3758-21snmpd08:40:122
73009963,2cyclictest29741-11brltty11:55:152
73009963,2cyclictest29511-21diskmemload10:26:182
73009963,2cyclictest19982-21systemd-journal11:17:002
73009963,2cyclictest15307-21tune2fs07:25:252
73009963,2cyclictest0-21swapper/208:55:222
73009962,3cyclictest8342-21expr09:20:212
73009962,3cyclictest8202-21expr12:25:222
73009962,3cyclictest3758-21snmpd11:20:082
73009962,3cyclictest3758-21snmpd09:56:062
73009962,3cyclictest3758-21snmpd09:05:492
73009962,3cyclictest3758-21snmpd07:51:202
73009962,3cyclictest25593-21expr09:00:242
73009962,3cyclictest24674-21cat07:45:292
73009962,3cyclictest19982-21systemd-journal07:35:012
73009962,3cyclictest18254-21date08:45:012
73009962,3cyclictest14106-21expr08:35:212
73009962,3cyclictest0-21swapper/211:36:212
73009962,3cyclictest0-21swapper/209:44:452
73009962,3cyclictest0-21swapper/209:15:552
73009962,2cyclictest19982-21systemd-journal10:50:482
73009962,1cyclictest0-21swapper/210:05:082
73009961,4cyclictest3758-21snmpd08:05:232
73009961,2cyclictest21900-21rm09:35:082
73009960,6cyclictest0-21swapper/212:05:092
73009960,6cyclictest0-21swapper/210:02:062
73009960,5cyclictest11651-21awk08:30:222
73009960,2cyclictest12721-21which12:00:222
73009960,0cyclictest0-21swapper/211:00:332
73009960,0cyclictest0-21swapper/209:30:412
72969966,0cyclictest0-21swapper/110:21:371
72969963,2cyclictest8781-21chrt08:21:221
72969963,2cyclictest668-21runrttasks07:16:011
72969963,2cyclictest502-21systemd-logind10:15:081
72969963,2cyclictest30922-21sh09:10:251
72969963,2cyclictest29818-21unixbench_singl11:15:391
72969963,2cyclictest16646-21taskset07:28:141
72969963,2cyclictest13226-21cut09:25:181
72969963,2cyclictest1-21systemd07:45:311
72969963,2cyclictest11538-21rm10:59:421
72969962,3cyclictest3758-21snmpd09:20:041
72969962,3cyclictest3758-21snmpd09:19:131
72969962,3cyclictest3758-21snmpd08:58:301
72969962,3cyclictest3758-21snmpd08:30:031
72969962,3cyclictest3758-21snmpd08:05:351
72969962,3cyclictest3758-21snmpd08:02:591
72969962,3cyclictest3758-21snmpd07:54:021
72969962,3cyclictest3758-21snmpd07:42:321
72969962,3cyclictest3758-21snmpd07:36:561
72969962,3cyclictest3583-21ntp_kernel_pll_08:10:261
72969962,3cyclictest29230-21expr07:55:291
72969962,3cyclictest27799-21cat11:45:241
72969962,3cyclictest23980-21cat10:40:241
72969962,3cyclictest23350-21diskstats11:10:281
72969962,3cyclictest20081-21cat12:35:271
72969962,3cyclictest19982-21systemd-journal10:30:341
72969962,3cyclictest11516-21cat11:30:231
72969962,3cyclictest0-21swapper/109:41:111
72969962,1cyclictest0-21swapper/111:26:211
72969962,1cyclictest0-21swapper/111:23:221
72969961,4cyclictest211rcuc/112:20:331
72969961,3cyclictest19982-21systemd-journal07:34:471
72969960,6cyclictest0-21swapper/109:51:401
72969960,5cyclictest14424-21expr10:00:221
72969960,4cyclictest19982-21systemd-journal10:35:091
72969960,2cyclictest19982-21systemd-journal08:29:471
72969960,1cyclictest0-21swapper/112:10:501
72919966,0cyclictest0-21swapper/011:47:160
72919965,1cyclictest12-21ksoftirqd/008:55:000
72919963,2cyclictest508-21dbus-daemon11:39:240
72919963,2cyclictest3758-21snmpd11:27:080
72919963,2cyclictest3758-21snmpd10:45:490
72919963,2cyclictest29741-11brltty08:28:180
72919963,2cyclictest25678-21ssh10:41:290
72919963,2cyclictest25038-21systemctl12:10:320
72919963,2cyclictest2403-21apt-get10:20:210
72919963,2cyclictest23011-21ntpq09:35:220
72919962,3cyclictest8218-21cat07:10:410
72919962,3cyclictest8218-21cat07:10:410
72919962,3cyclictest6335-21cron10:55:010
72919962,3cyclictest3758-21snmpd11:31:330
72919962,3cyclictest3758-21snmpd10:25:490
72919962,3cyclictest3758-21snmpd09:43:030
72919962,3cyclictest3758-21snmpd09:04:370
72919962,3cyclictest3758-21snmpd08:35:090
72919962,3cyclictest3758-21snmpd08:23:390
72919962,3cyclictest3758-21snmpd07:50:200
72919962,3cyclictest3758-21snmpd07:45:290
72919962,3cyclictest3758-21snmpd07:32:290
72919962,3cyclictest3758-21snmpd07:15:070
72919962,3cyclictest30224-21cat10:15:240
72919962,3cyclictest24699-21cat10:10:230
72919962,3cyclictest23654-21cat11:10:300
72919962,3cyclictest13052-21ls10:30:220
72919962,3cyclictest12356-21sort11:00:210
72919962,3cyclictest1-21systemd09:15:070
72919962,3cyclictest0-21swapper/010:35:220
72919962,3cyclictest0-21swapper/007:55:430
72919962,1cyclictest0-21swapper/011:56:350
72919962,1cyclictest0-21swapper/011:05:280
72919962,1cyclictest0-21swapper/009:50:060
72919962,1cyclictest0-21swapper/009:26:100
72919961,3cyclictest29741-11brltty08:45:260
72919961,3cyclictest16969-21lldpd11:19:210
72919960,6cyclictest0-21swapper/012:05:180
72919960,6cyclictest0-21swapper/011:40:250
73059953,1cyclictest0-21swapper/309:00:233
73059952,2cyclictest5473-21smartctl08:15:243
73059952,2cyclictest11723-21grep08:30:233
73059951,3cyclictest396-21apt-get08:05:233
73059951,3cyclictest3758-21snmpd09:45:033
73059950,3cyclictest16969-21lldpd10:15:113
73009953,1cyclictest3758-21snmpd08:20:032
73009952,2cyclictest28-21ksoftirqd/208:15:212
73009951,3cyclictest2847-21cat08:10:212
72969955,0cyclictest0-21swapper/110:45:191
72969953,1cyclictest19645-21cat08:45:271
72969952,2cyclictest25291-21seq09:00:211
72919953,1cyclictest14967-21cpuspeed_turbos07:25:220
72919952,2cyclictest3758-21snmpd09:30:010
72919951,3cyclictest750-21expr08:05:240
72919950,3cyclictest19982-21systemd-journal09:20:030
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional