You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 16:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Wed Apr 24, 2024 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
205423300,4sleep122-21ksoftirqd/107:05:191
28422266234,19sleep30-21swapper/307:07:273
28512263226,22sleep20-21swapper/207:07:342
27872263229,22sleep00-21swapper/007:06:430
78492600,1sleep10-21swapper/107:20:131
57082590,0sleep30-21swapper/312:24:053
249802590,0sleep30-21swapper/310:07:303
98742220,0sleep00-21swapper/009:28:020
144822190,0sleep30-21swapper/311:46:123
59072180,0sleep00-21swapper/010:46:350
262412170,0sleep10-21swapper/109:41:531
21862170,0sleep00-21swapper/012:21:050
317699152,7cyclictest12732-21cat09:30:133
186722150,1sleep20-21swapper/210:02:132
134722150,0sleep10-21swapper/110:53:171
134722150,0sleep10-21swapper/110:53:171
54042140,0sleep30-21swapper/309:51:493
317699142,9cyclictest21328-21ssh09:38:223
317699141,10cyclictest2517-1kworker/u9:110:38:153
317699140,11cyclictest30957-21ssh11:34:453
317699140,11cyclictest1632-21uname10:15:173
16972140,0sleep30-21swapper/309:49:283
317699133,5cyclictest11870-21sh09:56:503
317699132,8cyclictest0-21swapper/312:07:423
317699130,9cyclictest8280-21ssh09:25:443
317699130,9cyclictest16282-21ssh11:21:293
317699130,8cyclictest23803-21/usr/sbin/munin12:35:213
317699130,7cyclictest27728-21df09:15:123
317699130,10cyclictest6009-21ssh10:46:433
317699130,10cyclictest31620-21ssh11:59:013
317699130,10cyclictest2881-21ssh09:20:443
317699123,5cyclictest20835-21diskmemload11:38:333
317699122,8cyclictest13388-21snmpd11:41:233
317699121,9cyclictest20835-21diskmemload09:40:543
317699121,8cyclictest10959-21ssh10:23:133
317699120,9cyclictest4046-21ssh11:12:103
317699120,9cyclictest30813-21ssh12:19:263
317699120,9cyclictest30260-21sh11:07:263
317699120,9cyclictest21705-21sh12:34:403
317699120,9cyclictest21395-21sh11:25:403
317699120,9cyclictest18885-21sh10:57:253
317699120,9cyclictest18850-21ssh12:10:483
317699120,9cyclictest18701-21ssh10:30:083
317699120,9cyclictest11272-21chrt11:17:543
317699120,9cyclictest11130-21ssh12:27:093
317699120,9cyclictest0-21swapper/309:10:053
317699120,7cyclictest3207-21ssh12:00:373
317699120,7cyclictest29882-21ssh10:11:063
317699120,7cyclictest15310-21sh10:00:033
317699120,7cyclictest13017-21ssh10:52:473
317699120,7cyclictest13017-21ssh10:52:463
242202120,0sleep20-21swapper/212:15:112
317699110,9cyclictest20956-21ssh11:50:453
317699110,8cyclictest30381-21taskset08:16:493
317699110,8cyclictest17786-21chrt09:00:263
317699110,7cyclictest1366-21idleruntime08:25:183
317699110,7cyclictest1166-21sh10:43:023
317699110,6cyclictest18312-21cat07:50:173
317699110,6cyclictest15002-21ssh10:25:523
185372110,0sleep10-21swapper/110:57:011
317699100,9cyclictest11634-21grep08:50:013
317699100,8cyclictest19982-21systemd-journal07:45:063
317699100,8cyclictest19982-21systemd-journal07:45:003
317699100,7cyclictest4833-21chrt08:34:083
317699100,6cyclictest27381-21netstat08:10:203
317699100,6cyclictest16206-21runrttasks08:58:203
317699100,5cyclictest8038-21hddtemp_smartct08:40:143
317699100,5cyclictest21685-21cstates11:00:123
31769992,6cyclictest13388-21snmpd08:53:473
31769991,7cyclictest6347-21sendmail_mailst08:35:243
31769990,8cyclictest9176-21apt-get07:25:123
31769990,8cyclictest4778-21sort07:10:223
31769990,8cyclictest30924-21/usr/sbin/munin08:20:263
31769990,8cyclictest24728-21sort08:05:143
31769990,8cyclictest0-21swapper/307:35:073
31769990,8cyclictest0-21swapper/307:30:023
31769990,5cyclictest7297-21forks07:20:103
31769990,5cyclictest20387-21smartctl07:55:153
31719996,2cyclictest7121-21ssh09:53:392
31719994,3cyclictest19982-21systemd-journal09:20:372
31719990,6cyclictest11610-21idleruntime-cro09:30:002
31679994,3cyclictest19982-21systemd-journal11:20:481
31639996,2cyclictest12-21ksoftirqd/008:50:010
31639990,6cyclictest17683-21perf09:35:000
5098280,1sleep00-21swapper/008:35:010
31769980,7cyclictest5687-21munin-node07:15:023
31769980,7cyclictest22008-21acpi08:00:093
31769980,7cyclictest19381-21fschecks_time09:05:163
31719984,3cyclictest19982-21systemd-journal07:27:092
31719984,3cyclictest19116-21gdbus09:40:012
31719984,2cyclictest19982-21systemd-journal12:39:382
31719983,3cyclictest19982-21systemd-journal11:49:102
31719983,3cyclictest19982-21systemd-journal11:39:082
31719983,3cyclictest19982-21systemd-journal11:18:422
31719983,3cyclictest19982-21systemd-journal10:39:292
31719983,3cyclictest19982-21systemd-journal08:07:122
31719983,3cyclictest19982-21systemd-journal07:57:112
31719983,3cyclictest19982-21systemd-journal07:40:002
31719983,3cyclictest19982-21systemd-journal07:12:332
31679984,4cyclictest16366-21idleruntime-cro09:00:011
31679984,3cyclictest19982-21systemd-journal10:17:471
31679982,3cyclictest14751-21turbostat10:00:011
31679980,7cyclictest0-21swapper/111:02:021
31639985,2cyclictest508-21dbus-daemon12:09:100
31639983,4cyclictest19982-21systemd-journal11:07:270
31639983,3cyclictest19982-21systemd-journal10:22:480
31639980,7cyclictest20876-21ssh10:32:460
1345280,1sleep1211rcuc/109:20:141
31719974,2cyclictest11736-21in:imuxsock11:14:572
31719974,2cyclictest11736-21in:imuxsock09:33:082
31719973,3cyclictest2556-21sed10:15:242
31719973,3cyclictest17152-21awk10:55:252
31719973,3cyclictest13388-21snmpd12:29:032
31719973,3cyclictest13388-21snmpd08:12:312
31719973,1cyclictest0-21swapper/212:06:182
31719972,3cyclictest19982-21systemd-journal10:45:222
31719972,3cyclictest19982-21systemd-journal09:49:562
31719972,3cyclictest19982-21systemd-journal08:50:352
31719972,3cyclictest19982-21systemd-journal08:30:582
31719972,3cyclictest19982-21systemd-journal08:04:502
31719972,3cyclictest19982-21systemd-journal07:17:012
31719971,5cyclictest0-21swapper/209:20:002
31719971,3cyclictest26408-21perf11:05:012
31719970,0cyclictest0-21swapper/211:44:192
31679974,2cyclictest508-21dbus-daemon08:48:051
31679974,2cyclictest19982-21systemd-journal08:14:511
31679973,3cyclictest508-21dbus-daemon08:06:471
31679973,3cyclictest19982-21systemd-journal11:26:131
31679973,3cyclictest19982-21systemd-journal10:36:091
31679973,3cyclictest13074-21cron11:19:591
31679973,3cyclictest0-21swapper/110:03:361
31679973,2cyclictest19982-21systemd-journal09:45:101
31679971,5cyclictest0-21swapper/111:57:301
31679971,4cyclictest19982-21systemd-journal11:46:391
31679971,3cyclictest451-21munin-run10:15:011
31639974,2cyclictest508-21dbus-daemon09:00:350
31639973,3cyclictest24622-21df_inode08:05:110
31639973,3cyclictest13388-21snmpd11:15:160
31639973,3cyclictest13388-21snmpd07:43:450
31639973,1cyclictest0-21swapper/012:14:230
31639973,1cyclictest0-21swapper/011:57:300
31639972,3cyclictest11506-21turbostat11:45:000
31639970,3cyclictest314872sh09:18:230
10822270,1sleep20-21swapper/210:23:032
32199260,2sleep228-21ksoftirqd/208:20:252
31719963,2cyclictest28471-21unixbench_singl11:05:262
31719963,2cyclictest20507-21rm11:25:202
31719963,2cyclictest17264-21sshd07:49:482
31719963,2cyclictest11736-21in:imuxsock07:20:042
31719963,2cyclictest11200-21chrt09:56:082
31719962,3cyclictest508-21dbus-daemon09:41:302
31719962,3cyclictest18849-21sshd09:05:032
31719962,3cyclictest18232-21cat07:50:172
31719962,3cyclictest16741-21cat12:10:112
31719962,3cyclictest15752-21sed08:55:272
31719962,3cyclictest13388-21snmpd12:21:212
31719962,3cyclictest13388-21snmpd11:22:102
31719962,3cyclictest13388-21snmpd10:09:262
31719962,3cyclictest13388-21snmpd08:18:192
31719962,3cyclictest10330-21cat08:45:192
31719962,3cyclictest0-21swapper/211:50:002
31719962,2cyclictest19982-21systemd-journal11:56:152
31719962,1cyclictest0-21swapper/212:00:042
31719962,1cyclictest0-21swapper/210:27:432
31719961,3cyclictest19982-21systemd-journal10:50:222
31719961,3cyclictest19982-21systemd-journal10:50:222
31719961,3cyclictest19982-21systemd-journal10:30:182
31719960,6cyclictest0-21swapper/212:33:232
31719960,6cyclictest0-21swapper/211:31:122
31719960,6cyclictest0-21swapper/210:42:292
31719960,6cyclictest0-21swapper/210:12:402
31719960,2cyclictest5174-21/usr/sbin/munin08:35:122
31679966,0cyclictest0-21swapper/108:25:171
31679963,3cyclictest30740-21kworker/1:208:36:471
31679963,2cyclictest30232-21grep10:40:161
31679963,2cyclictest2517-1kworker/u9:111:12:201
31679963,2cyclictest22663-21cat12:35:121
31679963,2cyclictest19982-21systemd-journal07:15:531
31679963,2cyclictest19758-21chrt07:55:101
31679963,2cyclictest16969-21lldpd10:32:531
31679963,2cyclictest13388-21snmpd08:16:161
31679963,2cyclictest0-21swapper/111:50:121
31679962,4cyclictest30740-21kworker/1:207:54:591
31679962,3cyclictest19982-21systemd-journal12:00:371
31679962,3cyclictest19249-21expr09:05:151
31679962,3cyclictest16969-21lldpd08:23:031
31679962,3cyclictest13388-21snmpd12:05:141
31679962,3cyclictest13388-21snmpd11:36:081
31679962,3cyclictest13388-21snmpd09:31:301
31679962,3cyclictest13388-21snmpd09:25:241
31679962,3cyclictest13388-21snmpd08:43:171
31679962,3cyclictest13388-21snmpd08:04:461
31679962,3cyclictest13388-21snmpd07:49:121
31679962,3cyclictest13388-21snmpd07:35:031
31679962,3cyclictest13388-21snmpd07:34:091
31679962,3cyclictest13388-21snmpd07:25:531
31679962,3cyclictest13388-21snmpd07:14:441
31679962,1cyclictest13855-21awk08:55:011
31679962,1cyclictest0-21swapper/112:31:481
31679962,1cyclictest0-21swapper/112:25:451
31679962,1cyclictest0-21swapper/112:10:471
31679962,1cyclictest0-21swapper/111:41:551
31679962,1cyclictest0-21swapper/110:46:421
31679962,1cyclictest0-21swapper/110:25:071
31679962,1cyclictest0-21swapper/109:35:121
31679962,1cyclictest0-21swapper/109:17:431
31679962,1cyclictest0-21swapper/109:10:051
31679961,3cyclictest508-21dbus-daemon08:33:041
31679961,3cyclictest19982-21systemd-journal12:20:021
31679961,3cyclictest19982-21systemd-journal12:15:521
31679961,3cyclictest19982-21systemd-journal11:33:181
31679961,3cyclictest16969-21lldpd10:07:021
31679961,2cyclictest29486-21ssh11:06:311
31679960,3cyclictest3682-21which09:50:211
31679960,2cyclictest7880-21latency10:20:161
31639964,1cyclictest26133-21smartctl11:30:120
31639963,2cyclictest508-21dbus-daemon07:55:310
31639963,2cyclictest32158-21sh10:41:190
31639963,2cyclictest3076-21ssh09:21:010
31639963,2cyclictest26476-21dpkg08:10:130
31639963,2cyclictest24003-21sh11:53:580
31639963,2cyclictest20022-21grep11:25:160
31639963,2cyclictest17706-21ssh10:55:590
31639963,2cyclictest17064-21ssh11:22:320
31639963,2cyclictest13606-21cat07:35:160
31639963,2cyclictest13388-21snmpd11:11:040
31639963,2cyclictest1336-21tr12:00:120
31639963,2cyclictest12643-21sh10:25:030
31639963,2cyclictest11168-21ssh12:27:120
31639962,3cyclictest23430-21cat10:35:080
31639962,3cyclictest23117-21fschecks_time12:35:150
31639962,3cyclictest15659-21cat12:30:180
31639962,3cyclictest13388-21snmpd11:46:140
31639962,3cyclictest13388-21snmpd10:11:350
31639962,3cyclictest13388-21snmpd09:53:560
31639962,3cyclictest13388-21snmpd09:37:390
31639962,3cyclictest13388-21snmpd09:05:470
31639962,3cyclictest13388-21snmpd08:57:140
31639962,3cyclictest13388-21snmpd08:40:020
31639962,3cyclictest13388-21snmpd08:01:240
31639962,3cyclictest13388-21snmpd07:45:150
31639962,3cyclictest13388-21snmpd07:20:140
31639962,3cyclictest13388-21snmpd07:12:050
31639962,3cyclictest13337-21grep08:50:250
31639962,3cyclictest1195-21grep08:25:170
31639962,3cyclictest0-21swapper/009:11:390
31639962,1cyclictest0-21swapper/012:15:170
31639962,1cyclictest0-21swapper/010:51:560
31639962,1cyclictest0-21swapper/010:51:560
31639962,1cyclictest0-21swapper/010:06:590
31639961,3cyclictest19982-21systemd-journal10:00:130
31639961,3cyclictest19982-21systemd-journal08:24:530
31639960,6cyclictest0-21swapper/009:42:510
31639960,5cyclictest1286-21sshd10:15:130
31639960,0cyclictest0-21swapper/011:03:190
31639960,0cyclictest0-21swapper/009:55:210
31719952,2cyclictest7581-21cut08:40:122
31719952,2cyclictest1910-21cut08:25:242
31719952,2cyclictest17596-21ntpq09:00:202
31719952,2cyclictest14848-21chrt07:42:342
31719951,3cyclictest11555-21dpkg07:30:002
31719950,4cyclictest21118-21sshd09:10:032
31679952,2cyclictest16618-21sshd09:00:021
31679952,2cyclictest14738-21chrt07:41:081
31639953,1cyclictest13388-21snmpd07:25:110
31639952,2cyclictest5177-21acpi08:35:110
31639952,2cyclictest29179-21apt-get09:45:130
31639952,2cyclictest17552-21basename07:50:120
31639952,2cyclictest13388-21snmpd11:35:170
31639952,2cyclictest13388-21snmpd07:31:530
31639951,3cyclictest5807-21munin-node07:15:020
31639951,3cyclictest13388-21snmpd08:15:070
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional