You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-06-09 - 10:53

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Fri Jun 09, 2023 00:44:22)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
132892324289,23sleep10-21swapper/119:07:131
134702295259,23sleep30-21swapper/319:09:333
132932289262,16sleep00-21swapper/019:07:160
131602279245,21sleep20-21swapper/219:05:462
302552760,0sleep30-21swapper/320:55:273
303562690,0sleep00-21swapper/021:27:590
75802640,0sleep30-21swapper/322:41:513
101902570,0sleep20-21swapper/200:15:392
278772560,0sleep20-21swapper/221:25:452
198012560,1sleep10-21swapper/122:50:261
305252550,0sleep30-21swapper/319:45:203
161382550,0sleep30-21swapper/321:18:163
295932240,0sleep20-21swapper/222:57:242
88252230,0sleep10-21swapper/122:43:011
128772230,0sleep00-21swapper/021:15:300
164802180,0sleep20-21swapper/221:18:362
10572170,0sleep10-21swapper/123:45:241
204462160,0sleep00-21swapper/023:35:380
112802140,0sleep10-21swapper/123:30:141
292232130,0sleep20-21swapper/219:40:272
163692120,0sleep20-21swapper/223:33:322
1361499108,2cyclictest28-21ksoftirqd/220:15:002
1361499108,2cyclictest28-21ksoftirqd/219:15:002
1361499104,4cyclictest28-21ksoftirqd/221:56:462
19858290,1sleep1221ksoftirqd/123:58:521
136189994,3cyclictest25948-21systemd-journal21:53:083
136189994,3cyclictest25948-21systemd-journal19:51:443
136149998,1cyclictest28-21ksoftirqd/223:25:002
136149998,1cyclictest28-21ksoftirqd/222:25:012
136149997,2cyclictest28-21ksoftirqd/223:25:012
136149997,2cyclictest28-21ksoftirqd/222:05:012
136149994,3cyclictest25948-21systemd-journal20:35:072
136149993,4cyclictest28-21ksoftirqd/222:20:272
136149992,5cyclictest28-21ksoftirqd/222:40:272
136149992,5cyclictest28-21ksoftirqd/222:32:142
136149992,4cyclictest28-21ksoftirqd/222:52:062
136149991,4cyclictest28-21ksoftirqd/223:10:472
136149990,6cyclictest199942tail20:30:242
136069996,2cyclictest12-21ksoftirqd/020:20:000
136069994,4cyclictest25948-21systemd-journal23:33:400
136189986,1cyclictest29854-21cat22:35:183
136189985,2cyclictest508-21dbus-daemon20:42:383
136189984,3cyclictest508-21dbus-daemon00:28:433
136189983,3cyclictest25948-21systemd-journal23:38:393
136189983,3cyclictest25948-21systemd-journal22:00:023
136189983,3cyclictest25948-21systemd-journal20:00:553
136149987,1cyclictest28-21ksoftirqd/219:40:012
136149984,3cyclictest508-21dbus-daemon21:09:592
136149983,4cyclictest28-21ksoftirqd/221:47:152
136149983,3cyclictest25948-21systemd-journal19:25:012
136149982,5cyclictest0-21swapper/200:01:262
136149982,4cyclictest3673-21diskmemload21:44:292
136149982,4cyclictest28-21ksoftirqd/223:55:202
136149982,4cyclictest28-21ksoftirqd/223:46:302
136149982,4cyclictest28-21ksoftirqd/222:15:392
136149982,4cyclictest28-21ksoftirqd/222:07:302
136149982,4cyclictest28-21ksoftirqd/221:52:312
136149982,4cyclictest28-21ksoftirqd/200:35:382
136149982,3cyclictest14753-21awk21:40:022
136149982,3cyclictest0-21swapper/223:02:582
136149981,5cyclictest3673-21diskmemload23:07:412
136149981,5cyclictest3453-21kworker/2:223:35:262
136149981,5cyclictest28-21ksoftirqd/222:46:562
136149981,4cyclictest28-21ksoftirqd/223:44:332
136149981,4cyclictest28-21ksoftirqd/200:31:252
136149981,4cyclictest0-21swapper/222:14:252
136149980,6cyclictest28-21ksoftirqd/223:52:292
136149980,6cyclictest21993-21ssh21:21:572
136119986,2cyclictest22-21ksoftirqd/119:40:011
136119986,1cyclictest0-21swapper/122:18:221
136119984,3cyclictest25948-21systemd-journal23:12:231
136119980,7cyclictest0-21swapper/120:55:271
136119980,5cyclictest668-21runrttasks00:35:001
136069986,1cyclictest25738-21ssh00:03:080
136069986,1cyclictest0-21swapper/023:58:410
136069983,3cyclictest25948-21systemd-journal20:47:120
136069983,3cyclictest25948-21systemd-journal00:07:300
136069982,3cyclictest7720-21turbostat00:40:000
136189976,1cyclictest6739-21kworker/3:200:24:233
136189974,2cyclictest508-21dbus-daemon22:24:243
136189974,2cyclictest508-21dbus-daemon22:05:023
136189973,3cyclictest508-21dbus-daemon23:24:293
136189973,3cyclictest3758-21snmpd20:51:393
136189973,3cyclictest3758-21snmpd20:28:313
136189973,3cyclictest25948-21systemd-journal23:08:133
136189973,3cyclictest25948-21systemd-journal19:41:553
136189973,3cyclictest25948-21systemd-journal00:18:313
136189973,3cyclictest0-21swapper/323:45:013
136189973,3cyclictest0-21swapper/322:10:063
136189973,3cyclictest0-21swapper/321:32:163
136189973,2cyclictest25948-21systemd-journal23:33:263
136189973,1cyclictest0-21swapper/323:27:523
136189973,1cyclictest0-21swapper/322:32:593
136189971,5cyclictest16290-21cut22:25:193
136149976,1cyclictest28-21ksoftirqd/219:35:012
136149976,1cyclictest271rcuc/223:15:372
136149973,3cyclictest4878-21apt-get20:00:152
136149973,3cyclictest1108-21ntpq19:50:232
136149972,3cyclictest17413-21latency19:15:252
136149972,3cyclictest0-21swapper/220:20:222
136149972,1cyclictest141rcu_preempt20:40:172
136149971,4cyclictest28-21ksoftirqd/222:35:232
136149971,4cyclictest28-21ksoftirqd/221:10:082
136149971,4cyclictest28-21ksoftirqd/219:47:132
136149971,4cyclictest28-21ksoftirqd/200:20:382
136149971,4cyclictest21325-21kworker/2:000:05:472
136149971,4cyclictest0-21swapper/219:29:362
136149971,4cyclictest0-21swapper/200:25:042
136149971,3cyclictest28-21ksoftirqd/221:30:032
136149971,3cyclictest0-21swapper/219:55:182
136149970,3cyclictest0-21swapper/200:10:022
136119976,1cyclictest3673-21diskmemload21:22:541
136119975,1cyclictest2749-21df19:55:201
136119974,2cyclictest3758-21snmpd21:36:371
136119974,2cyclictest25948-21systemd-journal21:16:001
136119973,3cyclictest508-21dbus-daemon23:25:011
136119973,3cyclictest508-21dbus-daemon22:50:011
136119973,3cyclictest508-21dbus-daemon19:44:381
136119973,3cyclictest25948-21systemd-journal22:35:161
136119973,3cyclictest25948-21systemd-journal00:00:211
136119973,3cyclictest22089-21cron21:45:021
136119973,3cyclictest1-21systemd00:16:381
136119973,2cyclictest25948-21systemd-journal23:50:211
136119973,1cyclictest0-21swapper/121:51:391
136119973,1cyclictest0-21swapper/100:20:411
136119972,3cyclictest25948-21systemd-journal20:18:011
136069974,2cyclictest508-21dbus-daemon23:41:100
136069974,2cyclictest508-21dbus-daemon22:33:360
136069974,2cyclictest19928-21sshd23:13:270
136069974,2cyclictest1-21systemd19:13:220
136069973,3cyclictest508-21dbus-daemon22:16:300
136069973,3cyclictest508-21dbus-daemon22:13:100
136069973,3cyclictest508-21dbus-daemon21:55:130
136069973,3cyclictest508-21dbus-daemon19:21:430
136069973,3cyclictest24376-21wc20:40:250
136069973,3cyclictest11736-21in:imuxsock19:44:140
136069973,3cyclictest0-21swapper/021:53:020
136069973,1cyclictest0-21swapper/022:48:530
136069973,1cyclictest0-21swapper/021:39:470
136069972,3cyclictest25948-21systemd-journal21:42:160
136069972,3cyclictest25948-21systemd-journal21:24:290
136069972,3cyclictest25948-21systemd-journal20:30:070
11060270,0sleep10-21swapper/123:06:551
136189963,2cyclictest7950-21/usr/sbin/munin21:35:203
136189963,2cyclictest3758-21snmpd21:20:233
136189963,2cyclictest32322-21forks21:00:223
136189963,2cyclictest26219-21diskstats21:25:193
136189963,2cyclictest25948-21systemd-journal23:02:233
136189963,2cyclictest24987-21chrt19:30:593
136189963,2cyclictest24674-21ssh21:45:443
136189963,2cyclictest20932-21kworker/u8:000:00:013
136189963,2cyclictest1668-21df22:15:223
136189963,2cyclictest0-21swapper/300:10:493
136189962,3cyclictest4882-21basename21:10:193
136189962,3cyclictest3758-21snmpd20:45:123
136189962,3cyclictest3758-21snmpd20:30:083
136189962,3cyclictest3758-21snmpd20:15:403
136189962,3cyclictest3758-21snmpd20:11:283
136189962,3cyclictest3758-21snmpd20:08:463
136189962,3cyclictest3758-21snmpd19:22:543
136189962,3cyclictest3758-21snmpd19:16:093
136189962,3cyclictest3758-21snmpd00:06:413
136189962,3cyclictest28326-21tune2fs00:30:213
136189962,3cyclictest21308-21sed20:35:173
136189962,3cyclictest21140-21basename19:25:163
136189962,3cyclictest19688-21cat22:50:253
136189962,3cyclictest15492-21date23:55:233
136189962,3cyclictest13952-21find20:20:003
136189962,3cyclictest1-21systemd19:35:543
136189962,3cyclictest0-21swapper/323:40:063
136189962,1cyclictest0-21swapper/322:06:083
136189961,3cyclictest25948-21systemd-journal19:57:013
136189961,3cyclictest25948-21systemd-journal00:36:133
136189961,2cyclictest15205-21ssh21:40:143
136189960,6cyclictest0-21swapper/323:10:263
136189960,4cyclictest25948-21systemd-journal23:16:563
136189960,2cyclictest11730-21cstates22:45:223
136189960,0cyclictest0-21swapper/323:53:293
136189960,0cyclictest0-21swapper/322:57:263
136149965,1cyclictest28-21ksoftirqd/220:15:002
136149965,1cyclictest271rcuc/221:00:212
136149965,1cyclictest271rcuc/220:25:272
136149963,2cyclictest30130-21cut20:55:252
136149961,3cyclictest28-21ksoftirqd/220:05:372
136149961,2cyclictest0-21swapper/220:50:202
136149960,4cyclictest0-21swapper/220:45:272
136119966,0cyclictest0-21swapper/122:13:111
136119963,2cyclictest8995-21head22:20:191
136119963,2cyclictest5998-21systemctl21:55:261
136119963,2cyclictest508-21dbus-daemon19:10:261
136119963,2cyclictest3590-21sh00:10:321
136119963,2cyclictest23901-21cat23:15:391
136119963,2cyclictest22667-21sh21:45:181
136119963,2cyclictest18994-21fschecks_time20:30:171
136119963,2cyclictest1-21systemd21:26:501
136119963,2cyclictest1198-21sshd21:02:101
136119963,2cyclictest11736-21in:imuxsock23:26:091
136119963,2cyclictest11736-21in:imuxsock20:14:161
136119963,1cyclictest0-21swapper/123:36:461
136119962,3cyclictest7767-21cat20:05:211
136119962,3cyclictest3758-21snmpd22:02:021
136119962,3cyclictest3758-21snmpd21:05:121
136119962,3cyclictest3758-21snmpd20:36:471
136119962,3cyclictest3758-21snmpd19:50:031
136119962,3cyclictest3758-21snmpd00:05:501
136119962,3cyclictest32464-21grep19:50:001
136119962,3cyclictest27081-21grep23:40:251
136119962,3cyclictest25948-21systemd-journal20:25:071
136119962,1cyclictest0-21swapper/123:01:361
136119962,1cyclictest0-21swapper/122:56:001
136119962,1cyclictest0-21swapper/122:30:141
136119962,1cyclictest0-21swapper/122:25:141
136119961,4cyclictest0-21swapper/121:30:241
136119961,3cyclictest25948-21systemd-journal19:26:131
136119960,6cyclictest0-21swapper/120:45:211
136119960,0cyclictest0-21swapper/122:05:081
136119960,0cyclictest0-21swapper/121:12:401
136119960,0cyclictest0-21swapper/100:35:291
136119960,0cyclictest0-21swapper/100:25:011
136069963,2cyclictest8265-21ssh22:20:090
136069963,2cyclictest5898-21unixbench_singl21:10:260
136069963,2cyclictest5266-21ntp_kernel_pll_23:25:240
136069963,2cyclictest3758-21snmpd23:15:190
136069963,2cyclictest3758-21snmpd22:25:210
136069963,2cyclictest3758-21snmpd22:05:260
136069963,2cyclictest3758-21snmpd19:51:100
136069963,2cyclictest3758-21snmpd19:17:100
136069963,2cyclictest31685-21ssh22:35:370
136069963,2cyclictest30902-21gltestperf19:45:220
136069963,2cyclictest2490-21cat21:05:280
136069963,2cyclictest24581-21sh22:54:240
136069963,2cyclictest21212-21tune2fs20:35:160
136069963,2cyclictest1359-21tail21:30:200
136069963,2cyclictest11736-21in:imuxsock21:04:550
136069963,2cyclictest11736-21in:imuxsock00:18:430
136069962,3cyclictest9156-21sensors23:05:290
136069962,3cyclictest8632-21sed20:05:270
136069962,3cyclictest508-21dbus-daemon23:50:450
136069962,3cyclictest508-21dbus-daemon23:04:530
136069962,3cyclictest508-21dbus-daemon20:25:320
136069962,3cyclictest3758-21snmpd23:45:010
136069962,3cyclictest3758-21snmpd00:34:000
136069962,3cyclictest3758-21snmpd00:21:420
136069962,3cyclictest3046-21cat19:55:220
136069962,3cyclictest30351-21cat20:55:290
136069962,3cyclictest30085-21cat23:20:240
136069962,3cyclictest26323-21fw_packets22:55:210
136069962,3cyclictest26297-21cat19:35:290
136069962,3cyclictest25948-21systemd-journal19:30:010
136069962,3cyclictest23362-21idleruntime21:45:220
136069962,3cyclictest14568-21cut20:20:200
136069962,1cyclictest0-21swapper/000:25:050
136069961,3cyclictest25948-21systemd-journal22:40:000
136069961,3cyclictest25948-21systemd-journal20:10:060
136069960,3cyclictest2773-21/usr/sbin/munin00:10:200
136069960,3cyclictest13019-21tr22:00:250
136069960,2cyclictest25344-21munin-run19:35:000
136069960,0cyclictest0-21swapper/020:00:020
136189952,2cyclictest1790-21cpuspeed21:05:193
136189951,2cyclictest25948-21systemd-journal19:10:023
136119953,1cyclictest4750-21apt-config20:00:021
136119952,2cyclictest28130-21awk20:50:211
136119952,2cyclictest24365-21open_inodes19:30:241
136119952,2cyclictest16369-21munin-node19:15:021
136119952,2cyclictest1-21systemd20:40:071
136119951,3cyclictest3758-21snmpd20:20:021
136119951,3cyclictest18937-21apt-get19:20:181
136069951,3cyclictest3758-21snmpd20:50:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional