You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-12-03 - 04:04

x86 Intel Core i5-8265UE @1600 MHz, Linux 5.10.41-rt42 (Profile)

Latency plot of system in rack #a, slot #8
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the alll highest latencies:
System rackaslot8.osadl.org (updated Sat Dec 03, 2022 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
170632307277,19sleep20-21swapper/219:09:342
167102287256,20sleep00-21swapper/019:05:250
170892279247,20sleep30-21swapper/319:09:553
169892270239,20sleep10-21swapper/119:08:361
242432770,0sleep20-21swapper/221:45:182
35572640,0sleep00-21swapper/023:28:020
190142610,0sleep30-21swapper/322:05:123
240482550,0sleep10-21swapper/121:45:161
235042550,0sleep10-21swapper/122:55:401
298262220,0sleep122-21ksoftirqd/121:25:221
141292190,1sleep214128-21ssh00:25:182
15152180,0sleep00-21swapper/021:52:200
179212160,0sleep00-21swapper/021:17:040
301582140,0sleep30-21swapper/321:25:403
236622140,0sleep20-21swapper/222:55:492
17212991411,2cyclictest34-21ksoftirqd/323:40:013
17212991411,2cyclictest34-21ksoftirqd/323:40:013
17212991312,1cyclictest34-21ksoftirqd/300:40:003
164642130,0sleep10-21swapper/122:03:071
106972130,0sleep10-21swapper/121:59:261
17212991210,1cyclictest34-21ksoftirqd/322:00:023
1721299119,1cyclictest4830-21idleruntime-cro21:05:003
17212991110,1cyclictest34-21ksoftirqd/322:20:013
17212991110,1cyclictest34-21ksoftirqd/321:50:023
1721299109,1cyclictest34-21ksoftirqd/323:35:013
1721299109,1cyclictest34-21ksoftirqd/300:35:003
1721299108,2cyclictest34-21ksoftirqd/320:40:003
1721299101,2cyclictest34-21ksoftirqd/319:15:133
169732100,0sleep10-21swapper/100:01:511
172129998,1cyclictest34-21ksoftirqd/321:14:593
172129998,1cyclictest34-21ksoftirqd/300:30:003
172129997,1cyclictest34-21ksoftirqd/323:50:013
172129997,1cyclictest34-21ksoftirqd/323:20:013
172129997,1cyclictest34-21ksoftirqd/323:00:013
172129997,1cyclictest34-21ksoftirqd/319:15:013
172129996,2cyclictest34-21ksoftirqd/320:15:003
172129996,2cyclictest34-21ksoftirqd/319:40:013
172129996,2cyclictest34-21ksoftirqd/300:10:003
172079992,3cyclictest12550-21awk00:25:002
172049994,3cyclictest283-21systemd-journal20:49:591
172009996,2cyclictest12-21ksoftirqd/020:00:010
172129987,1cyclictest34-21ksoftirqd/323:15:013
172129987,1cyclictest34-21ksoftirqd/321:45:023
172129987,1cyclictest34-21ksoftirqd/321:00:003
172129987,1cyclictest34-21ksoftirqd/320:25:003
172129987,1cyclictest34-21ksoftirqd/319:25:003
172129986,2cyclictest34-21ksoftirqd/319:30:013
172129986,1cyclictest34-21ksoftirqd/322:40:013
172129986,1cyclictest34-21ksoftirqd/321:25:003
172129984,2cyclictest283-21systemd-journal23:08:343
172129983,3cyclictest283-21systemd-journal20:06:003
172129983,1cyclictest141rcu_preempt23:45:013
172129981,4cyclictest2960-21ssh23:27:253
172009984,1cyclictest28987-21munin-run19:35:010
172009983,3cyclictest29802-21latency_hist21:50:020
9644270,1sleep10-21swapper/100:22:011
2798270,0sleep00-21swapper/023:04:440
172129976,1cyclictest34-21ksoftirqd/319:40:023
172129976,1cyclictest34-21ksoftirqd/319:35:013
172129975,1cyclictest34-21ksoftirqd/322:45:013
172129975,1cyclictest34-21ksoftirqd/320:55:003
172129974,2cyclictest502-21systemd-logind21:34:433
172129974,1cyclictest34-21ksoftirqd/300:15:193
172129974,1cyclictest141rcu_preempt19:55:203
172129972,4cyclictest34-21ksoftirqd/300:04:493
172129972,1cyclictest0-21swapper/300:10:013
172129971,4cyclictest34-21ksoftirqd/323:23:563
172129971,4cyclictest34-21ksoftirqd/323:00:093
172129970,6cyclictest4725-21ntpq19:50:173
172129970,5cyclictest34-21ksoftirqd/321:19:163
172129970,5cyclictest34-21ksoftirqd/320:45:173
172129970,5cyclictest34-21ksoftirqd/320:15:203
172129970,4cyclictest34-21ksoftirqd/323:55:223
172129970,3cyclictest11840-21ssh22:00:143
172079975,2cyclictest28-21ksoftirqd/200:00:012
172079974,2cyclictest5388-21df21:55:122
172079973,3cyclictest7759-21cat22:20:152
172079973,3cyclictest508-21dbus-daemon19:46:172
172079973,3cyclictest4299-21apt-get21:55:012
172079973,3cyclictest29741-11brltty22:11:262
172079973,3cyclictest19116-21gdbus23:50:002
172079973,3cyclictest14659-21snmpd23:52:192
172079970,1cyclictest141rcu_preempt23:35:112
172079970,1cyclictest141rcu_preempt23:35:112
172049974,2cyclictest508-21dbus-daemon20:34:401
172049974,2cyclictest502-21systemd-logind22:18:571
172049974,2cyclictest283-21systemd-journal23:20:411
172049974,2cyclictest283-21systemd-journal20:52:591
172049973,3cyclictest508-21dbus-daemon22:50:391
172049973,3cyclictest508-21dbus-daemon21:45:011
172049973,3cyclictest283-21systemd-journal20:56:001
172049973,3cyclictest14659-21snmpd19:43:541
172049973,1cyclictest0-21swapper/123:15:081
172049972,3cyclictest283-21systemd-journal19:25:261
172049972,1cyclictest28998-21awk19:35:011
172049971,3cyclictest0-21swapper/119:40:011
172009974,2cyclictest283-21systemd-journal20:45:560
172009973,3cyclictest596-21apt-get20:55:120
172009973,3cyclictest283-21systemd-journal22:23:070
172009972,3cyclictest283-21systemd-journal22:01:260
172009971,4cyclictest283-21systemd-journal21:41:500
172009970,3cyclictest1934-21rm00:15:420
22238260,1sleep30-21swapper/322:31:073
172129965,1cyclictest34-21ksoftirqd/320:34:593
172129965,1cyclictest34-21ksoftirqd/320:29:593
172129963,2cyclictest7112-21cpuspeed22:20:133
172129963,2cyclictest263372sleep320:40:123
172129963,2cyclictest11596-21sh22:47:573
172129962,3cyclictest14659-21snmpd23:50:353
172129962,3cyclictest14659-21snmpd21:35:133
172129962,3cyclictest14659-21snmpd19:45:573
172129962,1cyclictest141rcu_preempt21:50:103
172129961,3cyclictest283-21systemd-journal20:00:033
172129961,2cyclictest14406-21ssh22:50:183
172129961,1cyclictest141rcu_preempt21:05:573
172129960,3cyclictest0-21swapper/322:10:143
172129960,1cyclictest141rcu_preempt22:25:163
172079966,0cyclictest0-21swapper/223:16:482
172079963,2cyclictest508-21dbus-daemon22:15:372
172079963,2cyclictest31743-21ssh00:39:562
172079963,2cyclictest283-21systemd-journal19:42:072
172079963,2cyclictest27301-21ssh23:21:132
172079963,2cyclictest20277-21swap22:05:202
172079963,2cyclictest14659-21snmpd19:25:422
172079963,2cyclictest14659-21snmpd00:10:442
172079963,2cyclictest13736-21tr22:25:172
172079963,2cyclictest1-21systemd23:56:082
172079963,1cyclictest0-21swapper/222:01:572
172079962,3cyclictest6010-21cat23:30:142
172079962,3cyclictest32639-21ntpq23:25:172
172079962,3cyclictest29088-21date19:35:012
172079962,3cyclictest2858-21apt-get21:00:122
172079962,3cyclictest14659-21snmpd22:51:182
172079962,3cyclictest14659-21snmpd22:41:002
172079962,3cyclictest14659-21snmpd20:35:082
172079962,3cyclictest14659-21snmpd20:20:532
172079962,3cyclictest14659-21snmpd20:10:092
172079962,3cyclictest14659-21snmpd00:15:062
172079962,3cyclictest11044-21cat23:10:162
172079962,1cyclictest0-21swapper/223:04:232
172079962,1cyclictest0-21swapper/221:25:282
172079962,1cyclictest0-21swapper/200:33:532
172079961,4cyclictest9049-21unixbench-2d21:10:202
172079961,3cyclictest283-21systemd-journal20:01:432
172079960,6cyclictest24663-21ssh23:43:522
172079960,6cyclictest0-21swapper/222:37:282
172079960,6cyclictest0-21swapper/221:42:522
172079960,6cyclictest0-21swapper/221:23:072
172079960,6cyclictest0-21swapper/219:15:232
172079960,6cyclictest0-21swapper/200:05:242
172079960,2cyclictest14397-21/usr/sbin/munin21:15:202
172079960,0cyclictest0-21swapper/223:09:572
172079960,0cyclictest0-21swapper/219:35:142
172049963,2cyclictest508-21dbus-daemon21:02:111
172049963,2cyclictest4264-21ssh00:18:141
172049963,2cyclictest283-21systemd-journal23:01:551
172049963,2cyclictest28129-21ssh00:35:531
172049963,2cyclictest24643-21rm21:21:581
172049963,2cyclictest21233-21ntp_states19:15:191
172049963,2cyclictest20828-21ntp_offset00:05:181
172049963,2cyclictest17807-21rm22:28:131
172049963,2cyclictest14659-21snmpd22:40:271
172049963,2cyclictest14659-21snmpd22:06:381
172049962,3cyclictest30962-21cat21:50:161
172049962,3cyclictest21199-21which22:30:211
172049962,3cyclictest19830-21tune2fs23:40:141
172049962,3cyclictest18122-21ntpq20:20:181
172049962,3cyclictest17038-21date20:20:001
172049962,3cyclictest14659-21snmpd23:55:141
172049962,3cyclictest14659-21snmpd23:31:221
172049962,3cyclictest14659-21snmpd22:35:411
172049962,3cyclictest14659-21snmpd22:11:091
172049962,3cyclictest14659-21snmpd21:34:551
172049962,3cyclictest14659-21snmpd21:10:301
172049962,3cyclictest14659-21snmpd20:41:051
172049962,3cyclictest14659-21snmpd20:36:381
172049962,3cyclictest14659-21snmpd20:25:531
172049962,3cyclictest14659-21snmpd00:31:171
172049962,2cyclictest283-21systemd-journal23:13:351
172049962,1cyclictest0-21swapper/123:06:041
172049962,1cyclictest0-21swapper/100:26:121
172049961,3cyclictest283-21systemd-journal19:24:361
172049961,2cyclictest28223-21ssh23:45:391
172049961,2cyclictest16259-21ssh21:15:301
172049961,1cyclictest141rcu_preempt21:39:111
172049960,5cyclictest14660-21latency_hist20:15:001
172049960,5cyclictest14247-21cat23:35:201
172049960,5cyclictest14247-21cat23:35:191
172049960,4cyclictest283-21systemd-journal22:21:271
172049960,3cyclictest6992-21idleruntime-cro23:55:011
172049960,2cyclictest7590-21lldpd20:05:031
172049960,2cyclictest10219-21munin-run20:04:591
172009963,2cyclictest668-21runrttasks19:42:400
172009963,2cyclictest508-21dbus-daemon20:04:380
172009963,2cyclictest3494-21ssh22:16:430
172009963,2cyclictest28724-21sh00:36:320
172009963,2cyclictest283-21systemd-journal20:37:010
172009963,2cyclictest27127-21latency22:35:160
172009963,2cyclictest25740-21dpkg00:10:000
172009963,2cyclictest24429-21sh21:21:440
172009963,2cyclictest19478-21sshd00:30:080
172009963,2cyclictest18631-21rm22:29:040
172009963,2cyclictest16733-21ssh00:01:320
172009963,2cyclictest14659-21snmpd19:10:240
172009963,2cyclictest14327-21sshd20:11:010
172009963,2cyclictest13829-21ntpq23:35:170
172009963,2cyclictest13829-21ntpq23:35:170
172009963,2cyclictest12478-21sh21:36:320
172009963,2cyclictest1-21systemd22:30:220
172009963,2cyclictest10710-21sh22:47:090
172009962,3cyclictest883-21expr23:50:130
172009962,3cyclictest8201-21ntpd23:10:200
172009962,3cyclictest6593-21grep23:30:180
172009962,3cyclictest31402-21date23:25:000
172009962,3cyclictest283-21systemd-journal20:55:000
172009962,3cyclictest20528-21cat00:05:160
172009962,3cyclictest2028-21tune2fs19:45:150
172009962,3cyclictest14659-21snmpd23:56:530
172009962,3cyclictest14659-21snmpd23:47:380
172009962,3cyclictest14659-21snmpd23:17:390
172009962,3cyclictest14659-21snmpd22:40:360
172009962,3cyclictest14659-21snmpd22:11:450
172009962,3cyclictest14659-21snmpd21:31:590
172009962,3cyclictest14659-21snmpd21:12:270
172009962,3cyclictest14659-21snmpd20:40:280
172009962,3cyclictest14659-21snmpd20:30:260
172009962,3cyclictest14659-21snmpd20:26:590
172009962,3cyclictest14659-21snmpd00:22:500
172009962,3cyclictest13703-21cat00:25:150
172009962,1cyclictest0-21swapper/022:06:100
172009961,4cyclictest28622-21grep21:25:140
172009961,3cyclictest502-21systemd-logind22:57:190
172009960,4cyclictest283-21systemd-journal21:55:110
172009960,3cyclictest14408-21rm22:50:180
172009960,1cyclictest0-21swapper/023:05:120
172129952,2cyclictest6180-21rm00:20:033
172079955,0cyclictest0-21swapper/221:35:092
172079953,1cyclictest7045-21diskmemload21:30:142
172079953,1cyclictest14659-21snmpd19:10:162
172079952,2cyclictest978-21expr20:55:122
172079952,2cyclictest7015-21ssh22:45:152
172079952,2cyclictest5804-21wc21:05:162
172079952,2cyclictest508-21dbus-daemon20:45:062
172079952,2cyclictest31472-21cat20:50:162
172079952,2cyclictest26249-21dpkg20:40:012
172079952,2cyclictest22694-21grep19:20:132
172079952,2cyclictest21110-21grep22:30:222
172079952,2cyclictest14659-21snmpd20:15:042
172079952,2cyclictest11738-21rs:main2
172079952,2cyclictest10647-21expr20:05:132
172079951,3cyclictest4079-21cat19:50:132
172079951,3cyclictest29741-11brltty20:30:052
172079951,0cyclictest141rcu_preempt19:55:132
172049952,2cyclictest6785-21sh22:45:031
172049952,2cyclictest508-21dbus-daemon19:55:011
172049951,3cyclictest5053-21/usr/sbin/munin21:05:141
172049951,3cyclictest3974-21cat19:50:131
172049951,3cyclictest18090-21cat19:10:151
172049951,3cyclictest1561-21/usr/sbin/munin19:45:141
172049951,1cyclictest0-21swapper/123:25:131
172049950,4cyclictest25925-21apt-get00:10:011
172009952,2cyclictest4211-21expr21:00:220
172009952,2cyclictest3993-21cat19:50:130
172009952,2cyclictest29558-21expr19:35:140
172009952,2cyclictest24932-21cstates19:25:140
172009952,2cyclictest15326-21grep20:15:140
172009952,2cyclictest14659-21snmpd20:05:010
172009951,3cyclictest6765-21sshd21:06:400
172009951,3cyclictest23128-21/usr/sbin/munin19:20:160
172009951,3cyclictest19920-21munin-node19:15:020
172009951,3cyclictest17266-21/usr/sbin/munin20:20:130
172009950,3cyclictest283-21systemd-journal23:40:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional