You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-26 - 16:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Mon Feb 26, 2024 12:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
45942324292,20sleep20-21swapper/207:06:222
46102268233,22sleep30-21swapper/307:06:353
47022262229,21sleep10-21swapper/107:07:461
46072260211,20sleep00-21swapper/007:06:320
298052660,0sleep00-21swapper/009:10:450
206032630,0sleep00-21swapper/012:30:430
10782620,0sleep00-21swapper/012:19:140
29992580,1sleep30-21swapper/310:05:273
170352580,1sleep20-21swapper/212:29:172
24392570,0sleep10-21swapper/111:19:051
87692200,0sleep10-21swapper/109:20:191
267162190,0sleep30-21swapper/311:13:143
181162190,1sleep30-21swapper/311:06:383
70752180,0sleep311738-21rs:main3
279732180,0sleep20-21swapper/211:14:212
278032180,0sleep30-21swapper/310:49:403
233412180,0sleep30-21swapper/307:47:323
165272180,1sleep10-21swapper/112:08:261
170262150,0sleep10-21swapper/111:48:321
74462140,0sleep10-21swapper/111:42:111
25612140,0sleep00-21swapper/010:05:240
154192120,0sleep00-21swapper/007:30:270
169222100,0sleep20-21swapper/211:28:112
160532100,0sleep30-21swapper/312:28:303
50119994,3cyclictest19982-21systemd-journal07:40:013
50119994,3cyclictest19982-21systemd-journal07:40:013
50079998,1cyclictest28-21ksoftirqd/212:35:002
50079998,1cyclictest28-21ksoftirqd/210:05:012
50079998,1cyclictest28-21ksoftirqd/210:00:002
50079993,4cyclictest28-21ksoftirqd/211:46:112
50079993,4cyclictest28-21ksoftirqd/211:37:502
50079993,4cyclictest19982-21systemd-journal07:53:222
50079992,5cyclictest28-21ksoftirqd/210:50:012
50079992,5cyclictest28-21ksoftirqd/209:42:392
50079992,4cyclictest28-21ksoftirqd/212:39:412
50079992,4cyclictest28-21ksoftirqd/209:25:422
50079992,4cyclictest10938-21idleruntime-cro11:45:012
50079992,3cyclictest0-21swapper/210:45:282
50079991,4cyclictest28-21ksoftirqd/211:30:102
49999996,2cyclictest4853-21awk08:20:000
49999996,2cyclictest16324-21grep10:40:230
49999990,3cyclictest20639-21ps11:50:250
12548290,0sleep20-21swapper/209:22:332
50119986,1cyclictest24898-21ssh09:57:573
50119984,3cyclictest508-21dbus-daemon11:18:133
50119984,3cyclictest508-21dbus-daemon08:30:293
50119984,3cyclictest508-21dbus-daemon07:26:413
50119984,3cyclictest19982-21systemd-journal11:52:513
50119984,2cyclictest19982-21systemd-journal10:10:313
50119983,3cyclictest19982-21systemd-journal12:00:003
50119983,3cyclictest19982-21systemd-journal09:04:593
50079987,1cyclictest28-21ksoftirqd/209:10:002
50079987,1cyclictest28-21ksoftirqd/208:10:002
50079985,2cyclictest3758-21snmpd11:20:342
50079984,2cyclictest19982-21systemd-journal08:14:482
50079983,1cyclictest141rcu_preempt12:01:102
50079983,1cyclictest141rcu_preempt10:58:182
50079982,4cyclictest28-21ksoftirqd/212:23:402
50079982,4cyclictest28-21ksoftirqd/211:05:412
50079982,4cyclictest28-21ksoftirqd/210:42:372
50079982,4cyclictest28-21ksoftirqd/210:30:092
50079982,4cyclictest28-21ksoftirqd/210:11:322
50079982,4cyclictest28-21ksoftirqd/209:37:062
50079982,4cyclictest28-21ksoftirqd/207:40:262
50079982,4cyclictest271rcuc/211:01:392
50079982,4cyclictest271rcuc/210:03:232
50079982,4cyclictest0-21swapper/212:10:022
50079982,4cyclictest0-21swapper/207:45:332
50079981,4cyclictest28-21ksoftirqd/212:05:482
50079981,4cyclictest28-21ksoftirqd/210:21:242
50079981,4cyclictest28-21ksoftirqd/207:12:552
50039986,1cyclictest22-21ksoftirqd/110:20:001
50039984,3cyclictest5272-21ntpq11:20:281
50039984,3cyclictest19982-21systemd-journal11:30:011
50039984,2cyclictest19982-21systemd-journal07:12:551
50039983,3cyclictest19982-21systemd-journal12:12:341
50039983,3cyclictest19982-21systemd-journal08:03:481
50039983,3cyclictest19982-21systemd-journal07:45:021
50039980,7cyclictest19983-21ssh11:08:381
49999983,3cyclictest508-21dbus-daemon11:58:410
49999983,3cyclictest19982-21systemd-journal12:04:320
49999983,3cyclictest19982-21systemd-journal09:49:210
49999983,3cyclictest19982-21systemd-journal08:00:010
50119976,1cyclictest27209-21diskmemload10:39:273
50119974,2cyclictest28078-21cat08:00:013
50119973,3cyclictest23980-21ntpq09:00:233
50119973,2cyclictest19982-21systemd-journal09:19:183
50119973,1cyclictest0-21swapper/311:23:543
50119973,1cyclictest0-21swapper/310:20:343
50119973,1cyclictest0-21swapper/309:46:403
50119973,1cyclictest0-21swapper/309:34:443
50119971,4cyclictest19982-21systemd-journal12:11:373
50079976,1cyclictest28-21ksoftirqd/207:15:012
50079976,1cyclictest271rcuc/208:30:282
50079974,2cyclictest28-21ksoftirqd/207:55:222
50079973,3cyclictest20778-21apt-get08:55:232
50079973,1cyclictest141rcu_preempt10:35:062
50079973,1cyclictest141rcu_preempt09:30:182
50079972,4cyclictest6466-21kworker/2:209:46:532
50079972,3cyclictest28-21ksoftirqd/210:16:192
50079972,3cyclictest28-21ksoftirqd/208:20:232
50079972,3cyclictest28-21ksoftirqd/207:35:302
50079972,3cyclictest28-21ksoftirqd/207:35:302
50079972,3cyclictest27209-21diskmemload11:15:332
50079972,3cyclictest0-21swapper/211:50:212
50079971,4cyclictest28-21ksoftirqd/210:26:402
50079971,4cyclictest28-21ksoftirqd/209:50:232
50079971,4cyclictest28-21ksoftirqd/209:15:322
50079971,4cyclictest28-21ksoftirqd/208:51:522
50079971,4cyclictest28-21ksoftirqd/208:15:222
50079971,3cyclictest6466-21kworker/2:212:15:382
50079970,5cyclictest28-21ksoftirqd/211:55:502
50079970,5cyclictest15852-21taskset08:42:592
50079970,5cyclictest0-21swapper/208:00:222
50079970,1cyclictest28-21ksoftirqd/209:10:172
50039976,1cyclictest22-21ksoftirqd/110:45:011
50039973,3cyclictest19982-21systemd-journal09:43:391
50039973,3cyclictest0-21swapper/112:24:121
50039972,4cyclictest22-21ksoftirqd/107:33:261
50039972,4cyclictest0-21swapper/112:00:001
50039972,3cyclictest19982-21systemd-journal10:25:301
50039972,3cyclictest19982-21systemd-journal10:05:011
50039972,3cyclictest19982-21systemd-journal08:05:531
50039970,7cyclictest0-21swapper/110:49:381
50039970,1cyclictest141rcu_preempt09:45:201
49999974,2cyclictest508-21dbus-daemon10:36:550
49999974,2cyclictest508-21dbus-daemon08:55:570
49999974,2cyclictest508-21dbus-daemon08:05:030
49999974,2cyclictest14299-21sh10:15:000
49999974,2cyclictest12242-21sh09:22:140
49999973,3cyclictest8188-21basename09:20:000
49999973,3cyclictest508-21dbus-daemon07:37:060
49999973,3cyclictest508-21dbus-daemon07:37:060
49999973,3cyclictest3758-21snmpd10:48:240
49999973,3cyclictest3758-21snmpd08:27:380
49999973,3cyclictest3758-21snmpd07:10:330
49999973,3cyclictest27587-21pluginstate10:25:010
49999973,3cyclictest11187-21sshd08:30:340
49999973,3cyclictest0-21swapper/012:26:270
49999973,3cyclictest0-21swapper/012:24:340
49999973,3cyclictest0-21swapper/011:24:040
49999972,4cyclictest16045-21munin-run08:45:000
49999972,3cyclictest19982-21systemd-journal11:44:050
49999971,5cyclictest13187-21unixbench_multi11:45:270
49999970,6cyclictest27054-21taskset11:13:310
1099270,0sleep10-21swapper/112:19:151
50119966,0cyclictest7517-21ssh11:42:143
50119966,0cyclictest0-21swapper/309:25:353
50119964,1cyclictest8098-21apt-get07:15:203
50119964,1cyclictest3457-21gltestperf08:15:233
50119963,2cyclictest8966-21/usr/sbin/munin11:00:213
50119963,2cyclictest8674-21switchtime08:25:333
50119963,2cyclictest6662-21sh10:33:173
50119963,2cyclictest4268-21tail10:55:313
50119963,2cyclictest31426-21ssh09:12:223
50119963,2cyclictest29741-11brltty07:33:463
50119963,2cyclictest28946-21ssh11:35:263
50119963,2cyclictest28360-21sed08:00:013
50119963,2cyclictest24758-21tr07:50:253
50119963,2cyclictest14480-21ssh09:50:103
50119963,2cyclictest11768-21tail12:05:223
50119963,2cyclictest11736-21in:imuxsock09:20:083
50119963,2cyclictest11736-21in:imuxsock07:22:553
50119963,1cyclictest0-21swapper/309:40:063
50119962,3cyclictest3758-21snmpd12:30:383
50119962,3cyclictest3758-21snmpd12:20:083
50119962,3cyclictest3758-21snmpd12:00:053
50119962,3cyclictest3758-21snmpd10:40:153
50119962,3cyclictest3758-21snmpd09:35:153
50119962,3cyclictest3758-21snmpd08:59:083
50119962,3cyclictest3758-21snmpd08:36:083
50119962,3cyclictest31510-21cat08:05:223
50119962,3cyclictest28267-21load10:00:263
50119962,3cyclictest20580-21grep07:40:273
50119962,3cyclictest20323-21grep11:30:233
50119962,3cyclictest18578-21cpu08:50:223
50119962,3cyclictest15545-21cat10:15:273
50119962,3cyclictest15031-21ntpq08:40:243
50119962,3cyclictest0-21swapper/312:35:043
50119962,2cyclictest19982-21systemd-journal08:45:313
50119962,1cyclictest0-21swapper/311:25:143
50119962,1cyclictest0-21swapper/310:25:273
50119961,4cyclictest51850irq/136-enp4s0-08:10:233
50119961,3cyclictest19982-21systemd-journal07:10:243
50119960,6cyclictest0-21swapper/311:45:223
50119960,4cyclictest19982-21systemd-journal12:15:223
50079964,1cyclictest28-21ksoftirqd/207:30:012
50079962,3cyclictest11901-21cpuspeed08:35:202
50079961,3cyclictest0-21swapper/207:25:232
50079960,4cyclictest28-21ksoftirqd/208:25:222
50079960,4cyclictest28-21ksoftirqd/207:20:192
50079960,4cyclictest16261-21runrttasks08:45:032
50079960,4cyclictest0-21swapper/209:00:162
50039963,2cyclictest7507-21cut08:25:221
50039963,2cyclictest668-21runrttasks10:01:471
50039963,2cyclictest21946-21fw_packets10:20:251
50039963,2cyclictest19982-21systemd-journal09:55:351
50039963,2cyclictest18209-21sendmail_mailtr07:35:311
50039963,2cyclictest18209-21sendmail_mailtr07:35:311
50039963,2cyclictest16162-21ls09:25:251
50039963,2cyclictest14197-21ssh11:25:571
50039963,2cyclictest13905-21cat08:40:001
50039963,2cyclictest11736-21in:imuxsock12:00:461
50039963,1cyclictest22-21ksoftirqd/109:00:171
50039962,3cyclictest8757-21cat07:15:231
50039962,3cyclictest5895-21sed08:20:241
50039962,3cyclictest508-21dbus-daemon12:32:541
50039962,3cyclictest3758-21snmpd10:10:411
50039962,3cyclictest3758-21snmpd09:15:121
50039962,3cyclictest3758-21snmpd09:10:091
50039962,3cyclictest3758-21snmpd07:28:091
50039962,3cyclictest3232-21expr08:15:211
50039962,3cyclictest30573-21seq10:50:371
50039962,3cyclictest22307-21expr11:10:241
50039962,3cyclictest22183-21expr09:30:201
50039962,3cyclictest19982-21systemd-journal07:44:431
50039962,3cyclictest16412-21cat08:45:211
50039962,3cyclictest10777-21tune2fs07:20:251
50039962,3cyclictest0-21swapper/111:51:261
50039962,2cyclictest502-21systemd-logind08:58:521
50039962,1cyclictest0-21swapper/112:36:031
50039962,1cyclictest0-21swapper/111:36:551
50039962,1cyclictest0-21swapper/111:00:351
50039962,1cyclictest0-21swapper/110:56:581
50039962,1cyclictest0-21swapper/110:31:281
50039962,1cyclictest0-21swapper/109:50:111
50039961,3cyclictest19982-21systemd-journal08:51:211
50039961,3cyclictest19982-21systemd-journal08:33:311
50039961,2cyclictest9716-21cut10:35:251
50039960,0cyclictest0-21swapper/109:36:361
49999963,2cyclictest6430-21date08:20:290
49999963,2cyclictest4665-21chrt10:55:570
49999963,2cyclictest30257-21ssh09:35:570
49999963,2cyclictest28475-21date12:35:320
49999963,2cyclictest22883-21grep09:30:250
49999963,2cyclictest21947-21gltestperf09:55:250
49999963,2cyclictest1623-21ssh09:40:060
49999963,2cyclictest11736-21in:imuxsock08:45:060
49999962,3cyclictest3758-21snmpd12:10:020
49999962,3cyclictest3758-21snmpd11:00:150
49999962,3cyclictest3758-21snmpd09:25:030
49999962,3cyclictest3758-21snmpd09:05:080
49999962,3cyclictest3758-21snmpd07:52:070
49999962,3cyclictest3758-21snmpd07:49:370
49999962,3cyclictest3758-21snmpd07:21:060
49999962,3cyclictest3758-21snmpd07:15:480
49999962,3cyclictest29988-21interrupts11:15:250
49999962,3cyclictest27104-21grep07:55:320
49999962,3cyclictest23419-21awk09:00:190
49999962,3cyclictest19982-21systemd-journal07:40:030
49999962,3cyclictest14818-21apt10:15:230
49999962,3cyclictest12889-21pmu-power08:35:300
49999962,3cyclictest10751-21packagekitd12:05:000
49999962,3cyclictest0-21swapper/011:30:340
49999962,3cyclictest0-21swapper/011:05:130
49999962,3cyclictest0-21swapper/010:51:030
49999962,1cyclictest0-21swapper/011:35:300
49999961,3cyclictest19982-21systemd-journal08:12:090
49999961,2cyclictest11760-21ssh11:25:150
49999960,6cyclictest0-21swapper/010:30:100
49999960,4cyclictest19982-21systemd-journal08:50:310
49999960,3cyclictest27894-21rm10:25:050
49999960,3cyclictest27313-21rm10:00:180
49999960,3cyclictest17393-21ssh09:51:300
14130260,0sleep00-21swapper/007:25:310
50119950,4cyclictest51850irq/136-enp4s0-10:50:193
50039952,2cyclictest892-21expr08:10:201
50039952,2cyclictest26884-21sort07:55:291
50039952,2cyclictest25333-21cpuspeed_turbos09:05:231
50039952,2cyclictest14317-21expr08:40:191
50039952,2cyclictest10400-21rm12:25:121
50039951,3cyclictest24223-21/usr/sbin/munin07:50:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional