You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-17 - 01:05
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sun Nov 16, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158682330296,21sleep20-21swapper/207:08:462
158542268238,18sleep30-21swapper/307:08:353
159082267235,20sleep00-21swapper/007:09:170
158672263228,23sleep10-21swapper/107:08:451
12162600,0sleep00-21swapper/010:46:270
159812590,0sleep10-21swapper/112:09:331
32512180,0sleep30-21swapper/309:57:133
49252170,0sleep30-21swapper/312:21:563
177092160,0sleep20-21swapper/210:34:282
43722150,0sleep20-21swapper/209:32:562
300882140,0sleep20-21swapper/210:18:422
241092130,0chrt0-21swapper/109:22:501
279322110,0sleep00-21swapper/012:35:420
1610799111,2cyclictest141rcu_preempt07:25:131
107052100,0sleep20-21swapper/209:12:022
107052100,0sleep20-21swapper/209:12:022
161119995,3cyclictest508-21dbus-daemon12:10:002
161119994,3cyclictest19982-21systemd-journal08:28:362
161079997,2cyclictest22-21ksoftirqd/111:40:001
161079994,3cyclictest19982-21systemd-journal08:40:171
161079990,8cyclictest19645-21df09:45:141
161049998,1cyclictest12-21ksoftirqd/007:30:010
23748280,1sleep30-21swapper/310:39:013
161159987,1cyclictest34-21ksoftirqd/312:35:003
161159984,3cyclictest19982-21systemd-journal10:53:493
161159984,3cyclictest19982-21systemd-journal10:27:563
161159984,2cyclictest19982-21systemd-journal11:25:163
161159983,3cyclictest19982-21systemd-journal12:01:223
161159983,3cyclictest19982-21systemd-journal09:34:523
161159983,3cyclictest19982-21systemd-journal08:30:413
161119984,3cyclictest19982-21systemd-journal12:03:272
161119983,3cyclictest19982-21systemd-journal11:00:032
161079984,3cyclictest508-21dbus-daemon09:05:001
161079983,3cyclictest19982-21systemd-journal11:28:251
161079983,3cyclictest19982-21systemd-journal10:09:591
161079983,3cyclictest19982-21systemd-journal08:24:001
161079982,3cyclictest16266-21awk08:20:001
161079981,4cyclictest25493-21cron08:40:001
161049985,2cyclictest508-21dbus-daemon09:41:120
161049982,3cyclictest11738-21rs:main0
161049982,3cyclictest11738-21rs:main0
30355270,2sleep330364-21ssh10:44:513
161159974,2cyclictest508-21dbus-daemon07:26:523
161159973,3cyclictest8955-21apt-get12:05:143
161159973,3cyclictest508-21dbus-daemon12:00:003
161159973,3cyclictest4061-21ntpq07:50:173
161159973,3cyclictest19982-21systemd-journal10:55:033
161159973,3cyclictest19982-21systemd-journal07:59:483
161159973,3cyclictest0-21swapper/311:40:253
161159973,2cyclictest19982-21systemd-journal11:20:163
161159973,2cyclictest19982-21systemd-journal09:39:493
161159972,3cyclictest7661-21lldpd09:07:393
161159972,3cyclictest19982-21systemd-journal12:12:133
161159972,3cyclictest19982-21systemd-journal11:34:153
161159972,3cyclictest19982-21systemd-journal09:15:193
161159972,3cyclictest19982-21systemd-journal08:49:433
161159972,3cyclictest19982-21systemd-journal08:24:553
161119974,2cyclictest9554-21turbostat08:05:012
161119974,2cyclictest508-21dbus-daemon09:21:102
161119974,2cyclictest11736-21in:imuxsock07:38:572
161119973,3cyclictest7661-21lldpd11:07:442
161119973,3cyclictest7661-21lldpd11:07:442
161119973,3cyclictest508-21dbus-daemon12:40:012
161119973,3cyclictest508-21dbus-daemon07:59:492
161119973,3cyclictest26154-21df08:40:162
161119973,3cyclictest19982-21systemd-journal11:15:292
161119973,3cyclictest19982-21systemd-journal09:19:492
161119973,3cyclictest0-21swapper/211:47:492
161119973,1cyclictest0-21swapper/212:23:052
161119973,1cyclictest0-21swapper/210:21:192
161119973,1cyclictest0-21swapper/209:42:342
161119973,1cyclictest0-21swapper/209:28:172
161119972,3cyclictest19982-21systemd-journal12:16:482
161119972,3cyclictest19982-21systemd-journal08:37:462
161119972,3cyclictest0-21swapper/207:49:332
161119970,4cyclictest29979-21latency_hist08:50:002
161119970,4cyclictest24809-21idleruntime-cro12:15:002
161119970,2cyclictest19982-21systemd-journal08:09:242
161079975,2cyclictest22-21ksoftirqd/108:35:001
161079975,1cyclictest22-21ksoftirqd/112:15:001
161079975,1cyclictest22-21ksoftirqd/107:45:001
161079974,2cyclictest508-21dbus-daemon12:17:381
161079974,2cyclictest11736-21in:imuxsock11:30:051
161079973,3cyclictest5705-21ntp_states11:40:191
161079973,3cyclictest508-21dbus-daemon11:50:001
161079973,3cyclictest19982-21systemd-journal12:38:301
161079973,3cyclictest19982-21systemd-journal11:07:091
161079973,3cyclictest19982-21systemd-journal11:07:091
161079973,3cyclictest0-21swapper/111:53:341
161079973,3cyclictest0-21swapper/111:03:051
161079973,1cyclictest0-21swapper/112:30:081
161079973,1cyclictest0-21swapper/112:25:321
161079972,3cyclictest19982-21systemd-journal09:52:031
161079970,6cyclictest0-21swapper/107:34:501
161049974,2cyclictest508-21dbus-daemon09:58:430
161049974,2cyclictest508-21dbus-daemon08:58:130
161049974,2cyclictest29741-11brltty11:31:450
161049974,2cyclictest19982-21systemd-journal11:19:480
161049974,2cyclictest11736-21in:imuxsock10:35:070
161049973,3cyclictest6793-21sshd11:40:490
161049973,3cyclictest508-21dbus-daemon09:54:080
161049973,3cyclictest508-21dbus-daemon08:00:000
161049973,3cyclictest30654-21snmpd12:25:270
161049973,3cyclictest19982-21systemd-journal12:10:010
161049973,3cyclictest19982-21systemd-journal10:16:400
161049973,3cyclictest0-21swapper/012:18:490
161049973,3cyclictest0-21swapper/012:10:280
161049973,3cyclictest0-21swapper/010:22:100
161049973,3cyclictest0-21swapper/010:07:570
161049973,2cyclictest19982-21systemd-journal07:23:310
161049973,1cyclictest0-21swapper/011:58:550
161049973,1cyclictest0-21swapper/011:38:290
161049973,1cyclictest0-21swapper/010:42:460
161049973,1cyclictest0-21swapper/010:28:430
161049972,3cyclictest19982-21systemd-journal09:25:200
161049971,3cyclictest20005-21rm11:25:500
22519260,1sleep20-21swapper/208:30:222
161159964,2cyclictest508-21dbus-daemon11:05:533
161159964,2cyclictest508-21dbus-daemon11:05:533
161159963,2cyclictest8976-21timerwakeupswit08:00:233
161159963,2cyclictest599-21gltestperf08:55:153
161159963,2cyclictest508-21dbus-daemon07:21:263
161159963,2cyclictest30985-21sh12:38:053
161159963,2cyclictest26849-21cat10:15:223
161159963,2cyclictest26781-21cat09:25:163
161159963,2cyclictest15751-21ssh09:41:543
161159963,2cyclictest1-21systemd07:16:253
161159963,1cyclictest0-21swapper/311:53:463
161159963,1cyclictest0-21swapper/310:08:223
161159963,1cyclictest0-21swapper/309:50:273
161159962,3cyclictest508-21dbus-daemon11:45:323
161159962,3cyclictest30811-21expr11:10:143
161159962,3cyclictest30654-21snmpd10:00:263
161159962,3cyclictest30654-21snmpd08:50:113
161159962,3cyclictest30654-21snmpd08:35:413
161159962,3cyclictest30654-21snmpd08:17:553
161159962,3cyclictest30654-21snmpd08:07:073
161159962,3cyclictest30654-21snmpd07:33:423
161159962,3cyclictest30654-21snmpd07:10:083
161159962,3cyclictest29345-21ntpq07:35:203
161159962,3cyclictest20385-21expr09:20:143
161159962,3cyclictest20039-21cat08:25:223
161159962,3cyclictest20016-21sed10:10:203
161159962,3cyclictest19982-21systemd-journal09:03:143
161159962,3cyclictest19223-21/usr/sbin/munin09:45:173
161159962,3cyclictest18124-21cat11:00:163
161159962,3cyclictest1-21systemd09:12:243
161159962,3cyclictest1-21systemd09:12:243
161159962,3cyclictest11736-21in:imuxsock11:35:303
161159962,1cyclictest0-21swapper/312:27:583
161159962,1cyclictest0-21swapper/310:30:133
161159961,3cyclictest19982-21systemd-journal10:20:043
161159961,3cyclictest19982-21systemd-journal08:44:523
161159961,2cyclictest948-21ssh10:46:103
161159960,3cyclictest30318-21ssh12:17:523
161119966,0cyclictest0-21swapper/210:56:242
161119963,2cyclictest755-21ssh11:36:232
161119963,2cyclictest30654-21snmpd11:31:322
161119963,2cyclictest30654-21snmpd08:17:162
161119963,2cyclictest28-21ksoftirqd/207:25:152
161119963,2cyclictest20629-21unixbench-2d07:15:272
161119963,2cyclictest19119-21grep11:25:222
161119963,2cyclictest12066-21sshd09:39:542
161119963,1cyclictest0-21swapper/211:50:552
161119962,3cyclictest7075-21smartctl10:00:172
161119962,3cyclictest31014-21expr07:40:162
161119962,3cyclictest30654-21snmpd11:10:012
161119962,3cyclictest30654-21snmpd07:50:122
161119962,3cyclictest26418-21which11:55:192
161119962,3cyclictest25308-21cat10:40:152
161119962,3cyclictest19982-21systemd-journal07:34:312
161119962,3cyclictest19928-21cat09:45:162
161119962,3cyclictest19116-21gdbus09:00:002
161119962,3cyclictest19116-21gdbus07:15:012
161119962,3cyclictest17197-21cat08:20:162
161119962,3cyclictest13782-21cat10:05:172
161119962,3cyclictest0-21swapper/211:23:462
161119962,1cyclictest0-21swapper/210:25:572
161119962,1cyclictest0-21swapper/209:54:252
161119961,3cyclictest19982-21systemd-journal10:10:492
161119961,3cyclictest19982-21systemd-journal09:55:232
161119961,3cyclictest19982-21systemd-journal09:00:432
161119961,2cyclictest4581-21ssh11:40:102
161119961,2cyclictest3009-21ssh10:48:172
161119960,5cyclictest19374-21grep10:35:172
161119960,4cyclictest19982-21systemd-journal12:25:092
161119960,4cyclictest19982-21systemd-journal10:51:422
161119960,4cyclictest19982-21systemd-journal07:21:262
161119960,3cyclictest19217-21tail12:30:222
161119960,2cyclictest30211-21/usr/sbin/munin08:50:192
161119960,2cyclictest12023-21/usr/sbin/munin08:10:152
161079966,0cyclictest0-21swapper/110:00:021
161079964,1cyclictest11792-21munin-run08:10:001
161079963,2cyclictest668-21runrttasks09:31:311
161079963,2cyclictest668-21runrttasks07:52:091
161079963,2cyclictest6495-21systemctl10:50:211
161079963,2cyclictest5477-21sshd11:15:181
161079963,2cyclictest3366-21ssh11:14:111
161079963,2cyclictest32147-21sshd08:54:441
161079963,2cyclictest27392-21rm10:15:451
161079963,2cyclictest27064-21sh10:41:191
161079963,2cyclictest1565-21memory12:00:171
161079963,2cyclictest14769-21ssh09:40:481
161079963,2cyclictest12873-21sed10:30:181
161079963,1cyclictest0-21swapper/110:55:201
161079962,3cyclictest8265-21cat08:00:181
161079962,3cyclictest7307-21cut09:35:151
161079962,3cyclictest30654-21snmpd09:06:061
161079962,3cyclictest30654-21snmpd07:45:121
161079962,3cyclictest19436-21cat08:25:171
161079962,3cyclictest0-21swapper/111:20:381
161079962,2cyclictest19982-21systemd-journal08:59:281
161079962,1cyclictest0-21swapper/110:26:211
161079962,1cyclictest0-21swapper/110:23:261
161079962,1cyclictest0-21swapper/110:10:471
161079962,1cyclictest0-21swapper/109:25:491
161079961,3cyclictest19982-21systemd-journal09:10:191
161079961,3cyclictest19982-21systemd-journal09:10:191
161079960,6cyclictest0-21swapper/110:46:561
161079960,5cyclictest8845-21cron12:25:001
161079960,5cyclictest13988-21seq09:15:131
161079960,4cyclictest1180-21ssh09:55:211
161079960,3cyclictest18605-21sshd10:35:071
161049965,1cyclictest12-21ksoftirqd/007:35:010
161049964,1cyclictest8169-21cut08:00:180
161049964,1cyclictest24119-21hddtemp_smartct08:35:160
161049963,2cyclictest2832-21cron07:50:000
161049963,2cyclictest20650-21tail07:15:260
161049963,2cyclictest17454-21sh12:30:100
161049963,2cyclictest15223-21sh08:15:170
161049963,2cyclictest14180-21ssh11:46:300
161049963,2cyclictest11736-21in:imuxsock07:53:330
161049962,3cyclictest7661-21lldpd10:51:440
161049962,3cyclictest3951-21grep09:00:210
161049962,3cyclictest30654-21snmpd09:35:400
161049962,3cyclictest30654-21snmpd08:50:350
161049962,3cyclictest30654-21snmpd08:41:290
161049962,3cyclictest30654-21snmpd08:30:530
161049962,3cyclictest30654-21snmpd08:13:580
161049962,3cyclictest30654-21snmpd08:06:220
161049962,3cyclictest30654-21snmpd07:40:100
161049962,3cyclictest30654-21snmpd07:36:090
161049962,3cyclictest30654-21snmpd07:12:320
161049962,3cyclictest2559-21expr12:20:190
161049962,3cyclictest24091-21ls11:05:140
161049962,3cyclictest24091-21ls11:05:140
161049962,3cyclictest2014-21tr12:00:190
161049962,3cyclictest19607-21expr09:45:140
161049962,3cyclictest18762-21dpkg08:25:150
161049962,3cyclictest11541-21cstates11:20:130
161049962,3cyclictest0-21swapper/010:11:370
161049962,1cyclictest0-21swapper/011:50:020
161049962,1cyclictest0-21swapper/011:00:070
161049962,1cyclictest0-21swapper/009:31:310
161049962,1cyclictest0-21swapper/009:20:190
161049961,3cyclictest7661-21lldpd09:08:240
161049960,6cyclictest0-21swapper/011:11:330
161049960,3cyclictest15936-21rm09:15:510
161049960,2cyclictest16501-21/usr/sbin/munin08:20:200
161049960,0cyclictest0-21swapper/010:30:160
161159952,2cyclictest4433-21sh11:15:043
161159951,3cyclictest31719-21/usr/sbin/munin07:40:213
161159951,3cyclictest12046-21/usr/sbin/munin08:10:143
161159951,2cyclictest19982-21systemd-journal07:45:013
161119952,2cyclictest5338-21cat09:05:162
161079954,1cyclictest22-21ksoftirqd/107:15:011
161079953,1cyclictest21634-21cstates07:20:141
161079953,1cyclictest0-21swapper/107:10:141
161079952,2cyclictest5565-21expr07:55:151
161079952,2cyclictest30654-21snmpd08:45:051
161079952,2cyclictest28697-21expr07:35:161
161079952,2cyclictest25130-21ssh11:55:071
161079952,2cyclictest12036-21cat08:10:131
161049952,2cyclictest30654-21snmpd10:55:040
161049952,2cyclictest28203-21cat08:45:130
161049951,3cyclictest6694-21ls10:00:150
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional