You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 13:29
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Thu Dec 18, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
133662300273,17sleep20-21swapper/219:05:452
136582278247,21sleep10-21swapper/119:09:291
134982266238,19sleep30-21swapper/319:07:263
135532259229,19sleep00-21swapper/019:08:070
57422570,0sleep30-21swapper/320:00:153
39312470,0sleep30-21swapper/322:20:133
1380099103,4cyclictest0-21swapper/223:25:002
1380099100,9cyclictest0-21swapper/220:55:002
138009991,7cyclictest1980-21ls21:05:012
138039984,2cyclictest275-21systemd-journal22:40:013
138009987,1cyclictest28-21ksoftirqd/200:00:002
138009982,3cyclictest24551-21munin-run21:55:012
137929986,1cyclictest12-21ksoftirqd/019:35:020
137929983,3cyclictest275-21systemd-journal23:30:060
138039973,3cyclictest30255-21apt23:20:133
138039973,2cyclictest275-21systemd-journal19:58:233
138039972,3cyclictest275-21systemd-journal19:54:133
138039972,3cyclictest275-21systemd-journal19:22:063
138039972,3cyclictest275-21systemd-journal00:28:533
138009976,1cyclictest28-21ksoftirqd/200:40:002
138009976,1cyclictest281ksoftirqd/223:55:002
138009975,1cyclictest281ksoftirqd/223:35:012
138009973,3cyclictest658-21snmpd21:31:152
138009970,6cyclictest24560-21entropy19:30:142
137979974,2cyclictest504-21dbus-daemon22:37:291
137979973,3cyclictest275-21systemd-journal00:29:441
137929973,3cyclictest7737-21diskstats20:05:140
138039964,1cyclictest23855-21smart_sda00:15:193
138039963,2cyclictest658-21snmpd21:09:303
138039963,2cyclictest658-21snmpd19:25:153
138039963,2cyclictest504-21dbus-daemon21:48:133
138039963,2cyclictest17197-21cat21:35:193
138039962,3cyclictest936-21ntpq21:00:173
138039962,3cyclictest734-21cat23:25:143
138039962,3cyclictest658-21snmpd23:50:093
138039962,3cyclictest658-21snmpd23:47:453
138039962,3cyclictest658-21snmpd23:31:533
138039962,3cyclictest658-21snmpd23:18:103
138039962,3cyclictest658-21snmpd22:50:373
138039962,3cyclictest658-21snmpd22:15:533
138039962,3cyclictest658-21snmpd21:57:533
138039962,3cyclictest658-21snmpd20:42:533
138039962,3cyclictest658-21snmpd20:31:323
138039962,3cyclictest658-21snmpd20:10:293
138039962,3cyclictest658-21snmpd19:45:403
138039962,3cyclictest658-21snmpd19:31:013
138039962,3cyclictest658-21snmpd00:37:313
138039962,3cyclictest658-21snmpd00:09:423
138039962,3cyclictest31189-21awk00:30:203
138039962,3cyclictest29312-21cat19:40:153
138039962,3cyclictest275-21systemd-journal23:57:373
138039962,3cyclictest275-21systemd-journal23:40:003
138039962,3cyclictest10997-21readlink21:25:013
138039961,1cyclictest16889-21apt-get19:15:133
138039960,6cyclictest0-21swapper/320:15:133
138039960,5cyclictest8932-21ntp_states22:30:173
138009965,1cyclictest28-21ksoftirqd/219:15:012
138009965,1cyclictest271rcuc/222:45:122
138009963,2cyclictest658-21snmpd20:40:112
138009963,2cyclictest658-21snmpd20:08:312
138009963,2cyclictest6435-21cat22:25:162
138009963,2cyclictest29255-21taskset00:28:482
138009963,2cyclictest26294-21grep23:10:122
138009962,3cyclictest6973-11brltty20:15:332
138009962,3cyclictest658-21snmpd23:41:572
138009962,3cyclictest658-21snmpd23:35:212
138009962,3cyclictest658-21snmpd22:58:222
138009962,3cyclictest658-21snmpd22:30:042
138009962,3cyclictest658-21snmpd22:03:322
138009962,3cyclictest658-21snmpd21:26:242
138009962,3cyclictest658-21snmpd21:17:192
138009962,3cyclictest658-21snmpd21:05:072
138009962,3cyclictest658-21snmpd20:58:242
138009962,3cyclictest658-21snmpd20:47:022
138009962,3cyclictest658-21snmpd19:49:322
138009962,3cyclictest658-21snmpd19:23:482
138009962,3cyclictest658-21snmpd00:15:122
138009962,3cyclictest658-21snmpd00:07:092
138009962,3cyclictest658-21snmpd00:04:182
138009962,3cyclictest5125-21cat21:10:152
138009962,3cyclictest275-21systemd-journal22:19:592
138009962,3cyclictest20645-21cat00:10:122
138009962,2cyclictest275-21systemd-journal21:45:012
138009960,5cyclictest275-21systemd-journal20:35:202
138009960,1cyclictest141rcu_preempt19:10:082
137979963,2cyclictest658-21snmpd22:27:001
137979963,2cyclictest658-21snmpd20:23:081
137979963,2cyclictest658-21snmpd00:06:451
137979963,2cyclictest24871-21/usr/sbin/munin00:20:151
137979963,2cyclictest21590-21sshd19:25:011
137979963,2cyclictest1-21systemd21:30:171
137979962,3cyclictest658-21snmpd23:57:001
137979962,3cyclictest658-21snmpd23:48:081
137979962,3cyclictest658-21snmpd22:21:511
137979962,3cyclictest658-21snmpd22:19:301
137979962,3cyclictest658-21snmpd22:12:391
137979962,3cyclictest658-21snmpd22:09:241
137979962,3cyclictest658-21snmpd22:02:301
137979962,3cyclictest658-21snmpd21:50:531
137979962,3cyclictest658-21snmpd21:42:171
137979962,3cyclictest658-21snmpd20:53:121
137979962,3cyclictest658-21snmpd20:45:211
137979962,3cyclictest658-21snmpd20:44:481
137979962,3cyclictest658-21snmpd19:35:351
137979962,3cyclictest658-21snmpd19:21:331
137979962,3cyclictest658-21snmpd00:01:511
137979962,3cyclictest504-21dbus-daemon21:00:011
137979962,3cyclictest504-21dbus-daemon20:35:001
137979962,3cyclictest29987-21systemctl23:20:011
137979962,3cyclictest23111-21latency_hist20:40:001
137979962,3cyclictest16298-21seq22:45:531
137979962,2cyclictest275-21systemd-journal00:40:011
137979960,4cyclictest31615-21basename00:35:011
137979960,4cyclictest275-21systemd-journal19:45:131
137929965,1cyclictest12-21ksoftirqd/000:35:000
137929964,1cyclictest12-21ksoftirqd/019:15:010
137929963,2cyclictest658-21snmpd22:14:350
137929963,2cyclictest6422-21chrt23:35:540
137929963,2cyclictest504-21dbus-daemon21:30:170
137929963,2cyclictest504-21dbus-daemon19:25:020
137929963,2cyclictest275-21systemd-journal21:56:590
137929963,2cyclictest275-21systemd-journal21:26:000
137929963,2cyclictest14422-21dump-pmu-power22:45:000
137929962,3cyclictest7727-21cat23:40:130
137929962,3cyclictest658-21snmpd23:25:110
137929962,3cyclictest658-21snmpd23:05:590
137929962,3cyclictest658-21snmpd23:03:380
137929962,3cyclictest658-21snmpd22:25:450
137929962,3cyclictest658-21snmpd22:05:080
137929962,3cyclictest658-21snmpd22:01:000
137929962,3cyclictest658-21snmpd21:45:570
137929962,3cyclictest658-21snmpd20:25:420
137929962,3cyclictest658-21snmpd20:20:030
137929962,3cyclictest658-21snmpd20:11:460
137929962,3cyclictest658-21snmpd19:55:430
137929962,3cyclictest658-21snmpd19:38:550
137929962,3cyclictest658-21snmpd00:20:240
137929962,3cyclictest658-21snmpd00:16:460
137929962,3cyclictest504-21dbus-daemon00:10:000
137929962,3cyclictest31191-21expr19:45:120
137929962,3cyclictest275-21systemd-journal00:35:340
137929962,3cyclictest275-21systemd-journal00:10:030
137929962,3cyclictest275-21systemd-journal00:03:330
137929962,3cyclictest24206-21cat20:40:150
137929962,3cyclictest2173-21grep19:50:200
137929962,3cyclictest19782-21cat22:55:150
137929962,3cyclictest17919-11brltty21:07:450
137929962,3cyclictest1-21systemd23:18:210
138039954,1cyclictest28256-21smart_sda22:00:193
138039953,1cyclictest663-21runrttasks22:45:103
138039953,1cyclictest25763-21acpi23:10:093
138039953,1cyclictest24356-21grep23:05:153
138039953,1cyclictest22899-21users23:00:213
138039952,2cyclictest7709-21cat23:40:143
138039952,2cyclictest7467-21cut21:15:143
138039952,2cyclictest658-21snmpd00:10:033
138039952,2cyclictest29542-21expr22:05:133
138039952,2cyclictest26919-21sendmail_mailtr20:45:173
138039952,2cyclictest25257-21expr00:20:123
138039952,2cyclictest23240-21cat21:50:133
138039952,2cyclictest21005-21cpu20:35:133
138039952,2cyclictest20029-21ntp_kernel_err22:55:163
138039952,2cyclictest18465-21expr21:40:113
138039952,2cyclictest16627-21df20:25:133
138039952,2cyclictest14922-21cut19:10:133
138039952,2cyclictest14328-21expr20:20:133
138039952,2cyclictest12681-21expr22:40:143
138039952,2cyclictest11228-21sort21:25:013
138039951,3cyclictest6239-21/usr/sbin/munin22:25:143
138039951,3cyclictest32125-21basename22:10:143
138039951,3cyclictest28330-21cat20:50:123
138039951,3cyclictest275-21systemd-journal21:10:013
138039950,3cyclictest275-21systemd-journal19:35:093
138039950,3cyclictest15949-40gzip00:00:013
138039950,2cyclictest7316-21/usr/sbin/munin20:05:153
138039950,1cyclictest13639-21/usr/sbin/munin21:30:123
138009953,1cyclictest3970-21fschecks_count22:20:152
138009953,1cyclictest28-21ksoftirqd/219:35:122
138009952,2cyclictest8880-21sshd21:20:022
138009952,2cyclictest658-21snmpd23:45:592
138009952,2cyclictest658-21snmpd23:00:162
138009952,2cyclictest658-21snmpd21:35:062
138009952,2cyclictest32480-21dpkg23:25:112
138009952,2cyclictest31457-21sshd22:10:022
138009952,2cyclictest30313-21cat00:30:152
138009952,2cyclictest29643-21expr22:05:132
138009952,2cyclictest28935-21expr19:40:132
138009952,2cyclictest25840-21grep21:55:162
138009952,2cyclictest24818-21cat23:05:192
138009952,2cyclictest20968-21hostname21:45:152
138009952,2cyclictest18741-21expr20:30:122
138009952,2cyclictest1334-21cat19:50:162
138009952,2cyclictest10790-21head22:35:152
138009951,3cyclictest3249-21diskstats19:55:132
138009951,3cyclictest22214-21expr19:25:142
138009951,3cyclictest13119-21cat22:40:152
138009951,1cyclictest141rcu_preempt20:10:092
138009950,4cyclictest16227-21/usr/sbin/munin20:25:132
138009950,4cyclictest15866-21chrt20:23:362
138009950,3cyclictest275-21systemd-journal23:15:262
138009950,3cyclictest275-21systemd-journal22:50:012
138009950,3cyclictest26839-21chrt00:24:522
137979953,2cyclictest501-21in:imuxsock23:40:001
137979953,1cyclictest658-21snmpd21:20:091
137979953,1cyclictest4432-21acpi21:10:101
137979953,1cyclictest16564-21cpu19:15:011
137979952,2cyclictest9840-21expr20:10:101
137979952,2cyclictest8601-21sort22:30:141
137979952,2cyclictest7470-21grep20:05:141
137979952,2cyclictest658-21snmpd23:25:571
137979952,2cyclictest658-21snmpd23:10:081
137979952,2cyclictest658-21snmpd21:25:031
137979952,2cyclictest501-21in:imuxsock21:58:131
137979952,2cyclictest501-21in:imuxsock20:00:011
137979952,2cyclictest3253-21cat23:30:161
137979952,2cyclictest30469-21expr23:20:151
137979952,2cyclictest275-21systemd-journal23:00:481
137979952,2cyclictest24842-21cat19:30:161
137979952,2cyclictest22706-21awk00:15:121
137979952,2cyclictest20912-21grep00:10:131
137979952,2cyclictest20523-21cut21:45:131
137979952,2cyclictest17552-21cat22:50:141
137979952,2cyclictest17307-21date21:35:191
137979952,2cyclictest14706-21cat19:10:111
137979952,2cyclictest13305-21date22:40:161
137979951,3cyclictest6859-21tr21:15:111
137979951,3cyclictest658-21snmpd21:00:101
137979951,3cyclictest5816-21irqstats20:00:161
137979951,3cyclictest2380-21grep21:05:131
137979951,3cyclictest23547-21/usr/sbin/munin23:05:141
137979951,3cyclictest19562-21fschecks_time22:55:131
137979951,3cyclictest1577-21/usr/sbin/munin19:50:161
137979951,3cyclictest11739-21sshd20:15:011
137979950,3cyclictest275-21systemd-journal20:25:191
137979950,1cyclictest11472-21/usr/sbin/munin23:50:161
137929955,0cyclictest0-21swapper/020:35:090
137929953,2cyclictest501-21in:imuxsock23:10:010
137929952,3cyclictest19132-21apt-get19:20:130
137929952,2cyclictest9935-21cat23:45:130
137929952,2cyclictest9125-21ls21:20:120
137929952,2cyclictest8097-21sort22:30:120
137929952,2cyclictest6885-21ls21:15:110
137929952,2cyclictest658-21snmpd22:35:060
137929952,2cyclictest658-21snmpd21:40:020
137929952,2cyclictest658-21snmpd21:10:060
137929952,2cyclictest4310-21cat22:20:160
137929952,2cyclictest32389-21sshd21:00:010
137929952,2cyclictest28610-21sshd19:40:110
137929952,2cyclictest2725-21grep22:15:190
137929952,2cyclictest27194-21dpkg00:25:000
137929952,2cyclictest25907-21cut20:45:110
137929952,2cyclictest19405-21awk20:30:170
137929952,2cyclictest17427-21gltestperf22:50:150
137929952,2cyclictest17317-21sort19:15:140
137929952,2cyclictest15346-21cat22:45:160
137929952,2cyclictest13703-21/usr/sbin/munin23:55:110
137929952,2cyclictest1-21systemd20:50:140
137929952,2cyclictest11913-21expr20:15:140
137929952,2cyclictest11549-21cpuspeed23:50:100
137929951,3cyclictest658-21snmpd23:24:350
137929951,3cyclictest658-21snmpd20:00:070
137929951,3cyclictest30295-21/usr/sbin/munin20:55:110
137929951,3cyclictest22648-21cat21:50:120
137929951,3cyclictest16563-21cat21:35:150
138039940,3cyclictest30149-21chrt20:55:003
138009940,3cyclictest5277-21cut20:00:142
137979942,1cyclictest7058-21apt-get23:40:101
137979940,3cyclictest275-21systemd-journal19:40:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional