You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-07 - 02:13
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sun Jul 06, 2025 12:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
288062303270,21sleep20-21swapper/207:06:572
289392277214,18sleep00-21swapper/007:08:400
288432261227,21sleep30-21swapper/307:07:263
270822254220,22sleep10-21swapper/107:05:031
274072690,0sleep00-21swapper/011:02:320
130802690,0sleep30-21swapper/309:57:523
137742630,0sleep20-21swapper/207:45:012
218962590,0sleep30-21swapper/309:10:263
79102580,0sleep00-21swapper/009:26:170
271062570,0sleep00-21swapper/008:10:210
271062570,0sleep00-21swapper/008:10:200
165722570,0sleep10-21swapper/111:39:331
243282530,0sleep30-21swapper/309:40:223
92852210,3sleep334-21ksoftirqd/307:35:013
23022190,0sleep20-21swapper/212:30:182
305732160,0sleep30-21swapper/311:47:523
288472140,0sleep10-21swapper/110:38:101
134612130,0sleep10-21swapper/110:25:131
2917199121,3cyclictest19982-21systemd-journal07:27:111
2917199113,3cyclictest20423-21tail11:20:201
2917199113,2cyclictest15086-21perf10:00:011
2917199112,3cyclictest19982-21systemd-journal08:03:291
2917199110,4cyclictest32685-21munin-run10:15:011
2917199110,3cyclictest19982-21systemd-journal10:20:011
2917199110,3cyclictest16323-21apt12:40:001
2917199110,2cyclictest19982-21systemd-journal08:40:001
2917199103,2cyclictest14215-21cat07:45:131
2917199103,1cyclictest6859-21sh11:53:271
2917199103,1cyclictest32114-21grep07:15:011
2917199102,3cyclictest30654-21snmpd09:28:011
2917199102,2cyclictest27993-21expr08:15:161
2917199102,2cyclictest13290-21sshd08:55:061
2917199101,3cyclictest8310-21idleruntime-cro12:35:001
2917199101,2cyclictest19982-21systemd-journal07:57:131
2917199100,3cyclictest19982-21systemd-journal11:05:321
2917199100,3cyclictest19982-21systemd-journal11:00:001
2917199100,2cyclictest502-21systemd-logind09:52:231
2917199100,2cyclictest19982-21systemd-journal10:50:221
2917199100,2cyclictest19982-21systemd-journal10:05:011
249372100,0sleep219733-21diskmemload12:05:012
249372100,0sleep219733-21diskmemload12:05:012
213752100,0sleep00-21swapper/012:02:100
213752100,0sleep00-21swapper/012:02:100
291719993,2cyclictest30654-21snmpd09:20:091
291719993,2cyclictest24948-21ssh09:40:451
291719993,1cyclictest19733-21diskmemload10:30:081
291719993,1cyclictest17533-21timerwakeupswit07:50:241
291719992,3cyclictest7661-21lldpd07:12:001
291719992,3cyclictest30654-21snmpd10:07:541
291719992,2cyclictest9548-21expr11:55:141
291719992,2cyclictest30654-21snmpd07:40:161
291719992,2cyclictest30654-21snmpd07:24:551
291719992,2cyclictest25906-21cat12:25:151
291719992,2cyclictest15689-21rm12:19:151
291719992,1cyclictest18705-21grep12:20:211
291719992,1cyclictest0-21swapper/112:02:301
291719992,1cyclictest0-21swapper/112:02:301
291719991,3cyclictest30654-21snmpd09:07:521
291719991,3cyclictest1924-21expr11:30:131
291719990,3cyclictest8576-21sed10:20:231
291719990,3cyclictest30529-21sh12:08:051
291719990,3cyclictest26519-21fschecks_count11:25:181
291719990,3cyclictest24423-21taskset11:44:241
291719990,3cyclictest19982-21systemd-journal09:46:321
291719990,3cyclictest15216-21ssh11:16:581
291719990,3cyclictest12506-21uname09:30:151
291719990,2cyclictest19982-21systemd-journal08:14:441
291719990,2cyclictest19982-21systemd-journal08:14:441
291679994,3cyclictest19982-21systemd-journal10:45:210
7443280,0sleep20-21swapper/211:11:112
30966280,0sleep30-21swapper/310:13:063
291789986,1cyclictest22109-21ssh11:21:523
291789983,3cyclictest19982-21systemd-journal09:16:543
291759986,1cyclictest28-21ksoftirqd/210:30:012
291759985,2cyclictest28-21ksoftirqd/212:40:002
291759984,3cyclictest508-21dbus-daemon09:51:332
291759984,3cyclictest508-21dbus-daemon07:12:102
291759984,3cyclictest10369-21ntpq11:55:182
291719983,3cyclictest19982-21systemd-journal08:45:121
291719982,2cyclictest30654-21snmpd12:10:391
291719982,2cyclictest30654-21snmpd08:32:511
291719981,3cyclictest30654-21snmpd09:00:491
291719981,3cyclictest0-21swapper/111:11:071
291719981,2cyclictest30654-21snmpd08:25:121
291719980,4cyclictest29943-21sh10:40:051
291719980,3cyclictest5194-21ssh10:45:231
291719980,3cyclictest30500-21df08:20:111
291719980,3cyclictest27927-21rm09:15:471
291719980,3cyclictest24415-21timerandwakeup08:05:201
291719980,3cyclictest24371-21irqstats11:00:161
291719980,3cyclictest21396-21ssh09:10:191
291719980,3cyclictest19150-21ssh09:35:581
291719980,3cyclictest12996-21chrt08:54:311
291719980,2cyclictest26460-21irqstats11:45:171
291719980,2cyclictest11391-21cron07:40:001
291679984,3cyclictest19982-21systemd-journal11:39:270
291679984,1cyclictest25190-21turbostat11:45:010
291679983,3cyclictest508-21dbus-daemon08:05:590
291679983,3cyclictest19982-21systemd-journal12:07:270
291679982,3cyclictest9156-21munin-run11:35:000
291789974,2cyclictest11736-21in:imuxsock11:09:083
291789973,3cyclictest508-21dbus-daemon08:56:023
291789973,3cyclictest508-21dbus-daemon08:37:163
291789973,3cyclictest31078-21ntpq10:40:183
291789973,3cyclictest10069-21diskstats11:35:153
291789973,3cyclictest0-21swapper/312:31:473
291789973,1cyclictest0-21swapper/311:33:063
291789973,1cyclictest0-21swapper/309:36:243
291789972,2cyclictest18405-21gzip12:20:203
291789971,2cyclictest1-21systemd10:33:163
291759975,1cyclictest19733-21diskmemload10:16:592
291759974,2cyclictest11736-21in:imuxsock09:50:012
291759973,3cyclictest508-21dbus-daemon11:19:342
291759973,3cyclictest30654-21snmpd12:26:032
291759973,3cyclictest30654-21snmpd08:51:092
291759973,3cyclictest27874-21apt-get08:15:152
291759973,3cyclictest23118-21expr09:40:152
291759973,3cyclictest19982-21systemd-journal11:06:132
291759973,3cyclictest19982-21systemd-journal08:09:272
291759973,3cyclictest19982-21systemd-journal07:35:572
291759973,1cyclictest0-21swapper/211:01:282
291759973,1cyclictest0-21swapper/210:56:002
291759973,1cyclictest0-21swapper/209:39:472
291759972,4cyclictest0-21swapper/211:35:392
291759972,3cyclictest8610-21munin-run08:45:002
291759972,3cyclictest19982-21systemd-journal07:48:022
291759971,5cyclictest0-21swapper/212:06:422
291759970,3cyclictest1110-21ssh09:20:242
291679976,1cyclictest12-21ksoftirqd/009:45:010
291679974,2cyclictest9917-21gltestperf07:35:150
291679974,2cyclictest508-21dbus-daemon08:54:220
291679974,2cyclictest11736-21in:imuxsock07:17:590
291679973,3cyclictest508-21dbus-daemon12:15:010
291679973,3cyclictest508-21dbus-daemon10:26:350
291679973,3cyclictest30654-21snmpd09:54:150
291679973,3cyclictest30654-21snmpd08:29:240
291679973,3cyclictest19982-21systemd-journal11:15:350
291679973,3cyclictest13702-21sshd11:57:280
291679973,3cyclictest12543-21sed09:30:160
291679973,3cyclictest0-21swapper/010:02:150
291679973,2cyclictest19982-21systemd-journal08:40:040
291679973,1cyclictest0-21swapper/012:36:440
291679973,1cyclictest0-21swapper/012:33:350
291679973,1cyclictest0-21swapper/010:50:340
291679972,4cyclictest9125-21apt-get09:55:120
291679972,3cyclictest19982-21systemd-journal11:06:370
291679972,3cyclictest19982-21systemd-journal09:35:120
291679971,4cyclictest19982-21systemd-journal10:39:310
291679971,3cyclictest19982-21systemd-journal11:10:480
291679970,4cyclictest24693-21perf12:25:010
291679970,4cyclictest12784-21munin-run10:25:010
22154270,0sleep00-21swapper/010:59:200
10242270,1sleep012-21ksoftirqd/008:45:210
291789966,0cyclictest0-21swapper/307:40:183
291789964,1cyclictest2371-21apt-get07:20:143
291789963,2cyclictest9308-21apt-get11:55:133
291789963,2cyclictest8888-21apt-get08:45:133
291789963,2cyclictest5782-21cat11:10:183
291789963,2cyclictest30654-21snmpd08:27:183
291789963,2cyclictest20758-21expr08:00:133
291789963,2cyclictest19982-21systemd-journal07:16:273
291789963,2cyclictest19733-21diskmemload10:50:203
291789963,2cyclictest13646-21fschecks_count10:25:143
291789963,2cyclictest11957-21/usr/sbin/munin11:15:193
291789963,2cyclictest11736-21in:imuxsock07:28:513
291789963,2cyclictest10412-21grep07:35:193
291789962,3cyclictest7759-21cat10:20:193
291789962,3cyclictest30654-21snmpd10:45:073
291789962,3cyclictest30654-21snmpd10:37:073
291789962,3cyclictest30654-21snmpd09:45:063
291789962,3cyclictest30654-21snmpd09:30:583
291789962,3cyclictest30654-21snmpd08:50:113
291789962,3cyclictest30654-21snmpd08:30:453
291789962,3cyclictest30654-21snmpd08:17:143
291789962,3cyclictest25303-21expr12:25:133
291789962,3cyclictest19982-21systemd-journal11:40:263
291789962,3cyclictest16785-21cat07:50:163
291789962,3cyclictest16747-21systemctl09:00:193
291789962,3cyclictest1357-21expr12:10:153
291789962,3cyclictest0-21swapper/312:17:003
291789962,3cyclictest0-21swapper/310:05:173
291789962,2cyclictest19982-21systemd-journal08:05:023
291789962,1cyclictest0-21swapper/311:26:083
291789962,1cyclictest0-21swapper/311:00:163
291789962,1cyclictest0-21swapper/310:55:043
291789961,3cyclictest7661-21lldpd09:20:033
291789961,3cyclictest19982-21systemd-journal08:13:043
291789961,3cyclictest19982-21systemd-journal08:13:043
291789961,3cyclictest19982-21systemd-journal07:49:513
291789961,3cyclictest19982-21systemd-journal07:11:453
291789961,2cyclictest13042-21rm12:37:223
291789960,6cyclictest0-21swapper/309:50:493
291789960,5cyclictest18321-21/usr/sbin/munin07:55:193
291789960,4cyclictest19982-21systemd-journal12:05:023
291789960,3cyclictest960-21basename10:15:133
291789960,2cyclictest1344-21/usr/sbin/munin11:50:173
291789960,0cyclictest0-21swapper/310:00:193
291789960,0cyclictest0-21swapper/309:25:043
291789960,0cyclictest0-21swapper/308:20:213
291759964,1cyclictest31082-21ntp_states08:20:162
291759963,2cyclictest7661-21lldpd11:42:082
291759963,2cyclictest668-21runrttasks12:22:092
291759963,2cyclictest668-21runrttasks09:14:342
291759963,2cyclictest668-21runrttasks08:30:072
291759963,2cyclictest4732-21sendmail_mailtr10:45:202
291759963,2cyclictest4016-21sshd07:21:282
291759963,2cyclictest28-21ksoftirqd/210:00:062
291759963,2cyclictest26368-21sshd10:35:232
291759963,2cyclictest25868-21sshd09:15:092
291759963,2cyclictest25412-21apt-config08:10:012
291759963,2cyclictest25412-21apt-config08:10:012
291759963,2cyclictest19982-21systemd-journal07:28:262
291759963,2cyclictest16497-21df07:50:142
291759963,2cyclictest13161-21ssh09:30:202
291759963,2cyclictest11736-21in:imuxsock08:48:322
291759963,2cyclictest0-21swapper/208:30:012
291759962,3cyclictest30654-21snmpd11:21:232
291759962,3cyclictest30654-21snmpd10:54:522
291759962,3cyclictest30654-21snmpd09:06:462
291759962,3cyclictest29741-11brltty07:33:012
291759962,3cyclictest21271-21cat08:00:152
291759962,3cyclictest19011-21cat07:55:182
291759962,3cyclictest1437-21df12:10:152
291759962,3cyclictest1-21systemd07:18:502
291759962,3cyclictest0-21swapper/210:10:152
291759962,2cyclictest19982-21systemd-journal10:05:012
291759962,1cyclictest15280-21awk09:00:002
291759962,1cyclictest0-21swapper/211:50:272
291759962,1cyclictest0-21swapper/211:45:042
291759962,1cyclictest0-21swapper/210:31:332
291759962,1cyclictest0-21swapper/209:25:532
291759961,1cyclictest141rcu_preempt11:30:122
291759960,4cyclictest325562ssh10:41:192
291759960,2cyclictest9095-21/usr/sbin/munin09:55:132
291759960,2cyclictest19982-21systemd-journal11:25:372
291759960,0cyclictest0-21swapper/212:15:462
291759960,0cyclictest0-21swapper/210:20:032
291719963,2cyclictest508-21dbus-daemon07:33:261
291719961,3cyclictest19982-21systemd-journal08:35:021
291679963,2cyclictest508-21dbus-daemon08:58:580
291679963,2cyclictest30654-21snmpd10:40:010
291679963,2cyclictest2632-21ssh09:22:220
291679963,2cyclictest19982-21systemd-journal10:10:180
291679963,2cyclictest11029-21ssh12:15:320
291679963,1cyclictest0-21swapper/009:12:240
291679962,3cyclictest7794-21cat07:30:170
291679962,3cyclictest508-21dbus-daemon09:07:430
291679962,3cyclictest30654-21snmpd11:50:050
291679962,3cyclictest30654-21snmpd11:25:080
291679962,3cyclictest30654-21snmpd10:33:550
291679962,3cyclictest30654-21snmpd08:38:120
291679962,3cyclictest30654-21snmpd08:20:140
291679962,3cyclictest30654-21snmpd08:15:350
291679962,3cyclictest30654-21snmpd07:58:350
291679962,3cyclictest30654-21snmpd07:51:110
291679962,3cyclictest30654-21snmpd07:29:070
291679962,3cyclictest30654-21snmpd07:10:450
291679962,3cyclictest19368-21fw_packets11:20:150
291679962,3cyclictest1605-21smartctl10:15:160
291679962,3cyclictest15081-21systemctl07:45:190
291679962,3cyclictest0-21swapper/011:45:430
291679962,1cyclictest0-21swapper/010:07:400
291679962,1cyclictest0-21swapper/009:15:190
291679961,3cyclictest7661-21lldpd08:31:470
291679961,3cyclictest19982-21systemd-journal09:45:420
291679960,5cyclictest20569-21/usr/sbin/munin08:00:140
291679960,3cyclictest27493-21ssh12:25:490
291789953,1cyclictest17782-21df12:00:153
291789953,1cyclictest17782-21df12:00:153
291789952,2cyclictest30654-21snmpd09:05:103
291789952,2cyclictest30654-21snmpd08:40:123
291759952,2cyclictest30654-21snmpd08:35:082
291759952,2cyclictest15916-21expr09:00:142
291679952,2cyclictest12905-21awk07:40:230
291679950,3cyclictest19982-21systemd-journal09:00:000
291679950,3cyclictest19982-21systemd-journal07:20:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional