You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-13 - 03:06
Click here to display the system's profile data.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot8.osadl.org (updated Mon May 12, 2025 12:43:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
36346552980,1sleep00-21swapper/011:10:280
3346925992826,1cyclictest3555200-21munin-plugin-st09:45:000
3346925992819,8cyclictest3612963-21cut10:40:000
3346925992724,2cyclictest3653427-21systemd-run11:24:590
3346932992522,2cyclictest1-21systemd11:19:592
3346934992421,1cyclictest0-21swapper/311:00:013
3346932992421,2cyclictest3596369-21systemd-run10:20:012
3346932992319,3cyclictest3631696-21latency_hist11:05:012
3346929992320,2cyclictest3767376-21cut12:35:011
3346932992219,2cyclictest3767395-21systemd-run12:35:002
3346929992219,2cyclictest3718561-21cut12:05:001
3346929992219,2cyclictest3386389-21idleruntime-cro07:40:001
3346925992218,3cyclictest514-21systemd-logind11:00:000
3346925992218,2cyclictest3618636-21latency_hist10:50:010
3346934992118,1cyclictest0-21swapper/307:15:013
3346929992118,2cyclictest3662387-21irqcore11:30:161
3346929992117,3cyclictest3574366-21packagekitd08:35:201
3346925992117,3cyclictest3514035-21sh09:20:000
35455682200,1sleep30-21swapper/309:37:113
3346934992017,1cyclictest0-21swapper/312:10:203
3346934992017,1cyclictest0-21swapper/307:50:003
3346932992017,2cyclictest0-21swapper/208:55:012
3346932992016,2cyclictest3580158-21latency_hist10:00:012
3346932992016,2cyclictest3580158-21latency_hist10:00:002
3346929992016,3cyclictest3585059-21kworker/u8:3+events_unbound12:00:011
3346925992016,3cyclictest277-21plymouthd07:19:590
3346925992013,6cyclictest0-21swapper/007:35:010
3346934991916,1cyclictest0-21swapper/311:15:003
3346932991916,2cyclictest3530516-21cron09:30:002
3346932991916,2cyclictest0-21swapper/212:40:002
3346929991917,1cyclictest3734784-21cron12:15:001
3346929991915,3cyclictest761-21cups-browsed09:40:211
3346929991915,3cyclictest3400415-21kthreadcore07:50:191
3346925991916,2cyclictest0-21swapper/011:30:010
3346925991914,3cyclictest3604834-21apt-config10:35:010
37359562180,5chrt3735955-21sed12:15:181
3346934991815,1cyclictest0-21swapper/310:25:003
3346934991815,1cyclictest0-21swapper/310:15:003
3346934991815,1cyclictest0-21swapper/309:48:533
3346934991814,1cyclictest0-21swapper/311:55:233
3346932991814,3cyclictest3751815-21fschecks_time12:25:162
3346932991814,3cyclictest3698650-21kthreadcore11:50:182
3346932991814,3cyclictest3411243-21latency_hist08:00:012
3346932991814,3cyclictest3411243-21latency_hist08:00:002
3346929991815,2cyclictest3661667-21latency_hist11:30:001
3346929991815,2cyclictest3546962-21sendmail09:40:001
3346929991815,2cyclictest3394240-21kthreadcore07:45:151
3346929991814,2cyclictest0-21swapper/110:35:001
3346925991815,2cyclictest3542262-21kthreadcore09:35:220
3346934991714,1cyclictest0-21swapper/311:29:593
3346934991714,1cyclictest0-21swapper/311:09:303
3346934991714,1cyclictest0-21swapper/309:09:593
3346934991714,1cyclictest0-21swapper/308:40:003
3346934991714,1cyclictest0-21swapper/308:30:003
3346934991714,1cyclictest0-21swapper/308:15:003
3346934991714,1cyclictest0-21swapper/307:35:153
3346932991714,2cyclictest3514080-21systemd-run09:20:012
3346932991714,2cyclictest0-21swapper/212:15:002
3346932991714,2cyclictest0-21swapper/210:10:012
3346932991713,3cyclictest0-21swapper/211:09:592
3346932991713,2cyclictest0-21swapper/211:45:002
3346932991713,2cyclictest0-21swapper/208:50:002
3346929991714,2cyclictest3417297-21sh08:05:011
3346929991714,2cyclictest3405554-21gltestperf07:55:181
3346929991714,2cyclictest3405554-21gltestperf07:55:171
3346929991714,2cyclictest0-21swapper/110:00:011
3346929991714,2cyclictest0-21swapper/110:00:001
3346929991714,2cyclictest0-21swapper/108:55:011
3346929991713,3cyclictest3531685-21irqcore09:30:151
334692599178,8cyclictest0-21swapper/007:25:000
3346925991714,2cyclictest500-21avahi-daemon12:25:230
3346925991714,2cyclictest3598974-21idleruntime-cro10:25:000
3346925991712,4cyclictest0-21swapper/008:50:110
3346925991712,3cyclictest3767525-21latency_hist12:35:010
3346934991613,1cyclictest0-21swapper/312:40:013
3346934991613,1cyclictest0-21swapper/312:31:383
3346934991613,1cyclictest0-21swapper/312:15:243
3346934991613,1cyclictest0-21swapper/311:30:163
3346934991613,1cyclictest0-21swapper/309:55:373
3346934991613,1cyclictest0-21swapper/309:55:363
3346934991613,1cyclictest0-21swapper/309:25:173
3346934991612,1cyclictest0-21swapper/312:05:163
3346934991612,1cyclictest0-21swapper/307:55:193
3346934991612,1cyclictest0-21swapper/307:55:183
3346932991614,1cyclictest0-21swapper/208:30:002
3346932991613,2cyclictest3751214-21systemd-run12:25:002
3346932991613,2cyclictest3711038-21gltestperf12:00:152
3346932991613,2cyclictest0-21swapper/211:39:592
3346932991613,2cyclictest0-21swapper/210:35:002
3346932991613,2cyclictest0-21swapper/207:15:002
3346932991612,3cyclictest3658903-21ntp_kernel_pll_11:25:252
334692999169,5cyclictest3686402-21apt-get11:45:141
3346929991613,2cyclictest3379539-21timerwakeupswit07:30:261
3346929991613,2cyclictest0-21swapper/110:35:161
3346929991612,3cyclictest3680923-21kthreadcore11:40:181
3346929991612,2cyclictest3497846-21diskmemload11:35:191
3346929991612,2cyclictest0-21swapper/110:25:001
3346929991612,2cyclictest0-21swapper/110:15:001
3346929991610,4cyclictest3562155-21sshd09:47:211
334692599168,7cyclictest3567679-21tr09:50:190
3346925991613,2cyclictest3579940-21idleruntime-cro10:00:010
3346925991613,2cyclictest3579940-21idleruntime-cro10:00:000
3346925991613,2cyclictest3537056-21runrttasks09:31:320
3346925991613,2cyclictest3485515-21sendmail09:00:010
3346925991613,2cyclictest0-21swapper/010:05:000
3346934991513,1cyclictest0-21swapper/312:21:053
3346934991512,1cyclictest0-21swapper/312:25:263
3346934991512,1cyclictest0-21swapper/312:05:003
3346934991512,1cyclictest0-21swapper/311:50:063
3346934991512,1cyclictest0-21swapper/311:01:063
3346934991512,1cyclictest0-21swapper/310:52:533
3346934991512,1cyclictest0-21swapper/310:18:203
3346934991512,1cyclictest0-21swapper/309:30:013
3346934991512,1cyclictest0-21swapper/309:19:593
3346934991512,1cyclictest0-21swapper/308:30:173
3346934991512,1cyclictest0-21swapper/308:20:193
3346934991512,1cyclictest0-21swapper/307:35:013
3346934991512,1cyclictest0-21swapper/307:25:203
3346934991511,1cyclictest0-21swapper/311:19:503
3346934991511,1cyclictest0-21swapper/309:20:203
3346932991512,2cyclictest3721949-21kthreadcore12:05:232
3346932991512,2cyclictest3649824-21kthreadcore11:20:192
3346932991512,2cyclictest3636580-21ssh11:14:442
3346932991512,2cyclictest3605151-21tr10:35:102
3346932991512,2cyclictest3497846-21diskmemload10:44:252
3346932991512,2cyclictest3485881-21cpuspeed_turbos09:00:142
3346932991512,2cyclictest3362146-21gltestperf07:20:172
3346932991512,2cyclictest0-21swapper/208:20:212
3346932991512,2cyclictest0-21swapper/208:15:202
3346932991511,3cyclictest3424047-21gltestperf08:10:152
3346932991510,3cyclictest3374418-21fschecks_count07:30:152
334693299150,14cyclictest3423476-21cron08:10:012
334692999158,5cyclictest3435670-21sshd08:18:201
3346929991513,1cyclictest3497846-21diskmemload11:00:011
3346929991512,2cyclictest3640055-21kthreadcore11:15:151
3346929991512,2cyclictest3601867-21munin-run10:30:011
3346929991512,2cyclictest3424029-21gltestperf08:10:161
3346929991512,2cyclictest3353193-21latency_hist07:15:011
3346929991512,2cyclictest0-21swapper/110:15:221
3346929991511,2cyclictest0-21swapper/110:40:251
3346929991511,2cyclictest0-21swapper/109:20:151
334692599159,4cyclictest3748531-21ntpq12:20:210
334692599159,4cyclictest3561480-21systemd-journal11:40:000
334692599159,4cyclictest3561480-21systemd-journal08:34:560
3346925991512,2cyclictest3770703-21kthreadcore12:35:180
3346925991512,2cyclictest3522622-21/usr/sbin/munin09:25:180
3346925991512,2cyclictest3401986-21kthreadcore07:50:190
3346925991512,2cyclictest171ktimers/010:30:000
3346925991512,2cyclictest0-21swapper/009:00:160
3346925991511,3cyclictest3667527-21unixbench_singl11:30:240
3346925991510,3cyclictest3423718-21/usr/sbin/munin08:10:210
3346934991412,1cyclictest0-21swapper/310:27:513
3346934991411,1cyclictest0-21swapper/311:46:253
3346934991411,1cyclictest0-21swapper/311:40:163
3346934991411,1cyclictest0-21swapper/310:40:013
3346934991411,1cyclictest0-21swapper/310:33:203
3346934991411,1cyclictest0-21swapper/310:05:013
3346934991411,1cyclictest0-21swapper/309:10:203
3346934991411,1cyclictest0-21swapper/308:50:253
3346934991411,1cyclictest0-21swapper/308:45:143
3346932991411,2cyclictest3398259-21unixbench-2d07:45:212
3346932991411,2cyclictest0-21swapper/207:40:002
3346932991411,1cyclictest0-21swapper/209:20:202
3346932991410,3cyclictest3531111-21fschecks_count09:30:142
3346932991410,3cyclictest3465390-21kthreadcore08:40:212
3346932991410,3cyclictest3453937-21unixbench_singl08:30:272
3346929991411,2cyclictest514-21systemd-logind12:25:001
3346929991411,2cyclictest3773241-21unixbench-2d12:35:241
3346929991411,2cyclictest3726674-21cron12:10:011
3346929991411,2cyclictest3696712-21kthreadcore11:50:171
3346929991411,2cyclictest3506913-21sh09:15:181
3346929991411,2cyclictest3417801-21fschecks_time08:05:171
3346929991411,2cyclictest3388862-21kthreadcore07:40:191
3346929991411,2cyclictest3363072-21irqrtprio07:20:181
3346929991411,2cyclictest0-21swapper/111:09:591
3346929991411,2cyclictest0-21swapper/109:05:161
3346929991410,3cyclictest3565036-21irqrtprio09:50:161
3346929991410,3cyclictest3442552-21gltestperf08:25:151
3346929991410,2cyclictest0-21swapper/111:25:011
334692599148,4cyclictest0-21swapper/008:45:240
3346925991412,1cyclictest3462554-21kworker/0:0+kacpid12:00:120
3346925991412,1cyclictest3462554-21kworker/0:0+kacpid10:50:230
3346925991411,2cyclictest3585059-21kworker/u8:3-xprtiod11:45:190
3346925991411,2cyclictest3415785-21kthreadcore08:00:190
3346925991411,2cyclictest0-21swapper/012:05:200
3346925991411,2cyclictest0-21swapper/011:15:160
3346925991411,2cyclictest0-21swapper/009:10:000
3346925991410,3cyclictest3727089-21cpuspeed_turbos12:10:110
3346925991410,3cyclictest3438628-21kthreadcore08:20:210
3346925991410,3cyclictest3373435-21unixbench-2d07:25:240
3346925991410,2cyclictest0-21swapper/009:20:180
3346934991311,1cyclictest0-21swapper/309:00:183
3346934991311,1cyclictest0-21swapper/308:55:233
3346934991310,1cyclictest0-21swapper/311:35:173
3346934991310,1cyclictest0-21swapper/311:24:193
3346934991310,1cyclictest0-21swapper/310:47:153
3346934991310,1cyclictest0-21swapper/310:05:263
3346934991310,1cyclictest0-21swapper/309:50:173
3346934991310,1cyclictest0-21swapper/309:43:263
3346934991310,1cyclictest0-21swapper/308:15:383
3346934991310,1cyclictest0-21swapper/308:05:183
3346934991310,1cyclictest0-21swapper/308:00:183
3346934991310,1cyclictest0-21swapper/307:50:543
3346934991310,1cyclictest0-21swapper/307:40:103
3346934991310,1cyclictest0-21swapper/307:20:383
3346934991310,1cyclictest0-21swapper/307:10:093
334693299139,2cyclictest0-21swapper/210:15:002
334693299138,4cyclictest3459427-21latency08:35:182
334693299137,4cyclictest3551199-21cut09:40:162
3346932991311,1cyclictest3621058-21systemd-run10:55:012
3346932991311,1cyclictest0-21swapper/207:20:002
3346932991310,2cyclictest3735497-21gltestperf12:15:172
3346932991310,2cyclictest3616373-21ssh10:45:372
3346932991310,2cyclictest3569432-21unixbench_singl09:50:232
3346932991310,2cyclictest3555934-21gltestperf09:45:162
3346932991310,2cyclictest3500251-21kthreadcore09:10:182
3346932991310,2cyclictest3497846-21diskmemload11:55:192
3346932991310,2cyclictest3484490-21missed_timers08:55:192
3346932991310,2cyclictest0-21swapper/211:30:252
3346932991310,2cyclictest0-21swapper/210:30:012
3346932991310,2cyclictest0-21swapper/210:25:002
334692999139,2cyclictest3355559-21cpuspeed_turbos07:15:121
334692999137,4cyclictest3561480-21systemd-journal10:55:011
334692999137,4cyclictest3529246-21sshd09:27:201
3346929991311,1cyclictest3486907-21irqrtprio09:00:161
3346929991311,1cyclictest0-21swapper/109:10:251
3346929991310,2cyclictest3483399-21kthreadcore08:55:181
3346929991310,2cyclictest3370131-21kthreadcore07:25:181
3346929991310,2cyclictest331ktimers/111:15:001
3346929991310,2cyclictest0-21swapper/110:10:011
334692599139,2cyclictest0-21swapper/007:10:000
334692599138,3cyclictest3708193-21grep11:55:270
334692599138,3cyclictest3353056-21cron07:15:000
334692599136,5cyclictest0-21swapper/011:05:020
334692599132,3cyclictest3499604-21kthreadcore09:10:170
3346925991312,1cyclictest3392547-21kworker/0:2+kacpid08:37:550
3346925991311,1cyclictest3462554-21kworker/0:0+kacpid11:06:050
3346925991311,1cyclictest3392547-21kworker/0:2+kacpid08:42:110
3346925991310,2cyclictest3559407-21kthreadcore09:45:180
3346925991310,2cyclictest3497846-21diskmemload10:42:280
3346925991310,2cyclictest3442712-21irqcore08:25:160
3346925991310,2cyclictest3418340-21irqcore08:05:180
3346925991310,2cyclictest3395812-21kthreadcore07:45:160
3346925991310,2cyclictest3392177-21unixbench_singl07:40:260
3346925991310,2cyclictest3380463-21cpuspeed_turbos07:35:120
3346925991310,2cyclictest0-21swapper/011:50:160
3346925991310,2cyclictest0-21swapper/011:45:000
334692599130,6cyclictest3588762-21grep10:15:120
334692599130,5cyclictest3742986-21cron12:20:000
334693499129,1cyclictest0-21swapper/308:40:183
3346934991210,1cyclictest0-21swapper/310:41:593
334693299129,2cyclictest3687084-21irqcore11:45:182
334693299129,2cyclictest3493320-21kernelversion09:05:182
334693299127,4cyclictest1-21systemd10:05:002
334693299126,4cyclictest3544229-21ntpq09:35:252
3346932991210,1cyclictest0-21swapper/210:55:102
334692999129,2cyclictest3631641-21cron11:05:011
334692999129,2cyclictest3448752-21gltestperf08:30:181
334692999129,2cyclictest0-21swapper/112:25:201
334692599129,2cyclictest3432869-21kthreadcore08:15:210
3346925991210,1cyclictest3462554-21kworker/0:0+kacpid10:06:330
3346925991210,1cyclictest3392547-21kworker/0:2+kacpid07:55:500
3346925991210,1cyclictest3392547-21kworker/0:2+kacpid07:55:490
334692599120,3cyclictest3586506-21ssh10:12:160
334693299119,1cyclictest33990032sleep207:50:142
334693299119,1cyclictest0-21swapper/208:00:172
334693299118,2cyclictest3370153-21kthreadcore07:25:182
334693299115,4cyclictest3388217-21tr07:40:192
334692999118,2cyclictest3467212-21fschecks_time08:45:141
334692999118,2cyclictest0-21swapper/108:40:251
334692999110,3cyclictest3618446-21munin-plugin-st10:50:001
334692999110,3cyclictest3441992-21latency_hist08:25:011
334692999110,10cyclictest0-21swapper/110:02:591
334693299106,3cyclictest3346956-21sed07:10:012
33409572101,5sleep30-21swapper/307:05:143
33469299981,4cyclictest3347020-21latency_hist07:10:001
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional