You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-10-28 - 19:55
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Tue Oct 28, 2025 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
328144124890,2sleep30-21swapper/311:25:023
309820421090,3sleep30-21swapper/309:40:023
2897580992816,7cyclictest0-21swapper/010:40:010
31215952270,3sleep30-21swapper/309:51:123
2897580992614,6cyclictest1652-1atopacctd09:14:330
2897581992521,2cyclictest0-21swapper/107:30:011
2897580992516,5cyclictest3143045-21cstates10:06:060
29677042240,2sleep20-21swapper/208:06:032
2897580992320,2cyclictest3351471-21gpgconf12:05:010
2897580992312,6cyclictest0-21swapper/009:35:010
835298220,3rtkit-daemon8351-21rtkit-daemon07:33:390
2897582992211,5cyclictest0-21swapper/207:20:012
2897580992214,5cyclictest3238396-21/usr/sbin/munin11:01:080
2897582992118,1cyclictest0-21swapper/211:05:002
2897582992115,3cyclictest0-21swapper/207:50:012
289758199219,6cyclictest170550irq/121-eno111:23:171
2897581992118,2cyclictest3132991-21sendmail10:00:011
2897581992118,2cyclictest3115483-21dump-pmu-power09:50:001
2897581992114,3cyclictest3319271-21kthreadcore11:46:081
2897580992118,2cyclictest3097941-21cron09:40:000
2897580992118,2cyclictest1635-21dbus-daemon10:25:000
2897580992112,5cyclictest3120695-21tr09:51:080
2897582992017,1cyclictest0-21swapper/209:30:002
2897582992017,1cyclictest0-21swapper/209:25:002
2897580992017,1cyclictest3281182-21dump-pmu-power11:25:010
2897580992012,4cyclictest0-21swapper/012:25:000
2897582991916,1cyclictest0-21swapper/208:25:012
2897582991915,2cyclictest0-21swapper/211:24:382
2897581991916,2cyclictest260-21systemd-journal08:05:001
289758099199,5cyclictest0-21swapper/009:10:020
289758099196,7cyclictest0-21swapper/010:50:590
2897580991916,2cyclictest3237657-21/usr/sbin/munin11:00:010
2897580991915,3cyclictest1700-21systemd-logind07:50:000
289758099191,1cyclictest3413117-21ssh12:40:010
2897580991911,7cyclictest0-21swapper/012:00:010
2897582991815,2cyclictest0-21swapper/212:20:022
2897582991815,1cyclictest0-21swapper/212:35:012
2897582991815,1cyclictest0-21swapper/211:50:012
2897582991810,5cyclictest0-21swapper/208:40:012
289758199189,3cyclictest501rcuop/210:23:061
289758199183,5cyclictest2955244-21aten2.4-expect07:56:021
2897581991815,2cyclictest3353930-21tr12:06:081
2897581991815,2cyclictest3272611-21latency_hist11:20:021
2897581991815,2cyclictest3185677-21latency_hist10:30:011
2897581991815,2cyclictest1700-21systemd-logind11:10:011
2897581991812,2cyclictest170550irq/121-eno111:05:001
2897581991812,2cyclictest170550irq/121-eno110:15:011
2897581991812,2cyclictest170550irq/121-eno110:15:011
2897581991811,3cyclictest3388513-21irqcore12:26:061
2897581991811,3cyclictest3089347-21latency_hist09:35:001
2897581991810,3cyclictest0-21swapper/111:45:001
289758099189,1cyclictest0-21swapper/008:11:060
289758099188,5cyclictest0-21swapper/012:31:060
289758099188,5cyclictest0-21swapper/009:40:580
2897580991815,2cyclictest3128169-21cut09:56:090
2897580991815,2cyclictest2897578-21cyclictest10:05:000
2897580991815,2cyclictest1631-21gmain09:25:020
2897580991815,2cyclictest1-21systemd11:46:060
2897580991811,6cyclictest0-21swapper/012:15:010
2897580991810,4cyclictest3357114-21kthreadcore12:06:100
2564091180,5phc2sys0-21swapper/308:06:003
2564091180,2phc2sys0-21swapper/312:06:443
2564091180,2phc2sys0-21swapper/309:34:573
835298170,3rtkit-daemon0-21swapper/008:38:470
2897582991715,1cyclictest0-21swapper/212:35:022
2897582991715,1cyclictest0-21swapper/207:45:012
2897582991714,1cyclictest0-21swapper/212:05:012
2897582991714,1cyclictest0-21swapper/211:20:002
289758199177,3cyclictest0-21swapper/108:41:071
2897581991716,1cyclictest0-21swapper/111:35:181
2897581991716,1cyclictest0-21swapper/111:35:181
2897581991715,1cyclictest0-21swapper/108:40:001
2897581991714,2cyclictest3231777-21kthreadcore10:56:101
2897581991714,2cyclictest3045314-21cut09:10:011
2897581991714,2cyclictest2035-21sshd07:21:171
2897581991714,2cyclictest1635-21dbus-daemon07:40:021
2897581991713,3cyclictest3325216-21kworker/u16:1+nfsiod12:03:221
2897581991713,3cyclictest3145524-21kthreadcore10:06:131
2897581991712,4cyclictest3054334-21systemd-run09:15:021
2897581991712,1cyclictest501rcuop/211:50:551
2897581991711,2cyclictest30771921latency09:26:111
289758099178,5cyclictest3298655-21latency_hist11:35:010
289758099178,5cyclictest0-21swapper/011:10:020
289758099173,9cyclictest0-21swapper/011:51:100
2897580991714,2cyclictest3395611-21sh12:30:020
2897580991714,2cyclictest2964597-21kthreadcore08:01:080
2897580991714,2cyclictest2903724-21open_files07:15:010
2897580991713,2cyclictest0-21swapper/009:50:010
2564091170,4phc2sys0-21swapper/309:16:473
2564091170,3phc2sys0-21swapper/310:03:473
2564091170,1phc2sys0-21swapper/311:34:343
2897582991614,1cyclictest0-21swapper/212:25:012
2897582991614,1cyclictest0-21swapper/207:15:012
2897582991613,1cyclictest0-21swapper/210:41:022
2897582991613,1cyclictest0-21swapper/210:20:022
2897582991613,1cyclictest0-21swapper/209:40:452
2897582991613,1cyclictest0-21swapper/207:31:152
289758299161,13cyclictest0-21swapper/209:56:132
289758199168,3cyclictest0-21swapper/111:31:151
2897581991613,2cyclictest3057303-21kthreadcore09:16:111
2897581991613,2cyclictest1661-21polkitd08:25:021
2897581991613,2cyclictest1661-21polkitd07:15:001
2897581991613,2cyclictest0-21swapper/110:20:021
2897581991612,3cyclictest3195813-21gltestperf10:36:041
2897581991612,1cyclictest601rcuop/308:57:031
2897581991610,3cyclictest170550irq/121-eno112:11:541
289758099169,6cyclictest0-21swapper/011:45:010
289758099167,5cyclictest0-21swapper/010:31:130
289758099166,5cyclictest0-21swapper/011:26:070
2897580991612,3cyclictest3203177-21kworker/u16:2+nfsiod11:12:210
2897580991612,3cyclictest2924074-21apt-config07:30:010
2897580991612,3cyclictest2897578-21cyclictest08:35:020
2897580991610,5cyclictest3204084-21cpuspeed10:41:020
289758099160,4cyclictest3167916-21dump-pmu-power10:20:000
2564091160,3phc2sys0-21swapper/309:47:413
2564091160,2phc2sys0-21swapper/311:29:123
2564091160,2phc2sys0-21swapper/311:08:123
2564091160,2phc2sys0-21swapper/311:04:343
2564091160,2phc2sys0-21swapper/310:28:313
2564091160,2phc2sys0-21swapper/310:09:483
2564091160,1phc2sys0-21swapper/312:36:423
301559721510,2sleep30-21swapper/308:46:003
2897582991513,1cyclictest0-21swapper/211:45:012
2897582991513,1cyclictest0-21swapper/208:51:012
2897582991512,1cyclictest0-21swapper/211:30:402
2897582991512,1cyclictest0-21swapper/211:30:012
2897582991512,1cyclictest0-21swapper/210:53:302
2897582991512,1cyclictest0-21swapper/210:15:002
2897582991512,1cyclictest0-21swapper/210:15:002
2897582991512,1cyclictest0-21swapper/209:51:052
2897582991512,1cyclictest0-21swapper/209:11:062
2897582991512,1cyclictest0-21swapper/207:10:012
289758199158,2cyclictest501rcuop/209:20:581
289758199158,2cyclictest170550irq/121-eno112:31:581
289758199158,1cyclictest601rcuop/310:48:311
289758199157,6cyclictest501rcuop/212:20:331
289758199157,3cyclictest501rcuop/212:19:211
289758199157,3cyclictest501rcuop/208:09:051
289758199156,3cyclictest501rcuop/210:32:361
289758199156,3cyclictest501rcuop/209:40:341
289758199154,7cyclictest3113639-21kworker/u16:4+xprtiod09:51:551
289758199153,8cyclictest3027226-21munin-plugin-st08:55:001
2897581991512,2cyclictest3260813-21phc2sys-jitter11:11:121
2897581991512,2cyclictest3134028-21tail10:01:031
2897581991512,2cyclictest3039418-21latency_hist09:05:011
289758199150,4cyclictest3284515-21cut11:26:071
289758199150,4cyclictest0-21swapper/108:46:101
289758099159,2cyclictest2936286-21turbostat07:40:010
289758099158,6cyclictest3213131-21cstates10:46:020
289758099158,6cyclictest0-21swapper/008:41:000
289758099154,3cyclictest3177698-21aten_repower_en10:26:020
289758099153,4cyclictest2906315-21aten_repower_vo07:16:010
2897580991512,2cyclictest3378061-21sh12:20:020
2897580991512,2cyclictest3269381-21latency11:16:140
2897580991512,2cyclictest3159501-21systemd10:15:020
2897580991512,2cyclictest3159501-21systemd10:15:020
2897580991512,2cyclictest2960793-21latency_hist08:00:000
2897580991512,2cyclictest2897578-21cyclictest07:55:010
2897580991512,2cyclictest1661-21polkitd09:30:000
2897580991511,3cyclictest1652-1atopacctd09:16:110
289758099150,13cyclictest2942393-21munin-run07:45:010
2564091151,1phc2sys0-21swapper/311:15:013
2564091150,3phc2sys0-21swapper/308:17:183
2564091150,2phc2sys0-21swapper/309:12:513
2564091150,2phc2sys0-21swapper/309:01:083
2564091150,2phc2sys0-21swapper/307:41:073
2564091150,1phc2sys0-21swapper/310:31:453
289758299142,6cyclictest0-21swapper/210:40:012
2897582991412,1cyclictest0-21swapper/208:30:022
2897582991411,1cyclictest0-21swapper/212:26:132
2897582991411,1cyclictest0-21swapper/212:11:052
2897582991411,1cyclictest0-21swapper/212:10:012
2897582991411,1cyclictest0-21swapper/211:51:082
2897582991411,1cyclictest0-21swapper/211:36:282
2897582991411,1cyclictest0-21swapper/211:36:282
2897582991411,1cyclictest0-21swapper/211:06:072
2897582991411,1cyclictest0-21swapper/210:32:352
2897582991411,1cyclictest0-21swapper/210:01:102
2897582991411,1cyclictest0-21swapper/208:10:182
2897582991411,1cyclictest0-21swapper/207:26:022
2897582991410,2cyclictest0-21swapper/208:46:062
289758299140,7cyclictest0-21swapper/209:33:152
289758299140,1cyclictest0-21swapper/211:12:472
289758199148,3cyclictest3095028-21/usr/sbin/munin09:36:101
289758199148,1cyclictest601rcuop/310:50:471
289758199147,1cyclictest601rcuop/307:15:311
289758199146,3cyclictest501rcuop/208:31:251
289758199146,3cyclictest501rcuop/208:25:161
289758199146,3cyclictest501rcuop/207:51:251
289758199145,3cyclictest501rcuop/212:35:561
289758199145,3cyclictest501rcuop/208:14:301
289758199145,3cyclictest501rcuop/207:45:361
289758199142,8cyclictest2743806-21kworker/u16:3+xprtiod11:55:031
2897581991412,1cyclictest8351-21rtkit-daemon10:41:051
2897581991411,2cyclictest2936950-21cpuspeed_turbos07:41:021
2897581991411,2cyclictest1652-1atopacctd07:31:101
289758099142,4cyclictest2967102-21sshd08:05:320
2897580991411,2cyclictest3027575-21/usr/sbin/munin08:56:290
2897580991411,2cyclictest3024271-21kthreadcore08:51:070
2897580991411,2cyclictest2979247-21aten_repower_cu08:16:000
2897580991410,3cyclictest3185569-21kworker/u16:0+nfsiod11:38:160
2897580991410,3cyclictest3185569-21kworker/u16:0+nfsiod11:38:160
2897580991410,3cyclictest3017834-21kthreadcore08:46:060
2564091140,3phc2sys0-21swapper/310:19:503
2564091140,2phc2sys0-21swapper/309:21:163
2564091140,2phc2sys0-21swapper/307:18:493
2564091140,1phc2sys0-21swapper/311:18:273
2564091140,1phc2sys0-21swapper/310:56:533
34018202130,4sleep30-21swapper/312:31:203
289758299139,2cyclictest0-21swapper/208:01:082
289758299139,2cyclictest0-21swapper/207:56:092
289758299137,1cyclictest0-21swapper/208:15:212
2897582991311,1cyclictest0-21swapper/209:45:022
2897582991310,1cyclictest0-21swapper/210:46:072
2897582991310,1cyclictest0-21swapper/210:26:002
2897582991310,1cyclictest0-21swapper/210:06:062
2897582991310,1cyclictest0-21swapper/209:36:022
2897582991310,1cyclictest0-21swapper/209:16:102
2897582991310,1cyclictest0-21swapper/209:06:032
2897582991310,1cyclictest0-21swapper/208:56:252
2897582991310,1cyclictest0-21swapper/208:31:082
2897582991310,1cyclictest0-21swapper/207:39:382
2897581991310,2cyclictest2897578-21cyclictest08:16:111
289758099138,3cyclictest170550irq/121-eno109:01:010
2897580991310,2cyclictest2991575-21cpuspeed_turbos08:26:030
2897580991310,2cyclictest2987659-21kthreadcore08:21:060
2897580991310,2cyclictest2916802-21latency07:21:080
2897580991310,2cyclictest2897699-21systemd-run07:10:010
2564091130,2phc2sys0-21swapper/307:39:353
289758299129,2cyclictest0-21swapper/208:41:082
289758299129,2cyclictest0-21swapper/207:21:042
289758299126,3cyclictest0-21swapper/211:55:592
2897582991210,1cyclictest0-21swapper/210:56:112
2897582991210,1cyclictest0-21swapper/210:21:022
2897582991210,1cyclictest0-21swapper/207:51:062
2564091124,2phc2sys0-21swapper/312:21:073
2564091121,2phc2sys0-21swapper/312:01:593
2564091120,2phc2sys0-21swapper/312:26:003
2564091120,2phc2sys0-21swapper/311:51:013
2564091120,2phc2sys0-21swapper/310:40:593
2564091120,2phc2sys0-21swapper/307:52:223
2564091120,1phc2sys0-21swapper/310:39:233
2564091120,1phc2sys0-21swapper/308:34:543
29157732110,3sleep30-21swapper/307:21:093
289758299119,1cyclictest0-21swapper/209:01:032
2564091112,2phc2sys0-21swapper/310:12:053
2564091112,2phc2sys0-21swapper/310:12:053
2564091110,5phc2sys0-21swapper/309:56:013
2564091110,4phc2sys0-21swapper/312:13:053
2564091110,2phc2sys0-21swapper/311:46:123
2564091110,2phc2sys0-21swapper/310:50:293
2564091110,2phc2sys0-21swapper/309:06:013
2564091110,2phc2sys0-21swapper/307:32:273
2564091110,2phc2sys0-21swapper/307:14:183
2564091110,1phc2sys0-21swapper/308:57:233
2564091110,1phc2sys0-21swapper/308:51:343
2564091110,1phc2sys0-21swapper/308:25:453
2564091110,1phc2sys0-21swapper/307:47:503
29735192100,2sleep30-21swapper/308:11:013
289758199102,1cyclictest491rcuog/207:10:011
2564091102,3phc2sys0-21swapper/310:25:013
2564091101,4phc2sys0-21swapper/307:06:033
2564091101,3phc2sys0-21swapper/307:56:033
2564091101,2phc2sys0-21swapper/312:16:063
2564091101,1phc2sys0-21swapper/308:41:073
2564091100,2phc2sys0-21swapper/311:41:313
2564091100,2phc2sys0-21swapper/311:35:383
2564091100,2phc2sys0-21swapper/311:35:383
2564091100,2phc2sys0-21swapper/310:47:503
2564091100,2phc2sys0-21swapper/309:25:573
2564091100,2phc2sys0-21swapper/308:36:073
2564091100,2phc2sys0-21swapper/308:01:003
2564091100,1phc2sys0-21swapper/309:43:343
256409191,2phc2sys0-21swapper/311:55:063
256409190,2phc2sys0-21swapper/307:26:023
256409180,2phc2sys0-21swapper/308:20:163
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional