You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-12-11 - 14:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4.osadl.org (updated Wed Dec 11, 2024 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3077725993228,3cyclictest556057-21kworker/3:1+pm19:41:503
3077725992522,2cyclictest524-21in:imuxsock22:55:003
3077723992522,2cyclictest510-21dbus-daemon22:15:002
3077720992420,2cyclictest3266248-21sh21:50:011
3077725992219,2cyclictest1055822-21systemd-journal22:15:003
3077720992217,3cyclictest3450315-21kernelversion23:50:171
3077720992217,3cyclictest3281590-21latency_hist22:00:001
3077725992117,2cyclictest3232477-21ntp_kernel_pll_21:25:193
3077723992118,2cyclictest3372937-21munin-run23:00:002
3077723992113,7cyclictest3141409-21munin-run20:10:012
3077720992117,2cyclictest3194511-21apt-key21:00:011
3077725992016,3cyclictest3207954-21kthreadcore21:10:193
3077720992017,2cyclictest3136001-21apt-config20:05:001
3077720992016,1cyclictest0-21swapper/100:40:001
3077720992015,3cyclictest3366017-21gltestperf22:55:161
3077718992017,2cyclictest3486878-21idleruntime-cro00:14:590
3077725991914,3cyclictest3438708-21unixbench-2d23:40:293
3077720991916,2cyclictest3499033-21ntp_kernel_pll_00:20:211
3077720991914,3cyclictest1055822-21systemd-journal20:40:001
3077720991914,3cyclictest1055822-21systemd-journal20:40:001
3077720991913,5cyclictest3109293-21cron19:39:591
3077718991916,2cyclictest3525394-21idleruntime-cro00:40:000
3077718991915,2cyclictest0-21swapper/022:14:590
3077723991815,2cyclictest3244348-21irqcore21:35:162
3077723991815,2cyclictest3194426-21latency_hist21:00:012
3077723991814,2cyclictest0-21swapper/222:09:592
3077720991815,2cyclictest0-21swapper/122:25:001
3077720991814,3cyclictest3415790-21unixbench-2d23:25:221
307772099180,9cyclictest3130383-21idleruntime-cro19:59:591
307772099180,16cyclictest3388119-21cut23:10:001
3077718991815,2cyclictest3167791-21sh20:35:010
3077718991814,3cyclictest61450irq/128-enp0s29f1:rx-023:30:120
3077718991814,3cyclictest61450irq/128-enp0s29f1:rx-021:30:330
3077718991814,3cyclictest61450irq/128-enp0s29f1:rx-019:20:140
3077718991814,2cyclictest0-21swapper/022:50:000
3077718991813,3cyclictest171ktimers/022:25:040
307771899180,1cyclictest510-21dbus-daemon19:41:510
307772599177,8cyclictest0-21swapper/321:17:103
3077725991714,2cyclictest3151035-21needreboot20:15:213
3077725991713,3cyclictest491ktimers/322:56:403
3077725991713,2cyclictest0-21swapper/321:00:003
3077725991713,2cyclictest0-21swapper/320:05:013
3077725991712,3cyclictest3312036-21cpuspeed_turbos22:20:123
3077725991711,4cyclictest3486894-21systemd-run00:15:003
3077725991711,4cyclictest1055822-21systemd-journal19:24:593
3077723991714,2cyclictest353-21hwrng22:40:182
3077723991714,2cyclictest3173813-21irqcore20:40:172
3077723991713,3cyclictest3514567-21needreboot00:30:192
3077723991713,3cyclictest3449561-21gltestperf23:50:142
3077723991713,3cyclictest3319473-21apt-key22:25:002
3077723991713,3cyclictest3163298-21irqcore20:30:172
3077723991713,2cyclictest3494991-21fschecks_count00:20:132
3077723991713,2cyclictest0-21swapper/223:10:002
3077723991713,2cyclictest0-21swapper/220:05:002
3077723991712,2cyclictest0-21swapper/223:44:322
3077720991712,4cyclictest311ktimers/122:19:591
3077720991712,3cyclictest3120161-21cpuspeed_turbos19:50:131
3077718991714,2cyclictest61450irq/128-enp0s29f1:rx-023:40:370
3077718991714,2cyclictest61450irq/128-enp0s29f1:rx-023:35:180
3077718991714,2cyclictest61450irq/128-enp0s29f1:rx-023:16:500
3077718991714,2cyclictest61450irq/128-enp0s29f1:rx-021:58:490
3077718991714,2cyclictest171ktimers/023:29:150
3077718991713,3cyclictest61450irq/128-enp0s29f1:rx-023:05:220
3077718991713,3cyclictest61450irq/128-enp0s29f1:rx-022:35:180
3077718991713,3cyclictest61450irq/128-enp0s29f1:rx-022:05:120
3077718991713,3cyclictest61450irq/128-enp0s29f1:rx-021:25:090
3077718991713,3cyclictest171ktimers/023:50:180
307772599169,6cyclictest3452659-21tr23:50:183
307772599169,5cyclictest3394238-21sshd23:12:193
3077725991613,2cyclictest3487429-21fschecks_count00:15:143
3077725991612,3cyclictest3468558-21needreboot00:00:193
3077725991611,3cyclictest3103568-21unixbench_singl19:30:263
307772399163,5cyclictest3400810-21kworker/u8:1+xprtiod00:16:222
3077723991613,2cyclictest3159942-21kthreadcore20:25:182
3077723991613,2cyclictest0-21swapper/200:10:002
3077723991611,3cyclictest0-21swapper/200:10:172
3077723991611,2cyclictest0-21swapper/200:35:182
307772399160,14cyclictest3357776-21munin-run22:49:592
3077720991613,2cyclictest311ktimers/121:30:151
3077720991613,2cyclictest311ktimers/121:15:181
3077720991612,3cyclictest3332368-21unixbench_multi22:30:221
3077720991612,2cyclictest0-21swapper/121:30:001
3077718991613,2cyclictest62250irq/129-enp0s29f1:tx-022:50:130
3077718991613,2cyclictest62250irq/129-enp0s29f1:tx-019:45:270
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-023:59:590
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-022:55:330
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-022:01:190
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-021:40:560
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-021:19:100
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-000:30:200
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-000:20:200
3077718991613,2cyclictest61450irq/128-enp0s29f1:rx-000:05:200
3077718991613,2cyclictest171ktimers/021:35:540
3077718991612,3cyclictest61450irq/128-enp0s29f1:rx-022:40:160
3077718991612,3cyclictest61450irq/128-enp0s29f1:rx-022:30:130
3077718991612,3cyclictest61450irq/128-enp0s29f1:rx-022:20:410
3077718991612,3cyclictest61450irq/128-enp0s29f1:rx-000:25:230
3077718991612,3cyclictest171ktimers/000:16:510
307772599158,5cyclictest3237395-21tr21:30:153
3077725991513,1cyclictest491ktimers/300:07:453
3077725991512,2cyclictest491ktimers/323:58:323
3077725991512,2cyclictest491ktimers/322:40:143
3077725991512,1cyclictest0-21swapper/322:35:003
3077725991511,3cyclictest3411221-21cpuspeed_turbos23:25:093
307772599151,13cyclictest3273831-21basename21:54:593
3077725991511,2cyclictest0-21swapper/322:09:593
3077725991510,3cyclictest0-21swapper/323:20:223
307772399158,5cyclictest3259352-21grep21:45:152
307772399152,4cyclictest41-21ksoftirqd/222:50:152
3077723991512,2cyclictest401ktimers/222:38:102
3077723991511,3cyclictest3461479-21unixbench_multi23:55:262
3077723991511,3cyclictest3403685-21cpuspeed_turbos23:20:132
3077723991511,2cyclictest0-21swapper/219:30:172
307772399150,5cyclictest0-21swapper/222:15:242
307772099158,5cyclictest3457518-21cut23:55:171
3077720991513,1cyclictest3468583-21needreboot00:00:191
3077720991512,2cyclictest3343293-21gltestperf22:40:171
3077720991511,2cyclictest0-21swapper/121:20:171
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-023:10:130
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-022:15:180
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-021:50:140
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-021:10:200
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-020:50:250
3077718991512,2cyclictest61450irq/128-enp0s29f1:rx-019:55:000
3077718991512,2cyclictest3194452-21latency_hist21:00:010
3077718991511,3cyclictest61450irq/128-enp0s29f1:rx-023:45:150
3077718991511,3cyclictest61450irq/128-enp0s29f1:rx-000:00:110
3077718991511,2cyclictest61450irq/128-enp0s29f1:rx-020:40:120
307772599149,3cyclictest3259377-21gltestperf21:45:153
307772599148,4cyclictest3422362-21tr23:30:153
307772599148,4cyclictest3337043-21tr22:35:183
307772599147,5cyclictest3512548-21cut00:30:173
307772599142,2cyclictest191rcu_preempt23:00:123
3077725991411,2cyclictest3502965-21sed00:25:163
3077725991411,2cyclictest3285518-21kthreadcore22:00:193
3077725991410,3cyclictest3162526-21apt20:30:003
3077725991410,3cyclictest0-21swapper/322:25:183
3077725991410,2cyclictest3448875-21grep23:50:013
3077725991410,2cyclictest0-21swapper/323:10:003
3077725991410,2cyclictest0-21swapper/322:50:003
3077725991410,2cyclictest0-21swapper/320:05:173
3077725991410,2cyclictest0-21swapper/319:14:593
3077725991410,2cyclictest0-21swapper/300:35:273
307772599140,11cyclictest3281577-21cat22:00:003
307772399149,3cyclictest0-21swapper/220:15:162
307772399147,5cyclictest3278481-21ntpq21:55:232
3077723991412,1cyclictest3125256-21latency_hist19:55:012
3077723991411,2cyclictest401ktimers/223:26:032
3077723991410,3cyclictest401ktimers/221:41:372
3077723991410,3cyclictest3332397-21unixbench_singl22:30:222
307772099147,5cyclictest3321160-21irqstats22:25:161
3077720991413,1cyclictest311ktimers/121:40:541
3077720991412,2cyclictest311ktimers/120:15:141
3077720991411,2cyclictest3173667-21gltestperf20:40:161
3077720991411,2cyclictest3165195-21kthreadcore20:30:191
3077720991411,2cyclictest311ktimers/123:30:591
3077720991411,2cyclictest0-21swapper/119:30:191
3077720991411,2cyclictest0-21swapper/100:25:241
3077720991410,3cyclictest3442801-21kernelversion23:45:181
3077720991410,2cyclictest0-21swapper/121:10:011
3077718991411,2cyclictest61450irq/128-enp0s29f1:rx-023:00:140
3077718991411,2cyclictest61450irq/128-enp0s29f1:rx-020:25:180
3077718991411,2cyclictest61450irq/128-enp0s29f1:rx-019:25:100
3077718991411,2cyclictest3404987-21kthreadcore23:20:190
307772599139,3cyclictest3141964-21gltestperf20:10:163
307772599139,3cyclictest3094087-21gltestperf19:25:143
307772599139,2cyclictest0-21swapper/320:45:163
307772599139,2cyclictest0-21swapper/320:40:223
307772599138,4cyclictest3130351-21sshd19:59:533
307772599138,3cyclictest0-21swapper/322:15:253
307772599136,4cyclictest3496895-21tr00:20:183
307772399139,3cyclictest3223104-21kthreadcore21:20:192
307772399138,3cyclictest0-21swapper/223:00:002
307772399137,5cyclictest3503773-21cut00:25:172
307772399137,4cyclictest3465001-21cut00:00:162
307772399135,6cyclictest510-21dbus-daemon23:20:012
3077723991310,2cyclictest62450irq/133-enp0s29f1:tx-219:40:002
3077723991310,2cyclictest401ktimers/221:17:362
3077723991310,2cyclictest3094008-21fschecks_time19:25:132
307772099139,3cyclictest3289608-21grep22:05:141
307772099139,3cyclictest3158649-21tr20:25:171
307772099139,2cyclictest3188906-21cron20:55:011
307772099139,2cyclictest0-21swapper/121:50:131
307772099137,4cyclictest3430085-21tr23:35:201
3077720991311,1cyclictest3183624-21idleruntime-cro20:50:001
3077720991310,2cyclictest0-21swapper/119:45:011
307772099130,4cyclictest0-21swapper/122:11:591
307772099130,3cyclictest0-21swapper/100:34:251
307772099130,11cyclictest32112582sleep121:12:211
307771899139,3cyclictest3124657-21unixbench_singl19:50:250
307771899138,2cyclictest61450irq/128-enp0s29f1:rx-021:00:130
3077718991310,2cyclictest0-21swapper/020:05:010
307772599129,2cyclictest3120584-21grep19:50:183
307772599129,2cyclictest3114967-21cpuspeed_turbos19:45:143
307772599129,2cyclictest0-21swapper/320:20:203
307772599129,1cyclictest0-21swapper/321:00:213
307772599128,2cyclictest0-21swapper/321:10:013
307772599120,3cyclictest3088247-21awk19:19:593
307772399129,2cyclictest3078002-21cpuspeed_turbos19:10:142
307772399129,2cyclictest0-21swapper/223:10:112
307772399128,2cyclictest0-21swapper/221:10:012
307772399127,4cyclictest3427908-21tr23:35:192
3077723991210,1cyclictest391rcuc/220:10:182
307772099129,2cyclictest311ktimers/122:00:061
307772099127,3cyclictest0-21swapper/122:50:121
3077720991210,1cyclictest0-21swapper/120:10:131
307771899129,2cyclictest61450irq/128-enp0s29f1:rx-020:04:530
307771899129,2cyclictest0-21swapper/019:35:240
307771899128,3cyclictest0-21swapper/021:10:010
3077718991210,1cyclictest0-21swapper/019:14:590
307772399117,3cyclictest0-21swapper/219:20:152
307772399117,2cyclictest0-21swapper/220:40:002
307772399117,2cyclictest0-21swapper/220:40:002
307772099118,2cyclictest0-21swapper/121:00:011
307771899117,3cyclictest3151029-21needreboot20:15:200
307771899115,4cyclictest3141955-21fw_conntrack20:10:150
307772399108,1cyclictest0-21swapper/219:45:182
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional