You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 01:00
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Sat Apr 27, 2024 12:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
287212621090,2sleep20-21swapper/210:10:162
306318021080,1sleep10-21swapper/112:10:111
28219712860,3sleep30-21swapper/309:38:063
29031972680,2sleep30-21swapper/310:30:013
2358491260,5ptp4l164790irq/127-enp1s0-TxRx-009:51:573
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-011:45:403
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-011:15:183
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-010:21:513
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-010:21:513
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-010:11:303
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-007:55:473
2358491250,4ptp4l164790irq/127-enp1s0-TxRx-012:03:123
2358491250,4ptp4l164790irq/127-enp1s0-TxRx-008:35:263
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-012:32:053
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-012:26:003
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-011:58:193
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-011:40:273
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-009:25:433
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-008:30:253
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-007:50:183
2358491240,3ptp4l164790irq/127-enp1s0-TxRx-010:35:073
2358491240,2ptp4l0-21swapper/311:32:193
310894022319,2sleep20-21swapper/212:36:382
309235422319,2sleep20-21swapper/212:25:322
308488422319,2sleep20-21swapper/212:21:352
306893822319,2sleep20-21swapper/212:11:412
306118822319,2sleep20-21swapper/212:07:362
303738022319,2sleep20-21swapper/211:52:492
303019922319,2sleep20-21swapper/211:49:252
300528022319,2sleep20-21swapper/211:32:252
297395222319,2sleep20-21swapper/211:13:332
296528022319,2sleep20-21swapper/211:07:112
295102422319,2sleep20-21swapper/211:00:032
294807222319,2sleep20-21swapper/210:55:252
291855722319,2sleep20-21swapper/210:39:192
289613722319,2sleep20-21swapper/210:25:162
287100222319,2sleep20-21swapper/210:09:492
286100522319,2sleep20-21swapper/210:01:232
285316422319,2sleep20-21swapper/209:56:382
282941022319,2sleep20-21swapper/209:42:032
282105922319,2sleep20-21swapper/209:36:222
278860822319,2sleep20-21swapper/209:15:542
26445712230,2chrt0-21swapper/307:15:183
263315022318,3sleep20-21swapper/207:07:132
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-012:23:443
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-012:11:053
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:01:273
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-008:45:213
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:41:113
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:06:133
2358491230,2ptp4l0-21swapper/307:40:213
304041822218,2sleep20-21swapper/211:55:222
298059622219,2sleep20-21swapper/211:15:582
289423222218,2sleep20-21swapper/210:23:232
289423222218,2sleep20-21swapper/210:23:232
280684622218,2sleep20-21swapper/209:29:492
278166522218,2sleep20-21swapper/209:13:252
276261522219,2sleep20-21swapper/208:56:222
274711122218,2sleep20-21swapper/208:45:232
272769922218,2sleep20-21swapper/208:25:322
269421822218,2sleep20-21swapper/208:00:152
267708022218,2sleep20-21swapper/207:45:172
267598722219,2sleep20-21swapper/207:44:082
2633552992219,2cyclictest2863417-21grep10:05:021
2633552992216,2cyclictest26861261kthreadcore07:50:211
2633552992215,6cyclictest1464-21dbus-daemon12:00:011
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-011:27:433
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-009:46:173
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-008:56:183
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-012:06:293
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-010:52:513
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-009:10:023
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-008:20:013
2358491220,2ptp4l0-21swapper/310:59:363
2358491220,2ptp4l0-21swapper/310:34:373
277440122118,2sleep20-21swapper/209:09:132
276323322118,2sleep20-21swapper/209:00:072
275676922118,2sleep20-21swapper/208:50:292
273949222118,2sleep20-21swapper/208:35:332
273373322118,2sleep20-21swapper/208:30:572
272202622118,2sleep20-21swapper/208:21:522
271620322118,2sleep20-21swapper/208:16:232
269317522118,2sleep20-21swapper/207:57:352
266997222118,2sleep20-21swapper/207:35:592
265860122118,2sleep20-21swapper/207:27:492
265860122118,2sleep20-21swapper/207:27:492
265241622118,2sleep20-21swapper/207:20:362
263889722118,2sleep20-21swapper/207:11:062
2633552992118,2cyclictest2639458-21grep07:15:021
2633552992117,3cyclictest1559-21gdbus12:20:001
2633551992118,2cyclictest0-21swapper/009:30:010
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-008:08:373
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-009:56:193
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-012:37:103
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-011:09:113
2358491210,2ptp4l0-21swapper/311:10:393
2358491210,2ptp4l0-21swapper/309:21:483
2358491210,1ptp4l0-21swapper/309:33:473
2633552992014,5cyclictest1509-21in:imuxsock08:35:011
2633552992014,5cyclictest1454-1atopacctd11:20:211
2633551992017,2cyclictest3054538-21/usr/sbin/munin12:04:590
2633551992017,2cyclictest3038529-21latency_hist11:55:000
2633551992017,2cyclictest1465-21gmain08:30:010
2358491200,6ptp4l164790irq/127-enp1s0-TxRx-011:20:113
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:51:453
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:00:043
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-010:48:423
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-008:42:073
2358491200,4ptp4l0-21swapper/309:40:103
2358491200,2ptp4l164790irq/127-enp1s0-TxRx-011:51:173
2358491200,2ptp4l164790irq/127-enp1s0-TxRx-010:18:493
2358491200,2ptp4l0-21swapper/312:15:523
2358491200,2ptp4l0-21swapper/309:15:403
2358491200,2ptp4l0-21swapper/307:10:233
2633553991916,1cyclictest0-21swapper/209:50:002
2633552991916,2cyclictest2782999-21latency_hist09:15:021
2633552991914,4cyclictest2840130-21irqcore09:50:211
2633552991914,4cyclictest1465-21gmain12:10:001
2633552991913,5cyclictest2939355-21kthreadcore10:50:231
2633552991913,5cyclictest2757230-21systemd-journal08:55:011
2358491190,5ptp4l164790irq/127-enp1s0-TxRx-007:33:513
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-009:01:083
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-007:46:583
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-011:39:563
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-008:25:063
2358491190,2ptp4l0-21swapper/311:00:293
2633552991815,2cyclictest2110946-1atop11:30:011
2633552991814,3cyclictest2663816-21mailstats07:30:301
2633552991812,5cyclictest3017042-21kthreadcore11:40:211
2633552991812,5cyclictest2928479-21kthreadcore10:45:161
2633552991812,5cyclictest2924396-21timerwakeupswit10:40:311
2633551991815,2cyclictest3022659-21latency_hist11:45:000
2633551991815,2cyclictest2825591-21kthreadcore09:40:180
2633551991815,2cyclictest25776-21rtkit-daemon10:40:140
2633551991815,2cyclictest1502-21systemd-logind09:00:000
2358491180,6ptp4l164790irq/127-enp1s0-TxRx-007:36:473
2358491180,5ptp4l164790irq/127-enp1s0-TxRx-009:10:003
2358491180,4ptp4l164790irq/127-enp1s0-TxRx-008:23:573
2358491180,3ptp4l0-21swapper/307:10:013
2358491180,2ptp4l0-21swapper/307:20:173
2358491180,1ptp4l0-21swapper/308:10:253
2633553991715,1cyclictest0-21swapper/212:20:002
2633553991714,1cyclictest0-21swapper/210:20:012
263355399171,13cyclictest0-21swapper/211:30:012
2633552991714,2cyclictest1502-21systemd-logind12:30:011
2633552991714,2cyclictest1502-21systemd-logind09:40:021
2633552991713,3cyclictest2884157-21pmu-power10:15:241
2633552991713,3cyclictest2795949-21missed_timers09:20:241
2633552991712,2cyclictest1769-21runrttasks12:03:481
2633552991711,5cyclictest3102994-21latency_hist12:35:021
2633552991711,5cyclictest2946000-21kthreadcore10:55:201
2633552991711,5cyclictest2633549-21cyclictest10:10:151
2633552991710,1cyclictest191rcu_preempt09:40:101
2633551991714,2cyclictest2944463-21kthreadcore10:55:190
2633551991714,2cyclictest2887146-21sh10:20:010
2633551991714,2cyclictest2871191-21latency_hist10:10:010
2633551991714,2cyclictest1485-21polkitd09:25:010
2633551991714,2cyclictest1451-21avahi-daemon09:00:470
2633551991714,2cyclictest0-21swapper/011:10:010
2633551991714,2cyclictest0-21swapper/010:00:010
2633551991713,3cyclictest2689070-21kthreadcore07:55:230
2358491170,5ptp4l164790irq/127-enp1s0-TxRx-007:25:213
2358491170,5ptp4l164790irq/127-enp1s0-TxRx-007:25:213
2633553991613,1cyclictest0-21swapper/212:34:472
2633553991613,1cyclictest0-21swapper/209:20:222
2633553991612,2cyclictest0-21swapper/211:21:402
263355299169,1cyclictest481rcuop/207:55:231
2633552991613,2cyclictest3000334-21kthreadcore11:30:201
2633552991613,2cyclictest2974720-21sh11:15:001
2633552991613,2cyclictest2868776-21unixbench_singl10:05:301
2633552991613,2cyclictest2854912-21cron10:00:001
2633552991613,2cyclictest2647980-21gltestperf07:20:161
2633552991613,2cyclictest2633549-21cyclictest07:40:011
2633552991613,2cyclictest2225101-21kworker/u8:2-writeback08:30:021
2633552991613,2cyclictest1-21systemd07:45:231
2633552991612,3cyclictest2760675-21kthreadcore08:55:201
2633552991612,3cyclictest1509-21in:imuxsock08:05:021
2633552991612,1cyclictest3035818-21ssh11:50:271
2633552991611,4cyclictest3027745-21ptp4l-jitter11:45:271
2633552991611,4cyclictest2903410-21/usr/sbin/munin10:30:181
263355199166,4cyclictest2664631-21systemd-run07:35:010
2633551991613,2cyclictest3073076-21kthreadcore12:15:180
2633551991613,2cyclictest2984020-21sort11:20:180
2633551991613,2cyclictest2953851-21kthreadcore11:00:210
2633551991613,2cyclictest2915800-21kthreadcore10:35:220
2633551991613,2cyclictest2757127-21cron08:55:010
2633551991613,2cyclictest2686747-21rt-features07:50:260
2633551991613,2cyclictest254-21systemd-journal12:08:460
2633551991613,2cyclictest0-21swapper/008:40:010
2633551991613,2cyclictest0-21swapper/008:15:000
2633551991612,3cyclictest3001687-21kthreadcore11:30:210
2633551991612,3cyclictest0-21swapper/008:10:000
2633551991611,3cyclictest0-21swapper/011:40:020
2633551991610,5cyclictest2694323-21gltestperf08:00:150
263355199160,15cyclictest2745655-21perf08:45:010
2633553991513,1cyclictest0-21swapper/211:39:522
2633553991513,1cyclictest0-21swapper/209:50:022
2633553991512,1cyclictest0-21swapper/210:52:502
2633553991512,1cyclictest0-21swapper/210:33:392
2633553991512,1cyclictest0-21swapper/208:10:242
2633553991511,2cyclictest0-21swapper/211:40:152
263355299158,6cyclictest2740180-21/usr/sbin/munin08:40:141
263355299158,6cyclictest0-21swapper/112:35:201
2633552991512,2cyclictest2966926-21latency_hist11:10:011
2633552991512,2cyclictest2919161-21ssh10:40:021
2633552991512,2cyclictest2812240-21mailstats09:30:271
2633552991512,2cyclictest2790789-21/usr/sbin/munin09:20:011
2633552991512,2cyclictest2722637-21sh08:25:011
2633552991512,2cyclictest2633549-21cyclictest09:26:411
2633552991512,2cyclictest1502-21systemd-logind09:10:011
2633552991512,2cyclictest1-21systemd08:10:161
2633552991512,2cyclictest0-21swapper/107:45:001
2633552991511,3cyclictest3081724-21kthreadcore12:20:181
2633552991511,3cyclictest2714902-21kthreadcore08:15:241
2633552991511,3cyclictest2642062-21fschecks_time07:15:131
263355199155,6cyclictest0-21swapper/012:10:570
263355199151,9cyclictest2994544-21kthreadcore11:25:210
2633551991512,2cyclictest2978084-21kthreadcore11:15:230
2633551991512,2cyclictest2971088-21kthreadcore11:10:220
2633551991512,2cyclictest2935451-21tr10:50:130
2633551991512,2cyclictest2929892-21kthreadcore10:45:170
2633551991512,2cyclictest2907234-21kthreadcore10:30:190
2633551991512,2cyclictest2895988-21cut10:25:130
2633551991512,2cyclictest2863193-21apt-key10:05:000
2633551991512,2cyclictest2836071-21proc_pri09:45:250
2633551991512,2cyclictest2782491-21latency_hist09:15:010
2633551991512,2cyclictest2774473-21diskmemload11:46:470
2633551991512,2cyclictest2734265-21cut08:35:020
2633551991512,2cyclictest2682024-21systemd-run07:50:020
2633551991512,2cyclictest2633549-21cyclictest07:45:010
2633551991512,2cyclictest25776-21rtkit-daemon10:24:250
2633551991512,2cyclictest25776-21rtkit-daemon10:24:250
2633551991511,3cyclictest3079995-21irqcore12:20:160
2633551991511,3cyclictest2810428-21kthreadcore09:30:230
2633553991411,1cyclictest0-21swapper/209:30:182
2633552991411,2cyclictest2887961-21fschecks_count10:20:151
2633552991411,2cyclictest2887961-21fschecks_count10:20:141
2633552991411,2cyclictest2831349-21acpi09:45:111
2633552991411,2cyclictest2767364-21kthreadcore09:00:181
2633552991411,2cyclictest2749382-21kthreadcore08:45:241
2633552991411,2cyclictest2704116-21processes08:05:231
2633552991410,3cyclictest2896876-21kthreadcore10:25:171
2633551991411,2cyclictest2872727-21kthreadcore10:10:200
2633551991411,2cyclictest2820016-21cut09:35:260
2633551991411,2cyclictest2783342-21cpuspeed_turbos09:15:110
2633551991411,2cyclictest2770932-21kthreadcore09:05:200
2633551991411,2cyclictest2659038-21munin-plugin-st07:30:020
2633551991411,2cyclictest2659038-21munin-plugin-st07:30:010
2633551991411,2cyclictest0-21swapper/012:35:000
2633551991410,3cyclictest3104021-21irqcore12:35:170
2633551991410,3cyclictest2644345-21kthreadcore07:15:190
263355199140,8cyclictest3044946-21ssh11:57:010
2633553991311,1cyclictest0-21swapper/208:40:142
2633553991311,1cyclictest0-21swapper/208:05:192
2633553991310,2cyclictest0-21swapper/210:42:562
2633553991310,1cyclictest0-21swapper/210:45:172
2633553991310,1cyclictest0-21swapper/207:16:162
263355299131,5cyclictest0-21swapper/108:35:131
2633552991310,2cyclictest3007640-21gltestperf11:35:161
2633552991310,2cyclictest2975262-21cpuspeed_turbos11:15:141
2633552991310,2cyclictest2953851-21kthreadcore11:00:211
2633551991311,1cyclictest0-21swapper/012:30:000
2633551991310,2cyclictest2839537-21cpuspeed_turbos09:50:130
2633551991310,2cyclictest2748327-21kthreadcore08:45:240
2633551991310,2cyclictest2721802-21unixbench-2d08:20:300
2633551991310,2cyclictest2712662-21kthreadcore08:15:220
2633551991310,2cyclictest2649916-21kthreadcore07:20:220
2633551991310,2cyclictest2635879-21kthreadcore07:10:150
2633551991310,2cyclictest0-21swapper/007:40:010
263355399127,4cyclictest0-21swapper/212:00:102
263355399123,5cyclictest0-21swapper/207:30:142
2633553991210,1cyclictest0-21swapper/207:50:202
263355299129,2cyclictest2633719-21true07:10:021
263355299128,3cyclictest1454-1atopacctd07:25:131
263355299128,3cyclictest1454-1atopacctd07:25:131
263355199107,2cyclictest2633556-21true07:10:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional