You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-06-13 - 02:28
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Wed Jun 12, 2024 12:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
62895121010,2sleep10-21swapper/109:24:191
8567932890,2sleep30-21swapper/311:45:233
6004972350,3sleep30-21swapper/309:05:213
9246452290,2chrt0-21swapper/312:29:023
2358491270,2ptp4l0-21swapper/311:15:543
2358491270,2ptp4l0-21swapper/307:24:593
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-011:01:213
2358491250,2ptp4l0-21swapper/310:41:143
7747152240,3chrt774718-21sh10:55:261
464322992422,1cyclictest0-21swapper/212:15:012
464320992421,2cyclictest773307-21latency_hist10:54:590
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-011:22:103
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-008:36:453
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-008:36:453
2358491240,2ptp4l0-21swapper/309:26:383
2358491240,1ptp4l0-21swapper/312:39:143
92449422319,2sleep20-21swapper/212:28:462
8620142230,2sleep20-21swapper/211:50:142
68452822319,2sleep20-21swapper/209:59:042
67539022319,2sleep20-21swapper/209:51:422
65350022319,2sleep20-21swapper/209:40:052
65124922319,2sleep20-21swapper/209:36:192
64437422319,2sleep20-21swapper/209:33:242
464322992320,1cyclictest0-21swapper/210:20:012
464320992320,2cyclictest725229-21apt-config10:25:000
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-012:06:483
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-012:01:053
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-011:29:073
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-010:46:083
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:58:043
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:52:163
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:43:223
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:23:263
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-009:17:403
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-008:58:443
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-008:30:033
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-008:01:383
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-011:42:053
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-011:30:433
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-011:12:193
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:59:503
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:34:403
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-010:05:553
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-009:12:053
2358491230,2ptp4l0-21swapper/307:55:333
93910822218,2sleep20-21swapper/212:35:442
93233822218,2sleep20-21swapper/212:33:042
90682522218,2sleep20-21swapper/212:15:442
89067822218,2sleep20-21swapper/212:05:502
88021722218,2sleep20-21swapper/212:00:252
85406122218,2sleep20-21swapper/211:45:182
85169322218,2sleep20-21swapper/211:42:252
84403322218,2sleep20-21swapper/211:38:012
82944022218,2sleep20-21swapper/211:30:022
82069522218,2sleep20-21swapper/211:24:092
81186922218,2sleep20-21swapper/211:17:332
80515622218,2sleep20-21swapper/211:14:592
79604422218,2sleep20-21swapper/211:07:472
78717722218,2sleep20-21swapper/211:01:002
77365722218,2sleep20-21swapper/210:55:082
76289022218,2sleep20-21swapper/210:45:462
75502522218,2sleep20-21swapper/210:40:362
74743722218,2sleep20-21swapper/210:36:242
73957722218,2sleep20-21swapper/210:31:382
73133622218,2sleep20-21swapper/210:26:062
72393322218,2sleep20-21swapper/210:22:412
70631422218,2sleep20-21swapper/210:10:342
69201422218,2sleep20-21swapper/210:03:052
63641322218,2sleep20-21swapper/209:28:222
62114522218,2sleep20-21swapper/209:19:402
61173222218,2sleep20-21swapper/209:11:512
53022522218,2sleep20-21swapper/208:05:012
464321992219,2cyclictest725417-21/usr/sbin/munin10:25:001
464321992219,2cyclictest254-21systemd-journal07:35:011
464321992214,3cyclictest802741-21unixbench-2d11:10:311
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-011:37:413
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-010:36:523
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-012:21:463
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-012:18:093
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-010:15:573
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-010:10:333
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-009:38:533
2358491220,2ptp4l0-21swapper/308:20:143
2358491220,2ptp4l0-21swapper/308:15:283
91661322118,2sleep20-21swapper/212:24:022
60516922118,2sleep20-21swapper/209:07:252
59933722118,2sleep20-21swapper/209:01:212
58208822118,2sleep20-21swapper/208:45:372
57643722118,2sleep20-21swapper/208:42:052
57062722118,2sleep20-21swapper/208:36:362
57062722118,2sleep20-21swapper/208:36:352
56509422118,2sleep20-21swapper/208:34:232
55618522118,2sleep20-21swapper/208:25:252
55330722118,2sleep20-21swapper/208:21:202
53563722118,2sleep20-21swapper/208:06:252
52396522118,2sleep20-21swapper/207:58:482
51807822118,2sleep20-21swapper/207:52:122
51231022118,2sleep20-21swapper/207:48:022
50125822118,2sleep20-21swapper/207:40:092
50086122118,2sleep20-21swapper/207:39:162
49503122118,2sleep20-21swapper/207:33:442
47885722118,2sleep20-21swapper/207:20:262
464321992117,3cyclictest922329-21ptp4l12:25:261
464321992116,4cyclictest1-21systemd10:55:001
464320992117,3cyclictest1502-21systemd-logind12:20:000
464320992114,2cyclictest2577798rtkit-daemon09:28:240
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-010:20:423
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-008:27:103
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-007:30:363
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-007:15:013
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-010:01:193
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-009:46:313
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-009:30:563
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-007:40:273
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-007:05:353
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-007:05:353
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-007:18:333
2358491210,2ptp4l0-21swapper/312:33:103
2358491210,2ptp4l0-21swapper/311:53:003
2358491210,2ptp4l0-21swapper/311:07:113
2358491210,2ptp4l0-21swapper/310:28:433
464321992017,2cyclictest716993-21apt-config10:20:011
464321992016,3cyclictest898306-21unixbench-2d12:10:301
464321992016,3cyclictest254-21systemd-journal09:30:011
464321992016,2cyclictest0-21swapper/112:10:001
464321992014,5cyclictest695863-21kthreadcore10:05:241
464320992017,2cyclictest861369-21/usr/sbin/munin11:50:370
464320992017,2cyclictest536118-21sh08:10:020
464320992017,2cyclictest477941-21systemd-run07:20:000
464320992016,3cyclictest1502-21systemd-logind10:15:010
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-008:42:583
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-007:39:043
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-008:48:423
2358491200,4ptp4l164790irq/127-enp1s0-TxRx-008:09:513
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-011:56:553
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-010:51:013
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-009:00:273
2358491200,2ptp4l0-21swapper/308:10:153
464321991916,2cyclictest664263-21kthreadcore09:45:291
464321991916,2cyclictest589448-21cut08:55:241
464321991915,3cyclictest762951-21timerwakeupswit10:45:461
464321991915,3cyclictest669710-21cut09:50:111
464321991915,3cyclictest568033-21kthreadcore08:35:281
464321991915,3cyclictest568033-21kthreadcore08:35:271
464321991914,4cyclictest600534-21gltestperf09:05:211
464321991914,1cyclictest2577798rtkit-daemon09:40:371
464320991916,2cyclictest920186-21kthreadcore12:25:220
464320991916,2cyclictest877080-21grep12:00:010
464320991916,2cyclictest861265-21cut11:50:010
464320991916,2cyclictest797250-21systemd-run11:10:000
464320991916,2cyclictest464439-21systemd-run07:10:020
464320991916,2cyclictest464439-21systemd-run07:10:010
464320991916,2cyclictest1464-21dbus-daemon08:05:010
46432099190,6cyclictest618282-21cat09:15:320
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-008:52:203
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-007:45:123
2358491190,2ptp4l0-21swapper/312:10:243
464321991815,2cyclictest849961-21ssh11:40:241
464321991815,2cyclictest789311-21latency_hist11:05:001
464321991815,2cyclictest560870-21kthreadcore08:30:241
464321991815,2cyclictest558292-21latency08:25:261
464321991815,2cyclictest533530-21kthreadcore08:05:241
464321991815,2cyclictest519076-21fschecks_count07:55:181
464321991815,2cyclictest496336-21irqcore07:35:241
464321991815,2cyclictest1451-21avahi-daemon10:15:011
464321991814,3cyclictest927931-21kthreadcore12:30:271
464321991814,3cyclictest862597-21kthreadcore11:50:191
464321991814,3cyclictest830568-21irqrtprio11:30:191
464321991814,3cyclictest542248-21cpuspeed_turbos08:15:141
464321991813,4cyclictest824200-21kthreadcore11:25:231
464321991813,4cyclictest810144-21grep11:15:221
464321991813,4cyclictest617673-21kthreadcore09:15:311
464321991812,5cyclictest816562-21kthreadcore11:20:211
464320991815,2cyclictest845130-21munin-run11:39:590
464320991815,2cyclictest547681-21apt-key08:20:020
464320991815,2cyclictest515369-21sed07:50:240
464320991815,2cyclictest1485-21polkitd12:05:010
2358491180,3ptp4l164790irq/127-enp1s0-TxRx-007:50:273
464322991715,1cyclictest0-21swapper/207:15:032
464321991714,2cyclictest857523-21kthreadcore11:45:221
464321991714,2cyclictest750858-21irqrtprio10:40:201
464321991714,2cyclictest746321-21needreboot10:35:251
464321991714,2cyclictest726323-21fschecks_time10:25:181
464321991714,2cyclictest678491-21irqcore09:55:211
464321991714,2cyclictest477889-21latency_hist07:20:011
464321991714,2cyclictest470683-21systemd-run07:15:021
464321991714,2cyclictest1454-1atopacctd10:31:271
464321991713,3cyclictest840137-21kthreadcore11:35:231
464321991713,3cyclictest690329-21mailstats10:00:301
464321991713,3cyclictest630691-21irqcore09:25:191
464321991713,3cyclictest580570-21kthreadcore08:45:211
464321991713,3cyclictest573667-21kthreadcore08:40:271
464321991713,3cyclictest550490-21kthreadcore08:20:291
464321991713,3cyclictest541334-21unixbench_multi08:10:351
464321991713,3cyclictest525850-21kthreadcore08:00:231
464321991713,3cyclictest502344-21irqrtprio07:40:201
464321991713,3cyclictest1454-1atopacctd07:45:131
464321991712,4cyclictest933903-21cpuspeed_turbos12:35:131
464321991712,4cyclictest903405-21kthreadcore12:15:191
464321991712,4cyclictest872792-21kthreadcore11:55:201
464320991714,2cyclictest717070-21apt-key10:20:010
464320991714,2cyclictest685211-21/usr/sbin/munin10:00:020
464320991714,2cyclictest1485-21polkitd09:45:380
464320991714,2cyclictest1465-21gmain09:34:550
464320991714,2cyclictest1-21systemd10:28:240
464320991713,3cyclictest399805-21kworker/u8:0+nfsiod12:21:140
464320991713,3cyclictest1464-21dbus-daemon08:15:020
464320991712,4cyclictest0-21swapper/010:50:000
464320991711,4cyclictest783940-21cut11:00:230
2358491170,3ptp4l164790irq/127-enp1s0-TxRx-007:28:573
46432299161,9cyclictest0-21swapper/207:30:012
464321991613,2cyclictest909885-21sh12:20:131
464321991613,2cyclictest609846-21kthreadcore09:10:211
464321991613,2cyclictest583369-21gltestperf08:50:181
464321991613,2cyclictest512789-21acpi07:50:111
464321991612,3cyclictest880884-21kthreadcore12:00:251
464321991612,3cyclictest485114-21kthreadcore07:25:191
464321991612,3cyclictest1454-1atopacctd09:35:221
46432099168,1cyclictest2577798rtkit-daemon07:41:220
464320991614,2cyclictest837163-21kworker/0:2+events_freezable_power_12:13:190
464320991614,2cyclictest765382-21kworker/0:1+events_freezable_power_11:18:230
464320991614,2cyclictest765382-21kworker/0:1+events_freezable_power_10:56:250
464320991614,2cyclictest524142-21kworker/0:0+events_freezable_power_09:06:350
464320991614,2cyclictest524142-21kworker/0:0+events_freezable_power_08:44:380
464320991614,2cyclictest495214-21kworker/0:2+events_freezable_power_07:49:430
464320991614,2cyclictest495214-21kworker/0:2+events_freezable_power_07:38:440
464320991613,2cyclictest938166-21kthreadcore12:35:220
464320991613,2cyclictest834477-21timerandwakeup11:30:300
464320991613,2cyclictest698249-21mailstats10:05:320
464320991613,2cyclictest674355-21/usr/sbin/munin09:50:310
464320991613,2cyclictest653345-21latency_hist09:40:020
464320991613,2cyclictest594977-21irqcore09:00:230
464320991613,2cyclictest0-21swapper/009:45:000
464320991612,3cyclictest661451-21kworker/u8:3+nfsiod11:27:430
464322991513,1cyclictest0-21swapper/209:00:002
464322991513,1cyclictest0-21swapper/208:20:012
464322991512,1cyclictest0-21swapper/210:51:212
464322991512,1cyclictest0-21swapper/210:05:132
464322991511,2cyclictest0-21swapper/211:55:232
464322991511,2cyclictest0-21swapper/209:24:262
464321991512,2cyclictest594358-21cpuspeed_turbos09:00:141
464321991512,2cyclictest479327-21irqrtprio07:20:301
464321991512,2cyclictest464318-21cyclictest11:05:401
464320991514,1cyclictest701031-21kworker/0:2+events_freezable_power_10:34:270
464320991512,2cyclictest933464-21systemd-run12:35:000
464320991512,2cyclictest799366-21diskmemload11:10:200
464320991512,2cyclictest752182-21kthreadcore10:40:210
464320991512,2cyclictest470242-21kthreadcore07:15:000
464320991512,2cyclictest1464-21dbus-daemon11:25:010
464320991512,2cyclictest1464-21dbus-daemon07:30:010
464320991512,2cyclictest1289-21rpcbind09:23:110
464320991512,2cyclictest0-21swapper/011:40:190
464320991512,2cyclictest0-21swapper/010:04:590
464322991412,1cyclictest0-21swapper/211:29:232
464320991411,2cyclictest888594-21kthreadcore12:05:260
464320991411,2cyclictest745029-21kthreadcore10:35:230
464320991411,2cyclictest608430-21kthreadcore09:10:200
464320991411,2cyclictest583202-21fschecks_count08:50:150
464320991411,2cyclictest567885-21kthreadcore08:35:270
464320991411,2cyclictest567885-21kthreadcore08:35:260
464320991411,2cyclictest564528-21threads08:30:330
464320991411,2cyclictest555313-21kthreadcore08:25:250
464320991411,2cyclictest549326-21kthreadcore08:20:280
464320991411,2cyclictest520775-21kthreadcore07:55:260
464320991411,2cyclictest482852-21sendmail_mailqu07:20:390
464320991411,2cyclictest464318-21cyclictest07:30:180
46432299131,8cyclictest0-21swapper/209:45:162
464322991311,1cyclictest0-21swapper/208:11:402
464322991311,1cyclictest0-21swapper/207:20:012
464320991310,2cyclictest592976-21pmu-power08:55:310
464320991310,2cyclictest0-21swapper/008:45:270
464322991210,1cyclictest0-21swapper/208:50:222
46432199118,2cyclictest0-21swapper/107:10:021
46432199118,2cyclictest0-21swapper/107:10:011
4643229997,1cyclictest0-21swapper/207:10:012
4643229997,1cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional