You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-18 - 06:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Thu Apr 18, 2024 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
202701321090,1sleep00-21swapper/022:54:460
20609882970,1sleep10-21swapper/123:15:191
21930032760,2sleep10-21swapper/100:36:041
19860732680,3sleep30-21swapper/322:27:363
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-023:05:073
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-022:17:463
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-022:10:123
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-022:10:113
2358491250,5ptp4l164790irq/127-enp1s0-TxRx-000:22:273
2358491250,4ptp4l164790irq/127-enp1s0-TxRx-022:31:213
2358491250,4ptp4l164790irq/127-enp1s0-TxRx-022:03:513
171854299252,11cyclictest0-21swapper/223:40:002
1718538992521,2cyclictest1931018-21grep21:55:011
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-023:56:463
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-023:11:423
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-022:43:073
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-021:52:173
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-021:22:553
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-021:10:093
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-000:27:203
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-000:18:023
2358491240,5ptp4l164790irq/127-enp1s0-TxRx-000:18:023
2358491240,4ptp4l164790irq/127-enp1s0-TxRx-000:30:303
2358491240,3ptp4l0-21swapper/319:40:123
23582912418,2phc2sys0-21swapper/319:26:423
171812522419,3sleep20-21swapper/219:06:532
2358491230,7ptp4l164790irq/127-enp1s0-TxRx-020:45:093
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-023:23:593
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-023:00:113
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:39:593
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-022:08:473
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-021:28:043
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-019:50:133
2358491230,5ptp4l164790irq/127-enp1s0-TxRx-019:05:173
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-022:48:373
2358491230,4ptp4l164790irq/127-enp1s0-TxRx-021:18:433
2358491230,3ptp4l164790irq/127-enp1s0-TxRx-023:51:093
2358491230,3ptp4l164790irq/127-enp1s0-TxRx-022:56:393
2358491230,3ptp4l0-21swapper/320:35:223
2358491230,2ptp4l0-21swapper/323:16:033
2358491230,2ptp4l0-21swapper/322:00:013
2358491230,2ptp4l0-21swapper/322:00:003
217838322319,2sleep20-21swapper/200:28:442
214558522319,2sleep20-21swapper/200:07:042
213839022319,2sleep20-21swapper/200:03:312
211647722319,2sleep20-21swapper/223:50:202
210480422319,2sleep20-21swapper/223:40:592
210480422319,2sleep20-21swapper/223:40:592
208951822319,2sleep20-21swapper/223:32:132
208142022319,2sleep20-21swapper/223:26:592
205690622319,2sleep20-21swapper/223:10:572
205054722319,2sleep20-21swapper/223:09:032
204152322319,2sleep20-21swapper/223:01:592
199426222319,2sleep20-21swapper/222:33:052
198682122319,2sleep20-21swapper/222:29:042
197115422319,2sleep20-21swapper/222:19:382
195295622319,2sleep20-21swapper/222:05:522
194669722319,2sleep20-21swapper/222:04:112
193675022319,2sleep20-21swapper/221:55:502
193675022319,2sleep20-21swapper/221:55:502
192939722319,2sleep20-21swapper/221:52:162
192263622319,2sleep20-21swapper/221:49:362
191303122319,2sleep20-21swapper/221:41:262
190565622319,2sleep20-21swapper/221:37:382
188330822319,2sleep20-21swapper/221:25:112
188161422319,2sleep20-21swapper/221:22:302
180640022319,2sleep20-21swapper/220:20:312
173185022319,2sleep20-21swapper/219:17:112
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-023:29:483
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-022:52:373
2358491220,5ptp4l164790irq/127-enp1s0-TxRx-000:11:173
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-021:45:293
2358491220,4ptp4l164790irq/127-enp1s0-TxRx-020:30:123
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-021:33:133
2358491220,3ptp4l164790irq/127-enp1s0-TxRx-021:05:023
2358491220,3ptp4l0-21swapper/321:35:223
216875022219,2sleep20-21swapper/200:20:352
215540822219,2sleep20-21swapper/200:15:052
215540822219,2sleep20-21swapper/200:15:052
215299922219,2sleep20-21swapper/200:11:012
211324122219,2sleep20-21swapper/223:46:522
201705122218,2sleep20-21swapper/222:45:562
196330122218,2sleep20-21swapper/222:14:532
196330122218,2sleep20-21swapper/222:14:532
187281022218,2sleep20-21swapper/221:15:542
185262022219,2sleep20-21swapper/221:00:312
184713922219,2sleep20-21swapper/220:58:542
183679022219,2sleep20-21swapper/220:50:172
182385222219,2sleep20-21swapper/220:38:262
18125032220,2chrt1812507-21turbostat20:30:003
180747722218,2sleep20-21swapper/220:25:122
180067222219,2sleep20-21swapper/220:15:462
177201022219,2sleep20-21swapper/219:51:412
174922222219,2sleep20-21swapper/219:33:422
174327222219,2sleep20-21swapper/219:26:072
173759822219,2sleep20-21swapper/219:22:042
1718536992219,2cyclictest1922874-21dump-pmu-power21:50:000
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-020:50:103
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-019:20:013
2358491210,5ptp4l164790irq/127-enp1s0-TxRx-000:09:563
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-023:49:553
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-023:43:123
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-023:43:113
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-023:33:343
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-020:10:103
2358491210,4ptp4l164790irq/127-enp1s0-TxRx-019:20:163
2358491210,3ptp4l164790irq/127-enp1s0-TxRx-020:15:193
2358491210,2ptp4l0-21swapper/300:37:303
2358491210,2ptp4l0-21swapper/300:03:093
181795222118,2sleep20-21swapper/220:31:292
178407422118,2sleep20-21swapper/220:05:042
176635922118,2sleep20-21swapper/219:47:562
175471922118,2sleep20-21swapper/219:35:452
1718538992118,2cyclictest2163090-21sendmail00:20:001
1718538992118,2cyclictest2163090-21sendmail00:20:001
1718538992113,7cyclictest2139198-21latency_hist00:05:011
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-020:55:543
2358491200,5ptp4l164790irq/127-enp1s0-TxRx-019:48:133
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-023:35:073
2358491200,3ptp4l164790irq/127-enp1s0-TxRx-021:42:413
2358491200,2ptp4l0-21swapper/322:20:303
2358491200,2ptp4l0-21swapper/319:55:213
23582912017,2phc2sys0-21swapper/320:07:153
1718536992017,2cyclictest1464-21dbus-daemon00:15:000
2358491190,5ptp4l164790irq/127-enp1s0-TxRx-020:20:553
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-019:35:323
2358491190,4ptp4l164790irq/127-enp1s0-TxRx-019:13:513
2358491190,3ptp4l164790irq/127-enp1s0-TxRx-021:05:133
1718538991916,2cyclictest2147147-21perf00:10:011
1718538991916,2cyclictest2131090-21apt-key00:00:011
1718538991916,2cyclictest2011234-21/usr/sbin/munin22:45:011
1718538991915,3cyclictest1895600-21kthreadcore21:30:241
1718536991916,2cyclictest1835774-21/usr/sbin/munin20:50:010
1718536991916,2cyclictest1718709-21wc19:10:010
1718536991916,2cyclictest1509-21in:imuxsock23:00:010
2358491180,7ptp4l164790irq/127-enp1s0-TxRx-019:30:223
2358491180,6ptp4l164790irq/127-enp1s0-TxRx-020:00:113
2358491180,3ptp4l164790irq/127-enp1s0-TxRx-020:41:323
19220462180,1chrt0-21swapper/121:48:261
1718542991815,1cyclictest0-21swapper/220:50:002
171854299180,10cyclictest0-21swapper/200:40:012
1718538991815,2cyclictest1931435-21/usr/sbin/munin21:55:281
1718538991815,2cyclictest1931435-21/usr/sbin/munin21:55:281
1718538991814,3cyclictest1559-21gdbus20:55:001
1718538991814,3cyclictest1464-21dbus-daemon23:40:001
1718538991812,5cyclictest1858888-21kworker/u8:2-events_unbound22:00:361
1718538991812,5cyclictest0-21swapper/100:35:011
171853699189,1cyclictest471rcuog/221:20:010
1718536991815,2cyclictest1939242-21apt-key22:00:010
1718536991815,2cyclictest1939242-21apt-key22:00:010
1718536991815,2cyclictest1732072-21cron19:20:000
1718536991815,2cyclictest1464-21dbus-daemon23:05:020
1718536991815,2cyclictest1-21systemd23:30:090
1718542991714,1cyclictest0-21swapper/219:43:592
1718538991714,2cyclictest1766734-21true19:50:021
1718538991714,2cyclictest1745063-21kthreadcore19:30:221
1718538991714,2cyclictest0-21swapper/122:10:001
1718538991713,3cyclictest2102872-21kthreadcore23:40:231
1718538991713,3cyclictest2102872-21kthreadcore23:40:231
1718538991712,4cyclictest1858728-21diskmemload00:20:141
1718536991715,1cyclictest1743616-21cut19:30:010
1718536991714,2cyclictest2052069-21gltestperf23:10:140
1718536991714,2cyclictest1984286-21needreboot22:25:200
1718536991713,3cyclictest1883511-21tr21:25:130
2577798160,3rtkit-daemon0-21swapper/020:42:350
1718542991613,1cyclictest0-21swapper/223:00:012
171853899169,6cyclictest0-21swapper/121:35:221
171853899169,1cyclictest481rcuop/221:20:131
171853899165,5cyclictest0-21swapper/123:47:151
1718538991613,2cyclictest2179182-21latency_hist00:30:011
1718538991613,2cyclictest1775135-21kthreadcore19:55:201
1718538991613,2cyclictest1755395-21/usr/sbin/munin19:40:201
1718538991613,2cyclictest1725056-21kthreadcore19:15:021
1718538991613,2cyclictest1485-21polkitd20:20:011
1718538991610,5cyclictest2043492-21/usr/sbin/munin23:05:181
1718538991610,5cyclictest1959746-21kthreadcore22:10:231
1718538991610,5cyclictest1959746-21kthreadcore22:10:231
1718538991610,3cyclictest191rcu_preempt22:37:581
171853699165,6cyclictest0-21swapper/019:12:350
1718536991614,2cyclictest1971439-21kworker/0:1+events_freezable_power_22:39:420
1718536991613,2cyclictest2140777-21kthreadcore00:05:190
1718536991613,2cyclictest2123054-21latency_hist23:55:010
1718536991613,2cyclictest1517-21wpa_supplicant21:31:560
1718536991613,2cyclictest1502-21systemd-logind23:45:010
1718536991613,2cyclictest1502-21systemd-logind23:45:010
1718536991613,2cyclictest1502-21systemd-logind21:05:020
1718536991613,2cyclictest1-21systemd23:10:010
1718536991613,2cyclictest0-21swapper/021:45:010
1718536991613,2cyclictest0-21swapper/021:15:020
1718536991613,2cyclictest0-21swapper/000:30:010
1718536991612,3cyclictest1451-21avahi-daemon00:20:010
1718536991612,3cyclictest1451-21avahi-daemon00:20:000
1718542991513,1cyclictest0-21swapper/222:39:432
1718542991513,1cyclictest0-21swapper/219:11:022
1718542991512,1cyclictest0-21swapper/222:55:012
1718542991512,1cyclictest0-21swapper/221:12:102
1718542991512,1cyclictest0-21swapper/219:55:172
1718542991512,1cyclictest0-21swapper/200:30:222
171853899157,1cyclictest191rcu_preempt23:23:061
171853899153,3cyclictest1772282-21latency_hist19:55:011
1718538991512,2cyclictest2029713-21kthreadcore22:55:171
1718538991512,2cyclictest2020383-21cut22:50:201
1718538991512,2cyclictest2015598-21kthreadcore22:45:211
1718538991512,2cyclictest1910777-21kthreadcore21:40:211
1718538991512,2cyclictest1884583-21kthreadcore21:25:201
1718538991512,2cyclictest1841825-21/usr/sbin/munin20:55:221
1718538991512,2cyclictest1485-21polkitd19:30:011
1718538991511,3cyclictest2149376-21kthreadcore00:10:181
1718538991511,3cyclictest1858728-21diskmemload23:29:481
171853699157,7cyclictest2165260-21tr00:20:170
171853699155,6cyclictest0-21swapper/022:33:260
171853699155,6cyclictest0-21swapper/020:26:410
171853699154,6cyclictest0-21swapper/019:35:430
171853699154,2cyclictest2016500-21switchtime22:45:280
1718536991514,1cyclictest1866918-21kworker/0:1+events_freezable_power_21:22:500
1718536991513,2cyclictest1732225-21kworker/0:2+events_freezable_power_19:43:590
1718536991512,2cyclictest25776-21rtkit-daemon22:22:560
1718536991512,2cyclictest25776-21rtkit-daemon00:00:360
1718536991512,2cyclictest2187284-21munin-plugin-st00:35:010
1718536991512,2cyclictest2109137-21kthreadcore23:45:210
1718536991512,2cyclictest2059825-21sh23:15:130
1718536991512,2cyclictest1963536-21/usr/sbin/munin22:15:010
1718536991512,2cyclictest1963536-21/usr/sbin/munin22:15:010
1718536991512,2cyclictest1763681-21sort19:45:200
1718536991511,3cyclictest2072074-21pmu-power23:20:230
1718536991511,3cyclictest2044249-21kworker/u8:2-nfsiod23:55:180
1718536991511,3cyclictest1943365-21kthreadcore22:00:200
1718536991511,3cyclictest1846358-21pmu-power20:55:220
1718542991411,1cyclictest0-21swapper/221:05:252
1718542991410,2cyclictest0-21swapper/223:20:002
171853899147,2cyclictest481rcuop/223:51:531
171853899145,2cyclictest471rcuog/220:45:111
1718538991411,2cyclictest2053706-21kthreadcore23:10:181
1718538991411,2cyclictest1988140-21sh22:30:141
1718538991411,2cyclictest1976549-21sh22:20:281
1718538991411,2cyclictest1965166-21kthreadcore22:15:181
1718538991411,2cyclictest1874971-21latency_hist21:20:021
1718538991411,2cyclictest1863913-21mailstats21:10:221
1718538991411,2cyclictest1853079-21systemd-run21:05:001
1718538991411,2cyclictest1825612-21kthreadcore20:40:181
1718538991411,2cyclictest1819118-21head20:35:191
1718538991411,2cyclictest1814779-21kthreadcore20:30:191
1718538991411,2cyclictest1802657-21runrttasks20:20:191
1718538991411,2cyclictest1790395-21gltestperf20:10:171
1718538991411,2cyclictest1778543-21cpuspeed_turbos20:00:121
1718538991411,2cyclictest1751464-21kthreadcore19:35:201
1718538991411,2cyclictest1718529-21cyclictest23:33:461
1718538991410,3cyclictest1979873-21cpuspeed_turbos22:25:111
1718538991410,3cyclictest1808631-21kthreadcore20:25:161
1718538991410,3cyclictest1784587-21fschecks_time20:05:151
1718538991410,3cyclictest1734073-21kthreadcore19:20:211
1718538991410,3cyclictest1725501-21kthreadcore19:15:011
171853899140,3cyclictest0-21swapper/121:07:281
171853699143,2cyclictest471rcuog/220:20:190
1718536991412,2cyclictest1947260-21kworker/0:2+events_freezable_power_22:06:460
1718536991412,2cyclictest1732225-21kworker/0:2+events_freezable_power_20:16:560
1718536991412,2cyclictest1732225-21kworker/0:2+events_freezable_power_19:33:000
1718536991411,2cyclictest38054-21packagekitd23:28:210
1718536991411,2cyclictest1899876-21gltestperf21:35:160
1718536991411,2cyclictest1858950-21systemd-run21:10:020
1718536991411,2cyclictest1840161-21kthreadcore20:50:180
1718536991411,2cyclictest1775118-21kthreadcore19:55:190
1718536991411,2cyclictest1771484-21rt-features19:50:240
1718536991411,2cyclictest1735712-21kthreadcore19:20:230
1718536991411,2cyclictest1-21systemd00:40:010
1718536991411,2cyclictest0-21swapper/020:15:010
1718536991410,3cyclictest1966387-21kthreadcore22:15:190
1718536991410,3cyclictest1819558-21irqrtprio20:35:220
1718536991410,3cyclictest1817321-21pmu-power20:30:220
171853699140,4cyclictest2094755-21kthreadcore23:35:210
1718542991310,1cyclictest0-21swapper/223:55:532
1718542991310,1cyclictest0-21swapper/223:22:452
1718542991310,1cyclictest0-21swapper/222:40:202
1718542991310,1cyclictest0-21swapper/221:31:592
1718542991310,1cyclictest0-21swapper/220:10:282
1718542991310,1cyclictest0-21swapper/220:00:172
1718538991310,2cyclictest2036728-21kthreadcore23:00:191
1718536991310,2cyclictest2004836-21kthreadcore22:40:190
1718536991310,2cyclictest1924470-21kthreadcore21:50:200
1718536991310,2cyclictest1784917-21irqcore20:05:180
171854299129,1cyclictest0-21swapper/220:40:222
1718542991210,1cyclictest0-21swapper/222:20:312
171853699129,2cyclictest1783868-21true20:05:010
171853899118,2cyclictest0-21swapper/119:09:591
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional