You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-25 - 04:53
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackeslot2.osadl.org (updated Thu Jul 25, 2024 00:43:57)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
417955121980,1sleep30-21swapper/323:40:003
379871621270,2sleep30-21swapper/319:15:243
38228032330,3chrt3822806-21proc_pri19:35:221
3785638992421,1cyclictest0-21swapper/200:00:012
2376191240,5ptp4l164990irq/125-enp1s0-TxRx-022:11:513
2376191240,5ptp4l164990irq/125-enp1s0-TxRx-021:54:393
2376191240,5ptp4l164990irq/125-enp1s0-TxRx-021:19:273
2376191240,5ptp4l164990irq/125-enp1s0-TxRx-000:23:133
2376191240,4ptp4l164990irq/125-enp1s0-TxRx-023:26:343
2376191240,4ptp4l164990irq/125-enp1s0-TxRx-000:10:393
2376191240,4ptp4l164990irq/125-enp1s0-TxRx-000:07:143
2376191240,4ptp4l164990irq/125-enp1s0-TxRx-000:07:133
2376191230,6ptp4l164990irq/125-enp1s0-TxRx-022:52:513
2376191230,5ptp4l164990irq/125-enp1s0-TxRx-022:38:163
2376191230,5ptp4l164990irq/125-enp1s0-TxRx-022:06:263
2376191230,5ptp4l164990irq/125-enp1s0-TxRx-020:15:283
2376191230,4ptp4l164990irq/125-enp1s0-TxRx-023:18:533
2376191230,3ptp4l164990irq/125-enp1s0-TxRx-023:55:533
2376191230,3ptp4l164990irq/125-enp1s0-TxRx-022:21:543
2376191230,3ptp4l164990irq/125-enp1s0-TxRx-021:28:343
2376191230,3ptp4l164990irq/125-enp1s0-TxRx-000:38:493
2376191230,3ptp4l164990irq/125-enp1s0-TxRx-000:17:203
2376191230,2ptp4l0-21swapper/319:10:203
2376191230,11ptp4l164990irq/125-enp1s0-TxRx-000:29:553
419416822218,2sleep20-21swapper/223:46:212
416997822218,2sleep20-21swapper/223:32:352
415608022218,2sleep20-21swapper/223:25:162
413714722218,2sleep20-21swapper/223:13:032
412995422218,2sleep20-21swapper/223:09:582
411959622218,2sleep20-21swapper/223:01:002
410624722218,2sleep20-21swapper/222:55:152
410289122218,2sleep20-21swapper/222:50:422
409525622218,2sleep20-21swapper/222:46:532
408621722218,2sleep20-21swapper/222:40:282
408621722218,2sleep20-21swapper/222:40:282
407854622218,2sleep20-21swapper/222:37:082
401123122218,2sleep20-21swapper/221:56:032
400351022218,2sleep20-21swapper/221:52:032
399477222218,2sleep20-21swapper/221:46:092
398762522218,2sleep20-21swapper/221:43:172
394484222218,2sleep20-21swapper/221:15:392
393737922218,2sleep20-21swapper/221:12:152
392395622218,2sleep20-21swapper/221:00:282
388819922218,2sleep20-21swapper/220:30:592
3785637992219,2cyclictest18938-21apt-key00:00:011
3785636992219,2cyclictest3791819-21cstates19:15:010
2777322218,2sleep20-21swapper/200:05:172
2777322218,2sleep20-21swapper/200:05:172
2681922218,2sleep20-21swapper/200:04:052
2376191220,5ptp4l164990irq/125-enp1s0-TxRx-023:21:333
2376191220,5ptp4l164990irq/125-enp1s0-TxRx-021:32:113
2376191220,5ptp4l164990irq/125-enp1s0-TxRx-000:34:113
2376191220,4ptp4l164990irq/125-enp1s0-TxRx-023:14:043
2376191220,4ptp4l164990irq/125-enp1s0-TxRx-022:41:583
2376191220,4ptp4l164990irq/125-enp1s0-TxRx-022:41:583
2376191220,4ptp4l164990irq/125-enp1s0-TxRx-022:28:393
2376191220,3ptp4l164990irq/125-enp1s0-TxRx-023:03:383
2376191220,3ptp4l164990irq/125-enp1s0-TxRx-022:18:083
2376191220,3ptp4l164990irq/125-enp1s0-TxRx-021:49:503
5231922117,2sleep20-21swapper/200:37:402
4846222117,2sleep20-21swapper/200:31:022
418632822117,2sleep20-21swapper/223:42:132
391216022118,2sleep20-21swapper/220:52:152
390622322118,2sleep20-21swapper/220:46:452
389498822118,2sleep20-21swapper/220:40:042
388235622118,2sleep20-21swapper/220:26:262
387063622118,2sleep20-21swapper/220:17:282
384703322118,2sleep20-21swapper/219:57:282
384124722118,2sleep20-21swapper/219:53:192
380541922118,2sleep20-21swapper/219:21:292
379920922118,2sleep20-21swapper/219:16:122
379118922118,2sleep20-21swapper/219:11:272
3785637992118,2cyclictest3882747-21systemd-run20:30:001
3785636992119,1cyclictest4187886-21cat23:45:000
2376191210,4ptp4l164990irq/125-enp1s0-TxRx-023:07:113
2376191210,4ptp4l164990irq/125-enp1s0-TxRx-022:30:193
2376191210,4ptp4l164990irq/125-enp1s0-TxRx-021:14:563
2376191210,3ptp4l164990irq/125-enp1s0-TxRx-023:42:463
2376191210,3ptp4l164990irq/125-enp1s0-TxRx-022:47:083
2376191210,3ptp4l164990irq/125-enp1s0-TxRx-021:56:203
1938622117,2sleep30-21swapper/300:00:053
417712122017,2sleep20-21swapper/223:35:342
391838622017,2sleep20-21swapper/220:58:392
389431122017,2sleep20-21swapper/220:35:352
381767322017,2sleep20-21swapper/219:33:562
3785637992017,2cyclictest4080551-21/usr/sbin/munin22:40:011
3785637992017,2cyclictest3924773-21apt-key21:05:011
3785637992017,2cyclictest30356-21latency_hist00:10:001
3785637992017,2cyclictest30356-21latency_hist00:10:001
3785637992016,3cyclictest0-21swapper/122:00:001
2376191200,6ptp4l164990irq/125-enp1s0-TxRx-019:25:013
2376191200,4ptp4l164990irq/125-enp1s0-TxRx-023:53:193
2376191200,4ptp4l164990irq/125-enp1s0-TxRx-023:49:553
2376191200,4ptp4l164990irq/125-enp1s0-TxRx-020:10:013
2376191200,4ptp4l164990irq/125-enp1s0-TxRx-019:55:173
2376191200,3ptp4l164990irq/125-enp1s0-TxRx-022:55:133
2376191200,3ptp4l164990irq/125-enp1s0-TxRx-021:20:203
2376191200,2ptp4l0-21swapper/320:10:233
3785637991916,2cyclictest4171527-21sh23:35:011
3785637991916,2cyclictest1384-1atopacctd20:35:151
3785637991916,2cyclictest0-21swapper/119:20:011
3785637991914,4cyclictest4140751-21kthreadcore23:15:191
3785637991914,4cyclictest1453-21in:imuxsock21:39:551
3785637991913,5cyclictest4043589-21/usr/sbin/munin22:15:241
3785636991917,1cyclictest27403-21latency_hist00:05:000
3785636991916,2cyclictest4155143-21/usr/sbin/munin23:25:120
3785636991913,4cyclictest4143308-21needreboot23:15:210
23762911913,2phc2sys0-21swapper/320:01:223
23762911913,2phc2sys0-21swapper/319:50:123
2376191190,5ptp4l164990irq/125-enp1s0-TxRx-020:54:273
2376191190,5ptp4l164990irq/125-enp1s0-TxRx-020:27:543
2376191190,4ptp4l164990irq/125-enp1s0-TxRx-019:40:123
2376191190,3ptp4l164990irq/125-enp1s0-TxRx-022:00:223
2376191190,3ptp4l164990irq/125-enp1s0-TxRx-021:00:193
2376191190,3ptp4l164990irq/125-enp1s0-TxRx-020:38:093
2376191190,3ptp4l164990irq/125-enp1s0-TxRx-020:32:283
2376191190,3ptp4l164990irq/125-enp1s0-TxRx-019:35:143
2376191190,2ptp4l164990irq/125-enp1s0-TxRx-021:36:403
2376191190,2ptp4l0-21swapper/321:41:203
2376191190,1ptp4l0-21swapper/323:31:133
2376191190,1ptp4l0-21swapper/319:45:153
3785638991816,1cyclictest0-21swapper/222:25:022
3785637991814,3cyclictest3899666-21pmu-power20:40:231
3785637991812,5cyclictest4060668-21/usr/sbin/munin22:25:241
3785636991815,2cyclictest4173088-21kthreadcore23:35:190
3785636991815,2cyclictest4098639-21irqrtprio22:50:180
3785636991815,2cyclictest4088977-21cut22:45:020
3785636991815,2cyclictest4088977-21cut22:45:020
3785636991815,2cyclictest4080544-21apt-key22:40:010
3785636991815,2cyclictest4016895-21kthreadcore22:00:240
3785636991815,2cyclictest3879776-21kthreadcore20:25:200
3785636991815,2cyclictest36364-21turbostat.cron00:20:000
3785636991815,2cyclictest30502-21systemd-run00:10:010
3785636991815,2cyclictest30502-21systemd-run00:10:010
3785636991815,2cyclictest18848-21apt-key00:00:010
3785636991814,3cyclictest4050040-21kthreadcore22:20:200
3785636991814,3cyclictest1386-21dbus-daemon20:05:010
3785636991814,2cyclictest252-21systemd-journal21:25:010
2376191180,6ptp4l164990irq/125-enp1s0-TxRx-020:55:113
2376191180,5ptp4l164990irq/125-enp1s0-TxRx-020:40:533
2376191180,5ptp4l164990irq/125-enp1s0-TxRx-020:22:173
2376191180,4ptp4l164990irq/125-enp1s0-TxRx-019:34:413
2376191180,4ptp4l164990irq/125-enp1s0-TxRx-019:29:443
2376191180,3ptp4l164990irq/125-enp1s0-TxRx-019:05:223
3785638991714,1cyclictest0-21swapper/222:35:012
3785637991714,2cyclictest4015489-21sed22:00:231
3785637991714,2cyclictest3931388-21tr21:10:201
3785637991714,2cyclictest1450-21systemd-logind00:05:001
3785637991714,2cyclictest0-21swapper/119:50:001
3785637991713,3cyclictest4109220-21kthreadcore22:55:201
3785637991713,3cyclictest3917441-21missed_timers20:55:211
3785637991712,4cyclictest4191858-21kthreadcore23:45:211
3785636991715,1cyclictest4071640-21cron22:35:000
3785636991714,2cyclictest4189432-21ps23:45:190
3785636991714,2cyclictest4133188-21kthreadcore23:10:210
3785636991714,2cyclictest4114696-21head23:00:170
3785636991714,2cyclictest4090468-21kthreadcore22:45:180
3785636991714,2cyclictest40865-21kthreadcore00:20:210
3785636991714,2cyclictest4060281-21pmu-power22:25:210
3785636991714,2cyclictest4040347-21kthreadcore22:15:220
3785636991714,2cyclictest4032353-21kthreadcore22:10:180
3785636991714,2cyclictest4024785-21kthreadcore22:05:200
3785636991714,2cyclictest3997594-21tr21:50:150
3785636991714,2cyclictest3989116-21aten_repower_fr21:45:130
3785636991714,2cyclictest3940731-21kernelversion21:15:250
3785636991714,2cyclictest3912436-21apt-key20:55:010
3785636991714,2cyclictest3895286-21cpuspeed_turbos20:40:140
3785636991714,2cyclictest3872494-21kthreadcore20:20:200
3785636991714,2cyclictest3866255-21irqcore20:15:210
3785636991714,2cyclictest3844382-21kthreadcore19:55:180
3785636991714,2cyclictest3837845-21kthreadcore19:50:210
3785636991714,2cyclictest3834571-21pmu-power19:45:230
3785636991714,2cyclictest3826712-21kthreadcore19:40:210
3785636991714,2cyclictest3808670-21kthreadcore19:25:200
3785636991714,2cyclictest3802819-21kthreadcore19:20:170
3785636991714,2cyclictest3792008-21kthreadcore19:15:030
3785636991714,2cyclictest3785634-21cyclictest23:50:180
3785636991714,2cyclictest3785537-21kworker/0:2+events_freezable_power_20:05:540
3785636991714,2cyclictest252-21systemd-journal21:05:010
3785636991714,2cyclictest1453-21in:imuxsock21:40:010
3785636991713,3cyclictest4009400-21kthreadcore21:55:230
3785636991712,4cyclictest3932908-21kthreadcore21:10:390
2376191170,1ptp4l0-21swapper/320:45:033
3785638991614,1cyclictest0-21swapper/222:28:412
3785638991614,1cyclictest0-21swapper/222:00:242
378563799169,2cyclictest0-21swapper/100:11:381
3785637991613,2cyclictest4154779-21latency_hist23:25:011
3785637991613,2cyclictest4047841-21fschecks_count22:20:151
3785637991613,2cyclictest4026384-21kthreadcore22:05:211
3785637991613,2cyclictest3864934-21cron20:15:011
3785637991613,2cyclictest18738-21kworker/u8:3-xprtiod00:30:011
3785637991613,2cyclictest0-21swapper/123:35:181
3785637991613,2cyclictest0-21swapper/122:50:011
3785637991613,2cyclictest0-21swapper/121:55:001
3785637991612,3cyclictest4159875-21needreboot23:25:201
3785637991612,3cyclictest3994053-21mailstats21:45:291
3785637991612,3cyclictest3986066-21unixbench_singl21:40:281
3785637991612,3cyclictest3850818-21kthreadcore20:00:211
3785637991612,3cyclictest1384-1atopacctd20:50:211
3785636991613,2cyclictest4168506-21switchtime23:30:240
3785636991613,2cyclictest4122549-21cstates23:05:130
3785636991613,2cyclictest4108431-21kthreadcore22:55:210
3785636991613,2cyclictest3983677-21kthreadcore21:40:200
3785636991613,2cyclictest3905298-21kthreadcore20:45:210
3785636991613,2cyclictest3891800-21kthreadcore20:35:230
3785636991613,2cyclictest3862066-21kthreadcore20:10:220
2376191160,1ptp4l0-21swapper/321:05:193
3785638991513,1cyclictest0-21swapper/222:05:152
3785638991513,1cyclictest0-21swapper/221:35:012
3785638991513,1cyclictest0-21swapper/221:20:152
3785638991513,1cyclictest0-21swapper/220:00:272
3785638991513,1cyclictest0-21swapper/200:15:012
3785638991512,1cyclictest0-21swapper/222:15:182
3785638991512,1cyclictest0-21swapper/221:39:522
3785638991512,1cyclictest0-21swapper/220:25:002
3785638991512,1cyclictest0-21swapper/200:25:002
378563799158,6cyclictest0-21swapper/121:15:131
378563799158,2cyclictest0-21swapper/100:30:441
378563799158,2cyclictest0-21swapper/100:17:221
3785637991512,2cyclictest4125690-21kthreadcore23:05:191
3785637991512,2cyclictest3948661-21grep21:20:221
3785637991512,2cyclictest3930647-21latency_hist21:10:001
3785637991512,2cyclictest3888795-21apt-config20:35:011
3785637991512,2cyclictest3786622-21gltestperf19:10:161
3785637991512,2cyclictest1421-21polkitd19:55:221
3785637991512,2cyclictest0-21swapper/120:10:011
3785637991511,3cyclictest3871216-21aten_repower_cu20:20:121
3785637991511,3cyclictest3827729-21kthreadcore19:40:211
3785637991511,3cyclictest3809374-21kthreadcore19:25:201
3785636991512,2cyclictest4148910-21kthreadcore23:20:190
3785636991512,2cyclictest3925640-21fschecks_time21:05:230
3785636991512,2cyclictest3913001-21aten_repower_cu20:55:120
3785636991512,2cyclictest3883928-21irqcore20:30:170
3785636991512,2cyclictest3822136-21kthreadcore19:35:190
3785636991512,2cyclictest3813930-21kthreadcore19:30:180
3785636991512,2cyclictest252-21systemd-journal00:39:540
3785636991511,3cyclictest3965605-21kthreadcore21:30:200
3785638991412,1cyclictest0-21swapper/223:50:242
3785638991412,1cyclictest0-21swapper/221:25:112
3785638991411,1cyclictest0-21swapper/223:20:182
3785638991411,1cyclictest0-21swapper/222:10:102
3785638991411,1cyclictest0-21swapper/221:05:462
3785638991411,1cyclictest0-21swapper/220:10:222
3785638991411,1cyclictest0-21swapper/219:25:202
378563799149,2cyclictest5161-21kthreadcore23:50:181
378563799148,5cyclictest4101977-21latency22:50:211
378563799148,5cyclictest0-21swapper/120:15:131
378563799148,2cyclictest0-21swapper/123:40:161
378563799147,2cyclictest0-21swapper/100:35:091
3785637991411,2cyclictest4064404-21fschecks_count22:30:151
3785637991411,2cyclictest4030786-21aten_repower_po22:10:101
3785637991411,2cyclictest3817769-21latency_hist19:35:021
3785637991411,2cyclictest3802378-21kthreadcore19:20:171
3785637991411,2cyclictest3785644-21sh19:10:011
3785637991410,3cyclictest4116699-21kthreadcore23:00:201
3785637991410,3cyclictest40458-21kthreadcore00:20:211
3785637991410,3cyclictest3965000-21gltestperf21:30:171
3785637991410,3cyclictest3902241-21kthreadcore20:45:191
3785636991411,2cyclictest3957278-21kthreadcore21:25:170
3785638991311,1cyclictest0-21swapper/223:15:192
3785638991311,1cyclictest0-21swapper/220:05:542
3785638991310,1cyclictest0-21swapper/219:45:212
3785638991310,1cyclictest0-21swapper/219:40:212
378563799139,3cyclictest3957988-21kthreadcore21:25:171
378563799137,5cyclictest0-21swapper/123:10:131
378563799136,6cyclictest0-21swapper/122:40:021
378563799136,6cyclictest0-21swapper/122:40:021
3785637991310,2cyclictest3838827-21kthreadcore19:50:221
378563699137,5cyclictest18738-21kworker/u8:3+nfsiod00:27:500
378563699133,6cyclictest0-21swapper/000:33:240
378563899129,1cyclictest0-21swapper/200:28:412
378563699125,5cyclictest30995-21sh00:10:410
378563899118,1cyclictest0-21swapper/219:35:112
378563899113,6cyclictest358742sleep200:19:082
686398100,4rtkit-daemon3779965-21apt-get19:05:110
37856389997,1cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional