You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-26 - 10:35
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System (updated Wed Nov 26, 2025 00:44:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
319657199106102,3cyclictest3281386-21kworker/u8:0+events_unbound00:04:011
31965719910085,12cyclictest3258278-21latency_hist22:20:001
3196565999787,7cyclictest3250060-21latency_hist21:55:010
3196571999285,6cyclictest3266500-21kworker/u8:2+events_unbound23:00:011
3196571999285,6cyclictest3266500-21kworker/u8:2+events_unbound23:00:001
3196571998783,3cyclictest3183812-21kworker/u8:1+flush-179:019:20:241
3196571998680,5cyclictest3251625-21kworker/u8:2+flush-179:022:05:261
3196571998679,5cyclictest3228839-21kworker/u8:0+flush-179:021:20:011
3196565998475,7cyclictest3290921-40mandb00:00:010
3196571998368,14cyclictest3214043-21kworker/u8:2+flush-179:020:40:001
3196571998276,5cyclictest3251625-21kworker/u8:2+events_unbound22:20:021
3196565998272,8cyclictest3215592-21latency_hist20:10:010
3196571998168,4cyclictest3207618-21kworker/u8:1+events_unbound20:20:141
3196565998066,12cyclictest3254844-21apt-get22:10:000
3196571997975,3cyclictest3214043-21kworker/u8:2+flush-179:020:10:271
3196571997873,4cyclictest3266500-21kworker/u8:2+flush-179:023:15:261
3196571997772,4cyclictest3281386-21kworker/u8:0+events_unbound00:05:241
3196571997772,4cyclictest3259011-21kworker/u8:0+flush-179:022:30:211
3196571997570,4cyclictest3241573-21kworker/u8:3+flush-179:021:30:271
3196571997468,5cyclictest3214043-21kworker/u8:2+flush-179:020:55:011
3196571997363,7cyclictest3281386-21kworker/u8:0+events_unbound23:40:191
3196571997362,8cyclictest3248473-21latency_hist21:50:011
3196565997363,7cyclictest3221130-21/usr/sbin/munin20:25:240
3196571997267,4cyclictest3197535-21kworker/u8:0+events_unbound19:35:251
3196571997258,4cyclictest3214043-21kworker/u8:2+events_unbound20:45:151
3196565997262,7cyclictest3212407-21latency_hist20:00:020
3196573997136,33cyclictest0-21swapper/221:50:592
3196571997166,4cyclictest3283989-21kworker/u8:3+events_unbound23:35:241
3196571997164,5cyclictest3214043-21kworker/u8:2+events_unbound20:25:221
3196571997061,3cyclictest3197535-21kworker/u8:0+events_unbound19:30:261
3196571996964,4cyclictest3197535-21kworker/u8:0+flush-179:019:55:241
3196571996856,9cyclictest3290921-40mandb00:00:001
3196565996857,8cyclictest3264913-21latency_hist22:40:010
3196571996762,4cyclictest3260176-21kworker/u8:3+events_unbound23:20:231
3196571996762,4cyclictest3260176-21kworker/u8:3+events_unbound23:20:221
3196571996757,4cyclictest3255337-21kworker/u8:1+events_unbound22:10:271
3196565996657,6cyclictest3214043-21kworker/u8:2+events_unbound20:20:000
3196571996561,3cyclictest3243671-21kworker/u8:0+flush-179:022:00:241
3196571996556,7cyclictest3271790-21/usr/sbin/munin23:00:241
3196571996556,3cyclictest3197535-21kworker/u8:0+events_unbound19:15:221
3196571996460,3cyclictest3228839-21kworker/u8:0+flush-179:021:10:221
3196571996460,3cyclictest3214043-21kworker/u8:2+flush-179:021:05:201
3196571996459,4cyclictest3207875-21kworker/u8:2+events_unbound19:45:241
3196571996458,5cyclictest3281386-21kworker/u8:0+flush-179:000:14:561
3196571996458,5cyclictest3281386-21kworker/u8:0+flush-179:000:14:551
3196574996359,2cyclictest0-21swapper/323:43:593
3196571996359,3cyclictest3225636-21kworker/u8:0+flush-179:020:40:131
3196571996359,3cyclictest3221435-21kworker/u8:0+events_unbound20:30:251
3196571996358,4cyclictest3260176-21kworker/u8:3+flush-179:023:10:231
3196571996257,4cyclictest3228839-21kworker/u8:0+flush-179:021:04:551
3196565996254,5cyclictest3277953-21kworker/u8:1+flush-179:023:35:220
3196571996155,4cyclictest3240755-21kworker/u8:1+events_unbound21:40:141
3196565996155,4cyclictest3214043-21kworker/u8:2+flush-179:021:10:000
3196571996056,3cyclictest3266500-21kworker/u8:2+flush-179:023:30:211
3196571996052,5cyclictest3251660-21latency_hist22:00:011
3196571995955,3cyclictest3263352-21kworker/u8:1+events_unbound22:45:221
3196571995954,4cyclictest3295779-21kworker/u8:3+flush-179:000:25:271
3196571995954,4cyclictest3243671-21kworker/u8:0+flush-179:021:50:231
3196571995953,4cyclictest3207618-21kworker/u8:1+flush-179:020:15:211
3196571995950,7cyclictest3302163-21latency_hist00:35:011
3196571995946,11cyclictest3266500-21kworker/u8:2+flush-179:023:30:001
3196571995854,3cyclictest3197535-21kworker/u8:0+flush-179:019:40:251
3196571995853,4cyclictest3281386-21kworker/u8:0+events_unbound00:15:201
3196565995850,5cyclictest3289303-21latency_hist23:55:000
3196571995753,3cyclictest3260176-21kworker/u8:3+flush-179:023:05:161
3196571995752,4cyclictest3183812-21kworker/u8:1+flush-179:019:25:231
3196571995742,11cyclictest3269685-21latency_hist22:55:021
3196571995652,3cyclictest3259011-21kworker/u8:0+flush-179:022:29:561
3196565995652,2cyclictest723-21Xorg23:43:590
3196571995546,3cyclictest3260176-21kworker/u8:3+events_unbound22:35:201
3196565995544,9cyclictest3222738-21apt-get20:30:120
3196571995450,3cyclictest3228839-21kworker/u8:0+flush-179:021:25:201
3196571995450,3cyclictest3214043-21kworker/u8:2+flush-179:021:20:211
3196565995346,5cyclictest3239188-21apt-get21:20:140
3196565995343,6cyclictest3183812-21kworker/u8:1+events_unbound19:10:250
3196565995247,3cyclictest3197535-21kworker/u8:0+events_unbound19:55:000
3196565995245,5cyclictest3251625-21kworker/u8:2+flush-179:022:20:180
3196565995242,8cyclictest3261729-21latency_hist22:30:000
3196565995242,7cyclictest3220635-21latency_hist20:25:010
3196571995147,3cyclictest3207875-21kworker/u8:2+flush-179:019:50:121
3196571995146,4cyclictest3240755-21kworker/u8:1+flush-179:021:39:561
3196565995143,6cyclictest3241573-21kworker/u8:3+flush-179:021:30:000
3196565995142,6cyclictest3228884-21kworker/u8:3+flush-179:020:50:250
319656599511,6cyclictest3269698-21apt-get22:55:030
319656599511,6cyclictest3269698-21apt-get22:55:020
3196571994944,4cyclictest3193639-21kworker/u8:2+flush-179:019:10:141
3196571994940,3cyclictest3207618-21kworker/u8:1+events_unbound20:04:551
3196571994939,7cyclictest3214246-21/usr/sbin/munin20:05:231
3196565994941,4cyclictest3228884-21kworker/u8:3+events_unbound20:50:010
3196565994939,8cyclictest3265180-21apt-get22:40:130
3196565994925,21cyclictest3280649-21missed_timers23:25:190
3196574994846,1cyclictest0-21swapper/319:10:593
3196571994843,4cyclictest3281386-21kworker/u8:0+flush-179:000:24:561
3196571994842,5cyclictest3302420-21apt-get00:35:131
3196565994845,2cyclictest3197535-21kworker/u8:0+events_unbound19:30:000
3196565994837,7cyclictest3295779-21kworker/u8:3+events_unbound00:30:240
3196565994738,6cyclictest3260176-21kworker/u8:3+flush-179:022:45:160
3196565994725,4cyclictest3237065-21cut21:15:010
3196565994626,18cyclictest3201267-21cron19:25:010
3196565994625,1cyclictest0-21swapper/020:55:130
3196565994620,23cyclictest0-21swapper/019:46:590
4670791450,13ptp4l441ktimers/319:10:003
3196565994536,7cyclictest3240755-21kworker/u8:1+flush-179:021:40:010
3196565994527,15cyclictest3291192-21apt-get00:00:180
319656599450,43cyclictest723-21Xorg00:07:590
3196574994434,1cyclictest0-21swapper/320:04:583
3196571994439,4cyclictest3228884-21kworker/u8:3+flush-179:020:59:561
3196565994435,6cyclictest3246868-21kworker/u8:3+flush-179:021:45:230
3196565994421,3cyclictest0-21swapper/022:15:200
3196571994338,4cyclictest3281386-21kworker/u8:0+events_unbound23:49:321
3196565994330,10cyclictest3260176-21kworker/u8:3+flush-179:023:20:180
3196565994330,10cyclictest3260176-21kworker/u8:3+flush-179:023:20:180
3196565994326,2cyclictest723-21Xorg20:04:580
3196565994320,4cyclictest3274514-21timerwakeupswit23:05:280
319656599430,40cyclictest3276565-21apt-get23:15:140
3196565994222,2cyclictest723-21Xorg00:14:590
3196565994222,2cyclictest723-21Xorg00:14:580
3196574994139,1cyclictest0-21swapper/300:35:593
3196571994136,4cyclictest3281386-21kworker/u8:0+events_unbound23:53:331
319656599411,38cyclictest3300570-21munin-run00:30:000
319656599410,39cyclictest723-21Xorg19:41:000
319656599410,39cyclictest723-21Xorg00:20:590
319657499400,38cyclictest3215612-21turbostat20:10:003
319657499400,1cyclictest0-21swapper/319:36:583
319657399400,1cyclictest0-21swapper/223:44:562
319656599400,3cyclictest3269698-21apt-get22:55:010
3196565993935,3cyclictest723-21Xorg19:36:590
3196565993935,3cyclictest3303764-21munin-run00:40:000
3196565993932,5cyclictest3266500-21kworker/u8:2+flush-179:023:05:010
3196565993929,7cyclictest3197535-21kworker/u8:0+flush-179:019:30:220
319656599390,37cyclictest723-21Xorg22:13:000
3196574993836,1cyclictest0-21swapper/323:17:583
319657499380,37cyclictest3298988-21turbostat00:25:003
3196573993835,2cyclictest0-21swapper/221:07:592
319657199380,37cyclictest0-21swapper/122:44:591
319656599382,31cyclictest3286387-21apt-get23:45:130
319656599380,37cyclictest0-21swapper/023:14:550
319656599380,37cyclictest0-21swapper/021:35:000
319656599380,2cyclictest723-21Xorg21:16:590
3196574993734,2cyclictest0-21swapper/323:34:543
3196574993734,2cyclictest0-21swapper/320:23:593
319657499370,36cyclictest0-21swapper/320:33:593
3196573993734,2cyclictest0-21swapper/221:16:002
3196573993734,2cyclictest0-21swapper/220:26:592
319656599370,1cyclictest0-21swapper/020:38:590
3196574993634,1cyclictest0-21swapper/322:11:593
3196574993633,2cyclictest0-21swapper/321:01:593
3196574993632,2cyclictest0-21swapper/321:24:593
319657499360,35cyclictest0-21swapper/321:39:593
3196573993633,2cyclictest0-21swapper/221:43:592
3196573993632,2cyclictest0-21swapper/223:00:582
319657399360,1cyclictest0-21swapper/223:59:592
319657399360,1cyclictest0-21swapper/219:34:552
3196565993633,2cyclictest0-21swapper/023:34:580
319656599363,29cyclictest3198329-21apt-get19:15:110
3196565993630,4cyclictest3289281-21kworker/u8:2+flush-179:000:20:000
3196574993533,1cyclictest0-21swapper/322:19:593
3196574993532,2cyclictest0-21swapper/322:39:593
3196573993532,2cyclictest0-21swapper/222:44:002
3196573993532,2cyclictest0-21swapper/222:14:552
3196573993531,2cyclictest0-21swapper/222:54:552
319657399350,1cyclictest0-21swapper/223:20:592
319657399350,1cyclictest0-21swapper/223:20:582
3196565993533,1cyclictest0-21swapper/021:04:550
3196565993527,6cyclictest3250041-21kworker/u8:1+events_unbound21:55:240
3196574993432,1cyclictest0-21swapper/320:50:593
3196574993432,1cyclictest0-21swapper/300:33:003
3196574993431,2cyclictest0-21swapper/323:12:003
3196574993431,2cyclictest0-21swapper/319:56:003
3196573993330,2cyclictest0-21swapper/219:56:592
3196565993327,4cyclictest3227348-21latency_hist20:45:010
3196574993230,1cyclictest0-21swapper/321:26:593
3196574993226,4cyclictest3238666-21turbostat21:20:003
3196573993230,1cyclictest0-21swapper/222:09:592
3196573993230,1cyclictest0-21swapper/220:58:592
3196573993229,2cyclictest0-21swapper/223:27:002
3196573993229,2cyclictest0-21swapper/219:41:592
3196573993229,2cyclictest0-21swapper/200:38:002
3196574993129,1cyclictest0-21swapper/320:42:593
3196574993128,2cyclictest0-21swapper/321:52:593
3196573993128,2cyclictest0-21swapper/221:27:592
319656599311,28cyclictest3215605-21apt-get20:10:030
3196574993028,1cyclictest0-21swapper/321:59:553
3196574993027,2cyclictest0-21swapper/320:39:553
3196573993027,2cyclictest0-21swapper/223:35:132
3196573993027,2cyclictest0-21swapper/221:20:022
319657399300,28cyclictest0-21swapper/220:30:142
3196574992927,1cyclictest0-21swapper/323:57:003
3196574992927,1cyclictest0-21swapper/321:12:593
3196574992927,1cyclictest0-21swapper/320:16:003
3196574992926,2cyclictest0-21swapper/323:46:583
3196574992926,2cyclictest0-21swapper/322:20:023
3196574992926,2cyclictest0-21swapper/322:06:583
3196574992925,2cyclictest0-21swapper/320:55:133
3196574992924,2cyclictest0-21swapper/323:05:163
3196574992922,5cyclictest3207652-21turbostat19:45:003
319657499290,27cyclictest0-21swapper/319:20:143
319657499290,27cyclictest0-21swapper/300:15:143
3196573992927,1cyclictest0-21swapper/219:30:002
3196573992926,2cyclictest0-21swapper/222:55:022
3196573992926,2cyclictest0-21swapper/222:55:022
3196573992926,2cyclictest0-21swapper/222:35:142
3196573992926,2cyclictest0-21swapper/222:00:132
3196573992926,2cyclictest0-21swapper/220:00:152
3196573992926,2cyclictest0-21swapper/219:52:592
3196573992925,2cyclictest0-21swapper/222:20:592
319657399290,27cyclictest0-21swapper/221:00:142
319657399290,27cyclictest0-21swapper/219:17:592
3196565992925,2cyclictest3263308-21anacron22:34:480
3196574992826,1cyclictest0-21swapper/320:10:033
3196574992826,1cyclictest0-21swapper/300:25:593
3196574992825,2cyclictest0-21swapper/322:50:113
3196574992825,2cyclictest0-21swapper/321:45:143
3196574992825,2cyclictest0-21swapper/320:25:013
319657499280,27cyclictest0-21swapper/322:30:133
319657499280,26cyclictest0-21swapper/323:25:023
319657499280,26cyclictest0-21swapper/322:25:123
319657499280,26cyclictest0-21swapper/320:45:143
319657499280,26cyclictest0-21swapper/300:00:183
3196573992825,2cyclictest0-21swapper/223:10:142
3196573992825,2cyclictest0-21swapper/221:59:002
3196573992825,2cyclictest0-21swapper/221:48:592
3196573992825,2cyclictest0-21swapper/219:37:592
319657399280,27cyclictest0-21swapper/220:40:142
319657399280,26cyclictest0-21swapper/220:05:122
4670791270,7ptp4l61690irq/136-eno1-TxRx-022:50:003
4670791270,7ptp4l61690irq/136-eno1-TxRx-022:45:013
4670791270,6ptp4l441ktimers/319:55:003
3196574992725,1cyclictest0-21swapper/323:50:123
319657499270,26cyclictest0-21swapper/321:30:153
319657499270,26cyclictest0-21swapper/321:05:593
3196573992724,2cyclictest0-21swapper/220:52:592
3196573992724,2cyclictest0-21swapper/219:23:592
3196573992723,2cyclictest0-21swapper/200:10:132
3196573992723,2cyclictest0-21swapper/200:10:132
319657399270,25cyclictest0-21swapper/221:36:592
319657399270,1cyclictest0-21swapper/222:45:122
3196565992720,5cyclictest3240755-21kworker/u8:1+flush-179:021:40:220
4670791260,6ptp4l61690irq/136-eno1-TxRx-023:25:013
4670791260,6ptp4l61690irq/136-eno1-TxRx-023:25:013
4670791260,6ptp4l61690irq/136-eno1-TxRx-000:14:563
4670791260,6ptp4l61690irq/136-eno1-TxRx-000:14:553
4670791260,6ptp4l441ktimers/319:50:003
4670791260,5ptp4l61690irq/136-eno1-TxRx-022:05:013
4670791260,5ptp4l441ktimers/321:45:003
4670791260,5ptp4l441ktimers/319:34:553
319657499260,25cyclictest0-21swapper/323:39:553
3196573992623,2cyclictest0-21swapper/223:34:552
3196573992623,2cyclictest0-21swapper/219:48:592
3196573992623,2cyclictest0-21swapper/219:10:162
319657399260,2cyclictest0-21swapper/200:28:582
319657399260,24cyclictest0-21swapper/220:13:592
319657399260,24cyclictest0-21swapper/200:25:012
3196565992624,1cyclictest0-21swapper/022:00:590
4670791250,6ptp4l61690irq/136-eno1-TxRx-023:04:563
4670791250,6ptp4l61690irq/136-eno1-TxRx-023:00:013
4670791250,6ptp4l61690irq/136-eno1-TxRx-023:00:003
4670791250,5ptp4l441ktimers/300:10:003
3196574992522,2cyclictest0-21swapper/319:17:593
319657499250,1cyclictest0-21swapper/319:26:293
3196573992522,2cyclictest0-21swapper/221:31:592
3196573992522,2cyclictest0-21swapper/220:19:552
3196573992421,2cyclictest0-21swapper/223:07:582
3196573992421,2cyclictest0-21swapper/221:14:592
3196573992420,2cyclictest0-21swapper/223:19:552
3196573992220,1cyclictest0-21swapper/223:46:592
202199220,11rtkit-daemon3195179-21apt-get19:05:151
3196573992118,2cyclictest0-21swapper/200:15:592
3196573992017,2cyclictest0-21swapper/220:39:552
3196573991917,1cyclictest0-21swapper/223:50:122
319656599193,13cyclictest3196562-21cyclictest19:10:010
3196573991614,1cyclictest0-21swapper/220:24:562
3196573991613,2cyclictest0-21swapper/200:30:122
3196573991412,1cyclictest0-21swapper/222:29:002
319657399119,1cyclictest0-21swapper/200:07:002
319657399108,1cyclictest0-21swapper/200:02:592
319657399107,2cyclictest0-21swapper/222:15:592
31965739996,2cyclictest0-21swapper/220:47:592
31965739980,7cyclictest0-21swapper/222:30:022
31965739930,2cyclictest0-21swapper/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional