You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 14:54
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6.osadl.org (updated Sun Apr 05, 2026 00:44:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28556199910087,10cyclictest2927392-21latency_hist22:55:010
2855619999787,7cyclictest2873017-21latency_hist20:05:010
2855620999589,4cyclictest2908331-21kworker/u8:3+flush-179:022:35:001
2855619999483,8cyclictest2925806-21latency_hist22:50:020
2855619998980,6cyclictest2925278-21kworker/u8:1+flush-179:000:00:010
2855620998878,8cyclictest2857080-21latency_hist19:15:011
2855620998781,4cyclictest2893834-21kworker/u8:1+flush-179:021:25:011
2855620998575,8cyclictest2863690-21/usr/sbin/munin19:35:231
2855620998475,7cyclictest2884172-21latency_hist20:40:011
2855620998268,13cyclictest2882438-21kworker/u8:0+flush-179:021:20:011
2855620998268,13cyclictest2882438-21kworker/u8:0+flush-179:021:20:011
2855620998174,5cyclictest2865098-21kworker/u8:3+flush-179:020:00:001
2855620998173,5cyclictest2937326-21kworker/u8:2+flush-179:000:05:211
2855620998074,4cyclictest2925278-21kworker/u8:1+flush-179:022:45:251
2855620998072,6cyclictest2863454-21latency_hist19:35:011
2855620997872,4cyclictest2929226-21kworker/u8:3+flush-179:023:15:201
2855619997869,6cyclictest2950334-21latency_hist00:05:000
2855620997769,6cyclictest2916246-21latency_hist22:20:001
2855619997767,8cyclictest266-21systemd-journal22:55:010
2855620997670,5cyclictest2877267-21kworker/u8:1+flush-179:020:25:201
2855620997567,5cyclictest2865098-21kworker/u8:3+events_unbound20:10:131
2855620997566,7cyclictest2931140-21/usr/sbin/munin23:05:251
2855619997568,5cyclictest2955630-21apt-get00:20:130
2855620997367,5cyclictest2877267-21kworker/u8:1+flush-179:020:45:011
2855620997366,5cyclictest2873001-21kworker/u8:1+flush-179:020:10:011
2855620997366,5cyclictest2873001-21kworker/u8:1+flush-179:020:10:011
2855619997363,8cyclictest2860533-21apt-get19:25:100
2855620997267,4cyclictest2937326-21kworker/u8:2+flush-179:023:54:551
2855620997162,7cyclictest2882559-21latency_hist20:35:011
2855619997064,4cyclictest2958258-21kworker/u8:3+flush-179:000:30:230
2855619996961,6cyclictest2902177-21apt-get21:35:120
2855619996960,6cyclictest2881226-21apt-get20:30:120
2855620996862,5cyclictest2852268-21kworker/u8:3+events_unbound19:15:241
2855620996860,6cyclictest2937326-21kworker/u8:2+events_unbound23:25:001
2855620996760,5cyclictest2908331-21kworker/u8:3+flush-179:022:05:141
2855620996759,5cyclictest2908279-21kworker/u8:1+flush-179:021:55:201
2855620996661,4cyclictest2925278-21kworker/u8:1+flush-179:022:59:571
2855620996661,4cyclictest2917314-21kworker/u8:4+flush-179:022:25:011
2855619996659,5cyclictest2925278-21kworker/u8:1+flush-179:023:05:180
2855619996659,5cyclictest2884805-21fschecks_time20:40:140
2855620996557,5cyclictest2925278-21kworker/u8:1+events_unbound23:40:251
2855620996555,8cyclictest2894220-21apt-get21:10:121
2855619996556,7cyclictest2858948-21kworker/u8:0+flush-179:019:30:230
2855619996555,8cyclictest2903786-21apt-get21:40:110
2855620996459,4cyclictest2903516-21kworker/u8:1+events_unbound21:40:221
2855620996457,6cyclictest2937326-21kworker/u8:2+events_unbound23:50:001
2855620996457,6cyclictest2882438-21kworker/u8:0+flush-179:020:45:211
2855620996457,6cyclictest2882438-21kworker/u8:0+flush-179:020:45:201
2855620996456,6cyclictest2948668-21latency_hist00:00:021
2855619996453,9cyclictest266-21systemd-journal21:55:010
2855620996359,3cyclictest2858948-21kworker/u8:0+flush-179:019:20:231
2855620996358,3cyclictest2957890-21kworker/u8:1+flush-179:000:35:201
2855620996357,4cyclictest2901921-21latency_hist21:35:011
2855620996357,4cyclictest2877267-21kworker/u8:1+flush-179:020:50:051
285562499610,59cyclictest0-21swapper/222:55:592
2855620996156,4cyclictest2899300-21kworker/u8:0+flush-179:021:25:161
2855620996156,4cyclictest2860253-21kworker/u8:2+events_unbound19:55:011
2855619996150,8cyclictest2917314-21kworker/u8:4+flush-179:022:25:210
2855620996055,4cyclictest2925278-21kworker/u8:1+flush-179:022:50:211
2855620996054,5cyclictest2948945-21kworker/u8:0+flush-179:000:10:251
2855619996057,2cyclictest0-21swapper/023:02:590
2855619996057,2cyclictest0-21swapper/022:07:580
2855619995953,4cyclictest2925278-21kworker/u8:1+flush-179:023:45:210
2855620995852,5cyclictest2877267-21kworker/u8:1+flush-179:020:20:001
2855620995850,6cyclictest2906701-21latency_hist21:50:011
2855619995852,4cyclictest2908279-21kworker/u8:1+events_unbound21:55:240
2855620995750,5cyclictest2939374-21apt-get23:30:121
2855620995750,5cyclictest266-21systemd-journal22:25:101
2855620995745,9cyclictest2956971-21apt-get00:25:001
2855619995751,4cyclictest2893834-21kworker/u8:1+events_unbound21:30:210
2855624995653,2cyclictest0-21swapper/200:23:592
2855620995651,4cyclictest2925278-21kworker/u8:1+flush-179:000:00:241
2855620995649,6cyclictest2925278-21kworker/u8:1+flush-179:023:40:011
2855620995649,6cyclictest2925278-21kworker/u8:1+flush-179:023:40:011
2855620995649,5cyclictest2908331-21kworker/u8:3+flush-179:022:10:201
2855619995649,5cyclictest2865098-21kworker/u8:3+events_unbound20:15:130
2855620995550,4cyclictest2882438-21kworker/u8:0+flush-179:021:00:211
2855620995550,4cyclictest2882438-21kworker/u8:0+events_unbound20:55:191
2855619995547,6cyclictest2865098-21kworker/u8:3+flush-179:020:10:210
2855620995449,4cyclictest2937326-21kworker/u8:2+flush-179:023:25:011
2855619995448,4cyclictest2852173-21kworker/u8:1+flush-179:019:14:550
2855619995445,7cyclictest2852268-21kworker/u8:3+flush-179:019:15:220
2855620995349,3cyclictest2860253-21kworker/u8:2+flush-179:019:29:551
2855620995348,4cyclictest2906687-21kworker/u8:2+flush-179:021:51:101
2855620995347,4cyclictest2929222-21kworker/u8:2+events_unbound23:00:191
2855620995343,8cyclictest266-21systemd-journal22:05:001
2855619995349,3cyclictest2875266-21kworker/u8:0+events_unbound20:25:010
2855619995347,5cyclictest2925278-21kworker/u8:1+flush-179:023:30:160
2855619995347,4cyclictest2916310-21kworker/u8:2+events_unbound22:40:130
2855619995345,6cyclictest2937326-21kworker/u8:2+events_unbound00:15:200
2855619995345,6cyclictest2929226-21kworker/u8:3+flush-179:023:15:000
2855620995247,4cyclictest2916310-21kworker/u8:2+flush-179:022:40:211
2855620995245,5cyclictest2908331-21kworker/u8:3+events_unbound22:35:151
2855619995246,4cyclictest2882438-21kworker/u8:0+flush-179:020:55:170
2855625995144,5cyclictest2879407-21turbostat20:25:013
2855620995146,4cyclictest2860253-21kworker/u8:2+flush-179:020:00:221
2855619995143,5cyclictest2863440-21kworker/u8:1+events_unbound19:45:130
2855620995043,5cyclictest2957890-21kworker/u8:1+events_unbound00:35:001
2855619995044,5cyclictest2908331-21kworker/u8:3+flush-179:022:04:550
4577091490,13ptp4l441ktimers/319:10:003
2855620994941,6cyclictest2934076-21latency_hist23:15:011
2855619994944,4cyclictest2948945-21kworker/u8:0+flush-179:000:05:270
2855619994939,7cyclictest2917314-21kworker/u8:4+events_unbound22:30:150
2855620994843,4cyclictest2958258-21kworker/u8:3+events_unbound00:25:231
2855619994843,4cyclictest2882438-21kworker/u8:0+events_unbound21:00:250
2855619994843,4cyclictest2877267-21kworker/u8:1+flush-179:020:39:550
2855619994842,4cyclictest2937326-21kworker/u8:2+flush-179:023:25:040
2855619994840,6cyclictest2899300-21kworker/u8:0+flush-179:021:25:230
2855619994737,8cyclictest2860253-21kworker/u8:2+events_unbound19:40:200
2855619994737,8cyclictest2860253-21kworker/u8:2+events_unbound19:40:200
2855619994641,4cyclictest2911460-21kworker/u8:0+events_unbound22:20:190
2855619994640,4cyclictest2899300-21kworker/u8:0+events_unbound21:45:150
2855619994638,6cyclictest2908279-21kworker/u8:1+events_unbound22:15:200
2855620994539,4cyclictest2863440-21kworker/u8:1+flush-179:019:45:201
2855619994541,3cyclictest2925278-21kworker/u8:1+flush-179:023:53:120
2855619994539,5cyclictest2908331-21kworker/u8:3+flush-179:022:35:160
2855619994535,7cyclictest510-21rs:main0
2855619994441,2cyclictest2882438-21kworker/u8:0+flush-179:021:10:010
2855619994440,3cyclictest2860253-21kworker/u8:2+flush-179:019:52:310
2855619994436,6cyclictest2925278-21kworker/u8:1+flush-179:023:20:220
2855619994436,6cyclictest2858927-21/usr/sbin/munin19:20:150
2855625994337,4cyclictest2857093-21turbostat19:19:553
2855624994340,2cyclictest0-21swapper/221:23:582
2855619994337,5cyclictest2911460-21kworker/u8:0+flush-179:022:13:110
2855619994336,5cyclictest2895548-21latency_hist21:15:020
2855620994237,4cyclictest2875266-21kworker/u8:0+flush-179:020:20:211
2855620994236,4cyclictest2860253-21kworker/u8:2+events_unbound19:40:241
2855620994236,4cyclictest2860253-21kworker/u8:2+events_unbound19:40:231
2855619994237,4cyclictest2858948-21kworker/u8:0+events_unbound19:35:130
2855619994235,5cyclictest2893834-21kworker/u8:1+flush-179:021:15:210
2855619994235,5cyclictest2893834-21kworker/u8:1+flush-179:021:15:210
4577091410,33ptp4l61490irq/134-eno1-TxRx-020:10:133
2855625994139,1cyclictest0-21swapper/300:12:593
2855619994136,4cyclictest2958258-21kworker/u8:3+flush-179:000:25:250
2855619994135,5cyclictest2937326-21kworker/u8:2+flush-179:000:10:230
2855619994135,4cyclictest2873001-21kworker/u8:1+flush-179:020:05:260
2855619994135,4cyclictest2873001-21kworker/u8:1+flush-179:020:05:260
2855625993937,1cyclictest0-21swapper/322:24:593
2855625993936,2cyclictest0-21swapper/319:49:583
2855624993936,2cyclictest0-21swapper/223:40:592
285562499390,37cyclictest0-21swapper/222:43:592
2855624993835,2cyclictest0-21swapper/221:37:582
285562499380,35cyclictest0-21swapper/223:50:002
2855620993832,5cyclictest2882592-21kworker/u8:3+events_unbound21:05:241
2855619993833,4cyclictest2925278-21kworker/u8:1+flush-179:023:40:220
2855619993833,4cyclictest2897170-21kworker/u8:3+events_unbound21:20:240
2855619993832,5cyclictest2877833-21kworker/u8:2+flush-179:020:30:010
2855625993735,1cyclictest0-21swapper/321:54:553
2855625993734,2cyclictest0-21swapper/323:08:593
2855624993734,2cyclictest0-21swapper/222:36:592
2855624993734,2cyclictest0-21swapper/220:55:592
2855624993734,2cyclictest0-21swapper/220:30:592
285562499370,35cyclictest0-21swapper/221:20:002
285562499370,35cyclictest0-21swapper/221:19:592
285562499370,35cyclictest0-21swapper/220:45:592
285562499370,35cyclictest0-21swapper/220:45:592
2855619993732,4cyclictest2925278-21kworker/u8:1+events_unbound23:35:200
2855619993732,4cyclictest2925278-21kworker/u8:1+events_unbound23:35:190
285561999371,34cyclictest1-21systemd20:46:080
285561999371,34cyclictest1-21systemd20:46:070
285562599360,1cyclictest0-21swapper/300:19:593
2855624993634,1cyclictest0-21swapper/222:55:012
2855624993634,1cyclictest0-21swapper/222:09:592
2855624993634,1cyclictest0-21swapper/222:05:012
2855624993634,1cyclictest0-21swapper/221:50:002
2855624993633,2cyclictest0-21swapper/219:55:592
2855624993633,2cyclictest0-21swapper/219:45:592
285562499360,1cyclictest0-21swapper/219:13:592
2855620993632,3cyclictest2937326-21kworker/u8:2+flush-179:000:15:221
4577091350,13ptp4l61490irq/134-eno1-TxRx-000:05:003
2855625993533,1cyclictest0-21swapper/300:20:593
2855625993533,1cyclictest0-21swapper/300:08:003
2855624993532,2cyclictest0-21swapper/223:29:002
2855624993532,2cyclictest0-21swapper/222:11:592
2855624993532,2cyclictest0-21swapper/221:12:592
285562099351,6cyclictest2902177-21apt-get21:35:141
4577091340,3ptp4l441ktimers/322:05:123
2855625993432,1cyclictest0-21swapper/323:32:583
2855625993432,1cyclictest0-21swapper/322:04:553
2855625993432,1cyclictest0-21swapper/321:35:593
2855624993432,1cyclictest0-21swapper/220:45:002
2855624993431,2cyclictest0-21swapper/220:10:592
2855624993431,2cyclictest0-21swapper/219:26:592
2855619993426,5cyclictest0-21swapper/019:55:130
285562599330,27cyclictest0-21swapper/322:55:123
285562599330,1cyclictest0-21swapper/323:20:133
2855624993331,1cyclictest0-21swapper/220:55:002
2855624993330,2cyclictest0-21swapper/200:03:592
2855619993324,7cyclictest2929226-21kworker/u8:3+events_unbound23:15:220
2855625993227,4cyclictest2934089-21turbostat23:15:003
2855624993229,2cyclictest0-21swapper/223:52:592
2855625993129,1cyclictest0-21swapper/320:37:003
2855625993126,4cyclictest0-21swapper/320:07:003
2855625993126,4cyclictest0-21swapper/320:07:003
2855625993126,3cyclictest4578291phc2sys20:45:143
2855625993126,3cyclictest4578291phc2sys20:45:133
2855625993028,1cyclictest0-21swapper/321:44:563
2855625993028,1cyclictest0-21swapper/321:29:003
2855625993025,4cyclictest2865071-21turbostat19:40:003
2855624993028,1cyclictest0-21swapper/221:35:002
2855624993028,1cyclictest0-21swapper/200:34:592
2855624993027,2cyclictest0-21swapper/223:24:552
2855624993027,2cyclictest0-21swapper/222:45:592
2855624993027,2cyclictest0-21swapper/220:16:592
285562499300,2cyclictest0-21swapper/200:10:032
285562499300,28cyclictest0-21swapper/221:41:592
4577091290,7ptp4l441ktimers/320:45:013
4577091290,7ptp4l441ktimers/319:55:013
4577091290,7ptp4l441ktimers/319:35:003
2855625992927,1cyclictest0-21swapper/322:19:593
2855625992927,1cyclictest0-21swapper/321:57:003
2855625992927,1cyclictest0-21swapper/321:32:593
2855625992926,2cyclictest0-21swapper/323:25:013
2855625992926,2cyclictest0-21swapper/319:20:123
2855625992923,4cyclictest2943910-21turbostat23:45:003
285562599290,2cyclictest0-21swapper/321:10:143
285562599290,27cyclictest0-21swapper/320:50:033
285562599290,1cyclictest0-21swapper/321:15:133
285562599290,1cyclictest0-21swapper/321:15:133
2855624992926,2cyclictest0-21swapper/219:51:592
2855624992926,2cyclictest0-21swapper/219:39:002
2855624992926,2cyclictest0-21swapper/219:15:132
2855624992926,2cyclictest0-21swapper/200:25:012
285562499290,27cyclictest0-21swapper/221:25:142
285562499290,27cyclictest0-21swapper/200:15:132
4577091280,7ptp4l441ktimers/323:20:003
4577091280,7ptp4l441ktimers/322:35:013
4577091280,6ptp4l441ktimers/323:50:003
4577091280,6ptp4l441ktimers/322:50:013
4577091280,6ptp4l441ktimers/321:49:543
2855625992826,1cyclictest0-21swapper/323:59:583
285562599280,27cyclictest0-21swapper/323:35:133
285562599280,27cyclictest0-21swapper/323:35:123
285562599280,27cyclictest0-21swapper/322:30:003
285562599280,27cyclictest0-21swapper/320:30:143
285562599280,26cyclictest0-21swapper/319:55:133
285562599280,26cyclictest0-21swapper/319:40:133
285562599280,26cyclictest0-21swapper/319:40:133
2855624992826,1cyclictest0-21swapper/221:55:112
2855624992826,1cyclictest0-21swapper/220:05:002
2855624992826,1cyclictest0-21swapper/219:30:142
2855624992826,1cyclictest0-21swapper/200:00:002
2855624992825,2cyclictest0-21swapper/223:15:112
2855624992825,2cyclictest0-21swapper/223:13:592
2855624992825,2cyclictest0-21swapper/222:20:592
2855624992825,2cyclictest0-21swapper/222:15:132
2855624992825,2cyclictest0-21swapper/221:00:592
2855624992825,2cyclictest0-21swapper/220:39:592
2855624992825,2cyclictest0-21swapper/219:40:132
2855624992825,2cyclictest0-21swapper/219:40:132
2855624992825,2cyclictest0-21swapper/200:35:122
285562499280,26cyclictest0-21swapper/220:08:002
285562499280,26cyclictest0-21swapper/220:08:002
2855619992824,3cyclictest0-21swapper/000:40:000
2855619992821,5cyclictest2855468-21latency_hist19:10:010
4577091270,7ptp4l441ktimers/319:30:003
4577091270,6ptp4l61490irq/134-eno1-TxRx-021:25:013
4577091270,6ptp4l61490irq/134-eno1-TxRx-021:00:003
4577091270,6ptp4l441ktimers/323:55:003
4577091270,6ptp4l441ktimers/322:40:003
2855625992725,1cyclictest0-21swapper/300:30:593
2855625992725,1cyclictest0-21swapper/300:25:023
285562599270,26cyclictest0-21swapper/322:50:123
285562599270,26cyclictest0-21swapper/322:40:113
285562599270,1cyclictest0-21swapper/321:06:003
2855624992724,2cyclictest0-21swapper/223:09:002
4577091260,6ptp4l441ktimers/320:04:563
4577091260,6ptp4l441ktimers/319:15:003
4577091260,5ptp4l61490irq/134-eno1-TxRx-000:39:553
4577091260,5ptp4l441ktimers/323:05:013
4577091260,5ptp4l441ktimers/322:14:553
4577091260,5ptp4l441ktimers/321:04:553
4577091260,5ptp4l441ktimers/320:20:003
2855624992623,2cyclictest0-21swapper/223:00:592
2855624992623,2cyclictest0-21swapper/222:25:592
2855624992623,2cyclictest0-21swapper/220:26:592
285562499260,25cyclictest0-21swapper/223:39:002
285562499260,25cyclictest0-21swapper/223:38:592
2855620992621,3cyclictest0-21swapper/119:10:011
4577091250,5ptp4l441ktimers/320:30:013
2855624992523,1cyclictest0-21swapper/221:50:582
2855624992523,1cyclictest0-21swapper/221:10:002
2855624992422,1cyclictest0-21swapper/219:21:592
285562499240,1cyclictest0-21swapper/222:34:582
2855624992321,1cyclictest0-21swapper/223:33:592
2855624992320,2cyclictest0-21swapper/200:07:592
2855624992219,2cyclictest0-21swapper/220:20:592
28556249920,1cyclictest0-21swapper/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional