You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-15 - 16:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6.osadl.org (updated Sat Nov 15, 2025 12:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29524759910580,14cyclictest2960574-21latency_hist07:35:001
29524759910089,8cyclictest2970162-21latency_hist08:05:011
2952474998882,5cyclictest3051142-21kworker/u8:1+events_unbound12:20:250
2952474998783,3cyclictest2963785-21kworker/u8:0+flush-179:008:00:230
2952474998176,4cyclictest3022126-21kworker/u8:2+flush-179:011:00:250
2952474998075,4cyclictest3026627-21kworker/u8:0+events_unbound11:05:250
2952475997972,5cyclictest3026627-21kworker/u8:0+flush-179:011:00:011
2952475997972,5cyclictest3026627-21kworker/u8:0+flush-179:011:00:001
2952474997870,6cyclictest2957383-21kworker/u8:1+flush-179:007:30:180
2952475997766,8cyclictest2953944-21latency_hist07:15:011
2952474997768,7cyclictest3036455-21/usr/sbin/munin11:30:290
2952474997469,4cyclictest2979697-21kworker/u8:0+flush-179:009:15:470
2952475997353,17cyclictest3025063-21latency_hist10:55:011
2952474997369,3cyclictest2990883-21kworker/u8:2+events_unbound09:30:210
2952474997268,4cyclictest3039448-21kworker/u8:3+events_unbound11:55:320
2952474997267,4cyclictest3032842-21kworker/u8:0+events_unbound11:20:250
2952474997262,7cyclictest2987666-21latency_hist09:00:000
2952475997165,4cyclictest3022126-21kworker/u8:2+flush-179:011:40:251
2952475997163,5cyclictest3039448-21kworker/u8:3+flush-179:012:15:261
2952475997060,8cyclictest3054253-21apt-get12:25:121
2952474996960,6cyclictest2984482-21latency_hist08:50:010
2952474996958,9cyclictest2962461-21apt-get07:40:140
2952475996757,6cyclictest3002497-21kworker/u8:0+flush-179:009:55:251
2952474996763,3cyclictest2947867-21kworker/u8:0+events_unbound07:15:240
2952475996656,7cyclictest2983134-21/usr/sbin/munin08:45:281
2952474996662,3cyclictest3047604-21kworker/u8:0+flush-179:012:10:250
2952474996658,3cyclictest2995874-21kworker/u8:0+events_unbound09:25:220
2952474996561,3cyclictest2947867-21kworker/u8:0+events_unbound07:10:150
2952474996559,5cyclictest3004601-21kworker/u8:1+flush-179:010:00:230
2952474996359,3cyclictest3002497-21kworker/u8:0+flush-179:009:55:230
2952474996354,6cyclictest2965615-21kworker/u8:2+flush-179:008:10:260
2952475996255,5cyclictest3022126-21kworker/u8:2+flush-179:011:15:261
2952474996258,3cyclictest3008925-21kworker/u8:2+events_unbound10:20:250
2952474996257,4cyclictest3039448-21kworker/u8:3+flush-179:012:00:230
2952474996257,4cyclictest3022126-21kworker/u8:2+flush-179:010:45:230
2952474996257,4cyclictest2986305-21kworker/u8:1+flush-179:009:00:150
2952474996257,4cyclictest2957383-21kworker/u8:1+events_unbound07:45:220
2952474996254,6cyclictest3042822-21/usr/sbin/munin11:50:270
2952474996056,3cyclictest2965615-21kworker/u8:2+events_unbound08:20:440
2952474995954,4cyclictest2986305-21kworker/u8:1+events_unbound09:20:160
2952477995854,2cyclictest0-21swapper/209:01:592
2952475995852,4cyclictest2999053-21kworker/u8:1+flush-179:009:40:181
2952475995852,4cyclictest2999053-21kworker/u8:1+flush-179:009:40:171
2952475995850,6cyclictest2978115-21latency_hist08:30:011
2952474995854,3cyclictest2979697-21kworker/u8:0+events_unbound08:50:150
2952474995853,4cyclictest3039448-21kworker/u8:3+flush-179:012:05:200
2952474995853,4cyclictest2999053-21kworker/u8:1+flush-179:009:40:230
2952474995853,4cyclictest2999053-21kworker/u8:1+flush-179:009:40:220
2952474995849,7cyclictest271-21systemd-journal11:29:550
2952475995746,8cyclictest2981296-21latency_hist08:40:011
2952474995752,4cyclictest2965615-21kworker/u8:2+flush-179:008:05:270
2952474995746,9cyclictest3024019-21diskstats10:50:170
2952475995646,8cyclictest2954457-21apt-get07:15:121
2952475995646,7cyclictest2986067-21latency_hist08:55:001
295247599560,2cyclictest723-21Xorg09:11:001
295247599560,2cyclictest723-21Xorg09:10:591
2952474995647,6cyclictest3030084-21/usr/sbin/munin11:10:240
2952474995643,11cyclictest3057715-21diskstats12:35:200
2952474995552,3cyclictest3002497-21kworker/u8:0+events_unbound09:45:250
2952474995551,3cyclictest3039448-21kworker/u8:3+flush-179:012:19:550
2952474995550,4cyclictest2947867-21kworker/u8:0+events_unbound07:20:220
295247599540,2cyclictest0-21swapper/112:32:591
2952474995450,3cyclictest3022126-21kworker/u8:2+flush-179:011:35:340
2952474995450,3cyclictest3008925-21kworker/u8:2+events_unbound10:30:150
2952474995449,4cyclictest3000641-21kworker/u8:2+events_unbound09:50:220
2952474995449,4cyclictest2979697-21kworker/u8:0+flush-179:008:40:230
2952484995349,2cyclictest0-21swapper/309:01:593
2952475995349,2cyclictest3042617-21kworker/u8:1+flush-179:011:55:021
2952475995348,3cyclictest0-21swapper/109:01:591
295247599530,52cyclictest0-21swapper/112:02:591
2952474995348,4cyclictest2986305-21kworker/u8:1+events_unbound09:06:470
2952474995342,9cyclictest3055843-21apt-get12:30:150
2952474995248,3cyclictest3017151-21kworker/u8:3+events_unbound10:40:190
2952474995247,4cyclictest3022126-21kworker/u8:2+events_unbound11:15:180
2952474995241,9cyclictest3041235-21/usr/sbin/munin11:45:240
2952475995142,7cyclictest3029844-21latency_hist11:10:001
2952475995136,12cyclictest3013804-21store10:20:001
2952474995147,3cyclictest3039448-21kworker/u8:3+flush-179:012:25:280
2952474995046,3cyclictest3008925-21kworker/u8:2+events_unbound10:25:210
2952474995046,3cyclictest2957383-21kworker/u8:1+events_unbound07:25:140
2952474995041,3cyclictest3008925-21kworker/u8:2+events_unbound10:16:010
2952475994941,6cyclictest3009127-21/usr/sbin/munin10:05:251
4670791480,14ptp4l441ktimers/307:10:013
2952474994844,3cyclictest3008925-21kworker/u8:2+events_unbound10:11:480
2952474994843,4cyclictest3026627-21kworker/u8:0+events_unbound10:56:070
2952474994843,4cyclictest3026627-21kworker/u8:0+events_unbound10:56:070
2952475994741,3cyclictest2973367-21kworker/u8:3+events_unbound08:30:261
2952475994739,6cyclictest271-21systemd-journal10:39:471
2952475994737,7cyclictest3048953-21latency_hist12:10:011
2952475994726,17cyclictest3007027-21apt-get10:00:041
2952474994741,4cyclictest2965615-21kworker/u8:2+flush-179:007:55:020
2952474994741,4cyclictest2965615-21kworker/u8:2+flush-179:007:55:020
2952474994739,6cyclictest2992436-21latency_hist09:15:020
2952474994739,6cyclictest2992436-21latency_hist09:15:010
2952475994638,5cyclictest2957383-21kworker/u8:1+flush-179:007:40:251
2952475994637,6cyclictest3015519-21latency_hist10:25:011
2952474994642,3cyclictest2957436-21kworker/u8:2+events_unbound07:35:250
2952474994637,6cyclictest3040999-21latency_hist11:45:010
2952475994536,7cyclictest2995891-21latency_hist09:25:001
295247599450,43cyclictest723-21Xorg07:47:591
295247599450,43cyclictest3028262-21cron11:04:591
295247499451,3cyclictest3000649-21cron09:40:010
2952475994438,5cyclictest271-21systemd-journal12:21:161
2952475994430,11cyclictest2963785-21kworker/u8:0+flush-179:007:50:171
2952475994425,18cyclictest3034631-21/usr/sbin/munin11:25:001
2952475994338,3cyclictest3042621-21systemd-run11:50:001
295247499430,41cyclictest723-21Xorg10:37:590
295248499420,40cyclictest2953955-21turbostat07:15:003
295248499420,2cyclictest0-21swapper/307:47:593
2952475994231,9cyclictest2993236-21diskstats09:15:191
2952475994229,12cyclictest2963785-21kworker/u8:0+flush-179:008:05:181
2952475994226,13cyclictest3017364-21apt-get10:30:141
2952474994238,3cyclictest2963785-21kworker/u8:0+events_unbound07:50:180
2952475994137,3cyclictest3039448-21kworker/u8:3+flush-179:011:55:331
2952475994134,5cyclictest3034663-21kworker/u8:3+flush-179:011:25:261
2952474994136,4cyclictest2973367-21kworker/u8:3+events_unbound08:32:490
2952477994036,2cyclictest0-21swapper/210:49:552
2952475994035,3cyclictest723-21Xorg07:38:591
2952475994035,2cyclictest3037253-21kworker/u8:0+flush-179:011:40:001
295247599401,26cyclictest723-21Xorg12:36:591
295248499390,4cyclictest3015534-21turbostat10:25:003
295248499390,4cyclictest2960588-21turbostat07:35:003
2952477993936,2cyclictest0-21swapper/211:07:002
2952477993935,2cyclictest0-21swapper/211:17:592
2952475993930,7cyclictest2999321-21apt-get09:35:121
2952475993928,8cyclictest2963785-21kworker/u8:0+flush-179:007:55:231
2952475993928,8cyclictest2963785-21kworker/u8:0+flush-179:007:55:231
295247599390,2cyclictest723-21Xorg10:47:591
2952474993935,3cyclictest3004601-21kworker/u8:1+events_unbound10:05:190
295247499390,3cyclictest2981302-21munin-run08:40:000
2952484993836,1cyclictest0-21swapper/307:44:593
2952484993831,5cyclictest3039405-21turbostat11:40:003
295247799380,36cyclictest0-21swapper/211:55:582
295247799380,35cyclictest0-21swapper/208:39:552
2952475993835,2cyclictest723-21Xorg10:13:581
2952475993835,2cyclictest723-21Xorg08:41:591
295248499370,36cyclictest0-21swapper/309:52:003
2952477993734,2cyclictest0-21swapper/210:12:582
2952477993734,2cyclictest0-21swapper/209:31:592
2952477993734,2cyclictest0-21swapper/208:49:582
2952477993734,2cyclictest0-21swapper/207:34:552
295247799370,35cyclictest0-21swapper/211:40:002
295247799370,35cyclictest0-21swapper/209:29:592
2952475993732,3cyclictest475-21dbus-daemon09:55:011
2952475993731,4cyclictest3021889-21latency_hist10:45:011
2952475993729,5cyclictest2990883-21kworker/u8:2+flush-179:009:30:261
295247599370,36cyclictest0-21swapper/107:24:551
295247599370,1cyclictest0-21swapper/109:09:551
2952474993733,3cyclictest2973214-21kworker/u8:1+flush-179:008:25:230
4670791360,28ptp4l441ktimers/310:25:163
2952484993633,2cyclictest0-21swapper/307:24:593
295248499360,35cyclictest0-21swapper/310:04:593
295248499360,1cyclictest0-21swapper/309:13:593
295248499360,1cyclictest0-21swapper/309:13:583
2952477993633,2cyclictest0-21swapper/208:28:582
2952475993631,3cyclictest723-21Xorg09:50:001
2952484993533,1cyclictest0-21swapper/308:39:553
2952484993532,2cyclictest0-21swapper/311:55:593
2952484993532,2cyclictest0-21swapper/309:49:593
2952477993531,2cyclictest0-21swapper/208:19:552
2952477993531,2cyclictest0-21swapper/207:54:552
295247799350,1cyclictest0-21swapper/207:24:592
2952475993531,3cyclictest723-21Xorg09:29:591
2952484993432,1cyclictest0-21swapper/309:29:593
2952484993432,1cyclictest0-21swapper/309:19:563
2952477993431,2cyclictest0-21swapper/208:10:002
2952475993426,6cyclictest3022126-21kworker/u8:2+events_unbound11:10:261
2952474993430,3cyclictest2965615-21kworker/u8:2+events_unbound08:15:510
4670791330,25ptp4l71-21kworker/3:1+events08:05:143
2952484993331,1cyclictest0-21swapper/310:54:003
2952484993331,1cyclictest0-21swapper/310:34:563
2952484993330,2cyclictest0-21swapper/312:39:593
2952484993330,2cyclictest0-21swapper/311:06:593
2952484993330,2cyclictest0-21swapper/310:49:563
2952477993330,2cyclictest0-21swapper/211:04:552
2952477993328,2cyclictest0-21swapper/208:53:002
2952484993229,2cyclictest0-21swapper/308:49:593
295247599321,29cyclictest2986324-21apt-get08:55:151
2952484993128,2cyclictest0-21swapper/311:17:593
2952484993128,2cyclictest0-21swapper/310:12:593
2952477993128,2cyclictest0-21swapper/212:25:002
2952477993128,2cyclictest0-21swapper/210:30:582
2952477993128,2cyclictest0-21swapper/210:05:592
295247799310,2cyclictest0-21swapper/207:29:592
295247799310,29cyclictest0-21swapper/208:34:592
2952475993126,4cyclictest3017107-21munin-run10:30:011
4670791300,7ptp4l441ktimers/308:59:593
2952484993028,1cyclictest0-21swapper/308:28:593
2952484993028,1cyclictest0-21swapper/307:29:593
295248499300,29cyclictest0-21swapper/308:30:153
295248499300,1cyclictest0-21swapper/312:06:593
2952477993027,2cyclictest0-21swapper/207:15:152
2952477993024,2cyclictest0-21swapper/210:40:162
2952475993027,2cyclictest0-21swapper/107:29:591
2952484992927,1cyclictest0-21swapper/309:31:583
295248499290,2cyclictest0-21swapper/311:42:593
295248499290,28cyclictest0-21swapper/311:20:143
295248499290,27cyclictest0-21swapper/310:35:153
295248499290,27cyclictest0-21swapper/310:05:143
295248499290,27cyclictest0-21swapper/307:55:143
295248499290,27cyclictest0-21swapper/307:55:143
295248499290,27cyclictest0-21swapper/307:15:023
2952477992926,2cyclictest0-21swapper/212:11:592
2952477992926,2cyclictest0-21swapper/207:37:592
2952477992925,2cyclictest0-21swapper/211:42:592
295247799290,28cyclictest0-21swapper/210:00:032
295247799290,27cyclictest0-21swapper/212:30:162
295247799290,27cyclictest0-21swapper/212:15:152
295247799290,27cyclictest0-21swapper/211:20:132
295247799290,27cyclictest0-21swapper/210:35:162
295247799290,27cyclictest0-21swapper/210:20:022
295247799290,27cyclictest0-21swapper/207:55:142
295247799290,27cyclictest0-21swapper/207:55:142
2952475992924,4cyclictest2973341-21turbostat08:19:551
295247599291,26cyclictest3049210-21apt12:10:161
2952484992826,1cyclictest0-21swapper/307:54:553
2952484992822,4cyclictest3053741-21turbostat12:24:593
295248499280,27cyclictest0-21swapper/312:30:163
295248499280,26cyclictest0-21swapper/312:15:163
2952477992825,2cyclictest0-21swapper/209:40:172
2952477992825,2cyclictest0-21swapper/209:40:172
295247599281,9cyclictest2973338-21idleruntime-cro08:15:001
295247599281,26cyclictest723-21Xorg08:22:591
4670791270,6ptp4l441ktimers/311:30:003
4670791270,6ptp4l441ktimers/309:25:013
4670791270,5ptp4l441ktimers/308:25:003
2952484992725,1cyclictest0-21swapper/310:42:583
2952484992725,1cyclictest0-21swapper/308:19:553
295248499270,26cyclictest0-21swapper/308:53:003
2952477992724,2cyclictest0-21swapper/211:54:552
2952477992724,2cyclictest0-21swapper/208:14:552
2952477992723,2cyclictest0-21swapper/209:50:132
2952477992723,2cyclictest0-21swapper/207:40:592
295247799270,25cyclictest0-21swapper/210:58:592
295247799270,25cyclictest0-21swapper/210:58:582
295247799270,25cyclictest0-21swapper/207:50:002
295247799270,25cyclictest0-21swapper/207:10:222
4670791260,6ptp4l61690irq/136-eno1-TxRx-011:35:003
4670791260,6ptp4l61690irq/136-eno1-TxRx-009:40:023
4670791260,6ptp4l441ktimers/312:29:553
4670791260,6ptp4l441ktimers/311:15:003
4670791260,6ptp4l441ktimers/309:59:563
4670791260,6ptp4l441ktimers/309:09:563
4670791260,6ptp4l441ktimers/308:04:563
4670791260,5ptp4l441ktimers/312:04:553
2952484992624,1cyclictest0-21swapper/309:40:173
2952484992624,1cyclictest0-21swapper/309:40:163
2952484992623,2cyclictest0-21swapper/311:50:593
295248499260,19cyclictest0-21swapper/308:11:003
2952477992623,2cyclictest0-21swapper/212:25:142
295247799260,2cyclictest0-21swapper/212:08:592
295247799260,24cyclictest0-21swapper/212:37:592
295247799260,24cyclictest0-21swapper/211:50:002
295247799260,24cyclictest0-21swapper/210:25:152
4670791250,5ptp4l61690irq/136-eno1-TxRx-012:15:003
2952484992523,1cyclictest0-21swapper/311:04:563
2952484992521,2cyclictest0-21swapper/307:37:593
295248499250,24cyclictest0-21swapper/311:47:593
2952477992523,1cyclictest0-21swapper/208:25:002
2952477992522,2cyclictest0-21swapper/211:13:582
2952475992519,4cyclictest3034663-21kworker/u8:3+flush-179:011:30:231
202199250,11rtkit-daemon2951770-21ntpq07:05:260
4670791240,5ptp4l61690irq/136-eno1-TxRx-008:45:003
2952484992421,2cyclictest0-21swapper/310:58:583
2952484992421,2cyclictest0-21swapper/310:58:583
2952477992421,2cyclictest0-21swapper/210:54:592
2952477992420,2cyclictest0-21swapper/209:15:022
2952477992420,2cyclictest0-21swapper/209:05:142
4670791230,4ptp4l61690irq/136-eno1-TxRx-010:20:003
2952477992220,1cyclictest0-21swapper/209:40:002
2952477992219,2cyclictest0-21swapper/208:44:552
2952477992219,2cyclictest0-21swapper/208:00:592
2952477992018,1cyclictest0-21swapper/212:04:592
2952477992017,2cyclictest0-21swapper/209:10:142
2952477992017,2cyclictest0-21swapper/209:10:142
2952477991916,2cyclictest0-21swapper/211:33:592
2952477991915,2cyclictest0-21swapper/209:55:592
2952477991815,2cyclictest0-21swapper/210:20:002
2952477991714,2cyclictest0-21swapper/209:20:152
295247599149,4cyclictest2952590-21latency_hist07:10:021
2952477991311,1cyclictest0-21swapper/209:00:002
29524779985,2cyclictest0-21swapper/211:30:002
29524779980,7cyclictest0-21swapper/209:45:462
29524779930,2cyclictest0-21swapper/207:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional