You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-16 - 17:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackbslot1.osadl.org (updated Sun Nov 16, 2025 12:44:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
523352210186,14sleep30-21swapper/307:08:083
523232202178,14sleep10-21swapper/107:07:591
522462194158,26sleep20-21swapper/207:06:592
522242188164,14sleep00-21swapper/007:06:410
27674021460,1sleep3276737-21snmp_ryswitch.c10:45:043
5267599982,93cyclictest152082-21chrome08:45:010
52675996561,2cyclictest276585-21snmp_ryswitch.c10:45:020
52685996458,5cyclictest322127-21kworker/u8:3+flush-179:012:15:313
52675996357,4cyclictest247560-21ThreadPoolForeg07:45:010
52675996256,4cyclictest312522-21/usr/share/muni11:20:110
52675995955,3cyclictest214289-21ThreadPoolSingl09:45:020
52675995955,3cyclictest192961-21kworker/u8:5+flush-179:009:30:140
52685995851,5cyclictest281827-21/usr/share/muni10:50:053
52675995853,4cyclictest203771-21/usr/share/muni09:35:020
52675995853,4cyclictest203771-21/usr/share/muni09:35:010
52685995545,3cyclictest296892-21munin-update11:05:323
52685995542,4cyclictest99907-21munin-limits07:50:333
52675995450,3cyclictest121308-21/usr/share/muni08:15:120
52683995330,22cyclictest47153-21kworker/u8:2+flush-179:007:15:082
52682995345,6cyclictest271283-21/usr/share/muni10:40:031
52675995349,3cyclictest167097-21kworker/u8:3+flush-179:009:19:280
52685995247,4cyclictest161477-31munin-html08:50:353
52683995245,5cyclictest247516-21Chrome_ChildIOT11:45:192
52675995246,4cyclictest338112-21chrome11:45:010
52685995144,5cyclictest146920-21/usr/share/muni08:40:143
52685995135,15cyclictest3812216-21apache208:45:133
52683995147,3cyclictest167097-21kworker/u8:3+flush-179:011:01:452
52683995144,5cyclictest188353-21/usr/share/muni09:20:042
52682995137,2cyclictest276573-21/usr/share/muni10:45:021
2248762510,1sleep1281ktimers/109:55:021
52683995035,2cyclictest276543-21chrome10:45:022
52682995044,4cyclictest100318-21kworker/u8:1+flush-179:008:35:181
52675995046,3cyclictest47153-21kworker/u8:2+events_unbound07:29:480
52685994942,5cyclictest276236-21latency_hist10:45:003
52683994944,3cyclictest182940-21kworker/u8:0+flush-179:009:50:252
52683994942,5cyclictest177769-21/usr/share/muni09:10:172
52682994945,3cyclictest182940-21kworker/u8:0+events_unbound09:20:011
52682994945,3cyclictest100318-21kworker/u8:1+flush-179:008:45:361
52682994941,6cyclictest327815-21/usr/share/muni11:35:171
52675994946,2cyclictest306197-21kworker/u8:0+flush-179:011:50:310
52675994946,2cyclictest306197-21kworker/u8:0+flush-179:011:17:010
52675994945,3cyclictest79553-21kworker/u8:5+events_unbound07:33:390
52683994844,3cyclictest167097-21kworker/u8:3+flush-179:011:10:312
52675994839,7cyclictest247515-21ThreadPoolForeg09:40:290
52685994742,4cyclictest3125724-21ThreadPoolForeg08:40:013
52683994741,5cyclictest214338-21/usr/share/muni09:45:132
52682994743,3cyclictest47153-21kworker/u8:2+flush-179:007:10:161
52675994744,2cyclictest312204-21kworker/u8:1+flush-179:011:25:230
52675994744,2cyclictest312204-21kworker/u8:1+flush-179:011:25:220
52675994743,3cyclictest167097-21kworker/u8:3+events_unbound10:20:100
52675994741,5cyclictest255649-21/usr/share/muni10:25:120
52685994642,3cyclictest90571-21ThreadPoolForeg07:45:203
52685994642,3cyclictest208629-21munin-update09:40:343
52683994632,2cyclictest3657117-1kworker/2:0H+kblockd12:10:152
52683994623,3cyclictest110492-31munin-html08:00:442
52682994642,3cyclictest79553-21kworker/u8:5+flush-179:007:37:011
52682994642,3cyclictest322127-21kworker/u8:3+flush-179:012:10:341
52675994642,3cyclictest74441-21kworker/u8:0+events_unbound07:45:000
52675994631,14cyclictest110554-21kworker/u8:3+flush-179:008:10:010
52685994540,4cyclictest145125-21kworker/u8:4+flush-179:010:00:203
52685994539,4cyclictest177539-21munin-update09:10:153
52683994541,3cyclictest347446-31munin-html11:50:362
52675994543,2cyclictest53150-21kworker/u8:4+flush-179:007:10:210
52685994438,4cyclictest214275-13Chrome_IOThread09:45:023
52683994433,10cyclictest353150-21kworker/2:0+pm12:07:472
52682994438,4cyclictest105765-21latency_hist08:00:021
52675994440,3cyclictest167097-21kworker/u8:3+flush-179:011:00:320
52675994440,3cyclictest167097-21kworker/u8:3+flush-179:010:10:280
52685994338,4cyclictest3125725-21ThreadPoolForeg11:31:543
52683994340,2cyclictest249832-21kworker/2:2+pm11:25:342
52683994340,2cyclictest249832-21kworker/2:2+pm11:25:342
52683994339,3cyclictest140810-31munin-html08:30:362
52683994336,5cyclictest247516-21Chrome_ChildIOT09:57:182
52683994323,19cyclictest247562-13Chrome_ChildIOT10:29:342
52682994341,1cyclictest1260-21snmpd11:21:461
52682994331,11cyclictest182940-21kworker/u8:0+flush-179:009:25:211
52675994339,3cyclictest312204-21kworker/u8:1+events_unbound11:35:210
52675994337,4cyclictest247515-21ThreadPoolForeg10:06:190
52675994327,14cyclictest306197-21kworker/u8:0+flush-179:012:27:150
52685994237,4cyclictest384586-21/usr/share/muni12:30:133
52685994237,4cyclictest360477-21ntpq12:05:183
52685994237,3cyclictest239887-21latency_hist10:10:013
52685994233,7cyclictest3464402-1kworker/3:2H+kblockd12:28:053
52683994236,4cyclictest141811-21/usr/share/muni08:35:142
52683994219,3cyclictest167097-21kworker/u8:3+flush-179:010:10:152
52682994238,3cyclictest3125648-13Chrome_IOThread08:52:101
52682994238,2cyclictest306197-21kworker/u8:0+flush-179:011:45:121
52682994237,4cyclictest110554-21kworker/u8:3+flush-179:008:05:011
52682994231,10cyclictest247561-21ThreadPoolForeg07:25:341
52675994238,3cyclictest306197-21kworker/u8:0+events_unbound11:55:260
52675994238,3cyclictest145125-21kworker/u8:4+flush-179:009:05:100
52675994237,4cyclictest229471-21kworker/u8:0+events_unbound10:50:200
52675994237,3cyclictest100318-21kworker/u8:1+flush-179:008:30:300
52675994236,4cyclictest157515-21/usr/share/muni08:50:050
52675994227,14cyclictest191rcuc/012:20:170
52685994131,9cyclictest3464402-1kworker/3:2H+kblockd09:23:463
52683994136,4cyclictest3125724-21ThreadPoolForeg10:09:582
52683994115,25cyclictest301099-21munin-limits11:05:332
52682994137,3cyclictest47153-21kworker/u8:2+flush-179:007:30:141
52682994136,4cyclictest229471-21kworker/u8:0+events_unbound10:50:291
52682994136,4cyclictest172070-31munin-graph09:01:211
52682994135,4cyclictest255649-21/usr/share/muni10:25:021
52682994135,4cyclictest239522-31munin-html10:05:511
52675994137,3cyclictest145125-21kworker/u8:4+flush-179:010:15:290
52675994137,3cyclictest141284-21kworker/u8:3+flush-179:008:35:020
52675994136,4cyclictest100318-21kworker/u8:1+flush-179:008:10:200
52675994135,5cyclictest260756-21/usr/share/muni10:30:040
5267599410,40cyclictest247545-13VizCompositorTh09:20:210
52685994035,3cyclictest79553-21kworker/u8:5+flush-179:007:33:453
52685994031,8cyclictest3464402-1kworker/3:2H+kblockd07:44:413
5268599400,2cyclictest3125721-21chrome10:10:213
52683994038,1cyclictest1260-21snmpd09:02:452
52683994037,2cyclictest90239-21kworker/2:3+pm08:08:092
52683994037,2cyclictest353150-21kworker/2:0+pm12:18:212
52683994037,2cyclictest249832-21kworker/2:2+pm11:33:312
52683994036,3cyclictest3125724-21ThreadPoolForeg11:40:362
52683994036,2cyclictest353150-21kworker/2:0+pm12:27:382
5268399401,38cyclictest0-21swapper/208:21:092
52682994037,2cyclictest4035035-1kworker/1:0H+kblockd12:35:261
52682994037,2cyclictest4035035-1kworker/1:0H+kblockd12:35:251
52682994036,3cyclictest100318-21kworker/u8:1+events_unbound08:12:021
52682994035,3cyclictest322127-21kworker/u8:3+flush-179:012:32:421
52682994034,4cyclictest60479-21apt-get07:15:151
52682994034,4cyclictest3125451-21mqtt2munin07:20:291
52682994034,4cyclictest3125451-21mqtt2munin07:20:281
52682994033,5cyclictest247516-21Chrome_ChildIOT09:34:541
52682994025,14cyclictest322127-21kworker/u8:3+events_unbound11:40:311
52675994037,2cyclictest322127-21kworker/u8:3+flush-179:012:30:300
52675994036,3cyclictest79553-21kworker/u8:5+flush-179:007:35:320
52675994035,4cyclictest306197-21kworker/u8:0+flush-179:012:00:270
52675994034,4cyclictest157519-1kworker/0:0H+kblockd10:38:470
52685993936,2cyclictest363705-21kworker/u8:1+flush-179:012:10:223
52685993935,3cyclictest3125724-21ThreadPoolForeg12:00:203
52685993934,4cyclictest193571-21/usr/share/muni09:25:093
52683993937,1cyclictest90239-21kworker/2:3+pm08:59:542
52683993937,1cyclictest90239-21kworker/2:3+pm07:50:112
52683993937,1cyclictest63985-21kworker/2:0+pm07:35:282
52683993937,1cyclictest63985-21kworker/2:0+pm07:25:092
52683993937,1cyclictest63985-21kworker/2:0+pm07:21:012
52683993937,1cyclictest63985-21kworker/2:0+pm07:21:012
52683993937,1cyclictest249832-21kworker/2:2+pm11:18:312
52683993936,2cyclictest90239-21kworker/2:3+pm09:31:092
52683993936,2cyclictest90239-21kworker/2:3+pm09:29:202
52683993936,2cyclictest90239-21kworker/2:3+pm09:15:502
52683993936,2cyclictest90239-21kworker/2:3+pm08:54:142
52683993936,2cyclictest90239-21kworker/2:3+pm08:28:052
52683993936,2cyclictest90239-21kworker/2:3+pm08:14:092
52683993936,2cyclictest4186900-21kworker/2:2+pm07:12:332
52683993936,2cyclictest353150-21kworker/2:0+pm12:31:372
52683993936,2cyclictest249832-21kworker/2:2+pm10:50:292
52683993936,2cyclictest249832-21kworker/2:2+pm10:35:352
5268399393,35cyclictest3125728-13Compositor07:41:462
52683993926,12cyclictest3657117-1kworker/2:0H+kblockd09:09:102
52683993926,12cyclictest1260-21snmpd10:20:012
5268399391,13cyclictest247545-13VizCompositorTh11:56:092
52682993934,4cyclictest295998-31munin-html11:00:351
52682993932,5cyclictest301104-21ntpq11:05:331
52682993932,5cyclictest136714-21/usr/share/muni08:30:131
52675993936,2cyclictest100318-21kworker/u8:1+events_unbound07:51:270
52675993935,3cyclictest145125-21kworker/u8:4+flush-179:009:55:230
52675993934,4cyclictest363705-21kworker/u8:1+flush-179:012:10:360
52675993934,3cyclictest3133125-1kworker/0:1H+kblockd07:55:110
52675993933,4cyclictest247516-21Chrome_ChildIOT08:20:250
52675993933,4cyclictest167097-21kworker/u8:3+events_unbound08:57:380
5267599392,29cyclictest3125629-21e21169fc69a4c6711:40:090
5267599390,38cyclictest3125629-21e21169fc69a4c6709:25:070
52685993836,1cyclictest3464402-1kworker/3:2H+kblockd10:16:003
52685993835,2cyclictest3125721-21chrome08:08:123
52685993834,2cyclictest3464402-1kworker/3:2H+kblockd08:00:033
52685993833,4cyclictest69881-21/usr/share/muni07:25:053
52685993833,4cyclictest203161-31munin-graph09:31:443
52683993836,1cyclictest249832-21kworker/2:2+pm10:34:592
52683993836,1cyclictest249832-21kworker/2:2+pm10:20:192
52683993835,2cyclictest90239-21kworker/2:3+pm08:40:352
52683993835,2cyclictest90239-21kworker/2:3+pm07:46:362
52683993835,2cyclictest63985-21kworker/2:0+pm07:34:182
52683993835,2cyclictest3657117-1kworker/2:0H+kblockd08:46:222
52683993835,2cyclictest3657117-1kworker/2:0H+kblockd08:17:512
52683993835,2cyclictest249832-21kworker/2:2+pm11:20:012
52683993835,2cyclictest249832-21kworker/2:2+pm10:58:302
52683993834,3cyclictest213781-21kworker/2:0+pm10:00:072
52683993834,3cyclictest207912-31munin-html09:35:342
52683993834,3cyclictest207912-31munin-html09:35:342
52683993834,2cyclictest3657117-1kworker/2:0H+kblockd09:41:092
5268399380,5cyclictest3125684-21Chrome_DevTools12:01:272
52682993835,2cyclictest4035035-1kworker/1:0H+kblockd11:11:251
52675993835,2cyclictest37236-21kworker/u8:1+events_unbound07:20:190
52675993835,2cyclictest37236-21kworker/u8:1+events_unbound07:20:190
52675993835,2cyclictest317765-1kworker/0:2H+kblockd11:34:100
52675993835,2cyclictest167097-21kworker/u8:3+flush-179:011:10:240
52675993833,4cyclictest3133125-1kworker/0:1H+kblockd08:03:050
52675993823,3cyclictest247573-21ThreadPoolForeg11:07:490
52685993735,1cyclictest3464402-1kworker/3:2H+kblockd09:03:233
52685993734,2cyclictest3464402-1kworker/3:2H+kblockd12:40:023
52685993734,2cyclictest3464402-1kworker/3:2H+kblockd12:40:023
52685993734,2cyclictest3464402-1kworker/3:2H+kblockd11:18:133
52685993734,2cyclictest3464402-1kworker/3:2H+kblockd09:52:323
52685993734,2cyclictest3464402-1kworker/3:2H+kblockd08:55:353
52685993733,3cyclictest208259-31munin-html09:35:523
52685993733,3cyclictest208259-31munin-html09:35:523
52685993733,2cyclictest3464402-1kworker/3:2H+kblockd09:16:253
52685993733,2cyclictest3464402-1kworker/3:2H+kblockd08:31:033
52685993731,5cyclictest131599-21/usr/share/muni08:25:043
52683993736,1cyclictest90239-21kworker/2:3+pm07:58:372
52683993735,1cyclictest353150-21kworker/2:0+pm12:35:212
52683993735,1cyclictest353150-21kworker/2:0+pm12:35:202
52683993734,2cyclictest249832-21kworker/2:2+pm11:39:112
52683993734,2cyclictest249832-21kworker/2:2+pm10:44:062
5268399371,14cyclictest3125721-21chrome12:21:102
52682993734,2cyclictest4035035-1kworker/1:0H+kblockd08:23:131
52682993734,2cyclictest3125724-21ThreadPoolForeg07:52:561
52682993734,2cyclictest3125721-21chrome09:45:091
52682993733,3cyclictest306197-21kworker/u8:0+flush-179:011:16:181
52682993733,3cyclictest247563-13Compositor11:25:341
52682993733,3cyclictest247563-13Compositor11:25:341
52682993733,2cyclictest4035035-1kworker/1:0H+kblockd11:34:061
52682993733,2cyclictest379594-21snmp_ryswitch2.12:25:011
52682993732,3cyclictest4035035-1kworker/1:0H+kblockd10:31:061
52682993731,4cyclictest121080-21munin-update08:15:041
52682993729,7cyclictest247560-21ThreadPoolForeg08:08:061
52675993734,2cyclictest317765-1kworker/0:2H+kblockd12:18:190
52675993733,3cyclictest145125-21kworker/u8:4+flush-179:009:50:360
52675993733,3cyclictest136122-21kworker/u8:2+events_unbound09:10:350
52675993722,13cyclictest247563-13Compositor07:17:300
52675993721,4cyclictest234150-21munin-limits10:00:370
52685993634,1cyclictest3464402-1kworker/3:2H+kblockd11:11:173
52685993634,1cyclictest286749-21kworker/3:0+pm11:56:223
52685993633,2cyclictest4192170-21kworker/3:1+pm07:37:063
52685993633,2cyclictest3464402-1kworker/3:2H+kblockd07:55:343
52685993633,2cyclictest3464402-1kworker/3:2H+kblockd07:21:103
52685993633,2cyclictest3464402-1kworker/3:2H+kblockd07:21:103
52685993633,2cyclictest280940-21kworker/u8:2+flush-179:011:03:053
52685993632,2cyclictest3464402-1kworker/3:2H+kblockd12:20:013
52685993629,6cyclictest3464402-1kworker/3:2H+kblockd10:31:503
5268599361,33cyclictest3125709-13VizCompositorTh10:25:323
52682993631,4cyclictest306197-21kworker/u8:0+flush-179:012:20:141
52682993630,4cyclictest100318-21kworker/u8:1+flush-179:008:25:591
52682993629,5cyclictest247516-21Chrome_ChildIOT10:55:291
52682993629,5cyclictest245237-21/usr/share/muni10:15:181
52675993632,3cyclictest317765-1kworker/0:2H+kblockd12:07:140
52675993632,2cyclictest157519-1kworker/0:0H+kblockd10:40:160
52675993631,4cyclictest374106-21kworker/u8:1+events_unbound12:35:190
52675993631,4cyclictest374106-21kworker/u8:1+events_unbound12:35:180
52685993534,1cyclictest3464402-1kworker/3:2H+kblockd07:16:573
52685993532,2cyclictest3464402-1kworker/3:2H+kblockd11:41:593
52685993532,2cyclictest3464402-1kworker/3:2H+kblockd11:21:153
52685993532,2cyclictest3464402-1kworker/3:2H+kblockd09:08:443
52685993532,2cyclictest3464402-1kworker/3:2H+kblockd08:14:533
52685993532,2cyclictest3125728-13Compositor07:14:143
52685993532,2cyclictest286749-21kworker/3:0+pm11:52:433
52685993531,3cyclictest286471-21kworker/u8:5+flush-179:010:56:143
52685993531,2cyclictest3464402-1kworker/3:2H+kblockd11:48:213
52685993520,14cyclictest3125726-13Chrome_ChildIOT10:24:333
52682993532,2cyclictest4035035-1kworker/1:0H+kblockd12:03:461
52682993532,2cyclictest4035035-1kworker/1:0H+kblockd11:56:291
52682993532,2cyclictest4035035-1kworker/1:0H+kblockd10:11:011
52682993532,2cyclictest4035035-1kworker/1:0H+kblockd07:45:011
52682993531,2cyclictest4035035-1kworker/1:0H+kblockd10:36:041
52682993531,2cyclictest4035035-1kworker/1:0H+kblockd10:20:531
52682993530,4cyclictest182940-21kworker/u8:0+flush-179:009:15:061
52675993532,2cyclictest157519-1kworker/0:0H+kblockd10:56:360
52675993531,3cyclictest172070-31munin-graph09:01:020
52685993432,1cyclictest3464402-1kworker/3:2H+kblockd11:28:003
52685993432,1cyclictest3464402-1kworker/3:2H+kblockd11:28:003
52685993432,1cyclictest3464402-1kworker/3:2H+kblockd09:56:423
52685993432,1cyclictest3464402-1kworker/3:2H+kblockd08:16:403
52685993431,2cyclictest3125708-13Chrome_ChildIOT08:20:193
52682993431,2cyclictest4035035-1kworker/1:0H+kblockd11:50:051
52682993431,2cyclictest3125599-21python308:58:291
52675993431,2cyclictest3133125-1kworker/0:1H+kblockd08:25:120
52682993330,2cyclictest4035035-1kworker/1:0H+kblockd10:00:151
52682993330,2cyclictest177318-21kworker/u8:1+flush-179:009:10:061
52682993329,2cyclictest4035035-1kworker/1:0H+kblockd12:19:591
52685993231,1cyclictest3464402-1kworker/3:2H+kblockd11:39:123
52685993230,2cyclictest1260-21snmpd10:37:423
52682993230,1cyclictest4035035-1kworker/1:0H+kblockd09:35:171
52682993230,1cyclictest4035035-1kworker/1:0H+kblockd09:35:171
52682993229,2cyclictest4035035-1kworker/1:0H+kblockd09:05:401
52682993229,2cyclictest1260-21snmpd09:40:481
52682993228,3cyclictest47153-21kworker/u8:2+events_unbound07:40:361
52682993228,3cyclictest4035035-1kworker/1:0H+kblockd09:52:521
52682993227,4cyclictest363581-31munin-graph12:06:111
52682993128,2cyclictest146949-21apache_processe08:40:011
52675993124,5cyclictest148263-21apt-get08:40:160
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional