You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 12:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rackbslot1.osadl.org (updated Thu May 01, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31474402207178,20sleep10-21swapper/107:07:261
31473222197174,14sleep20-21swapper/207:06:222
31476822190165,15sleep00-21swapper/007:09:380
31474042190166,14sleep30-21swapper/307:07:073
3147891996863,3cyclictest3368177-21snmp_wlanpowerc10:45:020
3147891996759,6cyclictest3451129-21HangWatcher12:25:170
3147894996661,3cyclictest3605936-13chrome11:45:031
3147894996359,3cyclictest3460025-21kworker/u8:1+flush-179:012:20:171
3147894996359,3cyclictest3460025-21kworker/u8:1+flush-179:012:20:171
3147894996157,3cyclictest3460774-21apt-get12:15:081
3147894996054,4cyclictest3403643-21/usr/share/muni11:20:151
3147891996055,4cyclictest3161312-21kworker/u8:4+flush-179:007:40:320
3147894995954,4cyclictest2721483-21apache212:25:031
3147891995752,4cyclictest3439429-21/usr/share/muni11:55:150
3147891995652,3cyclictest3413336-21kworker/u8:4+flush-179:012:10:170
3147894995548,4cyclictest3439429-21/usr/share/muni11:55:101
3147891995552,2cyclictest3280871-21kworker/u8:0+flush-179:010:00:180
3147891995551,3cyclictest3132184-21kworker/u8:3+flush-179:007:15:140
3147897995450,3cyclictest3423457-21kworker/u8:0+flush-179:011:56:112
3147891995250,2cyclictest3258774-21kworker/u8:2+flush-179:009:50:350
3147891995248,3cyclictest3449010-21kworker/u8:2+flush-179:012:05:010
314789199520,50cyclictest3184877-21exe07:45:020
3147897995130,20cyclictest3368140-21Chrome_ChildIOT10:45:122
3147894995136,3cyclictest3184867-21chrome07:45:021
3147891995148,2cyclictest3413336-21kworker/u8:4+flush-179:012:05:210
3147891995148,2cyclictest3258774-21kworker/u8:2+flush-179:009:20:170
3147891995147,3cyclictest3258774-21kworker/u8:2+flush-179:009:59:080
3147891995147,3cyclictest3258774-21kworker/u8:2+flush-179:009:59:080
3147891995146,3cyclictest3351832-21kworker/u8:1+events_unbound10:35:180
3147901995041,7cyclictest3164572-21/usr/share/muni07:25:083
3147897995047,2cyclictest3423457-21kworker/u8:0+flush-179:012:05:012
3147891995047,2cyclictest3280871-21kworker/u8:0+flush-179:011:05:180
3147891995046,3cyclictest3111643-21kworker/u8:1+events_unbound08:38:180
3147891995044,4cyclictest3398506-21/usr/share/muni11:15:040
314789199500,48cyclictest3606033-13Compositor09:00:180
3147901994944,3cyclictest3460091-21latency_hist12:15:013
3147897994945,3cyclictest3111643-21kworker/u8:1+flush-179:007:45:202
3147891994945,3cyclictest3362199-21kworker/u8:3+flush-179:011:20:170
3147897994844,3cyclictest3280871-21kworker/u8:0+flush-179:010:10:342
3147897994844,3cyclictest3280871-21kworker/u8:0+events_unbound10:20:182
3147897994844,3cyclictest3189323-21kworker/u8:0+flush-179:008:20:322
3147891994844,3cyclictest3258774-21kworker/u8:2+flush-179:009:15:170
3147897994745,1cyclictest3347483-21kworker/2:0+pm10:29:382
3147897994743,3cyclictest3137291-21kworker/u8:2+flush-179:007:40:082
3147897994738,6cyclictest3226001-21/usr/share/muni08:25:042
3147894994741,4cyclictest3266366-21/usr/share/muni09:05:041
3147894994741,4cyclictest3266366-21/usr/share/muni09:05:041
3147891994744,2cyclictest3377745-21kworker/u8:1+flush-179:011:35:340
3147891994743,3cyclictest3377745-21kworker/u8:1+flush-179:011:42:230
33377702460,1chrt3337765-21apache_volume10:15:022
32614242460,1chrt3261418-21snmp_wanswitch.09:00:023
3147897994642,3cyclictest3280871-21kworker/u8:0+flush-179:011:10:172
3147897994641,4cyclictest3165920-21apt-get07:25:152
3147894994641,4cyclictest3230618-21munin-update08:30:331
3147894994641,4cyclictest3205369-21/usr/share/muni08:05:021
3147891994642,3cyclictest3481022-21/usr/share/muni12:35:230
3147891994641,4cyclictest3225817-21/usr/share/muni08:25:130
3147891994632,13cyclictest3280871-21kworker/u8:0+flush-179:010:30:170
3147897994541,3cyclictest3413336-21kworker/u8:4+flush-179:012:25:062
3147897994540,4cyclictest3111643-21kworker/u8:1+flush-179:009:20:362
3147894994541,3cyclictest3352867-21/usr/share/muni10:30:011
3147894994541,3cyclictest3335049-21systemd-journal10:55:241
3147891994541,3cyclictest3460025-21kworker/u8:1+events_unbound12:24:370
3147891994541,3cyclictest3460025-21kworker/u8:1+events_unbound12:24:370
3147901994439,3cyclictest3362199-21kworker/u8:3+events_unbound10:50:193
3147901994439,3cyclictest3362199-21kworker/u8:3+events_unbound10:50:193
3147901994438,4cyclictest3409116-21apt-get11:25:093
3147901994431,12cyclictest2710489-1kworker/3:1H+kblockd09:28:173
3147897994440,3cyclictest3131904-1kworker/2:0H+kblockd07:50:162
3147897994438,4cyclictest3200517-21/usr/share/muni08:00:032
3147897994437,5cyclictest3451073-20chrome09:25:142
3147894994441,2cyclictest3240328-21kworker/u8:5+flush-179:009:10:351
3147894994440,3cyclictest3321460-21kworker/u8:4+flush-179:010:05:081
3147894994440,2cyclictest3335049-21systemd-journal11:35:141
3147891994440,3cyclictest3111643-21kworker/u8:1+flush-179:010:05:210
314789199441,40cyclictest3606026-21chrome09:05:200
314789199441,40cyclictest3606026-21chrome09:05:200
314789199440,43cyclictest3451073-20chrome10:20:390
3147901994339,3cyclictest3111643-21kworker/u8:1+flush-179:009:36:243
3147901994336,5cyclictest3193904-31munin-html07:50:353
3147897994339,3cyclictest3111643-21kworker/u8:1+flush-179:008:45:012
3147897994339,3cyclictest3111643-21kworker/u8:1+flush-179:008:45:002
3147897994328,14cyclictest3131904-1kworker/2:0H+kblockd08:34:482
3147894994339,3cyclictest3335049-21systemd-journal08:20:171
3147891994340,2cyclictest3423457-21kworker/u8:0+events_unbound12:15:140
3147891994340,2cyclictest3183623-21kworker/u8:3+flush-179:008:45:160
3147891994340,2cyclictest3183623-21kworker/u8:3+flush-179:008:15:210
3147891994338,4cyclictest3111643-21kworker/u8:1+flush-179:008:05:150
3147901994238,3cyclictest3460025-21kworker/u8:1+flush-179:012:35:183
3147897994239,2cyclictest3132184-21kworker/u8:3+flush-179:007:15:082
3147897994238,3cyclictest3606047-21ThreadPoolForeg07:35:432
3147897994238,3cyclictest3183623-21kworker/u8:3+events_unbound08:56:212
3147897994238,3cyclictest3161536-21kworker/u8:6+flush-179:008:10:352
3147897994237,3cyclictest3362199-21kworker/u8:3+flush-179:010:55:362
3147897994236,4cyclictest3301000-31munin-graph09:36:092
3147894994239,2cyclictest3137291-21kworker/u8:2+events_unbound07:50:211
3147891994239,2cyclictest3321460-21kworker/u8:4+flush-179:010:25:210
3147891994238,3cyclictest3240328-21kworker/u8:5+flush-179:009:35:310
3147891994238,3cyclictest3169623-21/usr/share/muni07:30:040
3147891994238,3cyclictest3111643-21kworker/u8:1+events_unbound08:00:180
3147901994138,2cyclictest3189323-21kworker/u8:0+flush-179:008:15:003
3147901994137,2cyclictest3429159-21snmp_wlanswitch11:45:023
3147901994125,15cyclictest3137291-21kworker/u8:2+flush-179:007:35:533
3147897994138,2cyclictest3413083-21kworker/2:2+pm11:27:132
3147897994114,25cyclictest3163795-31munin-html07:20:402
3147894994137,3cyclictest3413336-21kworker/u8:4+flush-179:012:35:081
3147894994137,3cyclictest3336897-31munin-graph10:10:491
3147894994136,3cyclictest3261074-21munin-update09:00:161
3147891994139,2cyclictest3111643-21kworker/u8:1+events_unbound09:25:220
3147891994138,2cyclictest3183623-21kworker/u8:3+flush-179:008:59:440
3147891994138,2cyclictest3161536-21kworker/u8:6+flush-179:007:55:140
3147891994138,2cyclictest3111643-21kworker/u8:1+flush-179:007:50:170
3147891994136,4cyclictest3377156-21munin-limits10:50:340
3147891994136,4cyclictest3377156-21munin-limits10:50:340
314789199410,40cyclictest3451163-21chrome10:15:140
3147901994037,2cyclictest2710489-1kworker/3:1H+kblockd10:21:133
3147901994035,4cyclictest3280871-21kworker/u8:0+flush-179:011:19:423
3147901994035,3cyclictest2710489-1kworker/3:1H+kblockd11:44:073
3147901994035,3cyclictest2710489-1kworker/3:1H+kblockd10:55:013
3147901994034,5cyclictest3450113-21/usr/share/muni12:05:083
3147901994033,5cyclictest3327576-21/usr/share/muni10:05:043
3147901994028,10cyclictest3451131-21ThreadPoolForeg09:20:133
3147897994038,1cyclictest3433888-21kworker/2:2+pm12:16:182
3147897994038,1cyclictest3209837-21kworker/2:2+pm08:16:002
3147897994038,1cyclictest3145319-21kworker/2:2+pm07:10:162
3147897994037,2cyclictest3433888-21kworker/2:2+pm12:09:432
3147897994037,2cyclictest3347483-21kworker/2:0+pm10:34:142
3147897994037,2cyclictest3321482-21kworker/2:1+pm10:00:042
3147897994037,2cyclictest3296089-21kworker/2:0+pm09:54:332
3147897994037,2cyclictest3245566-21kworker/2:0+pm08:46:122
3147897994036,2cyclictest3296089-21kworker/2:0+pm09:40:352
314789799401,37cyclictest3606026-21chrome09:06:082
314789799401,37cyclictest3606026-21chrome09:06:082
3147897994012,26cyclictest0-21swapper/211:06:162
314789799401,14cyclictest3606026-21chrome11:15:412
314789799400,3cyclictest3306930-21snmp_wanpowerct09:45:022
3147894994038,1cyclictest3306865-1kworker/1:2H+kblockd11:03:421
3147894994037,2cyclictest3132184-21kworker/u8:3+flush-179:007:10:371
3147894994035,3cyclictest3246034-21/usr/share/muni08:45:201
3147894994034,5cyclictest3451167-21ThreadPoolForeg07:40:141
3147891994037,3cyclictest3183623-21kworker/u8:3+flush-179:008:40:080
3147891994037,3cyclictest3183623-21kworker/u8:3+flush-179:008:40:080
3147901993936,2cyclictest3258774-21kworker/u8:2+flush-179:009:50:043
3147901993934,4cyclictest2710489-1kworker/3:1H+kblockd11:59:253
3147901993934,3cyclictest3260091-21munin-limits08:55:333
3147901993911,27cyclictest3451163-21chrome08:05:193
3147897993937,1cyclictest3397322-21kworker/2:1+pm11:35:572
3147897993937,1cyclictest3397322-21kworker/2:1+pm11:23:242
3147897993937,1cyclictest3266080-21kworker/2:1+pm09:32:162
3147897993936,2cyclictest3480165-21kworker/2:1+pm12:35:022
3147897993936,2cyclictest3433888-21kworker/2:2+pm12:10:142
3147897993936,2cyclictest3364435-21kworker/2:1+pm10:41:132
3147897993936,2cyclictest3163920-21kworker/2:1+pm07:33:582
3147897993934,4cyclictest3397322-21kworker/2:1+pm11:34:432
3147897993934,4cyclictest3131904-1kworker/2:0H+kblockd10:52:402
3147897993934,4cyclictest3131904-1kworker/2:0H+kblockd10:52:402
3147897993934,3cyclictest3433110-21kworker/u8:3+flush-179:011:50:172
3147894993935,3cyclictest3246043-21/usr/share/muni08:45:021
3147894993933,5cyclictest3235891-21/usr/share/muni08:35:011
3147894993933,5cyclictest3196680-21apt-get07:55:151
3147891993937,1cyclictest3200123-21kworker/0:0+pm08:21:260
3147891993936,2cyclictest3280871-21kworker/u8:0+flush-179:010:10:210
3147891993936,2cyclictest3280871-21kworker/u8:0+events_unbound10:40:200
3147891993935,3cyclictest3377745-21kworker/u8:1+flush-179:011:00:310
3147891993935,3cyclictest3258774-21kworker/u8:2+flush-179:009:30:260
3147901993834,3cyclictest2710489-1kworker/3:1H+kblockd08:45:123
3147901993833,4cyclictest3367766-21latency_hist10:45:013
3147901993833,3cyclictest2710489-1kworker/3:1H+kblockd07:22:263
3147901993832,4cyclictest3451132-21Chrome_ChildIOT12:20:143
3147901993832,4cyclictest3451132-21Chrome_ChildIOT12:20:143
3147901993831,5cyclictest3318916-21ntpq09:55:183
3147901993831,5cyclictest3318916-21ntpq09:55:173
3147897993836,1cyclictest3397322-21kworker/2:1+pm11:47:202
3147897993836,1cyclictest3397322-21kworker/2:1+pm11:41:562
3147897993836,1cyclictest3245566-21kworker/2:0+pm08:53:092
3147897993835,2cyclictest3321482-21kworker/2:1+pm10:05:192
3147897993835,2cyclictest3266080-21kworker/2:1+pm09:16:282
3147897993835,2cyclictest3266080-21kworker/2:1+pm09:14:192
3147897993835,2cyclictest3250886-21kworker/2:2+pm09:03:572
3147897993835,2cyclictest3209837-21kworker/2:2+pm08:35:352
3147897993834,2cyclictest3184248-21kworker/2:0+pm07:58:322
3147894993836,2cyclictest3164204-21kworker/1:2+pm08:12:061
3147894993836,1cyclictest3367663-21kworker/1:1+pm11:28:501
3147894993836,1cyclictest3336332-21kworker/1:2+pm10:38:431
3147894993832,5cyclictest3475737-21/usr/share/muni12:30:041
3147891993835,2cyclictest3183623-21kworker/u8:3+events_unbound08:50:360
3147891993835,2cyclictest3161312-21kworker/u8:4+flush-179:007:40:010
3147891993834,3cyclictest3280871-21kworker/u8:0+flush-179:011:25:160
3147891993834,3cyclictest3161312-21kworker/u8:4+flush-179:007:25:340
3147891993833,4cyclictest3434086-21latency_hist11:50:010
3147891993823,14cyclictest3280871-21kworker/u8:0+flush-179:009:45:070
314789199381,36cyclictest3606026-21chrome09:40:130
3147901993735,1cyclictest3316662-21kworker/3:0+pm10:18:223
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd12:25:183
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd09:34:043
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd09:06:343
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd09:06:343
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd08:37:333
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd07:55:053
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd07:49:253
3147901993734,2cyclictest2710489-1kworker/3:1H+kblockd07:11:523
3147901993732,4cyclictest3434328-21/usr/share/muni11:50:063
3147901993731,5cyclictest3170853-21apt-get07:30:143
3147901993731,4cyclictest3183623-21kworker/u8:3+flush-179:009:10:163
3147897993735,1cyclictest3357637-21kworker/2:2+pm10:35:142
3147897993735,1cyclictest3184248-21kworker/2:0+pm08:05:092
3147897993734,2cyclictest3296089-21kworker/2:0+pm09:55:132
3147897993734,2cyclictest3296089-21kworker/2:0+pm09:55:132
3147894993734,2cyclictest3397863-21kworker/u8:2+flush-179:011:50:341
3147894993734,2cyclictest3111643-21kworker/u8:1+flush-179:009:51:491
3147894993734,2cyclictest2942166-1kworker/1:0H+kblockd09:32:491
3147894993734,2cyclictest2942166-1kworker/1:0H+kblockd08:19:101
3147894993732,3cyclictest2942166-1kworker/1:0H+kblockd08:25:191
3147891993734,2cyclictest3362199-21kworker/u8:3+events_unbound10:55:170
3147891993733,3cyclictest3413336-21kworker/u8:4+flush-179:011:30:330
3147891993733,3cyclictest3161536-21kworker/u8:6+flush-179:008:30:140
314789199370,35cyclictest1-21systemd07:20:210
3147901993634,1cyclictest2710489-1kworker/3:1H+kblockd08:52:163
3147901993634,1cyclictest1276-21snmpd08:27:153
3147901993633,2cyclictest2710489-1kworker/3:1H+kblockd11:09:453
3147901993633,2cyclictest2710489-1kworker/3:1H+kblockd08:30:353
3147901993633,2cyclictest2710489-1kworker/3:1H+kblockd07:19:423
3147901993632,2cyclictest3606033-13Compositor11:30:173
3147901993630,5cyclictest3451166-21ThreadPoolForeg11:37:043
3147901993630,5cyclictest3332609-21/usr/share/muni10:10:043
3147897993634,1cyclictest3364435-21kworker/2:1+pm11:00:322
3147897993633,2cyclictest3480165-21kworker/2:1+pm12:35:052
314789499366,28cyclictest0-21swapper/110:22:011
3147894993635,1cyclictest1276-21snmpd11:19:571
3147894993634,1cyclictest3336332-21kworker/1:2+pm10:27:081
3147894993633,2cyclictest3306865-1kworker/1:2H+kblockd12:00:331
3147894993633,2cyclictest3306865-1kworker/1:2H+kblockd11:41:111
3147894993633,2cyclictest3306865-1kworker/1:2H+kblockd09:45:231
3147894993633,2cyclictest2942166-1kworker/1:0H+kblockd09:43:541
3147894993632,3cyclictest3322390-21/usr/share/muni10:00:171
3147894993632,3cyclictest3317080-21/usr/share/muni09:55:131
3147894993632,3cyclictest3317080-21/usr/share/muni09:55:131
3147894993632,3cyclictest3173905-31munin-graph07:30:511
3147891993634,1cyclictest3159707-1kworker/0:2H+kblockd08:11:240
3147891993633,2cyclictest3091008-21kworker/u8:0+flush-179:007:10:210
3147891993632,3cyclictest3183623-21kworker/u8:3+events_unbound09:10:060
3147901993533,1cyclictest2710489-1kworker/3:1H+kblockd09:19:103
3147901993533,1cyclictest2710489-1kworker/3:1H+kblockd08:19:103
3147901993532,2cyclictest2710489-1kworker/3:1H+kblockd11:23:543
3147901993532,2cyclictest2710489-1kworker/3:1H+kblockd10:35:063
3147901993532,2cyclictest2710489-1kworker/3:1H+kblockd09:45:323
3147901993532,2cyclictest2710489-1kworker/3:1H+kblockd09:40:033
3147901993532,2cyclictest2710489-1kworker/3:1H+kblockd07:44:473
3147897993530,4cyclictest3469475-31munin-html12:20:352
3147897993530,4cyclictest3469475-31munin-html12:20:352
3147894993533,1cyclictest3306865-1kworker/1:2H+kblockd10:40:071
3147894993533,1cyclictest2942166-1kworker/1:0H+kblockd09:25:131
3147894993533,1cyclictest2942166-1kworker/1:0H+kblockd07:25:031
3147894993532,2cyclictest3306865-1kworker/1:2H+kblockd10:53:531
3147894993532,2cyclictest3306865-1kworker/1:2H+kblockd10:53:531
3147894993531,3cyclictest3111643-21kworker/u8:1+flush-179:010:15:081
3147891993532,2cyclictest3605991-21ThreadPoolForeg11:50:180
3147891993531,3cyclictest3280871-21kworker/u8:0+events_unbound11:10:100
3147901993432,1cyclictest2710489-1kworker/3:1H+kblockd10:30:033
3147901993431,2cyclictest2710489-1kworker/3:1H+kblockd11:14:173
3147901993431,2cyclictest2710489-1kworker/3:1H+kblockd11:00:283
3147901993431,2cyclictest2710489-1kworker/3:1H+kblockd10:26:233
3147901993431,2cyclictest2710489-1kworker/3:1H+kblockd08:41:113
3147901993431,2cyclictest2710489-1kworker/3:1H+kblockd08:41:113
3147901993422,11cyclictest3443862-21kworker/u8:1+flush-179:012:00:153
3147894993433,1cyclictest3306865-1kworker/1:2H+kblockd12:07:031
3147894993432,2cyclictest2942166-1kworker/1:0H+kblockd09:22:331
3147894993432,1cyclictest3142321-21kworker/1:0+pm07:24:581
3147894993431,1cyclictest3306865-1kworker/1:2H+kblockd11:30:071
3147894993428,4cyclictest3260190-31munin-html08:55:361
3147901993331,1cyclictest2710489-1kworker/3:1H+kblockd08:20:063
3147901993330,2cyclictest1276-21snmpd12:15:503
3147894993331,1cyclictest2942166-1kworker/1:0H+kblockd07:36:111
3147894993328,4cyclictest3393788-21python311:10:071
3147901993230,1cyclictest1276-21snmpd12:32:303
3147901993230,1cyclictest1276-21snmpd08:01:593
3147901993229,2cyclictest3606033-13Compositor10:03:383
3147901993227,4cyclictest3362199-21kworker/u8:3+flush-179:010:45:073
3147894993230,1cyclictest3367663-21kworker/1:1+pm10:46:201
3147894993229,2cyclictest2942166-1kworker/1:0H+kblockd09:15:571
3147894993229,2cyclictest2942166-1kworker/1:0H+kblockd08:09:211
3147891993227,3cyclictest3606033-13Compositor12:32:210
3147894993129,1cyclictest2854065-21isc-net-000008:43:191
3147894993128,2cyclictest3606033-13Compositor07:16:531
3147894992929,0cyclictest1276-21snmpd11:08:351
3147894992927,1cyclictest1276-21snmpd12:13:131
3147894992927,1cyclictest1276-21snmpd09:36:351
3147894992824,3cyclictest3251233-21/usr/share/muni08:50:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional