You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-06-28 - 23:27
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackbslot1.osadl.org (updated Sat Jun 28, 2025 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31456042216188,18sleep20-21swapper/207:07:112
31457712209186,14sleep00-21swapper/007:09:170
31455682204155,35sleep30-21swapper/307:06:433
31455282197173,14sleep10-21swapper/107:06:141
33593102750,2sleep01515609-21ThreadPoolForeg10:35:280
33759812720,0chrt3375976-21/usr/sbin/munin10:55:000
3146039997168,2cyclictest3193052-21kworker/u8:1+flush-179:007:55:193
3146039997166,3cyclictest3365469-21latency_hist10:45:013
3146031996354,5cyclictest3365773-21chrome10:45:011
3146034996259,2cyclictest3395874-21kworker/u8:0+flush-179:011:30:202
3146031996257,4cyclictest1515606-21ThreadPoolForeg08:10:271
3146034996154,3cyclictest3445972-21kworker/u8:0+events_unbound12:30:202
3146039996044,2cyclictest3304537-13chrome09:45:013
3146029995955,3cyclictest3380412-21kworker/u8:1+events_unbound11:10:200
3146034995855,2cyclictest3401401-21kworker/u8:3+events_unbound11:25:192
3146034995852,3cyclictest3159658-21kworker/u8:2+events_unbound07:40:102
3146029995854,3cyclictest3324291-21kworker/u8:5+flush-179:010:15:190
3146039995649,2cyclictest3193421-21kworker/u8:4+flush-179:008:10:193
3146034995650,2cyclictest3420922-21kworker/u8:1+events_unbound12:05:172
3146039995551,3cyclictest3268773-21kworker/u8:1+flush-179:009:20:103
3146034995550,4cyclictest3176887-21kworker/u8:3+events_unbound08:10:032
3146034995450,3cyclictest3261790-21kworker/u8:2+flush-179:009:10:182
3146031995449,4cyclictest3218345-21/usr/share/muni08:20:001
3146029995450,3cyclictest3294120-21kworker/u8:0+flush-179:009:45:140
3146034995350,2cyclictest3294120-21kworker/u8:0+flush-179:009:35:362
3146034995350,2cyclictest3193052-21kworker/u8:1+flush-179:008:40:052
3146034995349,2cyclictest3116066-21kworker/u8:0+events_unbound07:15:102
3146031995350,2cyclictest3116066-21kworker/u8:0+events_unbound07:20:181
3146039995249,2cyclictest3330734-21kworker/u8:0+flush-179:010:10:173
3146034995248,3cyclictest3261790-21kworker/u8:2+events_unbound09:22:362
3146031995249,2cyclictest3253549-21kworker/u8:4+events_unbound08:55:071
3146029995249,2cyclictest3426567-21kworker/u8:3+flush-179:011:45:220
3146039995147,3cyclictest3213444-21kworker/u8:2+flush-179:008:20:193
3146034995145,3cyclictest3365834-21/usr/sbin/munin10:45:012
3146031995147,3cyclictest3451814-21latency_hist12:10:011
3146031995147,3cyclictest3323231-21kworker/u8:3+flush-179:010:15:021
3146031995143,7cyclictest3176887-21kworker/u8:3+flush-179:007:45:351
3146029995148,2cyclictest3350081-21kworker/u8:2+events_unbound10:50:100
3146029995148,2cyclictest3261790-21kworker/u8:2+flush-179:009:15:160
3146029995148,2cyclictest3193052-21kworker/u8:1+events_unbound08:05:080
3146039995047,2cyclictest3176887-21kworker/u8:3+flush-179:007:45:373
3146034995047,2cyclictest3324291-21kworker/u8:5+events_unbound10:20:002
3146034995046,2cyclictest3212936-21kworker/2:1+pm08:40:022
3146034995045,2cyclictest3324291-21kworker/u8:5+events_unbound10:05:072
3146031995046,3cyclictest3436345-21munin-update11:55:331
3146031995046,3cyclictest3131260-21kworker/u8:4+events_unbound07:25:281
3146029995048,2cyclictest3116066-21kworker/u8:0+flush-179:007:10:120
3146029995047,2cyclictest3390480-21kworker/u8:2+flush-179:011:20:190
32338162490,1chrt3233807-21snmp_ryswitch.c08:35:023
3146039994946,2cyclictest3193421-21kworker/u8:4+flush-179:008:05:193
3146034994946,2cyclictest3212936-21kworker/2:1+pm08:30:052
3146034994936,12cyclictest3462168-21kworker/2:1+pm12:23:482
3146029994946,2cyclictest3298333-21kworker/u8:4+flush-179:009:40:380
3146029994945,3cyclictest3395874-21kworker/u8:0+flush-179:011:25:110
3146039994846,2cyclictest3324291-21kworker/u8:5+events_unbound10:25:133
3146039994845,3cyclictest3350081-21kworker/u8:2+flush-179:010:45:203
3146034994845,2cyclictest3193052-21kworker/u8:1+flush-179:008:00:092
3146031994833,14cyclictest2720794-21apache212:15:231
3146029994845,2cyclictest3220739-21kworker/u8:0+flush-179:008:30:120
3146029994844,3cyclictest3213444-21kworker/u8:2+events_unbound08:15:180
3146034994744,2cyclictest3176887-21kworker/u8:3+events_unbound07:45:292
3146029994744,2cyclictest3131260-21kworker/u8:4+flush-179:007:40:320
3146039994643,2cyclictest3193052-21kworker/u8:1+flush-179:008:00:213
3146039994642,3cyclictest3380412-21kworker/u8:1+events_unbound11:05:023
3146039994642,3cyclictest3258896-21gpgv09:00:013
3146039994641,3cyclictest3146261-21/usr/share/muni07:10:063
3146034994644,2cyclictest3116066-21kworker/u8:0+events_unbound07:20:172
3146034994642,3cyclictest3176887-21kworker/u8:3+events_unbound08:10:012
3146031994642,3cyclictest3380412-21kworker/u8:1+events_unbound11:05:221
3146029994644,2cyclictest3251184-21kworker/u8:2+events_unbound08:50:360
3146029994644,2cyclictest3251184-21kworker/u8:2+events_unbound08:50:360
3146029994643,2cyclictest3380412-21kworker/u8:1+events_unbound11:05:360
3146029994643,2cyclictest1515606-21ThreadPoolForeg09:55:280
3146029994642,3cyclictest3268773-21kworker/u8:1+flush-179:010:00:250
3146029994640,3cyclictest3365704-13chrome10:45:000
3146039994542,2cyclictest3420922-21kworker/u8:1+flush-179:011:40:063
3146039994541,3cyclictest3176887-21kworker/u8:3+events_unbound09:00:023
3146039994540,2cyclictest3420922-21kworker/u8:1+flush-179:012:05:283
3146034994542,2cyclictest3193052-21kworker/u8:1+flush-179:007:55:282
3146034994541,3cyclictest3323231-21kworker/u8:3+events_unbound10:15:022
3146034994541,3cyclictest3253549-21kworker/u8:4+flush-179:009:00:172
3146034994535,9cyclictest3116066-21kworker/u8:0+events_unbound07:10:102
3146031994542,2cyclictest3342393-21kworker/u8:1+events_unbound10:25:211
3146031994542,2cyclictest3324291-21kworker/u8:5+events_unbound10:07:021
3146031994541,3cyclictest3178045-21/usr/share/muni07:40:001
3146029994542,2cyclictest3324291-21kworker/u8:5+events_unbound10:25:080
3146039994441,2cyclictest3452603-21kworker/u8:4+events_unbound12:10:113
3146031994441,2cyclictest3364644-21kworker/u8:0+events_unbound10:55:311
3146029994441,2cyclictest3426567-21kworker/u8:3+flush-179:012:25:210
3146029994441,2cyclictest3426567-21kworker/u8:3+flush-179:012:20:150
3146029994441,2cyclictest3370497-21kworker/u8:4+flush-179:011:15:190
3146029994440,3cyclictest3426567-21kworker/u8:3+flush-179:011:55:130
3146029994438,5cyclictest3476905-31munin-html12:30:350
314602999440,43cyclictest1515607-13Chrome_ChildIOT10:30:100
3146039994340,2cyclictest3401401-21kworker/u8:3+events_unbound11:25:093
3146039994340,2cyclictest3176887-21kworker/u8:3+flush-179:009:05:373
3146039994337,2cyclictest3159658-21kworker/u8:2+flush-179:007:40:143
3146034994341,2cyclictest3390480-21kworker/u8:2+events_unbound11:20:072
3146034994340,2cyclictest3436185-21kworker/u8:2+flush-179:012:00:372
3146034994340,2cyclictest3350081-21kworker/u8:2+events_unbound10:50:192
3146034994337,3cyclictest3324291-21kworker/u8:5+flush-179:010:30:082
3146034994335,2cyclictest3364644-21kworker/u8:0+events_unbound10:55:332
3146034994335,2cyclictest3161552-21kworker/u8:3+events_unbound07:25:152
3146031994341,2cyclictest3436185-21kworker/u8:2+events_unbound12:02:531
3146031994341,2cyclictest3350081-21kworker/u8:2+events_unbound10:55:011
3146031994340,2cyclictest3220739-21kworker/u8:0+events_unbound08:30:071
3146031994339,3cyclictest3273784-31munin-graph09:10:591
3146031994338,4cyclictest3217372-21python308:15:371
3146029994340,2cyclictest3166635-21kworker/u8:0+flush-179:007:30:170
3146029994340,2cyclictest3116066-21kworker/u8:0+flush-179:007:15:250
3146029994339,3cyclictest3395874-21kworker/u8:0+flush-179:011:40:280
3146039994239,2cyclictest3461564-21kworker/u8:2+flush-179:012:35:143
3146039994239,2cyclictest3426567-21kworker/u8:3+events_unbound12:15:073
3146039994239,2cyclictest3268773-21kworker/u8:1+events_unbound09:35:183
3146039994238,3cyclictest3261790-21kworker/u8:2+flush-179:009:30:183
3146034994240,2cyclictest3261790-21kworker/u8:2+flush-179:009:05:072
3146034994239,2cyclictest3380412-21kworker/u8:1+flush-179:011:00:112
3146034994238,3cyclictest3330734-21kworker/u8:0+events_unbound10:20:312
3146034994237,4cyclictest3304278-21latency_hist09:45:012
3146034994237,2cyclictest3395874-21kworker/u8:0+events_unbound11:45:332
3146031994236,5cyclictest1515560-21Chrome_ChildIOT12:10:581
3146031994236,4cyclictest3259310-21/usr/share/muni09:00:021
3146031994230,10cyclictest2242367-1kworker/1:0H+kblockd07:16:081
3146029994238,3cyclictest3161552-21kworker/u8:3+flush-179:007:23:030
3146029994227,14cyclictest3176887-21kworker/u8:3+events_unbound09:02:050
3146039994137,3cyclictest3294120-21kworker/u8:0+flush-179:009:40:073
3146034994138,2cyclictest3173157-21kworker/u8:1+flush-179:007:35:192
3146034994135,4cyclictest3171915-31munin-html07:30:372
3146031994139,2cyclictest3173157-21kworker/u8:1+events_unbound07:35:291
3146031994137,3cyclictest3355368-21kworker/u8:3+events_unbound10:39:211
3146029994139,2cyclictest3324291-21kworker/u8:5+events_unbound10:25:000
3146029994138,2cyclictest3420922-21kworker/u8:1+events_unbound12:10:230
3146029994138,2cyclictest3193421-21kworker/u8:4+flush-179:008:00:160
3146029994138,2cyclictest3159658-21kworker/u8:2+flush-179:007:50:380
3146029994128,12cyclictest1276-21snmpd12:02:370
3146039994037,3cyclictest3390480-21kworker/u8:2+events_unbound11:35:303
3146039994036,3cyclictest3445972-21kworker/u8:0+flush-179:012:20:373
3146039994035,4cyclictest3189550-21apt-get07:50:143
3146039994034,4cyclictest3411318-21/usr/share/muni11:30:063
3146034994038,1cyclictest3330341-21kworker/2:3+pm10:28:362
3146034994037,2cyclictest3462168-21kworker/2:1+pm12:27:302
3146034994037,2cyclictest3330341-21kworker/2:3+pm11:16:202
3146034994037,2cyclictest3268773-21kworker/u8:1+events_unbound09:30:412
3146034994037,2cyclictest3193052-21kworker/u8:1+events_unbound08:27:372
3146034994034,2cyclictest3461564-21kworker/u8:2+events_unbound12:35:092
3146031994038,2cyclictest3395874-21kworker/u8:0+flush-179:011:30:301
3146031994038,2cyclictest3324291-21kworker/u8:5+events_unbound10:15:261
3146031994037,2cyclictest3156784-21kworker/1:0+pm10:24:031
3146031994036,3cyclictest3268773-21kworker/u8:1+events_unbound09:34:271
3146031994022,14cyclictest3304583-21chrome09:45:021
3146029994036,3cyclictest3193052-21kworker/u8:1+flush-179:008:40:110
314602999400,38cyclictest1515603-21chrome08:10:280
3146039993937,2cyclictest3395874-21kworker/u8:0+flush-179:011:50:183
3146039993936,2cyclictest3350081-21kworker/u8:2+events_unbound10:30:113
3146039993934,4cyclictest3320114-21cp10:00:003
3146034993937,2cyclictest3445972-21kworker/u8:0+events_unbound12:15:422
3146034993937,2cyclictest3243480-21kworker/u8:0+flush-179:008:45:302
3146034993937,1cyclictest3274538-21kworker/2:2+pm10:00:072
3146034993937,1cyclictest3274538-21kworker/2:2+pm09:57:582
3146034993937,1cyclictest3274538-21kworker/2:2+pm09:50:182
3146034993937,1cyclictest3212936-21kworker/2:1+pm08:20:342
3146034993937,1cyclictest3086442-21kworker/2:0+pm07:55:002
3146034993936,2cyclictest3274538-21kworker/2:2+pm09:18:332
3146034993927,12cyclictest2089056-1kworker/2:0H+kblockd11:44:392
3146031993937,2cyclictest3193052-21kworker/u8:1+events_unbound08:05:091
3146031993935,3cyclictest3310009-21/usr/share/muni09:50:041
3146031993934,4cyclictest1515560-21Chrome_ChildIOT10:40:181
3146029993937,1cyclictest3145779-21kworker/0:0+pm07:39:420
3146029993936,2cyclictest3283173-21kworker/u8:4+flush-179:009:20:530
3146029993936,2cyclictest3268773-21kworker/u8:1+flush-179:009:25:190
3146029993935,3cyclictest3311892-21apt-get09:50:170
3146029993934,4cyclictest1515560-21Chrome_ChildIOT07:25:220
3146039993836,1cyclictest3233309-21kworker/3:2+pm09:17:223
3146039993836,1cyclictest3233309-21kworker/3:2+pm08:49:223
3146039993835,2cyclictest3166635-21kworker/u8:0+flush-179:007:30:293
3146039993835,2cyclictest2709389-1kworker/3:0H+kblockd11:58:013
3146039993834,3cyclictest3357583-21apt-get10:35:173
3146039993834,3cyclictest3176887-21kworker/u8:3+flush-179:008:30:313
3146039993834,3cyclictest2709389-1kworker/3:0H+kblockd09:25:073
3146039993832,2cyclictest3395874-21kworker/u8:0+events_unbound11:20:013
3146034993837,1cyclictest3330341-21kworker/2:3+pm11:55:342
3146034993836,1cyclictest3441713-21kworker/2:0+pm12:11:122
3146034993836,1cyclictest3330341-21kworker/2:3+pm11:51:082
3146034993836,1cyclictest3330341-21kworker/2:3+pm11:35:052
3146034993836,1cyclictest3330341-21kworker/2:3+pm11:11:102
3146034993836,1cyclictest3274538-21kworker/2:2+pm09:25:542
3146034993836,1cyclictest3212936-21kworker/2:1+pm08:15:512
3146034993835,2cyclictest3253549-21kworker/u8:4+flush-179:008:55:152
3146034993834,3cyclictest3380412-21kworker/u8:1+flush-179:011:05:252
3146034993831,3cyclictest3342393-21kworker/u8:1+flush-179:010:35:372
3146031993836,1cyclictest3156784-21kworker/1:0+pm11:13:021
3146031993835,3cyclictest3401401-21kworker/u8:3+events_unbound11:35:071
3146031993835,2cyclictest3395874-21kworker/u8:0+events_unbound11:49:021
3146031993835,2cyclictest3261790-21kworker/u8:2+flush-179:009:20:281
3146031993835,2cyclictest3156784-21kworker/1:0+pm11:23:171
3146031993834,3cyclictest3445972-21kworker/u8:0+events_unbound12:24:441
3146029993835,2cyclictest3395874-21kworker/u8:0+flush-179:011:50:210
3146029993835,2cyclictest3261790-21kworker/u8:2+events_unbound09:30:210
3146029993835,2cyclictest3176887-21kworker/u8:3+events_unbound08:56:210
3146039993735,1cyclictest3370392-21kworker/3:1+pm11:03:033
3146039993734,2cyclictest3243480-21kworker/u8:0+events_unbound08:50:123
3146039993734,2cyclictest3243480-21kworker/u8:0+events_unbound08:50:123
3146039993734,2cyclictest2709389-1kworker/3:0H+kblockd11:21:333
3146039993734,2cyclictest2709389-1kworker/3:0H+kblockd10:07:273
3146034993735,1cyclictest3274538-21kworker/2:2+pm09:45:042
3146031993735,2cyclictest3251184-21kworker/u8:2+flush-179:008:50:281
3146031993735,2cyclictest3251184-21kworker/u8:2+flush-179:008:50:281
3146031993734,2cyclictest3156784-21kworker/1:0+pm09:18:031
3146031993722,14cyclictest3225442-21needreboot08:25:181
3146029993734,2cyclictest3400808-21kworker/0:2+pm12:09:030
3146029993733,3cyclictest3364644-21kworker/u8:0+events_unbound10:44:590
3146029993733,3cyclictest3268773-21kworker/u8:1+flush-179:010:05:110
3146039993634,1cyclictest3151193-21kworker/3:3+pm07:18:133
3146039993634,1cyclictest2709389-1kworker/3:0H+kblockd10:02:013
3146039993633,2cyclictest3193052-21kworker/u8:1+flush-179:008:40:193
3146039993633,2cyclictest2709389-1kworker/3:0H+kblockd12:25:053
3146039993632,2cyclictest3364644-21kworker/u8:0+events_unbound10:55:353
3146039993631,4cyclictest3436185-21kworker/u8:2+flush-179:012:00:163
3146039993631,4cyclictest3172901-21/usr/share/muni07:35:033
3146034993634,1cyclictest3212936-21kworker/2:1+pm08:50:172
3146034993634,1cyclictest3212936-21kworker/2:1+pm08:50:172
3146031993635,1cyclictest3156784-21kworker/1:0+pm08:43:571
3146031993634,1cyclictest3156784-21kworker/1:0+pm08:39:411
3146031993634,1cyclictest3156784-21kworker/1:0+pm07:33:221
3146031993634,1cyclictest2242367-1kworker/1:0H+kblockd09:25:041
3146031993634,1cyclictest2242367-1kworker/1:0H+kblockd08:46:041
3146031993633,2cyclictest3350081-21kworker/u8:2+events_unbound10:30:271
3146031993633,2cyclictest2242367-1kworker/1:0H+kblockd12:30:311
3146031993633,2cyclictest2242367-1kworker/1:0H+kblockd07:50:471
3146031993631,4cyclictest3381111-21/usr/share/muni11:00:041
3146029993633,2cyclictest3268773-21kworker/u8:1+events_unbound09:35:230
3146029993633,2cyclictest3249090-1kworker/0:1H+kblockd12:35:020
3146029993633,2cyclictest3249090-1kworker/0:1H+kblockd10:10:310
3146029993633,2cyclictest3192686-21kworker/0:2+pm08:46:330
3146039993533,1cyclictest3370392-21kworker/3:1+pm11:12:523
3146039993532,2cyclictest2709389-1kworker/3:0H+kblockd07:20:293
3146039993531,3cyclictest3310025-21/usr/share/muni09:50:023
3146034993533,1cyclictest3330341-21kworker/2:3+pm10:40:502
3146031993532,3cyclictest3294120-21kworker/u8:0+events_unbound09:42:511
3146031993532,2cyclictest3176887-21kworker/u8:3+events_unbound08:00:271
3146031993530,4cyclictest3406265-21/usr/share/muni11:25:011
3146031993529,5cyclictest1515606-21ThreadPoolForeg11:15:521
3146029993533,1cyclictest2841232-1kworker/0:0H+kblockd08:25:120
3146029993532,2cyclictest2841232-1kworker/0:0H+kblockd08:21:520
3146029993531,3cyclictest3159658-21kworker/u8:2+flush-179:007:48:110
3146039993428,5cyclictest3269407-21/usr/share/muni09:10:013
3146031993431,2cyclictest3461564-21kworker/u8:2+events_unbound12:35:191
3146031993431,2cyclictest3445972-21kworker/u8:0+events_unbound12:29:461
3146031993430,3cyclictest3316460-21apt-get09:55:131
3146031993425,9cyclictest3395874-21kworker/u8:0+events_unbound11:51:521
3146029993432,2cyclictest3380412-21kworker/u8:1+flush-179:011:00:210
3146029993429,4cyclictest3415694-31munin-graph11:30:540
3146039993331,2cyclictest3324291-21kworker/u8:5+flush-179:010:15:173
3146039993330,2cyclictest3330734-21kworker/u8:0+flush-179:010:20:103
3146039993329,3cyclictest3395874-21kworker/u8:0+events_unbound11:48:383
3146039993328,3cyclictest3218082-21latency_hist08:20:013
3146031993331,1cyclictest3156784-21kworker/1:0+pm09:38:281
3146031993329,3cyclictest3264322-21/usr/share/muni09:05:051
3146029993331,1cyclictest2841232-1kworker/0:0H+kblockd08:36:060
3146029993330,2cyclictest3390480-21kworker/u8:2+flush-179:011:35:060
3146029993327,3cyclictest3193052-21kworker/u8:1+flush-179:007:56:060
3146039993229,2cyclictest3379691-21isc-net-000007:28:393
3146039993229,2cyclictest2709389-1kworker/3:0H+kblockd08:28:183
3146031993230,1cyclictest1276-21snmpd11:44:591
3146031993229,2cyclictest2242367-1kworker/1:0H+kblockd10:01:091
3146031993229,2cyclictest2242367-1kworker/1:0H+kblockd07:12:531
3146029993230,2cyclictest3400808-21kworker/0:2+pm12:19:180
3146029993229,1cyclictest3249090-1kworker/0:1H+kblockd09:10:540
3146039993128,2cyclictest1276-21snmpd10:51:053
3146031993028,1cyclictest2242367-1kworker/1:0H+kblockd07:58:121
3146029993027,2cyclictest3249090-1kworker/0:1H+kblockd09:05:180
3146039992826,1cyclictest3445972-21kworker/u8:0+flush-179:012:30:203
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional