You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-18 - 06:56
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackbslot1.osadl.org (updated Wed Sep 17, 2025 12:44:35)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31600222218188,20sleep20-21swapper/207:06:362
31600932208184,14sleep30-21swapper/307:07:333
31602102207183,14sleep00-21swapper/007:08:550
31601482201176,14sleep10-21swapper/107:08:101
3160480996154,5cyclictest3440601-21/usr/share/muni11:40:092
316047899615,55cyclictest3306273-21kworker/u8:0+efi_rts_wq09:54:580
3160479995653,2cyclictest3251747-21kworker/u8:1+flush-179:009:05:091
3160478995651,4cyclictest3456368-21/usr/share/muni11:55:090
3160482995549,4cyclictest3404857-21/usr/share/muni11:05:093
3160479995552,2cyclictest3306273-21kworker/u8:0+events_unbound10:05:091
3160482995450,3cyclictest3475993-31munin-html12:10:343
316048299534,47cyclictest3197581-13Chrome_IOThread07:45:023
316048299534,47cyclictest3197581-13Chrome_IOThread07:45:023
3160480995249,2cyclictest3332943-21kworker/u8:4+events_unbound11:05:252
3160479995247,4cyclictest247560-21ThreadPoolForeg12:25:091
3160479995148,2cyclictest3332943-21kworker/u8:4+flush-179:010:45:241
3160479995147,3cyclictest3306273-21kworker/u8:0+events_unbound10:00:001
3160479995045,4cyclictest3394646-21/usr/share/muni10:55:011
3160478995047,2cyclictest2188114-1kworker/0:0H+kblockd11:11:010
3160478995046,3cyclictest3322210-21CacheThread_Blo09:45:010
3160482994946,2cyclictest3332340-21kworker/u8:1+events_unbound09:55:143
3160482994946,2cyclictest3251747-21kworker/u8:1+events_unbound09:03:013
3160482994945,3cyclictest3244256-21kworker/u8:3+events_unbound08:33:073
3160482994944,3cyclictest3265525-21/usr/share/muni08:50:203
3160479994946,2cyclictest3419620-21kworker/u8:0+events_unbound11:35:101
3160479994946,2cyclictest3306273-21kworker/u8:0+flush-179:009:50:291
3160479994945,3cyclictest3291253-21kworker/u8:2+flush-179:009:25:271
3160479994945,3cyclictest3224318-21kworker/u8:2+flush-179:008:11:221
3160482994845,3cyclictest3306273-21kworker/u8:0+events_unbound10:20:363
3160480994845,2cyclictest3306273-21kworker/u8:0+events_unbound10:00:372
3160479994845,3cyclictest3450621-21kworker/u8:2+flush-179:012:20:051
3160482994744,2cyclictest3492010-21kworker/u8:0+events_unbound12:34:343
3160482994744,2cyclictest3403725-21kworker/u8:3+events_unbound11:21:493
3160482994743,3cyclictest3450621-21kworker/u8:2+flush-179:012:25:113
3160480994734,12cyclictest3332073-21kworker/2:0+pm10:50:322
3160479994743,3cyclictest3372431-31munin-html10:30:321
3160482994642,3cyclictest3362689-21kworker/u8:2+events_unbound10:36:103
3160480994640,4cyclictest3160621-21/usr/share/muni07:10:092
3160479994642,3cyclictest3291253-21kworker/u8:2+flush-179:009:35:251
3160479994642,2cyclictest3322141-13chrome09:45:011
3160479994641,4cyclictest3224318-21kworker/u8:2+flush-179:008:25:171
316048099450,2cyclictest247561-21ThreadPoolForeg09:45:012
3160479994542,2cyclictest3306273-21kworker/u8:0+flush-179:010:25:121
3160479994542,2cyclictest2632656-1kworker/1:0H+kblockd07:11:001
3160479994541,3cyclictest3224318-21kworker/u8:2+flush-179:008:15:101
3160479994539,4cyclictest3257049-21apt-get08:40:171
3160482994441,2cyclictest3306273-21kworker/u8:0+events_unbound09:26:323
3160482994441,2cyclictest3224318-21kworker/u8:2+events_unbound08:22:333
3160482994441,2cyclictest3123157-21kworker/u8:2+events_unbound07:39:543
3160482994441,2cyclictest3123157-21kworker/u8:2+events_unbound07:39:533
3160482994440,3cyclictest3466152-21kworker/u8:1+events_unbound12:02:413
3160482994440,3cyclictest3173142-21apt-get07:20:133
3160480994432,11cyclictest3397203-21kworker/2:1+pm11:34:002
3160478994439,4cyclictest3389246-21munin-update10:50:030
3160482994340,2cyclictest3466152-21kworker/u8:1+events_unbound12:18:363
3160482994339,3cyclictest3332943-21kworker/u8:4+events_unbound10:52:293
3160482994330,2cyclictest1260-21snmpd09:22:223
3160482994328,14cyclictest3332943-21kworker/u8:4+events_unbound10:47:133
316048099434,38cyclictest3306273-21kworker/u8:0+efi_rts_wq09:54:582
3160480994338,4cyclictest3471568-21latency_hist12:10:022
3160480994336,5cyclictest3420253-21/usr/share/muni11:20:142
3160479994336,6cyclictest3270959-21/usr/share/muni08:55:051
3160478994340,2cyclictest3441041-21kworker/u8:1+events_unbound11:40:060
3160478994337,5cyclictest247561-21ThreadPoolForeg11:00:390
3160482994241,1cyclictest3381757-21kworker/u8:0+events_unbound10:40:263
3160482994239,2cyclictest3306273-21kworker/u8:0+events_unbound10:06:483
3160482994238,3cyclictest3228464-21kworker/u8:4+events_unbound08:18:443
3160482994237,4cyclictest3204346-21apt-get07:50:113
3160482994236,2cyclictest3466152-21kworker/u8:1+events_unbound12:05:143
3160479994239,2cyclictest3212896-21kworker/u8:0+flush-179:008:24:291
3160479994238,3cyclictest3419620-21kworker/u8:0+flush-179:011:45:331
3160479994238,3cyclictest3212896-21kworker/u8:0+events_unbound08:05:361
3160478994238,3cyclictest3419071-21munin-limits11:15:320
3160478994236,4cyclictest3394646-21/usr/share/muni10:55:150
3160482994139,2cyclictest3362689-21kworker/u8:2+events_unbound10:32:223
3160482994138,2cyclictest3498293-21kworker/u8:4+events_unbound12:35:203
3160482994138,2cyclictest3402350-21kworker/u8:1+events_unbound11:00:293
3160482994137,3cyclictest3264997-21kworker/u8:0+events_unbound08:58:593
3160482994136,4cyclictest3311928-21/usr/share/muni09:35:093
3160482994136,3cyclictest3223798-21cat08:10:013
3160480994136,3cyclictest247560-21ThreadPoolForeg07:55:212
3160479994137,3cyclictest3123157-21kworker/u8:2+flush-179:007:25:201
3160479994132,8cyclictest3466152-21kworker/u8:1+events_unbound12:05:161
3160478994139,1cyclictest3332943-21kworker/u8:4+events_unbound10:10:330
3160478994129,10cyclictest2188114-1kworker/0:0H+kblockd08:16:130
3160482994037,2cyclictest3445905-21ThreadPoolForeg11:45:013
3160482994037,2cyclictest3347678-21munin-update10:10:313
3160482994036,3cyclictest3394432-21kworker/u8:2+events_unbound11:12:473
3160482994035,4cyclictest3456382-21/usr/share/muni11:55:093
3160482994026,3cyclictest1801477-1kworker/3:2H+kblockd10:19:143
3160480994037,2cyclictest3332073-21kworker/2:0+pm10:12:132
3160480994037,2cyclictest3180826-21kworker/2:2+pm08:44:142
3160480994037,2cyclictest3180826-21kworker/2:2+pm08:21:392
3160480994037,2cyclictest3180826-21kworker/2:2+pm07:37:542
3160480994037,2cyclictest3180826-21kworker/2:2+pm07:37:542
3160480994021,18cyclictest3448134-21cat11:45:192
3160479994037,2cyclictest3316588-21kworker/u8:1+flush-179:009:40:231
3160479994037,2cyclictest3264997-21kworker/u8:0+flush-179:009:01:361
3160479994037,2cyclictest3251747-21kworker/u8:1+events_unbound08:45:151
3160479994036,3cyclictest3403725-21kworker/u8:3+events_unbound11:17:031
3160479994034,4cyclictest3213375-21/usr/share/muni08:00:171
3160478994037,2cyclictest3144083-21kworker/u8:3+events_unbound07:48:440
3160478994037,2cyclictest3138912-21kworker/u8:1+events_unbound07:34:510
3160478994035,4cyclictest3336729-31munin-html09:55:460
3160478994034,4cyclictest3165743-21/usr/share/muni07:15:050
3160482993937,2cyclictest3403725-21kworker/u8:3+events_unbound11:17:453
3160482993937,1cyclictest3197008-21kworker/3:0+pm09:16:493
3160482993936,2cyclictest3306273-21kworker/u8:0+events_unbound10:28:263
3160482993935,3cyclictest247557-21chrome11:34:343
316048299390,4cyclictest247516-21Chrome_ChildIOT08:39:393
3160480993937,1cyclictest3397203-21kworker/2:1+pm11:27:262
3160480993937,1cyclictest3332073-21kworker/2:0+pm09:56:002
3160480993937,1cyclictest3180826-21kworker/2:2+pm07:52:372
3160480993937,1cyclictest0-21swapper/208:45:412
3160480993936,2cyclictest3482028-21kworker/2:3+pm12:39:042
3160480993936,2cyclictest3397203-21kworker/2:1+pm11:03:242
3160480993936,2cyclictest3300759-21kworker/2:2+pm09:42:542
3160480993936,2cyclictest3291243-21kworker/2:1+pm09:20:052
3160480993936,2cyclictest3256279-21kworker/2:0+pm09:00:062
3160480993936,2cyclictest3180826-21kworker/2:2+pm07:31:002
3160480993935,3cyclictest3471304-21kworker/2:2+pm12:12:502
3160480993935,3cyclictest3212896-21kworker/u8:0+flush-179:008:25:242
3160479993935,3cyclictest3466152-21kworker/u8:1+flush-179:012:15:141
3160479993935,3cyclictest3171233-21kworker/u8:0+flush-179:007:17:161
3160479993935,3cyclictest3138912-21kworker/u8:1+events_unbound07:51:031
3160479993923,4cyclictest3291253-21kworker/u8:2+events_unbound09:30:141
3160479993923,4cyclictest3291253-21kworker/u8:2+events_unbound09:30:141
3160478993937,1cyclictest3280801-21kworker/0:0+pm10:23:490
3160478993936,2cyclictest3482569-21kworker/u8:3+flush-179:012:30:290
3160478993935,3cyclictest3451215-21/usr/share/muni11:50:180
316047899391,37cyclictest1076-21dbus-daemon07:50:100
3160482993836,2cyclictest3123157-21kworker/u8:2+events_unbound07:10:123
3160482993836,1cyclictest1801477-1kworker/3:2H+kblockd10:58:443
3160482993836,1cyclictest1801477-1kworker/3:2H+kblockd09:07:493
3160482993834,3cyclictest3275667-21kworker/u8:3+events_unbound09:13:403
3160480993836,1cyclictest3397203-21kworker/2:1+pm11:14:002
3160480993836,1cyclictest3332073-21kworker/2:0+pm10:59:042
3160480993836,1cyclictest3332073-21kworker/2:0+pm10:50:002
3160480993836,1cyclictest3332073-21kworker/2:0+pm10:25:352
3160480993836,1cyclictest3275551-21kworker/2:2+pm09:14:102
3160480993836,1cyclictest3256279-21kworker/2:0+pm08:51:282
3160480993835,2cyclictest3471304-21kworker/2:2+pm12:17:592
3160480993835,2cyclictest3332943-21kworker/u8:4+events_unbound10:08:442
3160480993835,2cyclictest3180826-21kworker/2:2+pm07:40:072
3160480993835,2cyclictest3180826-21kworker/2:2+pm07:40:072
3160480993834,2cyclictest3332073-21kworker/2:0+pm10:15:322
3160480993834,2cyclictest3180826-21kworker/2:2+pm08:03:042
3160480993833,4cyclictest3461494-21/usr/share/muni12:00:122
316048099383,2cyclictest247505-21Chrome_DevTools09:25:352
3160479993836,1cyclictest3286148-21kworker/1:0+pm10:21:341
3160479993835,2cyclictest3435093-21kworker/u8:3+flush-179:011:40:211
3160479993834,3cyclictest3450621-21kworker/u8:2+events_unbound11:55:191
3160479993834,3cyclictest3403725-21kworker/u8:3+events_unbound11:20:061
3160479993834,3cyclictest3332943-21kworker/u8:4+flush-179:010:40:061
3160479993834,3cyclictest3331961-1kworker/1:2H+kblockd12:02:541
3160479993834,3cyclictest3186251-31munin-html07:30:351
3160478993837,1cyclictest3280801-21kworker/0:0+pm10:07:140
3160478993836,1cyclictest3280801-21kworker/0:0+pm10:49:480
3160478993835,2cyclictest3280801-21kworker/0:0+pm09:28:240
3160478993833,4cyclictest3440082-31munin-graph11:36:020
3160482993736,1cyclictest3103125-21kworker/3:1+pm07:32:143
3160482993735,2cyclictest3419620-21kworker/u8:0+events_unbound11:37:513
3160482993735,1cyclictest1260-21snmpd07:48:593
3160482993734,2cyclictest3332943-21kworker/u8:4+events_unbound10:00:473
3160482993734,2cyclictest1801477-1kworker/3:2H+kblockd07:55:523
3160482993733,3cyclictest3172104-21kworker/u8:4+events_unbound07:29:223
3160482993720,15cyclictest3328001-21cat09:50:073
3160480993735,1cyclictest3482028-21kworker/2:3+pm12:31:592
3160480993735,1cyclictest3397203-21kworker/2:1+pm11:51:132
3160480993735,1cyclictest3332073-21kworker/2:0+pm10:40:162
3160480993735,1cyclictest3332073-21kworker/2:0+pm10:33:322
3160480993735,1cyclictest3275551-21kworker/2:2+pm09:05:002
3160480993735,1cyclictest3180826-21kworker/2:2+pm08:12:282
3160480993735,1cyclictest3154477-21kworker/2:0+pm07:25:082
3160480993735,1cyclictest3154477-21kworker/2:0+pm07:15:062
3160480993734,2cyclictest3482028-21kworker/2:3+pm12:25:042
3160480993734,2cyclictest3397203-21kworker/2:1+pm11:35:012
3160480993734,2cyclictest3332073-21kworker/2:0+pm10:20:162
3160480993734,2cyclictest3300759-21kworker/2:2+pm09:31:122
3160480993734,2cyclictest3300759-21kworker/2:2+pm09:31:122
3160480993733,3cyclictest3397203-21kworker/2:1+pm11:19:192
3160480993731,4cyclictest3270953-21/usr/share/muni08:55:192
3160479993734,2cyclictest3429871-21kworker/u8:1+events_unbound11:33:191
3160479993734,2cyclictest3331961-1kworker/1:2H+kblockd11:25:051
3160479993734,2cyclictest2632656-1kworker/1:0H+kblockd08:35:481
3160479993733,3cyclictest3332943-21kworker/u8:4+flush-179:010:10:181
3160479993733,3cyclictest2632656-1kworker/1:0H+kblockd08:51:051
3160479993733,2cyclictest2632656-1kworker/1:0H+kblockd07:39:441
3160479993733,2cyclictest2632656-1kworker/1:0H+kblockd07:39:431
3160479993730,3cyclictest3332943-21kworker/u8:4+events_unbound11:00:191
3160479993728,8cyclictest3138912-21kworker/u8:1+flush-179:007:20:151
3160478993734,2cyclictest2188114-1kworker/0:0H+kblockd10:17:020
3160478993734,2cyclictest2188114-1kworker/0:0H+kblockd08:59:090
3160478993734,2cyclictest2188114-1kworker/0:0H+kblockd08:40:150
3160478993734,2cyclictest2188114-1kworker/0:0H+kblockd08:24:140
3160478993733,3cyclictest3261218-21ThreadPoolForeg08:45:120
3160482993634,2cyclictest3311382-21kworker/u8:3+events_unbound09:48:593
3160482993633,2cyclictest1801477-1kworker/3:2H+kblockd09:31:063
3160482993633,2cyclictest1801477-1kworker/3:2H+kblockd09:31:063
3160482993632,3cyclictest3429871-21kworker/u8:1+events_unbound11:28:573
3160480993634,1cyclictest3397203-21kworker/2:1+pm11:56:392
3160480993634,1cyclictest3180826-21kworker/2:2+pm08:09:012
3160480993634,1cyclictest3180826-21kworker/2:2+pm07:45:182
3160480993632,3cyclictest3154477-21kworker/2:0+pm07:20:142
3160480993630,5cyclictest3254340-31munin-html08:35:382
316048099361,34cyclictest3249359-31munin-graph08:30:532
316048099360,35cyclictest247505-21Chrome_DevTools12:20:092
3160479993634,1cyclictest3331961-1kworker/1:2H+kblockd12:32:191
3160479993634,1cyclictest2632656-1kworker/1:0H+kblockd08:31:041
3160479993634,1cyclictest2632656-1kworker/1:0H+kblockd07:58:411
3160479993633,2cyclictest3138912-21kworker/u8:1+flush-179:007:49:361
3160479993633,2cyclictest2632656-1kworker/1:0H+kblockd09:11:001
3160479993632,3cyclictest3332943-21kworker/u8:4+flush-179:010:35:341
3160479993632,3cyclictest247561-21ThreadPoolForeg10:18:391
3160479993632,2cyclictest3331961-1kworker/1:2H+kblockd10:02:081
3160479993629,5cyclictest3295908-31munin-html09:15:411
3160478993634,1cyclictest2188114-1kworker/0:0H+kblockd09:02:140
3160478993633,2cyclictest3450621-21kworker/u8:2+flush-179:012:20:000
3160478993633,2cyclictest3435258-21kworker/u8:4+flush-179:012:00:100
3160478993633,2cyclictest2188114-1kworker/0:0H+kblockd08:05:190
3160482993533,1cyclictest3415241-1kworker/3:1H+kblockd12:21:423
3160482993533,1cyclictest1801477-1kworker/3:2H+kblockd08:46:443
3160482993532,3cyclictest3435093-21kworker/u8:3+events_unbound11:44:503
3160482993532,2cyclictest3212896-21kworker/u8:0+events_unbound08:06:323
3160482993532,2cyclictest1801477-1kworker/3:2H+kblockd08:42:493
3160480993533,1cyclictest3332073-21kworker/2:0+pm10:35:372
3160480993533,1cyclictest3180826-21kworker/2:2+pm08:15:042
3160479993533,1cyclictest3331961-1kworker/1:2H+kblockd11:51:341
3160479993532,2cyclictest3450621-21kworker/u8:2+events_unbound12:35:141
3160479993532,2cyclictest2632656-1kworker/1:0H+kblockd09:20:201
3160479993531,3cyclictest3402350-21kworker/u8:1+events_unbound11:10:021
3160479993531,3cyclictest3123157-21kworker/u8:2+flush-179:007:43:191
3160479993531,3cyclictest3123157-21kworker/u8:2+flush-179:007:43:191
3160478993533,1cyclictest3171675-21kworker/0:3+pm07:41:240
3160478993533,1cyclictest3171675-21kworker/0:3+pm07:41:240
3160478993532,1cyclictest3486772-1kworker/0:1H+kblockd12:29:090
3160478993531,3cyclictest3291253-21kworker/u8:2+flush-179:009:30:140
3160478993531,3cyclictest3291253-21kworker/u8:2+flush-179:009:30:140
3160482993432,1cyclictest3415241-1kworker/3:1H+kblockd11:50:173
3160480993432,1cyclictest3300759-21kworker/2:2+pm09:38:462
3160480993432,1cyclictest3291243-21kworker/2:1+pm09:16:342
3160479993430,3cyclictest3403725-21kworker/u8:3+flush-179:011:05:101
3160479993429,4cyclictest3473090-21apt-get12:10:131
3160479993424,4cyclictest3332943-21kworker/u8:4+flush-179:010:53:031
3160478993432,1cyclictest3280801-21kworker/0:0+pm09:43:070
3160478993432,1cyclictest2188114-1kworker/0:0H+kblockd11:32:460
3160478993431,2cyclictest3291253-21kworker/u8:2+events_unbound09:17:140
3160478993431,2cyclictest2188114-1kworker/0:0H+kblockd12:05:470
3160478993431,2cyclictest2188114-1kworker/0:0H+kblockd11:26:400
3160478993431,2cyclictest2188114-1kworker/0:0H+kblockd10:35:010
3160478993431,2cyclictest2188114-1kworker/0:0H+kblockd09:35:590
316047899340,33cyclictest3175753-21sshd07:20:260
3160482993330,2cyclictest1801477-1kworker/3:2H+kblockd08:27:343
3160482993319,13cyclictest247468-13Chrome_IOThread07:16:193
3160478993330,2cyclictest3486772-1kworker/0:1H+kblockd12:25:000
3160478993330,2cyclictest1260-21snmpd07:36:010
3160478993330,2cyclictest1260-21snmpd07:36:010
3160478993327,5cyclictest247560-21ThreadPoolForeg10:04:340
3160478993320,12cyclictest1260-21snmpd08:14:100
3160478993318,14cyclictest3403725-21kworker/u8:3+events_unbound11:06:160
3160478993318,14cyclictest3144083-21kworker/u8:3+flush-179:007:14:420
3160482993229,2cyclictest1801477-1kworker/3:2H+kblockd08:00:533
3160482993228,3cyclictest3311382-21kworker/u8:3+events_unbound09:41:073
3160478993230,1cyclictest2188114-1kworker/0:0H+kblockd08:50:240
3160478993229,2cyclictest247468-13Chrome_IOThread07:59:240
3160478993229,2cyclictest2188114-1kworker/0:0H+kblockd10:27:140
3160478993228,3cyclictest3435093-21kworker/u8:3+flush-179:011:45:320
3160478993215,16cyclictest3224318-21kworker/u8:2+flush-179:008:25:190
3160478993129,1cyclictest3486772-1kworker/0:1H+kblockd12:35:010
3160478993129,1cyclictest1260-21snmpd08:31:170
3160478993128,1cyclictest2188114-1kworker/0:0H+kblockd08:35:370
3160478993118,12cyclictest3362689-21kworker/u8:2+flush-179:010:31:070
3160478993030,0cyclictest1260-21snmpd09:22:550
3160478993028,1cyclictest2188114-1kworker/0:0H+kblockd11:20:560
3160478993027,2cyclictest3138912-21kworker/u8:1+events_unbound08:03:410
3160478993027,2cyclictest2188114-1kworker/0:0H+kblockd09:12:390
3160478993025,4cyclictest3383909-21latency_hist10:45:010
3160478992927,1cyclictest1260-21snmpd12:14:390
3160478992623,2cyclictest247544-13Chrome_ChildIOT09:05:350
3160478992420,3cyclictest3123157-21kworker/u8:2+flush-179:007:25:230
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional