You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-22 - 17:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rackbslot1.osadl.org (updated Sat Nov 22, 2025 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
5755522206185,12sleep10-21swapper/107:07:121
5754952191167,14sleep00-21swapper/007:06:260
5755962190166,14sleep30-21swapper/307:07:463
5755172188164,14sleep20-21swapper/207:06:442
576007996460,3cyclictest716086-21kworker/u8:3+events_unbound10:25:102
576004995954,4cyclictest629414-21latency_hist08:00:011
576001995953,4cyclictest845647-21latency_hist11:30:010
576007995853,4cyclictest840554-21latency_hist11:25:002
576012995752,4cyclictest733849-21apt-get09:40:153
576012995751,4cyclictest907617-21latency_hist12:30:003
576012995751,4cyclictest907617-21latency_hist12:30:003
576001995753,3cyclictest850499-21kworker/u8:1+flush-179:012:20:100
57600199561,54cyclictest1-21systemd09:45:010
576012995548,4cyclictest747825-21latency_hist09:55:013
576007995538,16cyclictest571187-21kworker/u8:3+flush-179:008:15:192
576001995550,3cyclictest629198-21kworker/u8:0+flush-179:008:40:070
576007995348,3cyclictest716086-21kworker/u8:3+flush-179:012:25:372
576007995348,3cyclictest716086-21kworker/u8:3+flush-179:012:25:372
8218172520,1chrt821801-21ntpq11:05:171
576001995246,4cyclictest701834-21/usr/share/muni09:10:140
576001995245,5cyclictest660778-21/usr/share/muni08:30:130
576012995146,4cyclictest799695-21Chrome_ChildIOT10:45:093
576012995045,4cyclictest716086-21kworker/u8:3+flush-179:011:15:093
576012994942,5cyclictest247573-21ThreadPoolForeg11:35:073
576007994947,1cyclictest799357-21munin-update10:45:012
576007994946,2cyclictest871153-21kworker/u8:0+events_unbound12:00:362
576007994845,2cyclictest768771-21/usr/share/muni10:15:022
576004994844,3cyclictest629198-21kworker/u8:0+flush-179:008:20:221
576001994845,2cyclictest629198-21kworker/u8:0+events_unbound08:35:020
576001994845,2cyclictest597391-21kworker/u8:4+flush-179:007:35:100
576001994844,3cyclictest835169-21kworker/u8:4+flush-179:011:35:310
576001994844,3cyclictest629198-21kworker/u8:0+flush-179:008:20:280
576012994741,4cyclictest660533-21latency_hist08:30:013
576007994743,3cyclictest597391-21kworker/u8:4+flush-179:007:30:112
576007994736,10cyclictest746344-21kworker/2:1+pm09:59:392
576007994736,10cyclictest746344-21kworker/2:1+pm09:59:392
576004994739,6cyclictest3125725-21ThreadPoolForeg09:20:001
576001994743,3cyclictest757989-21kworker/u8:1+events_unbound10:07:470
57600199471,45cyclictest3125630-13chrome10:50:320
57600199470,45cyclictest3125721-21chrome07:40:350
57600199470,45cyclictest3125721-21chrome07:40:350
576012994643,2cyclictest811625-21kworker/u8:1+flush-179:011:10:263
576012994632,14cyclictest4102496-1kworker/3:2H+kblockd09:32:053
576007994643,2cyclictest850499-21kworker/u8:1+flush-179:012:20:162
576007994643,2cyclictest825121-21kworker/u8:0+events_unbound11:30:152
576007994642,3cyclictest721737-21kworker/u8:4+flush-179:009:50:152
576007994639,5cyclictest247515-21ThreadPoolForeg09:05:242
57600199460,44cyclictest3125627-21ChromeDriver00:55:190
576012994540,4cyclictest629198-21kworker/u8:0+flush-179:008:15:273
57601299453,42cyclictest757989-21kworker/u8:1+flush-179:010:19:573
576007994535,4cyclictest757989-21kworker/u8:1+flush-179:010:20:072
576004994540,3cyclictest907992-21/usr/share/muni12:30:081
576001994542,2cyclictest736501-21kworker/u8:2+flush-179:009:45:150
576001994539,4cyclictest907998-21/usr/share/muni12:30:020
576012994440,3cyclictest571187-21kworker/u8:3+flush-179:008:52:513
576012994439,4cyclictest599201-21apt-get07:30:143
576012994439,4cyclictest3125724-21ThreadPoolForeg11:24:203
576007994440,3cyclictest690997-21kworker/u8:0+flush-179:009:35:372
576007994439,4cyclictest565296-21kworker/u8:0+flush-179:007:35:282
576007994438,5cyclictest3125688-21Chrome_ChildIOT08:46:552
576007994438,5cyclictest3125688-21Chrome_ChildIOT08:46:552
576004994439,4cyclictest3125725-21ThreadPoolForeg09:03:101
576004994438,4cyclictest671209-21kworker/u8:4+flush-179:009:20:191
576001994441,2cyclictest716086-21kworker/u8:3+flush-179:011:50:100
576001994440,3cyclictest888283-21apt-get12:10:150
576001994440,3cyclictest597391-21kworker/u8:4+flush-179:008:00:230
576001994440,3cyclictest597391-21kworker/u8:4+flush-179:008:00:230
576001994438,5cyclictest247516-21Chrome_ChildIOT09:07:090
57601299431,3cyclictest247557-21chrome09:56:403
57601299431,3cyclictest247557-21chrome09:56:403
576007994339,3cyclictest629198-21kworker/u8:0+flush-179:008:40:002
576007994338,4cyclictest757989-21kworker/u8:1+flush-179:010:40:012
576007994338,4cyclictest690997-21kworker/u8:0+events_unbound09:40:352
576007994322,20cyclictest3125721-21chrome11:15:162
576004994337,4cyclictest688043-21ntpq08:55:171
576004994330,3cyclictest825121-21kworker/u8:0+flush-179:011:14:201
576001994340,2cyclictest793891-21kworker/u8:2+flush-179:010:55:350
576001994340,2cyclictest793891-21kworker/u8:2+flush-179:010:55:350
576001994340,2cyclictest580877-21kworker/u8:1+flush-179:007:25:370
576012994238,3cyclictest571187-21kworker/u8:3+flush-179:007:18:273
576007994239,2cyclictest571187-21kworker/u8:3+flush-179:008:32:492
576007994239,2cyclictest571187-21kworker/u8:3+flush-179:008:10:152
576007994239,2cyclictest571187-21kworker/u8:3+flush-179:008:10:152
576007994238,3cyclictest76405-21systemd-journal12:17:022
576007994237,3cyclictest716086-21kworker/u8:3+events_unbound12:33:432
576004994238,2cyclictest799345-21latency_hist10:45:011
576001994239,2cyclictest580877-21kworker/u8:1+flush-179:007:15:200
576001994238,3cyclictest716086-21kworker/u8:3+flush-179:011:55:290
576001994238,3cyclictest571187-21kworker/u8:3+events_unbound07:55:230
576001994238,2cyclictest676233-21snmp_wanpowerct08:45:020
576001994238,2cyclictest676233-21snmp_wanpowerct08:45:020
576001994238,2cyclictest629198-21kworker/u8:0+flush-179:008:17:020
576001994237,4cyclictest913374-21/usr/share/muni12:35:110
576001994236,5cyclictest748070-21/usr/share/muni09:55:060
576001994236,5cyclictest748070-21/usr/share/muni09:55:050
576012994136,3cyclictest717053-21/usr/share/muni09:25:133
576007994137,3cyclictest716086-21kworker/u8:3+flush-179:010:41:522
576007994136,4cyclictest597391-21kworker/u8:4+flush-179:007:50:402
576007994136,4cyclictest571187-21kworker/u8:3+flush-179:007:20:362
576004994137,3cyclictest835169-21kworker/u8:4+flush-179:011:35:221
576004994137,3cyclictest784270-21/usr/share/muni10:30:011
576004994137,3cyclictest650795-21kworker/u8:1+flush-179:008:40:101
576004994136,4cyclictest633763-31munin-html08:00:371
576004994136,4cyclictest633763-31munin-html08:00:371
576004994135,4cyclictest701841-21/usr/share/muni09:10:031
576004994129,1cyclictest3446490-1kworker/1:1H+kblockd10:23:201
576001994138,2cyclictest3125627-21ChromeDriver00:55:190
576001994137,3cyclictest592370-21kworker/u8:2+flush-179:007:34:290
576012994037,2cyclictest716086-21kworker/u8:3+flush-179:009:45:313
576012994036,3cyclictest721737-21kworker/u8:4+flush-179:010:12:483
576012994035,4cyclictest3125725-21ThreadPoolForeg08:11:503
576012994035,4cyclictest3125725-21ThreadPoolForeg08:11:493
576012994035,3cyclictest691390-21munin-update09:00:063
576012994024,4cyclictest660791-21/usr/share/muni08:30:063
576007994038,1cyclictest746344-21kworker/2:1+pm11:56:562
576007994038,1cyclictest746344-21kworker/2:1+pm10:51:542
576007994038,1cyclictest593033-21kworker/2:0+pm08:20:182
576007994037,2cyclictest746344-21kworker/2:1+pm11:42:442
576007994037,2cyclictest746344-21kworker/2:1+pm11:13:192
576007994037,2cyclictest593033-21kworker/2:0+pm09:00:242
576007994036,3cyclictest834945-21kworker/u8:2+events_unbound11:35:142
576007994036,2cyclictest593033-21kworker/2:0+pm07:43:032
576007994036,2cyclictest593033-21kworker/2:0+pm07:43:032
576007994035,3cyclictest650795-21kworker/u8:1+flush-179:008:55:282
576007994012,27cyclictest3125599-21python310:31:362
576004994037,2cyclictest597391-21kworker/u8:4+flush-179:007:30:231
576004994036,3cyclictest690997-21kworker/u8:0+flush-179:009:40:211
576004994034,5cyclictest737722-21CacheThread_Blo09:45:021
576001994036,3cyclictest716086-21kworker/u8:3+flush-179:011:15:070
576001994036,3cyclictest716086-21kworker/u8:3+flush-179:009:30:220
576001994036,3cyclictest671209-21kworker/u8:4+flush-179:009:17:300
576001994036,2cyclictest3914644-1kworker/0:2H+kblockd07:51:000
576001994026,2cyclictest871153-21kworker/u8:0+flush-179:012:15:070
576012993935,3cyclictest594093-21apt-get07:25:133
576012993933,5cyclictest4102496-1kworker/3:2H+kblockd08:02:243
576012993933,5cyclictest4102496-1kworker/3:2H+kblockd08:02:243
576012993931,6cyclictest247515-21ThreadPoolForeg08:40:243
576007993936,2cyclictest834945-21kworker/u8:2+events_unbound12:10:042
576007993936,2cyclictest746344-21kworker/2:1+pm10:55:532
576007993936,2cyclictest746344-21kworker/2:1+pm10:55:522
576007993936,2cyclictest593033-21kworker/2:0+pm09:46:042
576007993936,2cyclictest593033-21kworker/2:0+pm09:31:062
576007993936,2cyclictest593033-21kworker/2:0+pm09:20:522
576007993936,2cyclictest488353-21kworker/2:1+pm07:28:342
576007993935,3cyclictest861348-21/usr/share/muni11:45:202
576007993935,3cyclictest746344-21kworker/2:1+pm11:05:492
576007993935,2cyclictest593033-21kworker/2:0+pm09:28:072
576007993935,2cyclictest593033-21kworker/2:0+pm07:45:022
576007993932,6cyclictest746344-21kworker/2:1+pm12:05:042
57600799390,14cyclictest587073-31munin-graph07:15:562
576004993936,2cyclictest736501-21kworker/u8:2+flush-179:010:00:001
576004993936,2cyclictest736501-21kworker/u8:2+flush-179:010:00:001
576004993935,3cyclictest721737-21kworker/u8:4+flush-179:010:55:311
576004993935,3cyclictest721737-21kworker/u8:4+flush-179:010:55:311
576004993935,3cyclictest716086-21kworker/u8:3+flush-179:009:50:251
576004993933,5cyclictest247561-21ThreadPoolForeg12:00:241
576004993932,5cyclictest830492-21/usr/share/muni11:15:161
576001993937,2cyclictest650795-21kworker/u8:1+events_unbound08:55:340
576001993937,1cyclictest830072-21kworker/0:0+pm11:22:490
576001993937,1cyclictest0-21swapper/010:10:260
576001993936,3cyclictest757989-21kworker/u8:1+events_unbound10:20:180
576001993936,3cyclictest716086-21kworker/u8:3+events_unbound10:35:290
576001993936,2cyclictest716086-21kworker/u8:3+flush-179:010:00:230
576001993935,3cyclictest580877-21kworker/u8:1+events_unbound07:23:260
57600199391,36cyclictest247557-21chrome11:10:200
576012993836,1cyclictest645413-21kworker/3:3+pm09:22:503
576012993835,2cyclictest784068-21kworker/3:1+pm12:02:563
576012993832,5cyclictest706932-21/usr/share/muni09:15:103
576007993837,1cyclictest746344-21kworker/2:1+pm10:10:202
576007993836,1cyclictest904011-21kworker/2:0+pm12:35:062
576007993836,1cyclictest746344-21kworker/2:1+pm10:07:302
576007993836,1cyclictest488353-21kworker/2:1+pm07:11:542
576007993835,2cyclictest746344-21kworker/2:1+pm10:01:272
576007993835,2cyclictest721737-21kworker/u8:4+flush-179:011:00:182
576007993835,2cyclictest593033-21kworker/2:0+pm09:15:382
576007993835,2cyclictest593033-21kworker/2:0+pm09:10:052
576007993835,2cyclictest593033-21kworker/2:0+pm08:26:252
576007993835,2cyclictest593033-21kworker/2:0+pm08:05:162
576007993835,2cyclictest593033-21kworker/2:0+pm07:56:292
576004993836,1cyclictest794323-21kworker/1:2+pm11:23:151
576004993836,1cyclictest592666-21kworker/1:0+pm07:47:531
576004993834,3cyclictest845906-21/usr/share/muni11:30:061
576004993834,3cyclictest819323-21apt-get11:00:341
576004993834,3cyclictest3446490-1kworker/1:1H+kblockd07:53:471
576004993834,2cyclictest3446490-1kworker/1:1H+kblockd11:58:511
576004993833,4cyclictest580877-21kworker/u8:1+flush-179:007:15:171
576004993830,7cyclictest716086-21kworker/u8:3+flush-179:010:35:181
57600499380,37cyclictest3125630-13chrome08:50:001
57600499380,37cyclictest3125630-13chrome08:50:001
576001993835,2cyclictest3125726-13Chrome_ChildIOT07:49:510
576001993834,3cyclictest811625-21kworker/u8:1+flush-179:011:05:100
576001993834,3cyclictest757989-21kworker/u8:1+flush-179:010:45:320
576001993834,3cyclictest757989-21kworker/u8:1+flush-179:010:40:240
57600199380,37cyclictest3125721-21chrome10:30:010
576012993735,1cyclictest4102496-1kworker/3:2H+kblockd11:09:493
576012993734,2cyclictest876936-1kworker/3:0H+kblockd12:34:193
576012993734,2cyclictest4102496-1kworker/3:2H+kblockd10:24:393
576012993734,2cyclictest4102496-1kworker/3:2H+kblockd10:01:033
576012993733,3cyclictest4102496-1kworker/3:2H+kblockd09:13:453
576007993735,1cyclictest593033-21kworker/2:0+pm08:50:512
576007993735,1cyclictest593033-21kworker/2:0+pm08:02:552
576007993735,1cyclictest593033-21kworker/2:0+pm08:02:552
576007993734,2cyclictest593033-21kworker/2:0+pm08:40:502
576007993734,1cyclictest746344-21kworker/2:1+pm11:50:542
576004993734,2cyclictest850499-21kworker/u8:1+flush-179:011:41:481
576004993734,2cyclictest696354-21kworker/1:2+pm09:08:131
576004993734,2cyclictest3446490-1kworker/1:1H+kblockd10:01:071
576004993734,2cyclictest3446490-1kworker/1:1H+kblockd08:28:051
576004993733,3cyclictest3125726-13Chrome_ChildIOT11:27:531
576004993732,4cyclictest886968-21/usr/share/muni12:10:101
576001993734,2cyclictest3914644-1kworker/0:2H+kblockd10:19:400
576001993734,2cyclictest3914644-1kworker/0:2H+kblockd09:03:400
576001993734,2cyclictest247563-13Compositor08:26:340
576001993733,3cyclictest871153-21kworker/u8:0+events_unbound12:05:200
576001993733,3cyclictest834945-21kworker/u8:2+flush-179:011:32:440
576001993733,3cyclictest716086-21kworker/u8:3+flush-179:011:40:170
576012993634,1cyclictest4102496-1kworker/3:2H+kblockd08:57:373
576012993634,1cyclictest4102496-1kworker/3:2H+kblockd07:47:553
576012993634,1cyclictest4102496-1kworker/3:2H+kblockd07:40:333
576012993634,1cyclictest4102496-1kworker/3:2H+kblockd07:40:333
576012993634,1cyclictest1260-21snmpd10:32:193
576012993633,2cyclictest876936-1kworker/3:0H+kblockd12:06:423
576012993633,2cyclictest4102496-1kworker/3:2H+kblockd11:28:053
576012993633,2cyclictest4102496-1kworker/3:2H+kblockd07:55:343
576012993632,2cyclictest4102496-1kworker/3:2H+kblockd11:45:083
576012993631,4cyclictest247560-21ThreadPoolForeg08:46:043
576012993631,4cyclictest247560-21ThreadPoolForeg08:46:043
576012993630,5cyclictest814472-31munin-html10:55:423
576012993630,5cyclictest814472-31munin-html10:55:413
57600799360,4cyclictest3125627-21ChromeDriver00:55:192
576004993634,1cyclictest3446490-1kworker/1:1H+kblockd11:50:251
576004993634,1cyclictest3446490-1kworker/1:1H+kblockd10:06:451
576004993634,1cyclictest3446490-1kworker/1:1H+kblockd08:35:331
576004993633,2cyclictest671209-21kworker/u8:4+flush-179:008:50:221
576004993633,2cyclictest3446490-1kworker/1:1H+kblockd10:49:241
576004993633,2cyclictest3446490-1kworker/1:1H+kblockd07:35:321
576004993631,4cyclictest640185-21/usr/share/muni08:10:021
576004993631,4cyclictest640185-21/usr/share/muni08:10:021
576004993631,3cyclictest871153-21kworker/u8:0+flush-179:012:20:291
576001993634,1cyclictest723544-21kworker/0:0+pm09:37:450
576001993632,3cyclictest850499-21kworker/u8:1+flush-179:011:45:220
576001993621,14cyclictest3125721-21chrome10:30:380
576012993534,1cyclictest4102496-1kworker/3:2H+kblockd08:38:503
576012993533,1cyclictest876936-1kworker/3:0H+kblockd12:24:333
576012993533,1cyclictest4102496-1kworker/3:2H+kblockd11:54:293
576012993533,1cyclictest4102496-1kworker/3:2H+kblockd11:33:503
576012993533,1cyclictest4102496-1kworker/3:2H+kblockd07:13:483
576012993532,3cyclictest850499-21kworker/u8:1+flush-179:012:00:003
576012993532,2cyclictest876936-1kworker/3:0H+kblockd12:38:413
576012993532,2cyclictest793891-21kworker/u8:2+flush-179:010:54:003
576012993532,2cyclictest4102496-1kworker/3:2H+kblockd11:01:173
576012993530,4cyclictest721737-21kworker/u8:4+flush-179:009:35:263
576012993529,5cyclictest3125725-21ThreadPoolForeg09:05:353
576004993534,1cyclictest3446490-1kworker/1:1H+kblockd12:16:171
576004993534,1cyclictest3446490-1kworker/1:1H+kblockd09:38:351
576004993533,1cyclictest645116-21kworker/1:2+pm08:18:441
576004993533,1cyclictest3446490-1kworker/1:1H+kblockd11:48:581
576004993533,1cyclictest3446490-1kworker/1:1H+kblockd09:27:011
576004993532,2cyclictest629198-21kworker/u8:0+flush-179:008:05:291
576004993532,2cyclictest3446490-1kworker/1:1H+kblockd09:30:051
576004993528,5cyclictest608216-21/usr/share/muni07:40:031
576004993528,5cyclictest608216-21/usr/share/muni07:40:021
576004993520,14cyclictest3125687-21ThreadPoolForeg10:11:501
576001993533,1cyclictest3914644-1kworker/0:2H+kblockd08:50:350
576001993533,1cyclictest3914644-1kworker/0:2H+kblockd08:10:220
576001993533,1cyclictest3914644-1kworker/0:2H+kblockd08:10:220
576001993532,2cyclictest534419-21kworker/u8:2+flush-179:007:14:450
576012993433,1cyclictest742791-21kworker/3:1+pm10:09:283
576012993433,1cyclictest4102496-1kworker/3:2H+kblockd10:26:523
576012993431,2cyclictest876936-1kworker/3:0H+kblockd12:10:343
576012993431,2cyclictest4102496-1kworker/3:2H+kblockd10:40:333
576012993431,2cyclictest3125627-21ChromeDriver00:55:193
576012993431,2cyclictest247544-13Chrome_ChildIOT08:09:313
576012993427,6cyclictest247516-21Chrome_ChildIOT07:50:393
576004993433,1cyclictest3446490-1kworker/1:1H+kblockd12:36:401
576004993430,3cyclictest592879-21/usr/share/muni07:25:141
576001993431,2cyclictest850499-21kworker/u8:1+flush-179:012:25:090
576001993431,2cyclictest850499-21kworker/u8:1+flush-179:012:25:090
576001993431,2cyclictest3125721-21chrome12:00:240
576012993332,1cyclictest4102496-1kworker/3:2H+kblockd07:24:513
576012993330,2cyclictest876936-1kworker/3:0H+kblockd12:18:043
576012993330,2cyclictest4102496-1kworker/3:2H+kblockd10:37:193
576012993329,3cyclictest850499-21kworker/u8:1+flush-179:011:42:493
576004993331,1cyclictest3446490-1kworker/1:1H+kblockd08:34:551
576004993330,2cyclictest1260-21snmpd10:26:431
576004993330,2cyclictest1260-21snmpd07:20:141
576004993329,3cyclictest871153-21kworker/u8:0+flush-179:012:29:361
576004993329,3cyclictest871153-21kworker/u8:0+flush-179:012:29:361
576004993327,5cyclictest770174-21apt-get10:15:151
576001993329,3cyclictest671209-21kworker/u8:4+flush-179:009:20:100
576012993230,1cyclictest4102496-1kworker/3:2H+kblockd07:35:343
576004993230,2cyclictest571187-21kworker/u8:3+flush-179:007:10:351
576004993230,1cyclictest3446490-1kworker/1:1H+kblockd12:08:351
576004993229,2cyclictest809415-31[pango]00:55:191
576001993229,2cyclictest629198-21kworker/u8:0+flush-179:008:05:180
576001993128,2cyclictest3914644-1kworker/0:2H+kblockd09:51:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional