You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-13 - 07:20
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rackbslot1.osadl.org (updated Wed Nov 12, 2025 12:44:38)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24998322216191,16sleep30-21swapper/307:06:563
24998702215186,19sleep00-21swapper/007:07:210
24998552212169,33sleep20-21swapper/207:07:102
24998912208184,14sleep10-21swapper/107:07:371
283699621310,2sleep11253-21openvpn12:30:361
2500259991060,57cyclictest2537722-21/usr/share/muni07:45:013
2500259996459,3cyclictest2733921-21kworker/u8:0+events_unbound11:17:023
2500248996460,3cyclictest2542320-21kworker/u8:0+events_unbound08:15:300
2500259996360,2cyclictest2488873-21kworker/u8:3+events_unbound07:40:083
2500259995855,2cyclictest2687809-21kworker/u8:1+events_unbound12:10:193
2500259995853,3cyclictest2619725-21kworker/u8:0+events_unbound09:11:453
2500259995754,2cyclictest2656746-21kworker/u8:3+flush-179:009:40:103
2500259995753,3cyclictest2708033-21kworker/u8:0+events_unbound10:35:103
2500259995753,3cyclictest2484471-21kworker/u8:2+events_unbound07:10:093
2500259995652,3cyclictest2603968-21kworker/u8:2+events_unbound09:20:013
2500259995550,4cyclictest2582772-31munin-html08:25:343
2500257995546,7cyclictest247573-21ThreadPoolForeg12:30:142
2500248995552,2cyclictest2511155-21kworker/u8:0+flush-179:007:25:100
2500259995450,3cyclictest2786623-21kworker/u8:2+events_unbound12:05:013
2500259995450,3cyclictest2578222-21kworker/u8:1+flush-179:008:45:313
2500249995452,1cyclictest2662479-21snmp_ryswitch.c09:45:021
2500249995440,13cyclictest2537690-21/usr/share/muni07:45:021
2500248995239,2cyclictest2526571-21kworker/u8:4+flush-179:009:00:340
2500259995147,3cyclictest2786623-21kworker/u8:2+flush-179:012:30:193
2500248995148,2cyclictest2656746-21kworker/u8:3+events_unbound10:07:190
2500259995043,3cyclictest2542320-21kworker/u8:0+events_unbound08:15:133
2500248995047,2cyclictest2786623-21kworker/u8:2+flush-179:012:15:300
2500259994945,3cyclictest2765434-21kworker/u8:4+events_unbound11:30:273
2500259994945,3cyclictest2516495-21kworker/u8:2+flush-179:007:25:283
2500249994946,2cyclictest247515-21ThreadPoolForeg08:45:241
2500249994945,3cyclictest247560-21ThreadPoolForeg11:02:131
2500248994945,3cyclictest2828725-21kworker/u8:4+events_unbound12:34:270
2500248994945,2cyclictest2697471-21kworker/u8:2+events_unbound10:50:150
2500259994844,3cyclictest2687809-21kworker/u8:1+flush-179:010:40:233
2500248994845,2cyclictest2526571-21kworker/u8:4+events_unbound07:55:350
2500248994844,3cyclictest2656745-21kworker/u8:0+flush-179:009:50:110
2500248994843,3cyclictest2836744-21kworker/u8:0+events_unbound12:35:300
2500257994742,4cyclictest2521869-21/usr/share/muni07:30:192
2500257994741,4cyclictest2609952-21/usr/share/muni08:55:092
2500248994744,2cyclictest2697471-21kworker/u8:2+flush-179:010:15:390
2500248994743,3cyclictest2646072-21kworker/u8:1+flush-179:009:35:170
2500248994741,2cyclictest2511166-21kworker/u8:1+events_unbound07:50:220
250024899470,46cyclictest2537629-13chrome07:45:020
2500259994643,3cyclictest2526571-21kworker/u8:4+events_unbound09:00:213
2500259994642,3cyclictest2786623-21kworker/u8:2+events_unbound11:50:033
2500249994641,3cyclictest2563114-21latency_hist08:10:011
2500248994643,2cyclictest2687809-21kworker/u8:1+events_unbound10:55:340
2500248994642,3cyclictest2500744-21kworker/u8:4+events_unbound07:15:090
2500248994641,3cyclictest2603968-21kworker/u8:2+events_unbound09:20:290
2500259994542,2cyclictest2656745-21kworker/u8:0+flush-179:010:00:283
2500259994541,3cyclictest247560-21ThreadPoolForeg12:35:083
2500249994540,4cyclictest2594071-21/usr/share/muni08:40:211
2500249994536,8cyclictest2631199-21/usr/share/muni09:15:011
2500248994542,3cyclictest2656745-21kworker/u8:0+events_unbound10:00:320
2500248994542,2cyclictest2687809-21kworker/u8:1+events_unbound12:10:130
2500248994542,2cyclictest2687809-21kworker/u8:1+events_unbound11:40:180
2500248994541,3cyclictest2609051-21kworker/u8:3+flush-179:009:10:120
2500248994539,2cyclictest2764508-21kworker/u8:3+events_unbound11:25:050
2500259994441,2cyclictest2687809-21kworker/u8:1+events_unbound11:55:033
2500259994441,2cyclictest2687809-21kworker/u8:1+events_unbound11:45:173
2500259994441,2cyclictest2542320-21kworker/u8:0+events_unbound08:05:343
2500259994440,3cyclictest2687809-21kworker/u8:1+events_unbound12:25:293
2500259994440,3cyclictest2578222-21kworker/u8:1+flush-179:008:31:253
2500259994438,2cyclictest2656745-21kworker/u8:0+flush-179:009:55:283
2500257994428,15cyclictest247545-13VizCompositorTh12:07:092
2500249994437,5cyclictest2614903-21latency_hist09:00:011
2500248994441,2cyclictest2687809-21kworker/u8:1+flush-179:011:55:290
2500248994441,2cyclictest2687809-21kworker/u8:1+events_unbound11:50:200
2500248994441,2cyclictest2593589-21kworker/u8:0+events_unbound08:45:140
2500248994439,4cyclictest247562-13Chrome_ChildIOT09:15:230
2500259994340,2cyclictest2526571-21kworker/u8:4+events_unbound08:04:443
2500259994339,3cyclictest2593075-31munin-html08:35:323
2500257994335,6cyclictest247516-21Chrome_ChildIOT10:00:282
2500249994339,3cyclictest2684296-21apt-get10:05:131
2500248994340,2cyclictest2733921-21kworker/u8:0+events_unbound12:05:280
2500248994340,2cyclictest2656746-21kworker/u8:3+events_unbound10:15:010
2500248994340,2cyclictest2603968-21kworker/u8:2+flush-179:008:55:210
2500259994239,3cyclictest2733921-21kworker/u8:0+flush-179:012:15:193
2500259994237,4cyclictest2667546-21/usr/share/muni09:50:183
2500259994233,8cyclictest2488873-21kworker/u8:3+flush-179:007:15:203
2500249994238,3cyclictest2646072-21kworker/u8:1+flush-179:009:35:331
2500248994239,2cyclictest2687809-21kworker/u8:1+events_unbound11:05:190
2500248994239,2cyclictest2656745-21kworker/u8:0+events_unbound09:55:300
2500248994238,3cyclictest2697471-21kworker/u8:2+flush-179:010:30:290
2500248994238,3cyclictest2687809-21kworker/u8:1+flush-179:010:25:240
2500248994238,3cyclictest2687809-21kworker/u8:1+flush-179:010:25:240
2500248994238,3cyclictest2578222-21kworker/u8:1+flush-179:008:28:060
2500248994238,3cyclictest2526571-21kworker/u8:4+flush-179:008:20:250
2500248994237,4cyclictest2750902-21apt-get11:10:110
2500259994136,2cyclictest2656746-21kworker/u8:3+flush-179:009:45:233
2500257994139,1cyclictest2609212-21kworker/2:1+pm09:38:412
2500257994139,1cyclictest2434869-1kworker/2:0H+kblockd10:07:232
2500257994138,2cyclictest2474262-21kworker/2:2+pm07:26:432
2500249994135,4cyclictest2548049-21/usr/share/muni07:55:021
2500248994138,3cyclictest2687809-21kworker/u8:1+events_unbound12:25:090
2500248994137,3cyclictest2656745-21kworker/u8:0+events_unbound09:46:170
2500248994137,3cyclictest2603968-21kworker/u8:2+events_unbound09:31:500
2500248994137,3cyclictest2488873-21kworker/u8:3+flush-179:007:30:360
2500248994137,2cyclictest2468361-1kworker/0:1H+kblockd07:23:490
2500248994135,4cyclictest2500557-21/usr/share/muni07:10:040
2500259994037,3cyclictest2593589-21kworker/u8:0+flush-179:008:41:593
2500259994037,2cyclictest2542320-21kworker/u8:0+flush-179:007:55:293
2500259994037,2cyclictest2526571-21kworker/u8:4+events_unbound08:58:343
2500259994036,3cyclictest2733921-21kworker/u8:0+events_unbound12:08:213
2500259994036,3cyclictest2708033-21kworker/u8:0+flush-179:010:29:453
2500259994036,3cyclictest2708033-21kworker/u8:0+flush-179:010:29:453
2500259994036,3cyclictest2542320-21kworker/u8:0+events_unbound08:10:173
2500259994036,3cyclictest2511155-21kworker/u8:0+flush-179:007:20:223
2500259994032,7cyclictest2733921-21kworker/u8:0+flush-179:010:58:563
2500259994028,11cyclictest2687809-21kworker/u8:1+events_unbound11:40:063
2500259994025,14cyclictest2635955-21kworker/u8:4+events_unbound09:24:183
2500257994038,1cyclictest2474262-21kworker/2:2+pm07:23:232
2500257994037,2cyclictest2766985-21kworker/2:1+pm12:26:282
2500257994037,2cyclictest2682647-21kworker/2:2+pm10:23:132
2500257994037,2cyclictest2434869-1kworker/2:0H+kblockd09:20:182
2500257994036,3cyclictest2766985-21kworker/2:1+pm12:15:042
2500257994036,2cyclictest2537989-21kworker/2:1+pm08:05:102
2500257994034,4cyclictest2434869-1kworker/2:0H+kblockd10:40:042
2500257994029,10cyclictest2709370-21kworker/2:0+pm10:49:462
2500249994037,2cyclictest2448831-21kworker/1:2+pm07:44:131
2500249994036,2cyclictest2603968-21kworker/u8:2+flush-179:009:25:261
2500248994037,2cyclictest2687809-21kworker/u8:1+flush-179:011:37:190
2500248994037,2cyclictest2584183-21kworker/u8:2+events_unbound08:37:200
2500248994036,3cyclictest2702900-21kworker/u8:3+events_unbound10:20:540
2500259993936,2cyclictest2697471-21kworker/u8:2+flush-179:011:10:283
2500259993936,2cyclictest2697471-21kworker/u8:2+events_unbound11:20:103
2500259993936,2cyclictest2697471-21kworker/u8:2+events_unbound11:20:103
2500259993935,3cyclictest2765434-21kworker/u8:4+flush-179:011:35:073
2500259993928,10cyclictest2687855-21kworker/3:0+pm11:06:543
2500257993937,1cyclictest2766985-21kworker/2:1+pm11:40:522
2500257993937,1cyclictest2766985-21kworker/2:1+pm11:31:112
2500257993937,1cyclictest2709370-21kworker/2:0+pm11:15:242
2500257993937,1cyclictest2709370-21kworker/2:0+pm11:01:232
2500257993937,1cyclictest2573201-21kworker/2:0+pm08:21:082
2500257993937,1cyclictest2474262-21kworker/2:2+pm07:42:582
2500257993937,1cyclictest2474262-21kworker/2:2+pm07:19:542
2500257993936,2cyclictest2766985-21kworker/2:1+pm12:00:292
2500257993936,2cyclictest2766985-21kworker/2:1+pm11:35:242
2500257993936,2cyclictest2709370-21kworker/2:0+pm11:20:542
2500257993936,2cyclictest2709370-21kworker/2:0+pm11:20:542
2500257993936,2cyclictest2709370-21kworker/2:0+pm10:31:202
2500257993936,2cyclictest2609212-21kworker/2:1+pm09:07:482
2500257993936,2cyclictest2573201-21kworker/2:0+pm08:50:132
2500257993936,2cyclictest2573201-21kworker/2:0+pm08:47:532
2500257993936,1cyclictest2766985-21kworker/2:1+pm11:52:272
2500257993935,3cyclictest2434869-1kworker/2:0H+kblockd11:59:442
2500257993935,2cyclictest2682647-21kworker/2:2+pm10:10:152
2500257993935,2cyclictest2609212-21kworker/2:1+pm09:52:232
2500257993935,2cyclictest2474262-21kworker/2:2+pm07:45:052
2500257993934,3cyclictest2709370-21kworker/2:0+pm10:50:042
2500257993934,3cyclictest2603968-21kworker/u8:2+flush-179:009:17:012
2500257993933,5cyclictest2625926-21/usr/share/muni09:10:172
2500249993936,2cyclictest2698224-21kworker/1:1+pm10:52:531
2500249993935,3cyclictest2646072-21kworker/u8:1+flush-179:009:31:221
2500249993935,2cyclictest2484461-1kworker/1:2H+kblockd09:53:281
2500248993936,2cyclictest2697471-21kworker/u8:2+flush-179:011:21:500
2500248993936,2cyclictest2697471-21kworker/u8:2+flush-179:011:21:500
2500248993936,2cyclictest2697471-21kworker/u8:2+events_unbound10:40:150
2500248993936,2cyclictest2687809-21kworker/u8:1+events_unbound11:46:160
2500248993935,3cyclictest2603968-21kworker/u8:2+events_unbound09:29:030
2500248993934,4cyclictest247515-21ThreadPoolForeg08:40:050
2500259993835,2cyclictest2733921-21kworker/u8:0+events_unbound12:21:383
2500259993835,2cyclictest2511155-21kworker/u8:0+events_unbound07:35:363
2500259993834,3cyclictest2687809-21kworker/u8:1+events_unbound10:33:133
2500259993834,3cyclictest2656745-21kworker/u8:0+events_unbound10:09:123
2500257993836,1cyclictest2766985-21kworker/2:1+pm12:23:342
2500257993836,1cyclictest2709370-21kworker/2:0+pm11:05:352
2500257993836,1cyclictest2709370-21kworker/2:0+pm10:57:302
2500257993836,1cyclictest2609212-21kworker/2:1+pm09:57:432
2500257993836,1cyclictest2609212-21kworker/2:1+pm09:43:232
2500257993836,1cyclictest2609212-21kworker/2:1+pm09:30:092
2500257993836,1cyclictest2573201-21kworker/2:0+pm08:30:232
2500257993836,1cyclictest2573201-21kworker/2:0+pm08:25:032
2500257993836,1cyclictest2537989-21kworker/2:1+pm07:57:402
2500257993835,2cyclictest2766985-21kworker/2:1+pm12:14:542
2500257993835,2cyclictest2766985-21kworker/2:1+pm11:26:082
2500257993835,2cyclictest2709370-21kworker/2:0+pm11:13:492
2500257993835,2cyclictest2709370-21kworker/2:0+pm10:38:472
2500257993835,2cyclictest2609212-21kworker/2:1+pm09:25:262
2500257993835,2cyclictest2573201-21kworker/2:0+pm08:35:302
2500257993835,2cyclictest2434869-1kworker/2:0H+kblockd08:44:282
2500257993834,2cyclictest2434869-1kworker/2:0H+kblockd09:04:432
2500257993832,4cyclictest2558019-21latency_hist08:05:002
2500249993834,3cyclictest2484461-1kworker/1:2H+kblockd11:33:591
2500249993834,3cyclictest2484461-1kworker/1:2H+kblockd10:42:581
2500249993834,2cyclictest2484461-1kworker/1:2H+kblockd10:30:001
2500249993834,2cyclictest2484461-1kworker/1:2H+kblockd10:30:001
2500249993833,3cyclictest2630268-21kworker/u8:1+flush-179:009:11:071
2500249993832,4cyclictest2677668-21latency_hist10:00:001
2500249993828,8cyclictest2484461-1kworker/1:2H+kblockd11:05:151
250024899387,30cyclictest99883-21in:imklog11:00:280
2500248993835,2cyclictest2578222-21kworker/u8:1+flush-179:008:50:240
2500248993834,3cyclictest2708033-21kworker/u8:0+flush-179:010:35:280
2500259993735,2cyclictest2646072-21kworker/u8:1+events_unbound09:36:063
2500259993734,2cyclictest2656745-21kworker/u8:0+events_unbound10:10:133
2500259993734,2cyclictest2603968-21kworker/u8:2+events_unbound09:25:183
2500259993732,4cyclictest247561-21ThreadPoolForeg09:07:343
2500257993735,1cyclictest2682647-21kworker/2:2+pm10:25:172
2500257993735,1cyclictest2682647-21kworker/2:2+pm10:25:172
2500257993734,2cyclictest2766985-21kworker/2:1+pm11:45:022
2500257993734,2cyclictest2474262-21kworker/2:2+pm07:10:582
2500257993732,3cyclictest2662480-21/usr/sbin/munin09:45:012
2500257993724,12cyclictest2682647-21kworker/2:2+pm10:15:032
2500257993720,15cyclictest247560-21ThreadPoolForeg08:10:032
250025799371,3cyclictest247557-21chrome07:50:522
2500249993734,2cyclictest2608657-21kworker/1:0+pm09:02:341
2500249993734,2cyclictest2511166-21kworker/u8:1+flush-179:007:50:211
2500249993734,2cyclictest2484461-1kworker/1:2H+kblockd11:44:091
2500249993734,2cyclictest2484461-1kworker/1:2H+kblockd08:04:441
2500249993734,2cyclictest2484461-1kworker/1:2H+kblockd07:18:441
2500249993733,3cyclictest2484461-1kworker/1:2H+kblockd08:29:541
2500249993733,2cyclictest2484461-1kworker/1:2H+kblockd11:20:561
2500249993733,2cyclictest2484461-1kworker/1:2H+kblockd11:20:561
2500249993732,3cyclictest2484461-1kworker/1:2H+kblockd07:33:241
2500249993731,4cyclictest2723697-21agora-tariff2.s10:45:181
2500248993734,2cyclictest2733921-21kworker/u8:0+events_unbound12:20:080
2500248993734,2cyclictest2702900-21kworker/u8:3+flush-179:010:49:150
2500248993733,3cyclictest2656746-21kworker/u8:3+flush-179:009:40:350
2500248993733,3cyclictest2603968-21kworker/u8:2+flush-179:009:05:120
2500248993731,2cyclictest2765434-21kworker/u8:4+events_unbound11:31:260
2500259993634,1cyclictest1178279-1kworker/3:0H+kblockd07:30:053
2500259993633,2cyclictest2687809-21kworker/u8:1+events_unbound11:00:263
2500259993633,2cyclictest2687809-21kworker/u8:1+events_unbound10:45:153
2500259993633,2cyclictest1178279-1kworker/3:0H+kblockd08:50:243
2500259993632,3cyclictest2526571-21kworker/u8:4+flush-179:007:51:153
2500259993632,3cyclictest247557-21chrome10:20:213
2500257993634,1cyclictest2474262-21kworker/2:2+pm07:35:052
2500257993633,2cyclictest2434869-1kworker/2:0H+kblockd08:17:082
2500249993633,2cyclictest2484461-1kworker/1:2H+kblockd09:21:001
2500249993633,2cyclictest2484461-1kworker/1:2H+kblockd09:05:321
2500249993630,4cyclictest2796720-21/usr/share/muni11:55:021
2500249993622,13cyclictest2786623-21kworker/u8:2+flush-179:012:16:101
2500248993634,1cyclictest2474627-21kworker/0:1+pm07:37:030
2500248993633,2cyclictest2584183-21kworker/u8:2+events_unbound08:32:440
2500248993633,2cyclictest2468361-1kworker/0:1H+kblockd08:11:240
2500248993633,2cyclictest2468361-1kworker/0:1H+kblockd08:07:090
2500248993632,3cyclictest2526571-21kworker/u8:4+flush-179:007:43:250
28409642350,0chrt2840967-21sed12:35:211
2500249993532,2cyclictest2708033-21kworker/u8:0+flush-179:010:30:091
2500249993532,2cyclictest2526732-21munin-update07:35:311
2500249993532,2cyclictest2484461-1kworker/1:2H+kblockd10:16:481
2500249993532,2cyclictest2484461-1kworker/1:2H+kblockd10:00:141
2500249993532,2cyclictest2484461-1kworker/1:2H+kblockd07:12:181
2500249993531,2cyclictest2484461-1kworker/1:2H+kblockd07:22:281
2500249993530,4cyclictest2484461-1kworker/1:2H+kblockd11:53:141
2500249993528,5cyclictest247516-21Chrome_ChildIOT09:40:431
2500248993532,2cyclictest2468361-1kworker/0:1H+kblockd12:00:030
2500259993432,1cyclictest1178279-1kworker/3:0H+kblockd11:28:513
2500259993431,2cyclictest2526571-21kworker/u8:4+events_unbound08:21:123
2500259993428,5cyclictest247515-21ThreadPoolForeg10:50:343
2500257993429,4cyclictest2838075-21/usr/share/muni12:35:022
2500249993432,1cyclictest2484461-1kworker/1:2H+kblockd11:25:461
2500249993431,2cyclictest2484461-1kworker/1:2H+kblockd12:25:001
2500249993430,3cyclictest2484461-1kworker/1:2H+kblockd12:11:291
2500249993430,3cyclictest2484461-1kworker/1:2H+kblockd11:37:291
2500249993430,3cyclictest2484461-1kworker/1:2H+kblockd08:53:241
2500249993428,5cyclictest2754787-21/usr/share/muni11:15:021
2500248993431,2cyclictest2511166-21kworker/u8:1+events_unbound08:00:090
2500248993430,3cyclictest2687809-21kworker/u8:1+flush-179:011:15:150
2500259993330,2cyclictest1178279-1kworker/3:0H+kblockd10:16:443
2500249993330,2cyclictest2484461-1kworker/1:2H+kblockd10:55:521
2500249993329,2cyclictest2484461-1kworker/1:2H+kblockd12:09:141
2500259993228,3cyclictest2647073-21/usr/share/muni09:30:023
2500249993230,2cyclictest1260-21snmpd10:21:291
2500249993230,1cyclictest1260-21snmpd08:36:481
2500249993230,1cyclictest107350-21ntpd12:28:101
2500249993227,4cyclictest2786418-21ThreadPoolForeg11:45:201
2500249993225,5cyclictest2688135-21/usr/share/muni10:10:011
2500249993129,1cyclictest1260-21snmpd12:00:321
2500249993129,1cyclictest1260-21snmpd10:36:141
2500249993129,1cyclictest1260-21snmpd08:34:361
2500249993129,1cyclictest1260-21snmpd08:21:211
2500249993129,1cyclictest1260-21snmpd07:25:341
2500249993128,2cyclictest2484461-1kworker/1:2H+kblockd08:10:541
2500249993125,5cyclictest2749689-21/usr/share/muni11:10:201
2500249992624,1cyclictest1260-21snmpd08:16:031
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional