You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 20:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackbslot1.osadl.org (updated Fri Nov 21, 2025 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32809192207183,14sleep20-21swapper/207:08:222
32807482199169,20sleep30-21swapper/307:06:143
32808812197173,14sleep10-21swapper/107:07:511
32808572182158,14sleep00-21swapper/007:07:350
3281233997773,2cyclictest3504360-21/usr/share/muni10:45:011
3281237997470,3cyclictest3529271-21kworker/u8:5+flush-179:011:30:102
3281231996762,3cyclictest3493425-21kworker/u8:1+flush-179:010:40:360
3281233996357,4cyclictest3318255-21ThreadPoolSingl07:45:021
3281237996157,3cyclictest3520364-21kworker/u8:2+flush-179:011:10:202
3281233996154,5cyclictest3566198-21chrome11:45:041
3281231996156,4cyclictest3570888-21kworker/u8:0+flush-179:011:50:160
3281237995954,4cyclictest3334006-21/usr/share/muni08:00:022
3281233995947,3cyclictest3503877-21gpgv10:45:001
3281237995753,3cyclictest3601515-21kworker/u8:3+flush-179:012:30:302
3281233995750,5cyclictest3125724-21ThreadPoolForeg10:50:101
3281231995755,1cyclictest0-21swapper/009:40:350
3281231995651,4cyclictest3509861-21/usr/share/muni10:50:150
3281237995551,3cyclictest3555245-21kworker/u8:4+flush-179:011:45:292
3281237995551,3cyclictest3313674-21kworker/u8:2+events_unbound10:35:312
3281233995548,5cyclictest3441766-21/usr/share/muni09:45:111
3281231995540,14cyclictest3339998-21apt-get08:05:110
3281237995451,2cyclictest3313674-21kworker/u8:2+events_unbound09:15:302
3281237995450,3cyclictest3545253-21kworker/u8:2+events_unbound12:00:302
328123799544,48cyclictest3380234-21snmp_wlanswitch08:45:012
3281239995348,4cyclictest3239207-21kworker/u8:1+flush-179:008:45:313
3281239995346,4cyclictest3313097-21/usr/share/muni07:40:153
3281237995349,3cyclictest3426669-21kworker/u8:3+events_unbound10:17:002
3281237995349,3cyclictest3317862-21kworker/u8:3+events_unbound07:55:162
3281237995249,2cyclictest3384842-21kworker/u8:5+events_unbound09:38:102
3281231995247,4cyclictest3125688-21Chrome_ChildIOT11:30:360
3281237995148,2cyclictest3410664-21kworker/u8:1+flush-179:009:30:262
3281237995147,3cyclictest3545253-21kworker/u8:2+events_unbound12:15:012
3281237995147,3cyclictest3265010-21kworker/u8:2+flush-179:007:20:012
3281237995136,14cyclictest3541834-21ntpq11:20:162
3281237995136,14cyclictest3535034-21kworker/u8:1+events_unbound11:55:152
3281239995045,4cyclictest3467328-21kworker/u8:4+flush-179:010:23:113
3281237995047,2cyclictest3565466-21kworker/u8:5+events_unbound12:20:292
3281237995047,2cyclictest3565466-21kworker/u8:5+events_unbound12:20:292
3281237995046,3cyclictest3280811-21kworker/u8:3+flush-179:007:10:072
3281237995024,25cyclictest3493425-21kworker/u8:1+flush-179:010:45:022
3281233995042,6cyclictest3125724-21ThreadPoolForeg11:15:111
3281231995047,2cyclictest3313674-21kworker/u8:2+flush-179:009:25:220
3281231995046,3cyclictest3313674-21kworker/u8:2+flush-179:010:05:200
3281231995045,4cyclictest3125687-21ThreadPoolForeg12:00:350
3281237994946,2cyclictest3565466-21kworker/u8:5+flush-179:012:17:012
3281237994946,2cyclictest3313674-21kworker/u8:2+flush-179:008:10:112
3281237994945,3cyclictest3301741-21kworker/u8:3+events_unbound07:33:032
3281237994945,2cyclictest3239207-21kworker/u8:1+events_unbound08:22:442
3281237994945,2cyclictest3239207-21kworker/u8:1+events_unbound08:22:442
3281233994945,3cyclictest3301745-31munin-graph07:25:491
3281239994844,3cyclictest3493425-21kworker/u8:1+flush-179:010:55:063
3281239994844,3cyclictest3462265-21kworker/u8:0+flush-179:010:31:293
3281239994843,3cyclictest3239207-21kworker/u8:1+flush-179:008:25:113
3281231994845,2cyclictest3313674-21kworker/u8:2+flush-179:010:00:250
3281239994743,3cyclictest3451917-21gpgv09:54:593
3281237994745,2cyclictest3313674-21kworker/u8:2+events_unbound09:25:122
3281237994744,2cyclictest3565466-21kworker/u8:5+flush-179:012:35:272
3281237994743,3cyclictest76405-21systemd-journal09:25:012
3281237994743,2cyclictest3313674-21kworker/u8:2+events_unbound09:55:002
3281237994737,3cyclictest3467328-21kworker/u8:4+events_unbound11:05:022
3281231994744,2cyclictest3354010-21kworker/u8:3+flush-179:008:30:100
3281239994639,5cyclictest3426122-21latency_hist09:30:013
3281237994642,3cyclictest3555245-21kworker/u8:4+events_unbound11:50:072
3281237994642,3cyclictest3514394-21kworker/u8:0+flush-179:010:52:562
3281237994642,3cyclictest3364201-21kworker/u8:0+flush-179:008:52:052
3281237994633,13cyclictest3529271-21kworker/u8:5+flush-179:011:15:162
3281233994638,5cyclictest3359596-21/usr/share/muni08:25:021
3281233994638,5cyclictest3359596-21/usr/share/muni08:25:021
3281233994636,9cyclictest3529271-21kworker/u8:5+flush-179:011:25:161
3281237994542,3cyclictest3239207-21kworker/u8:1+flush-179:008:26:522
3281237994540,4cyclictest3125724-21ThreadPoolForeg10:04:162
3281237994540,3cyclictest3520364-21kworker/u8:2+events_unbound11:00:152
3281237994539,4cyclictest3441745-21chrome09:45:022
3281237994511,33cyclictest3125728-13Compositor08:30:452
3281231994542,2cyclictest3239207-21kworker/u8:1+events_unbound08:04:260
3281231994540,4cyclictest3565466-21kworker/u8:5+flush-179:011:45:010
3281231994539,4cyclictest3498697-21latency_hist10:40:010
33874662440,1sleep03387463-21if_enp3s008:50:190
3281239994440,3cyclictest3384842-21kworker/u8:5+flush-179:010:00:153
3281237994440,3cyclictest3545253-21kworker/u8:2+events_unbound11:40:152
3281237994440,3cyclictest3384842-21kworker/u8:5+flush-179:009:05:202
3281233994431,2cyclictest3446490-1kworker/1:1H+kblockd11:04:361
3281231994440,3cyclictest3384842-21kworker/u8:5+flush-179:009:00:120
3281231994440,3cyclictest3307661-21kworker/u8:0+flush-179:007:40:350
328123199441,42cyclictest247557-21chrome07:50:150
3281239994338,3cyclictest3529271-21kworker/u8:5+flush-179:011:15:203
3281239994325,16cyclictest3281389-21/usr/share/muni07:10:143
3281237994340,2cyclictest3503545-21kworker/u8:3+events_unbound10:44:562
3281237994340,2cyclictest3467328-21kworker/u8:4+flush-179:010:30:232
3281237994340,2cyclictest3313674-21kworker/u8:2+events_unbound08:41:452
3281237994340,2cyclictest3239207-21kworker/u8:1+flush-179:007:20:282
3281237994339,3cyclictest3313674-21kworker/u8:2+events_unbound10:26:542
3281237994336,2cyclictest3317862-21kworker/u8:3+events_unbound07:45:342
3281233994338,4cyclictest3483519-21/usr/share/muni10:25:031
3281233994336,5cyclictest3125687-21ThreadPoolForeg09:35:361
3281233994336,4cyclictest3477876-21latency_hist10:20:011
3281233994335,5cyclictest3313090-21/usr/share/muni07:40:091
3281231994339,3cyclictest3313674-21kworker/u8:2+flush-179:010:25:270
3281239994238,3cyclictest3505303-21ThreadPoolForeg10:45:143
3281239994238,3cyclictest3239207-21kworker/u8:1+flush-179:008:02:003
3281239994238,3cyclictest3239207-21kworker/u8:1+flush-179:007:30:183
3281239994237,4cyclictest3570888-21kworker/u8:0+events_unbound11:55:323
3281237994240,1cyclictest3276455-21kworker/2:2+pm07:39:242
3281237994239,2cyclictest3535034-21kworker/u8:1+flush-179:011:35:092
3281237994239,2cyclictest3384842-21kworker/u8:5+flush-179:008:55:252
3281237994238,3cyclictest3313674-21kworker/u8:2+flush-179:008:37:462
3281237994238,3cyclictest3239207-21kworker/u8:1+flush-179:008:05:262
3281233994236,4cyclictest3400798-21/usr/share/muni09:05:011
3281231994239,2cyclictest3384842-21kworker/u8:5+flush-179:009:10:080
3281231994239,2cyclictest3384842-21kworker/u8:5+flush-179:009:10:070
3281231994239,2cyclictest3354010-21kworker/u8:3+events_unbound08:25:290
3281231994238,3cyclictest3601515-21kworker/u8:3+flush-179:012:25:110
3281239994136,4cyclictest3493852-21/usr/share/muni10:35:093
3281239994136,4cyclictest3332731-21kworker/u8:0+flush-179:008:05:123
3281239994135,4cyclictest3535034-21kworker/u8:1+events_unbound11:25:123
3281237994138,2cyclictest3529271-21kworker/u8:5+events_unbound11:27:502
3281237994137,3cyclictest3587529-21kworker/u8:4+flush-179:012:05:262
3281237994137,3cyclictest3493425-21kworker/u8:1+flush-179:010:55:102
3281237994135,2cyclictest3239207-21kworker/u8:1+flush-179:008:17:122
3281233994132,7cyclictest3390573-21/usr/share/muni08:55:051
3281233994132,7cyclictest247560-21ThreadPoolForeg11:40:201
3281231994139,2cyclictest3239207-21kworker/u8:1+flush-179:008:10:310
3281231994137,3cyclictest3606218-31munin-html12:20:350
3281231994137,3cyclictest3606218-31munin-html12:20:340
3281231994137,3cyclictest3380179-21ThreadPoolForeg08:45:020
3281231994137,3cyclictest3313674-21kworker/u8:2+events_unbound08:40:130
328123199410,40cyclictest247557-21chrome09:36:400
3281239994036,3cyclictest3565466-21kworker/u8:5+flush-179:012:05:073
3281239994035,4cyclictest3125687-21ThreadPoolForeg07:25:253
3281237994038,1cyclictest3307475-21kworker/2:1+pm09:11:182
3281237994038,1cyclictest3307475-21kworker/2:1+pm09:11:182
3281237994037,2cyclictest3601515-21kworker/u8:3+flush-179:012:25:262
3281237994026,3cyclictest3313674-21kworker/u8:2+events_unbound07:42:442
3281233994035,4cyclictest3396783-21apt-get09:00:131
3281233994035,3cyclictest3462265-21kworker/u8:0+flush-179:010:20:271
3281233994034,5cyclictest3384842-21kworker/u8:5+events_unbound10:00:011
3281233994033,6cyclictest3125687-21ThreadPoolForeg08:11:501
3281233994033,5cyclictest3467842-21/usr/share/muni10:10:161
328123399400,39cyclictest3125630-13chrome11:32:171
3281231994038,1cyclictest3503861-1kworker/0:0H+kblockd11:09:440
3281231994037,2cyclictest3384842-21kworker/u8:5+events_unbound09:30:280
3281231994037,2cyclictest3313674-21kworker/u8:2+flush-179:008:35:150
3281231994036,3cyclictest3555245-21kworker/u8:4+flush-179:011:45:360
328123199400,39cyclictest3125721-21chrome09:15:110
3281239993936,3cyclictest3596349-21kworker/u8:0+flush-179:012:16:133
3281239993936,2cyclictest3539969-21kworker/3:2+pm12:32:493
3281239993936,2cyclictest247563-13Compositor07:39:293
3281239993934,4cyclictest3381053-1kworker/3:2H+kblockd09:24:293
3281239993934,4cyclictest3313674-21kworker/u8:2+flush-179:010:25:163
3281239993932,5cyclictest3565135-21munin-limits11:40:343
3281237993937,2cyclictest3317862-21kworker/u8:3+flush-179:007:50:292
3281237993937,1cyclictest3471909-21kworker/2:0+pm10:23:252
3281237993936,2cyclictest3436193-21kworker/2:2+pm10:13:442
3281237993936,2cyclictest3436193-21kworker/2:2+pm09:59:312
3281237993936,2cyclictest3307475-21kworker/2:1+pm09:00:062
3281233993936,2cyclictest3312918-21kworker/1:0+pm10:04:541
3281233993935,3cyclictest3354010-21kworker/u8:3+flush-179:008:30:081
3281233993934,3cyclictest1812590-1kworker/1:0H+kblockd09:40:191
3281233993934,3cyclictest1812590-1kworker/1:0H+kblockd07:38:441
3281233993930,6cyclictest2845356-21apache211:35:181
3281231993936,2cyclictest3570888-21kworker/u8:0+events_unbound11:55:340
3281231993935,3cyclictest3313674-21kworker/u8:2+flush-179:008:55:220
3281231993935,3cyclictest3239207-21kworker/u8:1+flush-179:007:20:210
3281231993933,5cyclictest247573-21ThreadPoolForeg11:37:390
328123199390,38cyclictest3125599-21python309:55:350
3281239993835,2cyclictest3570888-21kworker/u8:0+flush-179:011:46:373
3281239993835,2cyclictest3379936-21kworker/3:1+pm08:53:333
3281239993834,3cyclictest3384842-21kworker/u8:5+flush-179:009:10:153
3281239993834,3cyclictest3384842-21kworker/u8:5+flush-179:009:10:153
3281239993832,4cyclictest3125724-21ThreadPoolForeg11:07:283
3281239993831,5cyclictest3125724-21ThreadPoolForeg10:15:363
3281239993829,8cyclictest3125726-13Chrome_ChildIOT11:53:563
3281239993823,13cyclictest3441885-21/usr/share/muni09:45:153
3281237993836,1cyclictest3276455-21kworker/2:2+pm07:27:042
3281237993835,2cyclictest3436193-21kworker/2:2+pm10:05:352
3281233993834,3cyclictest3446490-1kworker/1:1H+kblockd12:38:541
3281233993833,4cyclictest3587529-21kworker/u8:4+flush-179:012:10:131
3281233993832,4cyclictest3520364-21kworker/u8:2+flush-179:011:10:151
3281233993831,5cyclictest3363922-21munin-limits08:25:351
3281231993836,1cyclictest3280682-21kworker/0:0+pm07:19:530
3281231993835,2cyclictest3313674-21kworker/u8:2+flush-179:009:50:170
3281231993833,4cyclictest3617432-21/usr/share/muni12:35:070
3281231993833,4cyclictest3524187-21munin-limits11:00:340
328123199380,9cyclictest247557-21chrome10:30:200
328123199380,37cyclictest3125709-13VizCompositorTh11:10:160
328123199380,37cyclictest247557-21chrome12:05:220
3281239993735,1cyclictest3379936-21kworker/3:1+pm09:18:043
3281239993735,1cyclictest3312647-21kworker/3:0+pm07:55:313
3281239993734,2cyclictest3381053-1kworker/3:2H+kblockd09:05:373
3281239993733,2cyclictest3265010-21kworker/u8:2+flush-179:007:15:063
3281239993731,4cyclictest3436582-21/usr/share/muni09:40:043
3281237993733,3cyclictest3426669-21kworker/u8:3+flush-179:009:42:062
3281233993734,2cyclictest3446490-1kworker/1:1H+kblockd12:02:281
3281233993734,2cyclictest3446490-1kworker/1:1H+kblockd11:24:101
3281233993734,2cyclictest3446490-1kworker/1:1H+kblockd09:50:281
3281233993734,2cyclictest1812590-1kworker/1:0H+kblockd08:15:161
3281233993734,2cyclictest1812590-1kworker/1:0H+kblockd07:11:461
3281233993733,2cyclictest3446490-1kworker/1:1H+kblockd11:52:591
3281233993733,2cyclictest1812590-1kworker/1:0H+kblockd08:40:231
3281233993732,4cyclictest3364201-21kworker/u8:0+flush-179:009:32:591
3281233993732,3cyclictest3380997-21ThreadPoolForeg08:45:141
3281233993731,4cyclictest3591225-31munin-graph12:06:011
3281233993730,5cyclictest3323530-21/usr/share/muni07:50:101
3281231993735,1cyclictest0-21swapper/007:35:110
3281239993633,2cyclictest3381053-1kworker/3:2H+kblockd10:10:043
3281239993633,2cyclictest3381053-1kworker/3:2H+kblockd08:55:363
3281239993633,1cyclictest3381053-1kworker/3:2H+kblockd12:20:463
3281239993633,1cyclictest3381053-1kworker/3:2H+kblockd12:20:463
3281239993631,4cyclictest3384842-21kworker/u8:5+flush-179:009:55:173
3281239993631,3cyclictest3514394-21kworker/u8:0+flush-179:011:00:183
3281239993630,4cyclictest3354638-21/usr/share/muni08:20:073
3281239993630,4cyclictest3354638-21/usr/share/muni08:20:063
3281239993627,7cyclictest247561-21ThreadPoolForeg11:30:593
328123999361,3cyclictest3125630-13chrome08:17:063
3281233993633,2cyclictest3446490-1kworker/1:1H+kblockd12:23:501
3281233993633,2cyclictest3446490-1kworker/1:1H+kblockd12:23:501
3281233993633,2cyclictest3446490-1kworker/1:1H+kblockd11:55:161
3281233993633,2cyclictest1812590-1kworker/1:0H+kblockd08:53:191
3281233993633,2cyclictest1812590-1kworker/1:0H+kblockd07:20:341
3281233993633,2cyclictest1812590-1kworker/1:0H+kblockd07:16:551
3281233993632,3cyclictest1812590-1kworker/1:0H+kblockd08:03:421
3281233993632,2cyclictest3125627-21ChromeDriver00:55:191
3281231993633,2cyclictest3503861-1kworker/0:0H+kblockd10:46:130
3281231993633,2cyclictest3462265-21kworker/u8:0+events_unbound10:15:160
3281231993632,3cyclictest99884-21rs:main0
3281231993632,3cyclictest3565466-21kworker/u8:5+events_unbound12:11:110
3281231993632,3cyclictest3410664-21kworker/u8:1+flush-179:009:20:120
328123199360,35cyclictest3125627-21ChromeDriver00:55:190
328123199360,35cyclictest247560-21ThreadPoolForeg11:20:120
3281239993533,1cyclictest3381053-1kworker/3:2H+kblockd12:01:023
3281239993531,3cyclictest3500153-21apt-get10:40:133
3281239993531,3cyclictest3317862-21kworker/u8:3+events_unbound07:45:243
3281239993530,4cyclictest3313674-21kworker/u8:2+events_unbound08:10:103
3281239993530,3cyclictest3596349-21kworker/u8:0+flush-179:012:14:583
3281239993530,3cyclictest3514343-31munin-graph10:50:523
3281239993530,3cyclictest3239207-21kworker/u8:1+flush-179:008:30:283
3281233993533,1cyclictest3446490-1kworker/1:1H+kblockd11:07:481
3281233993533,1cyclictest3446490-1kworker/1:1H+kblockd10:31:531
3281233993533,1cyclictest1260-21snmpd07:55:011
3281233993532,2cyclictest3446490-1kworker/1:1H+kblockd12:30:331
3281233993532,2cyclictest3446490-1kworker/1:1H+kblockd12:27:021
3281233993532,2cyclictest3446490-1kworker/1:1H+kblockd10:36:251
3281233993532,2cyclictest3446490-1kworker/1:1H+kblockd10:09:561
3281233993532,2cyclictest1812590-1kworker/1:0H+kblockd09:21:451
3281233993532,2cyclictest1812590-1kworker/1:0H+kblockd08:39:191
328123399351,32cyclictest247557-21chrome09:10:101
328123399351,32cyclictest247557-21chrome09:10:101
3281231993533,2cyclictest3313674-21kworker/u8:2+events_unbound10:20:340
3281231993532,2cyclictest3545253-21kworker/u8:2+flush-179:012:30:370
3281231993532,2cyclictest3529271-21kworker/u8:5+events_unbound11:25:390
3281231993532,2cyclictest3210621-21kworker/u8:0+flush-179:007:10:500
3281231993531,3cyclictest3534798-21kworker/u8:0+flush-179:011:15:320
3281231993530,3cyclictest3349433-21/usr/share/muni08:15:170
3281239993433,1cyclictest2893390-1kworker/3:1H+kblockd08:43:253
3281239993430,3cyclictest3410664-21kworker/u8:1+flush-179:009:35:063
3281239993430,3cyclictest3395688-21/usr/share/muni09:00:133
328123999340,2cyclictest3371277-21ld08:35:153
3281233993431,2cyclictest3446490-1kworker/1:1H+kblockd12:17:441
3281233993430,2cyclictest1260-21snmpd09:25:231
3281233993428,4cyclictest3410969-21/usr/share/muni09:15:001
3281231993433,1cyclictest3280682-21kworker/0:0+pm08:22:500
3281231993433,1cyclictest3280682-21kworker/0:0+pm08:22:500
3281231993430,3cyclictest3384842-21kworker/u8:5+flush-179:009:05:230
3281239993330,2cyclictest3545253-21kworker/u8:2+flush-179:012:38:443
3281239993330,2cyclictest3381053-1kworker/3:2H+kblockd12:28:483
3281239993330,2cyclictest2893390-1kworker/3:1H+kblockd07:20:593
3281239993330,2cyclictest1260-21snmpd10:08:443
3281239993323,9cyclictest2893390-1kworker/3:1H+kblockd07:51:413
3281233993327,5cyclictest3343727-31munin-graph08:05:541
3281231993331,1cyclictest3503861-1kworker/0:0H+kblockd10:57:550
3281231993330,2cyclictest2631980-1kworker/0:2H+kblockd07:32:110
3281231993329,3cyclictest3467328-21kworker/u8:4+events_unbound10:12:270
3281239993230,1cyclictest1260-21snmpd11:39:293
3281239993228,3cyclictest3381053-1kworker/3:2H+kblockd11:10:173
3281233993228,2cyclictest3125624-21chromedriver10:56:441
3281231993229,2cyclictest3503861-1kworker/0:0H+kblockd12:17:020
3281231993228,3cyclictest3317862-21kworker/u8:3+flush-179:007:45:150
3281239993128,2cyclictest3381053-1kworker/3:2H+kblockd11:20:573
3281239993127,3cyclictest3125629-21e21169fc69a4c6709:32:023
3281231993129,1cyclictest107350-21ntpd07:58:300
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional