You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 11:25
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Tue Nov 25, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
313538221050,2sleep30-21swapper/319:40:023
332283421040,1sleep00-21swapper/021:54:320
329420921030,1sleep00-21swapper/021:35:370
352252021010,2sleep20-21swapper/223:47:202
35746772840,2sleep20-21swapper/200:17:262
3096430992421,2cyclictest3541544-21sendmail-msp00:00:011
3096430992418,2cyclictest170550irq/121-eno121:45:011
3096429992313,6cyclictest3538220-21phc2sys-jitter23:55:320
3096429992312,6cyclictest0-21swapper/000:05:010
3096431992219,1cyclictest0-21swapper/222:15:012
3096430992219,2cyclictest3096428-21cyclictest23:40:011
3096429992219,2cyclictest3610910-21munin-run00:40:000
3096429992219,2cyclictest1-21systemd19:15:020
3096429992212,6cyclictest3455947-21kthreadcore23:10:280
835298210,6rtkit-daemon3102531-21munin-node23:29:130
3096431992119,1cyclictest0-21swapper/221:00:022
3096430992118,2cyclictest3297270-21grep21:40:021
3096430992118,2cyclictest1-21systemd00:15:001
3096430992113,3cyclictest0-21swapper/123:50:011
3096430992112,4cyclictest0-21swapper/122:30:021
3096429992118,2cyclictest3358379-21gpgconf22:15:010
3096429992115,4cyclictest3263517-21tr21:20:260
3096429992112,5cyclictest3326514-21kthreadcore21:55:300
3096429992112,5cyclictest3280086-21/usr/sbin/munin21:30:290
3096429992111,6cyclictest0-21swapper/021:50:010
3096429992110,6cyclictest0-21swapper/021:10:240
31661792200,2sleep30-21swapper/320:05:233
3096429992011,5cyclictest3419740-21/usr/sbin/munin22:50:310
3096429992010,5cyclictest3587314-21kthreadcore00:25:300
3096431991917,1cyclictest0-21swapper/223:10:022
3096431991916,1cyclictest0-21swapper/223:20:252
3096431991916,1cyclictest0-21swapper/222:37:052
3096431991916,1cyclictest0-21swapper/221:50:012
3096431991916,1cyclictest0-21swapper/220:15:002
3096430991916,2cyclictest3471699-21apt-key23:20:011
3096430991916,2cyclictest1-21systemd19:15:011
309642999199,6cyclictest3341508-21cstates22:05:230
3096429991916,2cyclictest3515538-21systemd-run23:45:010
3096429991916,2cyclictest1635-21dbus-daemon21:05:010
3096429991913,5cyclictest3579622-21kthreadcore00:20:320
309642999191,10cyclictest0-21swapper/022:32:300
302487291190,2phc2sys0-21swapper/323:09:473
302487291190,2phc2sys0-21swapper/322:50:283
3096430991815,2cyclictest3436578-21ssh23:00:001
3096430991815,2cyclictest3340640-21sh22:05:001
3096430991815,2cyclictest1-21systemd00:05:011
309642999188,5cyclictest0-21swapper/022:45:290
309642999187,6cyclictest0-21swapper/000:20:010
3096429991815,2cyclictest3497853-21systemd23:35:000
3096429991815,2cyclictest3436818-21grep23:00:020
3096429991812,5cyclictest3254930-21if_err_eno121:15:280
3096429991810,4cyclictest3525343-21hddtemp_smartct23:50:260
302487291180,2phc2sys0-21swapper/323:54:013
302487291180,2phc2sys0-21swapper/322:09:483
835298170,3rtkit-daemon2025-21snmpd22:17:310
3096431991714,1cyclictest0-21swapper/223:00:352
3096431991714,1cyclictest0-21swapper/222:50:022
3096430991714,2cyclictest3349660-21/usr/sbin/munin22:10:011
3096430991714,2cyclictest3244616-21latency_hist21:10:011
309642999178,8cyclictest3183512-21sshd20:16:310
309642999177,5cyclictest0-21swapper/023:00:340
309642999176,7cyclictest0-21swapper/021:40:240
3096429991715,1cyclictest3123407-21aten2.4-expect19:30:240
3096429991714,2cyclictest1542102-1atop21:10:020
3096429991711,5cyclictest3503766-21unixbench-2d23:35:370
302487291170,2phc2sys0-21swapper/323:39:413
3096431991614,1cyclictest0-21swapper/222:10:002
3096431991614,1cyclictest0-21swapper/219:30:022
3096431991613,1cyclictest0-21swapper/223:59:312
3096431991613,1cyclictest0-21swapper/223:45:002
3096431991613,1cyclictest0-21swapper/222:30:292
3096431991613,1cyclictest0-21swapper/221:10:012
3096431991612,2cyclictest0-21swapper/221:20:222
3096431991612,2cyclictest0-21swapper/220:08:252
309643099169,5cyclictest1635-21dbus-daemon22:25:021
309643099169,3cyclictest3306471-21aten_repower_po21:45:241
3096430991613,2cyclictest3262514-21latency_hist21:20:021
3096430991613,2cyclictest3195041-21phc2sys20:25:321
3096430991613,2cyclictest3096428-21cyclictest23:00:021
3096430991613,2cyclictest1635-21dbus-daemon23:30:011
3096430991613,2cyclictest1635-21dbus-daemon00:35:011
3096430991612,3cyclictest3355736-21kworker/u16:3+nfsiod23:32:461
3096430991612,3cyclictest1652-1atopacctd19:30:301
3096430991612,2cyclictest1629-21avahi-daemon19:55:021
309643099161,14cyclictest3196330-21apt-get20:30:221
3096430991610,1cyclictest170550irq/121-eno123:10:221
309642999169,6cyclictest0-21swapper/022:40:020
309642999168,1cyclictest0-21swapper/000:30:320
3096429991613,2cyclictest3402506-21aten_repower_cu22:40:210
3096429991613,2cyclictest3214489-21systemd20:45:020
3096429991613,2cyclictest0-21swapper/023:50:000
3096429991612,3cyclictest3355736-21kworker/u16:3+nfsiod23:07:180
3096429991610,2cyclictest0-21swapper/000:09:140
309642999160,8cyclictest3188561-21cut20:20:310
302487291160,2phc2sys0-21swapper/323:45:303
302487291160,2phc2sys0-21swapper/300:09:363
3096431991513,1cyclictest0-21swapper/223:30:302
3096431991513,1cyclictest0-21swapper/221:40:012
3096431991512,1cyclictest0-21swapper/223:35:022
3096431991512,1cyclictest0-21swapper/223:30:012
3096431991512,1cyclictest0-21swapper/222:00:342
3096431991512,1cyclictest0-21swapper/221:30:292
3096431991512,1cyclictest0-21swapper/221:30:002
3096431991512,1cyclictest0-21swapper/220:46:332
3096431991512,1cyclictest0-21swapper/220:00:002
3096431991512,1cyclictest0-21swapper/219:50:002
3096431991512,1cyclictest0-21swapper/219:50:002
3096431991512,1cyclictest0-21swapper/219:20:012
3096431991512,1cyclictest0-21swapper/200:00:362
3096431991511,2cyclictest0-21swapper/222:25:302
3096431991511,2cyclictest0-21swapper/220:20:302
309643199150,13cyclictest0-21swapper/200:26:042
309643099159,5cyclictest0-21swapper/121:25:011
309643099156,2cyclictest835298rtkit-daemon20:10:011
3096430991512,2cyclictest3605613-21kthreadcore00:35:311
3096430991512,2cyclictest3507640-21cstates23:40:231
3096430991512,2cyclictest3422516-21kthreadcore22:50:291
3096430991512,2cyclictest3323615-21/usr/sbin/munin21:55:291
3096430991512,2cyclictest3320351-21unixbench-2d21:50:331
3096430991512,2cyclictest3214478-21grep20:45:021
3096430991511,3cyclictest3552416-21kthreadcore00:05:291
3096430991511,3cyclictest3361807-21kthreadcore22:15:301
3096430991511,3cyclictest3281492-21kthreadcore21:30:301
3096430991511,3cyclictest3271732-21cpuspeed_turbos21:25:251
3096430991511,2cyclictest1700-21systemd-logind22:45:011
3096430991511,2cyclictest0-21swapper/120:40:021
309643099150,4cyclictest0-21swapper/123:21:081
309642999157,7cyclictest3152179-21tr19:50:310
309642999154,6cyclictest3562273-21kthreadcore00:10:300
309642999152,1cyclictest835298rtkit-daemon23:16:530
3096429991513,1cyclictest3177739-21latency_hist20:15:010
3096429991512,2cyclictest3220183-21sshd20:48:330
3096429991512,2cyclictest3208332-21latency_hist20:40:010
3096429991512,2cyclictest3111906-21head19:20:260
302487291150,7phc2sys0-21swapper/319:50:233
302487291150,6phc2sys0-21swapper/319:20:353
302487291150,3phc2sys0-21swapper/321:42:383
302487291150,3phc2sys0-21swapper/300:22:593
302487291150,2phc2sys0-21swapper/323:04:283
302487291150,2phc2sys0-21swapper/300:34:473
302487291150,2phc2sys0-21swapper/300:01:343
309643199141,9cyclictest0-21swapper/200:40:012
3096431991411,1cyclictest0-21swapper/223:50:212
3096431991411,1cyclictest0-21swapper/223:15:292
3096431991411,1cyclictest0-21swapper/222:40:282
3096431991411,1cyclictest0-21swapper/222:20:282
3096431991411,1cyclictest0-21swapper/221:55:362
3096431991411,1cyclictest0-21swapper/221:55:012
3096431991411,1cyclictest0-21swapper/220:50:332
3096431991411,1cyclictest0-21swapper/220:40:222
3096431991411,1cyclictest0-21swapper/220:05:012
3096431991411,1cyclictest0-21swapper/219:15:012
3096431991411,1cyclictest0-21swapper/200:20:362
3096431991411,1cyclictest0-21swapper/200:06:202
3096431991410,2cyclictest0-21swapper/221:12:272
309643099148,2cyclictest1106-21hwrng22:48:421
3096430991411,2cyclictest3524883-21cpuspeed_turbos23:50:241
3096430991411,2cyclictest3395180-21kthreadcore22:35:281
3096430991411,2cyclictest3245763-21cpuspeed_turbos21:10:251
3096430991411,2cyclictest3130478-21irqrtprio19:35:301
3096430991411,2cyclictest3111070-21cut19:20:021
3096430991411,2cyclictest1661-21polkitd21:00:011
3096430991410,3cyclictest3113983-21kthreadcore19:20:291
309643099140,3cyclictest0-21swapper/120:23:591
309642999145,8cyclictest3157431-21tr19:55:280
3096429991411,2cyclictest3274934-21kthreadcore21:25:310
3096429991411,2cyclictest3168655-21kthreadcore20:05:290
3096429991411,2cyclictest3134569-21timerwakeupswit19:35:370
3096429991411,2cyclictest3122580-21unixbench_singl19:25:350
3096429991411,2cyclictest3105426-21cstates19:15:230
3096429991410,3cyclictest3454078-21kworker/u16:2+nfsiod23:20:090
309642999140,9cyclictest3220628-21/usr/sbin/munin20:50:320
309642999140,9cyclictest3160305-21expr20:00:250
309642999140,6cyclictest0-21swapper/019:47:080
309642999140,6cyclictest0-21swapper/019:47:080
302487291144,3phc2sys0-21swapper/300:17:373
302487291140,2phc2sys0-21swapper/322:15:473
302487291140,2phc2sys0-21swapper/322:12:203
302487291140,2phc2sys0-21swapper/321:58:113
302487291140,2phc2sys0-21swapper/321:26:333
302487291140,2phc2sys0-21swapper/300:28:233
309643199139,2cyclictest0-21swapper/220:30:332
3096431991311,1cyclictest0-21swapper/223:10:342
3096431991311,1cyclictest0-21swapper/220:25:292
3096431991311,1cyclictest0-21swapper/219:50:302
3096431991311,1cyclictest0-21swapper/200:30:282
3096431991311,1cyclictest0-21swapper/200:10:282
3096431991310,1cyclictest0-21swapper/222:55:282
3096431991310,1cyclictest0-21swapper/222:15:302
3096431991310,1cyclictest0-21swapper/221:40:302
3096431991310,1cyclictest0-21swapper/221:15:222
3096431991310,1cyclictest0-21swapper/220:35:352
3096431991310,1cyclictest0-21swapper/220:15:242
3096431991310,1cyclictest0-21swapper/219:40:242
3096431991310,1cyclictest0-21swapper/219:35:302
309643099139,3cyclictest3215875-21kthreadcore20:45:291
309643099139,3cyclictest3136785-21kthreadcore19:40:291
309643099139,3cyclictest3119810-21kthreadcore19:25:291
309643099138,2cyclictest3173254-21kthreadcore20:10:281
309643099135,6cyclictest3096481-21grep19:10:011
3096430991311,1cyclictest3235601-21kthreadcore21:00:281
3096430991310,2cyclictest3588674-21kthreadcore00:25:301
3096430991310,2cyclictest3568311-21aten_repower_po00:15:231
3096430991310,2cyclictest3159910-21aten_repower_po20:00:231
3096430991310,2cyclictest3159541-21latency_hist20:00:011
309643099130,1cyclictest0-21swapper/123:07:241
309642999136,2cyclictest3190760-21diskstats20:25:250
309642999135,7cyclictest3199000-21tr20:30:290
3096429991311,1cyclictest3377686-21ssh22:25:280
3096429991310,2cyclictest3336075-21kthreadcore22:00:290
3096429991310,2cyclictest3269735-21kworker/u16:0+nfsiod22:20:120
3096429991310,2cyclictest3227374-21cut20:55:260
3096429991310,2cyclictest3140451-21mailstats19:40:340
3096429991310,2cyclictest1661-21polkitd19:10:010
302487291133,3phc2sys0-21swapper/321:10:253
302487291130,3phc2sys0-21swapper/322:33:123
302487291130,2phc2sys0-21swapper/323:40:053
302487291130,2phc2sys0-21swapper/323:28:553
302487291130,2phc2sys0-21swapper/322:39:383
302487291130,2phc2sys0-21swapper/321:46:563
309643199129,1cyclictest0-21swapper/219:20:232
309643199121,5cyclictest0-21swapper/219:10:012
3096431991210,1cyclictest0-21swapper/222:50:272
3096431991210,1cyclictest0-21swapper/219:30:292
309643099129,2cyclictest3385114-21aten_repower_cu22:30:201
309643099129,2cyclictest3353285-21kthreadcore22:10:291
309643099129,2cyclictest3179168-21irqrtprio20:15:291
309643099128,3cyclictest3225104-21kthreadcore20:50:291
309643099128,1cyclictest170550irq/121-eno100:20:251
309643099127,4cyclictest0-21swapper/119:45:201
309643099127,4cyclictest0-21swapper/119:45:201
302487291124,2phc2sys0-21swapper/323:30:353
302487291123,2phc2sys0-21swapper/320:21:313
302487291122,2phc2sys0-21swapper/322:21:143
302487291121,6phc2sys0-21swapper/319:05:233
302487291121,5phc2sys0-21swapper/322:45:223
302487291121,2phc2sys0-21swapper/321:54:013
302487291120,3phc2sys0-21swapper/319:45:213
302487291120,3phc2sys0-21swapper/319:45:213
302487291120,2phc2sys0-21swapper/323:19:133
302487291120,2phc2sys0-21swapper/321:32:243
302487291120,2phc2sys0-21swapper/321:10:023
302487291120,2phc2sys0-21swapper/320:47:363
302487291120,2phc2sys0-21swapper/300:10:323
309643199119,1cyclictest0-21swapper/221:00:212
302487291113,2phc2sys0-21swapper/321:15:303
302487291111,3phc2sys0-21swapper/322:55:333
302487291111,3phc2sys0-21swapper/322:02:153
302487291110,3phc2sys0-21swapper/320:35:213
302487291110,3phc2sys0-21swapper/319:40:283
302487291110,3phc2sys0-21swapper/319:10:223
302487291110,2phc2sys0-21swapper/323:14:563
302487291110,2phc2sys0-21swapper/322:43:103
302487291110,2phc2sys0-21swapper/322:27:033
302487291110,2phc2sys0-21swapper/320:55:013
302487291110,2phc2sys0-21swapper/320:00:553
302487291110,2phc2sys0-21swapper/319:25:253
302487291101,2phc2sys0-21swapper/323:55:253
302487291101,2phc2sys0-21swapper/323:20:293
302487291101,2phc2sys0-21swapper/320:25:283
302487291101,2phc2sys0-21swapper/319:15:233
302487291101,2phc2sys0-21swapper/300:39:093
302487291100,3phc2sys0-21swapper/321:35:293
302487291100,3phc2sys0-21swapper/319:30:263
302487291100,2phc2sys0-21swapper/321:21:273
302487291100,2phc2sys0-21swapper/320:30:333
302487291100,2phc2sys0-21swapper/320:10:253
30248729191,2phc2sys0-21swapper/321:00:263
30248729191,1phc2sys0-21swapper/320:55:133
30248729190,2phc2sys0-21swapper/320:15:263
30248729190,2phc2sys0-21swapper/319:55:223
30248729180,2phc2sys0-21swapper/320:40:223
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional