You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-09-17 - 14:07
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rackeslot2.osadl.org (updated Wed Sep 17, 2025 00:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
31151022370,2sleep30-21swapper/320:49:303
32991512330,1sleep10-21swapper/122:43:101
2996342992522,2cyclictest3420207-21kworker/u16:0-ext4-rsv-conversion00:00:000
34757532230,1sleep13475755-21rm00:23:451
2996342992312,6cyclictest0-21swapper/022:50:020
299634299222,12cyclictest0-21swapper/021:10:010
2996342992212,5cyclictest0-21swapper/023:00:010
299634399212,12cyclictest1633-21dbus-daemon23:50:021
2996342992115,4cyclictest1706-21rs:main0
2996343992017,2cyclictest3197007-21/usr/sbin/munin21:40:011
2996343992017,2cyclictest3083207-21latency_hist20:20:001
2996342992012,4cyclictest3375318-21mailstats23:24:380
2996342992011,8cyclictest3363170-21kthreadcore23:19:330
2996342992010,5cyclictest0-21swapper/022:40:010
2555591200,2phc2sys0-21swapper/300:06:343
2996344991916,1cyclictest0-21swapper/223:55:002
2996344991916,1cyclictest0-21swapper/220:45:012
2996343991917,1cyclictest3010698-21perf19:20:001
2996343991916,2cyclictest3314731-21grep22:50:021
2996343991912,3cyclictest3427722-21kthreadcore23:54:331
2996343991911,4cyclictest3259725-21kthreadcore22:19:331
2996342991916,2cyclictest1633-21dbus-daemon22:55:010
2996342991913,5cyclictest3485192-21aten2.4-expect00:29:320
2996342991911,7cyclictest0-21swapper/022:05:020
2555591190,2phc2sys0-21swapper/322:26:503
2555591190,2phc2sys0-21swapper/322:26:503
2996344991815,1cyclictest0-21swapper/223:45:012
2996344991815,1cyclictest0-21swapper/223:35:012
2996344991815,1cyclictest0-21swapper/222:00:002
2996343991815,2cyclictest3498163-21kthreadcore00:34:361
2996343991815,2cyclictest3349853-21grep23:10:011
2996343991815,2cyclictest1-21systemd19:15:011
2996343991815,2cyclictest1-21systemd19:15:011
2996343991814,3cyclictest3114650-21tr20:49:281
2996343991811,3cyclictest3383275-21kthreadcore23:29:361
299634299184,3cyclictest3353783-21ps23:14:300
299634299184,3cyclictest3353783-21ps23:14:300
2996342991815,2cyclictest3232244-21systemd-run22:00:020
2996342991810,4cyclictest3346765-21kthreadcore23:09:370
299634299180,2cyclictest3095392-21munin-run20:30:010
2555591181,2phc2sys0-21swapper/322:38:483
2555591180,6phc2sys0-21swapper/322:43:103
2555591180,2phc2sys0-21swapper/323:56:363
2555591180,1phc2sys0-21swapper/322:11:553
2996344991714,1cyclictest0-21swapper/222:15:012
2996344991714,1cyclictest0-21swapper/222:09:222
2996344991714,1cyclictest0-21swapper/221:20:002
2996344991714,1cyclictest0-21swapper/221:10:002
2996344991714,1cyclictest0-21swapper/219:30:002
2996344991714,1cyclictest0-21swapper/200:35:442
299634399179,3cyclictest3508329-21latency_hist00:40:001
2996343991714,2cyclictest3179037-21apt-key21:30:011
2996343991714,2cyclictest3012272-21ps19:24:291
2996343991714,2cyclictest1646-1atopacctd19:55:021
2996343991713,1cyclictest191rcu_preempt21:17:501
2996343991710,3cyclictest3411378-21latency_hist23:45:021
2996342991714,2cyclictest3429216-21apt-config23:55:000
2996342991714,2cyclictest3214470-21ls21:50:000
2996342991714,2cyclictest1646-1atopacctd21:37:580
2996342991714,2cyclictest0-21swapper/020:40:010
299634299171,2cyclictest3010882-21latency_hist19:20:010
299634299171,1cyclictest0-21swapper/022:31:380
2996342991710,6cyclictest3186012-21kthreadcore21:34:340
2555591170,2phc2sys0-21swapper/322:48:263
2555591170,2phc2sys0-21swapper/300:27:413
797898160,2rtkit-daemon0-21swapper/119:45:501
299634499162,7cyclictest0-21swapper/222:30:012
299634499162,7cyclictest0-21swapper/222:30:012
2996344991614,1cyclictest0-21swapper/222:55:012
2996344991613,1cyclictest0-21swapper/223:39:412
2996344991613,1cyclictest0-21swapper/223:15:012
2996344991613,1cyclictest0-21swapper/223:15:012
2996344991613,1cyclictest0-21swapper/222:56:572
2996344991613,1cyclictest0-21swapper/221:34:272
2996344991613,1cyclictest0-21swapper/219:55:012
2996344991613,1cyclictest0-21swapper/200:14:342
299634399166,4cyclictest1646-1atopacctd22:14:391
299634399163,3cyclictest501rcuop/221:09:261
299634399161,9cyclictest3464388-21rm00:15:001
2996343991613,2cyclictest3358376-21cron23:15:001
2996343991613,2cyclictest3358376-21cron23:15:001
2996343991613,2cyclictest3244188-21latency_hist22:10:011
2996343991613,2cyclictest3131821-21latency_hist21:00:021
2996343991613,2cyclictest2996340-21cyclictest22:29:371
2996343991613,2cyclictest2996340-21cyclictest22:29:371
2996343991613,2cyclictest1-21systemd00:20:011
2996343991613,2cyclictest0-21swapper/120:40:001
2996343991612,3cyclictest1703-21in:imuxsock00:10:011
2996343991611,4cyclictest3327022-21fschecks_time22:59:291
299634299169,6cyclictest3262207-21kworker/u16:2+xprtiod00:20:020
299634299169,6cyclictest0-21swapper/022:30:000
299634299169,6cyclictest0-21swapper/022:30:000
299634299167,5cyclictest0-21swapper/000:24:310
299634299164,7cyclictest0-21swapper/021:29:270
2996342991613,2cyclictest3402340-21unixbench_multi23:39:430
2996342991613,2cyclictest3002427-21latency_hist19:15:010
2996342991613,2cyclictest3002427-21latency_hist19:15:010
2996342991613,2cyclictest1666-21polkitd21:25:010
2996342991611,4cyclictest2996340-21cyclictest23:29:380
2996342991610,5cyclictest3266222-21kthreadcore22:24:350
2555591163,2phc2sys0-21swapper/322:06:383
2555591160,3phc2sys0-21swapper/323:46:303
797898150,2rtkit-daemon0-21swapper/121:00:221
31378532150,2sleep20-21swapper/221:05:002
299634499153,8cyclictest0-21swapper/222:20:012
299634499151,4cyclictest0-21swapper/222:50:012
2996344991513,1cyclictest0-21swapper/223:01:392
2996344991513,1cyclictest0-21swapper/219:40:022
2996344991512,1cyclictest0-21swapper/223:20:152
2996344991512,1cyclictest0-21swapper/222:45:002
2996344991512,1cyclictest0-21swapper/222:25:012
2996344991512,1cyclictest0-21swapper/221:25:012
2996344991512,1cyclictest0-21swapper/200:24:272
2996344991512,1cyclictest0-21swapper/200:00:152
2996344991511,2cyclictest0-21swapper/223:17:212
299634399159,2cyclictest501rcuop/223:38:591
299634399159,2cyclictest3232248-21kworker/u16:1+xprtiod22:22:251
299634399159,2cyclictest176650irq/121-eno123:04:321
299634399157,1cyclictest176650irq/121-eno121:40:171
299634399156,3cyclictest501rcuop/223:56:381
299634399152,5cyclictest491rcuog/223:15:021
2996343991512,2cyclictest3490134-21mailstats00:29:421
2996343991512,2cyclictest3314573-21kworker/u16:3-rpciod22:54:271
2996343991512,2cyclictest3148780-21kthreadcore21:14:341
2996343991511,3cyclictest3376017-21kworker/u16:1+nfsiod23:32:391
2996343991511,3cyclictest3232248-21kworker/u16:1+nfsiod22:30:291
2996343991511,3cyclictest3232248-21kworker/u16:1+nfsiod22:00:531
2996343991511,3cyclictest3227649-21kthreadcore21:59:341
2996343991511,3cyclictest3169584-21mailstats21:24:411
2996343991511,3cyclictest3075619-21kthreadcore20:14:361
2996343991511,3cyclictest3062145-21kthreadcore20:04:361
299634299157,5cyclictest0-21swapper/019:50:020
299634299157,2cyclictest0-21swapper/023:49:310
299634299156,4cyclictest0-21swapper/022:45:010
299634299153,7cyclictest3029500-21aten_repower_en19:39:260
299634299153,6cyclictest1633-21dbus-daemon22:15:010
299634299153,2cyclictest191rcu_preempt00:10:020
299634299151,8cyclictest0-21swapper/021:42:240
2996342991512,2cyclictest3494632-21gltestperf00:34:320
2996342991512,2cyclictest3238566-21sh22:09:230
2996342991512,2cyclictest3113955-21munin-plugin-st20:45:020
2996342991512,2cyclictest3065077-21perf20:05:000
2996342991512,2cyclictest0-21swapper/020:25:010
2996342991511,3cyclictest3463320-21latency00:14:360
2996342991511,3cyclictest3148282-21kthreadcore21:14:350
2555591150,3phc2sys0-21swapper/322:24:463
2996344991412,1cyclictest0-21swapper/219:15:032
2996344991412,1cyclictest0-21swapper/219:15:032
2996344991411,1cyclictest0-21swapper/223:29:322
2996344991411,1cyclictest0-21swapper/222:34:342
2996344991411,1cyclictest0-21swapper/221:54:352
2996344991411,1cyclictest0-21swapper/221:46:362
2996344991411,1cyclictest0-21swapper/221:44:312
2996344991411,1cyclictest0-21swapper/221:28:322
2996344991411,1cyclictest0-21swapper/220:40:012
2996344991411,1cyclictest0-21swapper/200:29:032
299634499140,12cyclictest0-21swapper/200:15:532
299634399144,6cyclictest36-21ksoftirqd/119:34:401
2996343991411,2cyclictest3375271-21sendmail_mailqu23:24:371
2996343991411,2cyclictest3214661-21latency_hist21:50:011
2996343991411,2cyclictest3183412-21irqcore21:34:321
2996343991411,2cyclictest3121906-21kthreadcore20:54:331
2996343991411,2cyclictest3109411-21irqrtprio20:44:311
2996343991411,2cyclictest3084975-21tr20:24:331
2996343991411,2cyclictest3038264-21kthreadcore19:44:321
2996343991411,2cyclictest3033549-21kthreadcore19:39:331
2996343991410,3cyclictest3442522-21kthreadcore00:04:351
2996343991410,3cyclictest3288506-21kworker/u16:3+nfsiod22:35:551
299634399140,3cyclictest0-21swapper/120:33:401
299634299148,5cyclictest3124095-21tr20:54:350
299634299147,2cyclictest3503966-21irqstats00:39:380
299634299145,5cyclictest0-21swapper/020:57:050
299634299141,8cyclictest0-21swapper/023:03:100
299634299141,3cyclictest3261861-21munin-run22:20:010
2996342991411,2cyclictest3441137-21aten_repower_fr00:04:280
2996342991411,2cyclictest3393172-21unixbench-2d23:34:390
2996342991411,2cyclictest3160696-21proc_pri21:19:370
2996342991411,2cyclictest3082964-21timerwakeupswit20:19:380
2996342991411,2cyclictest3074165-21kthreadcore20:14:350
2996342991411,2cyclictest3036309-21if_enp1s019:44:300
2996342991411,2cyclictest2996340-21cyclictest20:34:290
2996342991411,2cyclictest1633-21dbus-daemon19:55:020
2996342991411,2cyclictest0-21swapper/023:45:020
299634299140,9cyclictest3014861-21cut19:24:310
299634299140,1cyclictest0-21swapper/021:53:030
2555591140,3phc2sys0-21swapper/323:15:453
2555591140,2phc2sys0-21swapper/323:12:403
2555591140,2phc2sys0-21swapper/323:12:403
2555591140,2phc2sys0-21swapper/321:26:133
2555591140,2phc2sys0-21swapper/321:15:373
2555591140,2phc2sys0-21swapper/300:02:133
2555591140,1phc2sys0-21swapper/320:37:503
299634499139,2cyclictest0-21swapper/220:04:352
299634499131,7cyclictest0-21swapper/219:10:012
2996344991311,1cyclictest0-21swapper/223:49:342
2996344991311,1cyclictest0-21swapper/222:39:342
2996344991311,1cyclictest0-21swapper/220:25:012
2996344991311,1cyclictest0-21swapper/200:05:052
2996344991310,2cyclictest0-21swapper/223:09:352
2996344991310,1cyclictest0-21swapper/221:39:312
2996344991310,1cyclictest0-21swapper/221:14:402
2996344991310,1cyclictest0-21swapper/220:54:342
2996344991310,1cyclictest0-21swapper/220:49:332
2996344991310,1cyclictest0-21swapper/220:14:342
2996344991310,1cyclictest0-21swapper/219:59:312
2996344991310,1cyclictest0-21swapper/219:49:322
2996344991310,1cyclictest0-21swapper/219:33:262
2996344991310,1cyclictest0-21swapper/219:24:362
2996344991310,1cyclictest0-21swapper/200:34:312
299634399139,1cyclictest601rcuop/319:28:081
299634399138,1cyclictest601rcuop/320:29:321
2996343991310,2cyclictest3066044-21cpuspeed_turbos20:09:271
2996343991310,2cyclictest0-21swapper/121:52:111
299634299138,1cyclictest0-21swapper/019:34:290
299634299134,5cyclictest0-21swapper/021:01:280
2996342991310,2cyclictest3065795-21aten_repower_fr20:09:260
2996342991310,2cyclictest3022824-21unin-run19:30:010
2555591130,2phc2sys0-21swapper/322:00:573
2555591130,2phc2sys0-21swapper/321:41:283
2555591130,2phc2sys0-21swapper/321:38:253
31347232120,2sleep30-21swapper/321:04:343
299634499129,2cyclictest0-21swapper/220:29:322
299634499129,1cyclictest0-21swapper/223:56:412
299634499129,1cyclictest0-21swapper/220:57:292
299634499129,1cyclictest0-21swapper/220:31:532
299634499129,1cyclictest0-21swapper/220:19:272
299634499128,2cyclictest0-21swapper/220:09:382
2996344991210,1cyclictest0-21swapper/222:05:012
2996344991210,1cyclictest0-21swapper/219:44:292
2996344991210,1cyclictest0-21swapper/219:19:332
299634399129,2cyclictest3055456-21kthreadcore19:59:321
299634299125,6cyclictest0-21swapper/019:59:270
2555591123,2phc2sys0-21swapper/323:29:353
2555591122,3phc2sys0-21swapper/300:20:003
2555591120,2phc2sys0-21swapper/322:34:273
2555591120,2phc2sys0-21swapper/321:48:593
31425592110,2sleep30-21swapper/321:09:343
299634399118,2cyclictest2996462-21unin-run19:10:021
299634299114,5cyclictest1633-21dbus-daemon19:10:010
2555591112,2phc2sys0-21swapper/323:05:143
2555591111,3phc2sys0-21swapper/321:59:373
2555591111,2phc2sys0-21swapper/323:20:453
2555591110,4phc2sys0-21swapper/319:19:263
2555591110,2phc2sys0-21swapper/323:02:423
2555591110,2phc2sys0-21swapper/322:57:573
2555591110,2phc2sys0-21swapper/321:31:203
2555591110,2phc2sys0-21swapper/320:09:533
2555591110,2phc2sys0-21swapper/319:54:303
2555591110,2phc2sys0-21swapper/319:29:293
2555591110,2phc2sys0-21swapper/300:20:123
2555591110,1phc2sys0-21swapper/320:19:063
2555591110,1phc2sys0-21swapper/319:24:003
2555591110,1phc2sys0-21swapper/319:05:083
29977642100,3sleep30-21swapper/319:14:343
29977642100,3sleep30-21swapper/319:14:343
2555591101,3phc2sys0-21swapper/300:11:143
2555591101,2phc2sys0-21swapper/323:40:533
2555591101,2phc2sys0-21swapper/322:54:283
2555591101,2phc2sys0-21swapper/322:19:333
2555591101,2phc2sys0-21swapper/320:14:423
2555591101,2phc2sys0-21swapper/300:35:473
2555591100,4phc2sys0-21swapper/321:14:273
2555591100,2phc2sys0-21swapper/323:52:433
2555591100,2phc2sys0-21swapper/323:37:123
2555591100,2phc2sys0-21swapper/323:31:353
2555591100,2phc2sys0-21swapper/321:23:143
2555591100,2phc2sys0-21swapper/320:51:393
2555591100,2phc2sys0-21swapper/320:24:273
2555591100,2phc2sys0-21swapper/319:49:253
2555591100,1phc2sys0-21swapper/320:03:403
2555591100,1phc2sys0-21swapper/319:59:073
255559191,3phc2sys0-21swapper/320:45:023
255559190,2phc2sys0-21swapper/321:50:233
255559190,2phc2sys0-21swapper/320:56:263
255559190,2phc2sys0-21swapper/320:29:283
255559190,2phc2sys0-21swapper/319:44:353
255559190,2phc2sys0-21swapper/319:35:023
255559190,2phc2sys0-21swapper/319:34:423
255559190,2phc2sys0-21swapper/300:30:063
255559190,1phc2sys0-21swapper/320:33:573
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional