You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-04 - 04:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Mon May 04, 2026 00:43:11)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3130329997663,9cyclictest0-21swapper/000:20:380
3130329997663,9cyclictest0-21swapper/000:20:380
3130331997163,5cyclictest3239471-21grep22:40:012
3130331996355,5cyclictest3243543-21cut22:45:012
3130330995143,5cyclictest516-21in:imuxsock21:30:011
3130329994924,19cyclictest12350irq/32-eth022:10:460
313033099482,34cyclictest3228552-21ssh22:25:461
3130331994643,2cyclictest0-21swapper/223:00:492
3130331994643,2cyclictest0-21swapper/223:00:492
3130329994636,6cyclictest3261215-21ntpq23:05:520
3130331994536,6cyclictest3301062-21aten_r2power_po23:55:382
3130329994534,8cyclictest0-21swapper/021:20:510
3130331994433,7cyclictest3276069-21munin-run23:25:012
3130330994436,5cyclictest3304421-21systemd23:59:591
3130330994436,5cyclictest3281982-21tail23:30:581
3130330994436,5cyclictest3276071-21cut23:25:011
3130331994335,5cyclictest3176356-21tail21:20:582
313033199433,33cyclictest3224425-21ssh22:20:442
313033099435,31cyclictest3232563-21ssh22:30:461
3130330994335,5cyclictest3219744-21aten_r2power_cu22:15:351
3130330994335,5cyclictest3219744-21aten_r2power_cu22:15:351
313032999433,9cyclictest171rcu_preempt23:10:500
3130329994336,4cyclictest3130340-21systemd-run19:10:020
3130331994233,6cyclictest3294039-21timerandwakeup23:45:582
3130330994234,5cyclictest3174470-21idleruntime-cro21:20:011
3130331994136,2cyclictest0-21swapper/220:20:002
3130331994133,5cyclictest3286102-21unixbench_singl23:36:002
3130331994133,5cyclictest3247630-21ssh22:50:012
3130331994132,6cyclictest3304446-21cups-browsed00:10:482
313032999412,33cyclictest3313939-21sh00:10:510
3130331994031,6cyclictest3195611-21aten_r2power_vo21:45:372
3130331994031,5cyclictest420-21avahi-daemon00:29:452
3130330994032,5cyclictest421-21dbus-daemon00:20:021
3130330994032,5cyclictest0-21swapper/121:00:011
3130331993931,5cyclictest3203019-21cron21:55:002
3130331993930,4cyclictest0-21swapper/222:30:482
3130331993929,6cyclictest3333492-21aten_r2power_cu00:35:372
3130330993933,3cyclictest0-21swapper/122:45:011
3130329993932,4cyclictest3257695-21unixbench_singl23:00:590
3130329993932,4cyclictest3257695-21unixbench_singl23:00:590
313033199383,25cyclictest3192111-21ssh21:40:472
313033199383,25cyclictest3192111-21ssh21:40:472
3130331993831,4cyclictest3268052-21latency_hist23:15:022
3130331993831,3cyclictest3222497-21kworker/u8:13-xprtiod22:20:002
3130331993831,3cyclictest3222497-21kworker/u8:13-xprtiod22:20:002
3130331993830,5cyclictest3269756-21sh23:15:592
313033099385,26cyclictest3321377-21aten_r2power_po00:20:371
313033099385,26cyclictest3321377-21aten_r2power_po00:20:371
3130330993830,5cyclictest3151343-21systemd-run20:20:011
3130330993830,5cyclictest0-21swapper/100:40:011
3130330993829,6cyclictest3143815-21systemd-run19:55:011
3130330993828,7cyclictest3304446-21cups-browsed00:00:551
3130330993827,8cyclictest3165687-21ntp_kernel_pll_21:05:491
3130330993827,8cyclictest0-21swapper/123:45:461
3130330993817,8cyclictest3288253-21awk23:40:011
3130329993831,4cyclictest3243532-21cron22:45:010
3130329993827,8cyclictest3305480-21kernelversion00:00:420
3130331993731,3cyclictest0-21swapper/223:00:012
3130331993730,4cyclictest3174465-21munin-run21:20:012
313033199372,24cyclictest3330168-21ssh00:30:482
3130330993730,4cyclictest0-21swapper/121:10:461
3130329993730,5cyclictest695-21cron21:10:010
3130329993728,6cyclictest3196811-21head21:45:590
3130329993719,12cyclictest12350irq/32-eth023:50:560
3130329993719,12cyclictest12350irq/32-eth023:50:560
313033199363,5cyclictest171rcu_preempt20:30:482
3130331993625,8cyclictest3183237-21aten_r2power_fr21:30:372
3130330993628,5cyclictest3227292-21systemd-run22:25:011
3130330993627,6cyclictest428-21mta-sts-daemon21:55:001
3130330993627,6cyclictest421-21dbus-daemon23:09:321
3130330993626,6cyclictest0-21swapper/121:05:011
3130329993628,3cyclictest0-21swapper/022:15:450
3130329993628,3cyclictest0-21swapper/022:15:450
3130329993627,6cyclictest3288245-21sh23:40:010
3130329993612,5cyclictest171rcu_preempt23:40:520
313033199356,24cyclictest3305746-21ssh00:00:472
313033199354,23cyclictest3261267-21ssh23:05:532
3130331993524,7cyclictest3208444-21ssh22:00:552
3130331993523,9cyclictest3277832-21timerwakeupswit23:25:572
3130331993523,9cyclictest3143147-21ntp_kernel_err19:50:442
313033199352,26cyclictest3179926-21ssh21:25:512
3130330993527,5cyclictest3325674-21sh00:25:391
3130330993527,5cyclictest1339207-21cups-browsed23:54:411
3130330993527,5cyclictest1339207-21cups-browsed23:54:411
3130330993526,6cyclictest3153341-21fschecks_time20:25:391
3130330993525,7cyclictest3330050-21needreboot00:30:451
3130330993524,8cyclictest3184335-21timerandwakeup21:30:591
3130330993518,3cyclictest171rcu_preempt21:45:531
3130329993527,5cyclictest3302014-21switchtime23:55:580
3130329993527,5cyclictest3281879-21timerwakeupswit23:30:570
3130329993526,6cyclictest420-21avahi-daemon23:25:410
3130329993525,7cyclictest3188029-21ntp_kernel_pll_21:35:510
3130329993520,6cyclictest171rcu_preempt19:15:510
3130331993428,3cyclictest0-21swapper/223:30:452
3130331993428,3cyclictest0-21swapper/200:20:012
3130331993426,5cyclictest3190821-21cron21:40:012
3130331993425,4cyclictest0-21swapper/221:10:362
3130331993424,6cyclictest3134709-21tail19:20:562
3130331993423,7cyclictest1339207-21cups-browsed22:06:442
313033099343,24cyclictest3277408-21ssh23:25:491
3130330993428,3cyclictest0-21swapper/123:16:421
3130330993426,4cyclictest0-21swapper/100:10:521
3130330993423,8cyclictest3292320-21/usr/sbin/munin23:45:021
3130329993427,4cyclictest3228821-21systemctl22:25:540
3130329993427,4cyclictest3161793-21cron20:55:010
3130329993427,4cyclictest1054-21mta-sts-daemon22:25:010
3130329993426,6cyclictest3272038-21sh23:20:010
3130329993426,5cyclictest1-21systemd21:45:020
3130329993426,5cyclictest1-21systemd21:45:020
3130329993425,6cyclictest3304446-21cups-browsed00:28:280
3130329993425,6cyclictest1339207-21cups-browsed21:17:560
3130329993423,7cyclictest3204906-21tail21:55:590
3130329993420,11cyclictest3320707-21awk00:20:010
3130329993419,11cyclictest151ktimers/019:45:450
313033199334,23cyclictest3289555-21ssh23:40:492
3130331993326,4cyclictest3321310-21cut00:20:362
3130331993326,4cyclictest3321310-21cut00:20:362
3130331993321,10cyclictest1339207-21cups-browsed22:10:592
3130330993326,4cyclictest3141271-21cpuspeed19:45:371
3130330993326,4cyclictest0-21swapper/119:20:011
3130330993324,6cyclictest3155173-21ntpq20:30:461
3130330993323,8cyclictest3310227-21sh00:05:581
3130330993323,8cyclictest3144499-21latency19:55:451
313033099331,23cyclictest3208380-21rm22:00:521
313032999333,23cyclictest1339207-21cups-browsed20:30:460
3130329993326,5cyclictest421-21dbus-daemon21:00:410
3130329993326,5cyclictest3331272-21sh00:31:510
3130329993325,5cyclictest1-21systemd22:35:010
3130329993322,8cyclictest3273159-21missed_timers23:20:430
313032999332,26cyclictest3236710-21ssh22:35:500
3130329993312,16cyclictest12350irq/32-eth023:45:500
3130331993225,5cyclictest3152381-21sendmail_mailqu20:20:532
3130331993223,6cyclictest0-21swapper/221:55:362
313033099323,21cyclictest3248907-21ntpq22:50:481
3130330993226,3cyclictest0-21swapper/123:10:431
3130330993225,4cyclictest3192772-21unixbench_singl21:41:001
3130330993225,4cyclictest3192772-21unixbench_singl21:41:001
3130330993225,4cyclictest0-21swapper/121:20:561
3130330993224,5cyclictest3247769-21latency_hist22:50:021
3130330993220,3cyclictest3238892-21ssh22:38:571
3130330993210,16cyclictest421-21dbus-daemon19:30:481
3130329993224,6cyclictest3211167-21latency_hist22:05:020
3130329993224,5cyclictest1339203-21cupsd22:53:550
3130329993222,4cyclictest3137804-21cron19:35:010
3130331993123,5cyclictest3251711-21ssh22:55:022
3130331993122,6cyclictest261-21systemd-journal21:05:012
3130331993120,7cyclictest3157304-21munin-run20:40:012
3130330993125,3cyclictest0-21swapper/122:56:411
3130330993124,4cyclictest1055-21mta-sts-daemon20:00:491
3130330993120,7cyclictest0-21swapper/121:35:531
3130330993114,3cyclictest171rcu_preempt20:35:491
313032999313,22cyclictest3179831-21ssh21:25:470
3130329993127,2cyclictest0-21swapper/000:40:010
3130329993125,4cyclictest1051-21mta-sts-daemon20:10:580
3130329993121,7cyclictest0-21swapper/023:00:010
313033199304,17cyclictest441-21gpm20:50:472
3130331993024,3cyclictest3128970-21kworker/u8:26-xprtiod19:40:012
3130331993024,3cyclictest0-21swapper/219:15:012
3130330993022,5cyclictest3203791-21rm21:55:381
3130330993022,5cyclictest1339207-21cups-browsed19:40:421
3130329993024,3cyclictest0-21swapper/019:30:010
3130329993022,6cyclictest0-21swapper/021:10:360
3130329993022,5cyclictest3309211-21aten_r2power_po00:05:370
3130329993013,12cyclictest151ktimers/022:05:500
3130331992922,3cyclictest0-21swapper/220:05:012
3130331992919,3cyclictest3231362-21ssh22:30:012
3130330992923,3cyclictest427-21polkitd22:05:551
3130330992922,4cyclictest3139186-21unixbench_multi19:35:581
3130330992921,5cyclictest518-21rs:main1
3130330992921,5cyclictest3159837-21proc_pri20:45:541
3130330992920,7cyclictest3256274-21/usr/sbin/munin23:00:401
3130330992920,7cyclictest3256274-21/usr/sbin/munin23:00:401
3130330992920,6cyclictest1339207-21cups-browsed22:14:061
3130330992916,3cyclictest171rcu_preempt20:50:461
3130329992922,5cyclictest0-21swapper/019:55:010
313032999292,21cyclictest3244876-21ssh22:45:500
3130329992920,6cyclictest0-21swapper/021:30:460
3130329992914,10cyclictest12350irq/32-eth021:50:500
3130331992821,4cyclictest3132107-21aten_r2power_en19:15:362
3130331992821,3cyclictest0-21swapper/200:05:422
3130330992817,8cyclictest3136317-21munin-run19:30:011
3130329992821,4cyclictest0-21swapper/020:40:010
3130331992721,3cyclictest0-21swapper/220:45:012
3130331992720,4cyclictest3154062-21timerandwakeup20:25:562
3130331992720,4cyclictest3141331-21fschecks_count19:45:392
313033199271,8cyclictest3134883-21kworker/2:2+events_freezable19:25:502
3130331992718,6cyclictest420-21avahi-daemon20:10:552
3130330992719,5cyclictest3131808-21sh19:15:011
3130330992715,3cyclictest3148858-21basename20:10:411
3130329992721,3cyclictest0-21swapper/020:15:390
3130329992710,12cyclictest151ktimers/020:20:510
3130331992620,3cyclictest0-21swapper/223:50:402
3130331992620,3cyclictest0-21swapper/223:50:402
3130331992614,3cyclictest1339207-21cups-browsed20:56:062
313033099264,3cyclictest171rcu_preempt20:40:481
3130330992620,3cyclictest0-21swapper/120:05:441
3130330992620,3cyclictest0-21swapper/120:05:441
3130329992619,4cyclictest3146732-21sed20:01:060
3130329992613,9cyclictest3145339-21systemd20:00:010
3130329992613,11cyclictest420-21avahi-daemon20:05:490
3130329992613,11cyclictest420-21avahi-daemon20:05:490
313033299251,5cyclictest0-21swapper/300:05:453
3130331992517,5cyclictest3137740-21head19:30:582
313033099256,3cyclictest171rcu_preempt20:20:501
3130329992518,4cyclictest3140694-21unixbench_multi19:40:580
313033299241,7cyclictest0-21swapper/320:10:473
313033299241,5cyclictest0-21swapper/300:20:373
313033299241,5cyclictest0-21swapper/300:20:373
313033299241,4cyclictest0-21swapper/322:30:493
313033299241,4cyclictest0-21swapper/320:30:453
313033299241,3cyclictest0-21swapper/300:00:493
313033199245,13cyclictest428-21mta-sts-daemon19:40:462
3130331992419,3cyclictest0-21swapper/220:00:002
3130331992416,5cyclictest3166314-21cron21:10:012
3130331992416,5cyclictest1339207-21cups-browsed20:08:122
3130331992416,5cyclictest1339207-21cups-browsed20:08:122
313032999249,5cyclictest171rcu_preempt19:20:470
313032999241,19cyclictest3157929-21modprobe20:40:400
313033299232,16cyclictest0-21swapper/322:35:483
313033299231,5cyclictest0-21swapper/323:45:463
313033299231,5cyclictest0-21swapper/322:55:483
313033299231,4cyclictest0-21swapper/323:40:503
313033299231,4cyclictest0-21swapper/320:55:463
313033299231,4cyclictest0-21swapper/319:15:493
313033299231,3cyclictest0-21swapper/323:30:473
313033299231,3cyclictest0-21swapper/322:10:513
313033299231,3cyclictest0-21swapper/320:40:453
313033299230,5cyclictest0-21swapper/319:50:453
3130331992317,3cyclictest0-21swapper/219:10:012
3130331992316,4cyclictest3160329-21kworker/u8:1-xprtiod20:50:022
313032999232,16cyclictest3131285-21ntp_states19:10:500
3130329992318,2cyclictest0-21swapper/021:00:010
3130329992316,5cyclictest261-21systemd-journal20:26:400
313033299223,13cyclictest0-21swapper/321:10:473
313033299222,4cyclictest0-21swapper/322:45:473
313033299221,7cyclictest0-21swapper/320:50:473
313033299221,5cyclictest0-21swapper/322:40:473
313033299221,5cyclictest0-21swapper/321:35:423
313033299221,5cyclictest0-21swapper/320:15:463
313033299221,5cyclictest0-21swapper/320:00:493
313033299221,5cyclictest0-21swapper/319:55:513
313033299221,5cyclictest0-21swapper/300:25:453
313033299221,4cyclictest0-21swapper/323:55:493
313033299221,4cyclictest0-21swapper/323:50:533
313033299221,4cyclictest0-21swapper/323:50:533
313033299221,4cyclictest0-21swapper/323:25:483
313033299221,4cyclictest0-21swapper/323:20:453
313033299221,4cyclictest0-21swapper/323:15:493
313033299221,4cyclictest0-21swapper/323:05:523
313033299221,4cyclictest0-21swapper/322:55:023
313033299221,4cyclictest0-21swapper/322:20:493
313033299221,4cyclictest0-21swapper/321:45:513
313033299221,4cyclictest0-21swapper/320:25:483
313033299221,4cyclictest0-21swapper/320:05:423
313033299221,4cyclictest0-21swapper/320:05:423
313033299221,4cyclictest0-21swapper/319:45:453
313033299221,4cyclictest0-21swapper/319:30:463
313033299221,4cyclictest0-21swapper/319:25:443
313033299221,4cyclictest0-21swapper/300:35:513
313033299221,3cyclictest0-21swapper/321:55:483
313033299221,3cyclictest0-21swapper/300:15:493
313033299220,5cyclictest0-21swapper/300:30:513
3130329992216,4cyclictest0-21swapper/019:40:010
313033299212,6cyclictest0-21swapper/321:25:353
313033299212,15cyclictest0-21swapper/322:00:513
313033299211,5cyclictest0-21swapper/323:10:453
313033299211,5cyclictest0-21swapper/322:15:383
313033299211,5cyclictest0-21swapper/322:15:383
313033299211,5cyclictest0-21swapper/319:40:523
313033299211,4cyclictest0-21swapper/323:35:513
313033299211,4cyclictest0-21swapper/323:00:443
313033299211,4cyclictest0-21swapper/323:00:443
313033299211,4cyclictest0-21swapper/322:25:433
313033299211,4cyclictest0-21swapper/322:05:483
313033299211,4cyclictest0-21swapper/321:40:473
313033299211,4cyclictest0-21swapper/321:40:473
313033299211,4cyclictest0-21swapper/321:30:523
313033299211,4cyclictest0-21swapper/321:15:443
313033299211,4cyclictest0-21swapper/321:05:493
313033299211,4cyclictest0-21swapper/321:00:483
313033299211,4cyclictest0-21swapper/320:50:013
313033299211,4cyclictest0-21swapper/319:35:533
313033299211,4cyclictest0-21swapper/319:10:483
313033299211,3cyclictest0-21swapper/321:50:483
313033299211,3cyclictest0-21swapper/321:20:453
313033299211,3cyclictest0-21swapper/320:35:453
313033299211,3cyclictest0-21swapper/320:20:493
313033299211,3cyclictest0-21swapper/300:10:553
3130330992113,4cyclictest271ktimers/119:10:011
313033299201,4cyclictest0-21swapper/319:20:483
3130329992010,7cyclictest3159389-21/usr/sbin/munin20:45:410
31303329991,5cyclictest0-21swapper/319:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional