You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 02:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Wed May 06, 2026 00:43:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2855898995750,4cyclictest2960444-21sh22:35:480
2855900995547,3cyclictest0-21swapper/221:20:012
2855899995544,7cyclictest420-21avahi-daemon22:20:021
2855899995544,7cyclictest420-21avahi-daemon22:20:021
2855898995538,7cyclictest3027766-21cups-browsed00:05:520
2855898995437,14cyclictest420-21avahi-daemon22:40:580
2855900995144,4cyclictest2884448-21kworker/u8:6-xprtiod22:06:032
2855899995140,7cyclictest2979400-21systemd-run23:00:021
2855899995140,7cyclictest0-21swapper/121:20:521
2855899995134,12cyclictest2916763-21unixbench_multi21:41:011
2855900995035,12cyclictest2947111-21munin-run22:20:012
2855900995035,12cyclictest2947111-21munin-run22:20:012
2855899995040,4cyclictest0-21swapper/123:10:511
2855899994941,5cyclictest2895721-21sh21:15:001
2855899994935,10cyclictest3029353-21mailstats00:00:571
2855899994920,18cyclictest421-21dbus-daemon23:20:521
2855900994840,5cyclictest2884457-21systemd-run20:45:012
2855898994840,4cyclictest0-21swapper/021:45:010
2855898994838,6cyclictest2943793-21aten_r2power_vo22:15:390
2855898994838,6cyclictest2943793-21aten_r2power_vo22:15:390
2855898994738,4cyclictest0-21swapper/022:25:010
2855898994738,4cyclictest0-21swapper/022:25:010
2855898994729,15cyclictest2952473-21ssh22:25:500
2855899994636,7cyclictest659-21snmpd23:09:201
2855898994638,5cyclictest2882962-21systemd-run20:40:010
2855898994618,22cyclictest2968685-21ssh22:45:530
2855900994537,5cyclictest1-21systemd21:50:012
2855900994537,5cyclictest1-21systemd21:50:012
2855900994537,4cyclictest0-21swapper/222:40:532
2855899994536,5cyclictest1051-21mta-sts-daemon00:35:501
2855899994536,5cyclictest0-21swapper/100:15:491
2855900994433,7cyclictest3040761-21tr00:15:422
285590099442,6cyclictest2891294-21ntpq21:05:482
285590099442,6cyclictest2891294-21ntpq21:05:482
285590099441,31cyclictest3049157-21ssh00:25:492
285590099441,11cyclictest2888327-21ntpq20:55:492
2855900994336,4cyclictest3027752-21modprobe00:00:002
2855900994333,4cyclictest0-21swapper/222:30:482
2855900994332,8cyclictest3007551-21systemd-run23:35:012
2855900994322,15cyclictest0-21swapper/223:25:552
285590099431,4cyclictest3033140-21ntpq00:05:502
2855899994334,6cyclictest421-21dbus-daemon19:40:011
2855899994334,5cyclictest3044494-21aten_r2power_cu00:20:401
2855899994333,6cyclictest2967322-21systemd-run22:45:011
2855898994333,7cyclictest2910858-21munin-run21:35:010
2855898994319,18cyclictest421-21dbus-daemon20:50:520
285590099428,4cyclictest2978570-21ssh22:58:302
2855900994234,4cyclictest0-21swapper/200:35:472
2855900994233,4cyclictest0-21swapper/222:20:492
2855900994233,4cyclictest0-21swapper/222:20:492
2855900994232,6cyclictest421-21dbus-daemon21:25:012
285590099422,8cyclictest2984665-21ntpq23:05:522
285590099421,10cyclictest3054800-21ssh00:32:482
285590099421,10cyclictest3054800-21ssh00:32:482
2855899994235,3cyclictest0-21swapper/100:30:011
2855899994234,5cyclictest1066724-21cups-browsed23:40:571
2855899994231,7cyclictest421-21dbus-daemon23:19:521
2855899994230,9cyclictest3000035-21/usr/sbin/munin23:26:061
2855898994237,2cyclictest0-21swapper/022:05:480
285590099417,3cyclictest2959632-21ssh22:35:252
285590099413,6cyclictest3029084-21ntpq00:00:492
2855900994133,5cyclictest421-21dbus-daemon22:05:012
2855900994130,7cyclictest2997381-21unixbench_singl23:20:592
285590099412,6cyclictest2889775-21ntpq21:00:452
285590099412,17cyclictest2893341-21ssh21:10:542
285590099411,9cyclictest3039269-21ssh00:13:512
285590099411,7cyclictest2905198-21sh21:26:172
285590099411,12cyclictest2879419-21ntpq20:25:522
285590099411,11cyclictest2951664-21ssh22:25:352
285590099411,10cyclictest2987773-21ssh23:10:172
285590099411,10cyclictest2916971-21ssh21:41:152
285590099411,10cyclictest2882267-21ntpq20:35:472
285590099411,10cyclictest2862834-21ntpq19:30:492
2855899994134,4cyclictest0-21swapper/120:15:021
2855899994132,6cyclictest1066724-21cups-browsed22:30:431
2855899994131,7cyclictest420-21avahi-daemon22:20:541
2855899994131,7cyclictest420-21avahi-daemon22:20:541
285589899414,28cyclictest2900679-21ssh21:20:480
2855898994133,5cyclictest3000221-21aten_r2power_vo23:25:400
2855898994133,4cyclictest0-21swapper/021:39:000
2855898994122,5cyclictest2995458-21munin-run23:20:010
285590099409,29cyclictest2911153-21ssh21:35:112
285590099408,3cyclictest3012038-21ssh23:40:262
285590099403,6cyclictest2885359-21ntpq20:45:502
285590099403,6cyclictest2858261-21ntpq19:15:482
2855900994030,6cyclictest2923867-21if_wlan021:50:432
285590099402,5cyclictest2876311-21ntpq20:15:462
285590099402,5cyclictest2864301-21ntpq19:35:472
285590099401,9cyclictest2979716-21ssh23:00:152
285590099401,9cyclictest2979716-21ssh23:00:152
285590099401,9cyclictest2969526-21ssh22:46:332
285590099401,9cyclictest2886823-21ntpq20:50:482
285590099401,8cyclictest3022924-21ssh23:53:312
285590099401,8cyclictest3022924-21ssh23:53:312
285590099401,8cyclictest2994906-21ssh23:18:562
285590099401,8cyclictest2971847-21ssh22:50:372
285590099401,5cyclictest2868871-21ntpq19:50:522
285590099401,5cyclictest2867355-21ntpq19:45:502
285590099401,10cyclictest2942407-21ssh22:13:442
285590099401,10cyclictest2861326-21ntpq19:25:472
2855899994033,4cyclictest0-21swapper/121:45:531
2855899994033,4cyclictest0-21swapper/121:45:531
2855899994031,6cyclictest2865468-21fschecks_time19:40:421
2855899994029,7cyclictest420-21avahi-daemon23:56:141
285589999401,31cyclictest3008815-21ssh23:35:481
2855898994032,5cyclictest3023733-21ssh23:55:020
2855898994032,5cyclictest3023733-21ssh23:55:020
285590099395,6cyclictest1051-21mta-sts-daemon23:47:292
2855900993931,5cyclictest3008393-21ssh23:35:412
2855900993929,7cyclictest1066724-21cups-browsed20:10:412
2855900993929,6cyclictest420-21avahi-daemon21:30:532
285590099391,9cyclictest3044377-21ssh00:20:282
285590099391,9cyclictest2930661-21ssh21:59:252
2855900993913,22cyclictest2878436-21latency_hist20:25:022
285590099391,11cyclictest2856801-21ntpq19:10:502
285590099391,10cyclictest2873289-21ntpq20:05:472
285590099391,10cyclictest2865896-21ntpq19:40:522
2855899993928,7cyclictest261-21systemd-journal23:34:061
2855899993927,8cyclictest420-21avahi-daemon22:52:141
2855899993927,8cyclictest1066724-21cups-browsed23:50:561
2855899993927,8cyclictest1066724-21cups-browsed23:50:561
2855898993933,3cyclictest0-21swapper/000:16:000
2855898993912,19cyclictest2932288-21ssh22:00:490
285589899390,35cyclictest2956444-21ssh22:30:480
285590099383,9cyclictest2880819-21ntpq20:30:522
2855900993821,14cyclictest2870800-21tail19:55:582
2855899993828,7cyclictest420-21avahi-daemon21:36:111
2855899993827,8cyclictest2928639-21timerandwakeup21:56:001
2855899993827,7cyclictest3027766-21cups-browsed00:34:301
2855899993827,7cyclictest3027766-21cups-browsed00:34:301
2855899993827,7cyclictest2959742-21/usr/sbin/munin22:35:491
285589899383,28cyclictest3016979-21ssh23:45:520
2855899993731,2cyclictest0-21swapper/121:30:471
2855899993728,6cyclictest1066724-21cups-browsed22:07:161
2855899993725,9cyclictest421-21dbus-daemon23:50:011
2855899993724,9cyclictest2952195-21latency22:25:441
2855898993729,5cyclictest421-21dbus-daemon19:40:590
2855898993728,6cyclictest1-21systemd19:15:010
2855898993725,8cyclictest3004089-21aten_r2power_en23:30:370
2855898993724,9cyclictest3057722-21timerwakeupswit00:35:590
2855898993722,3cyclictest0-21swapper/023:45:010
2855898993720,4cyclictest0-21swapper/021:30:020
285589899371,29cyclictest3045342-21sh00:21:010
285590099361,4cyclictest2859868-21ntpq19:20:492
285590099361,10cyclictest2871862-21ntpq20:00:492
285589999363,27cyclictest3033090-21ssh00:05:481
285589999363,24cyclictest2904522-21ssh21:25:551
2855899993628,4cyclictest0-21swapper/121:19:121
2855899993627,5cyclictest2981295-21grep23:01:021
2855899993627,5cyclictest2981295-21grep23:01:021
2855898993630,4cyclictest2860469-21systemd-run19:25:020
2855898993628,5cyclictest2981316-21unixbench_singl23:01:020
2855898993628,5cyclictest2981316-21unixbench_singl23:01:020
2855898993627,6cyclictest439-21systemd-logind19:20:010
2855898993627,6cyclictest0-21swapper/022:00:010
2855898993620,13cyclictest0-21swapper/000:00:450
2855899993528,4cyclictest0-21swapper/100:10:451
2855899993527,5cyclictest2940904-21unixbench_multi22:11:011
2855898993528,4cyclictest3051946-21ssh00:30:020
2855898993525,3cyclictest0-21swapper/021:46:040
2855898993525,3cyclictest0-21swapper/021:46:040
2855898993524,5cyclictest2989296-21unixbench_multi23:11:010
2855898993524,4cyclictest2971924-21sh22:50:380
2855899993426,4cyclictest0-21swapper/122:45:561
2855899993424,7cyclictest1055-21mta-sts-daemon22:00:451
2855899993423,8cyclictest2888316-21ntp_kernel_pll_20:55:481
2855898993427,4cyclictest3024560-21fschecks_time23:55:400
2855898993427,4cyclictest0-21swapper/022:11:000
2855898993424,7cyclictest2977210-21unixbench_singl22:56:000
2855898993424,7cyclictest2884424-21cron20:45:000
2855899993326,3cyclictest0-21swapper/119:20:021
2855898993326,4cyclictest2885947-21systemd-run20:50:010
2855898993325,5cyclictest2896190-21/usr/sbin/munin21:15:420
2855898993324,4cyclictest0-21swapper/020:10:540
285589899331,27cyclictest2983965-21/usr/sbin/munin23:05:410
2855899993223,5cyclictest420-21avahi-daemon19:46:191
2855899993220,9cyclictest1066724-21cups-browsed21:50:531
2855898993224,6cyclictest1066717-21cupsd19:50:460
2855898993224,4cyclictest2864873-21unixbench_singl19:35:590
2855898993223,5cyclictest151ktimers/020:20:490
285589899322,26cyclictest3037142-21ssh00:10:490
2855898993217,10cyclictest12350irq/32-eth021:05:500
2855898993217,10cyclictest12350irq/32-eth021:05:500
285589999314,17cyclictest1051-21mta-sts-daemon19:20:471
2855899993123,5cyclictest421-21dbus-daemon21:10:011
2855899993123,5cyclictest421-21dbus-daemon21:10:011
2855899993123,5cyclictest2862581-21kernelversion19:30:431
2855899993123,5cyclictest2857402-21systemctl19:15:021
2855899993117,7cyclictest0-21swapper/119:55:481
2855898993122,6cyclictest0-21swapper/023:35:060
2855899993020,6cyclictest1-21systemd21:05:011
285589999295,19cyclictest1066717-21cupsd20:30:521
2855899992920,6cyclictest2877278-21aten_r2power_fr20:20:381
2855898992922,4cyclictest0-21swapper/021:00:010
2855898992921,5cyclictest1066717-21cupsd23:20:150
2855898992921,4cyclictest0-21swapper/021:52:380
2855898992917,10cyclictest2863307-21unixbench_multi19:30:590
285590099281,5cyclictest428-21mta-sts-daemon19:10:012
2855899992820,5cyclictest427-21polkitd20:19:551
2855899992820,5cyclictest1066724-21cups-browsed20:29:421
2855899992819,6cyclictest1066724-21cups-browsed20:38:451
285589899288,13cyclictest3053168-21ssh00:30:470
285589899288,13cyclictest3053168-21ssh00:30:470
2855898992818,7cyclictest12350irq/32-eth020:00:480
2855898992816,10cyclictest421-21dbus-daemon19:30:010
2855899992720,4cyclictest2861817-21unixbench_multi19:25:581
2855899992719,5cyclictest1066724-21cups-browsed20:00:141
2855899992718,6cyclictest420-21avahi-daemon20:40:421
2855899992718,6cyclictest2886455-21fschecks_time20:50:411
2855898992721,3cyclictest0-21swapper/020:20:010
2855898992718,5cyclictest2891946-21kworker/u8:8-events_unbound21:10:370
2855899992617,6cyclictest261-21systemd-journal20:10:011
2855899992617,5cyclictest2885947-21systemd-run20:50:011
2855898992520,3cyclictest1051-21mta-sts-daemon20:28:130
2855898992514,8cyclictest0-21swapper/019:55:580
2855899992416,5cyclictest2869414-21cron19:55:011
285589899242,17cyclictest1066724-21cups-browsed20:05:490
2855898992420,2cyclictest0-21swapper/020:30:430
2855898992417,4cyclictest1051-21mta-sts-daemon21:03:400
2855898992416,5cyclictest548-21gdbus19:45:550
285590199173,7cyclictest0-21swapper/322:00:563
2855901991711,4cyclictest0-21swapper/322:56:373
2855899991712,2cyclictest0-21swapper/119:10:031
285589899173,8cyclictest2855858-21munin-run19:10:010
285590199161,6cyclictest0-21swapper/323:45:493
285590199161,6cyclictest0-21swapper/319:15:493
285590199158,4cyclictest0-21swapper/321:40:473
285590199152,8cyclictest0-21swapper/323:50:463
285590199152,8cyclictest0-21swapper/323:50:463
285590199152,7cyclictest0-21swapper/320:40:543
285590199151,7cyclictest0-21swapper/321:55:503
285590199148,4cyclictest0-21swapper/321:28:083
285590199146,5cyclictest0-21swapper/321:06:013
285590199146,5cyclictest0-21swapper/321:06:013
285590199146,5cyclictest0-21swapper/300:00:473
285590199146,4cyclictest0-21swapper/300:30:463
285590199146,4cyclictest0-21swapper/300:30:463
285590199142,8cyclictest0-21swapper/323:20:513
285590199141,7cyclictest0-21swapper/323:40:473
285590199141,7cyclictest0-21swapper/321:50:553
285590199141,6cyclictest0-21swapper/322:10:493
285590199141,6cyclictest0-21swapper/320:15:483
285590199141,6cyclictest0-21swapper/320:10:463
285590199141,6cyclictest0-21swapper/319:30:473
285590199141,5cyclictest0-21swapper/319:25:503
285590199136,4cyclictest0-21swapper/323:55:513
285590199136,4cyclictest0-21swapper/323:25:483
285590199136,4cyclictest0-21swapper/323:05:523
285590199136,4cyclictest0-21swapper/323:00:523
285590199136,4cyclictest0-21swapper/323:00:523
285590199136,4cyclictest0-21swapper/322:50:493
285590199136,4cyclictest0-21swapper/322:25:473
285590199136,4cyclictest0-21swapper/321:46:023
285590199136,4cyclictest0-21swapper/321:46:023
285590199136,4cyclictest0-21swapper/321:35:433
285590199136,4cyclictest0-21swapper/300:10:313
285590199136,4cyclictest0-21swapper/300:05:473
285590199132,7cyclictest0-21swapper/323:15:473
285590199132,7cyclictest0-21swapper/321:20:473
285590199132,6cyclictest0-21swapper/321:10:373
285590199131,7cyclictest0-21swapper/323:30:493
285590199131,7cyclictest0-21swapper/319:55:523
285590199131,6cyclictest0-21swapper/323:35:443
285590199131,6cyclictest0-21swapper/322:35:433
285590199131,6cyclictest0-21swapper/321:15:463
285590199131,6cyclictest0-21swapper/320:50:533
285590199131,5cyclictest0-21swapper/321:00:503
285590199131,5cyclictest0-21swapper/319:10:483
285590199127,3cyclictest0-21swapper/322:05:543
285590199127,3cyclictest0-21swapper/320:35:423
285590199126,4cyclictest0-21swapper/322:50:023
285590199126,4cyclictest0-21swapper/322:15:413
285590199126,4cyclictest0-21swapper/322:15:413
285590199126,4cyclictest0-21swapper/321:30:383
285590199126,4cyclictest0-21swapper/300:35:593
285590199126,4cyclictest0-21swapper/300:25:423
285590199126,4cyclictest0-21swapper/300:15:243
285590199125,4cyclictest0-21swapper/323:10:443
285590199125,4cyclictest0-21swapper/322:22:053
285590199125,4cyclictest0-21swapper/322:22:053
285590199122,6cyclictest0-21swapper/320:10:013
285590199122,5cyclictest0-21swapper/320:55:403
285590199121,7cyclictest0-21swapper/322:40:453
285590199116,3cyclictest0-21swapper/322:30:393
285590199116,3cyclictest0-21swapper/320:45:463
285590199116,3cyclictest0-21swapper/320:20:483
285590199116,3cyclictest0-21swapper/319:50:463
285590199116,3cyclictest0-21swapper/319:35:503
285590199114,4cyclictest0-21swapper/300:20:313
285590199111,6cyclictest0-21swapper/320:00:513
285590199106,3cyclictest0-21swapper/320:25:363
285590199105,3cyclictest0-21swapper/320:30:393
285590199105,3cyclictest0-21swapper/319:20:393
285590199102,4cyclictest0-21swapper/319:10:033
285590199101,5cyclictest0-21swapper/319:45:493
28559019995,3cyclictest0-21swapper/319:40:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional