You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-02 - 15:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack2slot7s.osadl.org (updated Sat May 02, 2026 12:43:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
190096996048,8cyclictest265122-21sed10:00:481
190096996048,8cyclictest265122-21sed10:00:481
190097994740,4cyclictest263879-21systemctl10:00:012
190097994535,6cyclictest3572428-21cups-browsed12:05:462
190097994535,6cyclictest3572428-21cups-browsed12:05:462
190097994436,5cyclictest311364-21munin-run11:00:012
190097994436,5cyclictest275747-21systemd-run10:15:012
190095994438,4cyclictest516-21in:imuxsock09:25:010
190095994434,7cyclictest3572428-21cups-browsed09:31:560
190095994431,4cyclictest367890-21fschecks_time12:10:390
190095994336,4cyclictest287663-21latency_hist10:30:020
190095994233,6cyclictest3572428-21cups-browsed11:57:410
190097994132,5cyclictest383137-21latency_hist12:30:022
190096994133,5cyclictest328118-21df11:20:371
190096994132,6cyclictest421-21dbus-daemon11:35:401
190096994132,6cyclictest421-21dbus-daemon11:35:401
190097994032,5cyclictest325234-21unixbench_singl11:15:582
190097994032,5cyclictest252476-21sh09:45:012
190097993931,5cyclictest203589-21systemd-run07:55:012
190097993930,6cyclictest420-21avahi-daemon12:01:222
190097993930,6cyclictest246645-21missed_timers09:35:432
190096993931,5cyclictest242024-21latency_hist09:30:021
190096993931,5cyclictest194584-21cron07:25:001
190096993931,5cyclictest194584-21cron07:25:001
190096993930,6cyclictest439-21systemd-logind11:45:011
190096993929,7cyclictest1051-21mta-sts-daemon12:30:441
190095993934,3cyclictest292387-21grep10:35:400
190095993932,5cyclictest230080-21sh09:15:010
190095993932,4cyclictest347164-21ssh11:45:010
190097993831,4cyclictest299509-21ssh10:45:012
190097993831,4cyclictest299509-21ssh10:45:012
190097993830,5cyclictest303443-21cron10:50:002
190097993830,5cyclictest231637-21mailstats09:15:572
190097993830,5cyclictest1-21systemd11:55:012
190097993827,8cyclictest343177-21grep11:40:012
190097993827,8cyclictest343177-21grep11:40:012
190096993829,5cyclictest368291-21ntp_kernel_pll_12:10:461
190096993827,7cyclictest220094-21true08:50:011
190097993729,5cyclictest1-21systemd09:05:022
190097993729,4cyclictest0-21swapper/211:00:482
190097993728,5cyclictest420-21avahi-daemon10:34:342
190097993728,5cyclictest336957-21timerwakeupswit11:30:592
190097993728,5cyclictest193083-21sendmail07:20:002
190097993629,4cyclictest223065-21munin-run09:00:012
190097993628,5cyclictest3572428-21cups-browsed10:36:462
190097993627,6cyclictest420-21avahi-daemon09:10:012
190097993627,6cyclictest351147-21systemd-run11:50:012
190096993628,5cyclictest287601-21ssh10:30:011
190096993628,5cyclictest1-21systemd11:00:021
190096993627,6cyclictest312315-21if_wlan011:00:401
190096993625,8cyclictest1-21systemd08:55:381
190095993629,4cyclictest256971-21grep09:50:380
190095993628,6cyclictest275745-21sh10:15:010
190097993527,5cyclictest316893-21mailstats11:05:542
190097993527,5cyclictest242531-21aten_r2power_vo09:30:382
190096993529,3cyclictest0-21swapper/112:10:011
190096993529,3cyclictest0-21swapper/112:10:011
190096993526,6cyclictest420-21avahi-daemon09:20:001
190096993526,6cyclictest288740-21needreboot10:30:441
190095993529,4cyclictest375010-21sendmail12:20:010
190095993528,5cyclictest1-21systemd12:25:020
190095993528,4cyclictest3572428-21cups-browsed11:10:530
190095993527,5cyclictest421-21dbus-daemon09:40:240
190095993526,7cyclictest3572428-21cups-browsed10:09:260
190095993526,7cyclictest3572428-21cups-browsed10:09:260
190095993521,11cyclictest214077-21cron08:30:000
190095993521,11cyclictest214077-21cron08:30:000
190097993428,3cyclictest0-21swapper/209:30:012
190097993427,4cyclictest226982-21fschecks_count09:10:442
190097993427,4cyclictest0-21swapper/212:20:002
190097993423,8cyclictest265655-21timerwakeupswit10:01:002
190097993423,8cyclictest265655-21timerwakeupswit10:01:002
190096993425,6cyclictest297198-21timerandwakeup10:40:551
190096993425,6cyclictest297198-21timerandwakeup10:40:551
190096993425,6cyclictest277619-21unixbench_singl10:16:001
190096993421,10cyclictest320431-21missed_timers11:10:411
190095993428,4cyclictest348862-21ssh11:45:580
190095993428,3cyclictest0-21swapper/008:30:460
190095993428,3cyclictest0-21swapper/008:30:460
190095993427,4cyclictest239214-21ntp_kernel_pll_09:25:460
190095993426,5cyclictest3572428-21cups-browsed11:34:450
190095993426,5cyclictest196102-21kworker/u8:607:30:010
190095993424,7cyclictest384868-21head12:30:590
190095993423,9cyclictest222100-21grep08:55:390
190095993423,8cyclictest0-21swapper/009:20:000
190095993422,9cyclictest0-21swapper/012:25:380
190097993327,4cyclictest190094-21cyclictest11:55:482
190097993327,3cyclictest0-21swapper/209:55:002
190097993324,6cyclictest420-21avahi-daemon08:25:542
190097993324,6cyclictest420-21avahi-daemon08:25:542
190096993325,5cyclictest372857-21unixbench_multi12:15:581
190096993325,5cyclictest1-21systemd10:00:011
190096993322,8cyclictest388427-21processes12:35:541
190096993322,8cyclictest234586-21aten_r2power_cu09:20:361
19009699331,24cyclictest246905-21ssh09:35:511
190095993328,2cyclictest0-21swapper/011:40:010
190095993328,2cyclictest0-21swapper/011:40:010
190095993326,4cyclictest263917-21systemd-run10:00:010
190095993326,4cyclictest209183-21systemctl08:10:540
190095993325,5cyclictest3572428-21cups-browsed09:46:280
190095993325,5cyclictest3572428-21cups-browsed09:46:280
190095993322,8cyclictest319339-21latency_hist11:10:020
190097993227,2cyclictest0-21swapper/208:40:002
190097993225,4cyclictest347127-21cron11:45:002
190097993223,6cyclictest3572428-21cups-browsed12:20:402
190097993223,6cyclictest235667-21switchtime09:20:582
190096993226,3cyclictest0-21swapper/107:35:011
190096993224,5cyclictest325167-21unixbench_multi11:15:581
19009699322,22cyclictest352476-21ssh11:50:511
190096993220,9cyclictest269433-21switchtime10:05:581
190096993220,9cyclictest269433-21switchtime10:05:581
19009699321,24cyclictest316702-21ssh11:05:501
190095993226,4cyclictest301427-21/usr/sbin/munin10:46:000
190095993225,4cyclictest190101-21kworker/u8:2+xprtiod07:10:010
190095993224,6cyclictest1056-21mta-sts-daemon10:22:520
190095993224,5cyclictest327833-21/usr/sbin/munin11:21:030
190095993220,10cyclictest248983-21ssh09:40:010
190095993219,10cyclictest516-21in:imuxsock08:20:000
190097993126,2cyclictest0-21swapper/211:20:482
190097993124,3cyclictest0-21swapper/207:25:502
190097993123,6cyclictest226132-21diskmemload11:10:382
190097993121,8cyclictest287312-21sh10:29:302
190097993121,7cyclictest269371-21mailstats10:05:562
190097993121,7cyclictest269371-21mailstats10:05:562
190097993121,7cyclictest1056-21mta-sts-daemon07:10:522
190096993126,3cyclictest0-21swapper/107:20:001
190096993125,3cyclictest0-21swapper/112:25:011
190096993125,3cyclictest0-21swapper/110:35:581
190096993125,3cyclictest0-21swapper/107:40:011
190096993124,5cyclictest0-21swapper/108:00:011
190096993123,6cyclictest420-21avahi-daemon09:47:231
190096993123,6cyclictest420-21avahi-daemon09:47:231
190096993123,5cyclictest227193-21latency09:10:471
190096993123,5cyclictest200482-21unixbench_multi07:40:571
190096993122,6cyclictest211020-21unixbench_singl08:15:571
190096993122,4cyclictest0-21swapper/112:26:011
19009699310,27cyclictest257370-21ssh09:50:441
190095993125,3cyclictest0-21swapper/010:30:370
190095993122,6cyclictest359725-21aten_r2power_fr12:00:380
190097993024,3cyclictest0-21swapper/208:00:012
190097993024,3cyclictest0-21swapper/207:25:012
190097993024,3cyclictest0-21swapper/207:25:012
190097993021,7cyclictest219487-21ntp_kernel_pll_08:45:462
190097993021,5cyclictest0-21swapper/207:40:502
190097993020,7cyclictest277651-21uptime10:16:012
190096993024,3cyclictest0-21swapper/110:55:011
190096993024,3cyclictest0-21swapper/110:45:371
190096993024,3cyclictest0-21swapper/108:40:001
190096993023,5cyclictest0-21swapper/108:05:021
190096993023,4cyclictest208013-21unixbench_singl08:06:001
190096993022,5cyclictest3572428-21cups-browsed08:50:271
190096993022,5cyclictest226012-21tail09:05:581
190095993025,3cyclictest218589-21grep08:45:010
190095993025,3cyclictest212664-21latency_hist08:25:020
190095993024,2cyclictest0-21swapper/012:35:510
190095993018,9cyclictest0-21swapper/011:00:010
190095993017,9cyclictest0-21swapper/011:50:490
190097992923,3cyclictest1056-21mta-sts-daemon11:27:472
190097992923,3cyclictest0-21swapper/210:50:432
190097992923,3cyclictest0-21swapper/210:25:022
190097992920,7cyclictest221379-21timerwakeupswit08:50:562
190097992920,6cyclictest538-21wpa_supplicant08:30:552
190097992920,6cyclictest538-21wpa_supplicant08:30:552
190096992922,4cyclictest360921-21unixbench-2d12:01:041
190096992919,7cyclictest331902-21aten_r2power_fr11:25:361
190096992918,8cyclictest252493-21ssh09:45:021
190096992917,5cyclictest1054-21mta-sts-daemon10:12:591
190095992925,2cyclictest0-21swapper/010:45:000
190095992925,2cyclictest0-21swapper/010:45:000
190095992924,3cyclictest224288-21switchtime09:00:560
190095992923,3cyclictest0-21swapper/011:25:560
190095992921,5cyclictest3572428-21cups-browsed11:01:430
190097992823,2cyclictest0-21swapper/208:20:012
190097992821,4cyclictest386953-21munin-plugin-st12:35:012
190097992820,5cyclictest1-21systemd08:10:022
190097992818,7cyclictest368138-21missed_timers12:10:422
190096992822,3cyclictest0-21swapper/111:55:511
190096992822,3cyclictest0-21swapper/108:45:021
190096992820,5cyclictest3572428-21cups-browsed10:21:111
190096992819,6cyclictest548-21gdbus07:12:381
190096992818,8cyclictest244897-21sh09:33:301
190096992818,8cyclictest202753-21latency07:50:421
190096992818,3cyclictest226132-21diskmemload11:30:461
190095992822,3cyclictest0-21swapper/011:15:390
190095992820,6cyclictest265423-21mailstats10:00:570
190095992820,6cyclictest265423-21mailstats10:00:570
190095992820,5cyclictest0-21swapper/008:40:000
190097992720,4cyclictest1054-21mta-sts-daemon12:38:152
190096992719,5cyclictest209575-21munin-run08:15:011
190096992719,4cyclictest0-21swapper/111:45:511
190095992721,4cyclictest0-21swapper/010:50:530
190095992721,3cyclictest206736-21latency_hist08:05:020
190095992720,5cyclictest421-21dbus-daemon07:55:020
190095992718,7cyclictest194000-21ntp_kernel_pll_07:20:470
190095992718,7cyclictest194000-21ntp_kernel_pll_07:20:470
190095992716,8cyclictest0-21swapper/010:20:000
190097992621,2cyclictest0-21swapper/209:45:472
190097992621,2cyclictest0-21swapper/209:45:472
190097992620,3cyclictest0-21swapper/208:40:402
190097992619,4cyclictest199167-21latency_hist07:40:022
190097992619,4cyclictest1051-21mta-sts-daemon08:00:452
190097992617,6cyclictest211425-21aten_r2power_fr08:20:362
190096992619,4cyclictest215583-21munin-plugin-st08:35:001
190096992619,4cyclictest215583-21munin-plugin-st08:35:001
19009599263,18cyclictest364386-21ntpq12:05:500
19009599263,18cyclictest364386-21ntpq12:05:500
190095992620,3cyclictest196352-21aten_r2power_cu07:30:360
190095992618,6cyclictest204247-21latency07:55:410
190095992617,7cyclictest202083-21idleruntime-cro07:50:010
190095992617,6cyclictest226128-21latency_hist09:10:030
190095992616,8cyclictest221695-21latency_hist08:55:020
190097992518,4cyclictest196788-21latency07:30:422
190095992519,4cyclictest421-21dbus-daemon07:15:010
190095992518,4cyclictest206865-21kworker/u8:2+xprtiod08:05:380
190097992416,5cyclictest201124-21fschecks_time07:45:412
19009699247,10cyclictest214032-21head08:25:581
19009699247,10cyclictest214032-21head08:25:581
190096992418,3cyclictest0-21swapper/107:30:001
190096992417,5cyclictest224631-21latency_hist09:05:021
19009599242,16cyclictest218808-21/usr/sbin/munin08:45:580
190095992418,3cyclictest0-21swapper/007:35:450
190095992414,7cyclictest12350irq/32-eth007:15:450
190097992317,3cyclictest0-21swapper/208:10:512
190097992315,5cyclictest190100-21systemd-run07:10:012
190096992317,3cyclictest0-21swapper/107:45:491
19009699231,16cyclictest211320-21/usr/sbin/munin08:20:591
190095992313,7cyclictest200594-21cut07:45:020
19009899203,11cyclictest0-21swapper/309:30:503
19009899201,12cyclictest0-21swapper/309:50:473
19009899201,10cyclictest0-21swapper/312:05:473
19009899201,10cyclictest0-21swapper/312:05:473
19009899194,8cyclictest0-21swapper/310:20:013
19009899194,10cyclictest0-21swapper/311:45:513
19009899192,9cyclictest0-21swapper/310:05:463
19009899192,9cyclictest0-21swapper/310:05:463
19009899192,8cyclictest0-21swapper/312:15:463
190096991912,4cyclictest0-21swapper/107:10:011
19009899182,9cyclictest0-21swapper/310:30:483
19009899182,9cyclictest0-21swapper/310:10:473
19009899182,10cyclictest0-21swapper/312:20:463
19009899182,10cyclictest0-21swapper/310:01:013
19009899182,10cyclictest0-21swapper/310:01:013
19009899174,7cyclictest0-21swapper/310:25:483
19009899174,6cyclictest0-21swapper/309:45:503
19009899174,6cyclictest0-21swapper/309:45:503
19009899174,10cyclictest0-21swapper/312:30:473
19009899173,8cyclictest0-21swapper/311:25:513
19009899172,9cyclictest0-21swapper/311:50:463
19009899172,9cyclictest0-21swapper/311:35:463
19009899172,9cyclictest0-21swapper/311:35:463
19009899172,9cyclictest0-21swapper/310:55:463
19009899172,9cyclictest0-21swapper/309:15:543
19009899172,10cyclictest0-21swapper/312:10:493
19009899172,10cyclictest0-21swapper/311:20:473
19009899172,10cyclictest0-21swapper/311:10:513
19009899171,9cyclictest0-21swapper/312:35:413
19009899171,9cyclictest0-21swapper/311:30:453
19009899171,9cyclictest0-21swapper/310:40:503
19009899171,9cyclictest0-21swapper/310:40:503
19009899171,7cyclictest0-21swapper/308:00:443
19009899171,7cyclictest0-21swapper/307:25:483
19009899164,4cyclictest0-21swapper/309:05:523
19009899163,6cyclictest0-21swapper/308:55:473
19009899162,9cyclictest0-21swapper/309:35:413
19009899162,8cyclictest0-21swapper/311:55:473
19009899162,8cyclictest0-21swapper/310:45:463
19009899162,8cyclictest0-21swapper/309:20:453
19009899162,7cyclictest0-21swapper/307:40:453
19009899162,6cyclictest0-21swapper/308:15:413
19009899161,9cyclictest0-21swapper/311:15:473
19009899161,8cyclictest0-21swapper/309:40:453
19009899161,10cyclictest0-21swapper/312:25:513
19009899153,7cyclictest0-21swapper/310:50:443
19009899153,7cyclictest0-21swapper/307:40:013
19009899152,8cyclictest0-21swapper/309:25:453
19009899152,8cyclictest0-21swapper/309:10:593
19009899152,7cyclictest0-21swapper/308:40:443
19009899152,7cyclictest0-21swapper/307:10:483
19009899152,6cyclictest0-21swapper/307:15:453
19009899151,9cyclictest0-21swapper/310:35:393
19009899151,8cyclictest0-21swapper/311:40:373
19009899151,7cyclictest0-21swapper/308:25:513
19009899151,7cyclictest0-21swapper/308:25:513
19009899151,6cyclictest0-21swapper/307:50:473
19009899143,8cyclictest0-21swapper/309:55:363
19009899143,7cyclictest0-21swapper/311:05:383
19009899142,8cyclictest0-21swapper/310:20:383
19009899142,7cyclictest0-21swapper/312:00:393
19009899142,7cyclictest0-21swapper/308:45:563
19009899142,6cyclictest0-21swapper/308:10:533
19009899142,6cyclictest0-21swapper/307:55:473
19009899142,5cyclictest0-21swapper/308:20:453
19009899133,5cyclictest0-21swapper/311:00:363
19009899132,7cyclictest0-21swapper/309:00:453
19009899132,7cyclictest0-21swapper/308:50:383
19009899131,7cyclictest0-21swapper/308:30:453
19009899131,7cyclictest0-21swapper/308:30:453
19009899122,6cyclictest0-21swapper/307:35:013
19009899121,6cyclictest0-21swapper/307:45:493
19009899112,6cyclictest0-21swapper/308:40:003
19009899111,6cyclictest0-21swapper/307:20:433
19009899111,6cyclictest0-21swapper/307:20:433
19009899101,6cyclictest0-21swapper/308:05:373
1900989982,5cyclictest0-21swapper/307:10:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional