You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-22 - 20:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #2, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack2slot7s.osadl.org (updated Wed Jul 22, 2026 12:43:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2981555997165,3cyclictest0-21swapper/109:55:471
2981555997165,3cyclictest0-21swapper/109:55:471
2981554996034,4cyclictest3048658-21fschecks_count10:00:380
2981554995934,4cyclictest3047945-21sendmail10:00:010
2981554995934,4cyclictest3047945-21sendmail10:00:010
2981555995748,6cyclictest3137246-21timerandwakeup12:25:551
2981556994937,8cyclictest0-21swapper/210:20:472
2981556994937,8cyclictest0-21swapper/210:20:472
2981556994840,2cyclictest0-21swapper/212:00:402
2981554994830,8cyclictest151ktimers/011:45:470
2981555994739,5cyclictest421-21dbus-daemon09:45:021
298155499475,36cyclictest3064298-21ssh10:25:520
2981554994740,2cyclictest0-21swapper/012:10:020
2981554994636,6cyclictest12650irq/32-eth010:20:470
2981554994636,6cyclictest12650irq/32-eth010:20:470
298155499462,32cyclictest3115637-21ssh11:50:470
298155499461,37cyclictest3109573-21ssh11:40:440
2981556994536,6cyclictest2998073-21systemd-run08:05:022
2981555994337,3cyclictest0-21swapper/110:20:011
2981555994336,4cyclictest1003-21mta-sts-daemon12:30:521
298155499435,29cyclictest3088434-21ssh11:05:460
2981554994333,7cyclictest2170916-21cups-browsed11:13:350
298155499432,35cyclictest3097521-21ssh11:20:460
298155499432,35cyclictest3097521-21ssh11:20:460
2981556994235,4cyclictest3023644-21sendmail09:20:012
2981556994233,6cyclictest0-21swapper/211:45:342
298155599423,34cyclictest3109697-21ssh11:40:501
2981555994232,2cyclictest0-21swapper/110:15:011
2981554994234,5cyclictest151ktimers/007:55:480
2981556994132,5cyclictest0-21swapper/211:00:442
2981556994128,10cyclictest3076197-21needreboot10:45:432
2981556994127,10cyclictest3097986-21timerwakeupswit11:20:592
2981556994127,10cyclictest3097986-21timerwakeupswit11:20:592
2981556994121,11cyclictest351ktimers/210:00:492
2981555994130,7cyclictest420-21avahi-daemon12:18:461
2981555994130,7cyclictest420-21avahi-daemon12:18:461
2981555994034,3cyclictest0-21swapper/110:55:031
2981555994032,5cyclictest3123620-21cron12:05:011
2981555994032,5cyclictest1003-21mta-sts-daemon11:15:461
2981555994032,5cyclictest1003-21mta-sts-daemon11:15:461
298155699394,8cyclictest171rcu_preempt11:30:462
2981556993931,5cyclictest3016067-21systemd-run09:05:022
2981556993930,6cyclictest3032790-21idleruntime-cro09:35:012
2981555993931,5cyclictest3129656-21grep12:15:011
2981555993931,5cyclictest3007058-21systemd-run08:35:011
2981555993931,4cyclictest1001-21mta-sts-daemon11:37:131
2981555993931,4cyclictest0-21swapper/111:10:491
298155599392,28cyclictest3082289-21ssh10:55:451
2981555993830,5cyclictest3051010-21systemd-run10:05:011
2981555993830,5cyclictest2998067-21systemd-run08:05:011
2981555993825,10cyclictest3120461-21sshd11:59:411
2981555993813,19cyclictest265-21systemd-journal10:20:441
2981555993813,19cyclictest265-21systemd-journal10:20:441
2981554993829,4cyclictest0-21swapper/010:40:470
2981556993730,3cyclictest0-21swapper/212:00:012
2981556993729,5cyclictest3081738-21aten_r2power_po10:55:362
2981556993729,5cyclictest3002579-21systemd-run08:20:012
2981556993729,4cyclictest1003-21mta-sts-daemon08:45:462
2981556993726,7cyclictest420-21avahi-daemon09:50:132
298155699371,28cyclictest3033873-21ssh09:35:462
2981555993727,5cyclictest1003-21mta-sts-daemon09:15:211
2981554993724,7cyclictest12650irq/32-eth009:45:460
2981556993627,6cyclictest420-21avahi-daemon09:45:492
2981556993624,9cyclictest665-21snmpd09:20:522
2981556993624,9cyclictest665-21snmpd09:20:522
2981555993630,3cyclictest0-21swapper/110:40:351
2981555993629,5cyclictest2981553-21cyclictest11:45:211
2981555993628,5cyclictest3087278-21cron11:05:011
2981555993628,5cyclictest2992577-21fschecks_time07:45:381
2981555993625,8cyclictest3014525-21munin-run09:00:011
2981554993629,4cyclictest2983032-21sh07:15:000
2981554993628,5cyclictest1-21systemd11:00:020
2981554993625,8cyclictest151ktimers/008:25:490
2981554993624,9cyclictest3072137-21run-parts10:40:010
2981556993528,4cyclictest3132679-21cut12:20:002
2981556993528,4cyclictest3132679-21cut12:20:002
2981556993528,4cyclictest2985083-21fschecks_time07:20:372
2981556993528,4cyclictest2985083-21fschecks_time07:20:372
2981556993525,6cyclictest265-21systemd-journal10:30:012
298155699352,23cyclictest3058133-21ssh10:15:482
2981556993511,8cyclictest3017534-21diskmemload11:40:512
298155599353,24cyclictest3052050-21ssh10:05:471
2981555993529,3cyclictest0-21swapper/111:50:421
2981555993527,5cyclictest421-21dbus-daemon09:55:021
2981555993527,5cyclictest3018254-21gltestperf09:10:361
2981555993526,6cyclictest750-21ntpd08:25:011
2981555993526,5cyclictest3066846-21sh10:30:391
298155599351,26cyclictest3097442-21ssh11:20:421
298155599351,26cyclictest3097442-21ssh11:20:421
2981554993528,4cyclictest3007107-21latency_hist08:35:020
2981554993527,4cyclictest0-21swapper/007:40:080
2981554993526,6cyclictest3137431-21grep12:25:560
2981554993523,9cyclictest0-21swapper/012:30:590
2981554993523,7cyclictest12650irq/32-eth010:10:450
298155499352,27cyclictest3133368-21ssh12:20:370
298155699343,24cyclictest3070237-21ssh10:35:472
2981556993425,6cyclictest1003-21mta-sts-daemon10:43:282
298155699342,25cyclictest3027837-21ssh09:25:492
298155599345,14cyclictest3030919-21ssh09:30:491
2981555993425,6cyclictest3025365-21unixbench_singl09:21:001
2981555993425,6cyclictest3025365-21unixbench_singl09:21:001
298155599342,23cyclictest3040072-21ssh09:45:491
298155499343,27cyclictest3030875-21ssh09:30:470
2981554993426,5cyclictest3038884-21cron09:45:010
2981554993423,8cyclictest3079730-21timerwakeupswit10:50:560
2981554993423,4cyclictest3129645-21cron12:15:010
2981554993420,11cyclictest3102413-21cron11:30:000
2981554993420,11cyclictest3102413-21cron11:30:000
2981556993328,2cyclictest0-21swapper/212:15:022
2981556993325,5cyclictest2987550-21cut07:30:002
2981556993325,4cyclictest0-21swapper/207:10:462
2981556993324,6cyclictest2170916-21cups-browsed10:14:122
2981556993323,6cyclictest1000-21mta-sts-daemon11:25:412
2981556993323,6cyclictest1000-21mta-sts-daemon11:25:412
2981555993326,4cyclictest3142214-21head12:35:351
2981555993325,4cyclictest2984575-21kworker/u8:11+xprtiod07:20:011
2981554993327,4cyclictest3018840-21wc09:10:490
2981554993326,4cyclictest3069121-21systemd-run10:35:010
2981554993326,3cyclictest0-21swapper/008:50:460
2981554993325,5cyclictest3028186-21timerandwakeup09:25:580
2981554993322,8cyclictest3077466-21sshd10:47:460
2981554993317,11cyclictest3042958-21ssh09:50:440
2981556993225,4cyclictest3017539-21munin-run09:10:012
2981556993224,5cyclictest2989555-21fschecks_count07:35:382
2981556993224,4cyclictest3014567-21kworker/u8:8-rpciod11:08:492
2981556993223,6cyclictest3017534-21diskmemload11:10:442
2981556993222,7cyclictest3047982-21sh10:00:022
2981556993222,7cyclictest3047982-21sh10:00:022
298155699322,20cyclictest3139945-21ssh12:30:522
2981555993227,3cyclictest0-21swapper/111:30:511
2981555993224,5cyclictest3125348-21head12:05:581
2981555993224,5cyclictest3008547-21sendmail08:40:011
2981555993223,6cyclictest485-21in:imuxsock07:25:001
2981555993223,6cyclictest485-21in:imuxsock07:25:001
2981554993227,3cyclictest0-21swapper/011:55:480
2981554993226,4cyclictest2989056-21systemd-run07:35:020
2981554993226,4cyclictest0-21swapper/008:45:360
2981554993218,11cyclictest2990401-21unixbench_multi07:35:560
298155499321,21cyclictest265-21systemd-journal07:45:470
2981556993124,4cyclictest0-21swapper/212:08:462
2981556993124,3cyclictest0-21swapper/212:40:012
2981556993124,3cyclictest0-21swapper/210:50:432
2981556993123,5cyclictest2170916-21cups-browsed12:29:572
2981556993121,6cyclictest3115379-21kernelversion11:50:422
2981555993126,2cyclictest0-21swapper/110:50:021
2981555993125,3cyclictest0-21swapper/110:40:011
2981555993124,4cyclictest3034426-21grep09:35:581
2981555993124,4cyclictest1001-21mta-sts-daemon09:28:341
2981555993123,5cyclictest3002410-21unixbench_multi08:15:571
2981555993122,6cyclictest750-21ntpd07:40:031
2981555993122,5cyclictest2981559-21systemd-run07:10:011
2981554993122,5cyclictest151ktimers/012:15:500
2981554993122,5cyclictest151ktimers/012:15:500
2981554993117,9cyclictest12650irq/32-eth009:20:460
2981554993117,9cyclictest12650irq/32-eth009:20:460
298155699302,22cyclictest3094417-21ssh11:15:442
298155699302,22cyclictest3094417-21ssh11:15:442
2981556993021,6cyclictest0-21swapper/210:30:342
2981556993021,5cyclictest3105845-21acpi11:35:322
2981556993019,8cyclictest2999541-21munin-plugin-st08:10:022
2981555993024,3cyclictest0-21swapper/108:10:431
2981555993022,5cyclictest2987125-21systemctl07:25:511
2981555993021,6cyclictest265-21systemd-journal08:05:461
2981554993017,9cyclictest421-21dbus-daemon09:16:500
2981554993017,8cyclictest12650irq/32-eth012:00:470
2981554993017,10cyclictest3094836-21timerandwakeup11:15:560
2981554993017,10cyclictest3094836-21timerandwakeup11:15:560
298155699295,5cyclictest2980212-21kworker/u8:3+xprtiod07:40:052
2981556992921,5cyclictest3008398-21unixbench_multi08:35:562
2981556992919,7cyclictest3009562-21proc_pri08:40:502
2981556992919,7cyclictest3009562-21proc_pri08:40:502
298155599293,15cyclictest428-21mta-sts-daemon09:05:491
2981555992922,4cyclictest3010689-21kernelversion08:45:421
2981555992921,5cyclictest3012904-21unixbench_multi08:50:541
2981555992920,6cyclictest443-21gpm11:25:511
2981555992920,6cyclictest443-21gpm11:25:511
2981555992918,8cyclictest2994403-21ntp_kernel_pll_07:50:451
2981554992923,4cyclictest3144817-21systemd-run12:40:010
2981554992922,3cyclictest0-21swapper/011:34:470
2981556992821,4cyclictest3052462-21ssh10:06:012
2981556992821,4cyclictest3029754-21kworker/u8:9-xprtiod09:40:362
298155699281,22cyclictest3018651-21ssh09:10:442
298155599288,5cyclictest62750lldpd08:43:271
298155599288,5cyclictest62750lldpd08:43:271
2981555992821,4cyclictest0-21swapper/110:25:501
2981555992819,6cyclictest2990578-40mandb07:40:051
2981555992812,11cyclictest421-21dbus-daemon11:07:211
2981554992821,5cyclictest265-21systemd-journal09:05:020
2981554992820,5cyclictest2170916-21cups-browsed08:05:230
2981554992819,6cyclictest3017534-21diskmemload10:15:430
2981554992819,5cyclictest3029754-21kworker/u8:9+xprtiod11:00:400
2981556992721,3cyclictest0-21swapper/209:00:012
2981556992720,4cyclictest3003829-21timerwakeupswit08:20:562
2981556992719,5cyclictest2988936-21unixbench_multi07:30:542
2981555992719,5cyclictest1001-21mta-sts-daemon08:25:501
2981554992721,4cyclictest2984540-21munin-run07:20:010
2981554992721,3cyclictest0-21swapper/011:40:010
2981554992718,4cyclictest0-21swapper/008:40:460
2981554992718,4cyclictest0-21swapper/008:40:460
2981556992620,3cyclictest0-21swapper/208:30:022
2981556992620,3cyclictest0-21swapper/208:10:562
2981556992619,3cyclictest0-21swapper/212:20:442
2981556992618,5cyclictest439-21systemd-logind07:55:022
2981556992618,5cyclictest2996534-21idleruntime-cro08:00:012
2981555992620,3cyclictest0-21swapper/108:00:011
2981555992618,5cyclictest3134033-21mailstats12:20:521
2981555992617,6cyclictest420-21avahi-daemon07:33:471
298155499268,15cyclictest694-21cron07:30:000
298155499262,19cyclictest665-21snmpd07:50:470
2981554992620,4cyclictest3052648-21unixbench_multi10:06:020
2981554992617,6cyclictest2170916-21cups-browsed07:23:530
2981554992617,6cyclictest2170916-21cups-browsed07:23:530
298155499261,5cyclictest171rcu_preempt08:00:490
298155499261,20cyclictest3033604-21/usr/sbin/munin09:35:410
298155699254,16cyclictest2993070-21ps07:45:512
2981554992517,6cyclictest3002328-21timerwakeupswit08:15:570
2981554992516,6cyclictest2170916-21cups-browsed08:11:370
2981556992419,2cyclictest0-21swapper/207:15:472
2981554992417,4cyclictest3016852-21needreboot09:05:430
2981554992417,4cyclictest3004199-21latency_hist08:25:020
2981554992413,8cyclictest0-21swapper/008:55:570
2981556992317,3cyclictest1000-21mta-sts-daemon08:30:392
2981554992312,8cyclictest191rcuc/008:35:490
298155699222,15cyclictest3012494-21ntpq08:50:472
298155599223,15cyclictest265-21systemd-journal07:10:461
298155799213,8cyclictest0-21swapper/307:35:473
298155799212,12cyclictest0-21swapper/310:05:463
298155799211,11cyclictest0-21swapper/311:00:463
2981556992115,3cyclictest0-21swapper/207:10:012
298155599211,14cyclictest265-21systemd-journal09:03:471
298155799203,9cyclictest0-21swapper/312:15:463
298155799203,9cyclictest0-21swapper/312:15:463
298155799203,11cyclictest0-21swapper/310:40:473
298155799203,10cyclictest0-21swapper/309:15:513
298155799202,11cyclictest0-21swapper/312:30:483
298155799202,11cyclictest0-21swapper/312:10:593
298155799202,11cyclictest0-21swapper/310:20:513
298155799202,11cyclictest0-21swapper/310:20:513
298155799202,10cyclictest0-21swapper/311:30:463
298155799202,10cyclictest0-21swapper/309:40:443
298155799193,9cyclictest0-21swapper/312:00:463
298155799193,8cyclictest0-21swapper/309:50:473
298155799192,9cyclictest0-21swapper/310:50:393
298155799192,11cyclictest0-21swapper/311:15:473
298155799192,11cyclictest0-21swapper/311:15:473
298155799192,10cyclictest0-21swapper/310:35:433
298155799192,10cyclictest0-21swapper/309:35:483
298155799191,11cyclictest0-21swapper/311:20:433
298155799191,11cyclictest0-21swapper/311:20:433
298155499191,7cyclictest2981692-21latency_hist07:10:020
298155799184,6cyclictest0-21swapper/307:20:013
298155799183,9cyclictest0-21swapper/309:55:413
298155799183,9cyclictest0-21swapper/309:55:413
298155799182,9cyclictest0-21swapper/311:05:453
298155799182,9cyclictest0-21swapper/310:15:393
298155799182,9cyclictest0-21swapper/309:30:473
298155799182,8cyclictest0-21swapper/307:10:453
298155799182,7cyclictest0-21swapper/310:10:503
298155799182,10cyclictest0-21swapper/312:05:483
298155799181,10cyclictest0-21swapper/312:35:493
298155799181,10cyclictest0-21swapper/309:10:433
298155799174,9cyclictest0-21swapper/308:50:463
298155799173,6cyclictest0-21swapper/308:55:453
298155799172,9cyclictest0-21swapper/311:50:593
298155799172,9cyclictest0-21swapper/311:35:423
298155799172,9cyclictest0-21swapper/311:10:473
298155799172,9cyclictest0-21swapper/309:00:513
298155799172,8cyclictest0-21swapper/310:30:443
298155799172,7cyclictest0-21swapper/308:05:443
298155799172,11cyclictest0-21swapper/310:45:333
298155799172,10cyclictest0-21swapper/311:45:433
298155799171,9cyclictest0-21swapper/310:55:373
298155799171,9cyclictest0-21swapper/309:20:463
298155799171,9cyclictest0-21swapper/309:20:463
298155799171,8cyclictest0-21swapper/311:55:373
298155799171,10cyclictest0-21swapper/312:20:503
298155799171,10cyclictest0-21swapper/309:25:463
298155799165,7cyclictest0-21swapper/308:20:473
298155799164,4cyclictest0-21swapper/308:00:443
298155799163,8cyclictest0-21swapper/312:25:563
298155799163,8cyclictest0-21swapper/309:45:343
298155799162,8cyclictest0-21swapper/311:25:373
298155799162,8cyclictest0-21swapper/311:25:373
298155799162,7cyclictest0-21swapper/308:45:473
298155799161,9cyclictest0-21swapper/311:40:453
298155799161,9cyclictest0-21swapper/310:25:403
298155799161,9cyclictest0-21swapper/310:00:453
298155799161,8cyclictest0-21swapper/309:10:013
298155799161,8cyclictest0-21swapper/307:55:503
298155799152,8cyclictest0-21swapper/307:40:053
298155799152,8cyclictest0-21swapper/307:25:433
298155799152,8cyclictest0-21swapper/307:20:353
298155799152,8cyclictest0-21swapper/307:20:353
298155799152,7cyclictest0-21swapper/308:15:513
298155799143,5cyclictest0-21swapper/308:35:443
298155799142,7cyclictest0-21swapper/308:25:473
298155799142,7cyclictest0-21swapper/308:10:433
298155799142,6cyclictest0-21swapper/307:45:453
298155799141,7cyclictest0-21swapper/307:30:433
298155799133,6cyclictest0-21swapper/308:40:463
298155799133,6cyclictest0-21swapper/308:40:463
298155799131,7cyclictest0-21swapper/308:30:453
298155799121,6cyclictest0-21swapper/307:10:023
298155799112,7cyclictest0-21swapper/307:50:443
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional