You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 15:56

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat May 09, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
345326622040,4sleep375-21kworker/3:1-events10:46:123
32843972970,1chrt3284402-21unixbench_singl07:56:151
35280702640,3sleep2371rcuc/212:05:002
35280702640,3sleep2371rcuc/212:05:002
33287762620,4chrt75-21kworker/3:1-events08:41:073
3233299995751,5cyclictest3404176-21kworker/u8:0+events_unbound11:26:110
3233301995651,3cyclictest3404176-21kworker/u8:0+events_unbound10:05:541
3233299995645,9cyclictest3512426-21ntpq11:46:080
3233304995548,5cyclictest280-21systemd-journal09:45:012
3233301995545,7cyclictest3404517-21diskstats10:00:591
3233299995448,4cyclictest3320093-21kworker/u8:2+events_unbound08:45:580
3233299995448,4cyclictest3320093-21kworker/u8:2+events_unbound08:45:580
3233299995345,5cyclictest3348641-21ntpq09:01:070
3233299995247,4cyclictest3254974-21kworker/u8:1+flush-8:008:51:110
3233299995247,4cyclictest3254974-21kworker/u8:1+flush-8:008:51:110
3233301995143,6cyclictest3320093-21kworker/u8:2+flush-8:008:41:121
3233299995143,6cyclictest280-21systemd-journal07:45:570
3233301995039,9cyclictest3508871-21diskstats11:45:581
3233299994942,5cyclictest3454211-21apt-get10:50:530
3233301994741,3cyclictest3443570-21kworker/u8:2+flush-8:011:11:091
3233301994740,5cyclictest3454186-21/usr/sbin/munin10:51:051
3233299994741,4cyclictest3260171-21kworker/u8:3+flush-8:008:31:120
3233299994737,8cyclictest3275395-21diskstats07:50:580
3233299994737,7cyclictest280-21systemd-journal09:55:000
3233304994637,7cyclictest280-21systemd-journal11:59:592
3233301994641,4cyclictest3233160-21kworker/u8:0+flush-8:007:15:591
3233301994639,4cyclictest3314951-21apt-get08:30:561
3233301994540,4cyclictest3320093-21kworker/u8:2+events_unbound08:46:071
3233301994540,4cyclictest3320093-21kworker/u8:2+events_unbound08:46:061
3233301994534,9cyclictest280-21systemd-journal10:33:071
3233299994534,8cyclictest280-21systemd-journal07:25:010
3233301994438,4cyclictest3518515-21apt-get11:55:551
3233301994333,8cyclictest280-21systemd-journal11:04:071
3233299994339,3cyclictest3289724-21kworker/u8:0+flush-8:008:06:110
3233299994336,5cyclictest3182014-21kworker/u8:1+flush-8:007:15:060
3233299994234,5cyclictest3374281-21latency_hist09:30:000
3233301994134,5cyclictest280-21systemd-journal09:44:071
3233301994131,8cyclictest3427874-21ntpq10:21:081
3233299994137,3cyclictest3349716-21kworker/u8:3+events_unbound09:20:010
3233299994136,3cyclictest3443570-21kworker/u8:2+flush-8:011:21:100
3233299994135,4cyclictest3443570-21kworker/u8:2+flush-8:012:00:380
3233299994135,4cyclictest3443570-21kworker/u8:2+flush-8:012:00:370
3233304994031,7cyclictest3319595-21apt-get08:35:002
3233301994034,5cyclictest3289724-21kworker/u8:0+flush-8:008:36:131
3233299994030,8cyclictest3343657-21ntpq08:56:060
3233299993932,5cyclictest3260171-21kworker/u8:3+flush-8:008:15:580
3233299993930,7cyclictest3409221-21apt-get10:05:520
3233299993930,6cyclictest3418772-21latency_hist10:15:010
3233304993831,5cyclictest3260171-21kworker/u8:3+flush-8:007:56:152
3233301993830,6cyclictest3553100-21apt-get12:30:541
3233299993833,4cyclictest3404176-21kworker/u8:0+flush-8:012:21:120
3233299993829,7cyclictest3384486-21/usr/sbin/munin09:41:120
3233299993827,9cyclictest280-21systemd-journal12:06:070
3233304993730,5cyclictest280-21systemd-journal11:00:002
3233301993728,6cyclictest3259914-21latency_hist07:35:011
3233301993727,7cyclictest3294661-21latency_hist08:10:011
3233299993732,4cyclictest3369566-21kworker/u8:0+events_unbound09:36:110
3233299993728,6cyclictest280-21systemd-journal10:35:070
3233301993631,4cyclictest3443570-21kworker/u8:2+flush-8:011:51:021
3233301993629,5cyclictest3527714-21grep12:01:151
3233301993629,5cyclictest3527714-21grep12:01:151
3233301993629,5cyclictest3359412-21latency_hist09:15:011
3233301993628,6cyclictest280-21systemd-journal08:02:051
3233299993630,4cyclictest3443570-21kworker/u8:2+flush-8:010:41:150
3233299993630,4cyclictest3443570-21kworker/u8:2+events_unbound10:55:580
3233299993624,10cyclictest280-21systemd-journal09:35:000
3233299993614,21cyclictest1-21systemd11:18:070
32330652361,6sleep013-21ksoftirqd/007:09:150
323330499357,16cyclictest3293819-21ntpq08:06:082
3233304993524,9cyclictest280-21systemd-journal10:18:072
3233301993530,4cyclictest3260171-21kworker/u8:3+flush-8:008:25:591
3233301993528,5cyclictest3448732-21latency_hist10:45:011
3233301993528,5cyclictest3233521-21apt-get07:10:541
3233301993527,6cyclictest3254974-21kworker/u8:1+flush-8:008:51:071
3233301993527,6cyclictest3254974-21kworker/u8:1+flush-8:008:51:071
323330499345,13cyclictest3503685-21apt-get11:40:552
3233299993427,5cyclictest3394049-21cron09:50:000
3233299993427,3cyclictest3443570-21kworker/u8:2+flush-8:011:36:030
3233299993425,7cyclictest3557722-21latency_hist12:35:010
3233304993326,5cyclictest280-21systemd-journal07:35:072
3233301993329,3cyclictest3379446-21kworker/u8:3+flush-8:009:46:131
3233301993329,3cyclictest3308767-21needreboot08:21:071
3233301993328,4cyclictest3503596-21kworker/u8:1+events_unbound12:15:571
3233301993327,5cyclictest3349716-21kworker/u8:3+events_unbound09:06:141
3233301993327,4cyclictest3233160-21kworker/u8:0+events_unbound07:26:051
3233301993323,8cyclictest3399285-21/usr/sbin/munin09:56:061
3233301993323,8cyclictest3304506-21apt-get08:20:001
3233299993328,3cyclictest3541967-21ntpq12:16:060
3233299993327,4cyclictest3443570-21kworker/u8:2+events_unbound11:56:030
3233299993310,21cyclictest3369345-21kworker/0:2+events10:20:000
3233301993228,3cyclictest3289724-21kworker/u8:0+events_unbound09:16:001
3233301993222,8cyclictest3443518-21latency_hist10:40:011
3233299993227,4cyclictest3503596-21kworker/u8:1+flush-8:012:10:380
3233299993226,4cyclictest3364592-21kworker/u8:1+flush-8:010:31:100
3233299993225,5cyclictest3260171-21kworker/u8:3+events_unbound08:26:110
3233304993121,4cyclictest3488799-21apt-get11:25:542
3233301993126,4cyclictest3364592-21kworker/u8:1+flush-8:009:51:111
3233301993125,5cyclictest3443570-21kworker/u8:2+flush-8:011:31:131
3233301993124,6cyclictest3240327-21kworker/u8:2+flush-8:007:20:591
3233301993122,7cyclictest3448730-21apt-get10:45:011
3233299993125,4cyclictest3260171-21kworker/u8:3+flush-8:007:40:580
35590932300,2sleep3451irq_work/312:36:033
3233304993023,5cyclictest280-21systemd-journal07:30:072
3233304993015,10cyclictest3433967-21apt-get10:30:582
3233301993025,3cyclictest3320093-21kworker/u8:2+events_unbound09:30:581
3233301993024,4cyclictest3379446-21kworker/u8:3+events_unbound09:36:071
3233301993022,6cyclictest3289724-21kworker/u8:0+flush-8:008:56:071
3233301993021,7cyclictest3548113-21/usr/sbin/munin12:26:031
3233299993026,2cyclictest3238396-21latency_hist07:15:010
3233299993025,4cyclictest3463804-21kworker/u8:3+flush-8:011:11:140
3233299993025,4cyclictest3404176-21kworker/u8:0+flush-8:010:21:140
3233299993025,4cyclictest3379446-21kworker/u8:3+events_unbound10:01:100
3233299993025,4cyclictest3289724-21kworker/u8:0+flush-8:008:21:000
3233299993024,4cyclictest3503596-21kworker/u8:1+events_unbound12:25:390
3233299993023,6cyclictest3233160-21kworker/u8:0+flush-8:007:31:100
323330499297,5cyclictest3340002-21aten2_r5power_v08:55:562
323330499297,11cyclictest3427890-21ntpq10:21:082
3233304992926,2cyclictest3299223-21unixbench_singl08:11:162
3233304992925,2cyclictest3374710-21aten2_r5power_v09:30:562
3233304992916,9cyclictest3320141-21apt-get08:35:542
3233304992915,8cyclictest3553100-21apt-get12:30:552
3233301992925,3cyclictest3260171-21kworker/u8:3+events_unbound07:40:581
3233301992923,4cyclictest3487680-21kworker/u8:1+flush-8:011:21:111
3233301992923,4cyclictest3289724-21kworker/u8:0+flush-8:009:02:121
3233301992921,6cyclictest3478900-21/usr/sbin/munin11:16:051
3233299992924,3cyclictest3507982-21unixbench_singl11:41:130
3233299992924,3cyclictest3428731-21kworker/u8:3+events_unbound10:26:110
3233299992923,4cyclictest3254974-21kworker/u8:1+events_unbound08:40:590
323330499286,5cyclictest3429263-21/usr/sbin/munin10:25:572
323330499285,5cyclictest3447886-21ntpq10:41:092
323330499285,13cyclictest0-21swapper/207:46:082
3233304992819,4cyclictest3265217-21apt-get07:40:552
3233304992817,5cyclictest3449278-21apt-get10:45:542
3233301992824,3cyclictest3289724-21kworker/u8:0+events_unbound08:10:591
3233301992822,4cyclictest3443570-21kworker/u8:2+flush-8:012:06:131
3233301992819,7cyclictest3260211-21/usr/sbin/munin07:36:141
3233301992818,8cyclictest3543455-21diskstats12:20:571
3233299992823,3cyclictest3463804-21kworker/u8:3+flush-8:011:00:580
3233299992823,3cyclictest3398713-21kworker/u8:2+events_unbound09:56:110
3233299992818,8cyclictest3280361-21diskstats07:55:590
323330499275,11cyclictest3393217-21ntpq09:46:092
3233304992723,2cyclictest3439210-21fschecks_count10:35:572
3233304992723,2cyclictest3413484-21unixbench_singl10:06:132
3233304992723,2cyclictest3310231-21cpuspeed_turbos08:25:572
3233304992720,5cyclictest280-21systemd-journal12:25:012
3233304992718,4cyclictest3513578-21apt-get11:50:552
3233301992723,3cyclictest3364592-21kworker/u8:1+events_unbound10:56:081
3233301992723,2cyclictest3471206-21kthreadcore11:06:021
3233299992723,3cyclictest3240327-21kworker/u8:2+events_unbound08:00:590
3233299992722,4cyclictest3349716-21kworker/u8:3+flush-8:009:21:050
3233299992721,4cyclictest3404176-21kworker/u8:0+flush-8:010:46:080
3233299992716,8cyclictest3353548-21ntpq09:06:070
3233304992621,4cyclictest3304720-21apt-key08:20:012
3233304992621,4cyclictest0-21swapper/211:05:002
3233304992617,4cyclictest3379534-21apt-get09:35:552
3233304992617,4cyclictest3304506-21apt-get08:20:022
3233301992621,4cyclictest3443570-21kworker/u8:2+flush-8:011:27:381
3233301992621,3cyclictest0-21swapper/107:10:011
3233301992617,7cyclictest0-21swapper/110:16:041
3233299992622,2cyclictest0-21swapper/008:40:000
3233299992621,4cyclictest3443570-21kworker/u8:2+flush-8:011:06:140
3233299992621,3cyclictest3562293-21unixbench_multi12:36:150
3233304992521,2cyclictest3469145-21aten2_r5power_p11:05:562
3233304992517,6cyclictest280-21systemd-journal08:55:002
3233304992517,6cyclictest280-21systemd-journal08:55:002
3233304992512,10cyclictest3562061-21/usr/sbin/munin12:36:132
3233304992512,10cyclictest3477850-21/usr/sbin/munin11:11:112
3233304992511,11cyclictest3244680-21/usr/sbin/munin07:16:142
3233304992510,12cyclictest3285054-21seq08:00:482
3233301992520,4cyclictest3364911-21cpuspeed_turbos09:20:591
3233301992519,4cyclictest3498709-21apt-get11:35:541
3233301992518,5cyclictest3534033-21irqrtprio12:11:021
323330499243,5cyclictest3254227-21ps07:26:112
3233304992420,2cyclictest3484088-21cpuspeed_turbos11:20:582
3233304992415,7cyclictest280-21systemd-journal07:25:002
3233304992412,9cyclictest3408217-21/usr/sbin/munin10:01:132
3233304992412,9cyclictest3398118-21/usr/sbin/munin09:51:072
3233304992412,8cyclictest3414879-21ps10:11:022
3233304992412,10cyclictest3531971-21/usr/sbin/munin12:06:052
3233304992410,9cyclictest3330051-21apt-get08:45:552
3233304992410,9cyclictest3330051-21apt-get08:45:552
3233304992410,10cyclictest3454141-21seq10:50:172
3233301992419,4cyclictest3274828-21awk07:50:001
3233301992419,4cyclictest3240327-21kworker/u8:2+flush-8:007:51:071
3233301992418,4cyclictest3417837-21needreboot10:11:061
3233299992419,3cyclictest3260825-21sort07:36:030
3233299992415,8cyclictest3443570-21kworker/u8:2+flush-8:011:51:140
323330499238,11cyclictest3233500-21sort07:10:552
323330499236,8cyclictest0-21swapper/211:36:322
323330499235,9cyclictest0-21swapper/208:41:012
323330499235,8cyclictest0-21swapper/211:17:582
323330499235,10cyclictest0-21swapper/209:00:562
3233304992319,2cyclictest3548489-21fschecks_time12:25:562
3233304992316,3cyclictest3358578-21ntpq09:11:102
3233304992311,9cyclictest3508536-21sshd11:45:072
3233304992311,8cyclictest3364889-21/usr/sbin/munin09:20:592
3233304992310,11cyclictest3403762-21seq09:58:012
3233301992319,3cyclictest3428731-21kworker/u8:3+flush-8:010:26:091
3233301992319,2cyclictest0-21swapper/109:26:001
3233301992315,6cyclictest3503717-21aten2_r5power_c11:40:551
323329999232,4cyclictest0-21swapper/011:30:550
3233299992318,3cyclictest3289724-21kworker/u8:0+events_unbound09:11:000
3233299992317,4cyclictest3289724-21kworker/u8:0+flush-8:008:11:100
323330499225,5cyclictest0-21swapper/211:30:572
323330499225,4cyclictest0-21swapper/212:10:592
3233304992213,6cyclictest3360446-21ps09:16:012
3233304992212,7cyclictest3278897-21/usr/sbin/munin07:51:062
3233304992211,8cyclictest3369618-21sort09:25:552
3233304992211,7cyclictest3350046-21/usr/sbin/munin09:05:582
3233299992217,4cyclictest3233160-21kworker/u8:0+flush-8:007:26:150
323330499219,9cyclictest3538166-21chrt12:15:272
3233301992115,5cyclictest3557324-21kworker/u8:2+flush-8:012:36:081
32282472202,8sleep30-21swapper/307:05:013
32284992194,11sleep20-21swapper/207:05:132
34138262142,7sleep30-21swapper/310:10:003
35431022132,6sleep30-21swapper/312:20:033
35035482132,6sleep30-21swapper/311:40:013
34539212132,6sleep30-21swapper/310:50:023
34292332132,7sleep30-21swapper/310:25:583
33535582132,8sleep30-21swapper/309:06:093
33404002131,8sleep30-21swapper/308:56:013
33201152132,7sleep30-21swapper/308:35:553
33049112132,6sleep30-21swapper/308:20:023
35528012122,6sleep30-21swapper/312:30:023
35484482122,6sleep30-21swapper/312:25:553
35383232122,6sleep30-21swapper/312:15:573
35323892122,6sleep30-21swapper/312:06:143
35234712122,6sleep30-21swapper/312:00:563
35234712122,6sleep30-21swapper/312:00:563
35132752122,5sleep30-21swapper/311:50:013
35089912123,5sleep30-21swapper/311:46:003
34990812122,6sleep30-21swapper/311:36:013
34978532122,6sleep30-21swapper/311:31:153
34884682122,5sleep30-21swapper/311:25:003
34847512122,6sleep30-21swapper/311:21:043
34787272122,5sleep30-21swapper/311:15:023
34595272122,6sleep30-21swapper/310:56:003
34439932122,5sleep30-21swapper/310:40:033
34340262122,6sleep30-21swapper/310:31:003
34244782122,6sleep30-21swapper/310:21:013
34237182120,8sleep30-21swapper/310:20:003
34065922122,6sleep30-21swapper/310:01:063
33993152122,6sleep30-21swapper/309:55:563
33912822122,6sleep30-21swapper/309:46:053
33792412122,6sleep30-21swapper/309:35:023
33741972122,6sleep30-21swapper/309:29:083
33650292122,6sleep30-21swapper/309:21:013
33606092122,6sleep30-21swapper/309:16:043
33186922122,6sleep30-21swapper/308:31:093
33143212122,6sleep30-21swapper/308:26:163
33002612122,6sleep30-21swapper/308:16:013
32751492122,6sleep30-21swapper/307:50:573
32742622122,6sleep30-21swapper/307:46:153
32609472122,6sleep30-21swapper/307:36:043
32549822122,6sleep30-21swapper/307:30:023
32541142123,6sleep30-21swapper/307:26:093
32337632122,6sleep30-21swapper/307:11:003
35342312112,5sleep30-21swapper/312:11:033
35190212112,6sleep30-21swapper/311:56:033
34727522112,5sleep30-21swapper/311:06:073
34642082112,5sleep30-21swapper/311:00:573
34424502112,5sleep30-21swapper/310:36:053
34142152112,5sleep30-21swapper/310:10:573
33942832112,5sleep30-21swapper/309:50:023
33847612112,5sleep30-21swapper/309:41:003
33783352112,6sleep30-21swapper/309:31:093
33544642112,5sleep30-21swapper/309:10:023
33452002112,5sleep30-21swapper/309:00:593
33387182112,6sleep30-21swapper/308:51:083
33387182112,6sleep30-21swapper/308:51:073
33300252112,5sleep30-21swapper/308:45:543
33300252112,5sleep30-21swapper/308:45:543
32949852112,5sleep30-21swapper/308:10:593
32896912111,5sleep30-21swapper/308:05:003
32850632112,6sleep30-21swapper/308:00:563
32799032112,5sleep30-21swapper/307:55:023
32690872112,5sleep30-21swapper/307:41:093
32462692112,5sleep30-21swapper/307:21:033
32390482112,5sleep30-21swapper/307:15:043
34738792102,5sleep30-21swapper/311:10:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional