You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 11:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Sat Sep 19, 2026 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
409661321780,3sleep375-21kworker/3:1+events20:19:053
406100821760,2sleep3481ktimers/319:40:013
1248012780,2sleep3481ktimers/323:59:173
4029158995949,7cyclictest95399-21latency_hist23:30:010
4029166995850,6cyclictest70975-21/usr/sbin/munin23:09:151
4029166995845,11cyclictest278-21systemd-journal21:45:001
4029158995546,6cyclictest4028987-21latency_hist19:10:020
4029166995443,8cyclictest4160360-21latency_hist21:20:011
4029158995145,4cyclictest4029283-21kworker/u8:1+flush-8:019:20:010
4029158995042,6cyclictest4125507-21latency_hist20:45:010
4029158994940,7cyclictest120127-21latency_hist23:55:010
4029158994740,5cyclictest278-21systemd-journal20:29:460
40827962460,1chrt4082801-21kthreadcore20:04:061
4029158994640,4cyclictest1-21systemd00:10:000
4029158994433,7cyclictest278-21systemd-journal20:10:000
4029166994335,6cyclictest4041485-21apt-get19:23:571
4029166994326,15cyclictest4106220-21/usr/sbin/munin20:29:151
4029166994324,16cyclictest4170251-21latency_hist21:30:011
4029166994233,7cyclictest60587-21latency_hist22:55:011
4029158994234,6cyclictest159674-21latency_hist00:35:020
4029158994234,6cyclictest115188-21latency_hist23:50:010
915472410,1chrt91546-21awk23:29:061
4029166994133,6cyclictest4140544-21latency_hist21:00:011
4029158994137,3cyclictest4061184-21kworker/u8:2+flush-8:020:14:150
4029166994032,6cyclictest278-21systemd-journal23:05:001
4029166994023,14cyclictest278-21systemd-journal19:38:281
4029166993930,7cyclictest16358-21apt-get22:13:591
4029166993920,17cyclictest4115035-21ntpq20:34:121
4029166993920,17cyclictest4115035-21ntpq20:34:121
4029166993821,15cyclictest105295-21cron23:40:001
4029166993821,15cyclictest105295-21cron23:40:001
4029166993819,17cyclictest65528-21systemd-run23:00:011
4029166993819,17cyclictest130069-21sh00:05:011
4029158993833,4cyclictest55639-21kworker/u8:0+flush-8:023:59:150
4029158993832,4cyclictest278-21systemd-journal23:15:000
4029166993730,5cyclictest21345-21apt-get22:18:591
4029166993728,6cyclictest4040258-21ntpq19:19:101
4029166993724,11cyclictest4150505-21systemd-run21:10:011
4029166993721,14cyclictest0-21swapper/120:50:011
4029166993719,16cyclictest4105558-21unixbench_multi20:24:171
4029166993718,17cyclictest0-21swapper/122:48:271
4029166993717,2cyclictest0-21swapper/121:14:161
4029158993730,5cyclictest4061184-21kworker/u8:2+events_unbound22:05:000
4029158993728,7cyclictest4061184-21kworker/u8:2+flush-8:022:09:170
4029158993728,7cyclictest4061184-21kworker/u8:2+flush-8:022:09:160
402915899371,34cyclictest1-21systemd19:15:010
715142360,3sleep20-21swapper/223:09:052
40754702360,2sleep2371rcuc/219:54:162
4029166993620,14cyclictest85290-21sendmail23:20:001
4029166993619,15cyclictest39976-21ntp_kernel_pll_22:34:121
4029166993617,17cyclictest20865-21cron19:55:001
4029166993614,5cyclictest0-21swapper/122:09:061
4029166993614,5cyclictest0-21swapper/122:09:061
4029158993630,4cyclictest4155260-21grep21:14:180
4029158993627,6cyclictest278-21systemd-journal22:45:010
4029166993526,6cyclictest4164694-21ntpq21:24:101
4029166993519,3cyclictest100205-21unixbench_multi23:34:171
4029166993519,14cyclictest0-21swapper/119:43:591
4029166993517,2cyclictest0-21swapper/119:34:041
4029166993516,2cyclictest0-21swapper/122:04:071
4029166993516,2cyclictest0-21swapper/121:59:141
4029166993516,2cyclictest0-21swapper/120:39:011
4029166993516,10cyclictest278-21systemd-journal21:05:001
4029158993528,5cyclictest4061184-21kworker/u8:2+flush-8:022:29:150
4029166993417,2cyclictest0-21swapper/122:44:111
4029166993416,3cyclictest0-21swapper/120:19:091
4029166993416,2cyclictest0-21swapper/123:14:141
4029166993415,3cyclictest0-21swapper/123:53:581
4029166993415,2cyclictest0-21swapper/123:24:011
4029166993415,2cyclictest0-21swapper/100:23:591
4029166993414,6cyclictest4174515-21ntpq21:34:081
4029166993414,4cyclictest0-21swapper/120:14:151
4029166993414,4cyclictest0-21swapper/100:39:171
4029166993413,5cyclictest0-21swapper/100:19:111
4029158993427,5cyclictest110075-21grep23:44:190
4029158993426,6cyclictest75399-21kworker/u8:3+flush-8:023:38:580
4029158993426,6cyclictest75399-21kworker/u8:3+flush-8:023:38:580
4029158993425,7cyclictest4060322-21ntpq19:39:110
4029166993318,13cyclictest0-21swapper/119:30:001
4029166993313,4cyclictest0-21swapper/122:28:591
4029166993312,5cyclictest0-21swapper/100:14:001
4029166993312,3cyclictest0-21swapper/121:45:281
40244762334,9sleep20-21swapper/219:06:502
4029166993216,3cyclictest4033619-21mailstats19:14:151
4029166993216,3cyclictest154654-21unixbench_singl00:29:171
4029166993212,7cyclictest1135-21sed21:55:011
4029158993222,8cyclictest4135017-21ntpq20:54:120
4029166993125,4cyclictest95925-21kworker/u8:1+flush-8:023:44:041
4029158993127,3cyclictest4085909-21kworker/u8:3+flush-8:020:34:010
4029158993127,3cyclictest4085909-21kworker/u8:3+flush-8:020:34:010
4029158993127,3cyclictest4029283-21kworker/u8:1+flush-8:021:34:010
4029158993122,6cyclictest278-21systemd-journal00:25:000
4029158993121,7cyclictest20785-21latency_hist22:15:000
402916699305,5cyclictest0-21swapper/120:51:431
402916699302,11cyclictest110783-21apt-get23:49:001
4029158993025,3cyclictest4061184-21kworker/u8:2+flush-8:022:21:320
4029158993024,4cyclictest55639-21kworker/u8:0+events_unbound00:14:160
4029158993022,6cyclictest4085670-21ls20:05:000
4029158993021,7cyclictest81148-21diskstats23:19:030
4029171992924,4cyclictest4160304-21kworker/u8:3+flush-8:021:19:572
4029171992920,7cyclictest90236-21apt-get23:25:002
4029158992925,3cyclictest4160304-21kworker/u8:3+events_unbound21:44:060
4029158992924,4cyclictest95925-21kworker/u8:1+flush-8:000:19:160
4029158992922,5cyclictest50538-21grep22:44:180
4029158992921,6cyclictest0-21swapper/022:00:010
4029171992813,9cyclictest135534-21apt-get00:13:592
402916699287,3cyclictest0-21swapper/119:45:341
4029166992821,5cyclictest278-21systemd-journal21:37:271
4029158992825,2cyclictest4029283-21kworker/u8:1+events_unbound21:50:000
4029158992824,3cyclictest4029283-21kworker/u8:1+flush-8:021:04:080
4029158992822,4cyclictest4160304-21kworker/u8:3+events_unbound21:40:000
4029158992822,4cyclictest4051618-21apt-get19:33:590
4029158992820,6cyclictest164642-21apt-get00:40:000
4029158992816,9cyclictest45527-21apt-get22:40:010
402917199278,3cyclictest41815942sort21:44:082
402917199275,13cyclictest0-21swapper/222:54:102
4029171992722,3cyclictest16470-21aten2_r5power_v22:14:012
402917199272,23cyclictest1-21systemd23:15:002
4029171992718,6cyclictest4155421-21awk21:15:002
4029171992717,5cyclictest26301-21apt-get22:23:592
4029171992710,11cyclictest4051618-21apt-get19:34:002
4029158992723,3cyclictest4029283-21kworker/u8:1+flush-8:022:53:270
4029158992723,2cyclictest4099786-21needreboot20:19:100
402915899272,24cyclictest2640651-21kworker/0:2+events19:28:150
4029158992722,3cyclictest4061184-21kworker/u8:2+events_unbound20:24:000
4029158992721,4cyclictest4029283-21kworker/u8:1+flush-8:021:52:320
4029158992718,7cyclictest4070874-21latency_hist19:50:010
4029158992718,6cyclictest4159690-21ntpq21:19:090
402915899271,25cyclictest2640651-21kworker/0:2+events22:55:350
4029171992617,5cyclictest4136178-21apt-get20:58:582
4029171992616,5cyclictest140470-21apt-get00:18:582
4029171992611,11cyclictest4041732-21/usr/sbin/munin19:24:012
4029158992623,2cyclictest4149778-21needreboot21:09:080
402915899262,20cyclictest2640651-21kworker/0:2+events21:25:590
402915899262,19cyclictest2640651-21kworker/0:2+events23:01:430
4029158992621,4cyclictest4029283-21kworker/u8:1+flush-8:019:55:310
4029158992620,5cyclictest55639-21kworker/u8:0+flush-8:023:24:150
4029158992618,6cyclictest4136442-21grep20:59:020
4029158992618,6cyclictest120371-21kworker/u8:3+flush-8:000:25:430
402915899260,25cyclictest2640651-21kworker/0:2+events19:54:550
402917199256,9cyclictest0-21swapper/220:34:182
402917199256,9cyclictest0-21swapper/220:34:172
402917199256,8cyclictest0-21swapper/223:28:152
402917199256,7cyclictest4145517-21sshd21:04:502
402917199255,7cyclictest40812882/usr/sbin/munin20:03:572
402917199255,5cyclictest0-21swapper/222:00:002
402917199254,11cyclictest35028-21ntpq22:29:102
4029171992521,2cyclictest45364-21unixbench_multi22:39:162
4029171992521,2cyclictest130658-21aten2_r5power_e00:08:592
4029171992518,4cyclictest10204-21ntpq22:04:102
4029171992517,6cyclictest278-21systemd-journal21:53:272
4029171992514,7cyclictest154190-21ntpq00:29:122
4029171992511,11cyclictest4036963-21/usr/sbin/munin19:19:032
4029158992517,6cyclictest278-21systemd-journal23:30:190
402915899250,24cyclictest2640651-21kworker/0:2+events21:22:590
40246672255,13sleep10-21swapper/119:08:581
402917199245,9cyclictest0-21swapper/220:06:322
402917199245,4cyclictest149186-21ntpq00:24:122
402917199245,4cyclictest0-21swapper/221:08:592
402917199244,8cyclictest0-21swapper/222:09:162
402917199244,8cyclictest0-21swapper/222:09:162
402917199242,5cyclictest115192-21munin-run23:50:012
4029171992415,5cyclictest4121120-21apt-get20:43:592
4029171992413,8cyclictest116180-21/usr/sbin/munin23:54:032
4029171992410,11cyclictest4185401-21seq21:46:422
4029171992410,11cyclictest4095876-21seq20:16:092
4029166992419,3cyclictest30573-21unixbench_multi22:24:181
402915899245,18cyclictest2640651-21kworker/0:2+events23:08:030
4029158992420,3cyclictest16039-21kworker/u8:3+events_unbound22:19:100
4029158992419,3cyclictest0-21swapper/020:50:010
4029158992418,4cyclictest4029283-21kworker/u8:1+flush-8:019:24:070
402915899241,3cyclictest839-21mta-sts-daemon00:04:160
402917199239,11cyclictest4101190-21seq20:23:032
402917199237,8cyclictest0-21swapper/200:34:002
402917199236,6cyclictest0-21swapper/219:11:332
402917199235,8cyclictest0-21swapper/220:14:032
402917199234,9cyclictest0-21swapper/222:49:022
402917199234,5cyclictest25072-21ntpq22:19:112
4029171992319,2cyclictest4106357-21aten2_r5power_v20:29:002
4029171992319,2cyclictest4056633-21aten2_r5power_e19:38:592
4029171992319,2cyclictest125980-21fschecks_time00:04:032
4029171992316,5cyclictest4175177-21cron21:35:002
4029171992315,4cyclictest61133-21apt-get22:58:572
4029171992311,9cyclictest65827-21seq23:01:122
4029171992310,11cyclictest4046381-21seq19:25:412
4029171992310,10cyclictest4126551-21/usr/sbin/munin20:49:042
4029171992310,10cyclictest4066316-21seq19:47:202
4029166992320,2cyclictest44825-21grep22:39:081
4029166992318,3cyclictest0-21swapper/100:34:021
4029166992313,8cyclictest4089978-21ntpq20:09:111
4029158992319,3cyclictest4029283-21kworker/u8:1+events_unbound22:34:150
402917199228,11cyclictest105739-21chrt23:42:352
402917199227,8cyclictest0-21swapper/223:34:042
402917199225,6cyclictest0-21swapper/223:15:402
402917199225,6cyclictest0-21swapper/222:34:232
402917199224,3cyclictest164015-21ntpq00:39:112
4029171992219,2cyclictest0-21swapper/219:45:002
4029171992218,2cyclictest4170122-21unixbench_singl21:29:172
4029171992214,4cyclictest50026-21ntpq22:44:112
4029171992214,4cyclictest4076334-21apt-get19:58:572
4029171992212,7cyclictest100976-21/usr/sbin/munin23:39:002
4029171992212,7cyclictest100976-21/usr/sbin/munin23:39:002
4029171992210,9cyclictest4175515-21sshd21:36:272
4029166992218,2cyclictest0-21swapper/123:59:141
4029166992217,3cyclictest4080608-21unixbench_singl19:59:171
402915899222,19cyclictest2640651-21kworker/0:2+events19:41:310
402915899221,20cyclictest2640651-21kworker/0:2+events20:35:230
402917199216,2cyclictest0-21swapper/221:22:042
402917199215,8cyclictest0-21swapper/220:36:302
402917199215,3cyclictest0-21swapper/223:57:532
4029171992111,6cyclictest4131228-21/usr/sbin/munin20:54:002
4029166992116,3cyclictest134265-21needreboot00:09:081
40244672217,8sleep30-21swapper/319:06:433
4029166991913,4cyclictest0-21swapper/120:44:021
1355172162,9sleep30-21swapper/300:13:593
41361792142,7sleep30-21swapper/320:58:583
954262132,6sleep30-21swapper/323:30:013
759392132,7sleep30-21swapper/323:14:003
626322134,5sleep30-21swapper/322:59:073
59322132,6sleep30-21swapper/322:00:013
565452132,7sleep30-21swapper/322:54:023
470422133,6sleep30-21swapper/322:44:073
41548742132,7sleep30-21swapper/321:14:153
41012892134,5sleep30-21swapper/320:23:593
40955532132,6sleep30-21swapper/320:15:013
40368812132,7sleep30-21swapper/319:19:033
40333702132,7sleep30-21swapper/319:14:103
210152132,7sleep30-21swapper/322:15:063
1597012132,6sleep30-21swapper/300:35:013
863032122,6sleep30-21swapper/323:24:033
704722122,6sleep30-21swapper/323:05:013
660372122,6sleep30-21swapper/323:03:573
556082123,6sleep30-21swapper/322:50:023
50992122,6sleep30-21swapper/321:59:093
41909032122,6sleep30-21swapper/321:54:033
41752072122,6sleep30-21swapper/321:35:013
41719652122,6sleep30-21swapper/321:34:053
41696332123,6sleep30-21swapper/321:29:123
41460752122,6sleep30-21swapper/321:08:573
413862122,6sleep30-21swapper/322:39:013
41316012122,6sleep30-21swapper/320:54:053
41260582122,6sleep30-21swapper/320:48:593
41191052122,6sleep30-21swapper/320:39:083
41106842122,6sleep30-21swapper/320:30:013
41106842122,6sleep30-21swapper/320:30:013
41097982122,6sleep30-21swapper/320:29:093
40864812122,6sleep30-21swapper/320:09:033
40812622122,6sleep30-21swapper/320:03:573
40723102122,6sleep30-21swapper/319:54:063
40664392122,6sleep30-21swapper/319:48:573
40463482122,6sleep30-21swapper/319:25:173
40458562120,7sleep30-21swapper/319:25:013
315952122,6sleep30-21swapper/322:29:023
300712122,6sleep30-21swapper/322:24:133
1557512122,6sleep30-21swapper/300:34:053
1527512122,6sleep30-21swapper/300:29:073
1254232122,6sleep30-21swapper/300:01:113
1151092122,6sleep30-21swapper/323:49:193
1078522123,5sleep30-21swapper/323:44:093
913942112,5sleep30-21swapper/323:29:053
806712112,6sleep30-21swapper/323:16:253
41853682112,6sleep30-21swapper/321:46:173
41809192112,5sleep30-21swapper/321:44:043
41618562112,5sleep30-21swapper/321:24:063
41564772112,5sleep30-21swapper/321:19:053
41423852111,6sleep30-21swapper/321:04:093
41209902113,5sleep30-21swapper/320:42:373
40762692112,5sleep30-21swapper/319:58:273
40649882112,5sleep30-21swapper/319:44:113
40513772112,6sleep30-21swapper/319:31:113
361982112,5sleep30-21swapper/322:34:003
161802113,5sleep30-21swapper/322:12:013
1452532112,6sleep30-21swapper/300:22:053
1401452112,6sleep30-21swapper/300:15:073
1304442112,6sleep30-21swapper/300:07:173
1195422112,5sleep30-21swapper/323:54:133
118042112,5sleep30-21swapper/322:09:043
118042112,5sleep30-21swapper/322:09:043
1007732112,5sleep30-21swapper/323:37:273
1007732112,5sleep30-21swapper/323:37:273
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional