You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-17 - 03:01

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Thu Sep 17, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24027121750,5sleep30-21swapper/320:25:013
1912242880,3sleep375-21kworker/3:1-events19:39:073
163315997144,7cyclictest278-21systemd-journal20:25:010
3871342680,4sleep10-21swapper/122:54:091
4596422650,3chrt75-21kworker/3:1+events00:09:063
3364752560,2chrt471rcuc/322:04:083
163317995648,5cyclictest379820-21/usr/sbin/munin22:49:151
163317995647,7cyclictest269801-21latency_hist20:55:011
1753382550,2sleep3471rcuc/319:20:013
163315995243,7cyclictest284665-21kworker/u8:0+flush-8:023:14:180
163317995144,5cyclictest408896-21kworker/u8:1+events_unbound23:34:181
163317995142,7cyclictest284665-21kworker/u8:0+flush-8:022:39:181
163317994944,3cyclictest448731-21kworker/u8:3+flush-8:000:19:041
163317994940,6cyclictest219921-21latency_hist20:05:011
163315994939,8cyclictest314876-21/usr/sbin/munin21:44:110
163317994640,4cyclictest260193-21kworker/u8:2+flush-8:021:04:171
163317994540,4cyclictest234973-21kworker/u8:2+events_unbound20:40:011
163315994433,9cyclictest320087-21diskstats21:49:050
163317994335,6cyclictest319282-21latency_hist21:45:021
163315994335,6cyclictest413903-21latency_hist23:20:000
163315994231,8cyclictest278-21systemd-journal21:35:240
163317994126,12cyclictest278-21systemd-journal19:15:001
163321994031,7cyclictest334334-21awk22:00:002
163317994033,5cyclictest284665-21kworker/u8:0+flush-8:021:49:211
163317994029,8cyclictest278-21systemd-journal22:44:241
163315994035,3cyclictest215223-21kworker/u8:3+events_unbound21:24:100
2624642390,4sleep2381ktimers/220:49:072
163317993935,3cyclictest234973-21kworker/u8:2+flush-8:020:34:041
163317993934,4cyclictest210031-21kworker/u8:1+flush-8:021:14:061
163317993934,4cyclictest210031-21kworker/u8:1+flush-8:020:24:081
163317993933,4cyclictest260193-21kworker/u8:2+events_unbound20:49:051
163317993933,4cyclictest215223-21kworker/u8:3+flush-8:021:19:051
163317993931,6cyclictest284665-21kworker/u8:0+flush-8:021:59:171
163321993834,3cyclictest448731-21kworker/u8:3+flush-8:023:59:082
163317993830,6cyclictest163178-21kworker/u8:0+events_unbound19:49:161
163317993823,11cyclictest278-21systemd-journal20:20:001
163315993831,5cyclictest424343-21apt-get23:33:590
163317993729,6cyclictest210031-21kworker/u8:1+events_unbound22:10:021
163315993729,6cyclictest170678-21/usr/sbin/munin19:19:100
163315993728,7cyclictest339272-21latency_hist22:05:010
1587842371,7sleep013-21ksoftirqd/019:08:390
163317993631,4cyclictest255177-21kworker/u8:0+flush-8:020:44:031
163317993629,5cyclictest278-21systemd-journal19:38:251
163317993628,6cyclictest448731-21kworker/u8:3+flush-8:023:59:041
163317993627,6cyclictest284665-21kworker/u8:0+events_unbound00:29:121
163315993629,5cyclictest279688-21latency_hist21:05:000
163315993627,7cyclictest304241-21grep21:29:180
1586432364,11sleep10-21swapper/119:06:511
163317993530,3cyclictest408896-21kworker/u8:1+events_unbound23:19:091
163317993530,3cyclictest299468-21cron21:25:001
163317993528,5cyclictest399626-21apt-get23:08:581
163317993526,6cyclictest304407-21latency_hist21:30:011
163315993526,7cyclictest278-21systemd-journal22:30:000
16331599352,27cyclictest225109-21kworker/0:2+events21:14:010
163317993429,3cyclictest284665-21kworker/u8:0+events_unbound21:54:061
163317993427,5cyclictest284665-21kworker/u8:0+flush-8:023:24:061
163315993430,3cyclictest284665-21kworker/u8:0+flush-8:000:05:000
163315993424,8cyclictest473315-21latency_hist00:20:010
163315993410,22cyclictest225109-21kworker/0:2+events20:14:130
163317993328,4cyclictest170386-21kworker/u8:1+flush-8:019:21:551
163317993328,3cyclictest163178-21kworker/u8:0+flush-8:019:59:171
163317993326,5cyclictest448401-21grep23:54:201
163317993325,5cyclictest170386-21kworker/u8:1+events_unbound19:29:061
163317993323,8cyclictest280490-21diskstats21:09:031
163315993324,6cyclictest399079-21latency_hist23:05:010
15907423318,8sleep30-21swapper/319:09:023
163321993227,4cyclictest215223-21kworker/u8:3+flush-8:020:09:042
163321993225,5cyclictest483163-21apt-get00:30:002
163317993228,3cyclictest304650-21kworker/u8:2+flush-8:021:34:171
163317993227,4cyclictest424017-21kworker/u8:2+flush-8:023:44:081
163317993227,4cyclictest195414-21kworker/u8:3+events_unbound19:44:131
163317993227,3cyclictest210031-21kworker/u8:1+flush-8:020:29:181
163317993223,6cyclictest304650-21kworker/u8:2+flush-8:021:39:171
163317993222,7cyclictest278-21systemd-journal19:20:001
163315993227,3cyclictest239960-21gpgv20:25:000
163315993223,7cyclictest278-21systemd-journal21:10:000
163315993219,11cyclictest389203-21kworker/u8:2+events_unbound23:10:010
163321993127,3cyclictest284665-21kworker/u8:0+events_unbound00:04:062
163321993126,3cyclictest284665-21kworker/u8:0+flush-8:021:30:312
163321993125,4cyclictest438160-21journal-offline23:44:172
163317993127,2cyclictest339858-21aten2_r5power_e22:09:001
163317993126,4cyclictest284665-21kworker/u8:0+flush-8:022:04:031
163317993126,3cyclictest189279-21needreboot19:34:091
16331599312,27cyclictest309407-21kworker/0:0+events22:34:010
16331599312,27cyclictest225109-21kworker/0:2+events20:59:010
16331599311,25cyclictest309407-21kworker/0:0+events22:45:210
16331599311,25cyclictest2913847-21kworker/0:0+events19:25:130
1631352313,9sleep20-21swapper/219:09:592
163317993024,4cyclictest443560-21cron23:50:001
16331599309,20cyclictest309407-21kworker/0:0+events00:12:330
16331599307,19cyclictest309407-21kworker/0:0+events00:25:210
163315993026,3cyclictest418855-21systemd-run23:25:000
16331599300,26cyclictest225109-21kworker/0:2+events20:50:570
163321992925,2cyclictest354990-21aten2_r5power_p22:24:062
163321992925,2cyclictest354990-21aten2_r5power_p22:24:062
163321992924,3cyclictest275554-21cpuspeed_turbos21:04:032
163321992919,8cyclictest168232-21awk19:15:002
163317992924,3cyclictest405174-21irqcore23:14:071
163317992919,8cyclictest477625-21ntpq00:24:121
163317992919,7cyclictest278-21systemd-journal00:05:001
16331599296,18cyclictest478256-21kworker/0:1+events00:35:570
163315992925,2cyclictest394129-21sh23:00:000
16331599292,26cyclictest2913847-21kworker/0:0+events19:33:570
16331599292,22cyclictest225109-21kworker/0:2+events21:31:450
163315992920,7cyclictest453445-21/usr/sbin/munin00:00:000
163315992919,8cyclictest220021-21cp20:05:010
163315992917,9cyclictest278-21systemd-journal23:45:000
16331599291,26cyclictest309407-21kworker/0:0+events23:29:170
16331599291,26cyclictest309407-21kworker/0:0+events21:53:570
16331599291,26cyclictest2913847-21kworker/0:0+events19:49:130
163321992825,2cyclictest229865-21unixbench_multi20:14:182
163321992823,4cyclictest284665-21kworker/u8:0+flush-8:023:04:142
163317992824,2cyclictest484215-21cut00:34:031
163317992824,2cyclictest354354-21sendmail22:20:001
163317992824,2cyclictest354354-21sendmail22:20:001
163317992823,4cyclictest163178-21kworker/u8:0+flush-8:019:54:171
163317992818,8cyclictest423165-21ntpq23:29:111
16331599289,18cyclictest225109-21kworker/0:2+events20:19:290
163315992818,8cyclictest343550-21ntpq22:09:100
163315992817,2cyclictest0-21swapper/020:49:130
163315992810,16cyclictest309407-21kworker/0:0+events23:39:090
163321992723,3cyclictest214960-21cron20:00:002
163321992723,3cyclictest170386-21kworker/u8:1+events_unbound19:35:002
163321992723,2cyclictest439458-21fschecks_count23:49:042
163321992722,4cyclictest284665-21kworker/u8:0+events_unbound22:39:132
163321992722,3cyclictest310213-21fschecks_count21:39:032
163317992721,4cyclictest260193-21kworker/u8:2+flush-8:020:59:081
163317992721,3cyclictest0-21swapper/122:34:151
163317992719,6cyclictest224933-21unixbench_multi20:09:201
16331599279,17cyclictest2913847-21kworker/0:0+events19:41:210
16331599279,17cyclictest205096-21kworker/0:1+events19:51:370
16331599278,18cyclictest309407-21kworker/0:0+events00:24:330
16331599278,17cyclictest309407-21kworker/0:0+events22:36:290
16331599278,15cyclictest309407-21kworker/0:0+events23:50:250
16331599277,19cyclictest225109-21kworker/0:2+events20:32:570
16331599276,19cyclictest2913847-21kworker/0:0+events19:39:250
16331599274,19cyclictest309407-21kworker/0:0+events22:15:250
16331599274,19cyclictest309407-21kworker/0:0+events22:15:250
163315992724,2cyclictest379290-21cron22:45:000
163315992721,4cyclictest168234-21latency_hist19:15:010
16331599271,21cyclictest309407-21kworker/0:0+events21:55:530
163321992623,2cyclictest284637-21cron21:10:002
163321992622,2cyclictest245902-21fschecks_count20:34:032
163321992621,4cyclictest20865-21cron21:20:002
163321992618,6cyclictest433698-21awk23:40:002
163317992622,3cyclictest399081-21/usr/sbin/munin23:05:001
163317992622,2cyclictest0-21swapper/123:39:181
163317992621,4cyclictest215223-21kworker/u8:3+flush-8:020:14:111
163317992620,4cyclictest448731-21kworker/u8:3+events_unbound00:39:041
16331599267,18cyclictest225109-21kworker/0:2+events20:43:250
16331599265,17cyclictest309407-21kworker/0:0+events22:20:010
16331599265,17cyclictest309407-21kworker/0:0+events22:20:010
16331599261,24cyclictest309407-21kworker/0:0+events23:46:090
163321992517,6cyclictest463989-21apt-get00:14:022
163317992520,4cyclictest284665-21kworker/u8:0+flush-8:000:09:151
163317992518,5cyclictest0-21swapper/122:59:021
16331599255,19cyclictest205096-21kworker/0:1+events20:05:130
16331599251,23cyclictest478256-21kworker/0:1+events00:31:530
16331599251,23cyclictest309407-21kworker/0:0+events22:51:250
163321992421,2cyclictest409813-21fschecks_time23:19:062
163321992421,2cyclictest390-21dbus-daemon00:20:002
163321992419,3cyclictest318564-21needreboot21:44:112
16332199241,21cyclictest195006-21munin-run19:40:002
16331599249,14cyclictest2913847-21kworker/0:0+events19:22:210
16331599248,15cyclictest309407-21kworker/0:0+events22:13:090
16331599246,17cyclictest205096-21kworker/0:1+events19:59:050
16331599245,15cyclictest309407-21kworker/0:0+events00:05:170
16331599241,22cyclictest225109-21kworker/0:2+events21:17:250
163321992320,2cyclictest379958-21aten2_r5power_v22:49:002
163321992320,2cyclictest365220-21cpuspeed_turbos22:34:032
163321992320,2cyclictest360332-21fschecks_count22:29:032
163321992320,2cyclictest350185-21cpuspeed_turbos22:19:022
163321992320,2cyclictest350185-21cpuspeed_turbos22:19:022
163321992319,3cyclictest20865-21cron22:05:012
163321992316,5cyclictest209351-21ntpq19:54:122
163321992314,6cyclictest400846-21tr23:09:072
163317992315,6cyclictest210031-21kworker/u8:1+events_unbound22:29:121
16331599237,15cyclictest225109-21kworker/0:2+events20:39:330
163321992219,2cyclictest488308-21latency_hist00:35:002
163321992218,2cyclictest488983-21aten2_r5power_v00:39:032
163321992217,4cyclictest416621-21tr23:24:102
163321992217,4cyclictest210031-21kworker/u8:1+flush-8:020:04:032
163317992217,4cyclictest424017-21kworker/u8:2+flush-8:000:14:071
163317992217,3cyclictest284665-21kworker/u8:0+events_unbound22:24:111
163317992217,3cyclictest284665-21kworker/u8:0+events_unbound22:24:111
163321992118,2cyclictest389075-21unixbench_singl22:54:192
163321992118,2cyclictest319895-21aten2_r5power_e21:49:032
163321992117,2cyclictest327171-21kthreadcore21:54:072
163321992112,7cyclictest271256-21sed20:59:092
163321992112,7cyclictest254261-21awk20:39:112
163321992110,9cyclictest444123-21apt-get23:54:002
16332199210,19cyclictest234982-21unin-run20:20:002
163321992016,2cyclictest0-21swapper/222:10:002
163321992015,3cyclictest459341-21fschecks_time00:09:042
163321992012,6cyclictest428391-21sed23:34:182
163321992012,6cyclictest348659-21sed22:14:102
163321992012,6cyclictest299132-21sed21:24:192
16332199194,8cyclictest0-21swapper/222:56:482
16332199192,12cyclictest239943-21apt-get20:25:032
163321991914,3cyclictest0-21swapper/221:14:202
163321991911,6cyclictest171904-21cut19:19:072
163321991814,2cyclictest0-21swapper/221:29:132
163321991814,2cyclictest0-21swapper/220:20:102
163321991813,3cyclictest178400-21kthreadcore19:24:112
163321991810,6cyclictest198784-21tr19:44:092
163321991712,4cyclictest474595-21cut00:24:062
163321991712,3cyclictest0-21swapper/219:29:082
163321991711,4cyclictest0-21swapper/220:54:102
16332199170,3cyclictest256462-21cut20:44:072
16332199162,2cyclictest0-21swapper/222:44:192
16332199162,13cyclictest0-21swapper/219:46:582
163321991613,2cyclictest0-21swapper/223:28:002
163321991613,2cyclictest0-21swapper/223:14:022
3405262150,1sleep375-21kworker/3:1-events22:09:053
4875832133,6sleep30-21swapper/300:34:113
4683832132,6sleep30-21swapper/300:15:013
4429192132,7sleep30-21swapper/323:49:133
4040462132,6sleep30-21swapper/323:10:023
4034152132,7sleep30-21swapper/323:09:133
3687832132,7sleep30-21swapper/322:34:143
3255902133,6sleep30-21swapper/321:54:063
3236072132,7sleep30-21swapper/321:49:163
3086422132,7sleep30-21swapper/321:34:113
2895692132,6sleep30-21swapper/321:15:013
2753342132,7sleep30-21swapper/321:04:023
2226472132,7sleep30-21swapper/320:09:093
2099962132,7sleep30-21swapper/319:55:013
1850542132,6sleep30-21swapper/319:30:013
4742462122,6sleep30-21swapper/300:24:043
4643722122,6sleep30-21swapper/300:14:103
4505372122,6sleep30-21swapper/323:59:083
4299972122,6sleep30-21swapper/323:39:063
4286492122,6sleep30-21swapper/323:34:213
4208332122,6sleep30-21swapper/323:29:083
4138862123,5sleep30-21swapper/323:20:003
3946972122,6sleep30-21swapper/323:04:033
3850452122,6sleep30-21swapper/322:54:043
3793082122,6sleep30-21swapper/322:45:013
3588912122,6sleep30-21swapper/322:24:233
3588912122,6sleep30-21swapper/322:24:233
3503252122,6sleep30-21swapper/322:19:053
3503252122,6sleep30-21swapper/322:19:053
3143412122,6sleep30-21swapper/321:40:013
3103602122,6sleep30-21swapper/321:39:053
2854462122,6sleep30-21swapper/321:14:053
2654582122,6sleep30-21swapper/320:54:033
2609422122,6sleep30-21swapper/320:49:053
2557572123,5sleep30-21swapper/320:44:043
2459832122,6sleep30-21swapper/320:34:053
2411642122,6sleep30-21swapper/320:29:073
2250992122,6sleep30-21swapper/320:10:023
1957462122,6sleep30-21swapper/319:44:013
1849632122,6sleep30-21swapper/319:29:213
1757092122,6sleep30-21swapper/319:24:033
1635102122,6sleep30-21swapper/319:10:553
4885352112,6sleep30-21swapper/300:35:033
4537492112,6sleep30-21swapper/300:00:453
4441552112,5sleep30-21swapper/323:54:033
4339972112,6sleep30-21swapper/323:40:593
4142272112,6sleep30-21swapper/323:21:083
3894582112,6sleep30-21swapper/322:55:413
3747932112,6sleep30-21swapper/322:42:283
3697892112,6sleep30-21swapper/322:37:073
3597712113,5sleep30-21swapper/322:25:473
3448542112,6sleep30-21swapper/322:12:353
3297672112,6sleep30-21swapper/321:57:103
3040352112,5sleep30-21swapper/321:29:183
2950922112,5sleep30-21swapper/321:24:003
2800292112,6sleep30-21swapper/321:06:353
2703242112,6sleep30-21swapper/320:58:563
2505222112,5sleep30-21swapper/320:38:423
2302612112,6sleep30-21swapper/320:15:153
2152932112,6sleep30-21swapper/320:01:063
2103252112,6sleep30-21swapper/319:56:143
2045342112,6sleep30-21swapper/319:49:153
4784972102,5sleep30-21swapper/300:25:323
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional