You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-29 - 08:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Wed Jul 29, 2026 00:44:12)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16855082730,2chrt583-21kworker/3:2+events19:22:593
20016082530,5chrt0-21swapper/100:37:591
1672446994940,6cyclictest1838324-21latency_hist21:55:001
1672442994839,6cyclictest1672612-21base6419:10:010
1672442994741,4cyclictest1947703-21kworker/u8:3+flush-8:023:58:110
1672442994638,5cyclictest1822987-21latency_hist21:40:010
1672442994535,7cyclictest278-21systemd-journal22:30:010
1672442994438,4cyclictest1957223-21kworker/u8:1+events_unbound00:05:010
1672442994436,6cyclictest1763864-21kworker/u8:0+flush-8:021:18:080
1672446994333,7cyclictest278-21systemd-journal22:25:001
1672442994337,5cyclictest1689287-21kworker/u8:3+events_unbound20:17:590
1672442994136,4cyclictest1888310-21kworker/u8:3+events_unbound22:52:590
1672442994134,5cyclictest1763864-21kworker/u8:0+flush-8:021:53:100
1672442994035,4cyclictest1662580-21kworker/u8:2+flush-8:019:53:090
1672442994035,4cyclictest1662580-21kworker/u8:2+events_unbound20:38:070
1672446993929,7cyclictest1684306-21latency_hist19:20:001
1672442993934,3cyclictest1652333-21kworker/u8:1+events_unbound19:15:040
1672442993933,4cyclictest1833615-21kworker/u8:3+flush-8:022:23:000
1672442993932,5cyclictest1803460-21kworker/u8:1+flush-8:021:48:040
1672442993833,4cyclictest1763864-21kworker/u8:0+flush-8:022:13:080
167244299380,35cyclictest1977431-21true00:15:000
1672446993728,6cyclictest1743612-21latency_hist20:20:001
1672442993732,3cyclictest1662580-21kworker/u8:2+flush-8:019:23:000
1672446993630,4cyclictest1763864-21kworker/u8:0+flush-8:020:47:541
1672442993630,4cyclictest1947703-21kworker/u8:3+events_unbound23:48:060
1672442993630,4cyclictest1947703-21kworker/u8:3+events_unbound23:48:060
1672448993525,7cyclictest1758449-21apt20:35:002
1672448993524,8cyclictest1768617-21awk20:45:002
1672446993530,3cyclictest1778657-21latency_hist20:55:011
1672446993528,4cyclictest1652333-21kworker/u8:1+flush-8:019:27:541
1672442993530,3cyclictest1932857-21kworker/u8:2+events_unbound23:52:570
1672442993530,3cyclictest1893300-21kworker/u8:2+flush-8:022:57:580
1672446993429,3cyclictest1724076-21kworker/u8:0+flush-8:020:12:581
1672446993429,3cyclictest1724076-21kworker/u8:0+flush-8:020:12:571
1672446993428,4cyclictest1962819-21apt-get00:02:491
1672446993426,5cyclictest1907885-21latency_hist23:05:011
1672446993423,8cyclictest278-21systemd-journal23:35:171
1672442993427,5cyclictest1729244-21apt-get20:07:470
16720892344,10sleep10-21swapper/119:09:541
1672446993327,4cyclictest1933067-21apt-get23:32:481
1672446993325,5cyclictest1662580-21kworker/u8:2+flush-8:019:43:061
1672442993327,4cyclictest1763864-21kworker/u8:0+flush-8:021:13:020
1672442993325,6cyclictest1753516-21latency_hist20:30:010
1672446993227,3cyclictest1724842-21irqcore20:02:551
1672446993226,4cyclictest1797458-21needreboot21:13:001
1672446993222,7cyclictest1853173-21latency_hist22:10:011
1672442993227,4cyclictest1763864-21kworker/u8:0+flush-8:021:43:030
1672442993227,3cyclictest1662580-21kworker/u8:2+events_unbound19:37:550
1672446993125,4cyclictest1832405-21ntp_kernel_pll_21:48:021
1672446993123,6cyclictest1672845-21/usr/sbin/munin19:12:591
1672446993122,7cyclictest1922001-21ntpq23:18:031
1672442993127,3cyclictest1877997-21kworker/u8:0+events_unbound23:08:140
1672442993125,4cyclictest1883141-21kworker/u8:2+events_unbound22:45:000
1672442993124,5cyclictest1699168-21latency_hist19:35:010
1672446993025,3cyclictest1710211-21irqrtprio19:47:561
1672446993024,4cyclictest1859284-21irqrtprio22:17:561
1672446993023,5cyclictest1838790-21apt-get21:57:511
1672446993021,7cyclictest1987520-21cp00:25:001
1672442993026,3cyclictest1763864-21kworker/u8:0+flush-8:022:03:080
1672442993025,4cyclictest1803460-21kworker/u8:1+flush-8:021:23:060
1672442993025,3cyclictest1987482-21apt-key00:25:000
1672442993025,3cyclictest1943926-21kthreadcore23:42:580
1672446992920,7cyclictest1878135-21cron22:35:001
1672442992925,3cyclictest1907099-21needreboot23:03:010
1672442992925,3cyclictest1652333-21kworker/u8:1+flush-8:019:28:080
1672442992924,4cyclictest1833615-21kworker/u8:3+flush-8:022:28:090
1672442992923,4cyclictest1877997-21kworker/u8:0+events_unbound23:13:000
1672448992819,7cyclictest1827943-21turbostat.cron21:45:002
1672446992824,3cyclictest1988348-21cpuspeed_turbos00:27:521
1672446992823,3cyclictest1952475-21systemd-run23:50:001
1672446992823,3cyclictest1952475-21systemd-run23:50:001
1672446992823,3cyclictest1733710-21sh20:10:001
1672446992822,4cyclictest1955065-21kthreadcore23:53:011
1672446992822,4cyclictest1887292-21needreboot22:42:591
1672446992822,4cyclictest1788385-21cron21:05:001
1672446992822,4cyclictest1782636-21needreboot20:58:041
1672446992822,4cyclictest1768377-21unixbench_multi20:43:091
1672446992822,4cyclictest1763864-21kworker/u8:0+flush-8:021:07:521
1672446992821,5cyclictest1982379-21latency_hist00:20:011
1672446992821,4cyclictest1977407-21latency_hist00:15:011
1672446992820,5cyclictest278-21systemd-journal23:40:011
1672442992825,2cyclictest1942376-21kworker/u8:1+events_unbound23:38:260
1672442992824,3cyclictest1947703-21kworker/u8:3+flush-8:000:27:550
1672442992823,4cyclictest1843305-21kworker/u8:1+flush-8:022:07:570
1672442992822,5cyclictest1662580-21kworker/u8:2+events_unbound20:45:010
1672442992822,4cyclictest1772849-21ntp_kernel_pll_20:48:030
1672442992822,4cyclictest1763864-21kworker/u8:0+flush-8:021:58:060
1672442992821,5cyclictest1833615-21kworker/u8:3+events_unbound22:38:050
1672442992820,6cyclictest1818057-21latency_hist21:35:010
1672442992820,6cyclictest1793306-21latency_hist21:10:000
167244299281,25cyclictest1758296-21sshd20:33:170
1672448992723,2cyclictest1778258-21unixbench_multi20:53:102
1672448992721,4cyclictest1728577-21unixbench_singl20:03:082
1672448992717,7cyclictest1833134-21apt21:50:012
1672446992722,3cyclictest1758449-21apt-get20:35:001
1672446992721,4cyclictest1972259-21unixbench_multi00:08:101
1672446992721,4cyclictest1844664-21kthreadcore22:02:581
1672446992721,4cyclictest1804007-21fschecks_time21:22:561
1672446992719,6cyclictest1763604-21cron20:40:001
1672442992723,3cyclictest1662580-21kworker/u8:2+events_unbound19:48:100
1672442992723,2cyclictest1993302-21cpuspeed_turbos00:32:530
1672442992722,3cyclictest1689287-21kworker/u8:3+flush-8:021:02:590
1672442992721,4cyclictest278-21systemd-journal20:23:500
1672442992721,4cyclictest1947703-21kworker/u8:3+events_unbound00:18:030
1672442992721,4cyclictest1877997-21kworker/u8:0+flush-8:000:37:570
1672442992721,4cyclictest1662580-21kworker/u8:2+events_unbound19:58:080
1672448992623,2cyclictest1783961-21aten2_r5power_e21:02:532
1672448992621,3cyclictest1689014-21unixbench_multi19:23:112
1672448992620,4cyclictest1888773-21cpuspeed_turbos22:47:512
1672446992620,4cyclictest1703898-21unixbench_singl19:38:081
1672446992620,3cyclictest0-21swapper/122:30:011
1672442992622,3cyclictest1947703-21kworker/u8:3+events_unbound00:08:070
1672442992622,3cyclictest1763864-21kworker/u8:0+flush-8:020:58:100
1672442992622,2cyclictest1709022-21cron19:45:010
1672442992621,3cyclictest1843305-21kworker/u8:1+events_unbound22:18:080
1672442992620,4cyclictest1843305-21kworker/u8:1+events_unbound22:48:010
1672442992619,5cyclictest278-21systemd-journal20:13:490
1672442992619,5cyclictest278-21systemd-journal20:13:490
1672448992521,2cyclictest1808171-21cron21:25:002
1672446992521,3cyclictest1823698-21cpuspeed_turbos21:42:521
1672446992521,2cyclictest1883147-21systemd-run22:40:001
1672442992521,3cyclictest1768867-21kworker/u8:1+events_unbound20:52:540
1672442992518,5cyclictest1888310-21kworker/u8:3+flush-8:023:28:050
1672448992420,3cyclictest1893616-21aten2_r5power_v22:52:532
1672448992420,2cyclictest1967108-21unixbench_singl00:03:092
1672448992420,2cyclictest1798248-21sh21:15:002
1672448992420,2cyclictest0-21swapper/221:40:002
1672448992419,4cyclictest1952262-21unixbench_singl23:48:072
1672448992419,4cyclictest1952262-21unixbench_singl23:48:072
1672448992419,4cyclictest1662580-21kworker/u8:2-ext4-rsv-conversion20:00:002
1672448992418,4cyclictest1748544-21cron20:25:002
1672448992414,7cyclictest1763615-21cat20:40:002
1672446992420,2cyclictest1855788-21kthreadcore22:12:581
1672446992419,4cyclictest1662580-21kworker/u8:2+flush-8:020:28:571
1672446992419,3cyclictest1993365-21fschecks_count00:32:541
1672446992418,4cyclictest1877997-21kworker/u8:0+flush-8:023:08:011
1672446992418,4cyclictest1803029-21unixbench_singl21:18:091
1672446992417,5cyclictest1748544-21cron20:25:001
1672446992417,5cyclictest1723085-21ntpq19:58:021
1672446992414,7cyclictest278-21systemd-journal23:28:181
1672442992417,5cyclictest1918506-21grep23:17:530
1672448992319,2cyclictest0-21swapper/219:45:002
1672448992315,5cyclictest1818053-21cat21:35:012
167244699232,12cyclictest16889092timerandwakeup19:23:111
1672446992319,3cyclictest18911-21cron19:35:001
1672446992318,3cyclictest0-21swapper/123:13:031
1672446992317,4cyclictest1888310-21kworker/u8:3+flush-8:022:47:551
1672446992317,4cyclictest1812888-21unixbench_multi21:28:091
1672446992315,6cyclictest1902918-21cron23:00:001
1672442992313,7cyclictest1812443-21ntpq21:28:050
1672448992219,2cyclictest1903472-21aten2_r5power_e23:02:522
1672448992219,2cyclictest1694225-21turbostat.cron19:30:002
1672448992218,2cyclictest1848223-21cron22:04:592
1672448992217,3cyclictest1677385-21cron19:15:002
1672448992216,4cyclictest1843077-21unixbench_singl21:58:112
1672448992216,4cyclictest1783237-21unixbench_singl20:58:122
1672446992218,2cyclictest0-21swapper/122:53:021
1672446992218,2cyclictest0-21swapper/121:37:561
167244299226,15cyclictest1907907-21kworker/0:2+events23:23:040
1672442992219,1cyclictest0-21swapper/020:05:000
1672448992117,2cyclictest1992412-21unixbench_singl00:28:102
1672448992117,2cyclictest0-21swapper/200:25:002
1672448992116,3cyclictest0-21swapper/222:30:012
1672448992111,8cyclictest1854546-21cut22:12:572
1672446992116,3cyclictest0-21swapper/123:57:581
1672446992115,4cyclictest0-21swapper/123:23:081
1672446992114,5cyclictest0-21swapper/121:33:061
1672442992118,2cyclictest1888310-21kworker/u8:3+events_unbound23:33:080
16717842214,10sleep20-21swapper/219:08:102
167244899202,13cyclictest1698487-21ntpq19:33:052
167244899202,12cyclictest1792568-21ntpq21:08:012
167244899202,12cyclictest1769080-21apt-get20:47:512
1672448992017,2cyclictest1993425-21fschecks_time00:32:552
1672448992016,2cyclictest1833887-21aten2_r5power_e21:52:522
1672448992016,2cyclictest0-21swapper/200:37:562
1672446992015,3cyclictest0-21swapper/119:55:011
16675992202,3sleep00-21swapper/019:07:080
167244899198,8cyclictest1803222-21awk21:20:012
1672448991915,2cyclictest1958054-21cpuspeed_turbos23:57:542
1672448991915,2cyclictest0-21swapper/223:27:522
1672448991915,2cyclictest0-21swapper/222:32:542
167244899191,12cyclictest1977879-21apt-get00:17:502
1672448991910,2cyclictest0-21swapper/223:33:022
16674382192,8sleep30-21swapper/319:05:023
1672448991815,2cyclictest1729328-21aten2_r5power_p20:07:492
1672448991814,2cyclictest0-21swapper/222:38:022
1672448991814,2cyclictest0-21swapper/219:47:562
1672448991813,4cyclictest1947703-21kworker/u8:3+flush-8:023:53:042
1672448991813,4cyclictest1893300-21kworker/u8:2+events_unbound23:10:012
1672448991813,3cyclictest1684293-21cron19:20:002
1672448991812,4cyclictest0-21swapper/219:53:112
167244899181,12cyclictest1968009-21apt-get00:07:512
167244899178,6cyclictest1701275-21tr19:37:572
167244899177,8cyclictest1883802-21cpuspeed_turbos22:42:502
1672448991714,2cyclictest1918277-21aten2_r5power_e23:17:512
1672448991714,2cyclictest1749330-21fschecks_time20:27:522
1672448991713,2cyclictest0-21swapper/222:22:542
1672448991713,2cyclictest0-21swapper/222:07:592
167244899169,5cyclictest1913509-21grep23:12:552
167244899163,8cyclictest1941879-21ntpq23:38:052
1672448991613,2cyclictest0-21swapper/223:23:082
1672448991612,3cyclictest0-21swapper/223:43:012
1672448991612,2cyclictest0-21swapper/220:17:492
1672448991612,2cyclictest0-21swapper/220:13:042
1672448991612,2cyclictest0-21swapper/220:13:042
167244899161,11cyclictest1972945-21apt-get00:12:532
167244899161,11cyclictest1862414-21ntpq22:18:042
19245822150,2chrt583-21kworker/3:2-events23:23:003
18290932154,8sleep30-21swapper/321:47:553
17940202156,6sleep30-21swapper/321:12:533
1672448991510,3cyclictest0-21swapper/221:27:522
19778762142,8sleep30-21swapper/300:17:483
17244982140,2sleep3471rcuc/320:02:513
167244899142,1cyclictest0-21swapper/222:58:422
19717832132,7sleep30-21swapper/300:08:053
19319172132,7sleep30-21swapper/323:28:053
18246312133,6sleep30-21swapper/321:42:583
17982602132,6sleep30-21swapper/321:15:023
17877182132,7sleep30-21swapper/321:03:063
19979662122,6sleep30-21swapper/300:37:183
19935582122,6sleep30-21swapper/300:32:573
19428572122,6sleep30-21swapper/323:41:173
19380542122,6sleep30-21swapper/323:37:523
19085952122,6sleep30-21swapper/323:07:563
19032682122,6sleep30-21swapper/323:01:173
18940152122,6sleep30-21swapper/322:53:003
18894342122,6sleep30-21swapper/322:47:573
18781712122,6sleep30-21swapper/322:35:023
18495812122,6sleep30-21swapper/322:07:573
18457602122,6sleep30-21swapper/322:03:003
18378592123,6sleep30-21swapper/321:53:093
18135852122,6sleep30-21swapper/321:32:513
18123012122,7sleep30-21swapper/321:28:013
17890182122,6sleep30-21swapper/321:07:513
17778762122,6sleep30-21swapper/320:53:073
17585532122,5sleep30-21swapper/320:35:023
17530832122,6sleep30-21swapper/320:28:073
17445722122,6sleep30-21swapper/320:22:583
17390242122,6sleep30-21swapper/320:17:013
17386342121,7sleep30-21swapper/320:15:003
17386342121,7sleep30-21swapper/320:15:003
17335672122,6sleep30-21swapper/320:08:193
17189832122,5sleep30-21swapper/319:55:023
17160102122,6sleep30-21swapper/319:53:013
17139702122,7sleep30-21swapper/319:50:003
17045812122,6sleep30-21swapper/319:42:503
17040832122,5sleep30-21swapper/319:40:013
16943362122,5sleep30-21swapper/319:30:023
16938012122,6sleep30-21swapper/319:28:093
16795612122,6sleep30-21swapper/319:15:183
16745092122,7sleep30-21swapper/319:12:573
19918592112,5sleep30-21swapper/300:28:033
19826352112,5sleep30-21swapper/300:20:173
19726402112,5sleep30-21swapper/300:10:023
19671602112,6sleep30-21swapper/300:03:163
19576602112,6sleep30-21swapper/323:55:583
19526832112,6sleep30-21swapper/323:50:083
19523352112,6sleep30-21swapper/323:48:403
19523352112,6sleep30-21swapper/323:48:403
19328242112,5sleep30-21swapper/323:30:023
19177782112,5sleep30-21swapper/323:15:023
19171232112,6sleep30-21swapper/323:13:093
18983552113,5sleep30-21swapper/322:56:483
18835282112,6sleep30-21swapper/322:42:243
18734562112,6sleep30-21swapper/322:30:203
18688642112,6sleep30-21swapper/322:27:553
18634822112,6sleep30-21swapper/322:22:393
18583702112,6sleep30-21swapper/322:15:363
18580622112,6sleep30-21swapper/322:14:393
18385312112,5sleep30-21swapper/321:55:023
18035892112,6sleep30-21swapper/321:21:523
17788602112,6sleep30-21swapper/320:56:443
17690542112,5sleep30-21swapper/320:47:493
17640042112,6sleep30-21swapper/320:41:563
17544592111,6sleep30-21swapper/320:32:583
18182792102,5sleep30-21swapper/321:35:043
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional