You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-18 - 14:52

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon May 18, 2026 12:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
168302221410,1sleep375-21kworker/3:1-events10:30:523
17490252970,3chrt75-21kworker/3:1-events11:25:553
16714612840,4sleep21671466-21needreboot10:16:002
17050952720,4sleep30-21swapper/310:48:593
1481936997159,8cyclictest1703301-21dpkg10:48:270
16079032640,7sleep3451irq_work/309:15:003
1481936995646,7cyclictest632272-21kworker/u8:1+flush-8:007:26:040
1481936995448,4cyclictest1665378-21kworker/u8:0+flush-8:010:16:030
1481936995445,6cyclictest1503590-21kworker/u8:0+flush-8:008:21:020
15019422530,3sleep375-21kworker/3:1+mm_percpu_wq07:25:583
1481939995245,5cyclictest1503590-21kworker/u8:0+flush-8:007:36:081
1481936994839,7cyclictest1591859-21ntpq08:55:570
17267782470,2sleep375-21kworker/3:1-events11:01:113
1481939994740,5cyclictest1702261-21apt-get10:48:031
1481939994737,8cyclictest1522506-21ntpq07:46:001
1481936994742,4cyclictest1503590-21kworker/u8:0+flush-8:009:01:030
1481936994638,6cyclictest1538220-21kworker/u8:1+flush-8:009:16:030
1481939994537,6cyclictest1503590-21kworker/u8:0+flush-8:008:06:031
1481939994535,8cyclictest1636670-21ntpq09:41:021
1481936994536,6cyclictest1513487-21latency_hist07:40:010
1481939994433,7cyclictest280-21systemd-journal09:34:341
1481936994439,3cyclictest1538220-21kworker/u8:1+flush-8:008:30:490
1481943994333,7cyclictest280-21systemd-journal09:05:012
1481939994237,4cyclictest1462407-21kworker/u8:2+flush-8:007:51:051
1481939994235,5cyclictest1762206-21latency_hist11:40:011
1481939994235,5cyclictest1704890-21systemd-journal12:26:231
1481939994234,5cyclictest280-21systemd-journal08:45:011
1481939994232,8cyclictest1586808-21ntpq08:51:041
1481936994232,8cyclictest1532366-21ntpq07:56:010
1481943994130,8cyclictest1702451-21tar10:48:102
1481939994133,5cyclictest1652389-21latency_hist10:00:001
14816572414,31sleep30-21swapper/307:09:063
17861782400,4sleep00-21swapper/012:01:030
1481943994036,3cyclictest1503590-21kworker/u8:0+flush-8:008:11:042
1481936994031,7cyclictest1602004-21ntpq09:06:010
1481939993933,4cyclictest1503875-21apt-get07:30:461
1481939993932,5cyclictest280-21systemd-journal10:21:341
1481939993931,6cyclictest1687616-21apt-get10:35:471
1481939993930,7cyclictest1618015-21apt-get09:25:461
1481939993929,7cyclictest280-21systemd-journal10:16:341
1481936993934,3cyclictest1603119-21kworker/u8:2+events_unbound09:20:520
1481936993933,5cyclictest1617102-21kworker/u8:0+events_unbound09:36:000
1481936993929,7cyclictest280-21systemd-journal10:31:000
14814812394,10sleep10-21swapper/107:06:471
16918662380,1sleep01691868-21grep10:36:080
1481939993730,5cyclictest1662823-21apt-get10:10:481
1481936993731,5cyclictest1462407-21kworker/u8:2+flush-8:007:51:080
1481936993729,6cyclictest1642474-21latency_hist09:50:010
1481936993728,7cyclictest1756646-21python311:31:050
1481936993631,4cyclictest1665378-21kworker/u8:0+flush-8:010:11:020
1481936993631,3cyclictest1617102-21kworker/u8:0+events_unbound09:26:010
1481936993629,4cyclictest1481808-21kworker/u8:3+flush-8:008:05:530
1481936993628,6cyclictest1657351-21apt-get10:05:010
1481936993628,6cyclictest1538220-21kworker/u8:1+flush-8:008:36:020
1481943993526,7cyclictest280-21systemd-journal09:42:332
1481939993528,5cyclictest1681920-21grep10:26:071
1481939993527,6cyclictest1482097-21/usr/sbin/munin07:11:011
16762052340,5sleep3451irq_work/310:20:583
1481943993425,6cyclictest280-21systemd-journal09:00:012
1481939993429,3cyclictest1602902-21systemd-run09:10:001
1481939993428,4cyclictest1797367-21apt-get12:15:481
1481939993425,6cyclictest1533271-21latency_hist08:00:011
1481936993426,5cyclictest1677364-21latency_hist10:25:010
1481936993425,5cyclictest0-21swapper/011:45:460
1481943993327,4cyclictest280-21systemd-journal09:52:342
1481939993328,3cyclictest1784506-21kthreadcore12:00:571
1481939993325,6cyclictest1561971-21ntpq08:26:011
1481936993328,4cyclictest1617102-21kworker/u8:0+events_unbound09:30:490
1481936993326,5cyclictest1617102-21kworker/u8:0+flush-8:009:41:020
16794702320,4sleep00-21swapper/010:25:570
1481943993220,9cyclictest1797265-21cp12:15:022
1481939993225,5cyclictest1627934-21apt-get09:35:461
1481939993223,6cyclictest280-21systemd-journal08:32:341
1481936993228,3cyclictest1481808-21kworker/u8:3+events_unbound07:10:510
1481936993227,4cyclictest1771763-21kworker/u8:2+flush-8:011:50:360
1481936993227,4cyclictest1771763-21kworker/u8:2+flush-8:011:50:360
1481936993227,4cyclictest1752562-21kworker/u8:1+flush-8:012:26:020
1481936993227,3cyclictest1481808-21kworker/u8:3+flush-8:007:16:090
1481936993225,5cyclictest632272-21kworker/u8:1+flush-8:007:21:020
1481936993225,5cyclictest1821741-21cron12:40:000
1481943993128,2cyclictest1489081-21aten2_r5power_e07:15:502
1481939993126,3cyclictest1494702-21irqrtprio07:20:561
1481936993127,3cyclictest1481808-21kworker/u8:3+flush-8:008:16:060
1481936993126,4cyclictest1481808-21kworker/u8:3+events_unbound08:00:520
1481936993126,3cyclictest1503590-21kworker/u8:0+flush-8:007:30:580
1481936993125,4cyclictest1603119-21kworker/u8:2+flush-8:010:00:570
1481936993123,6cyclictest1716544-21ntpq10:51:020
14775522314,18sleep00-21swapper/007:05:530
1481943993026,2cyclictest1582287-21unixbench_singl08:46:082
1481939993025,4cyclictest1771764-21kworker/u8:4+flush-8:011:56:041
1481939993025,3cyclictest1747365-21cron11:25:001
1481939993025,3cyclictest1638593-21irqrtprio09:45:551
1481939993018,9cyclictest1821756-21apt-get12:40:011
1481936993026,3cyclictest1462407-21kworker/u8:2+flush-8:007:46:050
1481936993025,3cyclictest1572810-21kworker/u8:3+flush-8:009:51:040
1481936993022,6cyclictest1732510-21cp11:10:010
14814552303,8sleep20-21swapper/207:06:282
1481943992925,2cyclictest1568371-21cpuspeed_turbos08:35:502
1481939992925,3cyclictest632272-21kworker/u8:1+flush-8:007:18:051
1481939992922,5cyclictest1603119-21kworker/u8:2+flush-8:009:11:061
1481939992920,7cyclictest1692245-21apt-get10:40:021
1481939992920,7cyclictest1593055-21/usr/sbin/munin09:01:011
1481936992925,3cyclictest1732760-21kworker/u8:0+events_unbound11:15:540
1481936992924,4cyclictest1771764-21kworker/u8:4+events_unbound11:55:580
1481936992924,3cyclictest1587202-21unixbench_multi08:51:090
1481936992923,5cyclictest1503590-21kworker/u8:0+flush-8:008:41:040
1481943992825,2cyclictest1797398-21aten2_r5power_c12:15:492
1481943992821,5cyclictest1692231-21cron10:40:012
1481939992824,2cyclictest1719917-21kthreadcore10:55:561
1481939992822,4cyclictest280-21systemd-journal08:35:451
1481939992822,4cyclictest1703363-21kworker/u8:1+flush-8:010:51:041
1481939992819,7cyclictest1771191-21ntpq11:45:581
1481936992822,4cyclictest1603119-21kworker/u8:2+events_unbound11:00:000
1481936992821,5cyclictest1771763-21kworker/u8:2+flush-8:012:11:010
1481936992821,5cyclictest1603119-21kworker/u8:2+events_unbound10:40:500
1481936992820,6cyclictest1651502-21ntpq09:56:000
16424302270,6sleep20-21swapper/209:49:352
1481943992723,3cyclictest1727759-21aten2_r5power_v11:05:502
1481943992723,2cyclictest1523051-21grep07:46:092
1481943992720,5cyclictest1704890-21systemd-journal11:23:342
148194399270,25cyclictest1513100-21unixbench_multi07:36:082
1481939992722,3cyclictest1754799-21kthreadcore11:30:541
1481939992721,4cyclictest1787290-21apt-get12:05:471
1481939992721,4cyclictest1481808-21kworker/u8:3+flush-8:008:15:541
1481939992720,6cyclictest632272-21kworker/u8:1+flush-8:007:26:071
1481939992717,2cyclictest421rcuog/210:00:561
1481936992723,3cyclictest1732760-21kworker/u8:0+flush-8:011:10:360
1481936992723,3cyclictest1538220-21kworker/u8:1+events_unbound08:28:360
1481936992721,4cyclictest1771764-21kworker/u8:4+flush-8:012:20:570
1481936992721,4cyclictest1603119-21kworker/u8:2+events_unbound11:20:510
1481936992720,5cyclictest1732760-21kworker/u8:0+events_unbound11:40:490
1481943992622,3cyclictest1722394-21cron11:00:002
1481939992622,2cyclictest1613371-21cut09:20:511
1481939992622,2cyclictest0-21swapper/111:10:551
1481936992622,3cyclictest1771764-21kworker/u8:4+events_unbound12:15:060
1481936992622,3cyclictest1607467-21unixbench_singl09:11:090
1481936992622,3cyclictest1538220-21kworker/u8:1+events_unbound08:46:060
1481936992617,6cyclictest1548075-21latency_hist08:15:010
16086242250,2sleep1281rcuc/109:15:551
1481943992520,3cyclictest1733756-21kthreadcore11:10:562
1481939992520,3cyclictest1686925-21unixbench_multi10:31:081
1481939992518,5cyclictest1812169-21/usr/sbin/munin12:30:591
1481939992517,6cyclictest280-21systemd-journal08:55:481
1481936992521,3cyclictest1603119-21kworker/u8:2+events_unbound11:25:590
1481943992421,2cyclictest1742418-21sh11:19:592
1481943992420,2cyclictest1807526-21fschecks_count12:25:542
1481943992420,2cyclictest1682720-21aten2_r5power_p10:30:492
1481943992420,2cyclictest1532870-21unixbench_multi07:56:082
1481943992419,3cyclictest1713045-21fschecks_time10:50:532
1481943992419,3cyclictest1626682-21grep09:30:582
1481943992417,5cyclictest280-21systemd-journal10:30:002
1481939992420,2cyclictest1737933-21cpuspeed11:15:491
1481939992420,2cyclictest1722905-21cpuspeed11:00:541
1481939992420,2cyclictest1643098-21cut09:50:521
1481939992419,3cyclictest1773094-21irqrtprio11:50:541
1481939992419,3cyclictest1773094-21irqrtprio11:50:541
1481939992418,4cyclictest1557594-21unixbench_singl08:21:071
1481939992415,7cyclictest1547207-21ntpq08:11:011
1481936992420,3cyclictest1732760-21kworker/u8:0+events_unbound11:36:060
1481936992420,2cyclictest1727328-21cron11:05:000
1481936992418,4cyclictest1771764-21kworker/u8:4+events_unbound12:31:010
1481936992418,4cyclictest1771764-21kworker/u8:4+events_unbound12:05:500
1481943992319,3cyclictest0-21swapper/212:40:012
1481943992319,2cyclictest1616765-21needreboot09:21:002
1481943992318,3cyclictest1761793-21unixbench_multi11:36:082
1481943992317,4cyclictest1704890-21systemd-journal12:30:322
148193999233,11cyclictest0-21swapper/108:03:091
1481939992319,2cyclictest0-21swapper/108:46:071
148194399225,3cyclictest16962832kthreadcore10:40:592
1481943992218,2cyclictest1563412-21cpuspeed_turbos08:30:512
1481943992214,6cyclictest1657604-21cat10:05:012
148193999221,8cyclictest1795929-21ntpq12:11:021
1481939992218,3cyclictest1603119-21kworker/u8:2+flush-8:010:05:051
1481939992218,2cyclictest0-21swapper/111:05:511
1481939992216,4cyclictest0-21swapper/107:40:541
1481939992214,5cyclictest1806554-21grep12:21:071
1481939992213,7cyclictest1766373-21ntpq11:41:051
1481943992118,2cyclictest1658203-21fschecks_time10:05:532
1481943992114,5cyclictest1781402-21grep11:56:062
148194399211,18cyclictest1539238-21sed08:05:542
1481936992116,4cyclictest1503590-21kworker/u8:0+events_unbound07:40:530
148194399204,13cyclictest1676712-21awk10:21:062
148194399203,15cyclictest1484402-21tr07:10:592
1481943992017,2cyclictest1514172-21fschecks_time07:40:532
1481943992016,2cyclictest1628201-21fschecks_count09:35:512
1481943992013,5cyclictest1704890-21systemd-journal11:40:342
1481939992016,2cyclictest0-21swapper/111:25:531
148194399199,8cyclictest280-21systemd-journal08:05:002
1481943991916,2cyclictest1782447-21aten2_r5power_v12:00:492
1481943991915,2cyclictest0-21swapper/211:31:062
1481943991910,2cyclictest0-21swapper/207:21:092
1481943991815,2cyclictest1598469-21cpuspeed_turbos09:05:502
1481943991814,2cyclictest1583311-21fschecks_time08:50:522
1481943991813,3cyclictest1726932-21unixbench_multi11:01:112
1481943991810,6cyclictest1650653-21tr09:55:572
18032532170,6sleep20-21swapper/212:20:552
17794862178,6sleep30-21swapper/311:55:573
16220062170,2sleep3471rcuc/309:26:053
148194399178,7cyclictest1774210-21cut11:50:562
148194399178,7cyclictest1774210-21cut11:50:552
148194399178,7cyclictest1524407-21sed07:50:552
1481943991713,3cyclictest0-21swapper/207:26:082
1481943991713,2cyclictest0-21swapper/211:45:582
1481943991713,2cyclictest0-21swapper/210:11:002
1481943991713,2cyclictest0-21swapper/208:20:532
1481943991713,2cyclictest0-21swapper/208:15:592
15143062160,2sleep3481ktimers/307:40:553
148194399169,5cyclictest1604970-21kthreadcore09:10:582
148194399168,6cyclictest1504625-21sed07:30:552
148194399162,5cyclictest0-21swapper/209:25:002
148194399162,13cyclictest0-21swapper/208:29:082
1481943991613,2cyclictest0-21swapper/209:16:072
1481943991611,3cyclictest1791020-21ntp_kernel_pll_12:06:012
1481943991610,3cyclictest0-21swapper/208:41:012
148194399160,14cyclictest1750002-21cut11:25:562
17174862133,6sleep30-21swapper/310:55:023
16544172130,2sleep3481ktimers/310:00:553
15939712134,5sleep30-21swapper/309:00:583
15886022133,6sleep30-21swapper/308:55:513
18168462122,6sleep30-21swapper/312:35:023
18160342122,6sleep30-21swapper/312:31:053
18075112123,5sleep30-21swapper/312:25:553
18042862122,6sleep30-21swapper/312:20:573
18013842122,6sleep30-21swapper/312:16:083
17919152122,6sleep30-21swapper/312:10:023
17828122120,8sleep30-21swapper/312:00:553
17716932122,6sleep30-21swapper/311:46:063
17576912122,6sleep30-21swapper/311:35:503
17571422122,6sleep30-21swapper/311:33:343
17425922122,5sleep30-21swapper/311:20:013
17368002122,6sleep30-21swapper/311:11:073
17319732122,6sleep30-21swapper/311:06:093
17135942122,6sleep30-21swapper/310:50:573
16941432122,6sleep30-21swapper/310:40:583
16881422122,6sleep30-21swapper/310:35:563
16785702123,5sleep30-21swapper/310:25:573
16632932122,6sleep30-21swapper/310:10:563
16578922122,6sleep30-21swapper/310:05:503
16424922122,5sleep30-21swapper/309:50:013
16328682122,6sleep30-21swapper/309:40:343
16236972122,6sleep30-21swapper/309:30:553
16084712122,6sleep30-21swapper/309:15:543
16028592121,7sleep30-21swapper/309:10:013
15826732122,5sleep30-21swapper/308:50:023
15582552122,6sleep30-21swapper/308:25:503
15522302122,6sleep30-21swapper/308:16:073
15431592122,5sleep30-21swapper/308:10:013
15421062122,6sleep30-21swapper/308:05:593
15282962122,6sleep30-21swapper/307:55:003
15184682122,5sleep30-21swapper/307:45:013
15086392122,6sleep30-21swapper/307:35:013
15047722122,6sleep30-21swapper/307:30:573
14985012122,6sleep30-21swapper/307:23:343
14894792122,6sleep30-21swapper/307:15:563
17875752112,5sleep30-21swapper/312:05:533
17723172112,6sleep30-21swapper/311:50:243
17723172112,6sleep30-21swapper/311:50:233
17624622112,6sleep30-21swapper/311:40:163
17376922112,6sleep30-21swapper/311:15:093
16674732112,5sleep30-21swapper/310:15:003
16482822112,5sleep30-21swapper/309:55:553
16378452112,5sleep30-21swapper/309:45:473
16283132112,5sleep30-21swapper/309:35:533
16166702112,6sleep30-21swapper/309:21:003
15787812112,5sleep30-21swapper/308:45:573
15730562114,4sleep30-21swapper/308:40:343
15680622112,5sleep30-21swapper/308:35:053
15634302112,6sleep30-21swapper/308:30:523
15536872112,5sleep30-21swapper/308:20:533
15335112112,5sleep30-21swapper/308:00:023
15295072112,5sleep30-21swapper/307:55:573
14817812112,5sleep30-21swapper/307:10:023
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional