You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-27 - 22:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Mon Apr 27, 2026 12:44:15)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
158572121910,3sleep375-21kworker/3:1+events07:11:223
18827442810,2chrt0-21swapper/312:11:103
1581524997267,3cyclictest1702885-21kworker/u8:2+events_unbound09:46:221
1581524996962,5cyclictest1657659-21kworker/u8:3+events_unbound08:36:171
1581524996862,4cyclictest1657659-21kworker/u8:3+events_unbound10:06:221
1581524996458,5cyclictest1561983-21kworker/u8:2+events_unbound08:31:211
1581524996457,5cyclictest1722207-21kworker/u8:0+events_unbound10:56:211
1581524996457,5cyclictest1722207-21kworker/u8:0+events_unbound10:56:211
1581524996359,3cyclictest1702885-21kworker/u8:2+events_unbound09:31:211
1581524996358,4cyclictest1822014-21kworker/u8:1+events_unbound11:36:241
1581524996056,3cyclictest1561983-21kworker/u8:2+events_unbound08:01:241
1581524996054,5cyclictest1581387-21kworker/u8:3+flush-8:007:11:231
1581524996054,5cyclictest1561983-21kworker/u8:2+flush-8:007:41:221
18832332590,1sleep01883237-21grep12:11:110
1581524995955,3cyclictest1561983-21kworker/u8:2+events_unbound07:26:151
1581524995854,3cyclictest1772696-21kworker/u8:3+events_unbound10:21:211
1581524995853,4cyclictest1782614-21kworker/u8:2+events_unbound12:31:191
1581524995852,5cyclictest1598272-21kworker/u8:1+events_unbound09:06:201
1581524995852,4cyclictest1561983-21kworker/u8:2+events_unbound08:06:171
1581521995747,8cyclictest1905629-21ntpq12:31:140
1581524995652,3cyclictest1657659-21kworker/u8:3+events_unbound09:51:201
1581524995651,4cyclictest1561983-21kworker/u8:2+events_unbound08:21:181
1581524995650,4cyclictest1871154-21kworker/u8:0+events_unbound12:06:161
1581524995650,4cyclictest1782614-21kworker/u8:2+events_unbound11:21:061
18432552550,3chrt0-21swapper/211:31:122
1581524995551,3cyclictest1747251-21kworker/u8:1+events_unbound10:31:221
1581524995550,4cyclictest1603496-21kworker/u8:3+events_unbound07:46:101
1581521995545,7cyclictest1732405-21latency_hist09:40:010
1581524995449,4cyclictest1702885-21kworker/u8:2+flush-8:009:16:181
1581524995448,4cyclictest1747251-21kworker/u8:1+events_unbound10:01:211
16172082530,2chrt471rcuc/307:41:163
1581526995244,6cyclictest280-21systemd-journal08:40:002
1581524995145,4cyclictest1657659-21kworker/u8:3+events_unbound08:56:101
1581524995145,4cyclictest1598272-21kworker/u8:1+flush-8:008:16:181
1581521995143,6cyclictest1702513-21base6409:10:010
1581524995046,3cyclictest1722207-21kworker/u8:0+flush-8:011:31:231
1581524995045,3cyclictest1822014-21kworker/u8:1+events_unbound12:16:201
1581524995044,5cyclictest1657659-21kworker/u8:3+flush-8:009:11:201
1581521995040,7cyclictest1821996-21latency_hist11:10:010
1581524994945,3cyclictest1747251-21kworker/u8:1+flush-8:010:46:081
1581524994945,3cyclictest1722207-21kworker/u8:0+flush-8:010:11:241
1581524994944,3cyclictest1657659-21kworker/u8:3+events_unbound09:56:201
1581524994943,4cyclictest1772696-21kworker/u8:3+events_unbound10:26:061
1581524994943,4cyclictest1598272-21kworker/u8:1+events_unbound07:31:261
1581524994844,3cyclictest1747251-21kworker/u8:1+events_unbound10:41:061
1581524994843,4cyclictest1657659-21kworker/u8:3+flush-8:009:01:181
1581524994842,5cyclictest1702885-21kworker/u8:2+flush-8:009:36:181
1581524994842,4cyclictest1782614-21kworker/u8:2+events_unbound12:21:171
1581524994640,4cyclictest1846687-21kworker/u8:3+flush-8:011:41:251
1581524994640,4cyclictest1782614-21kworker/u8:2+events_unbound12:11:221
1581524994639,5cyclictest1822014-21kworker/u8:1+flush-8:012:36:171
1581524994639,5cyclictest1822014-21kworker/u8:1+flush-8:011:51:221
1581521994641,3cyclictest1544842-21kworker/u8:0+flush-8:007:16:080
1581521994639,5cyclictest1561983-21kworker/u8:2+flush-8:008:01:210
1581521994636,8cyclictest1752712-21/usr/sbin/munin10:01:140
1581524994539,4cyclictest1822014-21kworker/u8:1+events_unbound11:56:181
1581524994539,4cyclictest1603496-21kworker/u8:3+flush-8:007:56:221
1581524994538,5cyclictest1822014-21kworker/u8:1+events_unbound11:46:061
1581521994540,3cyclictest1722207-21kworker/u8:0+flush-8:010:51:230
1581521994540,3cyclictest1722207-21kworker/u8:0+flush-8:010:51:220
1581521994537,5cyclictest1801307-21ntpq10:46:180
1581524994439,4cyclictest1747251-21kworker/u8:1+events_unbound10:36:191
1581524994439,3cyclictest1762273-21kworker/u8:2+events_unbound10:16:061
1581524994438,4cyclictest1603496-21kworker/u8:3+events_unbound07:36:221
1581524994437,5cyclictest1822014-21kworker/u8:1+flush-8:012:26:171
1581521994435,6cyclictest1876382-21latency_hist12:05:010
1581526994337,4cyclictest1881314-21apt-get12:10:002
1581524994338,4cyclictest1544842-21kworker/u8:0+flush-8:007:21:251
1581524994338,3cyclictest1782614-21kworker/u8:2+events_unbound11:16:161
1581524994337,5cyclictest1657659-21kworker/u8:3+flush-8:008:46:181
1581524994337,4cyclictest1561983-21kworker/u8:2+flush-8:008:26:201
1581524994336,5cyclictest1657659-21kworker/u8:3+flush-8:009:41:191
1581524994336,5cyclictest1657659-21kworker/u8:3+flush-8:009:26:171
1581524994336,5cyclictest1581363-21latency_hist07:10:011
1581524994335,5cyclictest280-21systemd-journal11:01:371
1581521994334,7cyclictest1832187-21/usr/sbin/munin11:21:140
1581524994238,3cyclictest1561983-21kworker/u8:2+events_unbound08:11:151
1581524994237,4cyclictest1561983-21kworker/u8:2+events_unbound07:51:151
1581524994237,3cyclictest1722207-21kworker/u8:0+events_unbound10:51:181
1581524994237,3cyclictest1722207-21kworker/u8:0+events_unbound10:51:181
1581524994137,3cyclictest1822014-21kworker/u8:1+flush-8:012:01:181
1581521994137,3cyclictest1561983-21kworker/u8:2+flush-8:008:06:200
1581521994130,9cyclictest1628627-21diskstats07:56:060
1581521994129,9cyclictest1822572-21diskstats11:11:070
1581524994035,3cyclictest1598272-21kworker/u8:1+events_unbound08:41:111
1581524994035,3cyclictest1598272-21kworker/u8:1+events_unbound08:41:111
1581521994035,4cyclictest1782614-21kworker/u8:2+events_unbound11:26:220
1581521994034,5cyclictest1657659-21kworker/u8:3+flush-8:008:51:080
1581521993936,2cyclictest1747251-21kworker/u8:1+flush-8:010:41:170
1581521993934,3cyclictest1667809-21kworker/u8:0+flush-8:009:01:240
1581521993933,4cyclictest1561983-21kworker/u8:2+events_unbound07:26:100
1581521993930,7cyclictest1741413-21ntpq09:46:170
1581524993834,3cyclictest1782614-21kworker/u8:2+events_unbound11:11:121
1581524993833,4cyclictest1657659-21kworker/u8:3+flush-8:009:21:251
1581524993831,5cyclictest1782614-21kworker/u8:2+flush-8:011:26:181
1581521993833,3cyclictest1822014-21kworker/u8:1+flush-8:012:26:130
1581521993832,4cyclictest280-21systemd-journal11:00:000
1581521993832,4cyclictest280-21systemd-journal11:00:000
1581521993832,4cyclictest1608185-21latency_hist07:35:010
1581521993832,4cyclictest1598272-21kworker/u8:1+events_unbound08:41:190
1581521993832,4cyclictest1598272-21kworker/u8:1+events_unbound08:41:180
1581521993829,7cyclictest1896423-21apt-get12:25:010
1581521993735,1cyclictest1657659-21kworker/u8:3+flush-8:008:36:080
1581521993733,3cyclictest1561983-21kworker/u8:2+flush-8:008:31:080
1581521993732,4cyclictest1657659-21kworker/u8:3+flush-8:009:56:220
1581521993627,6cyclictest1846668-21latency_hist11:35:010
1581521993531,3cyclictest1657659-21kworker/u8:3+flush-8:009:11:240
1581521993531,3cyclictest1657659-21kworker/u8:3+flush-8:008:46:230
1581521993530,3cyclictest1702885-21kworker/u8:2+events_unbound09:16:240
1581521993429,3cyclictest1544842-21kworker/u8:0+events_unbound07:21:230
1581526993327,4cyclictest1896423-21apt-get12:25:002
1581524993330,2cyclictest1797801-21kworker/u8:3+events_unbound11:06:271
1581524993327,3cyclictest1657659-21kworker/u8:3+flush-8:008:51:251
1581521993328,4cyclictest1747251-21kworker/u8:1+flush-8:010:28:080
1581521993328,3cyclictest1747251-21kworker/u8:1+events_unbound10:36:060
1581521993327,4cyclictest1702885-21kworker/u8:2+events_unbound09:51:070
1581526993226,4cyclictest1702703-21gpgv09:10:012
1581521993227,3cyclictest1653016-21systemd-run08:20:000
1581521993226,4cyclictest280-21systemd-journal10:09:590
1581521993225,5cyclictest1881316-21latency_hist12:10:010
1581521993225,5cyclictest1561983-21kworker/u8:2+flush-8:007:41:190
1581521993125,5cyclictest1657659-21kworker/u8:3+events_unbound09:21:170
1581521993028,1cyclictest1747251-21kworker/u8:1+events_unbound10:31:070
1581521993022,6cyclictest1861559-21latency_hist11:50:010
1581526992925,2cyclictest1628036-21cron07:55:002
1581526992924,3cyclictest1906125-21unixbench_multi12:31:212
1581521992925,3cyclictest1657659-21kworker/u8:3+events_unbound09:26:220
1581521992924,4cyclictest1561983-21kworker/u8:2+flush-8:008:26:090
1581521992924,3cyclictest1847309-21fschecks_time11:36:090
1581521992923,5cyclictest1702885-21kworker/u8:2+flush-8:009:31:160
1581521992919,8cyclictest1907096-21diskstats12:36:070
17263762280,2sleep3481ktimers/309:31:153
1581526992824,2cyclictest1603659-21aten2_r5power_v07:31:072
1581526992823,3cyclictest1851289-21unixbench_singl11:36:242
1581526992823,3cyclictest1638507-21aten2_r5power_c08:06:052
1581526992821,5cyclictest280-21systemd-journal10:25:002
158152699281,25cyclictest1782003-21unixbench_multi10:26:232
1581521992824,3cyclictest1561983-21kworker/u8:2+flush-8:008:11:220
1581521992823,4cyclictest1603496-21kworker/u8:3+flush-8:007:36:200
1581521992822,5cyclictest1772696-21kworker/u8:3+flush-8:010:21:170
1581521992822,5cyclictest1581387-21kworker/u8:3+flush-8:007:11:280
1581521992822,4cyclictest1598272-21kworker/u8:1+flush-8:008:56:210
16065882270,2sleep3471rcuc/307:31:153
1581526992723,2cyclictest1837371-21cpuspeed_turbos11:26:072
1581526992723,2cyclictest1812744-21fschecks_count11:01:092
1581526992719,6cyclictest280-21systemd-journal08:12:372
1581524992721,4cyclictest1561983-21kworker/u8:2+events_unbound07:15:031
1581521992723,3cyclictest1561983-21kworker/u8:2+flush-8:008:21:240
1581521992723,3cyclictest1561983-21kworker/u8:2+flush-8:007:49:080
1581521992722,4cyclictest1657659-21kworker/u8:3+flush-8:009:44:080
1581521992721,5cyclictest1831860-21cron11:20:010
1581526992623,2cyclictest1822654-21fschecks_time11:11:082
1581526992622,2cyclictest1768041-21cpuspeed_turbos10:16:062
1581521992622,3cyclictest1561983-21kworker/u8:2+flush-8:007:51:210
1581521992621,4cyclictest1762273-21kworker/u8:2+events_unbound10:16:180
1581521992621,3cyclictest280-21systemd-journal12:17:140
1581521992617,7cyclictest1812454-21/usr/sbin/munin11:01:160
1581521992616,8cyclictest280-21systemd-journal12:00:010
1581526992522,2cyclictest1891099-21unixbench_singl12:16:232
1581526992522,2cyclictest1598873-21fschecks_count07:26:072
1581526992521,2cyclictest1806811-21grep10:51:242
1581526992521,2cyclictest1806811-21grep10:51:242
1581526992521,2cyclictest1692198-21unixbench_singl08:56:272
1581526992521,2cyclictest1588805-21aten2_r5power_v07:16:062
1581526992519,4cyclictest1751811-21unixbench_singl09:56:242
1581526992420,2cyclictest1807711-21tr10:56:072
1581526992420,2cyclictest1807711-21tr10:56:062
1581526992416,6cyclictest280-21systemd-journal09:23:362
1581521992420,3cyclictest1822014-21kworker/u8:1+flush-8:011:41:100
1581521992420,3cyclictest1722207-21kworker/u8:0+events_unbound10:11:230
1581526992320,2cyclictest1762199-21unixbench_singl10:06:242
1581526992320,2cyclictest1742968-21fschecks_time09:51:092
1581526992320,2cyclictest1618862-21fschecks_time07:46:082
1581526992319,2cyclictest1737904-21cpuspeed_turbos09:46:072
1581526992319,2cyclictest1593736-21aten2_r5power_p07:21:062
1581526992318,3cyclictest1831525-21unixbench_singl11:16:242
1581526992313,8cyclictest280-21systemd-journal08:49:592
1581526992218,3cyclictest280-21systemd-journal12:40:002
1581526992218,2cyclictest1788001-21fschecks_time10:36:082
158152699221,19cyclictest1677434-21grep08:41:232
158152699221,19cyclictest1677434-21grep08:41:232
158152699220,9cyclictest18832372grep12:11:112
158152699219,4cyclictest0-21swapper/207:56:042
1581526992118,2cyclictest1797649-21aten2_r5power_p10:46:072
1581526992117,2cyclictest1871804-21aten2_r5power_c12:01:052
1581526992117,2cyclictest1727434-21cron09:35:002
1581526992117,2cyclictest0-21swapper/210:05:012
1581526992117,2cyclictest0-21swapper/208:04:592
1581526992116,4cyclictest1603496-21kworker/u8:3-ext4-rsv-conversion07:40:002
158112322110,6sleep30-21swapper/307:07:053
15767362212,12sleep00-21swapper/007:05:210
1581526992017,2cyclictest1653541-21cpuspeed_turbos08:21:072
1581526992016,2cyclictest0-21swapper/209:45:002
1581521992016,3cyclictest1822014-21kworker/u8:1+events_unbound11:51:220
15804982204,10sleep20-21swapper/207:06:202
1581526991915,2cyclictest1832439-21tr11:21:062
1581526991915,2cyclictest0-21swapper/212:30:002
1581526991914,3cyclictest1652595-21unixbench_multi08:16:242
158152699189,2cyclictest0-21swapper/211:55:012
1581526991815,2cyclictest1613614-21aten2_r5power_e07:41:062
1581526991815,2cyclictest0-21swapper/210:11:142
1581526991814,2cyclictest0-21swapper/211:56:102
1581526991814,2cyclictest0-21swapper/210:41:062
1581526991814,2cyclictest0-21swapper/209:16:092
1581526991813,3cyclictest0-21swapper/209:26:132
1581526991812,4cyclictest0-21swapper/209:11:122
1581526991810,6cyclictest1859451-21tr11:46:122
1581526991714,2cyclictest1782940-21cpuspeed_turbos10:31:082
1581526991714,2cyclictest1663247-21aten2_r5power_c08:31:072
158152699170,8cyclictest18543081kthreadcore11:41:142
1581526991613,2cyclictest1581790-21aten2_r5power_c07:11:062
1581526991613,2cyclictest0-21swapper/211:07:582
1581526991611,3cyclictest0-21swapper/209:36:122
1581526991611,3cyclictest0-21swapper/209:01:152
158152699157,6cyclictest1662454-21sed08:26:242
1581526991510,3cyclictest0-21swapper/208:51:132
17024032143,7sleep30-21swapper/309:10:003
18917362135,5sleep30-21swapper/312:20:423
18610942133,7sleep30-21swapper/311:46:233
18188942132,7sleep30-21swapper/311:06:143
17980342132,7sleep30-21swapper/310:46:113
17676712132,6sleep30-21swapper/310:15:023
17423672132,6sleep30-21swapper/309:50:023
17175762132,6sleep30-21swapper/309:25:023
16925722132,6sleep30-21swapper/309:00:023
16438822132,7sleep30-21swapper/308:11:103
16182412132,6sleep30-21swapper/307:45:023
16031962132,7sleep30-21swapper/307:30:013
15933432132,6sleep30-21swapper/307:20:023
19068212122,5sleep30-21swapper/312:36:033
19060142122,6sleep30-21swapper/312:31:213
18763942122,5sleep30-21swapper/312:05:013
18720212122,6sleep30-21swapper/312:01:083
18668012122,6sleep30-21swapper/311:56:063
18625392122,6sleep30-21swapper/311:51:133
18526842122,6sleep30-21swapper/311:41:143
18475192123,6sleep30-21swapper/311:36:123
18418012122,5sleep30-21swapper/311:30:023
18324562122,6sleep30-21swapper/311:21:073
18311782122,6sleep30-21swapper/311:16:223
18043912122,6sleep30-21swapper/310:51:143
18043912122,6sleep30-21swapper/310:51:143
17930682122,6sleep30-21swapper/310:41:103
17875892122,6sleep30-21swapper/310:35:373
17777722122,6sleep30-21swapper/310:26:053
17625212122,7sleep30-21swapper/310:10:003
17570662122,6sleep30-21swapper/310:01:383
17321272122,6sleep30-21swapper/309:36:383
16924842122,6sleep30-21swapper/308:59:383
16783252122,6sleep30-21swapper/308:46:093
16733792122,6sleep30-21swapper/308:41:083
16733792122,6sleep30-21swapper/308:41:083
16681772122,6sleep30-21swapper/308:36:053
16664952122,6sleep30-21swapper/308:31:173
16530062122,5sleep30-21swapper/308:20:003
16527252122,6sleep30-21swapper/308:17:003
16388482122,6sleep30-21swapper/308:06:093
16361272122,5sleep30-21swapper/308:01:153
16243282122,6sleep30-21swapper/307:51:123
16094142122,6sleep30-21swapper/307:36:113
15889452122,6sleep30-21swapper/307:16:083
18968742112,5sleep30-21swapper/312:25:043
18872182112,5sleep30-21swapper/312:16:083
18225682111,6sleep30-21swapper/311:11:083
18164652112,5sleep30-21swapper/311:01:253
18103902112,6sleep30-21swapper/310:56:153
18103902112,6sleep30-21swapper/310:56:153
17827212112,5sleep30-21swapper/310:31:063
17730442112,5sleep30-21swapper/310:21:083
17633542112,5sleep30-21swapper/310:11:133
17475262112,5sleep30-21swapper/309:56:033
17382242112,5sleep30-21swapper/309:46:133
17327672112,5sleep30-21swapper/309:41:063
17134952112,5sleep30-21swapper/309:21:133
17125252112,6sleep30-21swapper/309:19:163
17032362112,5sleep30-21swapper/309:11:093
16834112112,5sleep30-21swapper/308:51:113
16581522112,5sleep30-21swapper/308:25:033
16287552112,5sleep30-21swapper/307:56:093
18370452102,5sleep30-21swapper/311:25:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional