You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-07 - 09:26

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Tue Jul 07, 2026 00:44:16)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16920542780,3chrt75-21kworker/3:1-events21:15:113
16920542780,3chrt75-21kworker/3:1-events21:15:113
16427242650,4sleep00-21swapper/020:25:150
1569710996559,5cyclictest1676118-21kworker/u8:1+flush-8:021:30:221
1569714995736,18cyclictest1704890-21systemd-journal00:32:312
16897442560,2sleep3471rcuc/321:10:163
16897442560,2sleep3471rcuc/321:10:163
1569708995645,8cyclictest1607111-21/usr/sbin/munin19:50:230
1569708995449,4cyclictest1586277-21kworker/u8:2+flush-8:020:05:240
1569710995347,5cyclictest1687121-21kworker/u8:3+flush-8:021:55:231
1569708995147,3cyclictest1687121-21kworker/u8:3+events_unbound21:15:250
1569708995147,3cyclictest1687121-21kworker/u8:3+events_unbound21:15:240
1569708995146,3cyclictest1549070-21kworker/u8:0+flush-8:020:35:200
1569708995145,4cyclictest770089-21kworker/u8:4+flush-8:019:25:120
1569710995042,6cyclictest1825709-21latency_hist23:30:001
1569708995046,3cyclictest1720970-21kworker/u8:2+events_unbound22:55:210
1569714994941,6cyclictest1704890-21systemd-journal22:10:002
1569710994943,4cyclictest1704890-21systemd-journal23:10:201
1569708994944,4cyclictest1586277-21kworker/u8:2+flush-8:019:55:110
1569708994938,9cyclictest1573663-21ntpq19:10:140
1569708994843,3cyclictest1735841-21kworker/u8:1+flush-8:022:00:270
1569710994641,4cyclictest1549070-21kworker/u8:0+flush-8:021:35:141
1569710994640,4cyclictest1549070-21kworker/u8:0+flush-8:022:00:131
1569708994639,5cyclictest1549070-21kworker/u8:0+flush-8:022:15:200
1569710994533,9cyclictest1704890-21systemd-journal22:36:241
1569708994536,7cyclictest1700607-21ntpq21:20:190
1569708994535,8cyclictest1702073-21diskstats21:25:110
18656892440,0chrt201rcuc/000:10:010
1569714994436,6cyclictest1704890-21systemd-journal23:30:312
1569714994434,8cyclictest1704890-21systemd-journal20:33:202
1569710994435,6cyclictest1704890-21systemd-journal20:30:011
1569708994440,3cyclictest1776055-21kworker/u8:0+events_unbound22:50:190
1569710994339,3cyclictest1586277-21kworker/u8:2+flush-8:019:50:211
1569710994338,4cyclictest1631882-21kworker/u8:3+flush-8:020:15:231
1569708994338,4cyclictest1676118-21kworker/u8:1+flush-8:021:00:130
1569708994338,4cyclictest1676118-21kworker/u8:1+flush-8:021:00:120
1569714994226,3cyclictest1715966-21unixbench_singl21:35:292
1569708994238,3cyclictest1835307-21kworker/u8:3+flush-8:000:05:010
1569710994137,3cyclictest1562182-21kworker/u8:1+flush-8:019:30:241
1569710994133,6cyclictest1704890-21systemd-journal23:45:001
1569708994136,4cyclictest1855813-21kworker/u8:5+flush-8:000:30:240
1569708994136,3cyclictest1631882-21kworker/u8:3+flush-8:020:20:250
1569708994135,4cyclictest1770569-21kworker/u8:1+events_unbound22:40:240
1569708994131,7cyclictest1690674-21ntpq21:10:200
1569708994131,7cyclictest1690674-21ntpq21:10:200
1569714994034,4cyclictest1621836-21gpgv20:05:012
1569710994035,4cyclictest1549070-21kworker/u8:0+flush-8:021:10:171
1569710994035,4cyclictest1549070-21kworker/u8:0+flush-8:021:10:171
1569708994035,4cyclictest1562182-21kworker/u8:1+flush-8:019:30:260
1569708994035,4cyclictest1549070-21kworker/u8:0+flush-8:021:45:250
1569708994034,5cyclictest1631882-21kworker/u8:3+flush-8:020:50:200
1569708994034,4cyclictest1562182-21kworker/u8:1+events_unbound19:45:110
1569708994031,7cyclictest1894414-21ntpq00:35:220
1569710993934,4cyclictest1855813-21kworker/u8:5+events_unbound00:00:231
1569710993933,4cyclictest1631882-21kworker/u8:3+events_unbound20:45:221
1569710993931,5cyclictest1704890-21systemd-journal23:06:211
1569708993935,3cyclictest1562182-21kworker/u8:1+flush-8:019:20:110
17582572380,5sleep3451irq_work/322:20:163
1569710993833,4cyclictest1676118-21kworker/u8:1+events_unbound21:20:211
1569710993831,5cyclictest1735841-21kworker/u8:1+flush-8:022:10:211
1569710993826,9cyclictest1704890-21systemd-journal19:14:451
1569708993833,4cyclictest1825185-21kworker/u8:0+flush-8:023:35:260
1569708993833,4cyclictest1549070-21kworker/u8:0+flush-8:020:45:300
1569708993828,8cyclictest1686389-21latency_hist21:10:000
1569708993828,7cyclictest1704890-21systemd-journal00:00:000
156970899380,36cyclictest1-21systemd22:25:240
156970899380,36cyclictest1-21systemd20:35:010
1569710993728,7cyclictest1671800-21apt-get20:55:071
1569708993732,4cyclictest1562182-21kworker/u8:1+events_unbound20:10:240
1569708993730,5cyclictest1676118-21kworker/u8:1+flush-8:021:40:290
1569710993632,3cyclictest1549070-21kworker/u8:0+flush-8:020:30:131
1569710993630,5cyclictest1687121-21kworker/u8:3+events_unbound21:50:101
1569710993627,7cyclictest1770851-21latency_hist22:35:011
1569708993632,3cyclictest1631882-21kworker/u8:3+flush-8:020:55:240
1569708993631,3cyclictest1562182-21kworker/u8:1+flush-8:020:00:300
15693552364,9sleep10-21swapper/119:07:361
1569710993528,6cyclictest1810453-21kworker/u8:2+flush-8:023:20:211
1569710993528,6cyclictest1810453-21kworker/u8:2+flush-8:023:20:201
1569710993528,5cyclictest1894373-21ntpq00:35:201
1569708993530,4cyclictest1816019-21kworker/u8:3+flush-8:023:25:280
1569708993530,3cyclictest1676118-21kworker/u8:1+flush-8:021:30:260
1569708993529,4cyclictest1562182-21kworker/u8:1+events_unbound19:40:220
1569708993526,6cyclictest1875440-21latency_hist00:20:010
1569710993428,5cyclictest770089-21kworker/u8:4+flush-8:019:25:211
1569710993428,4cyclictest1776055-21kworker/u8:0+events_unbound22:40:091
1569710993427,5cyclictest1875713-21apt-get00:20:071
1569710993421,9cyclictest1704890-21systemd-journal20:06:001
1569708993430,3cyclictest1810453-21kworker/u8:2+events_unbound23:20:270
1569708993430,3cyclictest1810453-21kworker/u8:2+events_unbound23:20:260
1569708993425,6cyclictest1775809-21latency_hist22:40:000
1569710993328,4cyclictest1586277-21kworker/u8:2+flush-8:019:55:241
1569710993328,3cyclictest1770569-21kworker/u8:1+flush-8:022:45:221
1569714993222,7cyclictest1704890-21systemd-journal20:55:002
1569710993227,4cyclictest1835307-21kworker/u8:3+events_unbound00:25:091
1569710993225,5cyclictest1741410-21apt-get22:05:061
1569708993228,3cyclictest1825185-21kworker/u8:0+flush-8:023:30:150
1569708993228,3cyclictest1735841-21kworker/u8:1+flush-8:022:05:260
1569714993126,3cyclictest1691922-21aten2_r5power_e21:15:102
1569714993126,3cyclictest1691922-21aten2_r5power_e21:15:092
1569710993127,3cyclictest1835307-21kworker/u8:3+flush-8:023:45:271
1569710993127,3cyclictest1562182-21kworker/u8:1+events_unbound20:00:161
1569710993127,3cyclictest1549070-21kworker/u8:0+flush-8:021:45:231
1569710993127,2cyclictest1886346-21irqrtprio00:30:141
1569710993126,4cyclictest1810453-21kworker/u8:2+events_unbound23:15:221
1569710993124,6cyclictest1562182-21kworker/u8:1+events_unbound20:10:201
1569710993124,5cyclictest1834733-21ntpq23:35:211
1569710993124,5cyclictest1720970-21kworker/u8:2+flush-8:023:00:261
1569710993123,5cyclictest1704890-21systemd-journal21:42:211
1569710993121,7cyclictest1704890-21systemd-journal21:01:211
1569710993121,7cyclictest1704890-21systemd-journal21:01:211
1569708993126,4cyclictest1800362-21kworker/u8:1+events_unbound23:05:010
1569708993126,4cyclictest1676118-21kworker/u8:1+flush-8:021:35:260
1569708993126,3cyclictest1810453-21kworker/u8:2+flush-8:023:15:260
1569708993124,5cyclictest1704890-21systemd-journal20:17:050
1569710993027,2cyclictest1855813-21kworker/u8:5+events_unbound00:10:241
1569710993026,3cyclictest1750661-21kworker/u8:3+events_unbound22:25:221
1569710993026,3cyclictest1687121-21kworker/u8:3+events_unbound21:15:211
1569710993026,3cyclictest1687121-21kworker/u8:3+events_unbound21:15:211
1569710993026,3cyclictest1631882-21kworker/u8:3+events_unbound20:50:291
1569710993026,3cyclictest1549070-21kworker/u8:0+events_unbound20:40:091
1569710993021,6cyclictest1582128-21latency_hist19:25:021
1569708993023,5cyclictest1549070-21kworker/u8:0+flush-8:022:30:210
156970899302,27cyclictest1820786-21kworker/0:1+events23:40:160
1569708993022,6cyclictest1562182-21kworker/u8:1+flush-8:019:35:110
1569710992925,3cyclictest1855541-21cp00:00:001
1569710992925,3cyclictest1676118-21kworker/u8:1+flush-8:021:25:131
1569710992924,4cyclictest1855813-21kworker/u8:5+flush-8:000:15:211
1569710992924,4cyclictest1562182-21kworker/u8:1+flush-8:019:45:201
1569710992923,5cyclictest1549070-21kworker/u8:0+flush-8:022:15:091
1569710992921,6cyclictest1704890-21systemd-journal19:45:011
1569708992925,3cyclictest1800362-21kworker/u8:1+events_unbound23:10:280
1569708992924,4cyclictest1800362-21kworker/u8:1+flush-8:023:50:260
1569708992924,4cyclictest1750661-21kworker/u8:3+flush-8:022:20:250
1569708992924,3cyclictest1770569-21kworker/u8:1+flush-8:022:45:270
1569708992923,4cyclictest1835307-21kworker/u8:3+events_unbound00:25:010
1569710992824,2cyclictest1592964-21irqrtprio19:35:141
1569710992821,5cyclictest1830702-21latency_hist23:35:021
1569708992820,6cyclictest1835307-21kworker/u8:3+flush-8:000:25:050
1569714992723,3cyclictest1656246-21unixbench_singl20:35:272
1569714992723,2cyclictest1811125-21aten2_r5power_e23:15:082
1569714992717,8cyclictest1704890-21systemd-journal22:31:282
1569710992723,3cyclictest1549070-21kworker/u8:0+flush-8:020:37:321
1569710992723,2cyclictest1795973-21awk22:59:591
1569710992721,5cyclictest1676118-21kworker/u8:1+events_unbound21:05:111
1569708992724,2cyclictest1569703-21cyclictest00:10:190
1569708992723,3cyclictest1800362-21kworker/u8:1+events_unbound23:05:120
1569708992720,5cyclictest1750581-21unixbench_multi22:10:260
1569708992720,5cyclictest1661820-21grep20:45:010
1569714992622,2cyclictest1622481-21fschecks_count20:05:102
1569714992620,4cyclictest1825263-21unixbench_multi23:25:272
1569714992616,8cyclictest1704890-21systemd-journal19:45:582
1569714992615,9cyclictest1704890-21systemd-journal19:44:582
1569710992621,4cyclictest1800362-21kworker/u8:1+events_unbound23:50:221
1569710992620,5cyclictest1860894-21aten2_r5power_c00:05:081
156970899261,23cyclictest1577214-21munin-run19:20:010
1569714992521,3cyclictest1562182-21kworker/u8:1+flush-8:020:15:212
1569714992520,3cyclictest1860146-21unixbench_multi00:00:272
1569714992519,4cyclictest1855521-21savelog00:00:012
1569714992519,4cyclictest1646330-21unixbench_singl20:25:272
1569714992516,7cyclictest1704890-21systemd-journal20:40:202
1569714992511,2cyclictest17518062cut22:15:122
1569710992517,6cyclictest1760527-21unixbench_multi22:20:261
1569710992517,6cyclictest1637180-21aten2_r5power_e20:20:081
1569714992421,2cyclictest1790587-21unixbench_singl22:50:272
1569714992419,3cyclictest1607248-21aten2_r5power_v19:50:062
156970899248,15cyclictest1820786-21kworker/0:1+events23:45:230
15694212243,3sleep00-21swapper/019:08:270
1569714992317,4cyclictest1781986-21kthreadcore22:45:152
18519542220,2sleep3471rcuc/323:55:163
156971499222,14cyclictest1627171-21apt-get20:10:072
1569714992219,2cyclictest0-21swapper/221:10:002
1569714992218,3cyclictest1816338-21fschecks_count23:20:122
1569714992218,3cyclictest1816338-21fschecks_count23:20:122
1569714992218,2cyclictest1761267-21aten2_r5power_c22:25:072
1569714992218,2cyclictest1582465-21aten2_r5power_p19:25:112
1569714992218,2cyclictest0-21swapper/200:40:002
1569710992218,3cyclictest1786347-21aten2_r5power_p22:50:091
1569708992218,3cyclictest1687121-21kworker/u8:3+events_unbound21:55:240
1569714992117,2cyclictest0-21swapper/219:35:012
1569708992116,3cyclictest0-21swapper/021:50:100
156971499209,8cyclictest1687116-21df21:10:102
156971499209,8cyclictest1687116-21df21:10:092
156971499208,8cyclictest1796248-21apt-get23:00:112
1569714992017,2cyclictest1671884-21aten2_r5power_p20:55:092
1569714992016,3cyclictest0-21swapper/222:00:012
1569714992016,2cyclictest1870813-21aten2_r5power_e00:15:082
1569710992015,3cyclictest0-21swapper/119:15:041
1569714991915,2cyclictest0-21swapper/221:20:252
1569714991913,4cyclictest0-21swapper/222:40:152
1569714991912,5cyclictest1868002-21kthreadcore00:10:172
15692662194,11sleep20-21swapper/219:06:282
1569714991815,2cyclictest1677019-21fschecks_count21:00:122
1569714991815,2cyclictest1677019-21fschecks_count21:00:112
1569714991814,2cyclictest0-21swapper/221:40:222
1569714991814,2cyclictest0-21swapper/219:35:072
1569714991814,2cyclictest0-21swapper/200:25:082
156971499181,2cyclictest17393912kthreadcore22:00:192
15691852183,9sleep30-21swapper/319:05:243
18055192172,2sleep20-21swapper/223:05:312
156971499172,10cyclictest1661886-21apt-get20:45:082
1569714991713,2cyclictest0-21swapper/223:35:252
1569714991713,2cyclictest0-21swapper/222:20:182
1569714991713,2cyclictest0-21swapper/219:20:222
1569714991712,3cyclictest15771552sleep219:20:002
1569714991712,3cyclictest0-21swapper/222:10:142
1569714991712,3cyclictest0-21swapper/219:10:122
1569714991711,4cyclictest1840217-21unixbench_singl23:40:262
1569714991711,4cyclictest0-21swapper/223:50:162
1569714991711,4cyclictest0-21swapper/223:10:152
1569714991711,4cyclictest0-21swapper/220:20:162
156971499167,7cyclictest1861759-21cut00:05:142
156971499167,7cyclictest1723921-21tr21:45:172
156971499167,6cyclictest1614939-21tr19:55:172
1569714991613,2cyclictest0-21swapper/221:29:432
1569714991612,2cyclictest0-21swapper/223:45:172
1569714991611,3cyclictest0-21swapper/222:55:132
1569714991611,3cyclictest0-21swapper/222:35:192
1569714991611,3cyclictest0-21swapper/200:20:172
156971499161,11cyclictest1726563-21apt-get21:50:072
156971499152,2cyclictest0-21swapper/221:30:252
15737682142,8sleep30-21swapper/319:10:193
18307012132,6sleep30-21swapper/323:35:023
17461332132,6sleep30-21swapper/322:10:013
16217122132,7sleep30-21swapper/320:05:013
18903462122,5sleep30-21swapper/300:35:013
18856002122,6sleep30-21swapper/300:30:083
18760842122,6sleep30-21swapper/300:20:123
18661772122,6sleep30-21swapper/300:10:143
18655312122,5sleep30-21swapper/300:10:003
18556062122,6sleep30-21swapper/300:00:013
18263572122,6sleep30-21swapper/323:30:153
18239372123,6sleep30-21swapper/323:25:193
18173122122,6sleep30-21swapper/323:20:173
18173122122,6sleep30-21swapper/323:20:163
18151322121,7sleep30-21swapper/323:15:263
18059022122,5sleep30-21swapper/323:10:023
18022642122,6sleep30-21swapper/323:05:163
17967312122,6sleep30-21swapper/323:00:173
17808222122,5sleep30-21swapper/322:45:003
17798622122,6sleep30-21swapper/322:40:193
17709532122,6sleep30-21swapper/322:35:023
17661462122,6sleep30-21swapper/322:30:083
17614842122,6sleep30-21swapper/322:25:103
17364242122,6sleep30-21swapper/322:00:033
17240652122,6sleep30-21swapper/321:45:183
17166352120,8sleep30-21swapper/321:40:113
17114432122,5sleep30-21swapper/321:35:013
17104822122,6sleep30-21swapper/321:30:213
16859372122,6sleep30-21swapper/321:05:333
16814402122,6sleep30-21swapper/321:05:003
16814402122,6sleep30-21swapper/321:04:593
16755282122,6sleep30-21swapper/320:55:213
16617092122,5sleep30-21swapper/320:45:013
16519022122,6sleep30-21swapper/320:35:073
16368822122,5sleep30-21swapper/320:20:023
16321222122,6sleep30-21swapper/320:15:083
16304512122,6sleep30-21swapper/320:10:173
16232752122,6sleep30-21swapper/320:05:173
16125392122,6sleep30-21swapper/319:55:123
16076192122,6sleep30-21swapper/319:50:123
16026772122,6sleep30-21swapper/319:45:143
15967062122,6sleep30-21swapper/319:37:023
15776842122,6sleep30-21swapper/319:20:093
18805872112,5sleep30-21swapper/300:25:023
18743092112,5sleep30-21swapper/300:15:193
18503822112,6sleep30-21swapper/323:53:203
18408972112,5sleep30-21swapper/323:45:083
18397852112,5sleep30-21swapper/323:40:243
17912472112,5sleep30-21swapper/322:55:093
17865002112,5sleep30-21swapper/322:50:113
17540862112,5sleep30-21swapper/322:15:163
17457262112,5sleep30-21swapper/322:05:283
17315022112,5sleep30-21swapper/321:55:083
17268102112,5sleep30-21swapper/321:50:113
17055682112,5sleep30-21swapper/321:25:233
16999492112,5sleep30-21swapper/321:20:163
16669562112,5sleep30-21swapper/320:50:123
16612852112,6sleep30-21swapper/320:40:443
16512052112,5sleep30-21swapper/320:30:293
16425322112,5sleep30-21swapper/320:25:143
15972282112,5sleep30-21swapper/319:40:073
15911512112,5sleep30-21swapper/319:30:253
15824232112,5sleep30-21swapper/319:25:123
15768422112,6sleep30-21swapper/319:16:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional