You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-12 - 21:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System (updated Fri Dec 12, 2025 00:44:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16168092840,3chrt586-21kworker/3:2+events20:51:183
1511933996846,19cyclictest1821366-21latency_hist00:20:010
1511933996446,16cyclictest1780798-21ntpq23:36:120
1511943995852,4cyclictest1523948-21kworker/u8:1+flush-8:020:21:212
1511933995740,15cyclictest1628252-21diskstats21:06:090
1511933995634,8cyclictest1815567-21ntpq00:11:170
18111052540,2chrt451irq_work/300:06:213
1511939995448,3cyclictest1766667-21kworker/u8:3+events_unbound23:56:031
1511943995247,4cyclictest1742215-21kworker/u8:1+events_unbound23:11:222
1511939995246,4cyclictest1742215-21kworker/u8:1+flush-8:023:01:201
1511933995237,5cyclictest282-21systemd-journal19:48:150
1511933995140,9cyclictest1790713-21ntpq23:46:120
1511939995042,5cyclictest282-21systemd-journal20:44:591
1511943994843,3cyclictest1697467-21kworker/u8:2+events_unbound00:01:232
1511939994842,4cyclictest1712012-21kworker/u8:3+flush-8:022:36:211
1511939994842,4cyclictest1712012-21kworker/u8:3+flush-8:022:36:201
1511943994743,3cyclictest1712012-21kworker/u8:3+flush-8:022:46:182
1511943994740,5cyclictest1523948-21kworker/u8:1+flush-8:019:56:182
1511939994741,4cyclictest563790-21kworker/u8:3+flush-8:019:16:171
1511939994638,6cyclictest1528948-21apt-get19:25:591
1511939994637,6cyclictest1164347-21kworker/u8:0+events_unbound19:11:131
1511939994535,8cyclictest1553620-21/usr/sbin/munin19:51:111
1511933994537,6cyclictest1558284-21latency_hist19:55:010
1511939994437,5cyclictest1523948-21kworker/u8:1+flush-8:020:01:131
1511933994435,7cyclictest1524268-21diskstats19:21:050
1511943994339,3cyclictest1742215-21kworker/u8:1+events_unbound23:01:112
1511939994334,7cyclictest1755876-21ntpq23:11:141
1511943994238,3cyclictest1672520-21kworker/u8:0+flush-8:021:56:222
1511943994237,4cyclictest1523948-21kworker/u8:1+events_unbound19:21:152
1511939994237,3cyclictest1578057-21kworker/u8:3+events_unbound20:51:201
1511939994235,5cyclictest1523948-21kworker/u8:1+events_unbound20:36:231
1511939994232,8cyclictest1626584-21ntpq21:01:161
1511939994231,8cyclictest1697467-21kworker/u8:2+flush-8:000:21:141
1511939994136,4cyclictest1523948-21kworker/u8:1+flush-8:019:31:181
1511933994133,6cyclictest1516820-21latency_hist19:15:010
1511939994032,5cyclictest282-21systemd-journal23:16:041
17684672390,1sleep11768471-21tr23:26:101
1511943993935,3cyclictest1552503-21kworker/u8:0+events_unbound20:06:162
1511939993934,4cyclictest1811185-21kworker/u8:1+flush-8:000:36:231
1511939993928,8cyclictest1572221-21ntpq20:06:131
151193399397,30cyclictest1761751-21kworker/0:1+events23:20:550
15190932380,5sleep20-21swapper/219:16:022
1511939993831,5cyclictest1538796-21apt-get19:35:591
1511939993827,8cyclictest1736112-21ntpq22:51:171
1511943993731,4cyclictest1766667-21kworker/u8:3+flush-8:023:55:062
1511939993730,5cyclictest1578057-21kworker/u8:3+flush-8:020:46:061
1511939993727,7cyclictest1617870-21/usr/sbin/munin20:56:121
1511939993727,7cyclictest1578057-21kworker/u8:3+flush-8:021:31:181
1511943993627,7cyclictest1687619-21awk22:05:002
1511939993626,7cyclictest1811470-21latency_hist00:10:011
1511933993630,5cyclictest1523948-21kworker/u8:1+flush-8:019:56:040
1511933993630,4cyclictest282-21systemd-journal23:56:050
1511943993527,6cyclictest282-21systemd-journal20:16:572
1511939993529,4cyclictest1712012-21kworker/u8:3+events_unbound22:31:051
1511939993529,4cyclictest1712012-21kworker/u8:3+events_unbound22:31:051
1511939993529,4cyclictest1524018-21apt-get19:21:011
1511939993528,5cyclictest1563202-21cron20:00:001
1511939993526,7cyclictest1548708-21apt-get19:45:581
1511939993524,9cyclictest282-21systemd-journal21:30:011
1511933993531,3cyclictest1578057-21kworker/u8:3+flush-8:020:56:140
1511933993525,7cyclictest282-21systemd-journal00:40:000
1511933993524,10cyclictest1523948-21kworker/u8:1+flush-8:019:41:180
15071522354,10sleep10-21swapper/119:05:541
1511939993427,5cyclictest1697467-21kworker/u8:2+events_unbound22:56:171
1511939993425,6cyclictest1831251-21latency_hist00:30:011
1511939993423,9cyclictest282-21systemd-journal00:14:591
1511939993420,10cyclictest282-21systemd-journal19:44:571
1511933993426,6cyclictest1578057-21kworker/u8:3+flush-8:020:53:580
1511943993325,6cyclictest1657345-21awk21:35:012
1511939993328,3cyclictest1523948-21kworker/u8:1+flush-8:020:16:191
1511939993328,3cyclictest1511805-21kworker/u8:2+flush-8:021:16:211
1511939993328,3cyclictest1511805-21kworker/u8:2+flush-8:021:16:211
1511939993327,4cyclictest1766667-21kworker/u8:3+flush-8:023:51:101
1511939993327,3cyclictest1672520-21kworker/u8:0+flush-8:022:01:181
1511939993325,6cyclictest1836188-21latency_hist00:35:011
1511939993323,7cyclictest1776524-21apt-get23:35:001
1511933993311,20cyclictest1657270-21kworker/0:1+events21:46:160
1511943993228,3cyclictest563790-21kworker/u8:3+events_unbound19:35:012
1511943993226,4cyclictest1658117-21tr21:36:002
1511943993226,4cyclictest1658117-21tr21:36:002
1511933993227,4cyclictest1677686-21kworker/u8:1+events_unbound22:21:160
1511933993227,4cyclictest1511805-21kworker/u8:2+events_unbound21:30:010
1511933993225,5cyclictest1523271-21grep19:16:200
1511933993223,7cyclictest1726268-21ntpq22:41:160
1511933993223,6cyclictest1572787-21grep20:06:210
1511933993222,8cyclictest282-21systemd-journal23:10:000
1511933993220,9cyclictest282-21systemd-journal20:25:570
1511933993210,17cyclictest1568208-21kworker/0:2+events21:31:000
1511943993126,4cyclictest1786664-21kworker/u8:0+events_unbound23:50:302
1511939993125,4cyclictest1552503-21kworker/u8:0+flush-8:020:11:151
1511939993122,7cyclictest1677686-21kworker/u8:1+events_unbound22:21:031
1511939993122,6cyclictest1578057-21kworker/u8:3+flush-8:021:36:121
1511939993122,6cyclictest1578057-21kworker/u8:3+flush-8:021:36:121
1511939993118,9cyclictest282-21systemd-journal22:20:001
151193399318,17cyclictest1662558-21kworker/0:0+events22:45:590
1511933993121,8cyclictest1582137-21ntpq20:16:120
1511933993121,7cyclictest1786645-21latency_hist23:45:010
1511939993025,3cyclictest1645013-21kthreadcore21:21:111
1511939993024,4cyclictest1697467-21kworker/u8:2+events_unbound23:36:031
151193399306,23cyclictest1568208-21kworker/0:2+events21:11:200
151193399306,23cyclictest1568208-21kworker/0:2+events21:11:190
151193399302,27cyclictest1516838-21kworker/0:1+events19:31:070
151193399302,26cyclictest1662558-21kworker/0:0+events23:01:160
151193399302,26cyclictest1662558-21kworker/0:0+events22:06:110
151193399302,26cyclictest1568208-21kworker/0:2+events20:41:160
1511933993018,9cyclictest282-21systemd-journal00:21:070
151193399301,27cyclictest1662558-21kworker/0:0+events23:51:190
1511943992924,4cyclictest1578057-21kworker/u8:3+events_unbound21:50:002
1511943992924,3cyclictest1602753-21sendmail20:40:002
1511939992925,2cyclictest1665021-21kthreadcore21:41:111
1511939992921,5cyclictest282-21systemd-journal22:40:011
151193399293,21cyclictest1662558-21kworker/0:0+events00:25:230
1511933992922,5cyclictest282-21systemd-journal00:35:000
151193399292,25cyclictest1568208-21kworker/0:2+events20:46:120
1511933992920,7cyclictest1627440-21apt-get21:05:000
151193399290,27cyclictest1662558-21kworker/0:0+events23:31:080
1511943992818,8cyclictest1553936-21fschecks_count19:51:052
1511939992823,4cyclictest1578057-21kworker/u8:3+flush-8:021:47:581
1511939992823,3cyclictest1523948-21kworker/u8:1+events_unbound20:31:071
1511939992822,4cyclictest1791289-21unixbench_singl23:46:211
1511939992822,4cyclictest1786664-21kworker/u8:0+flush-8:000:01:161
1511939992822,4cyclictest1578057-21kworker/u8:3+flush-8:021:51:221
1511939992822,4cyclictest1523948-21kworker/u8:1+flush-8:020:21:061
1511939992821,5cyclictest1742215-21kworker/u8:1+flush-8:023:21:181
1511939992817,8cyclictest282-21systemd-journal22:46:031
151193399284,20cyclictest1568208-21kworker/0:2+events20:20:150
1511933992818,8cyclictest282-21systemd-journal00:05:000
151193399281,25cyclictest1662558-21kworker/0:0+events22:01:160
1511933992810,17cyclictest1662558-21kworker/0:0+events22:16:160
1511943992723,3cyclictest1712012-21kworker/u8:3+flush-8:022:26:392
1511939992720,5cyclictest1786636-21sh23:45:001
1511939992720,5cyclictest1697467-21kworker/u8:2+flush-8:023:06:121
1511939992719,6cyclictest1692861-21apt-get22:10:591
1511939992719,6cyclictest1672520-21kworker/u8:0+flush-8:022:26:091
1511939992715,9cyclictest282-21systemd-journal00:20:001
151193399278,18cyclictest1657270-21kworker/0:1+events21:41:120
151193399272,24cyclictest1516838-21kworker/0:1+events20:04:560
1511933992718,7cyclictest282-21systemd-journal19:30:010
1511933992710,16cyclictest1662558-21kworker/0:0+events21:56:240
1511939992621,3cyclictest1511805-21kworker/u8:2+flush-8:021:11:101
1511939992621,3cyclictest1511805-21kworker/u8:2+flush-8:021:11:101
151193399268,16cyclictest1662558-21kworker/0:0+events22:51:120
1511933992621,3cyclictest1543422-21cron19:40:000
1511933992620,4cyclictest1577722-21unixbench_singl20:11:210
1511933992619,5cyclictest1717250-21latency_hist22:35:010
1511933992619,5cyclictest1717250-21latency_hist22:35:010
1511943992522,2cyclictest1781340-21unixbench_singl23:36:202
1511943992522,2cyclictest1767005-21aten2_r5power_c23:26:022
1511943992520,3cyclictest1732640-21cpuspeed_turbos22:51:062
1511943992515,8cyclictest1627842-21cat21:05:002
1511939992519,4cyclictest1511805-21kworker/u8:2+flush-8:020:26:191
1511939992516,5cyclictest0-21swapper/121:06:061
151193399255,18cyclictest1662558-21kworker/0:0+events22:56:120
1511933992519,4cyclictest1761294-21grep23:16:190
1511933992519,4cyclictest1602748-21latency_hist20:40:010
1511943992419,4cyclictest1820978-21unixbench_multi00:16:232
1511943992419,4cyclictest1677686-21kworker/u8:1+events_unbound22:09:072
1511943992419,4cyclictest1511805-21kworker/u8:2+events_unbound20:55:032
1511943992418,4cyclictest1591977-21needreboot20:26:152
1511943992417,5cyclictest1597451-21unixbench_multi20:31:202
151193399248,15cyclictest1662558-21kworker/0:0+events22:36:160
151193399248,15cyclictest1662558-21kworker/0:0+events22:36:160
151193399247,15cyclictest1662558-21kworker/0:0+events23:26:160
1511943992317,4cyclictest1552984-21unixbench_singl19:46:192
1511943992317,4cyclictest1516430-21unixbench_multi19:11:292
1511943992314,7cyclictest1533186-21grep19:26:192
151194399230,6cyclictest1759394-21tr23:16:092
1511939992319,2cyclictest0-21swapper/121:56:111
1511939992318,4cyclictest1578057-21kworker/u8:3+flush-8:022:06:191
151193399239,13cyclictest1657270-21kworker/0:1+events21:36:120
151193399239,13cyclictest1657270-21kworker/0:1+events21:36:110
1511933992319,2cyclictest0-21swapper/021:21:160
1511933992318,4cyclictest829-21mta-sts-daemon22:26:040
1511933992318,3cyclictest1597990-21latency_hist20:35:010
1511933992314,7cyclictest1697436-21cron22:15:000
1511943992217,3cyclictest1511805-21kworker/u8:2+events_unbound20:11:312
1511943992217,3cyclictest0-21swapper/223:00:012
151193399224,17cyclictest1568208-21kworker/0:2+events21:16:200
151193399224,17cyclictest1568208-21kworker/0:2+events21:16:200
151193399222,19cyclictest0-21swapper/000:06:010
1511933992218,2cyclictest0-21swapper/023:11:040
1511943992116,4cyclictest1722230-21sendmail22:40:002
1511943992116,4cyclictest1722230-21sendmail22:39:592
1511943992116,3cyclictest1751507-21unixbench_singl23:06:212
1511943992116,3cyclictest1603437-21grep20:41:042
1511943992115,4cyclictest1776776-21gpgv23:35:012
1511933992116,3cyclictest1673742-21tr21:51:110
1511943992016,2cyclictest0-21swapper/221:51:042
1511943992016,2cyclictest0-21swapper/200:06:132
1511943992012,6cyclictest1647650-21latency_hist21:25:012
1511943992011,7cyclictest1725034-21tr22:41:132
1511943991915,2cyclictest1613175-21cpuspeed_turbos20:51:042
1511943991914,3cyclictest1697112-21unixbench_singl22:11:182
15116612193,11sleep00-21swapper/019:08:540
15582642186,8sleep30-21swapper/319:55:003
1511943991813,3cyclictest0-21swapper/221:41:132
15077512183,8sleep30-21swapper/319:06:073
151194399174,4cyclictest0-21swapper/221:27:172
151194399173,8cyclictest1563555-21apt-get20:00:592
151194399173,6cyclictest0-21swapper/200:12:452
151194399172,10cyclictest1611794-21ntpq20:46:172
1511943991713,3cyclictest0-21swapper/222:16:022
1511943991713,2cyclictest0-21swapper/223:46:212
1511943991712,3cyclictest0-21swapper/221:16:112
1511943991712,3cyclictest0-21swapper/221:16:112
1511943991712,3cyclictest0-21swapper/200:34:592
15071602174,9sleep20-21swapper/219:05:592
151194399162,2cyclictest17829682grep23:41:062
151194399162,2cyclictest0-21swapper/219:40:402
1511943991613,2cyclictest0-21swapper/222:23:452
1511943991613,2cyclictest0-21swapper/200:21:132
1511943991613,1cyclictest0-21swapper/200:26:112
1511943991612,2cyclictest0-21swapper/221:11:062
1511943991612,2cyclictest0-21swapper/221:11:052
1511943991612,2cyclictest0-21swapper/200:36:022
1511943991611,3cyclictest0-21swapper/222:31:122
1511943991611,3cyclictest0-21swapper/222:31:122
1511943991610,4cyclictest0-21swapper/221:06:162
1511943991511,2cyclictest0-21swapper/219:36:052
1511943991510,3cyclictest0-21swapper/223:21:042
18236482145,5sleep30-21swapper/300:21:113
18164182132,6sleep30-21swapper/300:15:013
17419182132,7sleep30-21swapper/323:00:003
17320742132,6sleep30-21swapper/322:50:023
16983622130,8sleep30-21swapper/322:16:103
16916902132,7sleep30-21swapper/322:06:193
16628202135,5sleep30-21swapper/321:40:503
16515392132,7sleep30-21swapper/321:26:183
16415522132,7sleep30-21swapper/321:16:153
16415522132,7sleep30-21swapper/321:16:143
16214902132,7sleep30-21swapper/320:56:123
16117642132,7sleep30-21swapper/320:46:163
15475692132,7sleep30-21swapper/319:41:163
15190322135,5sleep30-21swapper/319:16:003
18320752122,6sleep30-21swapper/300:31:113
18266492123,6sleep30-21swapper/300:26:053
18046992122,6sleep30-21swapper/300:01:123
17971502123,5sleep30-21swapper/323:56:073
17915892122,6sleep30-21swapper/323:50:013
17724002122,6sleep30-21swapper/323:31:073
17715612122,6sleep30-21swapper/323:29:553
17472392122,6sleep30-21swapper/323:06:033
17461772122,6sleep30-21swapper/323:01:213
17368902122,6sleep30-21swapper/322:53:513
17227192122,6sleep30-21swapper/322:41:073
17201252122,6sleep30-21swapper/322:36:133
17201252122,6sleep30-21swapper/322:36:133
17161712122,6sleep30-21swapper/322:31:153
17161712122,6sleep30-21swapper/322:31:143
17073892122,5sleep30-21swapper/322:25:013
16966862122,6sleep30-21swapper/322:11:173
16716212122,6sleep30-21swapper/321:46:133
16586182122,6sleep30-21swapper/321:36:053
16586182122,6sleep30-21swapper/321:36:053
16573232122,6sleep30-21swapper/321:35:013
16317732122,7sleep30-21swapper/321:06:203
16033352122,6sleep30-21swapper/320:41:033
15978632122,6sleep30-21swapper/320:35:013
15838662122,6sleep30-21swapper/320:21:093
15635292123,5sleep30-21swapper/320:00:583
15381612122,6sleep30-21swapper/319:31:213
15141582122,6sleep30-21swapper/319:11:103
18370412112,5sleep30-21swapper/300:36:123
18117962112,5sleep30-21swapper/300:11:043
17918282112,6sleep30-21swapper/323:50:053
17820032112,5sleep30-21swapper/323:40:583
17770512112,5sleep30-21swapper/323:36:013
17662512112,5sleep30-21swapper/323:21:243
17571352112,5sleep30-21swapper/323:16:023
17521762112,5sleep30-21swapper/323:11:043
17064102112,5sleep30-21swapper/322:21:123
16833042112,5sleep30-21swapper/322:01:063
16786742112,5sleep30-21swapper/321:56:113
16729862112,5sleep30-21swapper/321:51:023
16470612112,5sleep30-21swapper/321:21:253
16326472112,5sleep30-21swapper/321:10:013
16326472112,5sleep30-21swapper/321:10:013
16226742112,5sleep30-21swapper/321:00:023
15938672112,5sleep30-21swapper/320:31:073
15882782112,5sleep30-21swapper/320:26:023
15783362112,5sleep30-21swapper/320:15:593
15731182112,5sleep30-21swapper/320:10:013
15686562112,5sleep30-21swapper/320:06:043
15624432112,6sleep30-21swapper/319:56:163
15491502112,5sleep30-21swapper/319:46:053
15420942112,5sleep30-21swapper/319:36:103
15294652112,5sleep30-21swapper/319:26:073
15239602112,5sleep30-21swapper/319:20:373
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional