You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-08 - 12:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack5slot4s.osadl.org (updated Tue Sep 08, 2026 00:44:13)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
19577972760,4chrt0-21swapper/023:04:250
18760252720,3chrt75-21kworker/3:1+events21:44:163
18819242550,2chrt0-21swapper/221:49:172
1722583994637,6cyclictest1778958-21latency_hist20:05:000
1722583994235,5cyclictest1973546-21kworker/u8:0+flush-8:000:00:010
1722588994137,3cyclictest1698025-21kworker/u8:4+events_unbound19:14:141
1722588994035,4cyclictest1833946-21kworker/u8:2+flush-8:021:39:281
1722588994034,5cyclictest1764083-21kworker/u8:0+events_unbound20:09:121
1722588994034,5cyclictest1764083-21kworker/u8:0+events_unbound20:09:121
1722583994034,4cyclictest1833946-21kworker/u8:2+flush-8:021:19:110
1722583994029,9cyclictest278-21systemd-journal19:55:000
20128982390,5sleep2371rcuc/200:00:002
1722583993932,5cyclictest1923480-21kworker/u8:1+flush-8:022:50:000
17179912394,10sleep10-21swapper/119:07:481
1722590993834,3cyclictest1873212-21kworker/u8:0+events_unbound21:44:302
1722583993831,5cyclictest1779500-21/usr/sbin/munin20:09:240
1722583993831,5cyclictest1779500-21/usr/sbin/munin20:09:230
1722583993828,8cyclictest278-21systemd-journal00:00:000
1722583993828,8cyclictest1726916-21ntpq19:14:200
1722583993714,16cyclictest1764083-21kworker/u8:0+flush-8:020:29:130
18918002350,1sleep10-21swapper/121:59:161
1722590993530,4cyclictest1878218-21kworker/u8:2+flush-8:022:24:202
1722588993530,3cyclictest1973546-21kworker/u8:0+flush-8:023:55:001
1722588993528,5cyclictest1973145-21cron23:20:001
1722583993529,5cyclictest1698025-21kworker/u8:4+flush-8:019:59:130
1722583993529,4cyclictest1838477-21unixbench_multi21:04:240
1722583993529,4cyclictest1838477-21unixbench_multi21:04:240
1722583993528,5cyclictest1818803-21cron20:45:000
1722583993525,8cyclictest278-21systemd-journal19:34:090
1722590993429,4cyclictest1698025-21kworker/u8:4+flush-8:020:04:262
1722590993428,4cyclictest1973546-21kworker/u8:0+flush-8:023:29:242
1722588993430,3cyclictest1803960-21kworker/u8:2+flush-8:020:34:141
1722588993429,4cyclictest1764083-21kworker/u8:0+flush-8:020:25:011
1722588993429,3cyclictest2042732-21ls00:30:001
1722588993426,6cyclictest278-21systemd-journal21:14:091
1722588993426,6cyclictest1913935-21apt-get22:24:061
1722588993425,7cyclictest2018554-21apt-get00:09:051
1722588993423,8cyclictest278-21systemd-journal20:45:011
1722583993428,4cyclictest1908019-21grep22:14:260
1722583993425,7cyclictest1912756-21ntpq22:19:220
1722583993424,8cyclictest1952564-21ntpq22:59:260
1722588993329,3cyclictest1947414-21kworker/u8:0+events_unbound22:59:301
1722588993329,2cyclictest2024102-21irqcore00:14:121
1722588993328,3cyclictest2009101-21irqrtprio23:59:181
1722588993328,3cyclictest1813823-21cron20:40:001
1722588993327,4cyclictest2013569-21/usr/sbin/munin00:04:231
1722588993322,9cyclictest278-21systemd-journal20:20:001
1722583993326,5cyclictest1854018-21apt-get21:24:060
1722590993227,4cyclictest1698025-21kworker/u8:4+flush-8:019:50:102
1722588993227,4cyclictest1973546-21kworker/u8:0+flush-8:023:39:231
1722583993228,3cyclictest1858408-21kworker/u8:1+events_unbound21:49:290
1722583993227,4cyclictest1908653-21kworker/u8:0+flush-8:022:24:080
1722583993227,3cyclictest1967506-21needreboot23:14:180
1722583993224,6cyclictest1759690-21/usr/sbin/munin19:49:210
1722583993223,7cyclictest1843578-21latency_hist21:10:010
172258399321,29cyclictest1799028-21munin-run20:25:010
172258399321,28cyclictest1844156-21sshd21:14:090
1722590993126,4cyclictest1858408-21kworker/u8:1+flush-8:021:59:132
1722588993127,3cyclictest1962954-21kworker/u8:1+events_unbound23:14:091
1722588993127,3cyclictest1833946-21kworker/u8:2+flush-8:021:29:111
1722588993125,4cyclictest1698025-21kworker/u8:4+events_unbound21:24:161
1722583993126,4cyclictest1878218-21kworker/u8:2+flush-8:022:05:000
1722583993126,3cyclictest1832982-21needreboot20:59:160
1722583993126,3cyclictest1759141-21cron19:45:000
1722583993125,4cyclictest1734208-21unixbench_multi19:19:270
1722590993025,4cyclictest1764083-21kworker/u8:0+flush-8:020:29:172
1722590993025,4cyclictest1749236-21kworker/u8:1+events_unbound19:39:142
1722590993024,5cyclictest1784391-21kworker/u8:1+flush-8:020:19:262
1722588993026,2cyclictest1948004-21systemctl22:55:001
1722588993025,4cyclictest1878218-21kworker/u8:2+events_unbound22:04:091
1722588993025,3cyclictest1943025-21idleruntime-cro22:50:001
1722588993024,5cyclictest1769036-21cron19:55:001
1722588993023,6cyclictest1858408-21kworker/u8:1+flush-8:021:44:261
1722588993018,5cyclictest1893007-21kworker/u8:3+flush-8:022:29:101
1722583993027,2cyclictest1924007-21cpuspeed_turbos22:34:100
1722583993026,3cyclictest1764083-21kworker/u8:0+flush-8:020:46:410
1722583993026,2cyclictest2018265-21kworker/u8:1+events_unbound00:19:270
1722583993024,5cyclictest1878218-21kworker/u8:2+flush-8:023:20:010
1722583993024,4cyclictest1878196-21cron21:45:000
1722583993020,7cyclictest2037127-21ntpq00:24:190
1722590992924,4cyclictest2007834-21kworker/u8:3+events_unbound00:04:282
1722590992923,4cyclictest1973546-21kworker/u8:0+flush-8:000:20:062
1722590992923,4cyclictest1722712-21kworker/u8:2+events_unbound19:34:222
1722588992924,4cyclictest1749236-21kworker/u8:1+events_unbound19:49:071
1722588992924,4cyclictest1698025-21kworker/u8:4+events_unbound20:04:111
1722588992923,4cyclictest1913343-21cron22:20:001
1722588992923,4cyclictest1823645-21unixbench_multi20:49:261
1722588992922,5cyclictest1938090-21turbostat.cron22:45:001
1722588992922,5cyclictest1803935-21sh20:30:001
1722588992922,5cyclictest1744798-21apt-get19:34:061
1722588992920,6cyclictest278-21systemd-journal00:38:101
1722583992925,3cyclictest1923480-21kworker/u8:1+events_unbound22:54:100
1722583992924,3cyclictest1873212-21kworker/u8:0+flush-8:021:54:160
1722583992923,4cyclictest1810208-21irqrtprio20:39:130
1722583992922,5cyclictest1871025-21kthreadcore21:39:190
1722590992823,3cyclictest1932959-21unixbench_multi22:39:262
1722590992823,3cyclictest1893014-21kworker/u8:4+events_unbound22:04:232
1722590992822,4cyclictest1698025-21kworker/u8:4+events_unbound19:24:192
1722588992825,2cyclictest1997951-21cron23:45:001
1722588992825,2cyclictest1740451-21irqcore19:29:131
1722588992823,4cyclictest1833946-21kworker/u8:2+flush-8:021:20:001
1722588992823,3cyclictest1998754-21cpuspeed_turbos23:49:091
1722588992820,6cyclictest2018265-21kworker/u8:1+flush-8:000:19:241
1722583992824,2cyclictest2052626-21sendmail00:40:000
1722583992823,3cyclictest0-21swapper/023:25:010
1722583992820,6cyclictest2043273-21/usr/sbin/munin00:34:240
1722583992819,7cyclictest1929060-21fschecks_time22:39:110
17223742282,5sleep00-21swapper/019:09:480
18205172270,6sleep20-21swapper/220:49:152
1722590992723,3cyclictest1909253-21fschecks_count22:19:122
1722590992721,4cyclictest1981260-21kworker/u8:3+flush-8:023:34:142
1722588992724,2cyclictest1722574-21cyclictest22:39:231
1722588992723,3cyclictest390-21dbus-daemon00:25:011
1722588992722,3cyclictest1904320-21irqcore22:14:151
1722588992720,5cyclictest1729195-21fschecks_count19:15:031
1722588992719,6cyclictest1828708-21latency_hist20:55:011
1722583992724,2cyclictest1867856-21mailstats21:34:220
1722583992723,3cyclictest1988840-21cpuspeed_turbos23:39:080
1722583992723,3cyclictest1962954-21kworker/u8:1+events_unbound23:54:240
1722583992722,4cyclictest0-21swapper/000:30:000
1722583992721,4cyclictest1984535-21kthreadcore23:34:150
1722583992721,4cyclictest1859072-21aten2_r5power_v21:29:110
1722583992719,6cyclictest1963149-21apt-key23:10:010
1722583992719,6cyclictest1963149-21apt-key23:10:000
1722583992718,7cyclictest1997950-21cron23:45:000
20490022260,6sleep20-21swapper/200:39:162
1722590992623,2cyclictest2038373-21aten2_r5power_c00:29:082
1722590992621,4cyclictest1923480-21kworker/u8:1+flush-8:022:49:222
1722590992621,4cyclictest1923480-21kworker/u8:1+events_unbound22:45:002
1722590992621,3cyclictest1977974-21unixbench_multi23:24:262
1722590992621,3cyclictest1933362-21kworker/u8:3+flush-8:023:10:062
1722590992620,4cyclictest1808824-21unixbench_singl20:34:262
1722590992619,5cyclictest1933362-21kworker/u8:3-ext4-rsv-conversion23:00:002
1722588992621,4cyclictest1973546-21kworker/u8:0+events_unbound23:24:201
1722588992621,4cyclictest1923480-21kworker/u8:1+flush-8:022:34:121
1722588992621,4cyclictest1858408-21kworker/u8:1+flush-8:021:49:161
1722588992621,4cyclictest1764083-21kworker/u8:0+flush-8:021:09:271
1722588992621,4cyclictest1698025-21kworker/u8:4+events_unbound20:59:231
1722588992621,3cyclictest1778980-21kworker/u8:2+flush-8:020:10:301
1722588992621,3cyclictest1773982-21cron20:00:001
1722588992620,5cyclictest1749236-21kworker/u8:1+flush-8:019:44:211
1722583992622,3cyclictest1764083-21kworker/u8:0+events_unbound20:10:010
1722583992621,4cyclictest1764083-21kworker/u8:0+events_unbound20:19:120
1722583992621,3cyclictest0-21swapper/022:29:120
1722583992617,7cyclictest1828597-21unixbench_singl20:54:250
1722590992520,3cyclictest1784809-21aten2_r5power_v20:14:092
172259099250,9cyclictest17414471kthreadcore19:29:132
1722588992520,4cyclictest1833946-21kworker/u8:2+flush-8:021:04:141
1722588992520,4cyclictest1833946-21kworker/u8:2+flush-8:021:04:141
1722588992519,4cyclictest1722712-21kworker/u8:2+flush-8:019:24:111
1722583992522,2cyclictest0-21swapper/019:24:170
1722583992521,2cyclictest0-21swapper/023:30:000
1722583992519,4cyclictest1698025-21kworker/u8:4+events_unbound19:39:100
1722590992420,2cyclictest1919199-21fschecks_time22:29:102
1722590992420,2cyclictest1814739-21fschecks_time20:44:122
1722590992420,2cyclictest0-21swapper/222:10:012
1722590992419,3cyclictest1923872-21aten2_r5power_p22:34:092
1722590992413,9cyclictest1908448-21cat22:15:012
1722588992420,2cyclictest0-21swapper/123:34:181
1722588992420,2cyclictest0-21swapper/123:29:251
1722588992419,4cyclictest1947414-21kworker/u8:0+events_unbound23:09:111
1722588992419,4cyclictest1947414-21kworker/u8:0+events_unbound23:09:111
1722588992419,3cyclictest1900765-21kthreadcore22:09:131
1722588992419,3cyclictest1858408-21kworker/u8:1-ext4-rsv-conversion21:55:001
1722588992415,7cyclictest278-21systemd-journal00:31:101
172258899241,12cyclictest1867745-21ntpq21:34:201
1722583992419,3cyclictest1804860-21fschecks_time20:34:100
1722583992415,7cyclictest1888970-21fschecks_time21:59:090
1722590992318,4cyclictest1698025-21kworker/u8:4+flush-8:020:05:002
1722590992318,4cyclictest1698025-21kworker/u8:4+flush-8:020:05:002
1722588992319,2cyclictest0-21swapper/123:04:261
1722583992318,3cyclictest2027785-21unixbench_singl00:14:240
1722583992317,5cyclictest1992938-21kworker/u8:2+flush-8:023:49:250
1722583992312,2cyclictest0-21swapper/000:09:250
172259099226,2cyclictest18436322cat21:10:002
1722590992217,3cyclictest1844266-21aten2_r5power_v21:14:122
1722590992217,3cyclictest1755029-21fschecks_count19:44:112
1722588992214,7cyclictest1750014-21cpuspeed_turbos19:39:101
1722583992218,3cyclictest1722712-21kworker/u8:2+events_unbound19:29:110
1722583992215,5cyclictest1903183-21awk22:10:010
1722590992116,4cyclictest1973546-21kworker/u8:0+flush-8:000:10:052
1722590992116,3cyclictest1730031-21aten2_r5power_e19:19:092
1722590992116,3cyclictest1723328-21fschecks_count19:14:102
1722590992116,3cyclictest0-21swapper/223:10:002
1722590992116,3cyclictest0-21swapper/223:10:002
1722590992115,4cyclictest1698025-21kworker/u8:4+events_unbound20:55:022
19820342200,4sleep3481ktimers/323:29:163
1722590992016,2cyclictest1838523-21unixbench_singl21:04:242
1722590992016,2cyclictest1838523-21unixbench_singl21:04:242
1722590992016,2cyclictest1809518-21aten2_r5power_c20:39:072
1722590992016,2cyclictest0-21swapper/223:54:162
1722590992015,4cyclictest1923480-21kworker/u8:1+events_unbound22:52:112
1722590992015,4cyclictest1878218-21kworker/u8:2+flush-8:021:50:142
1722590992015,3cyclictest1873095-21unixbench_multi21:39:292
1722590991916,2cyclictest1957986-21unixbench_singl23:04:272
1722590991915,3cyclictest1868183-21unixbench_singl21:34:252
1722590991914,4cyclictest1764064-21turbostat.cron19:50:002
1722590991911,6cyclictest278-21systemd-journal20:25:002
17180452193,10sleep30-21swapper/319:08:303
17178822194,11sleep20-21swapper/219:06:252
1722590991815,2cyclictest1993785-21cpuspeed_turbos23:44:082
1722590991815,2cyclictest1853450-21idleruntime-cro21:20:002
1722590991814,3cyclictest1998638-21aten2_r5power_v23:49:092
172258399189,7cyclictest1934052-21fschecks_time22:44:110
1722590991713,2cyclictest0-21swapper/200:09:152
1722590991712,3cyclictest1824393-21aten2_r5power_e20:54:072
172259099168,6cyclictest1988957-21sshd23:39:102
172259099162,13cyclictest0-21swapper/223:17:422
172259099162,13cyclictest0-21swapper/221:21:322
1722590991612,2cyclictest2044574-21kthreadcore00:34:142
1722590991611,4cyclictest1973546-21kworker/u8:0+events_unbound00:19:312
1722590991610,4cyclictest0-21swapper/219:59:162
17404782155,7sleep30-21swapper/319:29:133
1722590991511,2cyclictest0-21swapper/221:25:102
19994132133,7sleep30-21swapper/323:49:153
19830262132,6sleep30-21swapper/323:30:013
19682022132,6sleep30-21swapper/323:15:013
18237882132,6sleep30-21swapper/320:50:013
17915902132,6sleep30-21swapper/320:19:163
20495012122,6sleep30-21swapper/300:39:183
20382432122,6sleep30-21swapper/300:28:113
20374012123,6sleep30-21swapper/300:24:253
20229742122,6sleep30-21swapper/300:10:013
20124122122,6sleep30-21swapper/323:59:303
20077922122,5sleep30-21swapper/323:55:013
19944522122,6sleep30-21swapper/323:44:133
19883582122,6sleep30-21swapper/323:36:113
19739862122,6sleep30-21swapper/323:24:113
19537312122,6sleep30-21swapper/323:04:093
19524882123,6sleep30-21swapper/322:59:243
19391002122,6sleep30-21swapper/322:49:133
19281642122,6sleep30-21swapper/322:35:013
19078032122,6sleep30-21swapper/322:14:263
18998012122,6sleep30-21swapper/322:09:133
18929642122,6sleep30-21swapper/321:59:263
18633342122,6sleep30-21swapper/321:30:013
18592052122,7sleep30-21swapper/321:29:133
18578452123,6sleep30-21swapper/321:24:233
18344932122,6sleep30-21swapper/321:04:093
18344932122,6sleep30-21swapper/321:04:093
18193832122,6sleep30-21swapper/320:49:103
18149492122,6sleep30-21swapper/320:44:153
18069162122,6sleep30-21swapper/320:34:173
17998792122,6sleep30-21swapper/320:29:113
17946382122,6sleep30-21swapper/320:24:093
17835412122,6sleep30-21swapper/320:09:253
17835412122,6sleep30-21swapper/320:09:253
17787972122,6sleep30-21swapper/320:04:273
17664692122,6sleep30-21swapper/319:54:163
17551852122,6sleep30-21swapper/319:44:133
17456862122,6sleep30-21swapper/319:34:143
17387982122,6sleep30-21swapper/319:24:233
17292182122,6sleep30-21swapper/319:15:053
20429992112,6sleep30-21swapper/300:30:353
20281162112,5sleep30-21swapper/300:15:113
20190292112,6sleep30-21swapper/300:09:133
20133302112,6sleep30-21swapper/300:01:023
19634522112,5sleep30-21swapper/323:10:033
19585932112,6sleep30-21swapper/323:08:433
19585932112,6sleep30-21swapper/323:08:433
19430512112,5sleep30-21swapper/322:50:013
19374322112,5sleep30-21swapper/322:44:193
19327872112,5sleep30-21swapper/322:39:263
19191582112,6sleep30-21swapper/322:29:113
19137842113,5sleep30-21swapper/322:22:293
19125742112,5sleep30-21swapper/322:19:213
18940102112,6sleep30-21swapper/322:04:123
18833972112,6sleep30-21swapper/321:50:153
18787402112,5sleep30-21swapper/321:49:083
18685272112,6sleep30-21swapper/321:35:153
18487272112,6sleep30-21swapper/321:15:093
18477222112,5sleep30-21swapper/321:14:203
18396282112,6sleep30-21swapper/321:09:153
18289582112,5sleep30-21swapper/320:55:233
18092582112,6sleep30-21swapper/320:36:293
17881482112,5sleep30-21swapper/320:14:183
17693402112,5sleep30-21swapper/319:55:573
17597202112,5sleep30-21swapper/319:49:073
17494632112,5sleep30-21swapper/319:35:193
17227112112,5sleep30-21swapper/319:10:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional