You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-11 - 05:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot4s.osadl.org (updated Thu Dec 11, 2025 00:44:14)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1715987996858,7cyclictest1721360-21cp19:15:012
1715983996862,4cyclictest1916853-21kworker/u8:2+events_unbound22:36:181
1715983996459,4cyclictest1772435-21kworker/u8:1+events_unbound20:31:131
1715980996252,7cyclictest1901176-21ntpq22:11:140
19138252600,1sleep01913826-21cat22:26:100
1715983995853,4cyclictest1850519-21kworker/u8:2+flush-8:021:56:161
19356572570,2sleep30-21swapper/322:46:113
1715983995649,5cyclictest1935931-21kworker/u8:1+events_unbound23:31:151
1715983995644,4cyclictest1684131-21kworker/u8:3+flush-8:019:15:051
1715983995549,5cyclictest1837791-21kworker/u8:1+flush-8:022:06:201
1715983995450,3cyclictest1837791-21kworker/u8:1+flush-8:021:16:201
1715983995447,5cyclictest1876803-21kworker/u8:3+events_unbound22:26:141
17461192530,2sleep3471rcuc/319:36:093
1715983995349,3cyclictest1971478-21kworker/u8:3+flush-8:023:56:171
1715980995346,5cyclictest1772435-21kworker/u8:1+events_unbound20:56:220
1715983995144,5cyclictest1837791-21kworker/u8:1+flush-8:022:11:211
1715983995045,4cyclictest1777839-21kworker/u8:2+flush-8:020:41:041
1715983995043,5cyclictest1747671-21kworker/u8:0+flush-8:021:01:151
1715983994944,4cyclictest1876803-21kworker/u8:3+flush-8:022:16:181
1715983994944,4cyclictest1876803-21kworker/u8:3+flush-8:022:16:171
1715983994943,5cyclictest2026228-21kworker/u8:2+flush-8:000:21:131
1715983994942,5cyclictest1826980-21kworker/u8:3+events_unbound21:06:131
1715987994844,3cyclictest1911678-21kworker/u8:0+flush-8:023:21:192
1715983994844,3cyclictest1911678-21kworker/u8:0+flush-8:023:06:121
1715983994842,4cyclictest1935931-21kworker/u8:1+flush-8:000:06:161
1715983994841,6cyclictest1916853-21kworker/u8:2+flush-8:023:26:161
1715983994841,5cyclictest1747671-21kworker/u8:0+flush-8:020:21:131
20442592470,2sleep3481ktimers/300:36:113
1715983994739,6cyclictest1911678-21kworker/u8:0+flush-8:023:21:131
1715983994641,3cyclictest1837791-21kworker/u8:1+flush-8:021:21:201
1715983994637,7cyclictest2006816-21/usr/sbin/munin00:01:121
1715983994540,4cyclictest1946570-21kworker/u8:3+events_unbound23:11:131
1715983994539,5cyclictest1911678-21kworker/u8:0+flush-8:022:56:161
1715983994538,5cyclictest1850519-21kworker/u8:2+flush-8:021:41:151
1715983994537,5cyclictest1921884-21latency_hist22:35:011
1715980994535,8cyclictest1990826-21ntpq23:41:140
1715983994440,3cyclictest2016201-21kworker/u8:0+flush-8:000:31:191
1715983994440,3cyclictest1876803-21kworker/u8:3+events_unbound22:01:201
1715983994438,5cyclictest1747671-21kworker/u8:0+flush-8:020:26:171
1715983994438,4cyclictest1684131-21kworker/u8:3+flush-8:019:11:201
1715983994437,5cyclictest1716113-21kworker/u8:1+flush-8:019:31:081
1715987994338,3cyclictest1916853-21kworker/u8:2+events_unbound23:31:222
1715983994339,3cyclictest1837791-21kworker/u8:1+flush-8:021:46:091
1715983994338,4cyclictest1911678-21kworker/u8:0+flush-8:023:16:191
1715983994338,4cyclictest1716113-21kworker/u8:1+flush-8:019:21:151
1715983994337,4cyclictest1916853-21kworker/u8:2+flush-8:022:51:071
1715983994336,5cyclictest1837791-21kworker/u8:1+flush-8:021:36:161
1715983994335,6cyclictest1946570-21kworker/u8:3+flush-8:023:01:161
19758962420,3chrt201rcuc/023:26:130
1715983994236,4cyclictest2026228-21kworker/u8:2+events_unbound00:36:171
1715983994233,7cyclictest1971478-21kworker/u8:3+flush-8:023:51:101
1715980994229,10cyclictest1941671-21apt-get22:55:000
1715983994137,3cyclictest1747671-21kworker/u8:0+events_unbound20:46:181
1715983994137,3cyclictest1747671-21kworker/u8:0+events_unbound20:06:221
1715983994137,3cyclictest1747671-21kworker/u8:0+events_unbound20:06:211
1715983994135,4cyclictest1876803-21kworker/u8:3+flush-8:022:21:041
1715983994134,5cyclictest1723322-21kworker/u8:4+flush-8:019:51:131
1715980994132,7cyclictest1902386-21apt-get22:15:590
1715980994132,7cyclictest1902386-21apt-get22:15:590
1715980994128,10cyclictest282-21systemd-journal23:50:000
1715983994034,4cyclictest1772435-21kworker/u8:1+flush-8:020:51:141
1715980994029,8cyclictest1747671-21kworker/u8:0+flush-8:021:01:170
1715987993931,6cyclictest282-21systemd-journal19:44:592
1715983993933,5cyclictest1747671-21kworker/u8:0+flush-8:020:16:131
1715983993933,5cyclictest1747671-21kworker/u8:0+events_unbound19:56:131
1715983993932,5cyclictest1826980-21kworker/u8:3+events_unbound21:26:201
1715983993832,4cyclictest2016201-21kworker/u8:0+events_unbound00:26:111
1715983993832,4cyclictest1935931-21kworker/u8:1+flush-8:023:41:121
1715983993832,4cyclictest1716113-21kworker/u8:1+flush-8:019:26:161
1715983993828,8cyclictest1772435-21kworker/u8:1+flush-8:020:36:141
1715987993729,6cyclictest282-21systemd-journal22:00:002
1715987993728,7cyclictest282-21systemd-journal20:35:092
1715983993731,5cyclictest1916853-21kworker/u8:2+flush-8:022:46:151
1715980993729,6cyclictest1980866-21ntpq23:31:120
1715980993722,6cyclictest2046024-21unixbench_singl00:36:210
1715987993631,3cyclictest1850519-21kworker/u8:2+events_unbound21:51:212
1715983993631,3cyclictest1777839-21kworker/u8:2+events_unbound20:11:031
1715983993629,5cyclictest2021654-21latency_hist00:15:011
1715983993628,6cyclictest1716113-21kworker/u8:1+flush-8:019:36:141
1715980993629,4cyclictest1747583-21grep19:36:180
1715980993628,6cyclictest1737979-21latency_hist19:30:010
1715983993531,3cyclictest1684131-21kworker/u8:3+flush-8:019:41:041
1715983993529,4cyclictest1971478-21kworker/u8:3+events_unbound23:36:201
1715983993526,6cyclictest1715823-21latency_hist19:10:011
1715980993530,4cyclictest1837791-21kworker/u8:1+flush-8:022:31:160
1715980993528,4cyclictest1-21systemd00:30:000
1715980993527,6cyclictest1877390-21/usr/sbin/munin21:51:130
1715987993426,6cyclictest1832605-21gpgv21:05:012
1715983993430,3cyclictest1777839-21kworker/u8:2+flush-8:020:56:091
1715983993429,4cyclictest1837791-21kworker/u8:1+events_unbound21:51:071
1715983993428,5cyclictest1747671-21kworker/u8:0+flush-8:019:46:061
1715987993329,3cyclictest1747671-21kworker/u8:0+events_unbound21:11:212
1715983993327,4cyclictest1826980-21kworker/u8:3+flush-8:021:31:211
1715980993310,15cyclictest1951037-21ld23:01:160
1715983993225,5cyclictest1971478-21kworker/u8:3+flush-8:023:46:041
1715983993225,5cyclictest1911678-21kworker/u8:0+events_unbound22:41:021
1715980993223,6cyclictest1797403-21latency_hist20:30:010
171598099319,14cyclictest2031021-21cat00:21:190
1715980993125,4cyclictest1997158-21cpuspeed_turbos23:51:040
1715983993023,5cyclictest1842466-21latency_hist21:15:011
171598099309,12cyclictest1814987-21grep20:46:100
1715980993025,3cyclictest1873402-21kthreadcore21:46:050
1715980993025,3cyclictest1684131-21kworker/u8:3+flush-8:019:11:170
1715980993022,6cyclictest2015611-21ntpq00:06:150
1715980993022,5cyclictest1806927-21grep20:36:190
1715980993010,6cyclictest1957472-21fw_packets23:11:050
17112552302,6sleep00-21swapper/019:05:530
1715987992924,4cyclictest1837791-21kworker/u8:1+flush-8:021:21:192
1715987992919,8cyclictest282-21systemd-journal20:03:092
171598099293,4cyclictest1817773-21df_inode20:51:040
1715980992913,3cyclictest0-21swapper/022:01:090
171598099285,11cyclictest1791682-21ntpq20:21:150
171598099284,14cyclictest1762901-21sort19:55:000
171598099283,17cyclictest587-21runrttasks00:16:020
171598099282,5cyclictest2007010-21sort00:01:030
1715980992824,2cyclictest1773720-21irqrtprio20:06:080
1715980992824,2cyclictest1773720-21irqrtprio20:06:070
171598099281,9cyclictest1861654-21python321:31:210
1715980992819,7cyclictest1732164-21ntpq19:21:140
1715980992819,2cyclictest161rcu_preempt21:44:470
1715980992817,1cyclictest161rcu_preempt23:56:020
1715980992814,9cyclictest282-21systemd-journal23:20:000
171598099281,17cyclictest2017414-21hddtemp_smartct00:11:050
1715980992811,5cyclictest0-21swapper/022:46:080
1715987992722,4cyclictest1747671-21kworker/u8:0+flush-8:020:16:142
1715987992722,3cyclictest1906681-21unixbench_singl22:16:192
1715987992722,3cyclictest1906681-21unixbench_singl22:16:192
1715987992722,3cyclictest1901718-21unixbench_singl22:11:222
1715987992720,5cyclictest282-21systemd-journal21:10:002
1715987992720,5cyclictest2016481-21apt-get00:10:002
1715983992723,3cyclictest1772435-21kworker/u8:1+events_unbound20:05:001
1715983992721,4cyclictest2021974-21apt-get00:16:001
171598099278,9cyclictest1811406-21ntpq20:41:120
171598099277,16cyclictest282-21systemd-journal22:41:110
171598099275,10cyclictest1896537-21tail22:06:210
171598099273,14cyclictest1952357-21df23:06:040
171598099273,14cyclictest1833919-21kthreadcore21:06:070
171598099273,13cyclictest587-21runrttasks19:46:120
1715980992722,3cyclictest1922430-21cpuspeed_turbos22:36:030
1715980992722,3cyclictest1728143-21runrttasks19:20:010
1715980992719,5cyclictest1971521-21grep23:21:210
1715980992711,6cyclictest1769208-21cat20:01:100
171598099270,17cyclictest1865889-21cut21:36:110
19991672260,3sleep2371rcuc/223:51:112
1715987992622,3cyclictest2016201-21kworker/u8:0+flush-8:000:16:112
1715987992622,3cyclictest1747671-21kworker/u8:0+flush-8:020:06:152
1715987992622,3cyclictest1747671-21kworker/u8:0+flush-8:020:06:152
1715987992622,3cyclictest1747671-21kworker/u8:0+events_unbound20:46:092
1715987992622,2cyclictest1737628-21unixbench_singl19:26:212
1715987992622,2cyclictest1728416-21aten2_r5power_c19:21:032
1715987992620,4cyclictest1908267-21kthreadcore22:21:072
171598099262,10cyclictest1786902-21python320:16:190
1715980992620,4cyclictest1778855-21kthreadcore20:11:090
1715980992616,8cyclictest1982316-21diskstats23:36:030
1715980992616,1cyclictest161rcu_preempt19:41:110
1715980992613,3cyclictest0-21swapper/019:31:000
171598099261,15cyclictest1766937-21ntpq19:56:170
1715987992521,2cyclictest1922232-21aten2_r5power_c22:36:012
1715987992521,2cyclictest1777995-21aten2_r5power_e20:11:022
1715987992520,3cyclictest1822293-21apt-key20:55:012
1715987992517,6cyclictest2006087-21unixbench_multi23:56:182
171598099255,9cyclictest2037087-21df00:31:040
171598099253,12cyclictest1854168-21grep21:26:090
171598099252,13cyclictest1843120-21fschecks_time21:16:050
1715980992521,2cyclictest0-21swapper/023:00:000
171598099252,11cyclictest0-21swapper/021:21:150
171598099252,10cyclictest1886209-21ntpq21:56:150
1715980992517,2cyclictest161rcu_preempt20:31:010
171598099250,15cyclictest0-21swapper/021:11:050
171598099250,11cyclictest1909349-21kthreadcore22:21:080
17158042251,15sleep21715896-21sed19:10:012
1715987992420,3cyclictest1823278-21irqcore20:56:092
1715987992416,6cyclictest1912281-21apt-get22:26:002
1715987992320,2cyclictest2037082-21cpuspeed_turbos00:31:042
1715987992318,4cyclictest1935931-21kworker/u8:1+flush-8:023:41:252
1715987992219,2cyclictest1852905-21cpuspeed_turbos21:26:042
1715987992218,3cyclictest0-21swapper/223:20:012
1715987992217,3cyclictest1891622-21unixbench_singl22:01:212
1715987992217,3cyclictest0-21swapper/220:35:012
171598799212,2cyclictest0-21swapper/200:36:202
1715987992118,2cyclictest0-21swapper/221:40:002
1715987992117,2cyclictest0-21swapper/222:31:112
1715987992116,3cyclictest1762448-21unixbench_singl19:51:182
1715987992116,3cyclictest1721414-21timerwakeupswit19:15:012
1715987992112,7cyclictest1757962-21grep19:50:012
1715987992016,2cyclictest1738651-21fschecks_time19:31:052
1715987992016,2cyclictest0-21swapper/200:21:112
1715987992016,2cyclictest0-21swapper/200:11:012
1715987992015,4cyclictest0-21swapper/219:59:592
1715987992012,6cyclictest1941834-21awk22:55:002
1715987992011,7cyclictest1957321-21grep23:11:032
1715987991916,2cyclictest1952436-21fschecks_time23:06:062
1715987991915,2cyclictest1743338-21aten2_r5power_e19:36:012
1715987991915,2cyclictest0-21swapper/221:46:112
1715987991914,3cyclictest0-21swapper/222:09:592
1715987991911,6cyclictest1859264-21cut21:31:112
1715987991910,7cyclictest1844079-21tr21:16:082
171598799189,7cyclictest1933328-21tr22:46:092
171598799188,7cyclictest1794161-21tr20:26:102
171598799182,4cyclictest0-21swapper/222:56:032
171598799182,3cyclictest19724682tune2fs23:26:052
1715987991814,2cyclictest1950872-21needreboot23:01:122
1715987991814,2cyclictest0-21swapper/223:50:012
1715987991814,2cyclictest0-21swapper/220:41:122
1715987991813,3cyclictest0-21swapper/200:01:112
17156872183,8sleep30-21swapper/319:08:293
171598799179,6cyclictest1929457-21tr22:41:082
171598799173,1cyclictest0-21swapper/220:21:062
1715987991713,2cyclictest0-21swapper/223:36:182
1715987991713,2cyclictest0-21swapper/221:41:112
1715987991713,2cyclictest0-21swapper/200:26:142
19122842162,9sleep30-21swapper/322:26:023
19467712158,4sleep30-21swapper/322:59:153
18755562150,5sleep30-21swapper/321:46:083
19657882142,8sleep30-21swapper/323:16:143
18873252142,8sleep30-21swapper/322:01:013
18774132142,7sleep30-21swapper/321:51:023
20357272132,7sleep30-21swapper/300:26:173
20289812134,5sleep30-21swapper/300:21:113
19695382131,8sleep30-21swapper/323:21:123
17776352132,6sleep30-21swapper/320:10:003
17765592132,7sleep30-21swapper/320:06:123
17765592132,7sleep30-21swapper/320:06:123
20381702122,6sleep30-21swapper/300:31:093
20216652122,6sleep30-21swapper/300:15:013
20164012122,6sleep30-21swapper/300:09:113
20111232122,6sleep30-21swapper/300:01:213
19966242122,6sleep30-21swapper/323:50:013
19919142122,6sleep30-21swapper/323:45:113
19916012122,6sleep30-21swapper/323:44:113
19770792122,6sleep30-21swapper/323:30:593
19559032122,6sleep30-21swapper/323:06:153
19514822122,6sleep30-21swapper/323:01:213
19367132122,6sleep30-21swapper/322:50:013
19224512122,6sleep30-21swapper/322:36:053
19171512122,6sleep30-21swapper/322:30:113
19028702122,6sleep30-21swapper/322:16:063
19028702122,6sleep30-21swapper/322:16:063
19013932122,6sleep30-21swapper/322:11:203
18679162122,6sleep30-21swapper/321:41:073
18662502122,6sleep30-21swapper/321:36:123
18431722122,6sleep30-21swapper/321:16:073
18273682122,6sleep30-21swapper/321:00:013
18227482122,6sleep30-21swapper/320:56:043
18179012122,6sleep30-21swapper/320:51:073
17982232122,6sleep30-21swapper/320:31:083
17878532122,6sleep30-21swapper/320:21:013
17829762122,6sleep30-21swapper/320:16:033
17637302122,6sleep30-21swapper/319:56:093
17620222122,6sleep30-21swapper/319:51:153
17529332121,6sleep30-21swapper/319:45:013
17347502122,6sleep30-21swapper/319:26:113
17180342122,6sleep30-21swapper/319:11:093
20201192112,5sleep30-21swapper/300:11:123
20018442112,5sleep30-21swapper/323:55:593
19823082112,5sleep30-21swapper/323:36:043
19721582113,5sleep30-21swapper/323:26:003
19573422112,5sleep30-21swapper/323:11:033
19307702112,5sleep30-21swapper/322:41:113
19075942112,5sleep30-21swapper/322:21:033
18922902112,5sleep30-21swapper/322:06:033
18859842112,5sleep30-21swapper/321:56:123
18575282112,5sleep30-21swapper/321:30:113
18569352112,5sleep30-21swapper/321:26:223
18381982112,5sleep30-21swapper/321:11:053
18365992112,5sleep30-21swapper/321:06:123
18075862112,5sleep30-21swapper/320:40:593
18029462112,5sleep30-21swapper/320:36:063
17927622112,5sleep30-21swapper/320:26:023
17716912112,6sleep30-21swapper/320:01:143
17520662112,5sleep30-21swapper/319:41:163
17382732112,5sleep30-21swapper/319:31:003
17286212112,5sleep30-21swapper/319:21:053
17215652112,5sleep30-21swapper/319:15:033
18477272102,5sleep30-21swapper/321:20:483
18125012102,5sleep30-21swapper/320:45:093
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional