You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-19 - 21:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat Sep 19, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1741189995956,2cyclictest1740710-21kworker/u8:2+events_unbound07:25:243
1741183995350,2cyclictest1897937-21kworker/u8:1+flush-259:009:50:231
1741189995246,4cyclictest1913370-21latency_hist09:55:003
1741187994845,2cyclictest1945009-21kworker/u8:4+flush-259:010:39:242
1741187994441,2cyclictest2012416-21kworker/u8:1+events_unbound12:10:162
1741187994239,2cyclictest2033094-21kworker/u8:2+events_unbound12:00:142
1741189994138,2cyclictest1768123-21kworker/u8:1+events_unbound08:00:113
1741187994138,2cyclictest2012416-21kworker/u8:1+events_unbound11:50:142
1741187994138,2cyclictest1768123-21kworker/u8:1+events_unbound08:10:242
1741179994135,4cyclictest2064123-21latency_hist12:20:000
1741187994037,2cyclictest1919187-21kworker/u8:2+events_unbound10:00:182
1741189993936,2cyclictest1815034-21kworker/u8:3+events_unbound09:30:263
1741187993831,5cyclictest1955136-21latency_hist10:35:012
1741183993832,4cyclictest1783475-21gpgv07:50:001
1741189993734,2cyclictest2012416-21kworker/u8:1+flush-259:011:50:173
1741189993734,2cyclictest1740710-21kworker/u8:2+events_unbound07:15:123
1741189993733,3cyclictest1960226-21kworker/u8:0+events_unbound11:00:013
1741189993733,3cyclictest1815034-21kworker/u8:3+flush-259:009:25:253
1741189993731,5cyclictest1913647-21apt-get09:55:133
1741189993731,2cyclictest2033094-21kworker/u8:2+events_unbound12:05:233
1741187993734,2cyclictest3882118-21kworker/u8:5+flush-259:007:34:242
1741187993734,2cyclictest1872168-21kworker/u8:4+events_unbound09:35:162
1741187993733,3cyclictest3882118-21kworker/u8:5+events_unbound07:50:242
1741189993633,2cyclictest3882118-21kworker/u8:5+flush-259:007:40:143
1741187993633,2cyclictest1835767-21kworker/u8:1+events_unbound09:12:252
1741187993633,2cyclictest1740710-21kworker/u8:2+events_unbound07:21:252
1741187993632,3cyclictest3882118-21kworker/u8:5+events_unbound07:17:252
1741187993632,3cyclictest2033094-21kworker/u8:2+flush-259:012:36:232
1741187993632,3cyclictest1898164-21/usr/sbin/munin09:40:142
1741183993633,2cyclictest2002322-21kworker/u8:0+flush-259:011:20:281
1741183993633,2cyclictest1945009-21kworker/u8:4+flush-259:011:45:121
1741183993632,3cyclictest2033094-21kworker/u8:2+flush-259:012:05:241
1741189993532,2cyclictest1945009-21kworker/u8:4+flush-259:011:05:243
1741189993532,2cyclictest1945009-21kworker/u8:4+events_unbound10:35:173
1741189993532,2cyclictest1897937-21kworker/u8:1+flush-259:010:15:153
1741189993532,2cyclictest1740710-21kworker/u8:2+flush-259:007:20:163
1741189993531,2cyclictest1804919-21kworker/u8:0+flush-259:008:20:233
1741187993533,2cyclictest1804919-21kworker/u8:0+flush-259:008:45:042
1741187993532,2cyclictest1960226-21kworker/u8:0+events_unbound10:47:242
1741187993532,2cyclictest1897937-21kworker/u8:1+flush-259:009:49:242
1741187993531,3cyclictest1841331-21kworker/u8:2+events_unbound09:05:242
1741187993531,3cyclictest1768123-21kworker/u8:1+events_unbound08:07:242
1741183993531,3cyclictest3882118-21kworker/u8:5+flush-259:007:10:251
1741179993531,3cyclictest1897937-21kworker/u8:1+events_unbound09:45:110
1741179993529,4cyclictest1970644-21latency_hist10:50:010
1741189993431,2cyclictest1919187-21kworker/u8:2+events_unbound10:05:123
1741187993431,2cyclictest1996979-21kworker/u8:1+events_unbound11:15:282
1741187993431,2cyclictest1929016-21kworker/u8:3+flush-259:010:20:262
1741187993430,3cyclictest1991672-21kworker/u8:2+events_unbound11:28:242
1741187993430,3cyclictest1954844-21kworker/u8:1+events_unbound10:40:272
1741183993431,2cyclictest1991672-21kworker/u8:2+flush-259:011:25:261
1741183993429,3cyclictest1893200-21diskstats09:35:151
1741189993330,2cyclictest1954844-21kworker/u8:1+flush-259:011:00:233
1741189993329,3cyclictest1815034-21kworker/u8:3+events_unbound08:28:253
1741187993330,2cyclictest1954844-21kworker/u8:1+events_unbound10:55:162
1741187993330,2cyclictest1945009-21kworker/u8:4+events_unbound11:40:222
1741187993330,2cyclictest1872167-21kworker/u8:0+events_unbound09:30:042
1741179993330,2cyclictest2033094-21kworker/u8:2+flush-259:011:55:210
1741179993329,3cyclictest1815034-21kworker/u8:3+flush-259:008:25:170
1741179993327,4cyclictest1751644-21cp07:20:000
1741189993228,3cyclictest3882118-21kworker/u8:5+flush-259:007:45:213
1741189993226,4cyclictest2048564-21latency_hist12:05:003
1741187993229,2cyclictest1815034-21kworker/u8:3+events_unbound09:15:022
1741187993229,2cyclictest1815034-21kworker/u8:3+events_unbound08:55:172
1741187993228,3cyclictest2027833-21kworker/u8:0+events_unbound11:45:262
1741187993228,3cyclictest1897937-21kworker/u8:1+events_unbound09:51:242
1741183993229,2cyclictest1954844-21kworker/u8:1+flush-259:011:00:241
1741183993228,3cyclictest2033094-21kworker/u8:2+flush-259:011:55:261
1741179993228,3cyclictest1815034-21kworker/u8:3+flush-259:009:25:140
1741179993227,4cyclictest1762927-21apt-get07:30:110
1741187993128,2cyclictest1815034-21kworker/u8:3+events_unbound08:25:192
1741187993127,3cyclictest1794754-21/usr/sbin/munin08:00:142
1741183993127,3cyclictest1872421-21apt-get09:15:141
1741183993127,3cyclictest1815034-21kworker/u8:3+flush-259:009:45:241
1741189993027,2cyclictest3882118-21kworker/u8:5+flush-259:007:55:203
1741189993027,2cyclictest2058550-21kworker/u8:3+events_unbound12:20:183
1741189993027,2cyclictest1939406-21kworker/u8:2+flush-259:010:25:143
1741189993027,2cyclictest1815034-21kworker/u8:3+events_unbound09:15:013
1741189993026,3cyclictest2074762-21/usr/sbin/munin12:30:143
1741187993027,2cyclictest2069343-21kworker/u8:0+events_unbound12:30:382
1741187993027,2cyclictest2033094-21kworker/u8:2+events_unbound12:15:372
1741187993027,2cyclictest2033094-21kworker/u8:2+events_unbound12:05:152
1741187993025,3cyclictest2012416-21kworker/u8:1+flush-259:011:35:002
1741183993027,2cyclictest1768123-21kworker/u8:1+flush-259:008:05:171
1741179993025,3cyclictest1804919-21kworker/u8:0+flush-259:008:40:190
1741179993024,4cyclictest1882487-21latency_hist09:25:010
1741189992926,2cyclictest1945009-21kworker/u8:4+events_unbound11:35:203
1741189992926,2cyclictest1815034-21kworker/u8:3+flush-259:008:30:193
1741187992925,3cyclictest1991672-21kworker/u8:2+events_unbound11:39:252
1741183992926,2cyclictest1815034-21kworker/u8:3+flush-259:008:25:001
1741179992923,4cyclictest335557-21systemd-journal10:20:000
1741189992825,2cyclictest1945009-21kworker/u8:4+flush-259:011:10:213
1741189992824,3cyclictest1815034-21kworker/u8:3+events_unbound09:15:233
1741189992824,3cyclictest1762269-21kworker/u8:0+flush-259:007:38:253
1741187992826,2cyclictest2058550-21kworker/u8:3+events_unbound12:25:152
1741187992825,2cyclictest1918553-21kworker/u8:0+events_unbound10:10:212
1741187992825,2cyclictest1872168-21kworker/u8:4+flush-259:009:55:102
1741187992825,2cyclictest1804919-21kworker/u8:0+events_unbound08:20:262
1741187992824,3cyclictest1762269-21kworker/u8:0+events_unbound07:35:202
1741183992825,2cyclictest2033094-21kworker/u8:2+flush-259:012:20:281
1741183992824,3cyclictest2012416-21kworker/u8:1+events_unbound11:50:121
1741183992823,4cyclictest335557-21systemd-journal08:30:221
1741179992823,4cyclictest1815034-21kworker/u8:3+flush-259:008:50:250
1741179992821,5cyclictest2052846-21ntpq12:05:210
1741189992724,2cyclictest2012416-21kworker/u8:1+flush-259:011:32:233
1741189992723,3cyclictest335557-21systemd-journal10:05:003
1741187992724,2cyclictest1945009-21kworker/u8:4+events_unbound11:10:292
1741187992724,2cyclictest1945009-21kworker/u8:4+events_unbound10:50:182
1741187992724,2cyclictest1872168-21kworker/u8:4+flush-259:009:20:032
1741187992724,2cyclictest1815034-21kworker/u8:3+events_unbound08:50:272
1741183992723,3cyclictest1872168-21kworker/u8:4+events_unbound09:59:591
1741179992724,2cyclictest2033094-21kworker/u8:2+flush-259:012:35:260
1741179992723,3cyclictest1815034-21kworker/u8:3+flush-259:009:30:160
1741179992721,4cyclictest1918784-21store10:00:000
1741189992623,2cyclictest2027833-21kworker/u8:0+events_unbound11:45:183
1741189992622,3cyclictest2002322-21kworker/u8:0+flush-259:011:20:163
1741187992623,2cyclictest1815034-21kworker/u8:3+flush-259:009:00:152
1741183992623,2cyclictest1996979-21kworker/u8:1+events_unbound11:15:241
1741183992623,2cyclictest1815034-21kworker/u8:3+flush-259:008:55:151
1741183992622,3cyclictest1820620-21kworker/u8:2+flush-259:008:29:571
1741183992622,3cyclictest1784049-21apt-get07:50:131
1741183992620,4cyclictest1835057-21ntpq08:35:221
1741179992622,3cyclictest1841331-21kworker/u8:2+flush-259:009:10:010
1741179992622,3cyclictest1768123-21kworker/u8:1+events_unbound08:00:120
1741179992619,5cyclictest1923228-21ntpq10:00:230
1741189992523,1cyclictest1929016-21kworker/u8:3+flush-259:010:20:153
1741189992522,2cyclictest1815034-21kworker/u8:3+flush-259:009:40:193
1741189992522,2cyclictest1815034-21kworker/u8:3+flush-259:008:50:183
1741189992521,3cyclictest1815034-21kworker/u8:3+events_unbound09:45:173
1741189992520,4cyclictest1762236-21apt-get07:30:013
1741189992517,2cyclictest2033094-21kworker/u8:2+events_unbound11:55:193
1741187992523,2cyclictest2058550-21kworker/u8:3+events_unbound12:20:232
1741187992522,2cyclictest3882118-21kworker/u8:5+events_unbound07:29:242
1741187992522,2cyclictest1897937-21kworker/u8:1+events_unbound10:15:132
1741179992523,1cyclictest2012416-21kworker/u8:1+events_unbound11:30:190
1741179992522,2cyclictest1945009-21kworker/u8:4+flush-259:010:35:230
1741179992521,3cyclictest2012416-21kworker/u8:1+flush-259:012:00:250
1741179992518,5cyclictest1964620-21ntpq10:40:250
1741189992421,2cyclictest1835767-21kworker/u8:1+flush-259:008:55:053
1741189992421,2cyclictest1794146-21kworker/u8:2+flush-259:008:15:133
1741189992419,2cyclictest1804919-21kworker/u8:0+events_unbound08:40:183
1741189992417,5cyclictest2011481-21ntpq11:25:233
1741187992421,2cyclictest3882118-21kworker/u8:5+flush-259:007:55:262
1741187992421,2cyclictest1804919-21kworker/u8:0+events_unbound08:40:282
1741183992421,2cyclictest2058550-21kworker/u8:3+events_unbound12:25:171
1741183992420,3cyclictest1945009-21kworker/u8:4+flush-259:010:50:261
1741179992421,2cyclictest1918553-21kworker/u8:0+flush-259:010:10:140
1741179992420,3cyclictest507-21in:imuxsock11:55:000
1741179992420,3cyclictest1768123-21kworker/u8:1+events_unbound08:12:250
1741189992320,2cyclictest1815034-21kworker/u8:3+events_unbound09:05:143
1741189992319,3cyclictest2058550-21kworker/u8:3+flush-259:012:25:233
1741187992320,2cyclictest1815034-21kworker/u8:3+events_unbound08:31:242
1741183992320,3cyclictest2058757-21kworker/u8:4+events_unbound12:16:251
1741183992320,2cyclictest1945009-21kworker/u8:4+events_unbound11:10:151
1741183992319,3cyclictest1945009-21kworker/u8:4+events_unbound10:26:241
1741183992319,3cyclictest1815034-21kworker/u8:3+flush-259:009:00:241
1741179992320,2cyclictest1945009-21kworker/u8:4+events_unbound10:30:180
1741179992320,2cyclictest1835767-21kworker/u8:1+events_unbound08:48:240
1741189992219,2cyclictest1815034-21kworker/u8:3+events_unbound08:35:213
1741187992219,2cyclictest1996979-21kworker/u8:1+flush-259:011:20:012
1741187992216,2cyclictest1939406-21kworker/u8:2+events_unbound10:25:172
1741183992219,2cyclictest2033094-21kworker/u8:2+events_unbound12:11:201
1741183992219,2cyclictest1945009-21kworker/u8:4+events_unbound10:30:141
1741183992218,3cyclictest2012416-21kworker/u8:1+events_unbound11:30:181
1741183992218,3cyclictest1945009-21kworker/u8:4+events_unbound10:49:251
1741183992218,3cyclictest1835767-21kworker/u8:1+events_unbound09:08:231
1741183992218,3cyclictest1815034-21kworker/u8:3+events_unbound09:10:021
1741183992217,4cyclictest335557-21systemd-journal11:08:231
1741183992217,4cyclictest1919046-21base6410:00:011
1741179992218,3cyclictest1762269-21kworker/u8:0+events_unbound07:48:230
1741189992118,2cyclictest1794146-21kworker/u8:2+events_unbound08:09:533
1741189992114,5cyclictest1745402-21ntpq07:10:203
1741187992118,2cyclictest1815034-21kworker/u8:3+events_unbound08:19:242
1741183992118,2cyclictest1918553-21kworker/u8:0+events_unbound10:11:231
1741183992118,2cyclictest1815034-21kworker/u8:3+flush-259:009:25:011
1741183992118,2cyclictest1815034-21kworker/u8:3+events_unbound08:18:231
1741183992118,2cyclictest1768123-21kworker/u8:1+flush-259:007:39:501
1741183992118,2cyclictest1762269-21kworker/u8:0+events_unbound07:40:221
1741183992117,3cyclictest1815034-21kworker/u8:3+events_unbound08:52:241
1741179992118,2cyclictest3882118-21kworker/u8:5+events_unbound07:40:180
1741179992118,2cyclictest1815034-21kworker/u8:3+events_unbound09:00:180
1741179992118,2cyclictest1-21systemd10:57:230
1741179992117,3cyclictest2053978-21apt-get12:10:130
1741179992117,3cyclictest1929016-21kworker/u8:3+flush-259:010:20:220
1741187992016,3cyclictest1815034-21kworker/u8:3+events_unbound08:37:242
1741183992018,2cyclictest1945009-21kworker/u8:4+flush-259:010:35:131
1741183992018,1cyclictest1740710-21kworker/u8:2+events_unbound07:30:031
1741183992017,2cyclictest1740710-21kworker/u8:2+flush-259:007:20:201
1741183992016,3cyclictest2017842-21apt-get11:35:131
1741183992016,2cyclictest1897937-21kworker/u8:1+flush-259:010:15:201
1741183992014,4cyclictest1762395-21base6407:30:011
1741179992017,2cyclictest1939406-21kworker/u8:2+events_unbound10:25:120
1741179992014,4cyclictest1820377-21latency_hist08:25:010
1741189991917,2cyclictest1945009-21kworker/u8:4+events_unbound10:48:353
1741189991916,2cyclictest1768123-21kworker/u8:1+events_unbound08:10:283
1741187991916,2cyclictest1954844-21kworker/u8:1+events_unbound11:00:022
1741183991915,3cyclictest2069343-21kworker/u8:0+events_unbound12:31:241
1741183991915,3cyclictest1954844-21kworker/u8:1+events_unbound10:55:181
1741179991916,2cyclictest1740710-21kworker/u8:2+events_unbound07:25:150
1741179991915,3cyclictest1815034-21kworker/u8:3+flush-259:009:50:150
1741179991913,4cyclictest2002089-21latency_hist11:20:020
1741179991913,4cyclictest1877301-21latency_hist09:20:010
1741189991815,2cyclictest1996979-21kworker/u8:1+flush-259:011:15:143
1741189991815,2cyclictest1815034-21kworker/u8:3+events_unbound09:20:233
1741189991814,2cyclictest335557-21systemd-journal08:50:003
1741189991812,4cyclictest1975829-21latency_hist10:55:013
1741187991810,6cyclictest335557-21systemd-journal11:10:002
1741187991810,1cyclictest0-21swapper/211:59:592
1741183991815,2cyclictest1929016-21kworker/u8:3+events_unbound10:20:221
1741183991815,2cyclictest1794146-21kworker/u8:2+events_unbound07:57:241
1741183991814,3cyclictest1954844-21kworker/u8:1+events_unbound10:44:251
1741183991813,3cyclictest1751462-21apt-get07:20:001
1741179991814,3cyclictest2027833-21kworker/u8:0+flush-259:011:45:160
1741179991814,3cyclictest1945009-21kworker/u8:4+events_unbound11:40:240
1741179991814,3cyclictest1768150-21apt-get07:35:120
1741179991813,4cyclictest335557-21systemd-journal11:12:230
1741189991714,2cyclictest2058757-21kworker/u8:4+flush-259:012:15:243
1741189991714,2cyclictest1918553-21kworker/u8:0+flush-259:010:10:233
1741189991713,3cyclictest1762269-21kworker/u8:0+flush-259:007:52:293
1741187991713,3cyclictest3882118-21kworker/u8:5+events_unbound07:12:502
1741183991714,2cyclictest2012416-21kworker/u8:1+events_unbound12:00:251
1741183991714,2cyclictest1815034-21kworker/u8:3+flush-259:009:30:151
1741183991714,2cyclictest1804919-21kworker/u8:0+flush-259:008:44:581
1741183991713,3cyclictest1919187-21kworker/u8:2+flush-259:010:05:241
1741179991714,2cyclictest3882118-21kworker/u8:5+events_unbound07:20:150
1741179991714,2cyclictest1825801-21kworker/u8:4+events_unbound08:35:040
1741179991714,2cyclictest1794146-21kworker/u8:2+events_unbound08:17:220
1741179991713,3cyclictest2069343-21kworker/u8:0+flush-259:012:30:200
1741179991713,3cyclictest1945009-21kworker/u8:4+flush-259:011:35:210
1741179991711,4cyclictest1788928-21apt-get07:55:010
1741189991613,2cyclictest2012416-21kworker/u8:1+flush-259:012:10:273
1741187991613,2cyclictest1762269-21kworker/u8:0+flush-259:007:48:292
1741187991612,3cyclictest1815034-21kworker/u8:3+events_unbound09:25:032
1741183991613,2cyclictest2079439-21kworker/u8:1+events_unbound12:38:231
1741179991614,2cyclictest60350irq/132-enp0s29f1:rx-008:07:110
1741179991614,1cyclictest60350irq/132-enp0s29f1:rx-011:25:150
1741179991612,3cyclictest3882118-21kworker/u8:5+flush-259:007:50:210
1741179991612,3cyclictest1919187-21kworker/u8:2+flush-259:010:05:210
1741179991612,3cyclictest1815034-21kworker/u8:3+events_unbound09:10:170
1741189991512,2cyclictest1815034-21kworker/u8:3+events_unbound09:38:543
1741187991512,3cyclictest1929016-21kworker/u8:3+events_unbound10:06:352
1741183991511,3cyclictest1945009-21kworker/u8:4+flush-259:011:40:251
1741179991513,1cyclictest60350irq/132-enp0s29f1:rx-012:25:490
1741179991513,1cyclictest60350irq/132-enp0s29f1:rx-009:35:250
1741179991512,2cyclictest60350irq/132-enp0s29f1:rx-007:10:220
1741179991512,2cyclictest2002322-21kworker/u8:0+flush-259:011:20:160
1741179991512,2cyclictest1954844-21kworker/u8:1+flush-259:011:00:130
1741183991411,2cyclictest1810065-21sh08:15:001
1741183991410,3cyclictest1768123-21kworker/u8:1+events_unbound08:03:241
1741179991412,1cyclictest60350irq/132-enp0s29f1:rx-011:05:150
1741179991412,1cyclictest60350irq/132-enp0s29f1:rx-010:50:140
1741179991411,2cyclictest60350irq/132-enp0s29f1:rx-009:40:100
1741179991411,2cyclictest2064494-21cpuspeed_turbos12:20:130
174118999139,3cyclictest1939406-21kworker/u8:2+events_unbound10:33:303
1741183991310,2cyclictest1815034-21kworker/u8:3+events_unbound09:40:091
174118399128,2cyclictest1845434-21ntpq08:45:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional