You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-04 - 08:17

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat Jul 04, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4034402997571,3cyclictest4049844-21kworker/u8:3+events_unbound20:30:010
4034412995551,3cyclictest4049844-21kworker/u8:3+flush-259:019:55:012
4034407994845,2cyclictest75-21kswapd023:43:241
4034412994441,2cyclictest75-21kswapd023:43:232
4034412994441,2cyclictest4127676-21kworker/u8:2+events_unbound20:50:222
4034402994336,2cyclictest4049844-21kworker/u8:3+events_unbound19:35:130
4034402994239,2cyclictest4044411-21kworker/u8:0+flush-259:020:10:230
4034402994238,3cyclictest335557-21systemd-journal21:00:210
4034402994238,3cyclictest32052-21kworker/u8:2+flush-259:022:20:220
4034402994138,2cyclictest4168610-21kworker/u8:1+events_unbound21:35:150
4034402994138,2cyclictest4044411-21kworker/u8:0+flush-259:020:25:210
4034402994138,2cyclictest4044411-21kworker/u8:0+flush-259:020:15:220
4034407994036,3cyclictest4044411-21kworker/u8:0+flush-259:020:30:151
4034402994036,3cyclictest75-21kswapd023:43:230
4034402993936,2cyclictest4143116-21kworker/u8:1+flush-259:021:05:160
4034402993936,2cyclictest4127676-21kworker/u8:2+flush-259:021:15:200
4034402993935,3cyclictest6357-21kworker/u8:2+events_unbound21:50:200
4034402993935,3cyclictest156365-21kworker/u8:1+flush-259:000:15:220
4034416993833,3cyclictest335557-21systemd-journal21:30:223
4034412993835,2cyclictest42380-21kworker/u8:3+events_unbound22:50:012
4034407993834,3cyclictest32052-21kworker/u8:2+events_unbound22:20:171
4034402993835,2cyclictest4168610-21kworker/u8:1+flush-259:021:45:180
4034402993835,2cyclictest4127676-21kworker/u8:2+flush-259:020:55:180
4034412993734,2cyclictest109973-21kworker/u8:4+flush-259:000:20:002
4034402993734,2cyclictest4049844-21kworker/u8:3+flush-259:020:05:190
4034402993733,3cyclictest1975250-21kworker/u8:2+flush-259:019:15:000
4034416993630,4cyclictest4044661-21latency_hist19:20:003
4034412993633,2cyclictest42092-21apt-get22:22:202
4034412993630,4cyclictest4075573-21latency_hist19:50:012
4034402993631,3cyclictest4168610-21kworker/u8:1+events_unbound21:40:220
4034402993631,3cyclictest4168610-21kworker/u8:1+events_unbound21:40:220
4034416993531,3cyclictest73314-21latency_hist22:55:023
4034412993531,3cyclictest4127676-21kworker/u8:2+events_unbound21:35:012
4034402993531,2cyclictest211rcuc/023:35:000
403440299351,32cyclictest1-21systemd23:50:000
4034412993429,4cyclictest4085016-21ntpq19:55:202
4034407993430,3cyclictest99292-21kworker/u8:2+flush-259:023:30:231
4034402993431,2cyclictest68198-21kworker/u8:1+flush-259:023:00:170
4034402993430,3cyclictest109973-21kworker/u8:4+flush-259:000:30:130
4034412993330,3cyclictest4169088-21kworker/u8:4+events_unbound21:30:232
4034407993329,3cyclictest335557-21systemd-journal23:50:001
4034402993330,2cyclictest130665-21kworker/u8:0+events_unbound00:00:210
4034402993328,4cyclictest335557-21systemd-journal00:25:000
4034402993327,4cyclictest94322-21diskstats23:15:140
4034407993228,3cyclictest4168610-21kworker/u8:1+events_unbound21:50:001
4034407993227,3cyclictest4055219-21/usr/sbin/munin19:30:181
4034402993229,2cyclictest68198-21kworker/u8:1+events_unbound23:05:180
4034402993229,2cyclictest130665-21kworker/u8:0+events_unbound00:05:000
4034402993229,2cyclictest109973-21kworker/u8:4+flush-259:023:35:230
4034416993127,3cyclictest4158573-21kworker/u8:3+events_unbound21:20:223
4034407993127,3cyclictest837-21kworker/u8:0+events_unbound22:30:141
4034402993128,2cyclictest93837-21kworker/u8:0+events_unbound23:25:130
4034402993128,2cyclictest837-21kworker/u8:0+flush-259:022:25:180
4034402993128,2cyclictest837-21kworker/u8:0+events_unbound22:10:160
4034402993128,2cyclictest4127676-21kworker/u8:2+events_unbound21:10:170
4034402993128,2cyclictest4049844-21kworker/u8:3+events_unbound20:00:170
4034402993128,2cyclictest1975250-21kworker/u8:2+flush-259:019:45:210
4034407993027,2cyclictest135898-21apt-get23:55:101
4034407993026,3cyclictest4044411-21kworker/u8:0+flush-259:020:40:271
4034402993027,2cyclictest4049844-21kworker/u8:3+flush-259:019:30:210
4034402993027,2cyclictest130666-21kworker/u8:2+events_unbound23:50:180
4034402993027,2cyclictest130666-21kworker/u8:2+events_unbound23:50:170
4034412992926,2cyclictest837-21kworker/u8:0+flush-259:022:10:182
4034412992926,2cyclictest4127676-21kworker/u8:2+flush-259:020:55:242
4034412992926,2cyclictest4049844-21kworker/u8:3+events_unbound20:00:242
4034412992926,2cyclictest4044411-21kworker/u8:0+flush-259:021:00:192
4034407992926,2cyclictest4044411-21kworker/u8:0+flush-259:020:10:161
4034407992925,3cyclictest4168610-21kworker/u8:1+events_unbound22:12:231
4034407992924,3cyclictest4133031-21/usr/sbin/munin20:45:221
4034402992926,2cyclictest6357-21kworker/u8:2+flush-259:021:55:250
4034402992926,2cyclictest4044411-21kworker/u8:0+flush-259:020:40:180
4034402992920,2cyclictest109973-21kworker/u8:4+events_unbound00:25:200
4034416992825,2cyclictest3996860-21kworker/u8:1+flush-259:019:25:233
4034416992823,4cyclictest335557-21systemd-journal19:44:593
4034416992822,4cyclictest62966-21latency_hist22:45:013
4034412992824,3cyclictest335557-21systemd-journal20:35:212
4034412992822,4cyclictest4112202-21diskstats20:25:142
4034407992825,2cyclictest42380-21kworker/u8:3+flush-259:022:55:191
4034407992825,2cyclictest4158573-21kworker/u8:3+flush-259:021:20:261
4034407992825,2cyclictest4044411-21kworker/u8:0+events_unbound20:54:221
4034407992824,3cyclictest6357-21kworker/u8:2+flush-259:021:55:161
4034407992824,3cyclictest4049844-21kworker/u8:3+flush-259:019:35:151
4034407992823,4cyclictest4106616-21latency_hist20:20:011
4034402992825,2cyclictest837-21kworker/u8:0+flush-259:022:05:180
4034402992824,3cyclictest42380-21kworker/u8:3+events_unbound22:45:100
4034416992723,3cyclictest4168610-21kworker/u8:1+flush-259:021:40:263
4034416992723,3cyclictest4168610-21kworker/u8:1+flush-259:021:40:263
4034416992721,4cyclictest4189933-21latency_hist21:40:013
4034412992724,3cyclictest4044411-21kworker/u8:0+events_unbound20:18:232
4034412992723,3cyclictest42380-21kworker/u8:3+flush-259:022:40:002
4034412992723,3cyclictest16605-21kworker/u8:3+events_unbound22:00:112
4034412992723,3cyclictest109973-21kworker/u8:4+events_unbound23:34:222
4034407992724,2cyclictest4044411-21kworker/u8:0+events_unbound20:08:211
4034407992724,2cyclictest156365-21kworker/u8:1+events_unbound00:25:001
4034407992723,3cyclictest4044411-21kworker/u8:0+events_unbound19:40:171
4034402992724,2cyclictest4168610-21kworker/u8:1+events_unbound22:20:010
4034416992623,2cyclictest130666-21kworker/u8:2+events_unbound00:30:003
4034416992622,3cyclictest4044411-21kworker/u8:0+flush-259:020:20:203
4034412992623,2cyclictest6357-21kworker/u8:2+events_unbound21:58:222
4034412992623,2cyclictest42380-21kworker/u8:3+events_unbound22:55:152
4034412992623,2cyclictest4127676-21kworker/u8:2+events_unbound21:14:212
4034412992623,2cyclictest3996860-21kworker/u8:1+flush-259:019:15:212
4034412992622,3cyclictest3996860-21kworker/u8:1+events_unbound19:25:012
4034407992622,3cyclictest99292-21kworker/u8:2+events_unbound23:21:221
4034407992622,3cyclictest4169088-21kworker/u8:4+events_unbound21:33:221
4034407992622,3cyclictest4049844-21kworker/u8:3+events_unbound20:00:141
4034407992622,3cyclictest3996860-21kworker/u8:1+events_unbound19:15:131
4034407992621,3cyclictest335557-21systemd-journal22:01:211
4034402992623,2cyclictest837-21kworker/u8:0+flush-259:022:50:180
4034416992521,3cyclictest83859-21apt-get23:05:113
4034416992521,3cyclictest837-21kworker/u8:0+flush-259:022:35:253
4034416992521,3cyclictest4049844-21kworker/u8:3+flush-259:020:35:263
4034412992523,2cyclictest4044411-21kworker/u8:0+events_unbound20:44:212
4034412992522,2cyclictest4044411-21kworker/u8:0+flush-259:019:30:162
4034412992522,2cyclictest109973-21kworker/u8:4+events_unbound23:45:232
4034412992520,3cyclictest4065538-21/usr/sbin/munin19:40:142
4034407992522,2cyclictest4044411-21kworker/u8:0+events_unbound19:47:221
4034407992522,2cyclictest3996860-21kworker/u8:1+flush-259:019:20:181
4034407992521,3cyclictest4044411-21kworker/u8:0+events_unbound20:36:231
4034402992523,2cyclictest4044411-21kworker/u8:0+flush-259:020:20:230
4034402992522,2cyclictest42380-21kworker/u8:3+events_unbound22:30:210
4034416992422,1cyclictest68198-21kworker/u8:1+events_unbound23:10:203
4034416992421,2cyclictest4044411-21kworker/u8:0+events_unbound19:59:213
4034416992418,4cyclictest4117407-21cat20:30:013
4034412992421,2cyclictest42380-21kworker/u8:3+events_unbound22:52:022
4034412992421,2cyclictest4044411-21kworker/u8:0+events_unbound20:06:362
4034412992421,2cyclictest3996860-21kworker/u8:1+flush-259:019:10:242
4034407992421,2cyclictest130665-21kworker/u8:0+events_unbound00:07:321
4034407992420,3cyclictest837-21kworker/u8:0+flush-259:022:50:231
4034407992420,3cyclictest837-21kworker/u8:0+events_unbound22:44:221
4034407992420,3cyclictest4168610-21kworker/u8:1+flush-259:021:35:251
4034407992420,3cyclictest4163715-21latency_hist21:15:001
4034402992421,2cyclictest4127676-21kworker/u8:2+flush-259:020:50:200
4034402992421,2cyclictest1975250-21kworker/u8:2+flush-259:019:15:190
4034402992421,2cyclictest130666-21kworker/u8:2+flush-259:000:35:190
4034416992321,2cyclictest4085924-21kworker/u8:1+events_unbound20:30:213
4034416992319,3cyclictest42380-21kworker/u8:3+flush-259:022:45:183
4034416992319,3cyclictest4044411-21kworker/u8:0+events_unbound20:51:443
4034416992317,4cyclictest151220-21latency_hist00:10:013
4034416992316,5cyclictest4168857-21latency_hist21:20:003
4034412992320,2cyclictest4158573-21kworker/u8:3+events_unbound21:20:002
4034412992320,2cyclictest130665-21kworker/u8:0+events_unbound23:55:222
4034412992319,3cyclictest130665-21kworker/u8:0+flush-259:000:20:422
4034412992317,2cyclictest4049844-21kworker/u8:3+events_unbound19:35:232
4034407992321,2cyclictest4169088-21kworker/u8:4+events_unbound21:41:221
4034407992321,2cyclictest4169088-21kworker/u8:4+events_unbound21:41:211
4034407992320,2cyclictest837-21kworker/u8:0+flush-259:022:05:211
4034407992319,3cyclictest4169088-21kworker/u8:4+events_unbound21:25:151
4034407992319,3cyclictest1975250-21kworker/u8:2+events_unbound19:51:331
4034402992320,2cyclictest837-21kworker/u8:0+flush-259:022:35:260
4034402992320,2cyclictest109973-21kworker/u8:4+flush-259:000:10:170
4034416992218,3cyclictest3996860-21kworker/u8:1+events_unbound19:23:233
4034416992218,3cyclictest109973-21kworker/u8:4+events_unbound23:39:223
4034416992217,4cyclictest4158560-21latency_hist21:10:003
4034412992219,2cyclictest4158573-21kworker/u8:3+events_unbound21:20:142
4034412992219,2cyclictest4143116-21kworker/u8:1+events_unbound21:05:232
4034407992219,2cyclictest68198-21kworker/u8:1+events_unbound23:37:131
4034407992219,2cyclictest4158573-21kworker/u8:3+flush-259:021:15:321
4034407992219,2cyclictest3996860-21kworker/u8:1+events_unbound19:11:201
4034402992219,2cyclictest4169088-21kworker/u8:4+flush-259:021:30:130
4034402992219,2cyclictest1975250-21kworker/u8:2+flush-259:019:20:230
4034402992218,3cyclictest4158573-21kworker/u8:3+events_unbound21:23:220
4034416992119,2cyclictest99292-21kworker/u8:2+events_unbound23:20:213
4034416992118,2cyclictest99292-21kworker/u8:2+events_unbound23:30:193
4034416992118,2cyclictest4049844-21kworker/u8:3+flush-259:020:00:163
4034416992118,2cyclictest16605-21kworker/u8:3+events_unbound22:00:153
4034416992117,3cyclictest4127676-21kworker/u8:2+events_unbound21:25:233
4034416992117,3cyclictest4044411-21kworker/u8:0+events_unbound19:34:223
4034412992118,2cyclictest42380-21kworker/u8:3+events_unbound23:17:092
4034412992117,3cyclictest4044411-21kworker/u8:0+flush-259:020:20:162
4034412992115,4cyclictest509-21rs:main2
4034402992118,2cyclictest4127676-21kworker/u8:2+events_unbound21:25:190
4034402992118,2cyclictest1975250-21kworker/u8:2+events_unbound19:50:200
4034402992118,2cyclictest16605-21kworker/u8:3+events_unbound22:00:220
4034402992118,2cyclictest130665-21kworker/u8:0+events_unbound23:55:160
4034402992117,3cyclictest4049844-21kworker/u8:3+events_unbound19:56:350
4034416992017,2cyclictest837-21kworker/u8:0+flush-259:022:25:213
4034416992017,2cyclictest68198-21kworker/u8:1+flush-259:023:28:273
4034416992017,2cyclictest68198-21kworker/u8:1+events_unbound22:55:133
4034416992017,2cyclictest4168610-21kworker/u8:1+flush-259:022:15:163
4034416992017,2cyclictest4168610-21kworker/u8:1+events_unbound21:45:203
4034416992017,2cyclictest130666-21kworker/u8:2+events_unbound00:35:183
4034416992016,3cyclictest4044411-21kworker/u8:0+events_unbound21:04:233
4034412992017,2cyclictest6357-21kworker/u8:2+flush-259:021:51:272
4034412992017,2cyclictest32052-21kworker/u8:2+events_unbound22:26:222
4034412992016,3cyclictest99292-21kworker/u8:2+events_unbound23:20:112
4034412992016,3cyclictest837-21kworker/u8:0+events_unbound22:05:232
4034412992016,3cyclictest68198-21kworker/u8:1+events_unbound23:05:262
4034412992016,3cyclictest4168610-21kworker/u8:1+flush-259:021:40:132
4034412992016,3cyclictest4168610-21kworker/u8:1+flush-259:021:40:132
4034412992016,3cyclictest109973-21kworker/u8:4+flush-259:000:00:012
4034412992014,4cyclictest120071-21latency_hist23:40:002
4034407992017,2cyclictest4049844-21kworker/u8:3+events_unbound20:20:201
4034407992017,2cyclictest130666-21kworker/u8:2+events_unbound00:33:431
4034407992016,3cyclictest68198-21kworker/u8:1+events_unbound23:08:211
4034407992016,3cyclictest6357-21kworker/u8:2+events_unbound21:51:531
4034402992017,2cyclictest68198-21kworker/u8:1+flush-259:022:55:220
4034402992017,2cyclictest68198-21kworker/u8:1+events_unbound23:10:230
4034402992017,2cyclictest211rcuc/022:45:000
4034402992016,3cyclictest4049844-21kworker/u8:3+events_unbound20:45:160
4034416991916,2cyclictest4044411-21kworker/u8:0+events_unbound20:40:253
4034416991916,2cyclictest1975250-21kworker/u8:2+events_unbound19:45:173
4034416991916,2cyclictest109973-21kworker/u8:4+events_unbound00:10:173
4034416991915,3cyclictest335557-21systemd-journal19:14:213
4034416991915,3cyclictest156365-21kworker/u8:1+events_unbound00:16:423
4034412991916,2cyclictest68198-21kworker/u8:1+flush-259:023:00:202
4034412991916,2cyclictest42380-21kworker/u8:3+events_unbound23:10:122
4034412991915,3cyclictest93837-21kworker/u8:0+events_unbound23:25:092
4034412991915,3cyclictest4049844-21kworker/u8:3+events_unbound20:45:122
4034412991915,3cyclictest130666-21kworker/u8:2+events_unbound00:37:422
4034407991915,3cyclictest837-21kworker/u8:0+events_unbound22:38:231
4034407991915,3cyclictest167010-21apt-get00:25:111
4034407991913,4cyclictest335557-21systemd-journal23:10:211
4034402991916,2cyclictest4044411-21kworker/u8:0+flush-259:019:40:160
4034416991815,3cyclictest68198-21kworker/u8:1+events_unbound23:44:233
4034416991815,3cyclictest4127676-21kworker/u8:2+flush-259:021:10:413
4034416991814,3cyclictest837-21kworker/u8:0+events_unbound22:05:183
4034416991814,3cyclictest4168610-21kworker/u8:1+flush-259:021:53:263
4034416991814,3cyclictest156365-21kworker/u8:1+events_unbound00:23:423
4034416991812,4cyclictest83594-21latency_hist23:05:013
4034412991815,2cyclictest130666-21kworker/u8:2+events_unbound00:25:242
4034412991814,3cyclictest151477-21apt-get00:10:102
4034412991814,3cyclictest130666-21kworker/u8:2+flush-259:023:50:262
4034412991814,3cyclictest130666-21kworker/u8:2+flush-259:023:50:252
4034407991815,2cyclictest0-21swapper/121:05:001
4034407991814,3cyclictest42380-21kworker/u8:3+flush-259:023:20:001
4034407991814,3cyclictest42380-21kworker/u8:3+flush-259:022:45:271
4034407991814,3cyclictest109973-21kworker/u8:4+events_unbound23:50:011
4034407991814,3cyclictest109973-21kworker/u8:4+events_unbound23:50:011
4034416991715,2cyclictest837-21kworker/u8:0+events_unbound22:32:223
4034416991715,2cyclictest4127676-21kworker/u8:2+events_unbound20:47:233
4034416991714,2cyclictest4044411-21kworker/u8:0+events_unbound20:15:173
4034416991714,2cyclictest130666-21kworker/u8:2+flush-259:023:50:193
4034416991714,2cyclictest130666-21kworker/u8:2+flush-259:023:50:193
4034416991713,3cyclictest1975250-21kworker/u8:2+events_unbound19:50:263
4034412991713,3cyclictest4049844-21kworker/u8:3+events_unbound20:11:242
4034407991715,2cyclictest4127676-21kworker/u8:2+events_unbound20:55:221
4034407991714,3cyclictest68198-21kworker/u8:1+events_unbound23:02:041
4034407991713,3cyclictest3996860-21kworker/u8:1+events_unbound19:25:261
4034407991713,3cyclictest156365-21kworker/u8:1+events_unbound00:18:301
4034407991712,3cyclictest837-21kworker/u8:0+flush-259:022:25:161
4034402991712,3cyclictest99324-21apt-get23:20:110
4034416991613,2cyclictest94572-21irqcore23:15:163
4034416991612,3cyclictest130666-21kworker/u8:2+flush-259:000:03:203
403441299166,5cyclictest52667-21awk22:35:002
4034412991612,3cyclictest837-21kworker/u8:0+events_unbound22:40:222
4034412991612,3cyclictest1975250-21kworker/u8:2+events_unbound19:20:252
4034407991613,2cyclictest93837-21kworker/u8:0+flush-259:023:25:221
4034407991512,3cyclictest177332-21kworker/u8:0+events_unbound00:36:411
4034407991511,3cyclictest837-21kworker/u8:0+events_unbound22:19:571
4034407991511,3cyclictest109973-21kworker/u8:4+events_unbound00:14:431
403441299149,4cyclictest335557-21systemd-journal21:50:002
4034412991411,2cyclictest4044411-21kworker/u8:0+events_unbound20:31:412
4034412991410,3cyclictest4169088-21kworker/u8:4+flush-259:021:28:322
4034407991412,2cyclictest130666-21kworker/u8:2+events_unbound00:01:321
4034407991411,2cyclictest4044411-21kworker/u8:0+flush-259:020:25:291
403440299142,3cyclictest4050085-21apt-get19:25:120
4034407991310,2cyclictest4143116-21kworker/u8:1+events_unbound21:05:131
403440799128,3cyclictest4049844-21kworker/u8:3+flush-259:019:59:321
403441699117,3cyclictest130666-21kworker/u8:2+flush-259:023:55:363
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional