You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-06 - 04:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Apr 06, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
16683994138,2cyclictest37252-21kworker/u8:3+events_unbound20:20:171
16686994036,3cyclictest161933-21gpgv21:30:012
16683994037,2cyclictest4177560-21kworker/u8:2+events_unbound19:30:121
16683993936,2cyclictest120576-21kworker/u8:1+flush-259:020:55:231
16683993835,2cyclictest4177560-21kworker/u8:2+events_unbound19:15:231
16683993835,2cyclictest334693-21kworker/u8:2+flush-259:000:30:251
16686993629,5cyclictest252-21systemd-journal19:20:012
16690993532,2cyclictest4177560-21kworker/u8:2+flush-259:019:50:203
16683993532,2cyclictest130737-21kworker/u8:0+flush-259:021:40:001
16683993532,2cyclictest130737-21kworker/u8:0+events_unbound21:50:161
16683993531,3cyclictest156896-21kworker/u8:2+flush-259:021:30:181
16690993428,4cyclictest94810-21latency_hist20:25:013
16686993431,2cyclictest193562-21kworker/u8:3+events_unbound22:05:132
16686993330,2cyclictest4177560-21kworker/u8:2+flush-259:020:05:242
16686993329,3cyclictest150490-21kworker/u8:3+events_unbound21:20:222
16683993330,2cyclictest334693-21kworker/u8:2+flush-259:000:35:201
16683993229,2cyclictest303100-21kworker/u8:0+flush-259:023:50:251
16683993229,2cyclictest193562-21kworker/u8:3+events_unbound22:10:271
16683993226,5cyclictest78418-21ntpq20:05:201
16690993128,2cyclictest224834-21kworker/u8:2+events_unbound23:20:123
16686993128,2cyclictest360931-21kworker/u8:0+flush-259:000:40:012
16683993128,2cyclictest4177560-21kworker/u8:2+flush-259:021:00:161
16683993128,2cyclictest209415-21kworker/u8:0+events_unbound22:15:221
16683993127,3cyclictest318781-21kworker/u8:3+events_unbound00:05:211
16690993026,3cyclictest303100-21kworker/u8:0+events_unbound23:50:133
16683993027,2cyclictest224834-21kworker/u8:2+events_unbound23:00:191
16683993027,2cyclictest2131193-21kworker/u8:0+events_unbound19:45:171
16683993027,2cyclictest199353-21kworker/u8:1+events_unbound22:30:131
16680993023,5cyclictest252-21systemd-journal00:15:000
16680993022,7cyclictest156896-21kworker/u8:2+flush-259:022:15:000
16690992924,4cyclictest47595-21latency_hist19:40:013
16690992923,4cyclictest219914-21/usr/sbin/munin22:25:213
16686992923,4cyclictest168248-21diskstats21:35:142
16683992926,2cyclictest4177560-21kworker/u8:2+events_unbound20:40:231
16683992926,2cyclictest303100-21kworker/u8:0+events_unbound23:45:261
16683992925,3cyclictest4177560-21kworker/u8:2+events_unbound21:15:191
16690992825,2cyclictest156896-21kworker/u8:2+events_unbound22:20:183
16686992825,2cyclictest199353-21kworker/u8:1+flush-259:022:20:212
16686992824,3cyclictest224834-21kworker/u8:2+events_unbound22:50:232
16686992824,3cyclictest224834-21kworker/u8:2+events_unbound22:50:222
16686992823,3cyclictest84435-21latency_hist20:15:012
16683992826,1cyclictest2131193-21kworker/u8:0+flush-259:019:20:201
16683992825,2cyclictest219627-21kworker/u8:3+flush-259:023:10:201
16683992825,2cyclictest130737-21kworker/u8:0+flush-259:021:45:181
16680992822,4cyclictest252-21systemd-journal19:16:230
16690992724,3cyclictest224834-21kworker/u8:2+events_unbound23:05:013
16690992724,2cyclictest324592-21kworker/u8:1+flush-259:000:15:013
16690992723,3cyclictest4177560-21kworker/u8:2+events_unbound20:30:023
16690992723,3cyclictest4177560-21kworker/u8:2+events_unbound20:30:023
16683992725,1cyclictest224834-21kworker/u8:2+flush-259:022:55:151
16683992724,2cyclictest4177560-21kworker/u8:2+flush-259:020:45:151
16683992724,2cyclictest130737-21kworker/u8:0+events_unbound21:05:201
16683992721,4cyclictest302381-21ntpq23:40:191
16680992722,4cyclictest252-21systemd-journal22:50:010
16680992720,5cyclictest183237-21latency_hist21:50:010
16690992623,2cyclictest37252-21kworker/u8:3+flush-259:020:40:003
16690992623,2cyclictest224834-21kworker/u8:2+flush-259:023:55:153
16686992623,2cyclictest141224-21kworker/u8:1+events_unbound21:10:132
16686992622,3cyclictest37252-21kworker/u8:3+flush-259:020:20:152
16683992624,2cyclictest219627-21kworker/u8:3+flush-259:022:25:191
16683992623,2cyclictest4177560-21kworker/u8:2+events_unbound20:50:251
16683992623,2cyclictest2131193-21kworker/u8:0+flush-259:019:35:171
16690992522,2cyclictest16464-21kworker/u8:3+flush-259:019:10:193
16686992522,2cyclictest4177560-21kworker/u8:2+flush-259:020:00:152
16686992522,2cyclictest209415-21kworker/u8:0+events_unbound22:15:142
16686992521,3cyclictest509-21rs:main2
16683992522,2cyclictest4177560-21kworker/u8:2+events_unbound19:30:011
16683992522,2cyclictest37252-21kworker/u8:3+flush-259:020:30:131
16683992522,2cyclictest37252-21kworker/u8:3+flush-259:020:30:131
16683992522,2cyclictest193562-21kworker/u8:3+events_unbound22:05:151
16683992522,2cyclictest188323-21kworker/u8:1+flush-259:021:55:171
1668099252,21cyclictest1-21systemd20:57:270
16690992421,2cyclictest224834-21kworker/u8:2+flush-259:023:00:213
16690992420,3cyclictest4177560-21kworker/u8:2+flush-259:020:50:223
16686992421,2cyclictest4177560-21kworker/u8:2+flush-259:019:50:152
16686992421,2cyclictest318781-21kworker/u8:3+flush-259:000:00:192
16686992421,2cyclictest245933-21kworker/u8:0+events_unbound22:50:002
16686992420,3cyclictest156896-21kworker/u8:2+events_unbound22:10:212
16686992418,4cyclictest252-21systemd-journal23:20:002
16683992421,2cyclictest4177560-21kworker/u8:2+flush-259:019:55:211
16683992421,2cyclictest37252-21kworker/u8:3+flush-259:020:25:201
16683992421,2cyclictest334693-21kworker/u8:2+flush-259:000:20:111
16683992421,2cyclictest219627-21kworker/u8:3+events_unbound23:07:281
16690992320,2cyclictest37252-21kworker/u8:3+events_unbound20:40:133
16690992320,2cyclictest224834-21kworker/u8:2+flush-259:023:35:113
16690992319,3cyclictest4177560-21kworker/u8:2+flush-259:019:55:193
16690992319,3cyclictest4177560-21kworker/u8:2+flush-259:019:50:003
16690992318,3cyclictest162032-21gpgv21:30:013
16686992320,2cyclictest224834-21kworker/u8:2+events_unbound23:35:142
16686992320,2cyclictest219627-21kworker/u8:3+flush-259:022:40:212
16686992320,2cyclictest156896-21kworker/u8:2+flush-259:021:30:132
16686992319,3cyclictest2131193-21kworker/u8:0+flush-259:019:20:222
16683992322,1cyclictest224834-21kworker/u8:2+events_unbound23:30:111
16683992319,3cyclictest318781-21kworker/u8:3+events_unbound00:10:201
16683992319,3cyclictest318781-21kworker/u8:3+events_unbound00:00:171
16680992317,4cyclictest252-21systemd-journal19:48:220
1668099231,20cyclictest1-21systemd19:54:220
16690992219,2cyclictest324592-21kworker/u8:1+flush-259:000:15:193
16690992219,2cyclictest2131193-21kworker/u8:0+flush-259:019:40:233
16690992218,3cyclictest193562-21kworker/u8:3+flush-259:022:10:173
16690992215,5cyclictest252-21systemd-journal20:15:003
16686992219,2cyclictest324592-21kworker/u8:1+flush-259:000:10:262
16686992219,2cyclictest224834-21kworker/u8:2+flush-259:000:00:002
16686992219,2cyclictest224834-21kworker/u8:2+events_unbound23:20:252
16686992218,3cyclictest224834-21kworker/u8:2+events_unbound23:40:132
16686992218,3cyclictest188323-21kworker/u8:1+flush-259:021:55:002
16683992220,2cyclictest224834-21kworker/u8:2+events_unbound23:55:131
16683992220,2cyclictest130737-21kworker/u8:0+events_unbound22:00:271
16683992219,2cyclictest224834-21kworker/u8:2+events_unbound23:20:181
16683992219,2cyclictest2131193-21kworker/u8:0+events_unbound19:44:221
16680992218,3cyclictest198731-21gpgv22:05:000
16680992217,3cyclictest509-21rs:main0
16680992217,3cyclictest252-21systemd-journal20:35:560
16690992118,2cyclictest37252-21kworker/u8:3+flush-259:020:25:213
16690992118,2cyclictest318781-21kworker/u8:3+events_unbound00:05:143
16690992117,3cyclictest22036-21apt-get19:15:123
16690992116,4cyclictest193806-21apt-get22:00:143
16690992116,4cyclictest115627-21/usr/sbin/munin20:45:123
16686992118,2cyclictest37252-21kworker/u8:3+events_unbound20:15:152
16686992118,2cyclictest224834-21kworker/u8:2+flush-259:023:30:242
16686992118,2cyclictest219627-21kworker/u8:3+flush-259:022:25:202
16686992117,3cyclictest4177560-21kworker/u8:2+events_unbound19:55:112
16686992117,3cyclictest224834-21kworker/u8:2+events_unbound23:00:212
16683992119,2cyclictest261392-21kworker/u8:1+flush-259:023:35:201
16683992117,3cyclictest150490-21kworker/u8:3+events_unbound21:20:161
16680992117,3cyclictest4177560-21kworker/u8:2+flush-259:019:55:140
16680992117,3cyclictest224834-21kworker/u8:2+events_unbound22:30:170
16680992115,4cyclictest275892-21ntpq23:15:210
16680992114,5cyclictest73936-21base6420:05:000
16690992017,2cyclictest4177560-21kworker/u8:2+events_unbound19:28:233
16690992017,2cyclictest219627-21kworker/u8:3+flush-259:022:40:193
16690992015,3cyclictest292614-21latency_hist23:35:013
16686992017,2cyclictest4177560-21kworker/u8:2+events_unbound20:43:282
16686992017,2cyclictest199353-21kworker/u8:1+flush-259:022:35:142
16686992016,3cyclictest219627-21kworker/u8:3+events_unbound23:10:122
16686992016,3cyclictest130737-21kworker/u8:0+events_unbound21:07:272
16683992017,2cyclictest219627-21kworker/u8:3+flush-259:022:25:011
16683992017,2cyclictest219627-21kworker/u8:3+events_unbound22:40:181
16683992016,3cyclictest261392-21kworker/u8:1+events_unbound23:26:291
16683992016,3cyclictest252-21systemd-journal00:29:591
16680992016,3cyclictest4177560-21kworker/u8:2+flush-259:020:50:250
16680992014,4cyclictest235167-21latency_hist22:40:000
16690991916,2cyclictest334693-21kworker/u8:2+events_unbound00:30:223
16690991916,2cyclictest287023-21apt-get23:30:013
16690991916,2cyclictest209415-21kworker/u8:0+flush-259:022:15:203
16690991916,2cyclictest130737-21kworker/u8:0+flush-259:021:05:193
16690991914,4cyclictest173201-21apt-get21:40:113
16690991913,5cyclictest141465-21apt-get21:10:123
16686991916,3cyclictest261392-21kworker/u8:1+events_unbound23:25:122
16686991916,2cyclictest4177560-21kworker/u8:2+flush-259:020:50:182
16686991916,2cyclictest4177560-21kworker/u8:2+events_unbound20:38:272
16686991916,2cyclictest334693-21kworker/u8:2+events_unbound00:29:292
16686991916,2cyclictest156896-21kworker/u8:2+flush-259:021:50:002
16686991916,2cyclictest156896-21kworker/u8:2+flush-259:021:40:212
16683991916,2cyclictest4177560-21kworker/u8:2+events_unbound20:00:201
16683991916,2cyclictest37252-21kworker/u8:3+flush-259:020:15:211
16683991916,2cyclictest318781-21kworker/u8:3+flush-259:000:15:251
16683991916,2cyclictest219627-21kworker/u8:3+events_unbound22:45:221
16680991915,3cyclictest4177560-21kworker/u8:2+flush-259:020:30:230
16680991915,3cyclictest4177560-21kworker/u8:2+flush-259:020:30:220
16680991915,3cyclictest246173-21apt-get22:50:100
16680991915,3cyclictest246173-21apt-get22:50:100
16680991915,3cyclictest199353-21kworker/u8:1+flush-259:022:20:240
16680991914,4cyclictest224834-21kworker/u8:2+flush-259:023:30:240
16680991913,4cyclictest4177560-21kworker/u8:2+flush-259:021:15:180
16680991913,4cyclictest115398-21latency_hist20:45:010
16680991912,5cyclictest349265-21ntpq00:25:200
16680991912,5cyclictest199296-21cat22:05:000
16680991911,5cyclictest214571-21latency_hist22:20:000
16690991815,2cyclictest224834-21kworker/u8:2+events_unbound22:30:213
16690991815,2cyclictest188323-21kworker/u8:1+flush-259:021:56:133
16690991814,3cyclictest298260-21base6423:40:023
16690991814,3cyclictest183476-21/usr/sbin/munin21:50:143
16686991815,2cyclictest37252-21kworker/u8:3+events_unbound20:25:282
16686991815,2cyclictest37252-21kworker/u8:3+events_unbound19:47:232
16686991815,2cyclictest224834-21kworker/u8:2+flush-259:023:05:142
16686991815,2cyclictest130737-21kworker/u8:0+events_unbound22:02:282
16686991814,3cyclictest16464-21kworker/u8:3+events_unbound19:10:142
16686991814,3cyclictest120576-21kworker/u8:1+flush-259:020:55:192
16680991811,5cyclictest260436-21ntpq23:00:190
16690991713,3cyclictest509-21rs:main3
16686991715,2cyclictest141224-21kworker/u8:1+events_unbound21:16:032
16686991713,3cyclictest4177560-21kworker/u8:2+flush-259:019:30:212
16686991713,3cyclictest303100-21kworker/u8:0+events_unbound23:53:202
16686991713,3cyclictest303100-21kworker/u8:0+events_unbound23:46:292
16683991714,2cyclictest224834-21kworker/u8:2+flush-259:022:50:231
16683991714,2cyclictest224834-21kworker/u8:2+flush-259:022:50:231
16683991713,3cyclictest37252-21kworker/u8:3+events_unbound20:35:141
16683991713,3cyclictest156896-21kworker/u8:2+events_unbound21:26:061
16680991713,2cyclictest60350irq/132-enp0s29f1:rx-000:00:190
16680991712,4cyclictest287023-21apt-get23:30:000
16680991712,3cyclictest303100-21kworker/u8:0+flush-259:023:55:000
16680991712,3cyclictest281866-21turbostat23:25:010
16680991712,3cyclictest0-21swapper/020:20:000
16680991711,4cyclictest252-21systemd-journal21:05:000
16680991711,4cyclictest141440-21/usr/sbin/munin21:10:140
16690991614,1cyclictest224834-21kworker/u8:2+events_unbound00:01:303
16690991613,2cyclictest156896-21kworker/u8:2+flush-259:021:35:583
16690991613,2cyclictest156896-21kworker/u8:2+flush-259:021:30:163
16690991613,2cyclictest150490-21kworker/u8:3+flush-259:021:20:253
16690991612,3cyclictest199353-21kworker/u8:1+events_unbound22:35:153
16690991610,4cyclictest252-21systemd-journal00:21:303
16686991613,2cyclictest4177560-21kworker/u8:2+flush-259:020:45:282
16686991613,2cyclictest4177560-21kworker/u8:2+flush-259:019:25:222
16686991613,2cyclictest188323-21kworker/u8:1+flush-259:021:55:222
16686991612,3cyclictest131105-21kworker/u8:4+flush-259:021:00:422
16683991614,2cyclictest4177560-21kworker/u8:2+events_unbound19:54:551
16683991611,3cyclictest252-21systemd-journal21:42:271
1668399161,13cyclictest1-21systemd23:16:271
16680991614,1cyclictest60350irq/132-enp0s29f1:rx-019:30:140
16680991613,2cyclictest60350irq/132-enp0s29f1:rx-021:30:170
16680991613,2cyclictest60350irq/132-enp0s29f1:rx-021:25:250
16680991613,2cyclictest60350irq/132-enp0s29f1:rx-021:20:160
16680991613,2cyclictest60350irq/132-enp0s29f1:rx-000:20:030
16680991612,3cyclictest334693-21kworker/u8:2+events_unbound00:35:140
16690991512,2cyclictest57885-21kworker/u8:4+events_unbound20:02:263
16690991512,2cyclictest224834-21kworker/u8:2+events_unbound22:56:253
16690991512,1cyclictest0-21swapper/321:50:003
16690991511,3cyclictest4177560-21kworker/u8:2+flush-259:019:20:053
16686991512,2cyclictest2131193-21kworker/u8:0+flush-259:019:35:192
16683991512,2cyclictest57885-21kworker/u8:4+events_unbound20:10:441
16680991513,2cyclictest60350irq/132-enp0s29f1:rx-023:09:250
16680991513,2cyclictest60350irq/132-enp0s29f1:rx-021:08:030
16680991513,1cyclictest60350irq/132-enp0s29f1:rx-021:40:140
16680991513,1cyclictest60350irq/132-enp0s29f1:rx-020:20:150
16680991513,1cyclictest60350irq/132-enp0s29f1:rx-020:10:140
16680991513,1cyclictest60350irq/132-enp0s29f1:rx-019:40:170
16680991512,2cyclictest60350irq/132-enp0s29f1:rx-023:55:110
16680991512,2cyclictest60350irq/132-enp0s29f1:rx-022:40:010
16680991512,2cyclictest60350irq/132-enp0s29f1:rx-021:56:100
16680991512,2cyclictest60350irq/132-enp0s29f1:rx-020:45:130
16680991512,2cyclictest60350irq/132-enp0s29f1:rx-000:15:120
16680991512,2cyclictest172947-21turbostat21:40:000
16680991512,2cyclictest0-21swapper/023:40:010
16680991511,3cyclictest95068-21apt-get20:25:120
16680991511,3cyclictest60350irq/132-enp0s29f1:rx-022:55:210
1669099148,4cyclictest360060-21ntpq00:35:243
16690991411,2cyclictest303100-21kworker/u8:0+flush-259:023:45:243
16690991410,3cyclictest37252-21kworker/u8:3+events_unbound20:56:283
16690991410,3cyclictest224834-21kworker/u8:2+flush-259:023:12:493
16686991411,2cyclictest318781-21kworker/u8:3+events_unbound00:05:172
16686991411,2cyclictest2131193-21kworker/u8:0+events_unbound19:43:582
16686991410,3cyclictest324592-21kworker/u8:1+events_unbound00:16:212
1668399148,4cyclictest252-21systemd-journal21:15:001
16683991411,2cyclictest16464-21kworker/u8:3+events_unbound19:11:431
16680991413,1cyclictest60350irq/132-enp0s29f1:rx-019:25:170
16680991413,1cyclictest60350irq/132-enp0s29f1:rx-000:31:190
16680991412,2cyclictest60350irq/132-enp0s29f1:rx-022:28:130
16680991412,2cyclictest60350irq/132-enp0s29f1:rx-019:11:200
16680991412,1cyclictest60350irq/132-enp0s29f1:rx-023:48:200
16680991412,1cyclictest60350irq/132-enp0s29f1:rx-021:50:130
16680991412,1cyclictest60350irq/132-enp0s29f1:rx-020:07:250
16680991411,2cyclictest60350irq/132-enp0s29f1:rx-019:35:220
16680991411,2cyclictest60350irq/132-enp0s29f1:rx-000:07:480
16680991410,2cyclictest0-21swapper/023:10:170
1669099139,3cyclictest74442-21apt-get20:05:113
1669099139,3cyclictest219627-21kworker/u8:3+flush-259:023:15:483
16690991311,2cyclictest334693-21kworker/u8:2+events_unbound00:27:103
16690991310,2cyclictest246581-21irqcore22:50:153
16690991310,2cyclictest246581-21irqcore22:50:153
16690991310,2cyclictest141224-21kworker/u8:1+flush-259:021:15:263
1668699139,3cyclictest324592-21kworker/u8:1+events_unbound00:24:562
1668699139,3cyclictest229987-21latency_hist22:35:002
1669099129,3cyclictest4177560-21kworker/u8:2+events_unbound19:34:133
1669099129,2cyclictest37252-21kworker/u8:3+events_unbound20:18:253
1669099129,2cyclictest131105-21kworker/u8:4+flush-259:021:01:023
1668099121,2cyclictest16682-21cat19:10:010
1668099119,1cyclictest60350irq/132-enp0s29f1:rx-023:40:200
1668699105,3cyclictest350588-21diskstats00:30:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional