You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-10 - 12:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun May 10, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
4087925995447,5cyclictest142656-21cp23:10:003
4087922994844,3cyclictest4039763-21kworker/u8:2+events_unbound20:55:222
4087922994635,4cyclictest4072759-21kworker/u8:3+flush-259:019:30:012
4087922994440,3cyclictest4039763-21kworker/u8:2+flush-259:021:15:252
4087916994341,1cyclictest18518-21kworker/u8:1+flush-259:000:15:250
4087925994234,7cyclictest18518-21kworker/u8:1+flush-259:000:30:013
4087922994238,3cyclictest65072-21kworker/u8:3+flush-259:022:25:202
4087922994138,2cyclictest18518-21kworker/u8:1+events_unbound23:35:242
4087922994137,3cyclictest179451-21kworker/u8:3+flush-259:000:00:012
4087916994138,2cyclictest18518-21kworker/u8:1+flush-259:023:20:000
4087922994036,3cyclictest4039763-21kworker/u8:2+flush-259:020:00:192
4087919994037,2cyclictest179451-21kworker/u8:3+flush-259:023:50:001
4087922993733,3cyclictest18518-21kworker/u8:1+events_unbound00:15:212
4087922993531,3cyclictest4171096-21kworker/u8:4+events_unbound20:45:222
4087922993531,3cyclictest4039763-21kworker/u8:2+flush-259:021:00:262
4087922993531,3cyclictest4039763-21kworker/u8:2+flush-259:020:10:262
4087925993431,2cyclictest4039763-21kworker/u8:2+flush-259:020:05:003
4087925993431,2cyclictest18518-21kworker/u8:1+events_unbound21:55:203
4087922993430,3cyclictest18518-21kworker/u8:1+events_unbound23:13:262
4087919993428,5cyclictest17602-21ntpq21:05:221
4087919993428,5cyclictest106760-21apt-get22:35:121
4087925993327,5cyclictest4165649-21gpgv20:25:003
4087922993329,3cyclictest4072759-21kworker/u8:3+events_unbound19:15:232
4087922993326,5cyclictest252-21systemd-journal22:05:002
4087925993226,5cyclictest4098197-21latency_hist19:20:013
4087922993228,3cyclictest4072759-21kworker/u8:3+events_unbound19:57:332
4087922993228,3cyclictest18518-21kworker/u8:1+events_unbound23:23:102
4087919993226,4cyclictest85704-21/usr/sbin/munin22:15:231
4087919993225,5cyclictest106500-21latency_hist22:35:001
4087925993128,2cyclictest3267-21/usr/sbin/munin20:55:233
4087925993128,2cyclictest101301-21kworker/u8:2+events_unbound23:15:003
4087922993127,3cyclictest4039763-21kworker/u8:2+events_unbound19:53:252
4087922993127,3cyclictest18518-21kworker/u8:1+flush-259:022:10:242
4087922993127,3cyclictest18518-21kworker/u8:1+flush-259:021:35:212
4087922993027,2cyclictest4072759-21kworker/u8:3+events_unbound19:47:262
4087922993027,2cyclictest4039763-21kworker/u8:2+events_unbound20:08:262
4087922993026,3cyclictest4039763-21kworker/u8:2+events_unbound19:12:292
4087922993026,3cyclictest18518-21kworker/u8:1+events_unbound23:15:202
4087922993026,3cyclictest101301-21kworker/u8:2+events_unbound23:34:252
4087916993026,3cyclictest101301-21kworker/u8:2+flush-259:023:00:200
4087925992925,3cyclictest101301-21kworker/u8:2+flush-259:023:40:003
4087922992925,3cyclictest33611-21kworker/u8:0+events_unbound21:25:222
4087922992925,3cyclictest101301-21kworker/u8:2+flush-259:022:30:242
4087922992925,3cyclictest101301-21kworker/u8:2+events_unbound23:40:212
4087919992925,3cyclictest4114191-21rred19:35:021
4087919992925,3cyclictest4039763-21kworker/u8:2+flush-259:020:55:251
4087925992825,2cyclictest33611-21kworker/u8:0+events_unbound21:35:013
4087925992817,9cyclictest18518-21kworker/u8:1+flush-259:022:50:003
4087922992825,2cyclictest18518-21kworker/u8:1+events_unbound00:25:222
4087922992824,3cyclictest4072759-21kworker/u8:3+events_unbound19:21:252
4087919992824,3cyclictest215802-21apt-get00:20:131
4087919992823,3cyclictest4113635-21gpgv19:35:001
4087916992825,2cyclictest4072759-21kworker/u8:3+flush-259:019:20:220
4087925992723,3cyclictest4191749-21latency_hist20:50:013
4087922992723,3cyclictest4072759-21kworker/u8:3+events_unbound19:41:252
4087922992723,3cyclictest18518-21kworker/u8:1+flush-259:000:05:182
4087922992722,4cyclictest18518-21kworker/u8:1+flush-259:022:05:162
4087922992722,3cyclictest101301-21kworker/u8:2+flush-259:023:00:212
4087916992724,2cyclictest101301-21kworker/u8:2+flush-259:022:40:200
4087916992723,3cyclictest4181685-21apt-get20:40:120
4087916992723,3cyclictest4166064-21base6420:25:010
4087916992722,4cyclictest8195-21latency_hist21:00:010
4087922992623,2cyclictest101301-21kworker/u8:2+events_unbound22:40:202
4087922992622,3cyclictest18518-21kworker/u8:1+events_unbound22:58:062
4087922992622,3cyclictest18518-21kworker/u8:1+events_unbound00:10:252
4087922992621,3cyclictest54781-21apt-get21:45:122
4087919992622,3cyclictest95808-21kworker/u8:0+flush-259:022:25:251
4087919992622,3cyclictest4129495-21kworker/u8:1+events_unbound20:05:201
4087916992623,2cyclictest4150040-21kworker/u8:0+events_unbound20:16:260
4087916992622,3cyclictest18518-21kworker/u8:1+flush-259:023:40:220
4087916992621,4cyclictest204354-21ntpq00:05:210
4087916992619,5cyclictest84551-21ntpq22:10:210
4087925992521,3cyclictest18518-21kworker/u8:1+events_unbound00:31:273
4087922992522,2cyclictest4171096-21kworker/u8:4+events_unbound20:40:232
4087922992522,2cyclictest4072759-21kworker/u8:3+flush-259:019:30:262
4087922992521,3cyclictest54747-21kworker/u8:2+events_unbound21:50:122
4087919992522,2cyclictest4039763-21kworker/u8:2+events_unbound21:00:241
4087919992522,2cyclictest18518-21kworker/u8:1+flush-259:023:50:241
4087919992522,2cyclictest18518-21kworker/u8:1+flush-259:000:20:001
4087919992521,3cyclictest4039763-21kworker/u8:2+flush-259:019:10:261
4087919992518,5cyclictest28802-21latency_hist21:20:011
4087916992521,3cyclictest18758-21apt-get21:10:120
4087922992420,3cyclictest179451-21kworker/u8:3+flush-259:000:00:212
4087922992419,4cyclictest18518-21kworker/u8:1+events_unbound21:20:182
4087922992419,3cyclictest252-21systemd-journal20:15:232
4087922992418,2cyclictest18518-21kworker/u8:1+events_unbound23:05:182
4087919992419,3cyclictest4165530-21latency_hist20:25:011
4087919992418,4cyclictest4166219-21apt-get20:25:111
4087916992421,2cyclictest18518-21kworker/u8:1+events_unbound23:35:230
4087916992421,2cyclictest18518-21kworker/u8:1+events_unbound21:50:200
4087925992319,3cyclictest18518-21kworker/u8:1+events_unbound22:05:233
4087922992320,2cyclictest4039763-21kworker/u8:2+events_unbound21:10:272
4087922992320,2cyclictest226339-21kworker/u8:0+flush-259:000:35:232
4087922992320,2cyclictest18518-21kworker/u8:1+flush-259:023:25:142
4087922992320,2cyclictest179451-21kworker/u8:3+flush-259:000:30:202
4087922992319,3cyclictest4186602-21kworker/u8:3+events_unbound21:07:262
4087922992319,3cyclictest4171096-21kworker/u8:4+flush-259:020:37:262
4087922992319,3cyclictest4171096-21kworker/u8:4+flush-259:020:37:262
4087919992321,1cyclictest18518-21kworker/u8:1+events_unbound21:20:241
4087916992317,5cyclictest142472-21latency_hist23:10:000
4087916992317,4cyclictest49357-21latency_hist21:40:010
4087916992317,4cyclictest4160771-21diskstats20:20:130
4087925992219,2cyclictest4039763-21kworker/u8:2+flush-259:020:25:213
4087925992218,3cyclictest179451-21kworker/u8:3+events_unbound00:20:213
4087925992215,4cyclictest252-21systemd-journal21:04:243
4087922992217,4cyclictest4072759-21kworker/u8:3+flush-259:019:35:172
4087919992218,3cyclictest153462-21apt-get23:20:131
4087919992217,3cyclictest70244-21apt-get22:00:121
4087916992218,3cyclictest4150040-21kworker/u8:0+events_unbound20:47:400
4087916992217,4cyclictest231502-21apt-get00:35:000
4087916992216,4cyclictest4118354-21ntpq19:35:220
4087925992117,3cyclictest4150040-21kworker/u8:0+events_unbound20:35:233
4087925992117,3cyclictest4150040-21kworker/u8:0+events_unbound20:35:233
4087925992116,4cyclictest101301-21kworker/u8:2+flush-259:022:35:233
4087925992115,4cyclictest59680-21latency_hist21:50:013
4087922992118,2cyclictest18518-21kworker/u8:1+events_unbound23:50:252
4087922992117,3cyclictest18518-21kworker/u8:1+events_unbound21:40:192
4087919992117,3cyclictest34174-21apt-get21:25:101
4087919992117,3cyclictest18518-21kworker/u8:1+events_unbound22:10:181
4087916992114,5cyclictest167823-21ntpq23:30:220
4087925992017,2cyclictest4039763-21kworker/u8:2+events_unbound20:30:183
4087925992017,2cyclictest4039763-21kworker/u8:2+events_unbound20:30:173
4087925992017,2cyclictest179451-21kworker/u8:3+events_unbound00:35:013
4087925992016,3cyclictest18518-21kworker/u8:1+flush-259:023:00:003
4087922992016,3cyclictest65072-21kworker/u8:3+events_unbound22:20:142
4087922992016,3cyclictest4150040-21kworker/u8:0+events_unbound20:25:282
4087922992016,3cyclictest179451-21kworker/u8:3+flush-259:000:20:162
4087919992017,2cyclictest65072-21kworker/u8:3+events_unbound22:20:221
4087919992015,3cyclictest179451-21kworker/u8:3+flush-259:000:30:161
4087916992017,3cyclictest101301-21kworker/u8:2+events_unbound22:55:160
4087916992017,2cyclictest4039763-21kworker/u8:2+events_unbound21:15:220
4087916992017,2cyclictest18518-21kworker/u8:1+flush-259:022:00:250
4087916992016,3cyclictest4171096-21kworker/u8:4+events_unbound20:50:160
4087916992016,3cyclictest4093050-21kworker/u8:0+events_unbound19:18:250
4087916992016,3cyclictest33611-21kworker/u8:0+flush-259:021:25:160
4087925991916,2cyclictest18518-21kworker/u8:1+events_unbound23:15:233
4087925991915,3cyclictest18518-21kworker/u8:1+flush-259:000:15:163
4087922991915,3cyclictest4039763-21kworker/u8:2+flush-259:020:30:152
4087922991915,3cyclictest4039763-21kworker/u8:2+flush-259:020:30:152
4087919991915,3cyclictest4072759-21kworker/u8:3+flush-259:019:50:211
4087919991914,4cyclictest4176496-21/usr/sbin/munin20:35:141
4087919991914,4cyclictest4176496-21/usr/sbin/munin20:35:141
4087919991913,4cyclictest4144879-21latency_hist20:05:001
4087916991916,2cyclictest101301-21kworker/u8:2+events_unbound23:20:190
4087916991915,3cyclictest4129495-21kworker/u8:1+events_unbound20:00:220
4087916991915,3cyclictest179451-21kworker/u8:3+events_unbound00:22:400
4087916991914,4cyclictest252-21systemd-journal00:15:000
4087916991914,3cyclictest69965-21cron22:00:000
408791699191,16cyclictest1-21systemd19:31:240
4087925991815,2cyclictest96457-21apt-get22:25:113
4087925991815,2cyclictest18518-21kworker/u8:1+events_unbound21:20:223
4087925991814,3cyclictest4186602-21kworker/u8:3+events_unbound21:05:253
4087922991814,3cyclictest4171096-21kworker/u8:4+flush-259:020:50:192
4087922991813,3cyclictest252-21systemd-journal22:52:252
4087922991813,3cyclictest252-21systemd-journal22:52:242
4087919991815,2cyclictest18518-21kworker/u8:1+flush-259:021:55:241
4087919991814,3cyclictest4134898-21apt-get19:55:121
4087919991814,3cyclictest18518-21kworker/u8:1+flush-259:022:55:001
4087919991814,3cyclictest18518-21kworker/u8:1+flush-259:022:55:001
4087916991815,2cyclictest4039763-21kworker/u8:2+flush-259:019:55:230
4087916991814,3cyclictest4186602-21kworker/u8:3+events_unbound21:05:190
4087916991814,3cyclictest18518-21kworker/u8:1+flush-259:022:35:200
4087916991814,3cyclictest179451-21kworker/u8:3+events_unbound00:03:150
4087916991814,2cyclictest86153-21irqcore22:15:170
4087925991715,1cyclictest0-21swapper/319:55:003
4087925991713,3cyclictest18518-21kworker/u8:1+flush-259:023:50:153
4087925991712,4cyclictest4093030-21latency_hist19:15:013
4087922991713,3cyclictest18518-21kworker/u8:1+events_unbound21:30:192
4087919991714,2cyclictest59677-21idleruntime-cro21:50:001
4087919991714,2cyclictest3015-21idleruntime-cro20:55:001
4087919991713,3cyclictest18518-21kworker/u8:1+flush-259:022:05:251
4087919991712,4cyclictest174526-21apt-get23:40:101
4087916991715,2cyclictest101301-21kworker/u8:2+events_unbound22:45:230
4087916991713,3cyclictest54747-21kworker/u8:2+events_unbound21:45:220
4087916991713,3cyclictest18518-21kworker/u8:1+flush-259:021:40:260
4087916991713,3cyclictest18518-21kworker/u8:1+flush-259:021:20:160
4087916991712,4cyclictest4039763-21kworker/u8:2+events_unbound20:09:260
4087925991613,2cyclictest4171096-21kworker/u8:4+events_unbound20:50:183
4087925991613,2cyclictest4072759-21kworker/u8:3+flush-259:019:30:213
4087925991613,2cyclictest18518-21kworker/u8:1+events_unbound00:05:223
4087925991612,3cyclictest4155467-21apt-get20:15:123
4087925991612,3cyclictest18518-21kworker/u8:1+events_unbound21:40:233
4087919991613,2cyclictest4150040-21kworker/u8:0+events_unbound20:15:231
4087919991611,4cyclictest137330-21latency_hist23:05:001
4087919991610,5cyclictest252-21systemd-journal21:40:001
4087916991614,1cyclictest60350irq/132-enp0s29f1:rx-021:30:160
4087916991613,2cyclictest60350irq/132-enp0s29f1:rx-020:35:000
4087916991613,2cyclictest60350irq/132-enp0s29f1:rx-020:35:000
4087916991612,3cyclictest18518-21kworker/u8:1+events_unbound23:48:120
4087916991612,3cyclictest101301-21kworker/u8:2+flush-259:023:10:150
4087916991612,3cyclictest101301-21kworker/u8:2+flush-259:022:35:000
4087925991512,2cyclictest18518-21kworker/u8:1+flush-259:023:30:263
4087925991511,3cyclictest4039763-21kworker/u8:2+events_unbound21:10:213
4087922991513,1cyclictest18518-21kworker/u8:1+events_unbound22:45:162
408791999159,4cyclictest4186586-21latency_hist20:45:011
4087919991512,2cyclictest18518-21kworker/u8:1+flush-259:021:50:151
4087919991511,3cyclictest4039763-21kworker/u8:2+flush-259:021:10:251
4087919991510,3cyclictest252-21systemd-journal19:40:241
4087916991514,1cyclictest60350irq/132-enp0s29f1:rx-022:53:350
4087916991514,1cyclictest60350irq/132-enp0s29f1:rx-022:53:350
4087916991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:180
4087916991512,2cyclictest65072-21kworker/u8:3+events_unbound22:25:170
4087916991512,2cyclictest60350irq/132-enp0s29f1:rx-023:53:570
4087916991512,2cyclictest60350irq/132-enp0s29f1:rx-020:10:220
4087916991512,2cyclictest60350irq/132-enp0s29f1:rx-019:40:230
4087916991512,2cyclictest60350irq/132-enp0s29f1:rx-019:12:550
4087916991511,3cyclictest60350irq/132-enp0s29f1:rx-023:55:240
4087916991511,3cyclictest18518-21kworker/u8:1+flush-259:000:25:170
4087916991510,4cyclictest90606-21apt-get22:20:020
408792599149,4cyclictest33611-21kworker/u8:0+events_unbound21:27:253
4087925991412,1cyclictest106498-21cron22:35:003
4087925991410,3cyclictest4039763-21kworker/u8:2+events_unbound20:10:233
4087925991410,3cyclictest18518-21kworker/u8:1+events_unbound22:10:223
4087922991411,2cyclictest179451-21kworker/u8:3+events_unbound23:45:232
4087919991412,1cyclictest0-21swapper/119:20:001
4087919991410,3cyclictest18518-21kworker/u8:1+flush-259:000:25:251
4087916991412,1cyclictest60350irq/132-enp0s29f1:rx-019:53:310
4087916991411,2cyclictest60350irq/132-enp0s29f1:rx-023:27:170
4087916991411,2cyclictest60350irq/132-enp0s29f1:rx-019:47:150
4087916991410,3cyclictest4072759-21kworker/u8:3+events_unbound19:25:230
4087925991311,1cyclictest2971-21cron20:10:003
4087925991311,1cyclictest0-21swapper/322:20:003
4087925991310,2cyclictest95808-21kworker/u8:0+flush-259:022:25:003
4087922991310,2cyclictest0-21swapper/220:25:002
408791999139,3cyclictest101301-21kworker/u8:2+events_unbound23:10:231
408791999138,3cyclictest252-21systemd-journal22:49:241
4087916991310,2cyclictest60350irq/132-enp0s29f1:rx-020:35:180
4087916991310,2cyclictest60350irq/132-enp0s29f1:rx-020:35:180
408792599129,2cyclictest101301-21kworker/u8:2+events_unbound23:40:123
408792299128,3cyclictest54747-21kworker/u8:2+events_unbound22:15:222
408792299128,3cyclictest18518-21kworker/u8:1+events_unbound21:55:262
408791999129,2cyclictest163854-21cpuspeed_turbos23:30:131
408791999128,3cyclictest226339-21kworker/u8:0+flush-259:000:35:171
4087919991210,1cyclictest0-21swapper/100:05:001
4087919991210,1cyclictest0-21swapper/100:00:001
408792599118,2cyclictest0-21swapper/321:20:003
408792599117,2cyclictest0-21swapper/319:30:013
408791999118,2cyclictest148408-21cpuspeed_turbos23:15:131
408791999117,3cyclictest4072759-21kworker/u8:3+events_unbound19:20:211
408791999117,3cyclictest252-21systemd-journal21:44:241
408791999117,3cyclictest252-21systemd-journal21:32:071
408791999111,2cyclictest4103593-21apt-get19:25:131
408792599107,2cyclictest4119572-21cpuspeed_turbos19:40:133
408792599107,2cyclictest0-21swapper/300:10:173
408792599107,1cyclictest0-21swapper/323:55:193
408791999108,1cyclictest0-21swapper/123:40:001
408791999108,1cyclictest0-21swapper/100:05:171
408791999106,3cyclictest4039763-21kworker/u8:2+flush-259:019:45:291
40879259996,2cyclictest18518-21kworker/u8:1+flush-259:021:50:153
40879199997,1cyclictest0-21swapper/122:45:001
40879199996,2cyclictest4171431-21cpuspeed_turbos20:30:131
40879199996,2cyclictest4171431-21cpuspeed_turbos20:30:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional