You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-09 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Sat May 09, 2026 00:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
886503995447,5cyclictest1167015-21cat23:40:002
886500994037,2cyclictest1182640-21kworker/u8:2+events_unbound00:00:001
886500994036,3cyclictest975115-21gpgv20:35:011
886498994037,2cyclictest1047574-21kworker/u8:1+flush-259:022:25:000
886508993731,4cyclictest1010580-21ntpq21:05:203
886503993732,3cyclictest252-21systemd-journal23:41:142
886503993731,4cyclictest980567-21latency_hist20:40:012
886500993725,10cyclictest1011703-21apt-get21:10:091
886508993631,3cyclictest252-21systemd-journal23:55:003
886500993530,2cyclictest1161983-21apt-get23:35:111
886508993430,2cyclictest871365-21kworker/u8:0+flush-259:019:15:153
886503993430,3cyclictest1089462-21apt-get22:25:102
886503993429,4cyclictest1078498-21apt-get22:15:012
886503993428,4cyclictest1130824-21latency_hist23:05:012
886508993329,3cyclictest1063015-21kworker/u8:3+flush-259:022:15:243
886503993330,2cyclictest1047574-21kworker/u8:1+flush-259:021:55:232
886503993326,5cyclictest995996-21latency_hist20:55:012
886498993227,3cyclictest1-21systemd21:53:130
886498993128,2cyclictest1047574-21kworker/u8:1+flush-259:022:10:210
886508993026,3cyclictest1021252-21kworker/u8:0+events_unbound22:50:153
886503993026,3cyclictest848472-21kworker/u8:2+flush-259:020:00:182
886503993026,3cyclictest848472-21kworker/u8:2+flush-259:019:45:252
886498993027,2cyclictest871365-21kworker/u8:0+flush-259:020:05:240
886498993027,2cyclictest848472-21kworker/u8:2+events_unbound19:42:140
886498993026,3cyclictest3030831-21kworker/u8:1+events_unbound19:27:110
886498993023,5cyclictest252-21systemd-journal22:17:130
886498992925,3cyclictest1166884-21kworker/u8:1+events_unbound23:40:150
886498992825,2cyclictest1047574-21kworker/u8:1+flush-259:022:05:000
886498992824,3cyclictest3030831-21kworker/u8:1+events_unbound19:20:010
886508992722,3cyclictest1219346-21kworker/u8:2+flush-259:000:30:183
886503992721,4cyclictest912675-21apt-get19:35:002
886500992722,3cyclictest1099763-21apt-get22:35:111
886498992724,3cyclictest954602-21kworker/u8:1+events_unbound20:26:150
886498992724,2cyclictest1166884-21kworker/u8:1+events_unbound23:45:210
886498992724,2cyclictest1089243-21kworker/u8:2+events_unbound22:40:210
886498992724,2cyclictest1021252-21kworker/u8:0+events_unbound21:30:150
886508992620,4cyclictest252-21systemd-journal19:30:143
886503992622,3cyclictest1047574-21kworker/u8:1+events_unbound21:51:152
886498992623,2cyclictest1047574-21kworker/u8:1+events_unbound21:55:210
886498992622,3cyclictest964357-21kworker/u8:2+events_unbound20:55:140
886498992622,3cyclictest1172698-21kworker/u8:0+events_unbound23:58:130
886508992518,5cyclictest1031186-21ntpq21:25:213
886503992521,3cyclictest1198856-21kworker/u8:4+events_unbound00:15:092
886503992521,3cyclictest1188316-21kworker/u8:3+flush-259:000:03:162
886498992522,2cyclictest1011466-21kworker/u8:3+flush-259:021:22:280
886498992521,3cyclictest1021252-21kworker/u8:0+events_unbound22:28:150
886508992417,4cyclictest996015-21kworker/u8:1+flush-259:021:15:173
886503992421,2cyclictest1089243-21kworker/u8:2+events_unbound22:55:212
886503992420,3cyclictest964357-21kworker/u8:2+events_unbound21:00:152
886500992419,4cyclictest975685-21apt-get20:35:111
886500992419,4cyclictest959822-21apt-get20:20:131
886500992417,5cyclictest1208158-21ntpq00:15:221
886498992422,2cyclictest1026910-21kworker/u8:2+events_unbound21:38:150
886498992421,2cyclictest1166884-21kworker/u8:1+flush-259:000:35:260
886498992421,2cyclictest1021252-21kworker/u8:0+events_unbound21:17:150
886498992420,3cyclictest954634-21apt-get20:15:100
886498992420,3cyclictest1109845-21kworker/u8:1+events_unbound23:02:470
886508992319,3cyclictest996015-21kworker/u8:1+flush-259:021:10:153
886508992317,4cyclictest886451-21kworker/u8:3+flush-259:020:00:003
886508992317,4cyclictest1110460-21/usr/sbin/munin22:45:143
886508992317,4cyclictest1021252-21kworker/u8:0+flush-259:021:30:163
886508992316,5cyclictest1229664-21latency_hist00:40:003
886508992315,5cyclictest918691-21diskstats19:40:143
886503992320,2cyclictest871365-21kworker/u8:0+flush-259:019:40:252
886503992320,2cyclictest1209062-21kworker/u8:0+flush-259:000:25:242
886503992319,3cyclictest964357-21kworker/u8:2+events_unbound20:44:152
886503992318,4cyclictest1026911-21latency_hist21:25:002
886500992318,4cyclictest934013-21apt-get19:55:121
886498992320,2cyclictest3030831-21kworker/u8:1+events_unbound19:30:230
886498992320,2cyclictest1198856-21kworker/u8:4+flush-259:000:13:180
886498992320,2cyclictest1130847-21kworker/u8:4+flush-259:023:30:210
886498992319,3cyclictest996015-21kworker/u8:1+events_unbound21:12:280
886508992216,4cyclictest913524-21diskstats19:35:133
886508992215,5cyclictest959566-21latency_hist20:20:013
886503992219,2cyclictest964357-21kworker/u8:2+events_unbound20:47:152
886503992219,2cyclictest871365-21kworker/u8:0+flush-259:019:20:202
886503992219,1cyclictest0-21swapper/220:10:002
886503992218,3cyclictest964357-21kworker/u8:2+flush-259:020:55:162
886503992217,3cyclictest1146524-21apt-get23:20:102
886500992218,3cyclictest1110396-21base6422:45:011
886500992217,3cyclictest1006265-21munin-run21:05:011
886498992220,2cyclictest1130847-21kworker/u8:4+events_unbound23:12:130
886498992219,2cyclictest969860-21kworker/u8:3+events_unbound20:30:140
886498992219,2cyclictest964357-21kworker/u8:2+events_unbound21:05:130
886498992219,2cyclictest1099262-21kworker/u8:3+flush-259:022:35:000
886508992118,2cyclictest1125673-21idleruntime-cro23:00:003
886508992117,3cyclictest1047574-21kworker/u8:1+flush-259:022:10:233
886508992116,3cyclictest1089243-21kworker/u8:2+flush-259:023:20:143
886508992115,4cyclictest1188316-21kworker/u8:3+flush-259:000:05:253
886508992115,4cyclictest1021252-21kworker/u8:0+events_unbound21:45:123
886503992118,2cyclictest886451-21kworker/u8:3+events_unbound19:15:252
886503992118,2cyclictest871365-21kworker/u8:0+flush-259:019:25:242
886503992118,2cyclictest1047574-21kworker/u8:1+events_unbound22:10:202
886503992116,4cyclictest1089243-21kworker/u8:2+flush-259:023:15:212
886500992117,3cyclictest1099262-21kworker/u8:3+flush-259:022:45:001
886500992115,4cyclictest897481-21apt-get19:20:101
886498992119,1cyclictest886451-21kworker/u8:3+flush-259:019:35:210
886498992117,3cyclictest964357-21kworker/u8:2+flush-259:020:40:220
886498992116,4cyclictest1218439-21ntpq00:25:210
886508992017,2cyclictest891602-21cron19:14:593
886508992014,4cyclictest1209469-21diskstats00:20:143
886508992014,4cyclictest1209469-21diskstats00:20:133
886503992017,3cyclictest871365-21kworker/u8:0+events_unbound19:12:092
886503992017,2cyclictest871365-21kworker/u8:0+events_unbound20:10:212
886503992017,2cyclictest1188316-21kworker/u8:3+events_unbound00:10:132
886503992017,2cyclictest1166884-21kworker/u8:1+flush-259:023:45:152
886503992016,3cyclictest996015-21kworker/u8:1+events_unbound21:15:142
886503992016,3cyclictest1026910-21kworker/u8:2+events_unbound21:26:152
886503992016,3cyclictest1011466-21kworker/u8:3+events_unbound21:49:142
886500992016,3cyclictest1109845-21kworker/u8:1+flush-259:023:05:001
886500992015,3cyclictest252-21systemd-journal23:10:001
886498992017,2cyclictest886451-21kworker/u8:3+events_unbound19:10:130
886498992017,2cyclictest1109845-21kworker/u8:1+flush-259:023:00:000
886498992016,3cyclictest1209308-21apt-get00:20:100
886498992016,3cyclictest1209308-21apt-get00:20:100
886508991915,3cyclictest252-21systemd-journal23:17:503
886508991915,3cyclictest1058561-21irqcore21:55:153
886508991914,3cyclictest939173-21apt-get20:00:113
886508991914,3cyclictest1131086-21apt-get23:05:113
886503991917,1cyclictest1109845-21kworker/u8:1+events_unbound22:49:142
886503991916,3cyclictest964357-21kworker/u8:2+flush-259:021:05:232
886503991916,2cyclictest871365-21kworker/u8:0+events_unbound19:38:132
886503991916,2cyclictest848472-21kworker/u8:2+events_unbound19:50:142
886503991915,3cyclictest954602-21kworker/u8:1+events_unbound20:15:192
886503991915,3cyclictest1109845-21kworker/u8:1+flush-259:022:50:212
886503991915,3cyclictest1021252-21kworker/u8:0+flush-259:021:35:202
886500991915,3cyclictest928851-21apt-get19:50:121
886498991917,2cyclictest1120547-21kworker/u8:3+events_unbound23:07:490
886498991916,2cyclictest1219346-21kworker/u8:2+events_unbound00:30:120
886508991815,2cyclictest1063679-21irqcore22:00:163
886503991815,2cyclictest0-21swapper/220:30:002
886503991815,1cyclictest0-21swapper/200:40:002
886503991814,3cyclictest1182640-21kworker/u8:2+flush-259:023:55:202
886503991814,3cyclictest1130847-21kworker/u8:4+events_unbound23:10:152
886503991814,3cyclictest1120547-21kworker/u8:3+events_unbound23:05:222
886500991815,2cyclictest1188316-21kworker/u8:3+flush-259:000:20:201
886500991815,2cyclictest1188316-21kworker/u8:3+flush-259:000:20:201
886500991814,3cyclictest871365-21kworker/u8:0+flush-259:019:45:171
886500991812,4cyclictest252-21systemd-journal20:49:131
886498991816,2cyclictest848472-21kworker/u8:2+events_unbound19:45:200
886498991816,2cyclictest1047574-21kworker/u8:1+events_unbound22:05:260
886498991816,2cyclictest1047574-21kworker/u8:1+events_unbound22:05:260
886498991816,2cyclictest1021252-21kworker/u8:0+events_unbound21:45:200
886498991815,2cyclictest1089243-21kworker/u8:2+events_unbound22:35:260
88650899179,6cyclictest954366-21latency_hist20:15:013
886508991712,3cyclictest1091763-21ps22:25:173
886503991714,2cyclictest933978-21kworker/u8:1+events_unbound19:55:142
886503991713,3cyclictest1166884-21kworker/u8:1+events_unbound23:50:142
886503991713,3cyclictest1099262-21kworker/u8:3+events_unbound22:32:442
886503991713,3cyclictest1047574-21kworker/u8:1+events_unbound22:07:372
886503991713,3cyclictest1047574-21kworker/u8:1+events_unbound22:07:372
886500991715,1cyclictest0-21swapper/120:45:001
886498991714,3cyclictest1109845-21kworker/u8:1+flush-259:022:51:490
886498991712,4cyclictest252-21systemd-journal00:03:120
886503991612,3cyclictest1219346-21kworker/u8:2+events_unbound00:33:352
886503991612,3cyclictest1209062-21kworker/u8:0+flush-259:000:20:162
886503991612,3cyclictest1209062-21kworker/u8:0+flush-259:000:20:152
886503991612,3cyclictest1021252-21kworker/u8:0+events_unbound21:42:352
886500991614,1cyclictest1078509-21idleruntime-cro22:15:001
886500991611,3cyclictest252-21systemd-journal22:51:131
886500991610,4cyclictest1068412-21apt-get22:05:111
886500991610,4cyclictest1068412-21apt-get22:05:111
886498991613,2cyclictest886451-21kworker/u8:3+events_unbound20:04:590
88650899158,5cyclictest1172471-21latency_hist23:45:013
886508991513,1cyclictest998541-21kthreadcore20:55:173
886508991511,3cyclictest1172698-21kworker/u8:0+flush-259:023:58:423
886508991511,3cyclictest1130847-21kworker/u8:4+flush-259:023:30:013
886508991511,3cyclictest1025978-21ntp_kernel_err21:20:183
88650099159,4cyclictest1089204-21latency_hist22:25:001
886500991511,2cyclictest1167968-21irqcore23:40:151
886500991510,4cyclictest509-21rs:main1
886498991513,1cyclictest0-21swapper/023:40:000
886498991512,2cyclictest0-21swapper/020:50:000
886498991511,3cyclictest1188316-21kworker/u8:3+flush-259:000:05:200
88650899149,4cyclictest1021252-21kworker/u8:0+flush-259:021:40:253
886508991412,1cyclictest0-21swapper/320:30:003
886508991410,2cyclictest0-21swapper/323:40:003
886508991410,2cyclictest0-21swapper/320:35:003
886503991411,2cyclictest974158-21ntp_offset20:30:222
886503991411,2cyclictest1130847-21kworker/u8:4+events_unbound23:32:152
88650099149,4cyclictest912781-21cp19:35:001
88650099148,4cyclictest944073-21latency_hist20:05:001
886500991412,1cyclictest897120-21apt-key19:20:011
886500991411,2cyclictest965007-21cpuspeed_turbos20:25:131
886500991411,2cyclictest1022413-21irqcore21:20:141
886500991411,2cyclictest0-21swapper/122:20:001
886500991410,3cyclictest1021252-21kworker/u8:0+flush-259:021:45:001
88650099140,13cyclictest1-21systemd20:06:131
88649899149,4cyclictest1001376-21apt-get21:00:120
886498991413,1cyclictest60350irq/132-enp0s29f1:rx-020:51:540
886498991413,1cyclictest60350irq/132-enp0s29f1:rx-020:20:350
886498991412,2cyclictest60350irq/132-enp0s29f1:rx-021:42:480
886498991412,1cyclictest60350irq/132-enp0s29f1:rx-023:25:230
886498991412,1cyclictest60350irq/132-enp0s29f1:rx-020:35:100
886498991412,1cyclictest60350irq/132-enp0s29f1:rx-019:50:180
886498991411,2cyclictest1109845-21kworker/u8:1+flush-259:023:17:520
886498991411,2cyclictest1026910-21kworker/u8:2+flush-259:021:27:400
88650899139,3cyclictest1214453-21apt-get00:25:103
88650899139,3cyclictest1188792-21fschecks_time00:00:143
88650899138,3cyclictest923690-21apt-get19:45:123
88650899137,4cyclictest871365-21kworker/u8:0+flush-259:020:20:253
88650899136,5cyclictest901307-21memory19:20:193
88650899131,3cyclictest949273-21awk20:09:593
886503991311,2cyclictest1021252-21kworker/u8:0+events_unbound22:00:172
886503991310,2cyclictest1021252-21kworker/u8:0+events_unbound21:30:172
88650099139,3cyclictest1021252-21kworker/u8:0+flush-259:021:30:051
88650099138,4cyclictest252-21systemd-journal19:15:001
886500991311,1cyclictest0-21swapper/123:20:201
886500991310,2cyclictest1067726-21unixbench_singl22:00:251
886500991310,2cyclictest1000671-21unixbench_singl20:55:231
886498991312,1cyclictest60350irq/132-enp0s29f1:rx-019:55:140
886498991312,1cyclictest60350irq/132-enp0s29f1:rx-000:15:240
886498991311,1cyclictest60350irq/132-enp0s29f1:rx-022:45:450
886498991310,2cyclictest60350irq/132-enp0s29f1:rx-023:20:150
88650899129,2cyclictest980547-21cron20:40:003
88650899129,1cyclictest0-21swapper/323:10:153
88650899128,2cyclictest0-21swapper/322:45:003
88650899127,4cyclictest964357-21kworker/u8:2+flush-259:020:45:243
88650899127,3cyclictest964357-21kworker/u8:2+flush-259:020:40:243
88650899126,4cyclictest1021252-21kworker/u8:0+flush-259:021:35:153
88650899125,5cyclictest1099969-21uniq22:35:143
88650899121,3cyclictest1006259-21awk21:05:003
88650399129,2cyclictest1193792-21cpuspeed_turbos00:05:132
88650399129,2cyclictest1099262-21kworker/u8:3+events_unbound22:37:432
88650099129,2cyclictest1216743-21kthreadcore00:25:181
88650099129,2cyclictest1017287-21irqcore21:15:171
88650099129,2cyclictest0-21swapper/122:30:001
886500991210,1cyclictest0-21swapper/123:50:171
88649899129,2cyclictest944303-21kworker/u8:4+flush-259:020:10:160
88649899129,2cyclictest871365-21kworker/u8:0+flush-259:019:15:090
88650899118,2cyclictest0-21swapper/319:50:233
88650899115,4cyclictest991283-21diskstats20:50:123
88650099116,3cyclictest1198890-21apt-get00:10:101
88650899108,1cyclictest0-21swapper/322:20:213
88650899107,2cyclictest1172994-21fschecks_time23:45:143
88650899104,4cyclictest1204391-21fw_forwarded_lo00:15:153
88650899100,9cyclictest1203916-21cat00:15:003
88650899100,2cyclictest1161721-21latency_hist23:35:003
88650399108,1cyclictest0-21swapper/220:25:002
88650099108,1cyclictest0-21swapper/121:55:111
88650099107,2cyclictest1094850-21fschecks_time22:30:141
88650099106,3cyclictest954602-21kworker/u8:1+flush-259:020:15:141
88650099106,3cyclictest1130847-21kworker/u8:4+flush-259:023:30:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional