You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-19 - 12:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Wed Aug 19, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3828700995955,3cyclictest4151811-21gpgv00:20:001
3828695995957,1cyclictest75-21kswapd022:15:020
3828703995247,4cyclictest3964648-21kworker/u8:0+flush-259:021:40:242
3828703995247,3cyclictest3907512-21kworker/u8:0+flush-259:020:40:002
3828703994843,4cyclictest3907512-21kworker/u8:0+flush-259:020:45:012
3828695994740,5cyclictest335557-21systemd-journal22:35:240
3828705994542,2cyclictest3823696-21kworker/u8:4+flush-259:021:00:013
3828705994037,2cyclictest3964648-21kworker/u8:0+flush-259:022:10:003
3828703994036,3cyclictest3860125-21kworker/u8:0+flush-259:020:00:272
3828705993935,3cyclictest4016825-21kworker/u8:2+flush-259:022:30:243
3828700993934,4cyclictest4037976-21apt-get22:30:121
3828700993934,4cyclictest335557-21systemd-journal19:25:551
3828705993734,2cyclictest4006516-21kworker/u8:1+flush-259:022:00:263
3828695993730,6cyclictest4110270-21kworker/u8:2+flush-259:000:15:010
3828695993730,6cyclictest4110270-21kworker/u8:2+flush-259:000:15:000
3828695993631,4cyclictest3828878-21/usr/sbin/munin19:10:150
3828705993532,2cyclictest3865472-21kworker/u8:3+flush-259:019:50:183
3828705993531,3cyclictest75-21kswapd022:15:023
3828705993529,3cyclictest4151608-21latency_hist00:20:003
3828703993531,2cyclictest3823696-21kworker/u8:4+flush-259:021:50:212
3828703993531,2cyclictest3823696-21kworker/u8:4+flush-259:021:50:212
3828700993530,3cyclictest3891759-21base6420:10:001
3828700993529,4cyclictest3876283-21/usr/sbin/munin19:55:171
3828695993431,2cyclictest3823696-21kworker/u8:4+flush-259:022:10:260
3828705993328,4cyclictest4053240-21latency_hist22:45:013
3828705993327,5cyclictest3855195-21apt-get19:35:133
3828700993328,4cyclictest3871152-21apt-get19:50:121
3828695993328,3cyclictest335557-21systemd-journal00:00:010
3828703993227,4cyclictest335557-21systemd-journal23:10:002
3828700993229,2cyclictest3897147-21kworker/u8:2+flush-259:020:40:181
3828700993228,3cyclictest3970346-21kworker/u8:3+flush-259:021:35:201
3828700993227,3cyclictest3985863-21/usr/sbin/munin21:40:141
3828703993127,3cyclictest4152264-21kworker/u8:4+flush-259:000:40:012
3828703993125,4cyclictest3844134-21latency_hist19:25:012
3828700993127,3cyclictest3897147-21kworker/u8:2+flush-259:020:20:251
3828695993128,2cyclictest4110270-21kworker/u8:2+flush-259:000:00:290
3828695993128,2cyclictest3823696-21kworker/u8:4+events_unbound20:55:010
3828705993026,3cyclictest4027608-21kworker/u8:3+flush-259:023:10:003
3828703993026,3cyclictest4022343-21base6422:15:012
3828703993024,4cyclictest3892212-21cp20:10:012
3828700993027,2cyclictest4110270-21kworker/u8:2+flush-259:023:50:181
3828700993025,3cyclictest3849557-21kworker/u8:2+flush-259:019:30:261
3828695993027,2cyclictest4037569-21kworker/u8:0+flush-259:023:15:160
3828705992925,3cyclictest4016825-21kworker/u8:2+flush-259:022:25:253
3828705992925,3cyclictest3823696-21kworker/u8:4+events_unbound19:57:113
3828703992922,5cyclictest4011464-21latency_hist22:05:012
3828700992926,2cyclictest3823696-21kworker/u8:4+flush-259:019:20:201
3828705992825,2cyclictest3938651-21kworker/u8:1+flush-259:021:05:243
3828703992822,2cyclictest4162442-21idleruntime-cro00:30:002
3828700992824,3cyclictest335557-21systemd-journal21:01:141
3828695992823,4cyclictest4114475-21ntpq23:40:200
3828705992722,3cyclictest4136056-21latency_hist00:05:003
3828700992723,2cyclictest4115666-21apt-get23:45:141
3828700992721,4cyclictest4027377-21latency_hist22:20:011
3828695992724,2cyclictest4130893-21kworker/u8:3+flush-259:000:05:290
3828695992721,4cyclictest3928279-21latency_hist20:45:010
3828705992622,3cyclictest3964648-21kworker/u8:0+flush-259:021:55:003
3828705992622,3cyclictest3964648-21kworker/u8:0+flush-259:021:55:003
3828705992622,3cyclictest3780075-21kworker/u8:0+flush-259:019:30:003
3828705992621,3cyclictest4152264-21kworker/u8:4+flush-259:000:25:003
3828703992622,3cyclictest3780075-21kworker/u8:0+flush-259:019:20:002
3828703992622,2cyclictest3860353-21apt-get19:40:152
3828695992623,2cyclictest3964648-21kworker/u8:0+events_unbound21:55:240
3828705992518,5cyclictest4089545-21latency_hist23:20:013
3828703992521,3cyclictest4146668-21apt-get00:15:132
3828695992522,2cyclictest4110270-21kworker/u8:2+events_unbound00:30:110
3828695992521,3cyclictest3897147-21kworker/u8:2+events_unbound21:16:190
3828695992518,5cyclictest4084355-21latency_hist23:15:010
382869599250,24cyclictest1-21systemd00:29:240
3828705992421,2cyclictest3938651-21kworker/u8:1+events_unbound21:05:003
3828703992420,3cyclictest3823696-21kworker/u8:4+flush-259:020:15:262
3828700992419,4cyclictest4011701-21/usr/sbin/munin22:05:151
3828700992419,4cyclictest3897147-21kworker/u8:2+flush-259:020:30:171
3828695992420,3cyclictest3780075-21kworker/u8:0+events_unbound19:20:540
3828705992319,3cyclictest3897147-21kworker/u8:2+flush-259:020:45:243
3828703992319,3cyclictest4110270-21kworker/u8:2+flush-259:000:35:002
3828700992319,2cyclictest3823696-21kworker/u8:4+flush-259:021:30:181
3828695992319,3cyclictest3985644-21kworker/u8:2+events_unbound21:46:260
3828695992319,3cyclictest3823696-21kworker/u8:4+events_unbound21:12:250
3828705992219,2cyclictest3833819-21latency_hist19:14:593
3828705992217,3cyclictest3897147-21kworker/u8:2+events_unbound21:10:223
3828700992218,3cyclictest335557-21systemd-journal00:36:251
3828700992217,3cyclictest3938893-21apt-get20:55:131
3828695992218,3cyclictest3897147-21kworker/u8:2+events_unbound20:49:240
3828695992218,3cyclictest3865472-21kworker/u8:3+events_unbound19:51:250
3828695992218,3cyclictest3849557-21kworker/u8:2+flush-259:019:35:240
3828705992118,2cyclictest4037569-21kworker/u8:0+flush-259:022:55:243
3828705992118,2cyclictest3970346-21kworker/u8:3+events_unbound21:35:223
3828705992118,2cyclictest3897147-21kworker/u8:2+events_unbound20:30:193
3828705992115,4cyclictest4062743-21ntpq22:50:223
3828703992117,3cyclictest3897147-21kworker/u8:2+flush-259:020:45:222
3828703992117,3cyclictest335557-21systemd-journal22:10:002
3828703992116,4cyclictest4037569-21kworker/u8:0+flush-259:023:15:182
3828700992117,3cyclictest4120548-21kworker/u8:1+flush-259:000:25:171
3828700992117,3cyclictest4069065-21apt-get23:00:141
3828700992117,3cyclictest3849557-21kworker/u8:2+flush-259:019:35:161
3828700992117,3cyclictest3823696-21kworker/u8:4+flush-259:019:43:291
3828695992118,2cyclictest3860125-21kworker/u8:0+events_unbound20:05:280
3828695992117,3cyclictest4037569-21kworker/u8:0+events_unbound23:30:010
3828695992117,3cyclictest4016825-21kworker/u8:2+events_unbound22:45:120
3828695992117,3cyclictest3907512-21kworker/u8:0+events_unbound20:35:180
3828695992117,3cyclictest3897147-21kworker/u8:2+events_unbound20:20:210
3828695992117,3cyclictest3780075-21kworker/u8:0+flush-259:019:25:570
3828695992116,4cyclictest4037951-21/usr/sbin/munin22:30:150
3828695992116,4cyclictest335557-21systemd-journal19:20:000
3828695992114,5cyclictest4109359-21ntpq23:35:210
3828705992016,3cyclictest3985644-21kworker/u8:2+events_unbound21:45:173
3828705992016,3cyclictest3980467-21latency_hist21:35:003
3828705992016,3cyclictest3897147-21kworker/u8:2+events_unbound20:36:253
3828705992016,3cyclictest3860125-21kworker/u8:0+flush-259:020:05:263
3828703992017,2cyclictest3912933-21apt-get20:30:122
3828703992015,4cyclictest4079174-21kworker/u8:1+flush-259:023:10:242
3828700992016,3cyclictest4084376-21kworker/u8:4+events_unbound23:30:201
3828700992016,3cyclictest3907512-21kworker/u8:0+events_unbound20:35:261
3828700992015,3cyclictest3860125-21kworker/u8:0+flush-259:020:04:291
3828700992013,4cyclictest335557-21systemd-journal00:30:001
3828695992017,2cyclictest3860125-21kworker/u8:0+events_unbound19:59:250
3828695992017,2cyclictest3823696-21kworker/u8:4+events_unbound21:24:250
3828695992016,3cyclictest3849557-21kworker/u8:2+events_unbound19:30:170
3828695992015,4cyclictest335557-21systemd-journal22:55:000
3828695992013,5cyclictest4156353-21ntpq00:20:210
3828705991915,3cyclictest3881271-21kworker/u8:1+events_unbound20:17:253
3828705991913,4cyclictest335557-21systemd-journal21:20:243
3828703991916,2cyclictest3970346-21kworker/u8:3+flush-259:021:35:002
3828703991916,2cyclictest3823696-21kworker/u8:4+flush-259:019:14:592
3828703991913,5cyclictest4016825-21kworker/u8:2+flush-259:022:50:002
3828700991915,3cyclictest3897147-21kworker/u8:2+flush-259:020:50:001
3828695991913,5cyclictest3869625-21ntpq19:45:230
3828695991912,5cyclictest3944209-21diskstats21:00:150
3828705991815,2cyclictest4037569-21kworker/u8:0+flush-259:023:25:283
3828705991815,2cyclictest3964648-21kworker/u8:0+events_unbound21:43:263
3828705991813,3cyclictest509-21rs:main3
3828705991813,3cyclictest3912675-21latency_hist20:30:013
3828705991813,3cyclictest3892242-21/usr/sbin/munin20:10:153
382870399183,7cyclictest3975322-21munin-run21:30:002
3828703991815,2cyclictest4120548-21kworker/u8:1+flush-259:000:05:202
3828703991814,3cyclictest3897147-21kworker/u8:2+flush-259:021:25:002
3828703991813,4cyclictest3870468-21apt-get19:50:002
3828700991813,4cyclictest3985644-21kworker/u8:2+flush-259:021:45:191
3828695991815,2cyclictest3938651-21kworker/u8:1+events_unbound21:05:220
3828695991814,3cyclictest4037569-21kworker/u8:0+flush-259:023:05:210
3828695991814,3cyclictest4037569-21kworker/u8:0+events_unbound22:55:140
3828695991814,3cyclictest4027608-21kworker/u8:3+events_unbound22:20:260
3828695991814,3cyclictest3823696-21kworker/u8:4+events_unbound20:11:240
3828695991811,5cyclictest3885500-21ntpq20:00:220
3828705991715,1cyclictest3897147-21kworker/u8:2+events_unbound20:20:193
3828705991714,2cyclictest3849557-21kworker/u8:2+events_unbound19:40:293
3828705991714,2cyclictest3823696-21kworker/u8:4+flush-259:019:20:263
3828705991713,3cyclictest4027608-21kworker/u8:3+events_unbound22:35:133
3828703991714,2cyclictest4016825-21kworker/u8:2+flush-259:022:35:002
3828700991712,4cyclictest4027608-21kworker/u8:3+flush-259:022:41:071
3828700991712,4cyclictest335557-21systemd-journal20:15:011
3828700991712,3cyclictest3938651-21kworker/u8:1+events_unbound21:20:251
3828700991711,4cyclictest335557-21systemd-journal22:40:001
3828695991713,3cyclictest4110270-21kworker/u8:2+flush-259:000:15:160
3828705991613,2cyclictest0-21swapper/323:15:003
3828705991610,4cyclictest335557-21systemd-journal21:26:193
3828703991613,2cyclictest500-21systemd-logind23:05:012
3828703991612,3cyclictest4084376-21kworker/u8:4+flush-259:023:30:262
3828700991612,3cyclictest335557-21systemd-journal21:13:241
3828700991611,4cyclictest335557-21systemd-journal20:55:011
382869599169,6cyclictest4094758-21latency_hist23:25:000
3828695991613,2cyclictest60350irq/132-enp0s29f1:rx-023:45:250
3828695991613,2cyclictest60350irq/132-enp0s29f1:rx-021:50:160
3828695991613,2cyclictest60350irq/132-enp0s29f1:rx-021:50:150
3828695991613,2cyclictest60350irq/132-enp0s29f1:rx-020:30:160
3828695991612,3cyclictest4037569-21kworker/u8:0+events_unbound23:27:250
3828695991612,3cyclictest3964648-21kworker/u8:0+events_unbound22:05:230
3828705991513,2cyclictest4016825-21kworker/u8:2+events_unbound22:46:323
3828705991513,2cyclictest3823696-21kworker/u8:4+events_unbound21:15:233
3828705991512,2cyclictest3964648-21kworker/u8:0+events_unbound22:12:263
3828705991511,3cyclictest4152264-21kworker/u8:4+flush-259:000:35:153
3828705991511,3cyclictest4120548-21kworker/u8:1+events_unbound23:55:213
3828705991511,3cyclictest4016825-21kworker/u8:2+events_unbound23:00:233
3828705991511,3cyclictest3897147-21kworker/u8:2+flush-259:020:52:283
3828705991511,3cyclictest3860125-21kworker/u8:0+flush-259:020:02:363
3828705991510,3cyclictest335557-21systemd-journal23:40:013
3828703991512,2cyclictest4045469-21kthreadcore22:35:192
3828703991511,3cyclictest500-21systemd-logind22:00:002
3828695991514,1cyclictest60350irq/132-enp0s29f1:rx-021:25:180
3828695991513,1cyclictest60350irq/132-enp0s29f1:rx-022:40:160
3828695991513,1cyclictest60350irq/132-enp0s29f1:rx-000:35:150
3828695991512,2cyclictest60350irq/132-enp0s29f1:rx-022:01:370
3828695991512,2cyclictest3881271-21kworker/u8:1+events_unbound20:15:150
3828695991511,3cyclictest4037569-21kworker/u8:0+flush-259:022:29:290
3828695991511,2cyclictest0-21swapper/020:30:010
3828705991410,3cyclictest4120548-21kworker/u8:1+events_unbound00:27:393
382870399149,4cyclictest4084376-21kworker/u8:4+flush-259:023:45:292
382870399148,4cyclictest3870466-21latency_hist19:50:012
382870399143,5cyclictest4157241-21awk00:25:002
3828703991412,1cyclictest0-21swapper/221:40:002
3828703991411,2cyclictest4143803-21kthreadcore00:10:202
3828703991411,2cyclictest4143803-21kthreadcore00:10:192
382870399141,12cyclictest1-21systemd00:00:002
3828703991410,2cyclictest2971-21cron23:45:002
3828700991412,1cyclictest4095447-21irqcore23:25:151
3828700991412,1cyclictest0-21swapper/119:14:591
3828700991411,2cyclictest4114419-21needreboot23:40:191
3828700991410,3cyclictest4016825-21kworker/u8:2+flush-259:022:45:161
3828700991410,3cyclictest3881271-21kworker/u8:1+flush-259:020:15:181
382869599149,3cyclictest3849557-21kworker/u8:2+flush-259:019:40:160
3828695991412,1cyclictest60350irq/132-enp0s29f1:rx-021:40:030
3828695991412,1cyclictest60350irq/132-enp0s29f1:rx-021:39:000
3828695991411,2cyclictest60350irq/132-enp0s29f1:rx-023:50:240
3828695991410,3cyclictest3970346-21kworker/u8:3+events_unbound21:30:140
3828695991410,3cyclictest3823696-21kworker/u8:4+events_unbound20:55:250
382870599139,3cyclictest4120548-21kworker/u8:1+flush-259:000:10:003
382870599139,3cyclictest4110270-21kworker/u8:2+flush-259:000:34:293
382870599139,3cyclictest4110270-21kworker/u8:2+flush-259:000:10:263
382870599139,3cyclictest4110270-21kworker/u8:2+flush-259:000:10:263
382870599139,3cyclictest4110270-21kworker/u8:2+events_unbound23:50:233
382870599139,3cyclictest4037569-21kworker/u8:0+events_unbound23:41:443
382870599139,3cyclictest3854775-21store19:35:013
3828705991310,2cyclictest3870033-21unixbench_singl19:45:273
382870399138,4cyclictest3954110-21latency_hist21:10:002
382870399136,5cyclictest3854509-21apt-get19:35:002
3828703991311,1cyclictest4123097-21kthreadcore23:50:182
3828703991310,2cyclictest4063208-21unixbench_singl22:50:272
382870099139,3cyclictest4016825-21kworker/u8:2+flush-259:022:25:191
382870099138,4cyclictest3823696-21kworker/u8:4+events_unbound21:15:151
3828700991310,2cyclictest4074310-21cpuspeed_turbos23:05:121
3828700991310,2cyclictest3870493-21apt-key19:50:001
382870599129,2cyclictest3823696-21kworker/u8:4+flush-259:021:55:263
382870599128,3cyclictest4110270-21kworker/u8:2+events_unbound23:50:003
382870599128,3cyclictest3907512-21kworker/u8:0+flush-259:020:42:363
382870399129,2cyclictest4017284-21irqcore22:10:182
382870399127,4cyclictest3938626-21latency_hist20:55:012
3828703991210,1cyclictest0-21swapper/223:00:002
3828703991210,1cyclictest0-21swapper/220:55:262
382870099129,2cyclictest4063182-21unixbench_singl22:50:261
382870099125,5cyclictest4129954-21ntpq23:55:201
382870599116,4cyclictest4032579-21latency_hist22:25:013
382870399118,2cyclictest3944164-21cpuspeed_turbos21:00:142
382870399117,3cyclictest500-21systemd-logind22:30:002
382870399117,3cyclictest3985644-21kworker/u8:2+events_unbound21:45:202
382870099118,2cyclictest4066190-21tr22:55:171
382870099118,2cyclictest4016927-21cpuspeed_turbos22:10:141
382870099118,2cyclictest3953129-21needreboot21:05:201
382870399108,1cyclictest0-21swapper/219:30:192
382870399108,1cyclictest0-21swapper/219:30:002
382870099107,2cyclictest0-21swapper/120:25:221
382870099105,4cyclictest3813495-21kworker/u8:1+events_unbound19:15:241
38287059995,3cyclictest4094804-21sed23:25:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional