You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 07:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Wed May 06, 2026 00:44:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3817190995551,3cyclictest3853629-21kworker/u8:1+flush-259:019:55:002
3817187994742,3cyclictest252-21systemd-journal19:40:011
3817185994337,2cyclictest3796932-21kworker/u8:0+events_unbound19:35:010
3817190994037,2cyclictest3796932-21kworker/u8:0+events_unbound19:10:232
3817195993935,3cyclictest4020295-21kworker/u8:3+events_unbound23:21:493
3817195993935,3cyclictest3807090-21kworker/u8:4+events_unbound20:40:023
3817195993935,3cyclictest3807090-21kworker/u8:4+events_unbound20:40:013
3817190993936,2cyclictest3853629-21kworker/u8:1+events_unbound20:00:232
3817190993935,3cyclictest3828437-21kworker/u8:3+events_unbound19:41:042
3817190993935,3cyclictest3796932-21kworker/u8:0+events_unbound19:32:072
3817187993928,10cyclictest3868228-21ntpq19:55:211
3817195993834,3cyclictest3853629-21kworker/u8:1+events_unbound19:56:113
3817190993835,2cyclictest4109066-21kworker/u8:2+flush-259:000:10:212
3817190993834,3cyclictest3807090-21kworker/u8:4+events_unbound19:15:212
3817187993832,4cyclictest252-21systemd-journal19:46:101
3817195993734,2cyclictest3853629-21kworker/u8:1+events_unbound19:45:213
3817195993733,3cyclictest3926619-21kworker/u8:2+events_unbound21:05:203
3817195993634,2cyclictest3937332-21kworker/u8:4+events_unbound21:25:233
3817190993633,2cyclictest4020295-21kworker/u8:3+events_unbound23:55:122
3817190993628,3cyclictest4020295-21kworker/u8:3+events_unbound23:45:242
3817195993532,2cyclictest3916539-21kworker/u8:1+events_unbound20:50:233
3817195993531,3cyclictest3963099-21kworker/u8:1+flush-259:021:35:263
3817190993532,2cyclictest4119384-21kworker/u8:4+events_unbound00:30:222
3817190993532,2cyclictest3828437-21kworker/u8:3+events_unbound19:20:242
3817185993532,2cyclictest4020295-21kworker/u8:3+flush-259:022:45:240
3817185993531,3cyclictest3963099-21kworker/u8:1+events_unbound21:52:380
3817185993529,4cyclictest4082829-21cat23:25:010
3817195993431,2cyclictest3926619-21kworker/u8:2+events_unbound21:20:233
3817195993429,4cyclictest3910841-21gpgv20:40:003
3817195993429,2cyclictest3963099-21kworker/u8:1+events_unbound21:45:153
3817187993427,5cyclictest4014957-21latency_hist22:20:001
3817185993430,2cyclictest3937332-21kworker/u8:4+flush-259:022:00:250
3817185993428,4cyclictest252-21systemd-journal20:29:370
3817195993331,2cyclictest4035573-21kworker/u8:2+events_unbound22:50:413
3817195993331,2cyclictest4035573-21kworker/u8:2+events_unbound22:50:403
3817195993331,2cyclictest3942727-21kworker/u8:0+events_unbound21:15:233
3817195993330,2cyclictest4088055-21kworker/u8:0+events_unbound23:30:213
3817190993330,2cyclictest3807090-21kworker/u8:4+events_unbound20:33:392
381718599330,31cyclictest1-21systemd23:05:390
3817195993229,2cyclictest4035573-21kworker/u8:2+events_unbound22:48:393
3817195993229,2cyclictest3796932-21kworker/u8:0+events_unbound19:29:393
3817195993228,3cyclictest3807090-21kworker/u8:4+events_unbound20:21:393
3817195993226,5cyclictest3993950-21latency_hist22:00:013
3817190993229,2cyclictest4020295-21kworker/u8:3+flush-259:022:30:252
3817195993128,2cyclictest4020295-21kworker/u8:3+events_unbound22:25:143
3817195993128,2cyclictest3937332-21kworker/u8:4+events_unbound22:01:333
3817195993127,3cyclictest4109066-21kworker/u8:2+events_unbound00:14:423
3817190993128,2cyclictest4088055-21kworker/u8:0+flush-259:000:00:232
3817190993127,3cyclictest4020295-21kworker/u8:3+events_unbound22:53:392
3817190993127,3cyclictest4020295-21kworker/u8:3+events_unbound22:53:392
3817190993127,3cyclictest3880076-21kworker/u8:3+flush-259:020:20:002
3817185993124,5cyclictest4123407-21ntpq00:00:220
3817195993027,2cyclictest4088055-21kworker/u8:0+events_unbound23:52:393
3817195993027,2cyclictest3796932-21kworker/u8:0+events_unbound19:54:383
3817190993027,2cyclictest4020295-21kworker/u8:3+flush-259:023:20:202
3817190993027,2cyclictest3926619-21kworker/u8:2+events_unbound20:56:382
3817190993027,2cyclictest3807090-21kworker/u8:4+flush-259:020:45:182
3817190993027,2cyclictest3807090-21kworker/u8:4+events_unbound20:35:182
3817187993019,9cyclictest252-21systemd-journal19:18:361
3817185993026,3cyclictest3807090-21kworker/u8:4+events_unbound20:36:380
3817185993023,5cyclictest4019155-21ntpq22:20:200
3817195992928,1cyclictest4061261-21kworker/u8:1+events_unbound23:10:213
3817195992927,2cyclictest4119384-21kworker/u8:4+events_unbound00:31:403
3817195992927,2cyclictest4020295-21kworker/u8:3+events_unbound22:30:383
3817195992927,2cyclictest3880076-21kworker/u8:3+events_unbound20:11:103
3817195992926,2cyclictest4020295-21kworker/u8:3+events_unbound23:00:393
3817195992926,2cyclictest3963099-21kworker/u8:1+events_unbound21:30:203
3817195992925,3cyclictest3999134-21kworker/u8:2+events_unbound22:15:273
3817190992926,2cyclictest4061261-21kworker/u8:1+events_unbound23:15:222
3817190992926,2cyclictest4020295-21kworker/u8:3+events_unbound23:05:232
3817190992926,2cyclictest3963099-21kworker/u8:1+events_unbound22:06:372
3817187992925,3cyclictest4088055-21kworker/u8:0+flush-259:000:02:011
3817185992926,2cyclictest3828437-21kworker/u8:3+events_unbound19:22:370
3817185992925,3cyclictest4056387-21apt-get23:00:120
3817185992925,3cyclictest3937332-21kworker/u8:4+events_unbound21:10:200
3817185992925,3cyclictest3807090-21kworker/u8:4+flush-259:019:15:190
3817185992924,4cyclictest3880076-21kworker/u8:3+flush-259:020:45:000
3817185992924,4cyclictest3880076-21kworker/u8:3+flush-259:020:45:000
3817185992922,5cyclictest3873355-21ntpq20:00:210
3817195992825,2cyclictest4119384-21kworker/u8:4+events_unbound00:25:153
3817195992825,2cyclictest4009422-21kworker/u8:0+events_unbound22:58:403
3817195992825,2cyclictest4009422-21kworker/u8:0+events_unbound22:58:403
3817195992825,2cyclictest3942727-21kworker/u8:0+events_unbound21:11:233
3817195992825,2cyclictest3807090-21kworker/u8:4+events_unbound20:16:133
3817190992826,2cyclictest4020295-21kworker/u8:3+events_unbound23:32:402
3817190992826,2cyclictest3999134-21kworker/u8:2+events_unbound22:10:242
3817185992826,2cyclictest4020295-21kworker/u8:3+events_unbound23:11:480
3817185992825,3cyclictest4119384-21kworker/u8:4+events_unbound00:30:410
3817185992825,2cyclictest4088055-21kworker/u8:0+events_unbound23:34:410
3817185992825,2cyclictest3807090-21kworker/u8:4+events_unbound20:45:250
3817185992824,3cyclictest3796932-21kworker/u8:0+events_unbound19:10:580
3817195992724,2cyclictest4119384-21kworker/u8:4+events_unbound00:04:393
3817195992724,2cyclictest3926619-21kworker/u8:2+events_unbound21:40:293
3817195992724,2cyclictest3926619-21kworker/u8:2+events_unbound20:58:113
3817190992724,2cyclictest3916539-21kworker/u8:1+events_unbound20:50:372
3817190992724,2cyclictest3828437-21kworker/u8:3+events_unbound19:39:372
3817190992724,2cyclictest3807090-21kworker/u8:4+events_unbound20:20:232
3817190992723,3cyclictest3926619-21kworker/u8:2+flush-259:021:40:202
3817190992722,4cyclictest3879422-21latency_hist20:10:002
3817187992722,4cyclictest252-21systemd-journal22:04:361
3817185992723,3cyclictest3999134-21kworker/u8:2+events_unbound22:15:370
3817185992721,3cyclictest4009422-21kworker/u8:0+events_unbound22:40:230
3817195992623,2cyclictest3853629-21kworker/u8:1+events_unbound20:00:143
3817195992620,4cyclictest4009388-21apt-get22:15:003
3817190992623,2cyclictest4020295-21kworker/u8:3+events_unbound23:01:392
3817190992623,2cyclictest3963099-21kworker/u8:1+events_unbound21:50:372
3817190992623,2cyclictest3963099-21kworker/u8:1+events_unbound21:48:382
3817190992623,2cyclictest3963099-21kworker/u8:1+events_unbound21:35:142
3817190992622,3cyclictest4109066-21kworker/u8:2+events_unbound00:20:162
3817187992617,7cyclictest252-21systemd-journal21:40:001
3817185992623,2cyclictest4109066-21kworker/u8:2+flush-259:000:10:210
3817185992623,2cyclictest3999134-21kworker/u8:2+flush-259:022:10:250
3817185992621,4cyclictest3890388-21apt-get20:20:110
3817190992523,2cyclictest4088055-21kworker/u8:0+events_unbound00:06:412
3817190992522,2cyclictest4020295-21kworker/u8:3+events_unbound22:44:392
3817190992522,2cyclictest3937332-21kworker/u8:4+events_unbound21:55:222
3817190992521,3cyclictest4098363-21apt-get23:40:102
3817190992521,3cyclictest3880076-21kworker/u8:3+events_unbound20:41:392
3817190992521,3cyclictest3880076-21kworker/u8:3+events_unbound20:41:392
3817190992517,2cyclictest3963099-21kworker/u8:1+events_unbound22:15:132
3817185992522,2cyclictest4020295-21kworker/u8:3+events_unbound22:34:380
3817185992522,2cyclictest3926619-21kworker/u8:2+events_unbound21:04:380
3817185992521,3cyclictest3963099-21kworker/u8:1+events_unbound21:41:370
3817185992521,3cyclictest3942727-21kworker/u8:0+events_unbound21:15:210
3817195992422,2cyclictest3828437-21kworker/u8:3+events_unbound19:42:393
3817195992417,5cyclictest3827463-21apt-get19:20:003
3817195992415,4cyclictest3848505-21latency_hist19:40:013
3817190992422,2cyclictest3999134-21kworker/u8:2+events_unbound22:20:382
3817190992421,2cyclictest4020295-21kworker/u8:3+events_unbound22:46:402
3817190992421,2cyclictest3937332-21kworker/u8:4+events_unbound21:20:372
3817190992420,3cyclictest4134625-21kworker/u8:1+events_unbound00:16:412
3817185992421,2cyclictest3879450-21gpgv20:10:000
3817185992420,3cyclictest4020295-21kworker/u8:3+events_unbound23:21:420
3817185992420,3cyclictest3927271-21apt-get20:55:110
3817185992420,3cyclictest3796932-21kworker/u8:0+events_unbound19:56:390
3817195992320,2cyclictest3796932-21kworker/u8:0+events_unbound20:05:153
3817195992320,2cyclictest3796932-21kworker/u8:0+events_unbound19:10:273
3817190992320,2cyclictest4119384-21kworker/u8:4+flush-259:000:25:202
3817190992320,2cyclictest3942727-21kworker/u8:0+flush-259:021:10:262
3817190992319,3cyclictest3880076-21kworker/u8:3+events_unbound20:14:372
3817187992314,7cyclictest252-21systemd-journal20:56:171
3817185992320,2cyclictest4088055-21kworker/u8:0+events_unbound00:09:570
3817185992320,2cyclictest0-21swapper/021:50:000
3817195992219,2cyclictest4009422-21kworker/u8:0+events_unbound22:40:183
3817190992220,2cyclictest4061261-21kworker/u8:1+events_unbound23:25:222
3817190992220,1cyclictest2971-21cron21:30:002
3817190992219,3cyclictest4009422-21kworker/u8:0+events_unbound22:57:402
3817190992219,3cyclictest4009422-21kworker/u8:0+events_unbound22:57:392
3817190992219,2cyclictest4020295-21kworker/u8:3+events_unbound22:35:232
3817190992219,2cyclictest3942727-21kworker/u8:0+flush-259:021:15:242
3817190992219,2cyclictest3853629-21kworker/u8:1+events_unbound19:45:182
3817187992216,4cyclictest4072223-21/usr/sbin/munin23:15:141
3817185992219,2cyclictest4134625-21kworker/u8:1+flush-259:000:15:220
3817185992219,2cyclictest4109066-21kworker/u8:2+flush-259:000:35:150
3817185992219,2cyclictest4088055-21kworker/u8:0+events_unbound23:42:370
3817185992219,2cyclictest3853629-21kworker/u8:1+flush-259:019:50:210
3817185992218,3cyclictest4088055-21kworker/u8:0+events_unbound00:00:010
3817185992216,2cyclictest4088055-21kworker/u8:0+events_unbound23:50:180
3817195992116,4cyclictest4098105-21latency_hist23:40:013
3817195992115,2cyclictest4061261-21kworker/u8:1+events_unbound23:15:143
3817190992118,2cyclictest4020295-21kworker/u8:3+events_unbound23:36:512
3817187992118,2cyclictest0-21swapper/119:30:011
3817187992117,3cyclictest3989051-21apt-get21:55:121
3817187992115,4cyclictest4004486-21/usr/sbin/munin22:10:151
3817187992112,8cyclictest4133637-21needreboot00:10:191
3817185992117,3cyclictest3926619-21kworker/u8:2+flush-259:021:05:190
3817185992116,3cyclictest4020295-21kworker/u8:3+events_unbound22:35:190
3817195992017,2cyclictest4139793-21gpgv00:20:003
3817195992015,4cyclictest252-21systemd-journal23:25:033
3817187992017,2cyclictest3880076-21kworker/u8:3+flush-259:020:35:001
3817187992016,3cyclictest507-21in:imuxsock23:40:011
3817187992013,5cyclictest4134840-21/usr/sbin/munin00:15:151
3817187992012,7cyclictest500-21systemd-logind22:25:001
3817187992012,6cyclictest4003348-21ntpq22:05:201
3817185992017,3cyclictest3853629-21kworker/u8:1+events_unbound19:45:280
3817185992017,2cyclictest3916539-21kworker/u8:1+events_unbound20:50:150
3817185992013,3cyclictest3963099-21kworker/u8:1+events_unbound21:30:140
3817195991916,2cyclictest3880076-21kworker/u8:3+flush-259:020:25:193
3817190991917,2cyclictest3828437-21kworker/u8:3+events_unbound19:25:232
3817190991916,2cyclictest3926619-21kworker/u8:2+events_unbound21:30:262
3817190991915,3cyclictest4020295-21kworker/u8:3+events_unbound23:10:022
3817187991915,2cyclictest0-21swapper/123:10:001
3817187991913,4cyclictest4103245-21latency_hist23:45:011
3817187991912,4cyclictest3863939-21latency_hist19:55:001
381718799190,11cyclictest4092766-21runrttasks23:32:431
3817185991916,2cyclictest3880076-21kworker/u8:3+events_unbound20:30:170
3817195991816,1cyclictest0-21swapper/323:10:003
3817195991815,2cyclictest4119384-21kworker/u8:4+events_unbound00:05:243
3817195991815,2cyclictest4109066-21kworker/u8:2+events_unbound00:35:293
3817190991815,2cyclictest4109066-21kworker/u8:2+events_unbound00:35:202
3817190991813,3cyclictest252-21systemd-journal21:09:372
381718799186,10cyclictest3936483-21ntpq21:00:211
3817187991814,2cyclictest0-21swapper/121:50:011
3817187991813,4cyclictest4020295-21kworker/u8:3+flush-259:023:50:001
381718799181,15cyclictest4050089-21ntpq22:50:231
381718799181,15cyclictest4050089-21ntpq22:50:221
3817187991811,5cyclictest3926611-21gpgv20:55:001
381718799181,13cyclictest3890391-21taskset20:20:131
381718799180,5cyclictest3947668-21munin-run21:15:001
3817185991815,2cyclictest3807090-21kworker/u8:4+flush-259:020:15:260
3817185991814,3cyclictest4020295-21kworker/u8:3+flush-259:022:26:530
3817185991813,3cyclictest3937332-21kworker/u8:4+events_unbound21:55:180
3817195991715,2cyclictest4020295-21kworker/u8:3+events_unbound23:56:573
3817195991714,2cyclictest4035528-21idleruntime-cro22:40:003
3817190991714,2cyclictest4020295-21kworker/u8:3+events_unbound23:51:422
3817190991714,2cyclictest3890169-21kworker/u8:0+flush-259:021:00:152
381718799172,13cyclictest1-21systemd21:10:011
3817187991714,2cyclictest4067499-21irqcore23:10:161
3817187991714,2cyclictest0-21swapper/123:00:001
3817187991714,2cyclictest0-21swapper/123:00:001
3817187991713,3cyclictest4045833-21cron22:50:001
381718799171,15cyclictest4145325-21cron00:24:591
381718799171,14cyclictest4109074-21irqcore23:50:171
381718799171,14cyclictest3909744-21cut20:35:191
381718799171,14cyclictest3895934-21grep20:25:161
381718799171,14cyclictest3890137-21grep20:20:001
3817187991710,6cyclictest0-21swapper/120:45:221
381718799170,15cyclictest4150486-21munin-plugin-st00:29:591
381718799170,15cyclictest3843365-21latency_hist19:35:011
381718799170,14cyclictest4124677-21cut00:05:141
381718799170,14cyclictest4082738-21grep23:25:021
381718799170,14cyclictest3952893-21latency_hist21:20:011
381719599167,1cyclictest191rcu_preempt19:20:013
3817195991613,2cyclictest4109066-21kworker/u8:2+events_unbound00:22:043
381718799168,7cyclictest0-21swapper/119:10:261
381718799162,12cyclictest0-21swapper/121:35:001
381718799161,13cyclictest4156351-21grep00:35:161
381718799161,13cyclictest4031672-21tr22:35:191
381718799161,13cyclictest3957109-21ntpq21:20:221
381718799161,13cyclictest3885007-21latency_hist20:15:001
381718799161,13cyclictest3879682-21latency_hist20:10:001
381718799161,13cyclictest3852825-21smartctl19:40:191
381718799161,13cyclictest3828564-21tr19:20:161
381718799161,12cyclictest4025616-21grep22:30:141
381718799161,12cyclictest3988773-21cron21:55:001
381718799161,12cyclictest3817189-21date19:10:011
3817187991610,4cyclictest3958223-21apt-get21:25:111
381718799160,14cyclictest4118727-21turbostat.cron00:00:001
381718799160,14cyclictest4087828-21apt23:30:001
3817185991614,1cyclictest60350irq/132-enp0s29f1:rx-021:20:160
3817185991613,2cyclictest60350irq/132-enp0s29f1:rx-023:15:160
3817185991613,2cyclictest60350irq/132-enp0s29f1:rx-022:55:170
3817185991613,2cyclictest60350irq/132-enp0s29f1:rx-022:55:170
3817185991612,3cyclictest3828437-21kworker/u8:3+events_unbound19:36:380
3817185991612,3cyclictest3807090-21kworker/u8:4+flush-259:020:10:170
3817195991513,2cyclictest3796932-21kworker/u8:0+events_unbound19:34:393
3817195991513,1cyclictest491ktimers/321:05:003
3817190991512,2cyclictest4020295-21kworker/u8:3+events_unbound22:27:392
381718799151,12cyclictest3975901-21grep21:40:191
381718799151,11cyclictest0-21swapper/122:40:111
381718799150,3cyclictest4061242-21munin-run23:05:001
381718799150,2cyclictest4020747-21ps22:25:171
381718799150,13cyclictest4151763-21ps00:30:171
381718799150,13cyclictest3911533-21cut20:40:141
381718799150,13cyclictest3911533-21cut20:40:141
381718799150,12cyclictest3869586-21sort20:00:141
3817185991513,1cyclictest60350irq/132-enp0s29f1:rx-023:35:140
3817185991513,1cyclictest60350irq/132-enp0s29f1:rx-019:25:450
3817185991512,2cyclictest60350irq/132-enp0s29f1:rx-000:25:130
3817185991512,2cyclictest3796932-21kworker/u8:0+flush-259:019:40:120
381719599144,2cyclictest191rcu_preempt20:35:013
3817195991412,2cyclictest4020295-21kworker/u8:3+events_unbound23:46:513
3817190991411,2cyclictest3796932-21kworker/u8:0+events_unbound19:58:222
3817185991413,1cyclictest60350irq/132-enp0s29f1:rx-023:46:040
3817185991413,1cyclictest60350irq/132-enp0s29f1:rx-021:25:170
3817185991411,2cyclictest4109066-21kworker/u8:2+events_unbound00:20:180
3817185991411,2cyclictest3963099-21kworker/u8:1+events_unbound22:05:180
3817185991410,3cyclictest3926619-21kworker/u8:2+events_unbound21:36:290
3817195991310,2cyclictest4088055-21kworker/u8:0+events_unbound23:44:123
3817195991310,2cyclictest3963099-21kworker/u8:1+events_unbound22:23:333
3817185991310,2cyclictest4020295-21kworker/u8:3+events_unbound22:50:240
3817185991310,2cyclictest4020295-21kworker/u8:3+events_unbound22:50:240
381719599121,6cyclictest3984523-21sed21:50:163
381719099129,2cyclictest3994278-21cpuspeed_turbos22:00:142
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional