You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-01 - 09:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Mon Jun 01, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3222365993926,5cyclictest3336419-21latency_hist21:00:003
3222362993832,4cyclictest3435065-21latency_hist22:35:012
3222362993831,5cyclictest3518852-21diskstats23:55:152
3222362993528,5cyclictest3555771-21cat00:35:022
3222365993428,4cyclictest3248436-21latency_hist19:35:003
3222354993427,5cyclictest3445397-21latency_hist22:45:000
3222362993327,4cyclictest509-21rs:main2
3222362993326,5cyclictest335557-21systemd-journal23:40:002
3222357993328,3cyclictest335557-21systemd-journal23:35:341
3222354993328,4cyclictest3409202-21apt-get22:10:130
3222357993228,3cyclictest3445621-21kworker/u8:1+flush-259:023:00:161
3222357993227,4cyclictest3289144-21ntpq20:10:231
3222362993126,3cyclictest3471133-21gpgv23:10:012
3222362993126,3cyclictest3471133-21gpgv23:10:002
3222357993128,2cyclictest3512485-21kworker/u8:2+flush-259:000:15:181
3222357993124,5cyclictest335557-21systemd-journal20:16:321
3222362993024,5cyclictest335557-21systemd-journal20:51:572
3222365992822,4cyclictest509-21rs:main3
3222357992824,3cyclictest3507945-21/usr/sbin/munin23:45:191
3222354992823,4cyclictest3382271-21ntpq21:40:210
3222362992723,3cyclictest3471761-21kworker/u8:3+events_unbound23:40:232
3222357992723,3cyclictest3429553-21gpgv22:30:011
3222354992721,4cyclictest3387428-21ntpq21:45:210
3222365992620,4cyclictest3487060-21latency_hist23:25:013
3222365992620,4cyclictest3487060-21latency_hist23:25:003
3222357992619,5cyclictest3243416-21cat19:30:011
3222354992620,4cyclictest335557-21systemd-journal21:51:340
3222354992611,14cyclictest3335548-21ntpq20:55:220
3222365992519,5cyclictest3305692-21/usr/sbin/munin20:30:143
3222365992519,4cyclictest3300339-21latency_hist20:25:003
3222357992520,3cyclictest3398638-21kworker/u8:3+events_unbound22:15:201
3222357992519,4cyclictest3336672-21apt-get21:00:111
3222357992518,4cyclictest3174604-21kworker/u8:0+flush-259:019:40:161
3222354992519,5cyclictest335557-21systemd-journal22:25:350
3222354992518,5cyclictest3434142-21ntpq22:30:210
3222362992420,3cyclictest153081-21kworker/u8:2+flush-259:019:20:242
3222357992420,3cyclictest3512485-21kworker/u8:2+events_unbound00:15:001
3222357992420,3cyclictest3471761-21kworker/u8:3+flush-259:023:40:261
3222357992420,3cyclictest3377639-21gpgv21:40:001
3222357992419,4cyclictest3321166-21kworker/u8:4+events_unbound20:47:341
3222357992418,4cyclictest3242919-21https19:30:011
3222354992418,4cyclictest335557-21systemd-journal00:39:340
3222354992412,11cyclictest0-21swapper/020:10:000
3222362992319,3cyclictest3388567-21kworker/u8:1+flush-259:021:55:162
3222362992319,3cyclictest3264343-21kworker/u8:3+events_unbound20:45:252
3222362992319,3cyclictest153081-21kworker/u8:2+events_unbound20:05:262
3222357992320,2cyclictest3455693-21kworker/u8:0+events_unbound23:10:011
3222357992320,2cyclictest3455693-21kworker/u8:0+events_unbound23:10:001
3222357992319,3cyclictest3512849-21kworker/u8:4+events_unbound23:55:231
3222357992319,3cyclictest3445621-21kworker/u8:1+flush-259:022:50:001
3222357992319,3cyclictest3398638-21kworker/u8:3+events_unbound22:50:141
3222354992319,3cyclictest3471105-21apt-get23:10:000
3222354992319,3cyclictest3471105-21apt-get23:10:000
3222365992218,3cyclictest3398638-21kworker/u8:3+flush-259:022:50:263
3222365992217,3cyclictest3471768-21/usr/sbin/munin23:10:133
3222365992217,3cyclictest153081-21kworker/u8:2+flush-259:019:20:263
3222362992219,2cyclictest3295199-21kworker/u8:0+events_unbound20:25:222
3222362992218,3cyclictest3336639-21kworker/u8:0+events_unbound21:10:232
3222357992219,2cyclictest3512849-21kworker/u8:4+flush-259:023:50:151
3222357992216,4cyclictest3320954-21kworker/u8:1+flush-259:021:15:211
3222357992216,4cyclictest3305683-21kworker/u8:2+flush-259:020:30:241
322235499220,20cyclictest3555408-21cat00:35:020
3222365992117,3cyclictest3481938-21kworker/u8:4+flush-259:023:30:173
3222365992117,3cyclictest3388567-21kworker/u8:1+flush-259:022:00:193
3222365992115,4cyclictest335557-21systemd-journal19:27:323
3222362992117,3cyclictest3502573-21kworker/u8:0+flush-259:023:45:202
3222362992117,3cyclictest3398638-21kworker/u8:3+events_unbound22:10:252
3222362992117,3cyclictest335557-21systemd-journal22:00:342
3222357992117,3cyclictest3336639-21kworker/u8:0+events_unbound22:05:231
3222357992117,3cyclictest153081-21kworker/u8:2+flush-259:019:51:481
3222357992116,4cyclictest3174604-21kworker/u8:0+events_unbound19:11:331
3222354992117,3cyclictest490-21dbus-daemon23:55:010
322235499211,2cyclictest3523547-21latency_hist00:00:000
3222365992014,4cyclictest3367365-21latency_hist21:30:013
3222362992017,2cyclictest3445621-21kworker/u8:1+events_unbound22:55:232
3222362992015,4cyclictest153081-21kworker/u8:2+events_unbound19:50:232
3222362992013,5cyclictest3424359-21latency_hist22:25:012
3222357992017,2cyclictest3320954-21kworker/u8:1+flush-259:021:20:191
3222357992016,3cyclictest3502573-21kworker/u8:0+flush-259:000:00:171
3222357992016,3cyclictest3471761-21kworker/u8:3+flush-259:023:20:341
3222357992016,3cyclictest3471761-21kworker/u8:3+flush-259:023:20:341
3222357992016,3cyclictest3424583-21kworker/u8:4+events_unbound22:57:251
3222357992016,3cyclictest3264343-21kworker/u8:3+flush-259:020:00:171
3222357992016,3cyclictest153081-21kworker/u8:2+flush-259:019:55:221
3222357992014,4cyclictest3351876-21latency_hist21:15:011
322235499204,14cyclictest3523789-21/usr/sbin/munin00:00:150
3222354992017,2cyclictest3534510-21cron00:15:000
3222354992016,3cyclictest3174604-21kworker/u8:0+flush-259:019:15:000
3222354992014,4cyclictest3481904-21latency_hist23:20:010
3222354992014,4cyclictest3326110-21latency_hist20:50:000
3222354992013,5cyclictest3268553-21ntpq19:50:220
322235499201,2cyclictest3486213-21ntpq23:20:220
322235499201,2cyclictest3486213-21ntpq23:20:220
322235499201,2cyclictest3351020-21ntpq21:10:220
3222365991915,2cyclictest0-21swapper/300:20:003
3222365991913,4cyclictest3528711-21latency_hist00:05:003
3222362991916,2cyclictest153081-21kworker/u8:2+events_unbound19:45:232
3222362991915,3cyclictest3487294-21kworker/u8:1+flush-259:023:30:202
3222362991915,3cyclictest3398638-21kworker/u8:3+flush-259:022:40:232
3222362991915,3cyclictest153081-21kworker/u8:2+events_unbound20:00:242
3222357991916,2cyclictest3539638-21kworker/u8:1+events_unbound00:20:301
3222357991915,3cyclictest3465575-21kworker/u8:2+flush-259:023:15:201
3222357991915,3cyclictest3388567-21kworker/u8:1+events_unbound22:00:191
3222357991915,3cyclictest3336639-21kworker/u8:0+events_unbound21:50:161
3222357991915,3cyclictest3305683-21kworker/u8:2+events_unbound21:06:341
3222357991915,3cyclictest153081-21kworker/u8:2+flush-259:019:35:131
322235499197,11cyclictest3529364-21turbostat00:10:010
322235499195,12cyclictest3475999-21processes23:10:220
322235499193,3cyclictest3300735-21cut20:25:140
3222354991914,4cyclictest335557-21systemd-journal21:57:340
3222354991913,4cyclictest335557-21systemd-journal19:41:320
322235499191,2cyclictest3543928-21ntpq00:20:240
322235499190,6cyclictest3247577-21ntpq19:30:230
322235499190,2cyclictest3507714-21latency_hist23:45:000
3222365991815,2cyclictest0-21swapper/322:39:593
3222365991814,3cyclictest335557-21systemd-journal20:05:333
3222365991814,2cyclictest0-21swapper/320:30:003
3222362991815,2cyclictest3465575-21kworker/u8:2+events_unbound23:10:222
3222362991815,2cyclictest3305683-21kworker/u8:2+flush-259:020:55:162
3222357991815,2cyclictest3372474-21kworker/u8:2+events_unbound21:46:341
3222357991815,2cyclictest3295199-21kworker/u8:0+events_unbound20:35:141
3222357991814,3cyclictest3512849-21kworker/u8:4+events_unbound00:07:361
3222357991814,3cyclictest3388567-21kworker/u8:1+events_unbound22:20:261
3222357991814,3cyclictest3336639-21kworker/u8:0+events_unbound21:30:261
3222357991814,3cyclictest3305683-21kworker/u8:2+events_unbound20:40:331
3222357991814,3cyclictest153081-21kworker/u8:2+events_unbound19:20:191
322235499184,3cyclictest3435427-21grep22:35:140
322235499184,1cyclictest3367360-21turbostat21:30:000
3222354991815,2cyclictest153081-21kworker/u8:2+events_unbound19:45:190
322235499181,4cyclictest3549991-21cron00:30:000
322235499181,4cyclictest3295160-21cron20:20:000
322235499181,3cyclictest3538944-21/usr/sbin/munin00:15:250
322235499181,3cyclictest335557-21systemd-journal20:45:000
322235499181,3cyclictest3315767-21idleruntime-cro20:40:000
322235499181,2cyclictest3497415-21turbostat.cron23:35:000
322235499181,2cyclictest3449620-21ntpq22:45:200
322235499180,5cyclictest3454844-21ntpq22:50:230
322235499180,5cyclictest3273780-21ntpq19:55:210
322235499180,4cyclictest3253562-21cron19:40:010
322235499180,3cyclictest3330526-21/usr/sbin/munin20:50:250
322235499180,3cyclictest3222356-21date19:10:010
322235499180,17cyclictest3357013-21turbostat21:20:000
3222365991714,2cyclictest3305683-21kworker/u8:2+flush-259:021:00:163
3222365991712,3cyclictest490-21dbus-daemon21:50:003
3222362991714,2cyclictest3398638-21kworker/u8:3+flush-259:022:40:002
3222362991713,3cyclictest3512849-21kworker/u8:4+flush-259:023:50:182
3222362991713,3cyclictest3336639-21kworker/u8:0+events_unbound21:30:222
3222362991712,4cyclictest3174604-21kworker/u8:0+flush-259:019:15:232
3222357991714,2cyclictest3492933-21irqcore23:30:161
3222357991714,2cyclictest3398638-21kworker/u8:3+events_unbound22:11:341
3222357991713,3cyclictest3295199-21kworker/u8:0+events_unbound20:29:341
3222357991713,3cyclictest153081-21kworker/u8:2+events_unbound19:17:331
3222357991712,4cyclictest3305683-21kworker/u8:2+events_unbound20:57:351
3222357991711,4cyclictest3475834-21ntpq23:10:191
322235499175,10cyclictest0-21swapper/020:24:590
322235499173,3cyclictest3421303-21cut22:20:170
322235499171,2cyclictest3465947-21turbostat.cron23:05:000
322235499170,4cyclictest3497657-21/usr/sbin/munin23:35:110
322235499170,4cyclictest3368603-21/usr/sbin/munin21:30:170
322235499170,4cyclictest3340789-21/usr/sbin/munin21:00:230
322235499170,4cyclictest3238147-21cut19:25:140
322235499170,4cyclictest3236830-21ntpq19:20:220
322235499170,3cyclictest3408122-21ntp_states22:05:230
322235499170,3cyclictest3372874-21diskstats21:35:130
322235499170,3cyclictest3342851-21ps21:05:190
322235499170,3cyclictest3285301-21diskstats20:10:160
322235499170,1cyclictest3399529-21irqcore22:00:190
322235499170,1cyclictest0-21swapper/019:15:160
322235499170,16cyclictest3279818-21cat20:05:010
3222365991613,2cyclictest3450544-21turbostat22:50:013
3222365991613,2cyclictest3266865-21kthreadcore19:50:203
3222365991612,3cyclictest3279782-21kworker/u8:1+flush-259:020:05:003
3222365991611,4cyclictest335557-21systemd-journal23:00:003
3222365991610,5cyclictest3444473-21ntpq22:40:193
3222365991610,4cyclictest3512849-21kworker/u8:4+flush-259:023:55:173
3222362991614,1cyclictest3549994-21idleruntime-cro00:30:002
3222362991613,2cyclictest3502573-21kworker/u8:0+flush-259:000:30:232
3222362991613,2cyclictest3487751-21irqcore23:25:172
3222362991613,2cyclictest3243145-21apt-config19:30:012
3222362991612,3cyclictest3393461-21cron21:55:002
3222362991612,3cyclictest3320954-21kworker/u8:1+flush-259:021:15:312
3222357991613,2cyclictest3491321-21ntp_kernel_err23:25:221
3222357991612,3cyclictest3502573-21kworker/u8:0+events_unbound00:25:131
3222357991612,3cyclictest3424583-21kworker/u8:4+flush-259:022:30:211
3222357991610,4cyclictest3222272-21latency_hist19:10:011
322235499160,3cyclictest3508366-21interrupts23:45:150
322235499160,3cyclictest3487427-21cut23:25:140
322235499160,3cyclictest3456065-21cpuspeed_turbos22:55:120
322235499160,3cyclictest3414587-21tune2fs22:15:140
322235499160,3cyclictest3357492-21fschecks_count21:20:140
3222365991513,2cyclictest3174604-21kworker/u8:0+flush-259:019:40:113
3222365991512,2cyclictest3305683-21kworker/u8:2+flush-259:021:05:183
3222362991512,2cyclictest3502573-21kworker/u8:0+events_unbound00:10:192
3222362991511,3cyclictest3502573-21kworker/u8:0+flush-259:000:00:252
3222362991511,3cyclictest3471761-21kworker/u8:3+flush-259:023:20:252
3222362991511,3cyclictest3471761-21kworker/u8:3+flush-259:023:20:242
3222362991511,3cyclictest3279782-21kworker/u8:1+flush-259:020:17:332
3222362991511,3cyclictest3264343-21kworker/u8:3+flush-259:019:55:132
3222362991511,3cyclictest3174604-21kworker/u8:0+events_unbound19:40:222
3222362991510,3cyclictest3320954-21kworker/u8:1+flush-259:021:35:162
3222362991510,3cyclictest3320954-21kworker/u8:1+flush-259:021:20:152
3222357991512,2cyclictest3320954-21kworker/u8:1+flush-259:021:28:391
3222357991511,3cyclictest3539638-21kworker/u8:1+events_unbound00:30:021
3222357991511,3cyclictest3372474-21kworker/u8:2+flush-259:021:40:161
3222357991511,3cyclictest3264343-21kworker/u8:3+events_unbound20:08:341
3222357991510,4cyclictest3539638-21kworker/u8:1+events_unbound00:38:471
3222357991510,4cyclictest3434870-21kworker/u8:0+events_unbound22:44:371
322236599149,3cyclictest3285141-21apt-get20:10:143
3222365991412,1cyclictest3502573-21kworker/u8:0+flush-259:023:55:003
3222365991411,2cyclictest3371976-21unixbench_multi21:30:243
3222365991411,2cyclictest3249719-21kthreadcore19:35:173
322236299143,5cyclictest3419228-21basename22:20:012
3222362991411,1cyclictest0-21swapper/221:50:002
3222362991410,3cyclictest3398638-21kworker/u8:3+flush-259:022:50:172
3222362991410,3cyclictest3336639-21kworker/u8:0+flush-259:021:40:222
3222362991410,3cyclictest3305683-21kworker/u8:2+flush-259:021:05:002
3222362991410,3cyclictest3305683-21kworker/u8:2+events_unbound20:30:202
322236599138,3cyclictest335557-21systemd-journal20:45:003
322236599136,5cyclictest335557-21systemd-journal21:24:553
3222365991311,1cyclictest0-21swapper/321:40:003
3222365991311,1cyclictest0-21swapper/320:50:173
322236299139,3cyclictest3279782-21kworker/u8:1+events_unbound20:20:232
322236299138,4cyclictest3476998-21/usr/sbin/munin23:15:132
3222362991310,2cyclictest3450519-21idleruntime-cro22:50:002
322235799139,3cyclictest3388567-21kworker/u8:1+events_unbound21:57:111
322235799139,3cyclictest153081-21kworker/u8:2+flush-259:019:45:211
322235799138,4cyclictest3279782-21kworker/u8:1+events_unbound20:20:331
322236599129,2cyclictest3540686-21irqcore00:20:193
322236599128,3cyclictest3502573-21kworker/u8:0+flush-259:000:12:403
322236599128,2cyclictest0-21swapper/322:10:003
322236599118,2cyclictest3508036-21cpuspeed_turbos23:45:133
322236599118,2cyclictest3502573-21kworker/u8:0+flush-259:000:35:103
322236599118,2cyclictest3497930-21fschecks_time23:35:143
322236599118,2cyclictest3414403-21cpuspeed_turbos22:15:123
322236599118,1cyclictest0-21swapper/320:45:143
322236599117,2cyclictest3311302-21irqcore20:35:153
322236599114,5cyclictest335557-21systemd-journal22:25:003
322236299118,1cyclictest0-21swapper/222:05:132
322236299117,3cyclictest3424583-21kworker/u8:4+flush-259:022:25:162
322235799118,2cyclictest3330768-21unixbench_multi20:50:251
322235799117,3cyclictest3398638-21kworker/u8:3+events_unbound22:35:131
322236599106,3cyclictest3465575-21kworker/u8:2+flush-259:023:05:393
322236599106,3cyclictest3465575-21kworker/u8:2+flush-259:023:05:393
322236599106,3cyclictest3274611-21idleruntime-cro20:00:013
322236299108,1cyclictest3316449-21irqcore20:40:172
322236299106,3cyclictest335557-21systemd-journal19:34:592
322236299101,2cyclictest3227441-21latency_hist19:15:012
32223659996,2cyclictest491ktimers/321:44:343
32223629995,2cyclictest3290054-21latency_hist20:14:592
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional