You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 04:46

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sat Mar 21, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3497707993734,2cyclictest3721337-21kworker/u8:4+events_unbound22:45:231
3497707993734,2cyclictest3721337-21kworker/u8:4+events_unbound22:45:221
3497707993632,2cyclictest3743353-21kworker/u8:1+events_unbound23:45:141
3497710993528,5cyclictest3534652-21latency_hist19:45:022
3497710993326,5cyclictest3539763-21latency_hist19:50:012
3497707993329,3cyclictest3539781-21kworker/u8:1+events_unbound21:50:151
3497707993126,4cyclictest3513134-21latency_hist19:25:011
3497705993127,3cyclictest3503067-21apt-get19:15:110
3497707993026,3cyclictest3571181-21kworker/u8:0+flush-259:020:35:201
3497707993026,3cyclictest3539781-21kworker/u8:1+flush-259:021:05:211
3497710992922,5cyclictest3752743-21apt-get23:15:112
3497707992926,2cyclictest3743353-21kworker/u8:1+flush-259:023:25:241
3497707992926,2cyclictest3743353-21kworker/u8:1+flush-259:000:15:251
3497715992822,4cyclictest3716230-21apt-get22:40:093
3497710992822,4cyclictest252-21systemd-journal23:14:452
3497707992822,4cyclictest3685098-21latency_hist22:10:001
3497705992824,3cyclictest3581505-21kworker/u8:2+flush-259:020:30:160
3497705992824,3cyclictest3581505-21kworker/u8:2+flush-259:020:30:150
3497705992822,4cyclictest3565141-21ntpq20:10:190
3497705992723,3cyclictest3539781-21kworker/u8:1+flush-259:021:05:250
3497705992721,4cyclictest3649184-21latency_hist21:35:010
3497705992720,5cyclictest3663654-21ntpq21:45:190
3497710992623,2cyclictest3539781-21kworker/u8:1+flush-259:020:05:212
3497707992623,2cyclictest3674873-21kworker/u8:2+events_unbound22:20:241
3497707992623,2cyclictest3592438-21kworker/u8:3+flush-259:020:45:201
3497707992622,3cyclictest3747580-21apt-get23:10:091
3497707992622,3cyclictest3534909-21apt-get19:45:111
3497707992622,2cyclictest3773724-21apt-get23:35:121
3497705992621,3cyclictest3524588-21apt-get19:35:120
3497707992521,3cyclictest3674873-21kworker/u8:2+flush-259:022:55:001
3497707992520,3cyclictest252-21systemd-journal23:17:001
3497707992518,3cyclictest3539993-21kworker/u8:4+events_unbound19:50:161
3497715992420,3cyclictest3518319-21gpgv19:30:013
3497710992421,2cyclictest3540026-21apt-get19:50:112
3497707992422,1cyclictest3539993-21kworker/u8:4+events_unbound20:15:221
3497707992421,3cyclictest3737055-21kworker/u8:0+events_unbound23:33:441
3497707992421,2cyclictest3737055-21kworker/u8:0+flush-259:000:00:201
3497707992418,4cyclictest3518299-21latency_hist19:30:021
3497707992417,5cyclictest3522990-21ntpq19:30:191
3497705992418,4cyclictest3737055-21kworker/u8:0+flush-259:023:35:250
3497705992417,5cyclictest3824045-21ntpq00:20:210
3497715992318,4cyclictest3809878-21diskstats00:10:133
3497710992320,2cyclictest3743353-21kworker/u8:1+flush-259:023:25:182
3497710992317,4cyclictest3804344-21latency_hist00:05:012
3497707992320,2cyclictest3539781-21kworker/u8:1+flush-259:020:40:211
3497707992319,3cyclictest3643991-21kworker/u8:0+events_unbound22:16:461
3497707992319,3cyclictest3586646-21systemd-run20:35:001
3497707992319,3cyclictest3586646-21systemd-run20:35:001
3497707992319,3cyclictest1454795-21kworker/u8:2+flush-259:019:40:231
3497705992319,3cyclictest3508208-21apt-get19:20:110
3497715992218,3cyclictest3705943-21apt-get22:30:113
3497715992218,3cyclictest3523923-21sh19:35:013
3497715992218,3cyclictest3507969-21kworker/u8:1+flush-259:019:20:013
3497715992217,3cyclictest3743353-21kworker/u8:1+flush-259:023:25:153
3497707992219,2cyclictest3539781-21kworker/u8:1+flush-259:020:25:241
3497707992218,3cyclictest3539781-21kworker/u8:1+flush-259:020:10:251
3497705992218,3cyclictest507-21in:imuxsock23:20:000
3497705992215,6cyclictest3818798-21ntpq00:15:200
349771099210,3cyclictest252-21systemd-journal23:10:002
3497707992118,2cyclictest3607633-21cron20:55:001
3497707992117,3cyclictest3643991-21kworker/u8:0+flush-259:021:45:161
3497707992117,3cyclictest3592438-21kworker/u8:3+flush-259:021:20:241
3497707992116,4cyclictest3675090-21apt-get22:00:121
3497705992115,5cyclictest252-21systemd-journal19:15:000
3497715992014,4cyclictest3664814-21/usr/sbin/munin21:50:253
3497710992016,3cyclictest3721337-21kworker/u8:4+flush-259:022:45:152
3497710992016,3cyclictest3721337-21kworker/u8:4+flush-259:022:45:152
3497710992016,3cyclictest3539781-21kworker/u8:1+flush-259:020:40:162
3497707992017,3cyclictest3539781-21kworker/u8:1+events_unbound20:00:201
3497707992017,2cyclictest3539781-21kworker/u8:1+flush-259:021:30:201
3497707992017,2cyclictest3539781-21kworker/u8:1+events_unbound21:35:241
3497707992017,2cyclictest3539781-21kworker/u8:1+events_unbound20:55:151
3497707992015,3cyclictest3799227-21kworker/u8:3+events_unbound00:00:011
3497707992015,3cyclictest3743353-21kworker/u8:1+events_unbound23:24:591
3497707992014,4cyclictest3742416-21/usr/sbin/munin23:05:131
3497715991913,4cyclictest3613215-21diskstats21:00:153
3497710991914,4cyclictest3674873-21kworker/u8:2+flush-259:022:05:012
3497710991912,5cyclictest3587473-21diskstats20:35:142
3497710991910,8cyclictest3710837-21munin-plugin-st22:35:002
3497710991910,7cyclictest252-21systemd-journal22:29:592
349771099190,2cyclictest3669713-21latency_hist21:55:012
3497707991916,2cyclictest3737055-21kworker/u8:0+flush-259:023:42:051
3497707991916,2cyclictest3539993-21kworker/u8:4+events_unbound20:20:171
3497707991914,4cyclictest3539781-21kworker/u8:1+flush-259:021:16:431
3497705991916,2cyclictest3539781-21kworker/u8:1+events_unbound19:55:010
3497705991914,3cyclictest3778837-21/usr/sbin/munin23:40:220
3497705991913,4cyclictest3694531-21ntpq22:15:210
3497705991913,4cyclictest3612788-21latency_hist21:00:010
3497705991913,4cyclictest3549246-21ntpq19:55:210
3497715991815,2cyclictest252-21systemd-journal23:40:003
3497715991811,5cyclictest3555320-21gpgv20:04:593
349771099185,7cyclictest832-21runrttasks22:09:572
3497710991815,2cyclictest3507969-21kworker/u8:1+flush-259:019:25:002
3497710991812,4cyclictest252-21systemd-journal19:11:222
3497710991810,7cyclictest500-21systemd-logind00:40:002
349771099180,1cyclictest3700505-21cron22:25:002
3497707991814,3cyclictest3592438-21kworker/u8:3+events_unbound21:11:411
3497705991815,1cyclictest0-21swapper/022:50:000
3497705991815,1cyclictest0-21swapper/022:50:000
3497705991814,3cyclictest60350irq/132-enp0s29f1:rx-021:10:100
3497705991814,2cyclictest3571181-21kworker/u8:0+flush-259:020:40:010
349771599173,12cyclictest490-21dbus-daemon23:15:003
3497715991713,2cyclictest3704780-21ntp_kernel_pll_22:25:213
3497707991715,1cyclictest3743353-21kworker/u8:1+events_unbound00:10:221
3497707991714,2cyclictest3743353-21kworker/u8:1+events_unbound00:30:211
3497707991714,2cyclictest3497688-21kworker/u8:0+flush-259:019:35:451
3497707991714,2cyclictest1454795-21kworker/u8:2+events_unbound19:15:111
3497707991713,3cyclictest3737055-21kworker/u8:0+events_unbound00:37:291
3497707991713,3cyclictest3643991-21kworker/u8:0+flush-259:022:10:251
3497707991712,3cyclictest3825109-21/usr/sbin/munin00:25:131
3497705991714,2cyclictest60350irq/132-enp0s29f1:rx-023:10:220
3497705991714,2cyclictest60350irq/132-enp0s29f1:rx-022:56:130
3497705991714,2cyclictest60350irq/132-enp0s29f1:rx-022:56:130
3497705991713,3cyclictest60350irq/132-enp0s29f1:rx-000:10:170
3497705991713,3cyclictest3711094-21apt-get22:35:100
3497705991713,3cyclictest3705706-21kworker/u8:1+flush-259:022:35:000
3497705991711,4cyclictest252-21systemd-journal19:26:450
3497705991710,5cyclictest3533777-21ntpq19:40:200
349770599170,15cyclictest3654339-21cut21:40:010
3497715991612,3cyclictest3737055-21kworker/u8:0+flush-259:023:35:003
3497715991612,3cyclictest3608335-21irqcore20:55:163
349771599161,14cyclictest3737051-21true23:00:003
349771599161,14cyclictest3737051-21true23:00:003
3497715991611,3cyclictest3675250-21diskstats22:00:133
3497715991610,4cyclictest252-21systemd-journal19:45:013
349771099169,6cyclictest3829604-21unixbench_singl00:25:242
349771099165,9cyclictest0-21swapper/221:15:012
349771099161,5cyclictest3773402-21latency_hist23:35:012
3497710991613,2cyclictest3661986-21kthreadcore21:45:152
3497710991613,2cyclictest3592438-21kworker/u8:3+flush-259:020:55:162
3497710991613,2cyclictest3503488-21irqcore19:15:152
349771099161,2cyclictest252-21systemd-journal21:40:012
3497710991612,3cyclictest509-21rs:main2
3497710991612,3cyclictest509-21rs:main2
349771099160,4cyclictest3737017-21cron23:00:002
349771099160,4cyclictest3737017-21cron22:59:592
349771099160,4cyclictest3715962-21awk22:40:002
349771099160,3cyclictest3603168-21ps20:50:142
3497707991613,2cyclictest3737055-21kworker/u8:0+flush-259:000:05:201
3497707991613,2cyclictest3643991-21kworker/u8:0+flush-259:021:40:221
3497707991613,2cyclictest3539993-21kworker/u8:4+events_unbound20:07:471
3497707991613,2cyclictest3539781-21kworker/u8:1+events_unbound21:25:131
3497705991614,1cyclictest60350irq/132-enp0s29f1:rx-023:00:450
3497705991614,1cyclictest60350irq/132-enp0s29f1:rx-022:10:200
3497705991614,1cyclictest60350irq/132-enp0s29f1:rx-020:20:140
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-022:00:010
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-021:26:440
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-020:50:160
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-020:16:000
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-000:37:270
3497705991613,2cyclictest60350irq/132-enp0s29f1:rx-000:04:220
3497705991613,2cyclictest3669701-21idleruntime-cro21:55:010
3497705991613,2cyclictest0-21swapper/023:30:000
3497705991612,2cyclictest60350irq/132-enp0s29f1:rx-023:45:200
3497715991511,3cyclictest3539781-21kworker/u8:1+flush-259:021:05:163
3497715991511,2cyclictest3762766-21idleruntime-cro23:25:003
3497715991511,2cyclictest0-21swapper/320:00:003
3497715991510,4cyclictest3601578-21ntpq20:45:203
349771099155,9cyclictest0-21swapper/223:50:172
349771099154,10cyclictest3547511-21kthreadcore19:55:192
349771099153,10cyclictest3805510-21sed00:05:162
349771099153,10cyclictest3758638-21sed23:20:162
349771099153,10cyclictest3573682-21cut20:20:182
349771099153,10cyclictest3562132-21kthreadcore20:10:162
349771099152,9cyclictest3830299-21apt-get00:30:132
349771099152,11cyclictest513-21gdbus22:45:002
349771099151,2cyclictest3554383-21ntpq20:00:202
349771099151,2cyclictest252-21systemd-journal19:30:012
349771099151,1cyclictest3824860-21cron00:24:592
349771099151,1cyclictest3622171-21ntpq21:05:212
349771099151,13cyclictest0-21swapper/221:00:162
349771099150,5cyclictest3525568-21irqstats19:35:162
349771099150,4cyclictest3815893-21ps00:15:172
349771099150,4cyclictest3690246-21turbostat.cron22:14:592
349771099150,3cyclictest3778610-21awk23:40:002
349771099150,3cyclictest3737536-21tune2fs23:00:132
349771099150,3cyclictest3649171-21cron21:35:002
349771099150,3cyclictest3633386-21munin-plugin-st21:20:002
349771099150,3cyclictest3523896-21cron19:35:002
349771099150,2cyclictest3638497-21munin-plugin-st21:25:012
349771099150,2cyclictest3576693-21expr20:25:122
349771099150,13cyclictest3783310-21grep23:40:242
3497707991511,3cyclictest3743353-21kworker/u8:1+flush-259:023:50:251
349770599159,4cyclictest3804764-21diskstats00:05:130
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-023:30:240
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-022:00:160
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-021:00:140
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-020:40:170
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-020:07:260
3497705991513,1cyclictest60350irq/132-enp0s29f1:rx-000:30:240
3497705991513,1cyclictest3497697-21cyclictest22:05:240
3497705991512,2cyclictest60350irq/132-enp0s29f1:rx-022:50:160
3497705991512,2cyclictest60350irq/132-enp0s29f1:rx-022:24:090
3497705991512,2cyclictest60350irq/132-enp0s29f1:rx-020:25:190
3497705991512,2cyclictest60350irq/132-enp0s29f1:rx-019:45:170
3497705991511,3cyclictest3743353-21kworker/u8:1+flush-259:000:25:150
3497705991511,3cyclictest3674873-21kworker/u8:2+events_unbound22:25:240
3497705991510,4cyclictest252-21systemd-journal23:58:440
349771599149,4cyclictest3539993-21kworker/u8:4+flush-259:020:05:253
349771599149,3cyclictest3539781-21kworker/u8:1+events_unbound20:40:173
349771599143,2cyclictest38189342proc_pri00:15:233
3497715991411,2cyclictest3571181-21kworker/u8:0+flush-259:020:35:203
349771099141,3cyclictest3670070-21cpuspeed_turbos21:55:132
349771099141,2cyclictest3810734-21ps00:10:162
349771099141,2cyclictest3654761-21uniq21:40:142
349771099141,2cyclictest3601607-21ntpq20:45:202
349771099140,4cyclictest3785383-21grep23:45:172
349771099140,4cyclictest3728840-21grep22:50:182
349771099140,3cyclictest3798219-21cut23:55:202
349771099140,3cyclictest3690648-21cut22:15:122
3497707991410,3cyclictest3743353-21kworker/u8:1+events_unbound00:20:451
3497707991410,3cyclictest3685144-21kworker/u8:3+flush-259:022:42:251
3497707991410,3cyclictest3674873-21kworker/u8:2+flush-259:023:00:181
349770799140,12cyclictest1-21systemd21:00:441
3497705991412,1cyclictest60350irq/132-enp0s29f1:rx-022:40:410
3497705991412,1cyclictest60350irq/132-enp0s29f1:rx-019:30:220
3497705991411,2cyclictest60350irq/132-enp0s29f1:rx-021:40:280
3497705991411,2cyclictest60350irq/132-enp0s29f1:rx-020:46:380
3497705991411,2cyclictest3760169-21kthreadcore23:20:180
349771599138,4cyclictest3737055-21kworker/u8:0+flush-259:000:23:153
349771599137,4cyclictest252-21systemd-journal19:25:003
349771599136,5cyclictest3566024-21cron20:15:003
349771599136,5cyclictest252-21systemd-journal00:00:443
3497715991310,2cyclictest3752810-21cpuspeed_turbos23:15:133
3497715991310,2cyclictest3542334-21kthreadcore19:50:173
3497715991310,2cyclictest3534975-21cpuspeed_turbos19:45:123
349770799139,3cyclictest3643991-21kworker/u8:0+flush-259:021:55:231
349770599139,3cyclictest3592438-21kworker/u8:3+flush-259:021:15:240
3497705991310,2cyclictest60350irq/132-enp0s29f1:rx-023:50:590
3497705991310,2cyclictest60350irq/132-enp0s29f1:rx-023:06:590
3497705991310,2cyclictest60350irq/132-enp0s29f1:rx-020:01:270
349771599129,2cyclictest3649859-21irqcore21:35:183
349771599129,2cyclictest0-21swapper/319:10:113
349771599126,4cyclictest3586609-21cron20:35:003
349771599126,4cyclictest3586609-21cron20:34:593
3497715991210,1cyclictest0-21swapper/321:25:003
349770799129,2cyclictest3705706-21kworker/u8:1+events_unbound22:35:021
349770799121,2cyclictest3710846-21awk22:35:001
349770599129,2cyclictest60350irq/132-enp0s29f1:rx-021:20:160
349771599118,2cyclictest3603160-21irqcore20:50:143
349771599118,2cyclictest0-21swapper/322:45:173
349771599118,2cyclictest0-21swapper/322:45:173
349771599111,9cyclictest3685084-21cron22:10:003
349771599111,3cyclictest3539781-21kworker/u8:1+flush-259:021:15:013
349770799117,3cyclictest3674873-21kworker/u8:2+events_unbound22:55:041
349770799117,3cyclictest3674873-21kworker/u8:2+events_unbound22:55:041
349771599108,1cyclictest0-21swapper/321:40:153
349771599107,2cyclictest3731427-21unixbench_singl22:50:243
349771599104,4cyclictest252-21systemd-journal22:25:003
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional