You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-23 - 15:50

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot4s.osadl.org (updated Thu Apr 23, 2026 12:44:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3810469995450,3cyclictest4121184-21kworker/u8:3+events_unbound12:10:010
3810469995047,2cyclictest3778349-21kworker/u8:3+events_unbound08:35:010
3810469994642,3cyclictest3904047-21kworker/u8:1+flush-259:009:25:000
3810479994539,4cyclictest3836151-21latency_hist07:35:013
3810479994442,1cyclictest3872766-21fwupd08:06:263
3810469994441,2cyclictest3757639-21kworker/u8:2+events_unbound09:00:010
3810469994440,3cyclictest3757639-21kworker/u8:2+events_unbound07:15:240
3810469994237,3cyclictest4069621-21apt-get11:20:120
3810469994138,2cyclictest3992109-21kworker/u8:1+events_unbound10:10:140
3810469994137,3cyclictest3992109-21kworker/u8:1+flush-259:010:20:200
3810469994036,3cyclictest4023015-21kworker/u8:3+events_unbound11:40:220
3810469993936,2cyclictest3934998-21kworker/u8:0+flush-259:009:15:240
3810471993833,4cyclictest3960771-21apt-get09:35:031
3810471993832,4cyclictest4131238-21ntpq12:15:221
3810471993831,5cyclictest4084805-21latency_hist11:35:001
3810469993835,2cyclictest4126829-21kworker/u8:1+flush-259:012:35:250
3810469993834,3cyclictest3757639-21kworker/u8:2+events_unbound07:45:180
3810469993734,2cyclictest3924701-21kworker/u8:3+events_unbound09:00:200
3810469993730,5cyclictest3997235-21latency_hist10:10:000
3810469993632,3cyclictest4023015-21kworker/u8:3+events_unbound10:40:200
3810479993531,3cyclictest3992109-21kworker/u8:1+flush-259:010:50:013
3810471993527,6cyclictest3867924-21latency_hist08:05:011
3810469993532,2cyclictest4002371-21kworker/u8:0+flush-259:010:45:250
3810469993532,2cyclictest3757639-21kworker/u8:2+events_unbound08:50:230
3810479993428,4cyclictest252-21systemd-journal08:20:273
3810469993431,3cyclictest3757639-21kworker/u8:2+flush-259:008:05:230
3810469993430,3cyclictest3757639-21kworker/u8:2+events_unbound08:20:150
3810469993428,2cyclictest4023015-21kworker/u8:3+events_unbound11:10:140
3810469993329,3cyclictest3778349-21kworker/u8:3+events_unbound07:25:230
3810469993328,4cyclictest4002371-21kworker/u8:0+flush-259:011:45:210
3810469993327,4cyclictest4132128-21latency_hist12:20:010
3810474993226,5cyclictest4104949-21ntpq11:50:202
3810474993224,6cyclictest4053054-21ntpq11:00:212
3810471993227,3cyclictest4147808-21/usr/sbin/munin12:35:141
3810469993229,3cyclictest4126829-21kworker/u8:1+flush-259:012:20:220
3810469993227,3cyclictest4142187-21kworker/u8:2+events_unbound12:30:180
3810469993226,5cyclictest4080058-21diskstats11:30:130
3810471993123,5cyclictest4048753-21latency_hist11:00:011
3810469993128,2cyclictest3778349-21kworker/u8:3+events_unbound07:55:150
3810469993128,2cyclictest211rcuc/007:50:230
3810469993127,3cyclictest3778349-21kworker/u8:3+events_unbound07:35:250
3810469993127,3cyclictest3778349-21kworker/u8:3+events_unbound07:20:230
3810469993126,3cyclictest252-21systemd-journal09:44:240
3810471993025,3cyclictest4002371-21kworker/u8:0+flush-259:010:20:011
3810469993027,2cyclictest3934998-21kworker/u8:0+flush-259:009:30:200
3810479992923,4cyclictest252-21systemd-journal08:49:593
3810471992924,4cyclictest3862367-21gpgv08:00:001
3810471992923,4cyclictest3924683-21latency_hist09:00:001
3810469992926,2cyclictest4002371-21kworker/u8:0+events_unbound11:15:140
3810469992926,2cyclictest3934998-21kworker/u8:0+events_unbound09:35:180
3810469992925,3cyclictest3757639-21kworker/u8:2+events_unbound08:40:220
3810469992925,3cyclictest3757639-21kworker/u8:2+events_unbound08:00:020
3810469992922,3cyclictest4002371-21kworker/u8:0+events_unbound10:15:170
3810479992825,2cyclictest3778349-21kworker/u8:3+flush-259:008:35:163
3810469992825,2cyclictest4023015-21kworker/u8:3+events_unbound11:25:140
3810479992723,3cyclictest3888570-21kworker/u8:0+flush-259:008:25:163
3810479992722,4cyclictest3778349-21kworker/u8:3+flush-259:008:15:003
3810479992721,4cyclictest4059063-21latency_hist11:10:003
3810479992721,4cyclictest3894164-21diskstats08:30:123
3810471992720,5cyclictest4094667-21ntpq11:40:211
3810471992720,5cyclictest4053896-21latency_hist11:05:001
3810471992720,5cyclictest4011798-21ntpq10:20:191
3810469992724,2cyclictest3981825-21kworker/u8:3+events_unbound10:00:210
3810469992724,2cyclictest3934998-21kworker/u8:0+flush-259:009:50:240
3810469992723,3cyclictest3778349-21kworker/u8:3+events_unbound08:35:240
3810479992622,3cyclictest4002371-21kworker/u8:0+flush-259:011:20:003
3810479992621,4cyclictest252-21systemd-journal11:05:003
3810474992620,4cyclictest4141495-21ntpq12:25:202
3810471992620,4cyclictest3815885-21apt-get07:15:121
3810471992620,4cyclictest252-21systemd-journal11:30:001
3810471992620,4cyclictest252-21systemd-journal09:15:001
3810469992622,3cyclictest3778349-21kworker/u8:3+flush-259:008:15:270
3810479992521,3cyclictest4121184-21kworker/u8:3+flush-259:012:10:003
3810474992519,4cyclictest3971499-21latency_hist09:45:002
3810471992519,4cyclictest4142405-21latency_hist12:30:011
3810469992522,2cyclictest4132172-21kworker/u8:0+events_unbound12:25:140
3810469992521,3cyclictest4100895-21kworker/u8:2+events_unbound11:50:190
3810469992521,3cyclictest4002371-21kworker/u8:0+events_unbound12:12:260
3810479992420,3cyclictest3904047-21kworker/u8:1+flush-259:009:25:263
3810479992420,3cyclictest3904047-21kworker/u8:1+flush-259:009:25:253
3810479992419,4cyclictest3945521-21/usr/sbin/munin09:20:143
3810479992419,3cyclictest3987191-21/usr/sbin/munin10:00:193
3810479992418,4cyclictest4126967-21latency_hist12:15:013
3810479992418,4cyclictest252-21systemd-journal10:26:243
3810479992418,4cyclictest252-21systemd-journal10:19:563
3810474992418,4cyclictest4111034-21latency_hist12:00:012
3810474992417,5cyclictest4068431-21ntpq11:15:192
3810471992420,3cyclictest509-21rs:main1
3810471992419,4cyclictest3992109-21kworker/u8:1+flush-259:010:15:001
3810471992419,3cyclictest252-21systemd-journal09:23:251
3810469992421,2cyclictest4023015-21kworker/u8:3+flush-259:011:05:250
3810474992318,4cyclictest4073561-21ntpq11:20:212
3810471992318,4cyclictest4132389-21apt-get12:20:101
3810469992320,2cyclictest3934998-21kworker/u8:0+events_unbound09:45:140
3810479992220,1cyclictest4089933-21sh11:39:593
3810474992219,2cyclictest3934998-21kworker/u8:0+flush-259:009:50:002
3810474992216,4cyclictest3830168-21ntpq07:25:202
3810471992217,4cyclictest3757639-21kworker/u8:2+flush-259:008:55:001
3810471992215,5cyclictest3959906-21ntpq09:30:221
3810471992214,7cyclictest0-21swapper/108:15:001
3810471992214,6cyclictest3903124-21ntpq08:35:191
3810469992219,2cyclictest3934998-21kworker/u8:0+events_unbound09:10:110
3810469992219,2cyclictest3904047-21kworker/u8:1+flush-259:009:25:160
3810469992219,2cyclictest3904047-21kworker/u8:1+flush-259:009:25:150
3810469992219,2cyclictest3757639-21kworker/u8:2+events_unbound07:10:140
3810469992218,3cyclictest4002371-21kworker/u8:0+flush-259:010:30:210
3810469992218,3cyclictest4002371-21kworker/u8:0+events_unbound11:35:120
3810469992218,2cyclictest4023015-21kworker/u8:3+flush-259:011:00:100
3810479992118,2cyclictest4126829-21kworker/u8:1+events_unbound12:20:203
3810474992118,2cyclictest3757639-21kworker/u8:2+flush-259:007:15:172
3810474992117,3cyclictest3992109-21kworker/u8:1+events_unbound10:50:162
3810469992118,2cyclictest3904047-21kworker/u8:1+events_unbound09:05:220
3810469992116,4cyclictest3873338-21apt-get08:10:110
3810479992016,3cyclictest3757639-21kworker/u8:2+flush-259:008:50:173
3810479992015,3cyclictest3778349-21kworker/u8:3+flush-259:007:40:193
3810474992018,1cyclictest132-1kworker/2:1H+kblockd08:06:272
3810474992017,2cyclictest3778349-21kworker/u8:3+flush-259:008:30:152
3810474992016,3cyclictest3757639-21kworker/u8:2+flush-259:007:45:002
3810474992015,4cyclictest4132364-21/usr/sbin/munin12:20:132
381047199204,14cyclictest3873065-21idleruntime-cro08:10:001
3810471992015,4cyclictest3757639-21kworker/u8:2+flush-259:007:45:141
3810471992012,7cyclictest3955589-21sh09:30:011
3810471992012,7cyclictest3955589-21sh09:30:001
3810469992014,5cyclictest3888825-21apt-get08:25:110
3810479991917,1cyclictest0-21swapper/307:30:013
3810479991914,4cyclictest4090621-21apt-get11:40:113
3810474991916,2cyclictest4002371-21kworker/u8:0+events_unbound12:10:162
3810474991916,2cyclictest3904047-21kworker/u8:1+flush-259:009:25:252
3810474991916,2cyclictest3904047-21kworker/u8:1+flush-259:009:25:242
3810474991915,3cyclictest3836423-21apt-get07:35:112
3810474991914,3cyclictest3821026-21apt-get07:20:112
3810474991913,4cyclictest4022119-21ntpq10:30:212
381047199196,11cyclictest4069371-21awk11:19:591
3810471991916,2cyclictest3778349-21kworker/u8:3+flush-259:007:35:161
3810471991913,4cyclictest252-21systemd-journal07:24:251
3810471991911,7cyclictest1-21systemd07:55:021
381047199190,3cyclictest4034000-21irqcore10:45:171
3810469991916,2cyclictest4002371-21kworker/u8:0+events_unbound10:55:250
3810469991913,4cyclictest3982225-21diskstats09:55:140
3810479991812,4cyclictest4146744-21ntpq12:30:223
3810474991815,2cyclictest3757639-21kworker/u8:2+flush-259:007:30:262
3810474991814,3cyclictest3810674-21/usr/sbin/munin07:10:142
3810474991814,3cyclictest3778349-21kworker/u8:3+flush-259:008:36:132
3810474991813,3cyclictest3960939-21cat09:35:002
381047199185,11cyclictest3992818-21sed10:05:151
3810471991813,3cyclictest4038651-21apt-get10:50:091
3810469991815,2cyclictest4002371-21kworker/u8:0+events_unbound10:35:250
3810469991815,2cyclictest3778349-21kworker/u8:3+events_unbound07:32:560
3810469991814,3cyclictest4002371-21kworker/u8:0+events_unbound10:25:550
3810479991714,2cyclictest4095543-21kworker/u8:1+flush-259:011:55:003
3810479991714,2cyclictest4002371-21kworker/u8:0+flush-259:010:35:163
3810479991714,2cyclictest3945282-21sh09:20:003
3810474991713,3cyclictest4023015-21kworker/u8:3+flush-259:011:35:162
3810474991713,3cyclictest4002371-21kworker/u8:0+flush-259:010:55:252
3810474991712,3cyclictest4023015-21kworker/u8:3+flush-259:011:30:152
381047199176,9cyclictest0-21swapper/109:50:251
381047199175,4cyclictest3814593-21sed07:10:181
381047199175,10cyclictest500-21systemd-logind11:50:011
381047199173,8cyclictest3971510-21basename09:45:001
381047199171,4cyclictest4121374-21sh12:10:001
3810471991710,5cyclictest3831032-21latency_hist07:30:011
381047199170,5cyclictest3986965-21idleruntime-cro10:00:001
381047199170,14cyclictest4106025-21cat11:55:011
3810479991610,4cyclictest252-21systemd-journal10:50:243
3810474991614,1cyclictest3920788-21kthreadcore08:55:152
3810474991613,2cyclictest4002371-21kworker/u8:0+flush-259:011:15:002
3810474991613,2cyclictest4002371-21kworker/u8:0+flush-259:010:15:212
3810474991613,2cyclictest3757639-21kworker/u8:2+flush-259:007:50:212
3810474991612,3cyclictest3992109-21kworker/u8:1+flush-259:010:20:232
3810474991612,3cyclictest3924701-21kworker/u8:3+flush-259:009:00:212
381047199167,8cyclictest0-21swapper/108:45:261
381047199165,9cyclictest4146454-21latency12:30:191
381047199165,9cyclictest252-21systemd-journal09:50:011
381047199161,4cyclictest4059067-21grep11:10:001
3810471991611,4cyclictest3888570-21kworker/u8:0+flush-259:008:29:551
381047199160,3cyclictest4126960-21sh12:14:591
3810469991613,2cyclictest60350irq/132-enp0s29f1:rx-010:50:160
3810469991613,2cyclictest3757639-21kworker/u8:2+events_unbound07:43:190
3810469991612,3cyclictest3904047-21kworker/u8:1+events_unbound08:46:070
3810479991511,3cyclictest3929817-21journal-offline09:05:003
3810474991512,2cyclictest4116889-21irqcore12:05:162
3810474991512,2cyclictest4078735-21ntp_kernel_pll_11:25:202
3810474991512,2cyclictest3986081-21ntp_kernel_pll_09:55:202
3810474991511,3cyclictest4002371-21kworker/u8:0+events_unbound10:25:202
3810474991511,3cyclictest3778349-21kworker/u8:3+flush-259:007:55:162
3810474991511,2cyclictest0-21swapper/209:24:592
3810474991510,4cyclictest3904262-21/usr/sbin/munin08:40:192
3810474991510,3cyclictest3778349-21kworker/u8:3+flush-259:008:20:172
3810474991510,3cyclictest252-21systemd-journal11:45:012
381047199154,3cyclictest4014651-21cut10:25:181
381047199153,3cyclictest4070592-21sed11:20:171
381047199152,2cyclictest4028352-21apt-get10:40:111
381047199152,2cyclictest4027642-21unixbench_singl10:35:231
381047199151,4cyclictest4089445-21unixbench_multi11:35:241
381047199151,3cyclictest3831711-21grep07:30:181
381047199151,3cyclictest252-21systemd-journal09:01:261
381047199151,2cyclictest4116203-21cron12:05:001
381047199151,2cyclictest4059461-21grep11:10:121
381047199150,4cyclictest4106254-21grep11:55:111
381047199150,4cyclictest4022161-21grep10:30:221
381047199150,4cyclictest3846439-21cron07:45:001
381047199150,3cyclictest3992067-21cron10:05:011
381047199150,3cyclictest3810472-21cat07:10:001
381047199150,1cyclictest3940822-21sed09:15:161
381046999156,1cyclictest191rcu_preempt11:55:180
381047999149,4cyclictest252-21systemd-journal10:34:563
3810479991412,1cyclictest4142187-21kworker/u8:2+events_unbound12:35:213
3810479991411,2cyclictest4047794-21needreboot10:55:203
3810479991411,2cyclictest4023015-21kworker/u8:3+flush-259:011:35:003
3810479991410,3cyclictest3778349-21kworker/u8:3+flush-259:008:20:013
381047499149,4cyclictest4100895-21kworker/u8:2+flush-259:012:00:162
3810474991412,1cyclictest4099675-21needreboot11:45:192
381047199141,2cyclictest3888544-21cron08:25:001
381047999139,3cyclictest4106112-21apt-get11:55:113
381047999139,3cyclictest4100895-21kworker/u8:2+flush-259:012:00:173
381047999139,3cyclictest3934998-21kworker/u8:0+flush-259:009:30:273
381047999139,2cyclictest0-21swapper/308:55:123
3810479991310,2cyclictest4128244-21kthreadcore12:15:173
3810479991310,2cyclictest3977955-21kthreadcore09:50:183
381047499139,3cyclictest3904047-21kworker/u8:1+flush-259:009:05:232
3810474991310,2cyclictest500-21systemd-logind08:50:002
3810474991310,2cyclictest3944791-21unixbench_multi09:15:262
381047999129,2cyclictest3965875-21unixbench_multi09:35:253
381047999129,2cyclictest3934479-21unixbench_multi09:05:243
381047999129,2cyclictest0-21swapper/311:15:003
381047999129,2cyclictest0-21swapper/307:35:163
381047999128,2cyclictest0-21swapper/311:25:143
381047999127,4cyclictest3825019-21ntpq07:20:213
3810479991210,1cyclictest0-21swapper/309:45:183
381047499129,2cyclictest3914682-21cpuspeed_turbos08:50:122
381047499128,3cyclictest4023015-21kworker/u8:3+events_unbound11:05:212
381047499127,3cyclictest252-21systemd-journal12:37:252
381047999119,1cyclictest0-21swapper/308:00:013
381047999118,2cyclictest4032734-21unixbench_multi10:40:233
381047999118,2cyclictest3757639-21kworker/u8:2+flush-259:007:50:163
381047999118,2cyclictest0-21swapper/310:10:233
381047999118,2cyclictest0-21swapper/310:05:133
381047999117,2cyclictest3757639-21kworker/u8:2+flush-259:008:05:003
381047999116,3cyclictest252-21systemd-journal11:49:593
381047499119,1cyclictest0-21swapper/209:50:142
381047499118,2cyclictest4147554-21cron12:35:002
381047499118,2cyclictest4037414-21needreboot10:45:212
381047499118,2cyclictest4032215-21needreboot10:40:192
381047999106,3cyclictest491ktimers/309:40:133
381047499107,2cyclictest4001917-21unixbench_singl10:10:232
381047499104,4cyclictest3992344-21apt-get10:05:122
381047499101,7cyclictest4027237-21ntpq10:35:202
381047499101,6cyclictest3851595-21munin-plugin-st07:50:002
38104799997,1cyclictest0-21swapper/307:10:173
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional