You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-01 - 03:42

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot4s.osadl.org (updated Fri May 01, 2026 00:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
420288999490,3cyclictest456293-21apt-get19:45:031
420290994743,3cyclictest638304-21kworker/u8:4+events_unbound23:00:242
420290994339,3cyclictest502993-21kworker/u8:1+events_unbound20:50:222
420290994239,2cyclictest638304-21kworker/u8:4+events_unbound23:35:252
420290994238,3cyclictest711067-21kworker/u8:0+events_unbound00:00:002
420290994137,3cyclictest622843-21kworker/u8:3+flush-259:023:45:222
420290994036,3cyclictest612114-21kworker/u8:1+flush-259:022:15:252
420290994031,3cyclictest575486-21kworker/u8:0+events_unbound21:45:202
420290993936,2cyclictest430282-21kworker/u8:0+events_unbound20:25:142
420290993834,3cyclictest451163-21kworker/u8:2+flush-259:020:20:202
420290993734,2cyclictest606723-21kworker/u8:0+events_unbound22:30:162
420290993633,2cyclictest502993-21kworker/u8:1+flush-259:021:35:232
420288993631,3cyclictest451163-21kworker/u8:2+events_unbound19:50:151
420288993630,4cyclictest513976-21apt-get20:40:101
420294993529,4cyclictest591285-21cat21:55:013
420284993529,4cyclictest529577-21diskstats20:55:140
420290993330,2cyclictest711067-21kworker/u8:0+events_unbound00:00:222
420290993328,4cyclictest622843-21kworker/u8:3+flush-259:023:10:162
420290993229,2cyclictest451163-21kworker/u8:2+events_unbound20:07:142
420290993228,3cyclictest638304-21kworker/u8:4+events_unbound22:55:222
420290993128,2cyclictest430282-21kworker/u8:0+flush-259:019:30:012
420290993128,2cyclictest430282-21kworker/u8:0+events_unbound20:33:472
420288993125,4cyclictest737672-21/usr/sbin/munin00:20:131
420284993126,4cyclictest742412-21apt-get00:23:010
420284993125,4cyclictest715318-21ntpq23:50:220
420284993125,4cyclictest502993-21kworker/u8:1+flush-259:021:00:190
420290993027,2cyclictest638304-21kworker/u8:4+flush-259:023:25:202
420284993027,2cyclictest451163-21kworker/u8:2+flush-259:020:20:240
420294992925,3cyclictest658942-21gpgv23:00:003
420290992926,2cyclictest632956-21kworker/u8:2+flush-259:022:35:162
420290992926,2cyclictest585769-21kworker/u8:2+flush-259:022:20:242
420290992925,3cyclictest451163-21kworker/u8:2+flush-259:019:52:122
420294992823,3cyclictest508134-21latency_hist20:35:003
420294992823,3cyclictest456502-21gpgv19:45:013
420290992825,2cyclictest430282-21kworker/u8:0+events_unbound19:55:172
420290992823,4cyclictest727391-21/usr/sbin/munin00:10:112
420290992724,2cyclictest518898-21kworker/u8:3+flush-259:021:07:212
420290992723,3cyclictest502993-21kworker/u8:1+events_unbound21:00:172
420288992721,5cyclictest252-21systemd-journal20:20:011
420288992721,4cyclictest252-21systemd-journal21:28:471
420284992723,3cyclictest591572-21apt-get21:55:120
420294992620,4cyclictest695163-21latency_hist23:35:013
420294992620,4cyclictest695163-21latency_hist23:35:003
420290992623,2cyclictest622843-21kworker/u8:3+events_unbound22:25:212
420290992622,3cyclictest451163-21kworker/u8:2+events_unbound19:44:462
420290992619,5cyclictest476408-21ntpq20:00:222
420290992522,2cyclictest695050-21kworker/u8:1+events_unbound00:31:542
420290992522,2cyclictest585769-21kworker/u8:2+events_unbound21:55:212
420290992522,2cyclictest430771-21kworker/u8:3+events_unbound19:24:462
420290992521,3cyclictest695050-21kworker/u8:1+events_unbound00:26:472
420290992521,3cyclictest518898-21kworker/u8:3+events_unbound22:01:462
420288992521,3cyclictest732533-21/usr/sbin/munin00:15:241
420284992521,3cyclictest658751-21apt-get23:00:010
420294992420,2cyclictest638337-21apt-get22:40:113
420290992421,2cyclictest638304-21kworker/u8:4+events_unbound23:05:242
420290992421,2cyclictest622843-21kworker/u8:3+events_unbound00:16:462
420290992420,3cyclictest575486-21kworker/u8:0+events_unbound21:53:482
420290992420,3cyclictest502993-21kworker/u8:1+events_unbound20:40:242
420290992419,4cyclictest398450-21kworker/u8:1+flush-259:019:15:162
420290992417,5cyclictest553986-21ntpq21:15:242
420290992417,5cyclictest553986-21ntpq21:15:232
420288992418,4cyclictest509-21rs:main1
420288992418,4cyclictest252-21systemd-journal00:30:381
420284992420,3cyclictest711067-21kworker/u8:0+events_unbound00:00:260
420284992420,3cyclictest622843-21kworker/u8:3+flush-259:000:20:000
420294992317,4cyclictest252-21systemd-journal19:21:453
420290992321,2cyclictest518898-21kworker/u8:3+events_unbound22:10:222
420290992320,2cyclictest518898-21kworker/u8:3+events_unbound20:47:272
420290992319,3cyclictest502993-21kworker/u8:1+events_unbound21:14:482
420288992319,3cyclictest518898-21kworker/u8:3+flush-259:021:20:221
420288992318,3cyclictest612147-21apt-get22:15:121
420288992318,3cyclictest565436-21apt-get21:30:121
420288992317,4cyclictest700553-21cat23:40:011
420284992319,3cyclictest518898-21kworker/u8:3+flush-259:021:30:170
420284992317,4cyclictest252-21systemd-journal23:45:000
42029499221,4cyclictest477276-21latency_hist20:05:013
420294992214,6cyclictest252-21systemd-journal20:50:003
420290992220,2cyclictest430282-21kworker/u8:0+flush-259:020:35:132
420290992219,2cyclictest518898-21kworker/u8:3+events_unbound22:09:472
420290992219,2cyclictest518898-21kworker/u8:3+events_unbound21:42:472
420290992219,2cyclictest502993-21kworker/u8:1+events_unbound21:34:472
420290992219,2cyclictest430282-21kworker/u8:0+events_unbound19:30:192
420288992218,3cyclictest622843-21kworker/u8:3+flush-259:023:50:271
420288992218,3cyclictest590886-21apt-get21:55:001
420288992217,3cyclictest252-21systemd-journal00:02:551
420284992214,6cyclictest434816-21ntpq19:20:200
420294992116,3cyclictest467287-21apt-get19:55:113
420294992115,4cyclictest560275-21apt-get21:25:123
420294992115,4cyclictest518898-21kworker/u8:3+flush-259:021:20:263
420294992112,7cyclictest743000-21cpuspeed_turbos00:25:163
420290992118,2cyclictest638304-21kworker/u8:4+events_unbound22:49:472
420290992118,2cyclictest622843-21kworker/u8:3+events_unbound23:34:462
420290992118,2cyclictest622843-21kworker/u8:3+events_unbound23:34:462
420290992117,3cyclictest711067-21kworker/u8:0+events_unbound00:07:592
420290992117,3cyclictest518898-21kworker/u8:3+events_unbound20:55:212
420284992118,2cyclictest211rcuc/021:20:000
420284992118,2cyclictest211rcuc/021:20:000
420294992013,5cyclictest638070-21latency_hist22:40:013
420290992017,2cyclictest451163-21kworker/u8:2+events_unbound19:45:222
420290992017,2cyclictest430282-21kworker/u8:0+flush-259:020:15:252
420288992016,3cyclictest695050-21kworker/u8:1+flush-259:000:40:001
420288992016,3cyclictest252-21systemd-journal20:58:461
420284992016,3cyclictest638304-21kworker/u8:4+events_unbound23:05:200
420284992015,3cyclictest638304-21kworker/u8:4+flush-259:023:25:150
420284992015,3cyclictest451163-21kworker/u8:2+flush-259:020:00:170
42029499197,10cyclictest252-21systemd-journal23:39:463
420294991916,2cyclictest575710-21apt-get21:40:103
420294991915,3cyclictest695050-21kworker/u8:1+flush-259:000:25:013
420294991913,4cyclictest716203-21latency_hist23:55:003
42029499190,3cyclictest623892-21grep22:25:163
420290991916,2cyclictest2971-21cron19:40:012
420290991915,3cyclictest518898-21kworker/u8:3+events_unbound21:25:262
420288991915,3cyclictest622843-21kworker/u8:3+flush-259:023:55:251
420284991916,2cyclictest518898-21kworker/u8:3+events_unbound21:10:200
420284991916,2cyclictest502993-21kworker/u8:1+flush-259:020:50:150
420284991916,2cyclictest451163-21kworker/u8:2+events_unbound20:30:220
420284991915,3cyclictest430282-21kworker/u8:0+flush-259:019:35:160
420284991913,4cyclictest674609-21latency_hist23:15:000
420284991913,4cyclictest430282-21kworker/u8:0+flush-259:020:25:160
42029499183,3cyclictest513-21gdbus21:35:013
420294991815,2cyclictest529159-21awk20:54:593
42029499181,3cyclictest617032-21cron22:20:003
420294991813,3cyclictest661731-21kthreadcore23:00:183
420294991813,3cyclictest252-21systemd-journal20:05:463
42029499180,2cyclictest758151-21latency_hist00:40:013
420290991815,2cyclictest695050-21kworker/u8:1+flush-259:000:20:222
420290991815,2cyclictest695050-21kworker/u8:1+events_unbound23:40:252
420288991814,3cyclictest502993-21kworker/u8:1+flush-259:021:00:191
420288991814,3cyclictest455401-21ntp_kernel_pll_19:40:201
420288991813,4cyclictest648704-21apt-get22:50:111
420284991814,3cyclictest622843-21kworker/u8:3+events_unbound22:40:230
420284991814,3cyclictest430771-21kworker/u8:3+flush-259:019:25:200
420284991814,3cyclictest430282-21kworker/u8:0+events_unbound19:40:210
420284991811,5cyclictest663459-21ntpq23:00:220
42029499172,2cyclictest701011-21apt-get23:40:163
42029499171,5cyclictest554919-21systemd-run21:20:003
42029499171,5cyclictest554919-21systemd-run21:20:003
42029499171,4cyclictest679744-21cron23:20:013
42029499171,4cyclictest596442-21cron22:00:003
42029499171,4cyclictest513-21gdbus22:05:013
42029499171,4cyclictest430541-21turbostat.cron19:19:593
42029499171,3cyclictest513706-21apt20:40:003
42029499171,3cyclictest252-21systemd-journal22:25:003
42029499170,4cyclictest670142-21cut23:10:173
420290991714,2cyclictest559998-21idleruntime-cro21:25:002
420290991714,2cyclictest430282-21kworker/u8:0+events_unbound20:10:262
420290991714,2cyclictest410292-21kworker/u8:4+flush-259:019:10:202
420290991713,3cyclictest622843-21kworker/u8:3+events_unbound22:40:122
420288991714,1cyclictest0-21swapper/120:35:001
420288991712,4cyclictest622843-21kworker/u8:3+flush-259:022:25:211
420288991711,5cyclictest600658-21ntpq22:00:201
420284991715,1cyclictest430282-21kworker/u8:0+flush-259:019:30:160
420284991714,2cyclictest622843-21kworker/u8:3+flush-259:023:15:240
420284991714,2cyclictest61150irq/133-enp0s29f1:tx-023:30:130
420284991714,2cyclictest61150irq/133-enp0s29f1:tx-023:30:130
420284991714,2cyclictest60350irq/132-enp0s29f1:rx-000:28:080
420284991713,3cyclictest451163-21kworker/u8:2+events_unbound19:45:240
420284991710,5cyclictest472135-21latency_hist20:00:010
42029499165,2cyclictest549861-21cat21:15:013
42029499164,3cyclictest533482-21ld20:55:223
42029499161,5cyclictest683250-21cut23:20:183
42029499161,4cyclictest664597-21taskset23:05:143
42029499161,4cyclictest653089-21grep22:50:243
42029499161,4cyclictest543763-21ntpq21:05:223
42029499161,4cyclictest457294-21hddtemp_smartct19:45:153
42029499161,3cyclictest721387-21basename00:00:003
42029499161,3cyclictest711048-21turbostat23:50:003
42029499161,3cyclictest513-21gdbus22:15:013
42029499161,3cyclictest252-21systemd-journal21:50:003
42029499161,2cyclictest736545-21ntpq00:15:223
42029499161,2cyclictest727157-21turbostat.cron00:10:013
42029499161,2cyclictest722060-21cut00:00:183
42029499161,2cyclictest632919-21munin-run22:35:003
42029499160,4cyclictest539008-21grep21:00:273
42029499160,2cyclictest685558-21sed23:25:153
420290991613,2cyclictest622843-21kworker/u8:3+flush-259:023:19:512
420288991613,2cyclictest430525-21cron19:20:001
420288991612,3cyclictest638304-21kworker/u8:4+flush-259:023:10:251
420288991610,4cyclictest632042-21ntpq22:30:231
420284991614,1cyclictest60350irq/132-enp0s29f1:rx-022:30:260
420284991613,2cyclictest60350irq/132-enp0s29f1:rx-023:55:470
420284991613,2cyclictest60350irq/132-enp0s29f1:rx-020:46:150
420284991613,2cyclictest60350irq/132-enp0s29f1:rx-019:51:580
420284991612,3cyclictest617284-21store22:20:000
420284991612,3cyclictest430282-21kworker/u8:0+flush-259:020:35:210
42029499157,7cyclictest0-21swapper/320:25:003
42029499155,9cyclictest446329-21cpuspeed_turbos19:35:123
42029499151,4cyclictest498315-21/usr/sbin/munin20:25:123
42029499151,4cyclictest466216-21nvmesmart_nvme019:50:223
42029499151,3cyclictest606700-21turbostat22:10:003
42029499151,2cyclictest727829-21cut00:10:133
42029499151,2cyclictest648439-21apt22:50:003
42029499151,2cyclictest514398-21grep20:40:153
42029499150,5cyclictest748261-21/usr/sbin/munin00:30:153
42029499150,4cyclictest492262-21head20:15:263
42029499150,4cyclictest436070-21cpuspeed_turbos19:25:133
42029499150,3cyclictest420605-21cut19:10:133
42029499150,3cyclictest420354-21ls19:10:003
42029499150,2cyclictest486668-21ntpq20:10:243
420288991511,3cyclictest502993-21kworker/u8:1+flush-259:021:35:141
42028899151,12cyclictest1-21systemd22:48:461
420284991514,1cyclictest60350irq/132-enp0s29f1:rx-021:45:130
420284991513,1cyclictest60350irq/132-enp0s29f1:rx-020:15:210
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-023:48:560
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-023:35:190
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-022:50:100
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-022:37:410
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-021:40:200
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-020:05:120
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-019:10:250
420284991512,2cyclictest60350irq/132-enp0s29f1:rx-000:35:110
420284991512,2cyclictest509-21rs:main0
420284991512,2cyclictest398450-21kworker/u8:1+events_unbound19:15:150
420284991512,2cyclictest0-21swapper/021:20:190
42029499141,4cyclictest441470-21awk19:30:143
420290991411,2cyclictest695050-21kworker/u8:1+events_unbound00:35:152
420290991411,2cyclictest652753-21ntp_offset22:50:212
420290991410,3cyclictest638304-21kworker/u8:4+events_unbound23:23:312
42028899148,4cyclictest705911-21latency_hist23:45:001
42028899148,4cyclictest596449-21latency_hist22:00:011
42028899147,5cyclictest502086-21ntpq20:25:201
420288991412,1cyclictest0-21swapper/122:25:001
420288991411,2cyclictest638757-21irqcore22:40:161
420288991411,2cyclictest477538-21apt-get20:05:091
42028499149,4cyclictest606723-21kworker/u8:0+flush-259:022:20:020
420284991412,1cyclictest60350irq/132-enp0s29f1:rx-023:20:160
420284991412,1cyclictest60350irq/132-enp0s29f1:rx-021:35:230
420284991412,1cyclictest60350irq/132-enp0s29f1:rx-000:10:080
420284991412,1cyclictest60350irq/132-enp0s29f1:rx-000:07:460
420284991411,2cyclictest60350irq/132-enp0s29f1:rx-022:05:110
420284991411,2cyclictest60350irq/132-enp0s29f1:rx-000:30:140
420284991410,3cyclictest622843-21kworker/u8:3+events_unbound22:45:250
42028899139,3cyclictest252-21systemd-journal21:47:311
42028899138,2cyclictest252-21systemd-journal19:35:011
42028899136,5cyclictest512787-21ntpq20:35:191
420288991311,1cyclictest676235-21runrttasks23:15:171
420284991311,1cyclictest60350irq/132-enp0s29f1:rx-022:10:500
42029099128,3cyclictest622843-21kworker/u8:3+events_unbound23:51:152
42028899129,2cyclictest706366-21fschecks_count23:45:141
42028899128,3cyclictest622843-21kworker/u8:3+flush-259:023:20:251
42028899128,3cyclictest430771-21kworker/u8:3+flush-259:019:20:261
42028899127,4cyclictest638304-21kworker/u8:4+events_unbound23:30:221
42028899127,4cyclictest638304-21kworker/u8:4+events_unbound23:30:221
42028899127,3cyclictest658769-21gpgv23:00:001
420288991210,1cyclictest0-21swapper/100:25:281
42028499129,3cyclictest430282-21kworker/u8:0+events_unbound20:10:190
42028499129,2cyclictest60350irq/132-enp0s29f1:rx-022:00:350
42028899118,2cyclictest502993-21kworker/u8:1+flush-259:021:10:241
42028899118,1cyclictest0-21swapper/100:10:141
42028899117,3cyclictest518898-21kworker/u8:3+events_unbound22:05:201
42028899108,1cyclictest421523-21tr19:10:171
42028899108,1cyclictest0-21swapper/119:35:151
42028899107,1cyclictest0-21swapper/121:15:191
42028899107,1cyclictest0-21swapper/121:15:191
42028899106,3cyclictest518898-21kworker/u8:3+events_unbound21:05:261
42028899105,3cyclictest252-21systemd-journal19:29:441
4202889995,3cyclictest252-21systemd-journal23:07:451
4202889995,2cyclictest496989-21ntpq20:20:201
4202889986,1cyclictest0-21swapper/121:40:171
4202889973,2cyclictest7269282sleep100:07:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional