You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-05 - 20:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4s.osadl.org (updated Sun Apr 05, 2026 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
481033994134,4cyclictest589427-21latency_hist08:55:001
481033994129,10cyclictest698104-40mandb10:36:211
48102999390,37cyclictest1-21systemd08:35:000
481039993832,4cyclictest615306-21gpgv09:20:013
481029993834,3cyclictest533040-21kworker/u8:2+flush-259:009:25:210
481029993732,3cyclictest776762-21apt-get11:55:110
481029993632,3cyclictest533040-21kworker/u8:2+flush-259:008:39:590
481039993529,3cyclictest693282-21latency_hist10:35:013
481033993532,2cyclictest533040-21kworker/u8:2+flush-259:009:35:011
481029993532,2cyclictest516949-21kworker/u8:1+events_unbound07:45:170
481039993430,3cyclictest533040-21kworker/u8:2+events_unbound08:42:203
481033993428,4cyclictest252-21systemd-journal12:21:221
481029993430,3cyclictest533040-21kworker/u8:2+events_unbound08:20:240
481033993327,4cyclictest252-21systemd-journal09:50:001
481029993329,3cyclictest771119-21kworker/u8:4+flush-259:012:20:240
481039993229,2cyclictest797606-21kworker/u8:0+events_unbound12:16:233
481039993228,3cyclictest464445-21kworker/u8:4+events_unbound07:13:263
481039993227,4cyclictest641427-21apt-get09:45:003
481033993229,2cyclictest599749-21kworker/u8:0+flush-259:009:40:181
481029993228,3cyclictest807828-21kworker/u8:3+flush-259:012:30:010
481029993225,5cyclictest714313-21latency_hist10:55:010
481039993130,1cyclictest470425-21kworker/u8:0+events_unbound07:55:153
481039993126,3cyclictest543329-21apt-get08:10:133
481039993027,2cyclictest807828-21kworker/u8:3+events_unbound12:33:233
481037993025,4cyclictest533040-21kworker/u8:2+flush-259:008:10:242
481033993025,4cyclictest507073-21diskstats07:35:141
481033993023,5cyclictest547430-21ntpq08:10:231
481033992924,3cyclictest509-21rs:main1
481033992923,4cyclictest252-21systemd-journal12:11:231
481039992825,2cyclictest620798-21kworker/u8:5+events_unbound10:27:213
481039992825,2cyclictest599749-21kworker/u8:0+events_unbound09:51:213
481039992822,4cyclictest252-21systemd-journal07:39:193
481029992823,4cyclictest533040-21kworker/u8:2+events_unbound09:00:140
481033992722,3cyclictest734862-21kworker/u8:2+flush-259:011:50:161
481029992723,3cyclictest516949-21kworker/u8:1+flush-259:008:10:000
481029992722,3cyclictest532414-21gpgv08:00:000
481039992620,4cyclictest657297-21latency_hist10:00:003
481029992623,2cyclictest683031-21kworker/u8:1+flush-259:011:45:260
481029992620,4cyclictest656423-21ntpq09:55:210
481039992523,2cyclictest683031-21kworker/u8:1+events_unbound10:54:103
481039992522,2cyclictest599749-21kworker/u8:0+events_unbound10:08:213
481037992520,4cyclictest533040-21kworker/u8:2+flush-259:008:20:172
481037992520,3cyclictest533040-21kworker/u8:2+flush-259:008:15:142
481037992518,5cyclictest252-21systemd-journal07:55:012
481029992522,2cyclictest533040-21kworker/u8:2+flush-259:008:25:240
481029992521,3cyclictest533040-21kworker/u8:2+events_unbound08:45:150
481039992421,2cyclictest734862-21kworker/u8:2+events_unbound11:59:563
481039992421,2cyclictest683031-21kworker/u8:1+events_unbound10:59:163
481037992420,3cyclictest516949-21kworker/u8:1+flush-259:008:05:002
481037992418,4cyclictest755431-21latency_hist11:35:012
481037992418,4cyclictest755431-21latency_hist11:35:012
481029992422,1cyclictest683031-21kworker/u8:1+events_unbound10:30:120
481029992421,2cyclictest533040-21kworker/u8:2+flush-259:008:44:590
481029992421,2cyclictest533040-21kworker/u8:2+events_unbound08:15:120
481029992421,2cyclictest516949-21kworker/u8:1+flush-259:008:15:000
481029992421,2cyclictest470425-21kworker/u8:0+flush-259:007:20:240
481029992419,3cyclictest678154-21apt-get10:20:110
481039992319,3cyclictest599749-21kworker/u8:0+events_unbound10:44:373
481037992318,3cyclictest252-21systemd-journal08:48:442
481033992319,3cyclictest532393-21munin-plugin-st08:00:001
481033992318,3cyclictest704034-21kworker/u8:3+flush-259:011:15:161
481033992317,4cyclictest662694-21apt-get10:05:121
481029992319,3cyclictest584471-21kworker/u8:4+flush-259:009:15:150
481029992319,3cyclictest533040-21kworker/u8:2+flush-259:009:45:180
481029992317,5cyclictest485211-21ntpq07:10:200
481029992316,5cyclictest486543-21diskstats07:15:140
481039992219,2cyclictest807828-21kworker/u8:3+events_unbound12:35:363
481039992219,2cyclictest599749-21kworker/u8:0+events_unbound09:38:523
481039992219,2cyclictest516949-21kworker/u8:1+events_unbound09:04:333
481039992218,3cyclictest642081-21/usr/sbin/munin09:45:143
481039992214,5cyclictest252-21systemd-journal12:25:003
481037992218,3cyclictest599749-21kworker/u8:0+flush-259:010:25:012
481037992218,3cyclictest584471-21kworker/u8:4+flush-259:008:50:172
481037992217,3cyclictest533040-21kworker/u8:2+flush-259:009:25:162
481037992216,4cyclictest818607-21/usr/sbin/munin12:35:122
481037992216,4cyclictest599749-21kworker/u8:0+flush-259:009:05:162
481033992218,3cyclictest771119-21kworker/u8:4+flush-259:012:10:001
481033992217,3cyclictest818632-21apt-get12:35:101
481033992217,3cyclictest683031-21kworker/u8:1+flush-259:011:45:161
481033992216,4cyclictest252-21systemd-journal07:30:191
481029992217,4cyclictest745378-21apt-get11:25:090
481039992119,2cyclictest470425-21kworker/u8:0+events_unbound07:40:083
481039992118,2cyclictest704034-21kworker/u8:3+events_unbound11:08:083
481039992118,2cyclictest683031-21kworker/u8:1+events_unbound11:10:013
481039992118,2cyclictest516949-21kworker/u8:1+events_unbound08:22:003
481039992118,2cyclictest470425-21kworker/u8:0+events_unbound07:16:283
481039992117,3cyclictest533040-21kworker/u8:2+events_unbound08:48:213
481037992115,4cyclictest599749-21kworker/u8:0+flush-259:010:25:252
481033992117,3cyclictest464445-21kworker/u8:4+flush-259:007:50:171
481033992115,4cyclictest517187-21apt-get07:45:101
481029992118,2cyclictest620798-21kworker/u8:5+events_unbound10:00:230
481029992117,3cyclictest771119-21kworker/u8:4+flush-259:012:15:010
481039992017,2cyclictest771119-21kworker/u8:4+events_unbound11:51:173
481039992017,2cyclictest620798-21kworker/u8:5+events_unbound10:04:443
481039992017,2cyclictest533040-21kworker/u8:2+events_unbound09:25:333
481039992016,3cyclictest792703-21apt-get12:10:113
481039992016,3cyclictest734862-21kworker/u8:2+events_unbound11:41:453
481037992014,4cyclictest662854-21diskstats10:05:132
481033992014,4cyclictest636282-21latency_hist09:40:001
481029992017,2cyclictest734862-21kworker/u8:2+events_unbound12:04:210
481029992017,2cyclictest584471-21kworker/u8:4+flush-259:009:20:180
481029992016,3cyclictest470425-21kworker/u8:0+events_unbound07:35:220
481029992015,4cyclictest464445-21kworker/u8:4+events_unbound07:31:210
481029992015,3cyclictest734862-21kworker/u8:2+flush-259:011:30:240
481029992015,3cyclictest734862-21kworker/u8:2+flush-259:011:30:240
481029992012,6cyclictest718530-21ntpq10:55:190
481039991917,1cyclictest464445-21kworker/u8:4+events_unbound07:33:383
481039991916,2cyclictest777187-21kworker/u8:1+events_unbound12:08:153
481039991916,2cyclictest683031-21kworker/u8:1+events_unbound11:28:003
481039991916,2cyclictest599749-21kworker/u8:0+events_unbound10:24:313
481039991916,2cyclictest599749-21kworker/u8:0+events_unbound10:14:113
481039991916,2cyclictest584471-21kworker/u8:4+events_unbound09:24:133
481039991916,2cyclictest533040-21kworker/u8:2+events_unbound08:53:223
481039991916,2cyclictest516949-21kworker/u8:1+events_unbound08:37:373
481039991916,2cyclictest516949-21kworker/u8:1+events_unbound08:34:263
481039991916,2cyclictest516949-21kworker/u8:1+events_unbound07:52:573
481039991916,2cyclictest470425-21kworker/u8:0+events_unbound07:45:033
481039991916,2cyclictest464445-21kworker/u8:4+events_unbound07:21:143
481039991915,3cyclictest771119-21kworker/u8:4+events_unbound12:03:193
481039991915,3cyclictest516949-21kworker/u8:1+events_unbound08:03:363
481037991915,3cyclictest470425-21kworker/u8:0+flush-259:007:35:262
481037991914,3cyclictest698429-21apt-get10:40:032
481037991913,4cyclictest808402-21diskstats12:25:142
481037991913,4cyclictest735102-21apt-get11:15:112
481037991912,5cyclictest734836-21latency_hist11:15:012
481037991911,6cyclictest252-21systemd-journal09:45:012
481033991914,3cyclictest625947-21cron09:30:001
481033991913,4cyclictest614275-21ntpq09:15:191
481029991915,3cyclictest771119-21kworker/u8:4+flush-259:011:51:330
481029991915,3cyclictest734862-21kworker/u8:2+events_unbound11:20:220
481029991915,3cyclictest599749-21kworker/u8:0+flush-259:009:50:170
481039991815,2cyclictest807828-21kworker/u8:3+events_unbound12:26:503
481039991815,2cyclictest734862-21kworker/u8:2+events_unbound11:33:303
481039991815,2cyclictest734862-21kworker/u8:2+events_unbound11:33:293
481039991815,2cyclictest704034-21kworker/u8:3+events_unbound11:18:043
481039991815,2cyclictest599749-21kworker/u8:0+events_unbound10:48:443
481039991815,2cyclictest516949-21kworker/u8:1+events_unbound08:18:413
481039991815,2cyclictest516949-21kworker/u8:1+events_unbound08:08:533
481039991813,3cyclictest745139-21kworker/u8:0+flush-259:011:35:193
481037991814,3cyclictest704034-21kworker/u8:3+flush-259:011:10:002
481037991814,3cyclictest599749-21kworker/u8:0+flush-259:010:35:232
481037991814,3cyclictest533040-21kworker/u8:2+flush-259:008:34:592
481037991811,5cyclictest480948-21latency_hist07:10:002
481033991815,2cyclictest714299-21idleruntime-cro10:55:001
481029991815,2cyclictest807828-21kworker/u8:3+flush-259:012:30:300
481029991815,2cyclictest516949-21kworker/u8:1+events_unbound08:00:190
481029991814,3cyclictest584471-21kworker/u8:4+events_unbound08:50:140
481029991814,3cyclictest533040-21kworker/u8:2+events_unbound09:30:110
481039991714,2cyclictest683031-21kworker/u8:1+events_unbound10:39:143
481039991714,2cyclictest533040-21kworker/u8:2+events_unbound09:30:383
481039991714,2cyclictest516949-21kworker/u8:1+events_unbound08:27:563
481039991714,2cyclictest464445-21kworker/u8:4+events_unbound07:29:043
481037991713,3cyclictest683031-21kworker/u8:1+flush-259:011:00:252
481033991714,2cyclictest657977-21irqcore10:00:151
481033991714,2cyclictest498948-21kthreadcore07:25:171
481033991713,3cyclictest724849-21apt-get11:05:111
481029991714,2cyclictest620798-21kworker/u8:5+events_unbound10:19:570
481029991714,2cyclictest61150irq/133-enp0s29f1:tx-008:55:180
481029991714,2cyclictest464445-21kworker/u8:4+events_unbound07:28:190
481029991713,3cyclictest807828-21kworker/u8:3+events_unbound12:35:160
481029991713,3cyclictest533040-21kworker/u8:2+flush-259:009:40:000
481029991713,3cyclictest252-21systemd-journal11:10:000
481029991713,2cyclictest667596-21turbostat10:10:010
481039991614,2cyclictest734862-21kworker/u8:2+events_unbound11:23:303
481039991613,2cyclictest599749-21kworker/u8:0+events_unbound10:17:463
481039991613,2cyclictest599749-21kworker/u8:0+events_unbound09:11:103
481039991613,2cyclictest599749-21kworker/u8:0+events_unbound09:09:323
481039991613,2cyclictest516949-21kworker/u8:1+events_unbound08:55:063
48103799161,1cyclictest620783-21awk09:24:592
481037991610,4cyclictest641937-21base6409:45:012
481037991610,4cyclictest252-21systemd-journal07:45:012
481033991613,2cyclictest490388-21ntp_kernel_pll_07:15:211
481033991612,3cyclictest615877-21apt-get09:20:101
481033991612,3cyclictest579389-21apt-get08:45:121
481033991610,4cyclictest252-21systemd-journal12:29:251
481029991613,2cyclictest704034-21kworker/u8:3-ext4-rsv-conversion11:14:590
481029991613,2cyclictest683031-21kworker/u8:1+flush-259:010:40:190
481029991613,2cyclictest60350irq/132-enp0s29f1:rx-011:15:110
481029991612,3cyclictest464445-21kworker/u8:4+flush-259:007:54:080
481029991612,2cyclictest765714-21turbostat11:45:000
481029991611,3cyclictest516949-21kworker/u8:1+events_unbound09:07:220
481039991512,2cyclictest683031-21kworker/u8:1+events_unbound11:49:023
48103799158,4cyclictest573960-21latency_hist08:40:012
48103799151,5cyclictest599737-21basename09:05:002
481037991512,2cyclictest782391-21irqcore12:00:162
481037991511,3cyclictest599749-21kworker/u8:0+flush-259:010:10:182
481037991511,2cyclictest0-21swapper/211:30:002
481033991512,1cyclictest0-21swapper/110:45:001
481033991511,3cyclictest533072-21apt-get08:00:111
481033991510,3cyclictest252-21systemd-journal09:04:201
48102999159,4cyclictest697508-21ntpq10:35:190
481029991513,1cyclictest60350irq/132-enp0s29f1:rx-011:35:020
481029991513,1cyclictest60350irq/132-enp0s29f1:rx-007:40:200
481029991512,2cyclictest683031-21kworker/u8:1+flush-259:010:45:210
481029991512,2cyclictest60350irq/132-enp0s29f1:rx-012:05:220
481029991511,3cyclictest599749-21kworker/u8:0+events_unbound10:25:210
481029991511,3cyclictest516949-21kworker/u8:1+events_unbound09:12:210
48103999142,3cyclictest50-21ksoftirqd/311:00:153
48103799148,5cyclictest464445-21kworker/u8:4+flush-259:007:30:162
481037991411,2cyclictest807828-21kworker/u8:3+events_unbound12:30:172
48103399148,5cyclictest578288-21ntpq08:40:211
48103399147,4cyclictest516924-21latency_hist07:45:011
481033991412,1cyclictest211-21jbd2/nvme0n1p2-810:35:001
481033991410,3cyclictest683031-21kworker/u8:1+events_unbound11:30:171
481033991410,3cyclictest683031-21kworker/u8:1+events_unbound11:30:171
481033991410,3cyclictest533040-21kworker/u8:2+flush-259:009:55:251
481029991411,2cyclictest771119-21kworker/u8:4+flush-259:012:18:320
481029991411,2cyclictest60350irq/132-enp0s29f1:rx-011:00:200
48103799139,3cyclictest584471-21kworker/u8:4+flush-259:009:31:252
48103799139,2cyclictest0-21swapper/209:55:002
481037991310,2cyclictest792426-21cron12:10:002
481037991310,2cyclictest541245-21kthreadcore08:05:202
481037991310,2cyclictest491943-21irqcore07:20:162
481037991310,2cyclictest0-21swapper/209:10:252
48103399139,3cyclictest813426-21apt-get12:30:121
48103399139,3cyclictest755692-21apt-get11:35:131
48103399139,3cyclictest533040-21kworker/u8:2+flush-259:008:25:261
48103399139,2cyclictest734862-21kworker/u8:2+flush-259:011:20:161
481033991310,2cyclictest704034-21kworker/u8:3+flush-259:011:13:511
481029991311,2cyclictest60350irq/132-enp0s29f1:rx-010:10:490
48103799129,2cyclictest803096-21cpuspeed_turbos12:20:122
48103799129,2cyclictest764325-21kthreadcore11:40:182
48103799129,2cyclictest719025-21unixbench_singl10:55:252
48103799129,2cyclictest673078-21cpuspeed_turbos10:15:122
48103799128,3cyclictest533040-21kworker/u8:2+flush-259:008:59:592
48103799128,2cyclictest0-21swapper/207:30:012
48103799125,1cyclictest0-21swapper/210:00:012
48103399129,2cyclictest600057-21cpuspeed_turbos09:05:131
48103399128,3cyclictest683031-21kworker/u8:1+flush-259:010:45:241
48103399128,3cyclictest599749-21kworker/u8:0+flush-259:010:27:511
48103399128,3cyclictest470425-21kworker/u8:0+flush-259:007:25:011
48103799119,1cyclictest0-21swapper/212:10:162
48103799118,2cyclictest503-21tpm2-abrmd10:49:592
48103799118,2cyclictest486640-21fschecks_time07:15:142
48103799118,2cyclictest0-21swapper/207:55:252
48103799116,3cyclictest486123-21latency_hist07:15:012
48103799115,5cyclictest615210-21https09:20:012
48103799110,9cyclictest563684-21awk08:29:592
48103399118,2cyclictest568345-21unixbench_multi08:30:241
48103399117,2cyclictest0-21swapper/110:25:011
48103399115,4cyclictest252-21systemd-journal10:18:211
48103399111,8cyclictest646979-21awk09:50:001
48103799106,2cyclictest0-21swapper/211:45:162
48103799104,4cyclictest755954-21uniq11:35:162
48103799100,2cyclictest693282-21latency_hist10:35:002
48103399107,2cyclictest765213-21unixbench_multi11:40:241
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional