You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4s.osadl.org (updated Fri Jul 26, 2024 12:44:06)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2066375994744,2cyclictest2283648-21kworker/u8:4+flush-259:010:55:222
2066368994639,5cyclictest2350516-21kworker/u8:2+flush-259:011:40:010
2066375994339,3cyclictest2350516-21kworker/u8:2+flush-259:011:55:222
2066375994236,4cyclictest2314029-21latency_hist10:30:012
2066378994037,2cyclictest2367207-21kworker/u8:3+events_unbound11:15:013
2066378994036,3cyclictest2171268-21kworker/u8:0+events_unbound08:55:203
2066378993935,3cyclictest2329434-21kworker/u8:2+flush-259:010:45:003
2066378993935,3cyclictest2329434-21kworker/u8:2+flush-259:010:44:593
2066378993835,2cyclictest2237808-21kworker/u8:3+events_unbound09:45:163
2066378993835,2cyclictest2029568-21kworker/u8:2+flush-259:007:25:233
2066375993835,2cyclictest2367207-21kworker/u8:3+events_unbound11:39:232
2066378993734,2cyclictest2313946-21kworker/u8:1+events_unbound10:50:243
2066378993530,4cyclictest73-21kswapd010:50:003
2066378993430,3cyclictest2455192-21kworker/u8:4+events_unbound12:05:013
2066378993428,2cyclictest2076670-21kworker/u8:4+events_unbound08:45:233
2066378993330,2cyclictest2087030-21kworker/u8:5+events_unbound07:35:203
2066375993330,2cyclictest2390033-21kworker/u8:1+flush-259:011:25:062
2066368993329,3cyclictest73-21kswapd010:55:000
2066378993229,2cyclictest2155788-21kworker/u8:2+flush-259:009:05:243
2066378993229,2cyclictest2076670-21kworker/u8:4+events_unbound08:30:203
2066368993230,1cyclictest2364740-21fwupd11:00:450
2066378993127,3cyclictest73-21kswapd010:15:123
2066378993127,3cyclictest2367207-21kworker/u8:3+events_unbound11:30:193
2066378993126,3cyclictest2081823-21latency_hist07:25:003
2066375993128,2cyclictest2367207-21kworker/u8:3+events_unbound11:49:212
2066375993126,2cyclictest2113692-21kworker/u8:0+events_unbound07:55:122
2066375993126,2cyclictest2113692-21kworker/u8:0+events_unbound07:55:112
2066368993127,3cyclictest2087691-21apt-get07:30:110
2066378993027,2cyclictest2076670-21kworker/u8:4+events_unbound08:35:153
2066378993026,3cyclictest2237808-21kworker/u8:3+events_unbound10:05:213
2066375993027,2cyclictest2237808-21kworker/u8:3+flush-259:010:35:152
2066375993027,2cyclictest2237808-21kworker/u8:3+flush-259:010:35:152
2066375993026,3cyclictest73-21kswapd010:40:122
2066375993026,3cyclictest73-21kswapd010:40:112
2066375993026,3cyclictest2076670-21kworker/u8:4+flush-259:008:15:002
2066368993026,3cyclictest2076670-21kworker/u8:4+flush-259:008:40:000
2066368993024,4cyclictest2374794-21latency_hist11:10:010
2066378992926,2cyclictest2367207-21kworker/u8:3+events_unbound11:45:183
2066378992926,2cyclictest2350516-21kworker/u8:2+events_unbound10:55:143
2066378992926,2cyclictest2245868-21kworker/u8:0+flush-259:010:25:203
2066378992926,2cyclictest2087029-21kworker/u8:1+events_unbound07:50:233
2066378992926,2cyclictest2076670-21kworker/u8:4+events_unbound07:30:183
2066378992923,5cyclictest2253605-21apt-get09:50:113
2066375992926,2cyclictest2245868-21kworker/u8:0+flush-259:010:10:162
2066378992825,2cyclictest2283648-21kworker/u8:4+events_unbound10:30:243
2066378992825,2cyclictest2196985-21kworker/u8:4+flush-259:009:30:163
2066375992825,2cyclictest2313946-21kworker/u8:1+flush-259:010:50:212
2066375992825,2cyclictest2113692-21kworker/u8:0+flush-259:008:25:102
2066375992822,4cyclictest2268704-21/usr/sbin/munin10:00:142
2066373992825,2cyclictest73-21kswapd011:49:201
2066373992824,3cyclictest2113692-21kworker/u8:0+flush-259:008:40:251
2066378992724,2cyclictest2245868-21kworker/u8:0+flush-259:010:24:593
2066378992724,2cyclictest2155788-21kworker/u8:2+flush-259:009:15:233
2066378992723,3cyclictest2155788-21kworker/u8:2+events_unbound09:10:213
2066375992724,2cyclictest2313946-21kworker/u8:1+events_unbound11:00:252
2066368992723,3cyclictest2245965-21apt-get09:45:110
2066378992623,2cyclictest2460799-21kworker/u8:1+events_unbound12:10:233
2066378992623,2cyclictest2367207-21kworker/u8:3+events_unbound11:40:013
2066378992623,2cyclictest2313946-21kworker/u8:1+flush-259:011:00:273
2066378992623,2cyclictest2237624-21gpgv09:39:593
2066378992622,3cyclictest73-21kswapd010:40:013
2066378992622,3cyclictest73-21kswapd010:40:013
2066378992622,3cyclictest2124620-21/usr/sbin/munin08:05:133
2066375992623,2cyclictest2155788-21kworker/u8:2+events_unbound08:55:122
2066375992622,3cyclictest2460799-21kworker/u8:1+flush-259:012:10:202
2066373992622,3cyclictest2367207-21kworker/u8:3+events_unbound11:55:181
2066373992622,3cyclictest2238369-21apt-get09:40:121
2066378992522,2cyclictest2450295-21kworker/u8:0+events_unbound12:20:203
2066378992522,2cyclictest2076670-21kworker/u8:4+events_unbound07:55:083
2066378992522,2cyclictest2076670-21kworker/u8:4+events_unbound07:55:073
2066375992522,2cyclictest2222759-21apt-get09:30:142
2066375992522,2cyclictest2076670-21kworker/u8:4+flush-259:008:45:002
2066375992521,3cyclictest2119460-21kworker/u8:1+events_unbound08:05:252
2066375992520,4cyclictest2375102-21/usr/sbin/munin11:10:162
2066375992520,3cyclictest2261157-21/usr/sbin/munin09:55:132
2066373992523,1cyclictest2313946-21kworker/u8:1+flush-259:011:00:231
2066373992519,5cyclictest255-21systemd-journal10:49:591
2066373992518,6cyclictest2186994-21kworker/u8:1+flush-259:009:35:281
2066373992517,5cyclictest2329150-21latency_hist10:40:011
2066373992517,5cyclictest2329150-21latency_hist10:40:001
2066368992522,2cyclictest2087030-21kworker/u8:5+flush-259:007:35:280
2066368992521,3cyclictest2350516-21kworker/u8:2+flush-259:011:15:530
2066368992520,4cyclictest2097781-21apt-get07:40:010
2066378992421,2cyclictest2390033-21kworker/u8:1+events_unbound11:27:233
2066378992421,2cyclictest2367207-21kworker/u8:3+events_unbound11:40:293
2066378992420,3cyclictest2390033-21kworker/u8:1+flush-259:011:25:013
2066375992421,2cyclictest2283648-21kworker/u8:4+flush-259:010:45:182
2066375992421,2cyclictest2237808-21kworker/u8:3+events_unbound10:05:242
2066375992421,2cyclictest2029568-21kworker/u8:2+flush-259:007:14:592
2066375992420,3cyclictest2460799-21kworker/u8:1+flush-259:012:10:002
2066373992421,2cyclictest2171268-21kworker/u8:0+flush-259:008:55:241
2066373992420,3cyclictest2283648-21kworker/u8:4+flush-259:010:40:051
2066373992420,3cyclictest2283648-21kworker/u8:4+flush-259:010:40:051
2066368992421,2cyclictest2207570-21apt-get09:20:110
2066368992419,3cyclictest2276378-21apt-get10:05:110
2066378992320,2cyclictest2196985-21kworker/u8:4+flush-259:009:25:233
2066375992320,2cyclictest2350516-21kworker/u8:2+flush-259:011:50:232
2066375992319,3cyclictest2359606-21kworker/u8:0+events_unbound11:05:222
2066375992319,3cyclictest2283648-21kworker/u8:4+flush-259:010:30:272
2066375992319,3cyclictest2098468-21apt-get07:40:112
2066373992319,3cyclictest2119460-21kworker/u8:1+events_unbound08:00:241
2066373992318,3cyclictest2108784-21apt-get07:50:121
2066368992317,4cyclictest2398071-21latency_hist11:25:010
2066368992316,5cyclictest255-21systemd-journal08:00:200
2066378992219,2cyclictest2367207-21kworker/u8:3+flush-259:012:30:013
2066378992219,2cyclictest2245868-21kworker/u8:0+events_unbound09:58:453
2066378992219,2cyclictest2229502-21kworker/u8:2+events_unbound09:44:283
2066375992219,2cyclictest2237808-21kworker/u8:3+flush-259:010:20:142
2066375992218,3cyclictest2214858-21kworker/u8:0+events_unbound09:35:112
2066375992218,3cyclictest2155788-21kworker/u8:2+flush-259:008:50:012
2066373992218,3cyclictest2113692-21kworker/u8:0+events_unbound08:05:131
206637399220,20cyclictest2097827-21munin-run07:40:001
2066368992218,3cyclictest2119460-21kworker/u8:1+flush-259:008:20:270
2066368992217,4cyclictest2181582-21latency_hist09:00:010
2066378992119,2cyclictest2076670-21kworker/u8:4+flush-259:008:20:003
2066378992118,2cyclictest73-21kswapd012:15:033
2066378992118,2cyclictest2029568-21kworker/u8:2+events_unbound07:10:263
2066378992117,3cyclictest2288252-21ssh10:10:233
2066375992118,2cyclictest2367207-21kworker/u8:3+events_unbound11:30:232
2066375992118,2cyclictest2155788-21kworker/u8:2+events_unbound09:05:142
2066373992118,2cyclictest2237808-21kworker/u8:3+flush-259:010:05:181
2066373992118,2cyclictest2113692-21kworker/u8:0+flush-259:008:35:231
2066373992117,2cyclictest2306456-21latency_hist10:25:011
2066373992115,5cyclictest73-21kswapd011:10:121
2066378992017,2cyclictest2367207-21kworker/u8:3+flush-259:011:10:363
2066375992017,2cyclictest2436189-21kworker/u8:1+flush-259:012:00:162
2066375992017,2cyclictest2367207-21kworker/u8:3+flush-259:012:20:272
2066375992017,2cyclictest2214828-21idleruntime-cro09:25:002
2066375992016,3cyclictest2087029-21kworker/u8:1+events_unbound07:53:202
2066375992012,3cyclictest2029568-21kworker/u8:2+events_unbound07:25:152
2066373992017,2cyclictest2186994-21kworker/u8:1+flush-259:009:30:261
2066373992016,3cyclictest73-21kswapd010:19:591
2066373992016,3cyclictest2313946-21kworker/u8:1+flush-259:010:30:251
2066373992016,3cyclictest2237808-21kworker/u8:3+flush-259:010:10:241
2066368992017,2cyclictest2864-21cron10:25:000
2066378991916,2cyclictest2359606-21kworker/u8:0+events_unbound11:06:543
2066378991916,2cyclictest2350516-21kworker/u8:2+flush-259:011:55:173
2066378991916,2cyclictest2113692-21kworker/u8:0+events_unbound08:40:173
2066375991916,2cyclictest2229502-21kworker/u8:2+flush-259:009:40:152
2066375991916,2cyclictest2171268-21kworker/u8:0+events_unbound08:50:132
2066375991916,2cyclictest2087030-21kworker/u8:5+events_unbound07:45:242
2066373991916,2cyclictest2367207-21kworker/u8:3+flush-259:012:35:241
2066373991915,3cyclictest2076910-21apt-get07:20:121
2066373991914,3cyclictest2258768-21ssh09:51:191
2066368991916,2cyclictest73-21kswapd010:14:590
2066368991915,3cyclictest2367207-21kworker/u8:3+flush-259:012:05:250
2066378991816,2cyclictest2087030-21kworker/u8:5+events_unbound07:45:283
2066378991815,2cyclictest2350516-21kworker/u8:2+events_unbound11:52:173
2066375991815,2cyclictest2367207-21kworker/u8:3+flush-259:011:40:162
2066375991815,2cyclictest2245868-21kworker/u8:0+events_unbound09:50:122
2066373991815,2cyclictest2402579-21ntp_kernel_pll_11:25:231
2066373991815,2cyclictest2076670-21kworker/u8:4+events_unbound08:20:141
2066373991814,3cyclictest2367207-21kworker/u8:3+flush-259:012:05:241
2066373991814,3cyclictest2171268-21kworker/u8:0+flush-259:009:00:211
2066368991815,2cyclictest2352790-21irqcore10:55:150
2066368991814,3cyclictest2367207-21kworker/u8:3+flush-259:012:35:140
2066368991814,3cyclictest2314018-21journal-offline10:29:590
2066368991811,5cyclictest2237584-21latency_hist09:40:010
2066378991714,2cyclictest2450295-21kworker/u8:0+events_unbound12:09:573
2066378991714,2cyclictest2155788-21kworker/u8:2+events_unbound09:02:223
2066378991714,2cyclictest2076670-21kworker/u8:4+flush-259:008:25:233
2066375991714,2cyclictest2450295-21kworker/u8:0+flush-259:012:25:222
2066375991714,2cyclictest2350516-21kworker/u8:2+flush-259:011:19:272
2066375991714,2cyclictest2245868-21kworker/u8:0+events_unbound10:16:202
2066375991714,2cyclictest2155788-21kworker/u8:2+flush-259:009:15:222
2066375991714,2cyclictest2087030-21kworker/u8:5+events_unbound07:35:242
2066375991711,4cyclictest2087598-21base6407:30:012
2066373991714,2cyclictest2390032-21apt-key11:20:001
2066373991714,2cyclictest2087030-21kworker/u8:5+events_unbound07:45:251
2066373991714,2cyclictest0-21swapper/107:14:591
2066373991713,3cyclictest2229502-21kworker/u8:2+events_unbound09:55:191
2066373991713,3cyclictest2155788-21kworker/u8:2+events_unbound09:05:121
2066373991713,3cyclictest2113692-21kworker/u8:0+events_unbound07:55:141
2066373991713,3cyclictest2113692-21kworker/u8:0+events_unbound07:55:131
2066373991713,2cyclictest1-21systemd08:35:011
2066368991714,2cyclictest61450irq/129-enp0s29f1:tx-011:55:200
2066368991714,2cyclictest60650irq/128-enp0s29f1:rx-010:00:180
2066368991714,2cyclictest2421770-21irqcore11:40:180
2066368991714,2cyclictest0-21swapper/012:30:010
2066368991713,2cyclictest60650irq/128-enp0s29f1:rx-011:10:200
2066375991613,2cyclictest2140975-21irqcore08:20:172
2066375991612,3cyclictest2367207-21kworker/u8:3+events_unbound12:35:252
2066373991614,1cyclictest0-21swapper/109:25:201
2066373991613,2cyclictest2283648-21kworker/u8:4+flush-259:010:50:231
2066373991613,2cyclictest2181605-21kworker/u8:3+events_unbound09:20:161
2066373991613,2cyclictest2113692-21kworker/u8:0+events_unbound08:15:261
2066373991612,3cyclictest2155788-21kworker/u8:2+events_unbound08:50:231
2066373991612,2cyclictest506-21tpm2-abrmd11:00:011
2066368991614,1cyclictest60650irq/128-enp0s29f1:rx-011:53:350
2066368991614,1cyclictest60650irq/128-enp0s29f1:rx-011:33:490
2066368991614,1cyclictest60650irq/128-enp0s29f1:rx-009:15:280
2066368991614,1cyclictest60650irq/128-enp0s29f1:rx-009:00:270
2066368991613,2cyclictest61450irq/129-enp0s29f1:tx-010:45:170
2066368991613,2cyclictest60650irq/128-enp0s29f1:rx-011:25:180
2066368991613,2cyclictest60650irq/128-enp0s29f1:rx-010:15:450
2066368991613,2cyclictest60650irq/128-enp0s29f1:rx-009:40:230
2066368991611,1cyclictest60650irq/128-enp0s29f1:rx-009:55:210
2066378991513,2cyclictest2237808-21kworker/u8:3+events_unbound10:00:163
2066375991513,2cyclictest2155788-21kworker/u8:2+events_unbound09:14:032
2066375991512,2cyclictest2450295-21kworker/u8:0+flush-259:012:20:012
2066375991512,2cyclictest2186994-21kworker/u8:1+flush-259:009:25:402
2066375991512,2cyclictest2113692-21kworker/u8:0+events_unbound08:35:292
2066375991512,2cyclictest2066358-21kworker/u8:3+flush-259:007:20:202
2066375991512,2cyclictest2029568-21kworker/u8:2+flush-259:007:15:162
2066373991512,2cyclictest2229502-21kworker/u8:2+flush-259:009:49:551
2066373991512,2cyclictest2076670-21kworker/u8:4+events_unbound08:10:241
2066373991511,3cyclictest2196985-21kworker/u8:4+flush-259:009:15:131
2066373991511,2cyclictest0-21swapper/112:20:011
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-012:00:280
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-011:47:380
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-010:37:150
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-010:37:140
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-010:31:120
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-009:51:050
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-009:28:470
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-009:14:420
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-008:51:590
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-008:32:530
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-008:27:520
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-008:15:280
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-007:55:220
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-007:55:210
2066368991513,1cyclictest60650irq/128-enp0s29f1:rx-007:15:200
2066368991512,2cyclictest60650irq/128-enp0s29f1:rx-009:30:250
2066368991510,3cyclictest0-21swapper/008:10:000
2066378991411,2cyclictest2171268-21kworker/u8:0+events_unbound08:54:203
2066378991411,2cyclictest2029568-21kworker/u8:2+flush-259:007:15:053
2066378991410,3cyclictest2119460-21kworker/u8:1+flush-259:008:10:173
2066375991412,1cyclictest2237808-21kworker/u8:3+events_unbound09:47:582
2066375991411,2cyclictest2113692-21kworker/u8:0+flush-259:008:00:102
2066375991411,2cyclictest2076670-21kworker/u8:4+flush-259:008:30:212
2066373991411,2cyclictest2350516-21kworker/u8:2+events_unbound11:50:181
2066373991411,2cyclictest2076220-21unixbench_singl07:15:291
2066373991410,3cyclictest2029568-21kworker/u8:2+flush-259:007:35:001
2066368991413,1cyclictest60650irq/128-enp0s29f1:rx-012:31:020
2066368991413,1cyclictest60650irq/128-enp0s29f1:rx-009:05:160
2066368991412,1cyclictest60650irq/128-enp0s29f1:rx-008:45:150
206636899140,12cyclictest255-21systemd-journal07:25:190
206637899139,3cyclictest2113692-21kworker/u8:0+events_unbound08:05:003
206637899139,3cyclictest2087030-21kworker/u8:5+events_unbound07:42:373
2066378991310,2cyclictest2367207-21kworker/u8:3+flush-259:012:35:213
206637599139,3cyclictest2171268-21kworker/u8:0+events_unbound09:00:232
206637599137,4cyclictest2487219-21latency_hist12:35:002
206637399139,3cyclictest2350516-21kworker/u8:2+flush-259:011:34:561
2066373991311,1cyclictest0-21swapper/108:30:001
2066373991311,1cyclictest0-21swapper/107:30:001
2066373991310,2cyclictest2395420-21unixbench_multi11:20:281
2066373991310,2cyclictest2155788-21kworker/u8:2+flush-259:009:10:111
206637399130,6cyclictest2276035-21munin-run10:04:591
2066368991312,1cyclictest60650irq/128-enp0s29f1:rx-007:13:220
2066368991310,2cyclictest60650irq/128-enp0s29f1:rx-012:24:190
2066368991310,2cyclictest2104015-21irqcore07:45:180
206637899129,2cyclictest2450295-21kworker/u8:0+flush-259:012:30:163
206637899128,3cyclictest2076670-21kworker/u8:4+flush-259:008:20:133
206637399129,2cyclictest2421771-21grep11:40:171
206637399129,2cyclictest2350516-21kworker/u8:2+flush-259:011:05:261
206637399129,2cyclictest2098605-21cpuspeed_turbos07:40:141
2066373991210,1cyclictest255-21systemd-journal11:40:001
2066373991210,1cyclictest2484614-21tr12:30:181
2066373991210,1cyclictest0-21swapper/110:25:211
2066368991210,1cyclictest60650irq/128-enp0s29f1:rx-008:42:480
206636899118,2cyclictest2461161-21cpuspeed_turbos12:10:110
206636899118,2cyclictest2087029-21kworker/u8:1+flush-259:007:55:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional