You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 03:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Thu Apr 25, 2024 12:43:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2153592993216,9cyclictest2407637-21idleruntime-cro10:35:012
2153592992521,2cyclictest2269505-21latency_hist08:59:592
2153589992521,2cyclictest2520769-21sh11:50:001
215358799231,19cyclictest0-21swapper/009:50:260
215359299226,7cyclictest2190757-21munin-plugin-st07:45:002
2153592992117,2cyclictest2475477-21kworker/u8:3-ext4-rsv-conversion11:39:592
2153589992117,2cyclictest2287892-21idleruntime-cro09:14:591
2153587992118,2cyclictest2505419-21systemd-run11:40:000
2153592992017,2cyclictest0-21swapper/209:10:012
2153589992017,2cyclictest2529842-21kthreadcore11:55:161
2153589992017,2cyclictest2505467-21apt-key11:40:001
2153587992017,2cyclictest2355774-21fschecks_time10:00:130
2153592991915,2cyclictest0-21swapper/210:45:012
2153587991916,2cyclictest2280139-21latency_hist09:10:010
2153592991813,3cyclictest2955-21cron11:05:002
2153589991814,3cyclictest2310288-21cron09:30:001
2153589991814,3cyclictest2289367-21kthreadcore09:15:181
2153589991814,3cyclictest2289367-21kthreadcore09:15:181
2153589991814,2cyclictest0-21swapper/111:15:001
2153587991815,2cyclictest2460976-21irqcore11:10:190
2153587991814,3cyclictest60650irq/128-enp0s29f1:rx-009:40:110
2153587991813,2cyclictest60650irq/128-enp0s29f1:rx-012:18:080
2153597991714,2cyclictest2955-21cron12:15:003
2153597991714,2cyclictest2955-21cron12:15:003
2153597991714,2cyclictest2269495-21idleruntime-cro08:59:593
2153597991713,2cyclictest0-21swapper/312:35:003
2153592991714,2cyclictest2180220-21apt07:35:012
2153592991713,3cyclictest2468436-21cpuspeed_turbos11:15:132
2153592991711,4cyclictest2366731-21tr10:05:192
2153589991713,3cyclictest2400874-21gltestperf10:30:141
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-012:05:210
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-012:05:210
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-010:22:460
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-010:10:110
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-009:48:380
2153587991714,2cyclictest60650irq/128-enp0s29f1:rx-009:10:010
2153587991713,3cyclictest2190748-21turbostat.cron07:45:000
2153587991713,2cyclictest0-21swapper/011:45:000
2153587991712,4cyclictest61450irq/129-enp0s29f1:tx-010:30:120
2153587991711,2cyclictest60650irq/128-enp0s29f1:rx-012:36:370
2153597991613,2cyclictest355-21hwrng10:30:183
2153597991613,2cyclictest2363409-21gltestperf10:05:153
2153597991612,3cyclictest2420172-21unixbench_singl10:40:263
2153597991612,3cyclictest0-21swapper/307:15:003
2153597991612,2cyclictest0-21swapper/311:15:003
2153597991612,2cyclictest0-21swapper/308:50:233
2153597991611,3cyclictest0-21swapper/307:25:003
2153597991610,4cyclictest260-21systemd-journal09:44:353
215359799160,2cyclictest2543191-21turbostat12:05:003
2153592991613,2cyclictest2237962-21idleruntime-cro08:29:592
2153592991613,2cyclictest0-21swapper/212:35:212
2153592991612,3cyclictest2573534-21cpuspeed_turbos12:25:122
2153592991612,3cyclictest2303245-21cpuspeed_turbos09:25:122
2153592991612,2cyclictest0-21swapper/208:40:152
2153589991613,2cyclictest355-21hwrng09:40:081
2153589991613,2cyclictest2244031-21irqcore08:35:211
2153589991613,2cyclictest2153582-21cyclictest07:35:201
2153589991612,3cyclictest2457574-21unixbench-2d11:05:281
2153589991612,3cyclictest0-21swapper/110:50:011
2153589991612,2cyclictest0-21swapper/110:25:111
2153589991610,4cyclictest260-21systemd-journal07:43:471
2153587991614,2cyclictest60650irq/128-enp0s29f1:rx-009:22:180
2153587991614,1cyclictest60650irq/128-enp0s29f1:rx-011:54:370
2153587991614,1cyclictest60650irq/128-enp0s29f1:rx-011:21:070
2153587991614,1cyclictest60650irq/128-enp0s29f1:rx-010:42:150
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-011:59:520
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-011:27:390
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-011:08:250
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-010:53:420
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-010:25:190
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-010:08:260
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-009:30:140
2153587991613,2cyclictest60650irq/128-enp0s29f1:rx-007:20:150
2153587991612,3cyclictest60650irq/128-enp0s29f1:rx-012:00:140
2153587991612,3cyclictest60650irq/128-enp0s29f1:rx-009:55:110
2153587991612,3cyclictest514-21in:imuxsock09:20:000
2153587991612,3cyclictest514-21in:imuxsock09:19:590
2153587991612,2cyclictest0-21swapper/011:20:000
2153587991610,2cyclictest60650irq/128-enp0s29f1:rx-010:45:180
2153597991513,1cyclictest2222264-21idleruntime-cro08:14:593
2153597991512,2cyclictest2347689-21systemd-run09:55:003
2153597991512,2cyclictest0-21swapper/311:35:003
2153597991511,3cyclictest491ktimers/310:45:123
2153597991511,3cyclictest2201817-21gltestperf07:55:133
215359299158,5cyclictest1-21systemd07:25:002
215359299157,5cyclictest260-21systemd-journal08:20:002
2153592991513,2cyclictest401ktimers/209:39:402
2153592991512,2cyclictest61650irq/133-enp0s29f1:tx-212:14:052
2153592991512,2cyclictest61650irq/133-enp0s29f1:tx-212:14:042
2153592991512,2cyclictest2955-21cron07:50:012
2153592991512,2cyclictest0-21swapper/209:50:012
2153592991512,2cyclictest0-21swapper/207:55:002
2153592991511,3cyclictest2370836-21gltestperf10:10:152
2153592991511,3cyclictest0-21swapper/209:20:002
2153592991511,3cyclictest0-21swapper/209:20:002
215358999157,7cyclictest0-21swapper/112:15:011
215358999157,7cyclictest0-21swapper/112:15:011
215358999152,3cyclictest2573459-21apt-get12:25:121
2153589991512,2cyclictest355-21hwrng12:22:571
2153589991512,2cyclictest311ktimers/110:35:231
2153589991512,2cyclictest2296035-21gltestperf09:20:131
2153589991512,2cyclictest2249914-21kthreadcore08:40:141
2153589991512,1cyclictest0-21swapper/109:50:011
2153589991511,3cyclictest2482904-21cron11:29:551
2153589991511,3cyclictest2450217-21unixbench_singl11:00:321
2153589991511,2cyclictest0-21swapper/110:54:591
2153589991511,2cyclictest0-21swapper/110:25:001
2153589991511,2cyclictest0-21swapper/109:10:011
2153587991514,1cyclictest60650irq/128-enp0s29f1:rx-011:45:400
2153587991513,2cyclictest60650irq/128-enp0s29f1:rx-007:30:120
2153587991513,1cyclictest60650irq/128-enp0s29f1:rx-012:25:300
2153587991513,1cyclictest60650irq/128-enp0s29f1:rx-011:33:340
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-012:10:290
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-012:10:290
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-011:00:200
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-010:35:280
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-010:15:090
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-009:03:290
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-008:10:180
2153587991512,2cyclictest60650irq/128-enp0s29f1:rx-008:07:280
2153587991512,2cyclictest2581162-21ssh12:30:140
2153587991512,2cyclictest2211379-21unixbench_singl08:00:300
2153587991512,2cyclictest2157863-21needreboot07:10:190
2153587991511,2cyclictest61450irq/129-enp0s29f1:tx-010:55:250
215359799148,4cyclictest2280312-21dpkg09:10:003
215359799147,5cyclictest497-21dbus-daemon12:20:003
215359799142,2cyclictest25704602cat12:20:333
2153597991411,2cyclictest491ktimers/311:40:003
2153597991411,2cyclictest2348363-21gltestperf09:55:173
2153597991411,2cyclictest2258090-21needreboot08:45:193
2153597991410,3cyclictest2475477-21kworker/u8:3+xprtiod11:58:033
2153597991410,3cyclictest2412672-21unixbench_singl10:35:283
2153597991410,3cyclictest2185289-21kworker/u8:2+xprtiod10:17:243
2153597991410,2cyclictest0-21swapper/307:45:003
215359799140,3cyclictest2446044-21ps11:00:203
215359799140,2cyclictest23568762cut10:00:183
215359299149,3cyclictest2490762-21ssh11:30:122
215359299147,5cyclictest2515847-21tr11:45:222
215359299144,4cyclictest2490421-21basename11:30:002
2153592991413,1cyclictest401ktimers/212:05:382
2153592991413,1cyclictest401ktimers/212:05:372
2153592991411,2cyclictest401ktimers/211:20:232
2153592991411,2cyclictest2442202-21kworker/u8:1+xprtiod12:01:342
2153592991411,2cyclictest2408235-21fschecks_time10:35:122
2153592991411,2cyclictest2310923-21sort09:30:142
2153592991411,2cyclictest2157830-21needreboot07:10:192
2153592991411,2cyclictest0-21swapper/208:35:002
2153592991410,3cyclictest2217799-21sed08:10:182
2153589991411,2cyclictest2536163-21cpuspeed_turbos12:00:111
2153589991411,2cyclictest2475477-21kworker/u8:3+xprtiod12:06:011
2153589991411,2cyclictest2475477-21kworker/u8:3+xprtiod12:06:011
2153589991411,2cyclictest2340500-21/usr/sbin/munin09:50:201
2153589991411,2cyclictest2264743-21fschecks_count08:55:131
2153589991410,3cyclictest2227085-21unixbench_singl08:15:281
2153589991410,3cyclictest2196328-21cpuspeed_turbos07:50:101
2153589991410,3cyclictest2169594-21cpuspeed_turbos07:25:141
2153589991410,3cyclictest0-21swapper/108:04:591
215358999140,11cyclictest0-21swapper/112:16:441
215358799147,5cyclictest497-21dbus-daemon08:00:000
2153587991412,1cyclictest60650irq/128-enp0s29f1:rx-008:30:380
2153587991411,2cyclictest60650irq/128-enp0s29f1:rx-008:47:510
2153587991411,2cyclictest60650irq/128-enp0s29f1:rx-008:25:140
2153587991411,2cyclictest60650irq/128-enp0s29f1:rx-008:15:120
2153587991411,2cyclictest60650irq/128-enp0s29f1:rx-007:35:080
2153587991411,2cyclictest2259430-21cpuspeed_turbos08:50:160
2153587991410,3cyclictest60650irq/128-enp0s29f1:rx-007:25:380
215359799137,4cyclictest260-21systemd-journal07:26:473
215359799136,5cyclictest2333402-21fw_packets09:45:153
215359799131,5cyclictest835-21snmpd11:24:383
2153597991310,2cyclictest2543205-21kworker/u8:4+xprtiod12:25:513
2153597991310,2cyclictest2442202-21kworker/u8:1+xprtiod11:17:533
2153597991310,2cyclictest2421200-21kworker/u8:0+xprtiod11:07:053
2153597991310,2cyclictest2412201-21kworker/u8:3+xprtiod10:57:173
2153597991310,2cyclictest2412201-21kworker/u8:3+xprtiod10:52:233
2153597991310,2cyclictest2242899-21kworker/u8:1+xprtiod09:14:263
2153597991310,2cyclictest2185289-21kworker/u8:2+xprtiod10:24:223
2153597991310,2cyclictest2148123-21kworker/u8:3+xprtiod09:38:093
2153597991310,2cyclictest0-21swapper/311:50:193
2153597991310,2cyclictest0-21swapper/307:55:003
215359799130,3cyclictest0-21swapper/311:40:273
215359299139,2cyclictest0-21swapper/212:20:182
215359299139,2cyclictest0-21swapper/211:55:242
215359299139,2cyclictest0-21swapper/210:50:012
215359299138,3cyclictest0-21swapper/208:09:592
215359299136,2cyclictest2185506-21basename07:40:002
2153592991311,2cyclictest401ktimers/210:54:362
2153592991311,2cyclictest2527593-21kworker/u8:0+xprtiod12:33:052
2153592991310,3cyclictest2497754-21kworker/u8:2+xprtiod11:50:082
2153592991310,2cyclictest2393088-21cpuspeed_turbos10:25:112
2153592991310,2cyclictest2281064-21gltestperf09:10:152
2153592991310,2cyclictest2254447-21gltestperf08:45:142
2153592991310,2cyclictest0-21swapper/211:05:282
215359299130,10cyclictest2211781-21latency_hist08:05:012
215358999136,5cyclictest497-21dbus-daemon08:25:001
2153589991311,1cyclictest0-21swapper/107:25:001
2153589991310,2cyclictest0-21swapper/112:30:211
2153589991310,2cyclictest0-21swapper/111:50:211
2153589991310,2cyclictest0-21swapper/111:20:091
2153589991310,2cyclictest0-21swapper/110:00:141
2153589991310,1cyclictest0-21swapper/107:15:161
215358999130,3cyclictest2419865-21ssh10:40:241
215358799139,3cyclictest60650irq/128-enp0s29f1:rx-008:40:080
215358799139,3cyclictest2247856-21sshd08:35:310
215358799137,4cyclictest60650irq/128-enp0s29f1:rx-008:20:120
2153587991310,2cyclictest60650irq/128-enp0s29f1:rx-007:46:100
215359799129,2cyclictest2362710-21kworker/u8:0+xprtiod10:27:293
215359799129,2cyclictest2288320-21cpuspeed_turbos09:15:113
215359799129,2cyclictest2288320-21cpuspeed_turbos09:15:103
215359799129,2cyclictest2180566-21cpuspeed_turbos07:35:123
215359799129,2cyclictest0-21swapper/309:30:173
215359799128,3cyclictest2269825-21cpuspeed_turbos09:00:113
215359799128,2cyclictest2543648-21grep12:05:113
215359799128,2cyclictest2543648-21grep12:05:113
215359799127,4cyclictest260-21systemd-journal08:23:473
215359799127,4cyclictest2484983-21tr11:25:193
215359799126,4cyclictest2297533-21cut09:20:183
215359799120,5cyclictest2303565-21grep09:25:143
215359299129,2cyclictest2527593-21kworker/u8:0+xprtiod12:19:002
215359299129,2cyclictest2259373-21cpuspeed_turbos08:50:152
215359299129,2cyclictest2185289-21kworker/u8:2+xprtiod09:55:182
215359299128,3cyclictest401ktimers/210:21:462
215359299128,2cyclictest0-21swapper/209:50:112
215359299127,3cyclictest2412201-21kworker/u8:3+xprtiod10:55:192
215359299123,7cyclictest2382707-21grep10:15:262
2153592991210,2cyclictest2148123-21kworker/u8:3+xprtiod09:42:322
215359299120,4cyclictest0-21swapper/211:43:522
215358999129,2cyclictest2239325-21tr08:30:181
215358999129,2cyclictest0-21swapper/110:55:251
215358999129,2cyclictest0-21swapper/110:15:261
215358999127,3cyclictest2254450-21gltestperf08:45:141
215358999121,2cyclictest0-21swapper/108:50:181
2153589991210,1cyclictest301rcuc/107:10:111
2153589991210,1cyclictest2468294-21/usr/sbin/munin11:15:171
2153589991210,1cyclictest2185289-21kworker/u8:2-xprtiod09:35:241
215358999120,4cyclictest2206513-21cron08:00:001
215358999120,3cyclictest0-21swapper/111:30:201
215358999120,2cyclictest0-21swapper/108:10:151
215358799127,4cyclictest60650irq/128-enp0s29f1:rx-007:50:140
215358799121,9cyclictest2264544-21apt-get08:55:110
215359799119,2cyclictest2362710-21kworker/u8:0+xprtiod10:10:153
215359799118,2cyclictest2442202-21kworker/u8:1+xprtiod11:47:023
215359799118,1cyclictest0-21swapper/308:25:253
215359799117,3cyclictest2159334-21gltestperf07:15:173
215359799117,2cyclictest0-21swapper/308:20:003
215359799116,4cyclictest260-21systemd-journal08:42:303
215359299119,1cyclictest0-21swapper/207:55:122
215359299118,2cyclictest0-21swapper/207:25:142
215359299117,3cyclictest401ktimers/211:10:052
215359299116,3cyclictest0-21swapper/208:24:592
215359299115,5cyclictest2248496-21sshd08:39:292
215359299115,4cyclictest2356228-21cut10:00:172
215358999119,1cyclictest2506732-21tr11:40:201
215358999117,3cyclictest2233217-21grep08:25:131
215358999117,3cyclictest2212133-21cpuspeed_turbos08:05:111
215358999116,4cyclictest311ktimers/112:35:011
215358999116,3cyclictest2270088-21tail09:00:141
215358999112,2cyclictest191rcu_preempt07:30:211
215358799118,2cyclictest61450irq/129-enp0s29f1:tx-007:19:470
215359799108,1cyclictest3008581-21kworker/3:3+events_power_efficient07:46:373
215359799108,1cyclictest1321210-21kworker/3:1+events_power_efficient08:35:333
215359799107,1cyclictest0-21swapper/307:30:223
215359799106,2cyclictest0-21swapper/308:00:223
215359799104,5cyclictest2242825-21systemd08:30:373
215359299105,4cyclictest2163299-21/usr/sbin/munin07:15:252
21535979998,1cyclictest3008581-21kworker/3:3+events_power_efficient08:05:053
21535899997,1cyclictest0-21swapper/107:45:181
21535929984,2cyclictest0-21swapper/207:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional