You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:11
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot4.osadl.org (updated Fri Jul 26, 2024 12:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2050912992819,7cyclictest2232397-21cpuspeed_turbos09:45:123
2050905992824,2cyclictest0-21swapper/111:20:001
2050912992616,8cyclictest2402557-21cut11:35:123
2050902992315,1cyclictest191rcu_preempt10:35:170
2050912992212,9cyclictest2316391-21turbostat10:40:003
2050912992210,10cyclictest2378398-21idleruntime-cro11:20:003
2050905992219,2cyclictest2231910-21munin-run09:45:011
205091299216,5cyclictest2256534-21cut10:00:183
2050912992118,2cyclictest0-21swapper/311:10:003
2050912992112,8cyclictest2151305-21idleruntime-cro08:44:593
2050905992118,2cyclictest2232822-21irqcore09:45:191
2050905992116,4cyclictest2389357-21kthreadcore11:25:171
205091299205,6cyclictest0-21swapper/311:25:173
2050912992016,3cyclictest515-21in:imuxsock11:44:593
2050912992011,8cyclictest0-21swapper/307:55:013
2050912992010,9cyclictest0-21swapper/312:40:003
2050912992010,8cyclictest0-21swapper/310:10:133
2050905992017,2cyclictest2146043-21cron08:39:591
2050902992017,2cyclictest0-21swapper/007:50:000
2050902992015,1cyclictest191rcu_preempt09:30:210
2050902992011,2cyclictest191rcu_preempt11:15:170
205091299199,2cyclictest2466403-21gltestperf12:25:133
205091299199,2cyclictest2466403-21gltestperf12:25:133
205091299198,2cyclictest2227013-21kthreadcore09:40:183
205091299198,2cyclictest0-21swapper/310:15:253
205091299198,1cyclictest0-21swapper/310:25:103
205091299197,3cyclictest2325063-21cut10:45:183
205091299197,2cyclictest0-21swapper/309:35:173
205091299197,2cyclictest0-21swapper/309:10:183
205091299196,5cyclictest2125802-21sshd08:20:183
2050912991910,7cyclictest0-21swapper/311:25:003
2050908991916,2cyclictest2362572-21munin-plugin-st11:10:002
2050905991916,2cyclictest2317863-21kthreadcore10:40:161
2050905991915,2cyclictest0-21swapper/109:10:141
2050902991913,2cyclictest191rcu_preempt08:45:240
2050902991913,1cyclictest191rcu_preempt11:45:250
205091299189,7cyclictest0-21swapper/311:30:163
205091299189,2cyclictest2347159-21turbostat11:00:013
205091299188,1cyclictest0-21swapper/311:15:003
205091299187,1cyclictest0-21swapper/308:50:213
205091299181,8cyclictest2339444-21latency_hist10:55:003
2050908991815,2cyclictest2286395-21fschecks_time10:20:132
205090599189,7cyclictest262-21systemd-journal08:45:001
2050905991815,2cyclictest2362568-21latency_hist11:10:001
2050905991813,3cyclictest2383891-21grep11:20:281
205090299181,3cyclictest22626922sh10:05:010
2050902991810,1cyclictest191rcu_preempt10:29:070
2050902991810,1cyclictest191rcu_preempt08:05:210
205091299178,3cyclictest491ktimers/311:53:333
205091299177,3cyclictest2263409-21gltestperf10:05:143
205091299177,2cyclictest2439458-21turbostat11:59:593
205091299174,2cyclictest5131systemd-logind08:02:063
2050912991712,4cyclictest0-21swapper/311:00:183
205091299170,8cyclictest2082481-21latency_hist07:40:003
205091299170,3cyclictest2324130-21sed10:45:013
2050908991715,1cyclictest2425171-21latency_hist11:50:002
2050908991713,3cyclictest2178992-21ssh09:10:162
2050905991714,2cyclictest2250081-21kthreadcore09:55:181
2050905991714,2cyclictest0-21swapper/108:10:231
2050905991711,5cyclictest2397112-21tr11:30:201
205090299179,1cyclictest191rcu_preempt09:16:480
205090299176,1cyclictest191rcu_preempt09:48:050
205090299175,7cyclictest16-21ksoftirqd/010:50:220
205090299172,4cyclictest16-21ksoftirqd/010:10:230
2050902991715,1cyclictest211rcuc/011:00:000
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-011:52:320
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-011:40:570
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-011:14:020
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-011:08:090
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-011:02:060
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-010:34:580
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-009:35:470
2050902991714,2cyclictest60450irq/133-enp0s29f1:rx-009:23:590
2050902991714,2cyclictest211rcuc/010:00:010
2050902991713,1cyclictest191rcu_preempt11:32:190
2050902991712,1cyclictest191rcu_preempt10:20:140
2050902991712,1cyclictest191rcu_preempt09:42:580
2050902991712,1cyclictest191rcu_preempt09:27:480
2050902991712,1cyclictest191rcu_preempt07:35:190
2050902991711,1cyclictest191rcu_preempt11:20:530
2050902991711,1cyclictest191rcu_preempt10:46:040
2050902991710,1cyclictest191rcu_preempt11:38:320
205091299169,2cyclictest491ktimers/309:17:133
205091299165,2cyclictest2240532-21irqcore09:50:183
2050912991612,3cyclictest2288580-21tr10:20:183
205090899165,2cyclictest191rcu_preempt07:45:002
2050908991614,1cyclictest2240541-21irqcore09:50:182
2050908991613,2cyclictest401ktimers/211:10:182
2050908991613,2cyclictest401ktimers/210:53:572
2050908991613,2cyclictest2247976-21gltestperf09:55:142
2050908991613,2cyclictest0-21swapper/209:45:012
2050908991612,2cyclictest0-21swapper/207:55:132
2050908991611,4cyclictest0-21swapper/209:50:012
2050908991611,1cyclictest0-21swapper/209:19:592
205090899160,3cyclictest0-21swapper/210:40:102
2050905991612,3cyclictest2402594-21fschecks_time11:35:131
2050905991612,3cyclictest2340019-21fschecks_count10:55:111
2050905991611,3cyclictest0-21swapper/112:10:231
2050905991611,3cyclictest0-21swapper/107:40:011
205090599160,5cyclictest2093541-21awk07:50:021
205090299169,2cyclictest191rcu_preempt09:53:040
205090299168,1cyclictest191rcu_preempt08:25:240
205090299167,2cyclictest191rcu_preempt09:13:260
2050902991613,2cyclictest60450irq/133-enp0s29f1:rx-009:05:010
2050902991613,2cyclictest60450irq/133-enp0s29f1:rx-008:55:130
2050902991613,2cyclictest60450irq/133-enp0s29f1:rx-007:30:120
2050902991613,2cyclictest171ktimers/011:27:160
2050902991611,1cyclictest191rcu_preempt12:10:180
2050902991611,1cyclictest191rcu_preempt10:40:140
2050902991611,1cyclictest191rcu_preempt09:00:200
2050902991610,1cyclictest191rcu_preempt10:15:310
2050902991610,1cyclictest191rcu_preempt08:38:060
205090299160,3cyclictest0-21swapper/012:05:140
205091299155,4cyclictest2252716-21seq09:56:003
205091299152,1cyclictest191rcu_preempt09:21:043
2050912991512,2cyclictest2454864-21unixbench_multi12:10:263
2050912991512,2cyclictest2136276-21irqcore08:30:143
2050912991510,4cyclictest2156561-21idleruntime-cro08:49:593
205091299150,3cyclictest2135526-21latency_hist08:30:003
205090899159,4cyclictest262-21systemd-journal11:20:182
205090899156,1cyclictest191rcu_preempt08:00:162
205090899153,1cyclictest191rcu_preempt12:10:112
205090899153,1cyclictest0-21swapper/211:04:272
2050908991514,1cyclictest357-21hwrng11:19:152
205090899151,2cyclictest2065765-21sed07:20:232
2050908991512,2cyclictest401ktimers/211:43:262
2050908991512,2cyclictest2297387-21kthreadcore10:25:182
2050908991512,2cyclictest2177977-21cron09:09:592
2050908991512,2cyclictest2125045-21latency_hist08:19:592
2050908991511,2cyclictest0-21swapper/210:05:252
205090599154,3cyclictest262-21systemd-journal11:45:001
2050905991512,2cyclictest2476791-21fschecks_count12:35:121
2050905991512,2cyclictest2110596-21kthreadcore08:05:161
2050905991511,3cyclictest2190225-21needreboot09:15:181
2050905991511,2cyclictest0-21swapper/109:35:191
2050905991511,2cyclictest0-21swapper/108:54:591
2050905991510,3cyclictest2465840-21turbostat12:25:001
205090599150,14cyclictest2425026-21basename11:50:001
205090299159,2cyclictest191rcu_preempt07:25:200
205090299159,1cyclictest191rcu_preempt07:44:330
205090299158,1cyclictest191rcu_preempt08:10:130
205090299153,3cyclictest16-21ksoftirqd/008:15:140
205090299152,4cyclictest16-21ksoftirqd/012:40:000
2050902991514,1cyclictest357-21hwrng12:31:570
2050902991514,1cyclictest357-21hwrng12:19:390
2050902991514,1cyclictest357-21hwrng08:03:400
2050902991513,1cyclictest60450irq/133-enp0s29f1:rx-010:05:130
2050902991513,1cyclictest60450irq/133-enp0s29f1:rx-007:55:240
2050902991513,1cyclictest2136915-21kthreadcore08:30:150
2050902991512,2cyclictest60450irq/133-enp0s29f1:rx-012:00:230
2050902991512,2cyclictest60450irq/133-enp0s29f1:rx-008:40:260
2050902991512,2cyclictest60450irq/133-enp0s29f1:rx-007:50:130
2050902991512,2cyclictest60450irq/133-enp0s29f1:rx-007:15:230
2050902991511,3cyclictest2125640-21gltestperf08:20:150
2050902991511,1cyclictest191rcu_preempt12:25:010
2050902991510,1cyclictest191rcu_preempt08:50:240
205090299150,4cyclictest16-21ksoftirqd/007:20:190
205091299149,4cyclictest2056655-21cut07:15:153
205091299147,5cyclictest262-21systemd-journal11:48:193
2050912991410,2cyclictest0-21swapper/310:33:053
2050912991410,2cyclictest0-21swapper/307:50:013
205091299140,4cyclictest21139352cat08:05:243
205090899149,4cyclictest262-21systemd-journal10:34:562
205090899142,1cyclictest191rcu_preempt08:55:232
205090899142,1cyclictest191rcu_preempt08:40:222
2050908991411,2cyclictest515-21in:imuxsock10:35:002
2050908991411,2cyclictest4050ktimers/211:32:412
2050908991411,2cyclictest401ktimers/210:02:282
2050908991411,2cyclictest2432703-21sh11:55:002
2050908991411,2cyclictest2219708-21kthreadcore09:35:192
2050908991411,2cyclictest2069347-21tr07:25:182
2050908991411,2cyclictest0-21swapper/211:40:002
2050908991411,2cyclictest0-21swapper/209:25:112
2050908991410,2cyclictest0-21swapper/212:20:262
205090899140,4cyclictest0-21swapper/210:15:242
205090899140,1cyclictest0-21swapper/208:25:272
205090599149,3cyclictest0-21swapper/107:50:001
205090599147,5cyclictest2108975-21sshd08:01:561
205090599147,5cyclictest0-21swapper/109:00:001
205090599146,6cyclictest2130269-21cron08:25:001
2050905991411,2cyclictest311ktimers/110:28:161
2050905991411,2cyclictest2209447-21sh09:30:161
2050905991411,2cyclictest2171854-21unixbench_multi09:00:271
2050905991411,2cyclictest2124062-21needreboot08:15:181
2050905991410,3cyclictest2130825-21fschecks_time08:25:151
2050905991410,2cyclictest0-21swapper/111:00:201
205090599140,8cyclictest2208836-21latency_hist09:30:011
205091299138,4cyclictest0-21swapper/308:55:203
205091299138,3cyclictest0-21swapper/309:05:003
205090899138,1cyclictest20535401kthreadcore07:10:162
205090899133,3cyclictest2368967-21kworker/u8:0+nfsiod11:57:042
205090899133,2cyclictest191rcu_preempt10:45:122
205090899132,2cyclictest191rcu_preempt09:20:182
205090899132,1cyclictest191rcu_preempt11:25:232
2050908991310,2cyclictest2341987-21kthreadcore10:55:162
2050908991310,2cyclictest2209601-21gltestperf09:30:172
205090899130,4cyclictest2109688-21fschecks_count08:05:132
205090899130,3cyclictest0-21swapper/212:25:162
205090899130,3cyclictest0-21swapper/212:25:162
205090899130,3cyclictest0-21swapper/212:15:112
205090899130,3cyclictest0-21swapper/208:50:252
205090899130,3cyclictest0-21swapper/207:45:172
205090899130,2cyclictest0-21swapper/209:03:412
205090599139,2cyclictest0-21swapper/110:15:011
205090599139,2cyclictest0-21swapper/109:50:111
205090599139,2cyclictest0-21swapper/107:20:291
205090599138,3cyclictest0-21swapper/110:50:141
205090599137,5cyclictest2282656-21ntpq10:15:221
2050905991310,2cyclictest2363907-21tr11:10:171
205090599130,2cyclictest23049222kthreadcore10:30:171
205090299130,3cyclictest0-21swapper/012:25:200
205090299130,3cyclictest0-21swapper/012:25:200
205090299130,3cyclictest0-21swapper/007:10:100
205091299128,3cyclictest2115898-21tr08:10:193
205091299128,2cyclictest0-21swapper/309:25:213
205090899129,2cyclictest2125373-21cpuspeed_turbos08:20:132
2050908991210,1cyclictest2056746-21gltestperf07:15:152
205090899120,3cyclictest2097165-21kthreadcore07:50:222
205090899120,3cyclictest0-21swapper/212:05:172
205090899120,3cyclictest0-21swapper/210:10:132
205090899120,3cyclictest0-21swapper/207:35:282
205090899120,2cyclictest2151749-21fschecks_count08:45:132
205090899120,1cyclictest191rcu_preempt12:30:182
205090599129,2cyclictest2255443-21cpuspeed_turbos10:00:121
205090599126,4cyclictest262-21systemd-journal12:33:181
205090599125,5cyclictest2071949-21latency_hist07:30:011
205090599121,3cyclictest2077220-21latency_hist07:35:001
205091299118,2cyclictest2051408-21gltestperf07:10:133
205091299117,2cyclictest2071076-21ntpq07:25:223
205091299111,8cyclictest2087752-21latency_hist07:45:013
205090899113,1cyclictest191rcu_preempt08:35:122
205090899110,3cyclictest2476843-21fschecks_time12:35:122
205090599118,2cyclictest2440028-21gltestperf12:00:141
205090599118,2cyclictest0-21swapper/107:40:181
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional