You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-19 - 04:08
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Fri Jul 19, 2024 00:43:43)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94429992421,2cyclictest317255-21munin-run22:10:002
94422992422,1cyclictest74-1kworker/0:1H+kblockd19:22:290
94422992421,2cyclictest515-21in:imuxsock00:20:000
94422992321,1cyclictest115449-21cron19:30:000
94422992118,2cyclictest517-21rs:main0
94432992017,2cyclictest475713-21systemd-run23:50:003
94432992017,2cyclictest302312-21irqcore22:00:133
94432992016,3cyclictest264721-21kthreadcore21:35:163
94429992017,2cyclictest206790-21fschecks_count20:55:152
94427992016,3cyclictest491504-21cron00:00:011
94427992012,7cyclictest0-21swapper/120:45:011
9443299191,16cyclictest336330-21kthreadcore22:20:153
94429991911,1cyclictest191rcu_preempt00:00:002
94432991815,2cyclictest517-21rs:main3
94432991815,2cyclictest163088-21apt-key20:15:013
94432991814,3cyclictest491ktimers/323:51:593
94432991813,3cyclictest425345-21runrttasks23:15:213
94432991811,5cyclictest262-21systemd-journal21:25:003
94429991812,1cyclictest191rcu_preempt20:05:232
94422991815,2cyclictest185134-21apt-key20:35:010
94422991814,4cyclictest60450irq/133-enp0s29f1:rx-000:30:370
94432991714,2cyclictest137174-21gltestperf19:50:143
94432991714,2cyclictest137174-21gltestperf19:50:143
94432991713,2cyclictest0-21swapper/321:35:003
94429991714,2cyclictest0-21swapper/223:20:002
94429991714,2cyclictest0-21swapper/220:05:002
9442299177,9cyclictest0-21swapper/022:20:110
94422991714,2cyclictest60450irq/133-enp0s29f1:rx-023:33:110
94422991714,2cyclictest60450irq/133-enp0s29f1:rx-023:29:460
94422991714,2cyclictest60450irq/133-enp0s29f1:rx-020:20:130
94422991714,2cyclictest60450irq/133-enp0s29f1:rx-000:22:560
94422991714,2cyclictest141805-21idleruntime-cro19:55:000
94422991714,2cyclictest141805-21idleruntime-cro19:55:000
94422991713,3cyclictest464979-21unixbench_multi23:40:240
94422991713,2cyclictest60450irq/133-enp0s29f1:rx-023:35:150
94422991713,2cyclictest0-21swapper/021:50:160
94422991713,2cyclictest0-21swapper/020:10:130
94422991712,4cyclictest417117-21needreboot23:10:180
94422991712,3cyclictest61250irq/134-enp0s29f1:tx-022:00:140
94422991711,2cyclictest60450irq/133-enp0s29f1:rx-023:48:510
94432991613,2cyclictest515157-21sh00:15:003
94432991613,2cyclictest147402-21cpuspeed_turbos20:00:093
94432991612,2cyclictest0-21swapper/300:15:143
9442999166,2cyclictest0-21swapper/219:45:192
9442999165,4cyclictest41-21ksoftirqd/200:30:152
94429991614,1cyclictest531013-21idleruntime-cro00:25:002
94429991614,1cyclictest523107-21cron00:20:002
94429991614,1cyclictest119577-21kthreadcore19:30:172
94429991613,2cyclictest212277-21gltestperf21:00:122
94429991611,4cyclictest228421-21ssh21:12:102
94429991611,1cyclictest191rcu_preempt23:20:172
94429991610,4cyclictest0-21swapper/219:50:182
94429991610,4cyclictest0-21swapper/219:50:182
94427991614,2cyclictest311ktimers/123:32:481
94427991613,2cyclictest432984-21ntp_kernel_err23:20:181
94427991613,2cyclictest311ktimers/100:30:171
94427991613,2cyclictest115519-21latency_hist19:30:011
94427991613,2cyclictest0-21swapper/120:25:001
94427991611,4cyclictest262-21systemd-journal22:40:001
94427991611,4cyclictest262-21systemd-journal22:40:001
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-023:00:080
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-022:35:180
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-022:35:180
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-022:25:020
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-022:08:570
94422991614,1cyclictest60450irq/133-enp0s29f1:rx-020:00:120
94422991613,2cyclictest61250irq/134-enp0s29f1:tx-023:57:420
94422991613,2cyclictest61250irq/134-enp0s29f1:tx-000:14:570
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-023:15:160
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-023:05:230
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-022:56:590
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-022:40:470
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-022:30:090
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-022:15:150
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:55:170
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:45:150
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:40:170
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:35:590
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:31:580
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:25:150
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:24:020
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:16:260
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-021:11:550
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-020:47:180
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-020:40:230
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-019:55:170
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-000:35:090
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-000:25:170
94422991613,2cyclictest60450irq/133-enp0s29f1:rx-000:05:350
94422991610,4cyclictest262-21systemd-journal22:50:000
94422991610,2cyclictest60450irq/133-enp0s29f1:rx-000:00:190
94432991512,2cyclictest491ktimers/300:23:213
94432991512,2cyclictest377318-21ntp_kernel_pll_22:45:193
94432991511,3cyclictest460828-21sed23:40:143
94432991511,2cyclictest0-21swapper/322:10:003
9443299150,3cyclictest115455-21munin-plugin-st19:30:003
9442999156,2cyclictest309385-21munin-run22:05:002
9442999153,3cyclictest94418-21cyclictest23:39:542
94429991514,1cyclictest401ktimers/221:59:542
94429991513,2cyclictest401ktimers/223:25:462
94429991513,1cyclictest326614-21kthreadcore22:15:162
94429991512,2cyclictest405174-21cpuspeed_turbos23:05:102
94429991512,2cyclictest0-21swapper/221:20:002
94429991511,3cyclictest498836-21ssh00:04:072
9442799159,4cyclictest262-21systemd-journal23:40:001
9442799159,4cyclictest262-21systemd-journal23:28:151
94427991513,1cyclictest211819-21latency_hist21:00:011
94427991512,2cyclictest531582-21fschecks_count00:25:131
94427991512,2cyclictest290162-21grep21:50:191
94427991512,2cyclictest146596-21unixbench_multi19:55:231
94427991511,3cyclictest355182-21ssh22:32:361
94427991511,2cyclictest0-21swapper/122:55:001
94427991511,2cyclictest0-21swapper/122:55:001
9442799150,3cyclictest0-21swapper/123:45:201
9442299159,4cyclictest206618-21apt-get20:55:130
94422991513,1cyclictest60450irq/133-enp0s29f1:rx-022:10:100
94422991512,2cyclictest61250irq/134-enp0s29f1:tx-023:55:000
94422991512,2cyclictest60450irq/133-enp0s29f1:rx-022:50:170
94422991512,2cyclictest60450irq/133-enp0s29f1:rx-022:50:170
94422991512,2cyclictest60450irq/133-enp0s29f1:rx-020:25:210
94422991512,2cyclictest60450irq/133-enp0s29f1:rx-020:15:180
94422991512,2cyclictest189640-21ntp_kernel_pll_20:35:200
94422991512,2cyclictest152702-21cpuspeed_turbos20:05:110
94422991511,3cyclictest60450irq/133-enp0s29f1:rx-019:40:120
94422991511,3cyclictest60450irq/133-enp0s29f1:rx-019:15:110
94422991511,3cyclictest115931-21fschecks_time19:30:120
94432991413,1cyclictest491ktimers/300:02:503
94432991411,2cyclictest398174-21irqcore23:00:153
94432991411,2cyclictest341771-21sed22:25:153
94432991411,2cyclictest231643-21kthreadcore21:15:163
94432991411,2cyclictest0-21swapper/321:10:113
94432991411,2cyclictest0-21swapper/319:35:003
94432991410,2cyclictest0-21swapper/322:00:003
94432991410,2cyclictest0-21swapper/321:50:143
94432991410,2cyclictest0-21swapper/321:00:013
94432991410,2cyclictest0-21swapper/320:40:133
9442999149,4cyclictest262-21systemd-journal22:23:052
9442999149,1cyclictest191rcu_preempt22:25:172
9442999148,4cyclictest468364-21df23:45:112
9442999146,6cyclictest278496-21sed21:45:132
9442999144,2cyclictest243880-21kworker/u8:1+nfsiod21:42:142
94429991413,1cyclictest401ktimers/222:11:352
94429991412,1cyclictest511327-21kthreadcore00:10:182
94429991411,2cyclictest401ktimers/221:35:132
94429991411,2cyclictest221756-21unixbench_singl21:05:232
94429991411,2cyclictest104398-21unixbench_multi19:15:232
94429991411,2cyclictest0-21swapper/222:40:002
94429991411,2cyclictest0-21swapper/222:40:002
94429991411,2cyclictest0-21swapper/220:35:012
94429991410,3cyclictest189714-21ntp_offset20:35:212
94429991410,3cyclictest174625-21cpuspeed_turbos20:25:102
9442799144,3cyclictest11-21kworker/u8:0+rpciod22:22:451
9442799143,2cyclictest0-21swapper/120:50:161
94427991413,1cyclictest357-21hwrng22:11:321
94427991412,1cyclictest0-21swapper/100:05:151
94427991411,2cyclictest99653-21munin-plugin-st19:15:001
94427991411,2cyclictest61350irq/136-enp0s29f1:tx-123:41:041
94427991411,2cyclictest495618-21kthreadcore00:00:161
94427991411,2cyclictest425536-21unixbench-2d23:15:221
94427991411,2cyclictest397260-21cpuspeed_turbos23:00:111
94427991411,2cyclictest341305-21cpuspeed_turbos22:25:121
94427991411,2cyclictest262568-21ssh21:35:131
94427991411,2cyclictest222645-21cpuspeed_turbos21:10:111
94427991411,2cyclictest137153-21gltestperf19:50:141
94427991411,2cyclictest137153-21gltestperf19:50:141
94427991411,2cyclictest0-21swapper/100:20:131
94427991411,1cyclictest0-21swapper/123:05:101
9442799140,4cyclictest547610-21ssh00:35:121
9442799140,4cyclictest521997-21ssh00:18:161
9442799140,3cyclictest0-21swapper/121:30:181
94422991411,2cyclictest61250irq/134-enp0s29f1:tx-020:50:120
94422991411,2cyclictest60450irq/133-enp0s29f1:rx-019:36:050
9443299139,2cyclictest0-21swapper/320:35:133
9443299138,4cyclictest503946-21ntp_00:05:183
9443299138,3cyclictest538957-21turbostat00:30:003
94432991311,1cyclictest147093-21munin-plugin-st20:00:003
94432991310,2cyclictest389209-21gltestperf22:55:133
94432991310,2cyclictest172897-21needreboot20:20:213
9442999139,3cyclictest253872-21cron21:30:002
9442999139,1cyclictest191rcu_preempt22:54:332
9442999139,1cyclictest191rcu_preempt22:54:332
9442999138,4cyclictest99630-21cron19:15:002
9442999138,4cyclictest503988-21ntpq00:05:192
9442999135,2cyclictest191rcu_preempt19:55:192
9442999134,5cyclictest317284-21kworker/u8:3+rpciod22:57:092
9442999134,3cyclictest41-21ksoftirqd/220:25:002
9442999133,2cyclictest191rcu_preempt19:20:112
94429991312,1cyclictest401ktimers/221:34:592
94429991311,1cyclictest532492-21kthreadcore00:25:172
94429991311,1cyclictest463200-21kthreadcore23:40:162
94429991311,1cyclictest365277-21/usr/sbin/munin22:40:152
94429991311,1cyclictest196180-21cut20:45:102
94429991311,1cyclictest0-21swapper/219:45:012
94429991310,2cyclictest0-21swapper/221:50:142
9442999130,3cyclictest238656-21ssh21:20:132
9442799139,3cyclictest262-21systemd-journal20:27:411
9442799139,3cyclictest262-21systemd-journal19:37:331
9442799134,2cyclictest191rcu_preempt19:15:131
9442799133,3cyclictest110169-21munin-plugin-st19:25:001
9442799132,3cyclictest274067-21kthreadcore21:40:171
9442799131,6cyclictest24326550ssh21:20:321
94427991311,1cyclictest296745-21ssh21:55:181
94427991310,2cyclictest222163-21idleruntime-cro21:10:011
94427991310,2cyclictest126305-21cpuspeed_turbos19:40:131
94427991310,1cyclictest201059-21idleruntime-cro20:50:011
9442799130,2cyclictest0-21swapper/123:53:141
9442299134,1cyclictest970331kthreadcore19:10:180
94422991311,2cyclictest60450irq/133-enp0s29f1:rx-021:00:080
94422991310,2cyclictest211rcuc/021:05:150
9443299129,2cyclictest491ktimers/323:22:133
9443299129,2cyclictest491ktimers/322:41:563
9443299128,2cyclictest0-21swapper/323:55:143
9443299128,2cyclictest0-21swapper/319:15:173
9443299127,3cyclictest246217-21ssh21:25:013
9443299126,4cyclictest157259-21sshd20:06:003
9443299121,3cyclictest184870-21awk20:35:003
9442999129,2cyclictest401ktimers/223:50:192
9442999128,3cyclictest547508-21gltestperf00:35:112
9442999127,4cyclictest449735-21seq23:31:072
9442999127,1cyclictest191rcu_preempt19:25:212
9442999126,4cyclictest121261-21fw_forwarded_lo19:35:142
94429991210,1cyclictest373237-21cpuspeed_turbos22:45:112
9442799129,2cyclictest373243-21cpuspeed_turbos22:45:111
9442799129,2cyclictest116201-21irqcore19:30:151
9442799129,2cyclictest0-21swapper/122:10:001
9442799121,5cyclictest39615650ssh22:59:371
94427991210,2cyclictest311ktimers/123:12:481
94427991210,1cyclictest0-21swapper/121:15:111
94427991210,1cyclictest0-21swapper/120:10:151
9442799120,6cyclictest28324650ssh21:46:021
9442799120,1cyclictest185149-21apt-key20:35:011
9442799120,1cyclictest1655781kthreadcore20:15:171
9443299119,1cyclictest491ktimers/300:35:153
9443299118,2cyclictest325557-21cpuspeed_turbos22:15:123
9443299117,3cyclictest452812-21expr23:35:133
9443299116,3cyclictest125009-21needreboot19:35:193
9442999119,1cyclictest203339-21kthreadcore20:50:152
9442799118,2cyclictest0-21swapper/120:05:151
9442799112,1cyclictest191rcu_preempt20:00:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional