You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 08:04
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot4.osadl.org (updated Sat Jul 27, 2024 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1666751993836,1cyclictest2069328-21kworker/0:0+pm00:11:350
1666755993230,1cyclictest2075043-21fwupd00:11:341
166676099267,8cyclictest0-21swapper/322:41:463
166676099266,11cyclictest1710836-21cut19:50:183
1666757992616,8cyclictest0-21swapper/221:20:122
1666760992516,7cyclictest0-21swapper/322:15:003
1666757992517,7cyclictest502-21dbus-daemon20:10:002
1666757992517,7cyclictest502-21dbus-daemon20:10:002
1666760992416,6cyclictest0-21swapper/300:05:003
166676099237,6cyclictest1793154-21diskmemload21:51:303
166676099236,7cyclictest2036871-21kworker/u8:3+xprtiod23:54:133
166676099234,9cyclictest1898060-21kworker/u8:1+xprtiod22:17:473
1666760992320,2cyclictest2110318-21kthreadcore00:35:183
1666760992315,7cyclictest513-21systemd-logind22:35:013
1666757992317,4cyclictest1703496-21cron19:45:002
166676099223,9cyclictest1929817-21kworker/u8:0+nfsiod23:27:543
1666760992214,7cyclictest2069899-21fschecks_time00:10:153
1666757992213,7cyclictest0-21swapper/222:05:312
1666760992112,7cyclictest0-21swapper/323:40:143
1666757992118,2cyclictest1784024-21kthreadcore21:00:212
1666757992111,8cyclictest1756742-21cpuspeed_turbos20:35:112
166676099202,7cyclictest191rcu_preempt00:25:013
1666760992018,1cyclictest1677252-21sh19:20:003
1666760992016,2cyclictest1788660-21irqcore21:05:183
1666760992012,7cyclictest1901464-21irqcore22:20:183
1666760992012,7cyclictest1836541-21runrttasks21:35:263
166676099200,4cyclictest1931288-21cat22:40:003
166675799208,10cyclictest1851024-21tr21:45:172
166675799206,12cyclictest1681789-21/usr/sbin/munin19:20:262
1666757992017,2cyclictest2024450-21sed23:40:152
1666757992017,2cyclictest0-21swapper/222:15:022
1666757992012,7cyclictest1724068-21unixbench_singl20:00:272
1666757992011,8cyclictest2000937-21irqcore23:25:162
1666757992011,8cyclictest1756407-21idleruntime-cro20:35:002
1666757992011,8cyclictest0-21swapper/221:20:012
1666757992011,7cyclictest1821446-21ssh21:25:532
166676099191,7cyclictest18022742cut21:15:173
1666760991913,5cyclictest0-21swapper/320:45:003
1666760991910,8cyclictest0-21swapper/320:30:003
166676099190,3cyclictest2013664-21sh23:31:583
166676099190,12cyclictest0-21swapper/319:40:273
166675799196,12cyclictest2032699-21cut23:45:152
1666757991916,2cyclictest1885734-21irqcore22:10:142
1666757991916,2cyclictest1672713-21irqcore19:15:162
1666757991911,7cyclictest0-21swapper/223:05:262
166675799191,16cyclictest1992401-21latency_hist23:20:002
1666755991916,2cyclictest262-21systemd-journal20:20:001
1666755991916,2cyclictest262-21systemd-journal20:20:001
166676099189,7cyclictest1723577-21ntpq20:00:213
166676099189,7cyclictest0-21swapper/320:50:003
166676099188,8cyclictest262-21systemd-journal20:30:013
1666760991815,2cyclictest2914-21cron23:25:013
1666760991815,2cyclictest2100363-21cpuspeed_turbos00:30:103
1666760991815,2cyclictest1972521-21kthreadcore23:05:183
1666760991815,2cyclictest1884894-21latency_hist22:10:003
1666760991814,3cyclictest1963347-21kthreadcore23:00:183
1666760991813,3cyclictest1874347-21nvmesmart_nvme022:00:243
166676099181,2cyclictest0-21swapper/322:45:113
1666760991810,7cyclictest1669371-21kthreadcore19:10:193
1666760991810,7cyclictest0-21swapper/323:00:003
1666760991810,6cyclictest0-21swapper/323:35:113
166676099180,4cyclictest182970950ssh21:31:503
166676099180,3cyclictest1761678-21latency_hist20:40:003
166676099180,2cyclictest191rcu_preempt21:13:373
166675799189,7cyclictest1746229-21cpuspeed_turbos20:25:112
166675799186,10cyclictest1766784-21sshd20:43:312
166675799186,10cyclictest0-21swapper/223:50:252
166675799185,5cyclictest1904401-21cut22:20:202
166675799181,6cyclictest2100441-21uniq00:30:122
1666757991811,6cyclictest1969439-21cron23:05:002
166675799180,5cyclictest1708885-21latency_hist19:50:002
1666755991816,1cyclictest1687772-21munin-plugin-st19:29:591
1666755991814,3cyclictest1954623-21cpuspeed_turbos22:55:131
1666751991816,1cyclictest1839115-21munin-plugin-st21:40:010
1666751991816,1cyclictest1687757-21cron19:29:590
1666751991815,2cyclictest262-21systemd-journal21:10:000
1666751991815,2cyclictest1970016-21fschecks_count23:05:140
1666751991814,2cyclictest1-21systemd21:48:310
1666751991814,2cyclictest0-21swapper/019:40:000
166676099177,8cyclictest2064036-21cut00:05:193
166676099175,9cyclictest1682950-21cut19:25:143
166676099175,10cyclictest1864376-21kthreadcore21:55:183
166676099174,6cyclictest1645446-21kworker/u8:2+rpciod22:27:213
1666760991714,2cyclictest2093184-21irqcore00:25:153
1666760991714,2cyclictest1772925-21sed20:50:163
166676099170,7cyclictest0-21swapper/323:16:143
166676099170,4cyclictest182350550ssh21:29:243
166676099170,14cyclictest1698247-21latency_hist19:40:003
166675799179,7cyclictest2092973-21gltestperf00:25:142
166675799179,7cyclictest0-21swapper/219:10:272
166675799178,7cyclictest0-21swapper/221:57:312
166675799177,9cyclictest0-21swapper/222:56:252
166675799177,8cyclictest18450irq/131-nvme0q321:00:002
166675799177,8cyclictest0-21swapper/220:15:132
166675799177,8cyclictest0-21swapper/220:15:132
166675799176,9cyclictest2008404-21gltestperf23:30:182
166675799175,9cyclictest0-21swapper/221:10:092
166675799175,10cyclictest0-21swapper/220:50:002
166675799171,7cyclictest1948791-21grep22:50:172
166675799171,5cyclictest1666759-21latency_hist19:10:002
166675799171,4cyclictest262-21systemd-journal22:45:002
166675799171,4cyclictest1846762-21cron21:45:002
166675799171,4cyclictest0-21swapper/200:00:102
1666757991714,2cyclictest0-21swapper/223:20:142
166675799171,3cyclictest1946536-21idleruntime-cro22:50:002
166675799171,2cyclictest191rcu_preempt23:13:292
166675799171,13cyclictest2053527-21latency_hist00:00:002
166675799170,7cyclictest1916648-21gltestperf22:30:132
166675799170,5cyclictest19281462netstat22:35:252
1666755991715,1cyclictest1938885-21cron22:44:591
1666755991714,2cyclictest2038950-21gltestperf23:50:151
1666755991714,2cyclictest0-21swapper/100:05:001
1666751991714,2cyclictest60450irq/133-enp0s29f1:rx-023:55:250
1666751991714,2cyclictest60450irq/133-enp0s29f1:rx-022:50:200
1666751991714,2cyclictest60450irq/133-enp0s29f1:rx-021:32:190
1666751991714,2cyclictest60450irq/133-enp0s29f1:rx-021:10:040
1666751991713,3cyclictest60450irq/133-enp0s29f1:rx-023:15:100
166676099168,6cyclictest0-21swapper/320:10:013
166676099167,7cyclictest0-21swapper/323:55:133
166676099166,8cyclictest1813264-21grep21:20:213
166676099166,8cyclictest1781666-21missed_timers20:55:203
166676099163,11cyclictest1734525-21ldconfig20:10:233
1666760991613,2cyclictest491ktimers/323:45:113
1666760991613,2cyclictest0-21swapper/319:30:263
166676099160,1cyclictest191rcu_preempt21:43:303
166675799166,9cyclictest0-21swapper/220:20:222
166675799165,9cyclictest0-21swapper/221:50:162
166675799165,3cyclictest1777001-21unixbench_singl20:50:262
166675799164,2cyclictest0-21swapper/200:10:132
166675799161,6cyclictest1832749-21irqcore21:35:162
166675799161,5cyclictest2077662-21sed00:15:132
166675799161,5cyclictest2022983-21cron23:40:012
166675799161,4cyclictest1877288-21latency_hist22:04:592
166675799161,4cyclictest1735396-21apt20:15:002
1666757991611,3cyclictest1693439-21fschecks_count19:35:142
1666757991610,4cyclictest0-21swapper/200:05:252
166675799160,7cyclictest2108378-21ps00:35:162
166675799160,5cyclictest2085015-21grep00:20:112
166675799160,5cyclictest1683255-21sed19:25:172
166675799160,3cyclictest1824364-21cpuspeed_turbos21:30:202
166675599168,2cyclictest2038240-21munin-run23:50:001
166675599167,5cyclictest191rcu_preempt00:25:261
1666755991614,1cyclictest1719256-21sh20:00:001
1666755991613,2cyclictest0-21swapper/122:15:001
1666755991612,2cyclictest0-21swapper/119:50:001
1666755991611,4cyclictest1977723-21grep23:10:121
1666751991614,2cyclictest60450irq/133-enp0s29f1:rx-022:40:440
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:50:210
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:45:190
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:44:120
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:35:100
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:30:110
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:12:400
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-023:01:370
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-022:30:120
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-022:28:580
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-022:15:230
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-021:56:180
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-021:50:130
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-021:42:510
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-021:20:190
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-020:10:000
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-020:10:000
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-019:15:100
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-000:33:570
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-000:21:040
1666751991613,2cyclictest60450irq/133-enp0s29f1:rx-000:16:400
1666751991613,2cyclictest262-21systemd-journal19:50:000
1666751991613,2cyclictest1766905-21cron20:45:000
1666751991613,2cyclictest1751909-21irqcore20:30:170
1666751991613,2cyclictest171ktimers/000:25:130
1666751991612,3cyclictest60450irq/133-enp0s29f1:rx-022:45:210
1666751991612,3cyclictest60450irq/133-enp0s29f1:rx-020:50:110
1666751991612,2cyclictest60450irq/133-enp0s29f1:rx-023:25:260
1666751991612,2cyclictest1878041-21grep22:05:190
166676099158,6cyclictest1714278-21apt-get19:55:113
166676099157,7cyclictest1682028-21sed19:20:273
166676099156,8cyclictest1983016-21diskmemload23:11:513
166676099154,8cyclictest0-21swapper/319:45:133
166676099150,5cyclictest1949748-21grep22:50:173
166675799151,6cyclictest1714412-21cpuspeed_turbos19:55:122
166675799151,3cyclictest1709118-21tr19:50:112
1666757991511,2cyclictest1688089-21cpuspeed_turbos19:30:112
1666755991512,2cyclictest2085481-21irqcore00:20:151
1666755991512,2cyclictest2030596-21cut23:45:001
1666755991512,2cyclictest1854871-21cpuspeed_turbos21:50:131
1666755991512,2cyclictest1731356-21irqcore20:10:181
1666755991512,2cyclictest0-21swapper/122:50:001
1666755991511,3cyclictest1946948-21cpuspeed_turbos22:50:111
1666755991510,4cyclictest262-21systemd-journal21:00:001
166675599150,5cyclictest2053559-21/usr/sbin/munin00:00:011
166675599150,5cyclictest20097841kthreadcore23:30:201
1666751991513,2cyclictest60450irq/133-enp0s29f1:rx-022:02:120
1666751991513,1cyclictest60450irq/133-enp0s29f1:rx-023:20:200
1666751991512,2cyclictest60450irq/133-enp0s29f1:rx-022:10:200
1666751991512,2cyclictest60450irq/133-enp0s29f1:rx-021:25:530
1666751991512,2cyclictest60450irq/133-enp0s29f1:rx-019:44:190
1666751991512,2cyclictest60450irq/133-enp0s29f1:rx-019:30:270
1666751991512,2cyclictest60450irq/133-enp0s29f1:rx-000:05:580
166675199150,5cyclictest19583041kthreadcore22:55:210
1666760991412,1cyclictest0-21swapper/320:15:133
1666760991412,1cyclictest0-21swapper/320:15:133
166676099141,11cyclictest1729985-21latency_hist20:10:003
166676099140,4cyclictest2077859-21cut00:15:153
166675599148,2cyclictest191rcu_preempt19:45:001
166675599142,2cyclictest1672583-21sed19:15:141
166675599141,3cyclictest1974831-21chrt23:05:511
1666755991413,1cyclictest311ktimers/121:25:281
1666755991412,1cyclictest1645446-21kworker/u8:2-rpciod22:25:221
1666755991411,2cyclictest2077372-21cpuspeed_turbos00:15:111
1666755991411,2cyclictest1709008-21/usr/sbin/munin19:50:181
1666755991411,2cyclictest1689852-21kthreadcore19:30:181
1666755991411,2cyclictest1666746-21cyclictest21:45:251
1666755991411,2cyclictest0-21swapper/122:00:161
1666755991411,2cyclictest0-21swapper/120:25:001
1666755991410,3cyclictest1787492-21unixbench_singl21:00:301
1666755991410,2cyclictest0-21swapper/120:35:131
166675199143,9cyclictest211rcuc/000:00:170
1666751991412,1cyclictest60450irq/133-enp0s29f1:rx-022:22:280
166675199140,13cyclictest1772168-21munin-plugin-st20:50:000
166676099130,5cyclictest1783027-21tr21:00:143
166675599139,3cyclictest1916791-21irqcore22:30:151
166675599139,3cyclictest0-21swapper/122:10:001
166675599137,4cyclictest1894000-21cut22:15:171
166675599135,2cyclictest191rcu_preempt19:15:001
166675599132,2cyclictest16972332sed19:35:201
1666755991311,1cyclictest0-21swapper/120:45:001
1666755991310,2cyclictest2789002-21kworker/1:0+events_power_efficient19:20:181
1666755991310,2cyclictest1788429-21fschecks_time21:05:141
1666755991310,2cyclictest0-21swapper/123:20:261
1666755991310,2cyclictest0-21swapper/123:00:171
166675199139,3cyclictest60450irq/133-enp0s29f1:rx-019:10:100
166675199129,2cyclictest60450irq/133-enp0s29f1:rx-019:20:240
166675199129,2cyclictest1777801-21cpuspeed_turbos20:55:130
166675199128,2cyclictest0-21swapper/019:55:200
1666751991210,1cyclictest0-21swapper/020:00:180
166675199120,1cyclictest191rcu_preempt20:10:160
166675599117,3cyclictest1751541-21cpuspeed_turbos20:30:121
166675599114,2cyclictest191rcu_preempt22:20:171
166675599110,2cyclictest2103610-21kthreadcore00:30:181
166675199118,2cyclictest1735639-21/usr/sbin/munin20:15:180
166675199118,2cyclictest1735639-21/usr/sbin/munin20:15:180
166675199116,4cyclictest1758701-21tr20:35:200
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional