You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-28 - 12:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Wed Feb 28, 2024 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77862295260,22sleep20-21swapper/219:06:412
78832272237,21sleep00-21swapper/019:07:480
78022263229,21sleep30-21swapper/319:06:543
78272261226,23sleep10-21swapper/119:07:041
57652610,0sleep00-21swapper/023:10:490
180562570,0sleep20-21swapper/223:20:242
208692560,0sleep20-21swapper/221:49:512
144642560,0sleep00-21swapper/000:35:010
279172550,0sleep20-21swapper/223:04:312
214742530,0sleep10-21swapper/121:26:061
138822200,1sleep20-21swapper/221:44:502
97802150,0sleep30-21swapper/300:30:253
817099144,3cyclictest19982-21systemd-journal20:45:140
146012110,0sleep00-21swapper/023:17:380
146012110,0sleep00-21swapper/023:17:370
272792100,0sleep10-21swapper/123:26:471
81829994,3cyclictest19982-21systemd-journal21:49:553
81829990,3cyclictest21384-21runrttasks23:22:383
81789995,3cyclictest3758-21snmpd22:26:132
81789994,3cyclictest19982-21systemd-journal23:30:522
81789994,3cyclictest19982-21systemd-journal21:15:422
81739995,3cyclictest508-21dbus-daemon23:45:001
81739994,3cyclictest19982-21systemd-journal23:16:411
81739994,3cyclictest19982-21systemd-journal23:16:411
81739993,3cyclictest23786-21munin-run22:15:001
81709994,3cyclictest19982-21systemd-journal19:38:060
81829985,2cyclictest34-21ksoftirqd/319:25:013
81829984,2cyclictest19982-21systemd-journal22:52:373
81829983,3cyclictest19982-21systemd-journal23:15:023
81829983,3cyclictest19982-21systemd-journal23:15:023
81829983,3cyclictest19982-21systemd-journal23:01:163
81829983,3cyclictest19982-21systemd-journal00:18:263
81789985,2cyclictest502-21systemd-logind23:58:492
81789983,3cyclictest19982-21systemd-journal22:57:312
81789983,3cyclictest19982-21systemd-journal20:20:002
81789982,3cyclictest19346-21awk22:35:002
81789980,2cyclictest502-21systemd-logind22:54:362
81739986,1cyclictest221ksoftirqd/119:30:011
81739984,3cyclictest19982-21systemd-journal21:17:471
81739983,3cyclictest19982-21systemd-journal21:04:011
81739982,3cyclictest19116-21gdbus20:50:011
31890280,0sleep30-21swapper/322:20:223
28311280,0sleep20-21swapper/221:55:082
27984280,0sleep30-21swapper/323:52:083
21139280,0sleep00-21swapper/023:46:570
81829974,2cyclictest19409-21cron20:45:003
81829974,2cyclictest11736-21in:imuxsock22:29:083
81829973,3cyclictest5285-21apt-get23:35:243
81829973,3cyclictest508-21dbus-daemon20:20:383
81829973,3cyclictest508-21dbus-daemon20:17:183
81829973,3cyclictest3758-21snmpd20:47:493
81829973,3cyclictest3758-21snmpd20:11:223
81829973,3cyclictest20357-21awk21:25:323
81829973,3cyclictest19982-21systemd-journal00:05:053
81829973,3cyclictest0-21swapper/300:25:063
81829973,1cyclictest0-21swapper/300:39:343
81829972,3cyclictest19982-21systemd-journal23:31:173
81829972,3cyclictest19982-21systemd-journal22:04:573
81829970,1cyclictest0-21swapper/323:27:123
81789974,2cyclictest508-21dbus-daemon21:52:262
81789974,2cyclictest0-21swapper/223:30:002
81789973,3cyclictest508-21dbus-daemon00:30:012
81789973,3cyclictest3758-21snmpd23:45:372
81789973,3cyclictest3758-21snmpd19:55:552
81789973,3cyclictest0-21swapper/200:18:432
81789973,1cyclictest0-21swapper/221:38:522
81789973,1cyclictest0-21swapper/200:11:362
81789972,3cyclictest19982-21systemd-journal19:25:012
81789972,3cyclictest19982-21systemd-journal19:18:542
81789970,4cyclictest23880-21idleruntime-cro20:55:012
81739973,3cyclictest3758-21snmpd19:16:231
81739973,3cyclictest32346-21ntpq23:55:281
81739973,3cyclictest29741-11brltty19:38:061
81739973,3cyclictest22462-21cat21:50:301
81739973,3cyclictest19982-21systemd-journal22:09:321
81739973,3cyclictest19982-21systemd-journal00:08:481
81739973,3cyclictest1968-21cron00:25:011
81739973,3cyclictest16969-21lldpd19:14:171
81739973,3cyclictest1-21systemd19:58:061
81739973,1cyclictest0-21swapper/123:00:341
81739973,1cyclictest0-21swapper/121:23:441
81739973,1cyclictest0-21swapper/100:39:481
81739971,3cyclictest4980-21awk21:15:001
81709973,3cyclictest6003-21cat23:35:290
81709973,3cyclictest3758-21snmpd20:42:400
81709973,3cyclictest3758-21snmpd20:17:400
81709973,3cyclictest3758-21snmpd19:14:020
81709973,3cyclictest17231-21systemctl19:25:360
81709973,3cyclictest0-21swapper/021:18:250
81709973,2cyclictest19982-21systemd-journal21:43:150
81709973,2cyclictest16969-21lldpd00:02:500
81709973,1cyclictest0-21swapper/023:33:540
81709973,1cyclictest0-21swapper/022:16:580
81709973,1cyclictest0-21swapper/021:56:100
81709972,3cyclictest19982-21systemd-journal22:55:000
81709972,3cyclictest19982-21systemd-journal21:52:500
3389270,0sleep00-21swapper/021:36:260
81829963,2cyclictest8339-21sed21:40:263
81829963,2cyclictest5899-21grep00:00:223
81829963,2cyclictest3758-21snmpd22:48:593
81829963,2cyclictest29439-21sh00:20:213
81829963,2cyclictest27618-21grep19:50:253
81829963,2cyclictest22120-21cstates20:50:243
81829963,2cyclictest2119-21sh21:59:383
81829963,2cyclictest18107-21ssh21:24:283
81829963,2cyclictest1797-21ntpq21:35:303
81829963,2cyclictest11736-21in:imuxsock20:02:183
81829963,1cyclictest0-21swapper/323:14:313
81829962,3cyclictest9056-21cat19:10:273
81829962,3cyclictest5863-21cat21:15:293
81829962,3cyclictest3758-21snmpd23:55:133
81829962,3cyclictest3758-21snmpd23:47:433
81829962,3cyclictest3758-21snmpd23:07:433
81829962,3cyclictest3758-21snmpd21:30:113
81829962,3cyclictest3758-21snmpd21:10:333
81829962,3cyclictest3758-21snmpd21:00:573
81829962,3cyclictest3758-21snmpd20:30:283
81829962,3cyclictest3758-21snmpd20:26:073
81829962,3cyclictest3758-21snmpd19:49:363
81829962,3cyclictest30127-21cat19:55:313
81829962,3cyclictest29741-11brltty20:06:283
81829962,3cyclictest28676-21awk21:05:243
81829962,3cyclictest25067-21ntp_kernel_err20:55:333
81829962,3cyclictest21918-21cat19:35:363
81829962,3cyclictest18495-21expr19:30:253
81829962,3cyclictest18427-21ntpq00:10:263
81829962,3cyclictest16969-21lldpd22:11:113
81829962,3cyclictest15510-21expr22:55:233
81829962,3cyclictest1-21systemd23:41:183
81829962,3cyclictest10839-21expr22:05:273
81829962,1cyclictest0-21swapper/322:40:043
81829962,1cyclictest0-21swapper/322:35:343
81829962,1cyclictest0-21swapper/322:30:303
81829961,3cyclictest19982-21systemd-journal22:17:283
81829960,2cyclictest15589-21df_inode20:35:263
81829960,0cyclictest0-21swapper/321:50:513
81789966,0cyclictest0-21swapper/221:26:142
81789963,2cyclictest7174-21vmstat00:00:312
81789963,2cyclictest508-21dbus-daemon20:35:142
81789963,2cyclictest31694-21apt-get20:00:262
81789963,2cyclictest29547-21uniq23:05:272
81789963,2cyclictest29220-21hddtemp_smartct21:05:262
81789963,2cyclictest27876-21ssh23:52:022
81789963,2cyclictest26824-21sort21:00:242
81789963,2cyclictest21164-21ssh22:12:292
81789963,2cyclictest11736-21in:imuxsock19:43:312
81789963,2cyclictest11736-21in:imuxsock19:12:502
81789962,3cyclictest5434-21seq20:12:092
81789962,3cyclictest3758-21snmpd22:35:592
81789962,3cyclictest3758-21snmpd20:49:262
81789962,3cyclictest3758-21snmpd20:25:132
81789962,3cyclictest3758-21snmpd20:23:422
81789962,3cyclictest3758-21snmpd20:06:072
81789962,3cyclictest3758-21snmpd00:06:222
81789962,3cyclictest25639-21cat19:45:262
81789962,3cyclictest24806-21cat20:55:312
81789962,3cyclictest18661-21diskstats19:30:262
81789962,3cyclictest0-21swapper/223:42:542
81789962,1cyclictest0-21swapper/222:47:422
81789962,1cyclictest0-21swapper/222:20:372
81789962,1cyclictest0-21swapper/222:15:252
81789962,1cyclictest0-21swapper/222:01:002
81789962,1cyclictest0-21swapper/221:20:382
81789962,1cyclictest0-21swapper/221:11:232
81789962,1cyclictest0-21swapper/200:32:392
81789961,3cyclictest19982-21systemd-journal23:15:002
81789961,3cyclictest19982-21systemd-journal23:15:002
81789961,3cyclictest19982-21systemd-journal20:41:052
81789961,3cyclictest19982-21systemd-journal00:20:072
81789961,3cyclictest14766-21sshd20:33:052
81789960,6cyclictest0-21swapper/221:30:052
81789960,6cyclictest0-21swapper/200:39:182
81789960,5cyclictest4980-21ssh23:10:292
81789960,0cyclictest0-21swapper/222:40:062
81789960,0cyclictest0-21swapper/222:05:062
81739963,2cyclictest8077-21ssh22:50:211
81739963,2cyclictest508-21dbus-daemon00:00:011
81739963,2cyclictest3864-21grep22:00:291
81739963,2cyclictest30596-21diskmemload22:35:441
81739963,2cyclictest29741-11brltty23:05:261
81739963,2cyclictest28578-21seq21:05:061
81739963,2cyclictest19982-21systemd-journal20:20:021
81739963,2cyclictest11736-21in:imuxsock19:47:171
81739963,2cyclictest11370-21ssh21:42:251
81739963,1cyclictest0-21swapper/121:35:441
81739962,3cyclictest7597-21sed22:25:301
81739962,3cyclictest508-21dbus-daemon20:00:341
81739962,3cyclictest3758-21snmpd23:35:251
81739962,3cyclictest3758-21snmpd23:11:031
81739962,3cyclictest3758-21snmpd22:47:211
81739962,3cyclictest3758-21snmpd20:54:521
81739962,3cyclictest3758-21snmpd20:27:591
81739962,3cyclictest3758-21snmpd20:05:271
81739962,3cyclictest3758-21snmpd19:30:541
81739962,3cyclictest3758-21snmpd19:21:591
81739962,3cyclictest3758-21snmpd00:17:051
81739962,3cyclictest3758-21snmpd00:11:411
81739962,3cyclictest32359-21tune2fs22:20:241
81739962,3cyclictest28967-21sh21:31:341
81739962,3cyclictest27568-21cat22:40:281
81739962,3cyclictest24455-21seq19:42:071
81739962,3cyclictest0-21swapper/123:32:291
81739962,1cyclictest0-21swapper/123:20:531
81739962,1cyclictest0-21swapper/122:30:411
81739962,1cyclictest0-21swapper/122:16:431
81739962,1cyclictest0-21swapper/121:56:201
81739962,1cyclictest0-21swapper/121:45:251
81739962,1cyclictest0-21swapper/100:25:141
81739961,4cyclictest19982-21systemd-journal23:45:531
81739961,3cyclictest19982-21systemd-journal20:30:391
81739961,3cyclictest19982-21systemd-journal19:52:161
81739961,2cyclictest24976-21cat23:50:231
81739961,1cyclictest0-21swapper/100:30:321
81739960,2cyclictest16969-21lldpd22:55:571
81709966,0cyclictest0-21swapper/020:30:370
81709964,1cyclictest4315-21ntp_states22:00:330
81709964,1cyclictest23962-21smart_sda19:40:330
81709963,2cyclictest9756-21cat20:20:340
81709963,2cyclictest668-21runrttasks23:27:550
81709963,2cyclictest5098-21sh00:26:120
81709963,2cyclictest508-21dbus-daemon22:26:390
81709963,2cyclictest3758-21snmpd23:50:050
81709963,2cyclictest3758-21snmpd22:40:060
81709963,2cyclictest3758-21snmpd20:27:200
81709963,2cyclictest32365-21if_enp4s020:00:290
81709963,2cyclictest3126-21chrt20:06:160
81709963,2cyclictest31127-21taskset19:56:570
81709963,2cyclictest26562-21expr21:30:270
81709963,2cyclictest26011-21sed19:45:290
81709963,2cyclictest2062-21cat22:45:230
81709963,2cyclictest13801-21apt19:20:200
81709963,2cyclictest13202-21sh22:30:170
81709963,2cyclictest0-21swapper/023:02:010
81709963,1cyclictest0-21swapper/021:45:430
81709962,3cyclictest508-21dbus-daemon23:20:030
81709962,3cyclictest3758-21snmpd21:10:570
81709962,3cyclictest3758-21snmpd21:05:110
81709962,3cyclictest3758-21snmpd20:55:070
81709962,3cyclictest3758-21snmpd20:52:100
81709962,3cyclictest3758-21snmpd20:35:500
81709962,3cyclictest3758-21snmpd20:11:300
81709962,3cyclictest3758-21snmpd19:15:120
81709962,3cyclictest3758-21snmpd00:20:100
81709962,3cyclictest3758-21snmpd00:10:490
81709962,3cyclictest3758-21snmpd00:07:440
81709962,3cyclictest27766-21ntpd22:35:300
81709962,3cyclictest27131-21sed21:00:250
81709962,3cyclictest20076-21seq22:11:260
81709962,3cyclictest19221-21ntpq19:30:310
81709962,3cyclictest11236-21cat22:05:290
81709962,3cyclictest0-21swapper/022:20:480
81709962,3cyclictest0-21swapper/000:15:060
81709962,1cyclictest0-21swapper/023:05:230
81709961,3cyclictest19982-21systemd-journal21:20:180
81709960,4cyclictest19982-21systemd-journal22:55:250
81709960,3cyclictest447-21/usr/sbin/munin23:55:340
81709960,3cyclictest19156-21rm21:25:170
81709960,3cyclictest16652-21ssh23:44:030
81709960,3cyclictest10931-21rm00:31:000
18768260,0sleep10-21swapper/120:40:341
81829953,1cyclictest668-21runrttasks19:40:213
81829952,2cyclictest11907-21expr19:15:223
81829950,0cyclictest0-21swapper/319:25:103
81789952,2cyclictest5030-21ssh23:35:112
81789952,2cyclictest28504-21threads19:50:352
81789952,2cyclictest20882-21df19:35:252
81789952,2cyclictest16013-21find19:25:232
81739952,2cyclictest3758-21snmpd20:35:021
81739951,3cyclictest3758-21snmpd20:15:001
81739950,3cyclictest19982-21systemd-journal20:55:401
81739950,3cyclictest19982-21systemd-journal20:10:121
81709951,3cyclictest19982-21systemd-journal19:50:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional