You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-21 - 12:45
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackaslot8.osadl.org (updated Sun Apr 21, 2024 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
304022298266,20sleep20-21swapper/219:09:382
302422292260,20sleep10-21swapper/119:07:321
300682281213,21sleep00-21swapper/019:05:340
301132258225,20sleep30-21swapper/319:06:093
8922710,3sleep012-21ksoftirqd/022:57:270
317872620,0sleep30-21swapper/322:55:503
283482620,0sleep00-21swapper/021:15:160
38802600,0sleep10-21swapper/122:35:141
45702570,0sleep10-21swapper/121:46:091
274302570,0sleep00-21swapper/022:28:520
211712570,0sleep20-21swapper/221:35:002
195982560,0sleep30-21swapper/322:22:593
91462240,0sleep30-21swapper/322:15:143
133522220,0sleep10-21swapper/100:20:131
121902200,0sleep30-21swapper/323:54:083
99762160,0sleep20-21swapper/200:17:182
61152150,1sleep30-21swapper/323:00:553
300932150,0sleep30-21swapper/321:40:463
243212150,0sleep30-21swapper/321:36:373
64132140,0sleep20-21swapper/223:01:142
30548991211,1cyclictest28-21ksoftirqd/200:00:002
299762120,0sleep10-21swapper/120:15:231
3055299119,1cyclictest34-21ksoftirqd/300:40:003
36172100,0sleep30-21swapper/321:20:233
9830290,0sleep00-21swapper/000:17:080
4665290,0sleep20-21swapper/220:30:212
305529997,1cyclictest34-21ksoftirqd/320:40:003
305529996,2cyclictest34-21ksoftirqd/321:10:003
305529990,2cyclictest4389-21ssh00:13:013
305489994,3cyclictest19982-21systemd-journal23:41:072
305459998,1cyclictest22-21ksoftirqd/119:40:001
305459997,1cyclictest2971-21ntp_states21:20:191
305459994,3cyclictest19982-21systemd-journal20:32:011
305459990,8cyclictest25774-21ssh22:27:131
305409994,3cyclictest19982-21systemd-journal22:38:320
305409992,4cyclictest1952-21basename22:10:010
24486290,1sleep324484-21ssh23:15:123
10820290,4sleep228-21ksoftirqd/223:05:142
305529986,1cyclictest22761-21latency_hist22:50:013
305529984,3cyclictest508-21dbus-daemon20:02:063
305529984,3cyclictest23664-21smart_sda22:25:233
305529983,3cyclictest19982-21systemd-journal19:52:303
305489985,2cyclictest508-21dbus-daemon21:18:012
305489985,2cyclictest28-21ksoftirqd/222:45:012
305489985,2cyclictest28-21ksoftirqd/200:00:002
305489984,2cyclictest19982-21systemd-journal00:34:562
305489983,4cyclictest0-21swapper/219:30:012
305459984,3cyclictest508-21dbus-daemon21:37:121
305459984,3cyclictest19982-21systemd-journal00:04:291
305459982,3cyclictest14516-21munin-run21:30:011
305459981,4cyclictest31798-21basename23:45:001
305459980,7cyclictest4889-21ntp_states23:00:171
305409984,3cyclictest508-21dbus-daemon00:12:240
305409984,3cyclictest19982-21systemd-journal20:22:570
305409983,3cyclictest19982-21systemd-journal20:05:500
15588280,0sleep10-21swapper/119:45:201
1501280,0sleep00-21swapper/022:33:410
305529975,1cyclictest34-21ksoftirqd/323:40:003
305529974,2cyclictest508-21dbus-daemon22:13:053
305529974,2cyclictest11736-21in:imuxsock22:05:013
305529973,3cyclictest31967-21sshd22:07:283
305529973,3cyclictest24854-21packagekitd00:30:013
305529973,3cyclictest23732-21sshd21:11:013
305529973,3cyclictest19982-21systemd-journal23:55:433
305529973,3cyclictest19982-21systemd-journal19:12:013
305529973,3cyclictest19982-21systemd-journal19:12:013
305529973,3cyclictest11378-21cat20:45:213
305529973,3cyclictest10200-21ls22:40:133
305529973,1cyclictest0-21swapper/321:58:113
305529973,1cyclictest0-21swapper/321:47:303
305529971,5cyclictest19982-21systemd-journal21:17:273
305529970,6cyclictest1352-21expr19:15:153
305529970,4cyclictest19982-21systemd-journal23:46:573
305529970,1cyclictest0-21swapper/323:41:513
305489976,1cyclictest28-21ksoftirqd/223:50:002
305489976,1cyclictest28-21ksoftirqd/223:20:012
305489974,2cyclictest9451-21grep21:25:212
305489974,2cyclictest508-21dbus-daemon21:50:592
305489974,2cyclictest508-21dbus-daemon19:15:012
305489974,2cyclictest508-21dbus-daemon19:15:012
305489974,2cyclictest28-21ksoftirqd/219:40:002
305489974,2cyclictest15462-21/usr/sbin/munin19:45:242
305489973,3cyclictest508-21dbus-daemon20:05:512
305489973,3cyclictest508-21dbus-daemon20:00:002
305489973,3cyclictest24640-21latency_hist00:30:002
305489973,3cyclictest19982-21systemd-journal21:02:352
305489973,3cyclictest19982-21systemd-journal00:10:192
305489973,3cyclictest1704-21grep20:25:142
305489973,3cyclictest15026-21cron22:20:012
305489972,3cyclictest19982-21systemd-journal21:57:012
305489972,3cyclictest19982-21systemd-journal21:11:452
305489972,3cyclictest19982-21systemd-journal20:17:322
305489970,7cyclictest0-21swapper/200:05:242
305489970,4cyclictest27900-21dump-pmu-power22:05:012
305459974,2cyclictest508-21dbus-daemon21:03:501
305459974,2cyclictest27082-21ssh21:14:401
305459973,3cyclictest6889-21awk23:25:231
305459973,3cyclictest508-21dbus-daemon20:40:001
305459973,3cyclictest508-21dbus-daemon20:04:111
305459973,3cyclictest31515-21sshd21:17:271
305459973,3cyclictest30938-21sshd00:08:151
305459973,3cyclictest19982-21systemd-journal21:32:291
305459973,2cyclictest19982-21systemd-journal23:21:301
305459973,1cyclictest0-21swapper/100:14:341
305459972,3cyclictest19982-21systemd-journal22:32:421
305459970,7cyclictest0-21swapper/123:45:311
305459970,6cyclictest20241-21cat00:00:001
305409974,2cyclictest508-21dbus-daemon19:28:430
305409974,2cyclictest508-21dbus-daemon00:39:060
305409973,3cyclictest6169-21cron23:50:000
305409973,3cyclictest19982-21systemd-journal19:55:000
305409973,3cyclictest15968-21ntpq21:30:180
305409973,3cyclictest13809-21sed00:20:180
305409973,3cyclictest13388-21snmpd19:49:090
305409973,3cyclictest13388-21snmpd00:25:470
305409973,1cyclictest0-21swapper/021:52:270
305409972,3cyclictest19982-21systemd-journal19:30:020
305409971,3cyclictest2681-21rm21:20:170
305409971,2cyclictest29376-21rm00:06:340
16641270,0sleep20-21swapper/223:33:172
305529963,2cyclictest5371-21cat23:25:143
305529963,2cyclictest34-21ksoftirqd/323:11:233
305529963,2cyclictest29709-21ls22:30:173
305529963,2cyclictest25588-21sensors_temp20:05:213
305529963,2cyclictest2080-21needreboot20:25:183
305529963,2cyclictest15555-21sh23:08:373
305529963,2cyclictest15152-21sed20:55:173
305529963,2cyclictest13388-21snmpd21:32:243
305529963,2cyclictest12879-21gltestperf20:50:133
305529963,2cyclictest11736-21in:imuxsock19:57:303
305529963,2cyclictest11736-21in:imuxsock19:24:333
305529962,3cyclictest8863-21cat19:30:183
305529962,3cyclictest7345-21cat00:15:163
305529962,3cyclictest508-21dbus-daemon22:35:123
305529962,3cyclictest19655-21cat00:25:193
305529962,3cyclictest16780-21grep19:45:293
305529962,3cyclictest13635-21cat19:40:173
305529962,3cyclictest13388-21snmpd23:30:063
305529962,3cyclictest13388-21snmpd23:21:363
305529962,3cyclictest13388-21snmpd21:04:203
305529962,3cyclictest13388-21snmpd20:10:433
305529962,3cyclictest1-21systemd20:30:023
305529962,3cyclictest0-21swapper/300:05:163
305529962,1cyclictest0-21swapper/321:50:163
305529962,1cyclictest0-21swapper/321:25:043
305529961,3cyclictest19982-21systemd-journal20:22:073
305529961,3cyclictest19982-21systemd-journal00:22:593
305529960,5cyclictest24383-21sed22:50:223
305529960,4cyclictest19982-21systemd-journal19:38:443
305529960,4cyclictest19982-21systemd-journal00:00:183
305489963,2cyclictest5372-21chrt19:24:552
305489963,2cyclictest3546-21tail21:20:232
305489963,2cyclictest31166-21ls00:35:122
305489963,2cyclictest29075-21ntpq21:40:212
305489963,2cyclictest18298-21hddtemp_smartct19:50:162
305489963,2cyclictest17296-21sh23:10:082
305489963,2cyclictest14087-21gunzip19:40:212
305489963,2cyclictest11985-21taskset20:48:562
305489963,2cyclictest11736-21in:imuxsock20:37:202
305489963,1cyclictest0-21swapper/223:50:042
305489962,3cyclictest8529-21cat19:30:152
305489962,3cyclictest29368-21ntpq22:05:202
305489962,3cyclictest23715-21cat22:50:172
305489962,3cyclictest16969-21lldpd21:45:372
305489962,3cyclictest13388-21snmpd23:35:012
305489962,3cyclictest13388-21snmpd22:58:092
305489962,3cyclictest13388-21snmpd22:48:062
305489962,3cyclictest13388-21snmpd20:41:202
305489962,3cyclictest13388-21snmpd20:14:222
305489962,3cyclictest0-21swapper/222:30:142
305489962,1cyclictest0-21swapper/223:25:582
305489962,1cyclictest0-21swapper/223:20:362
305489962,1cyclictest0-21swapper/222:25:222
305489962,1cyclictest0-21swapper/221:35:492
305489961,3cyclictest19982-21systemd-journal22:11:012
305489961,3cyclictest19982-21systemd-journal20:57:242
305489961,2cyclictest18258-21ssh22:21:332
305489960,6cyclictest0-21swapper/222:35:182
305489960,6cyclictest0-21swapper/220:00:222
305489960,1cyclictest1159-21/usr/sbin/munin19:15:212
305489960,0cyclictest0-21swapper/200:21:242
305459966,0cyclictest0-21swapper/123:19:461
305459964,1cyclictest11736-21in:imuxsock22:50:131
305459963,2cyclictest8237-21cat20:40:111
305459963,2cyclictest668-21runrttasks21:40:351
305459963,2cyclictest25026-21/usr/sbin/munin00:30:161
305459963,2cyclictest21884-21ssh00:27:101
305459963,2cyclictest20934-21cut19:55:181
305459963,2cyclictest17269-21sh23:10:061
305459963,2cyclictest15208-21if_enp4s020:55:181
305459963,2cyclictest13388-21snmpd22:57:451
305459963,2cyclictest13388-21snmpd21:55:581
305459963,2cyclictest13388-21snmpd19:23:211
305459963,2cyclictest1-21systemd22:15:221
305459963,1cyclictest0-21swapper/123:52:551
305459962,3cyclictest8886-21cat21:50:141
305459962,3cyclictest2590-21expr22:10:111
305459962,3cyclictest2210-21sed19:15:211
305459962,3cyclictest19982-21systemd-journal20:08:211
305459962,3cyclictest19699-21cat21:05:151
305459962,3cyclictest13631-21cat19:40:171
305459962,3cyclictest13388-21snmpd22:05:501
305459962,3cyclictest13388-21snmpd20:22:101
305459962,3cyclictest13388-21snmpd20:13:311
305459962,3cyclictest13388-21snmpd19:50:451
305459962,1cyclictest0-21swapper/123:36:171
305459962,1cyclictest0-21swapper/123:05:421
305459962,1cyclictest0-21swapper/122:45:551
305459962,1cyclictest0-21swapper/122:40:101
305459962,1cyclictest0-21swapper/122:00:031
305459962,1cyclictest0-21swapper/100:15:271
305459961,3cyclictest19982-21systemd-journal22:21:261
305459961,3cyclictest19982-21systemd-journal20:26:421
305459961,3cyclictest16969-21lldpd20:46:381
305459960,0cyclictest0-21swapper/123:32:031
305459960,0cyclictest0-21swapper/100:35:041
305409963,2cyclictest29741-11brltty00:31:360
305409963,2cyclictest26287-21sh22:52:040
305409963,2cyclictest24202-21rm21:11:320
305409963,2cyclictest22559-21sh23:37:250
305409963,2cyclictest20579-21cat19:55:140
305409963,2cyclictest19302-21sshd22:22:400
305409963,2cyclictest1880-21uname19:15:180
305409963,2cyclictest14812-21sh23:31:280
305409963,2cyclictest13388-21snmpd23:50:400
305409963,2cyclictest11736-21in:imuxsock19:42:540
305409963,2cyclictest11736-21in:imuxsock00:00:000
305409963,2cyclictest0-21swapper/023:40:160
305409962,3cyclictest6211-21sed20:35:140
305409962,3cyclictest4089-21cat19:20:160
305409962,3cyclictest20760-21sshd21:07:240
305409962,3cyclictest16969-21lldpd19:14:340
305409962,3cyclictest16969-21lldpd19:14:340
305409962,3cyclictest15533-21expr21:55:110
305409962,3cyclictest13388-21snmpd23:00:060
305409962,3cyclictest13388-21snmpd22:12:500
305409962,3cyclictest13388-21snmpd21:46:520
305409962,3cyclictest13388-21snmpd21:35:120
305409962,3cyclictest13388-21snmpd21:28:120
305409962,3cyclictest13388-21snmpd20:51:590
305409962,3cyclictest13388-21snmpd20:30:430
305409962,3cyclictest13388-21snmpd20:15:040
305409962,3cyclictest13388-21snmpd20:11:310
305409962,3cyclictest11660-21sed20:45:220
305409962,3cyclictest11051-21cat19:35:140
305409962,3cyclictest10381-21tune2fs22:40:140
305409962,3cyclictest0-21swapper/023:55:240
305409962,3cyclictest0-21swapper/023:25:530
305409962,3cyclictest0-21swapper/023:23:300
305409962,3cyclictest0-21swapper/023:15:400
305409962,3cyclictest0-21swapper/022:45:330
305409961,2cyclictest9481-21rm22:15:160
305409960,6cyclictest0-21swapper/020:27:010
305409960,3cyclictest28828-21rm21:40:190
305409960,3cyclictest21831-21rm22:00:130
305409960,3cyclictest17273-21rm23:10:060
305409960,3cyclictest10492-21rm23:05:080
305529952,2cyclictest6314-21cat19:25:153
305529952,2cyclictest29705-21needreboot20:15:193
305529952,2cyclictest16969-21lldpd20:40:083
305489952,2cyclictest19224-21seq21:05:132
305489952,2cyclictest12986-21if_enp4s020:50:142
305489951,1cyclictest31356-21apt-get20:20:022
305459952,2cyclictest5879-21expr19:25:121
305459952,2cyclictest12861-21gltestperf20:50:131
305459951,3cyclictest30851-21cat19:10:111
305459951,3cyclictest30851-21cat19:10:111
305459950,3cyclictest19982-21systemd-journal19:30:231
305409952,2cyclictest8763-21uname20:40:160
305409952,2cyclictest13388-21snmpd20:55:010
305409951,2cyclictest19982-21systemd-journal20:00:000
305409950,3cyclictest19982-21systemd-journal21:00:040
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional