You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-20 - 11:50
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackaslot8.osadl.org (updated Sat Apr 20, 2024 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
40572263231,20sleep00-21swapper/019:09:350
37962262228,21sleep20-21swapper/219:06:272
38362261229,20sleep10-21swapper/119:06:431
38552257230,16sleep30-21swapper/319:06:563
75812670,0sleep10-21swapper/123:19:531
183372650,0sleep10-21swapper/121:26:521
7972620,0sleep10-21swapper/120:10:171
266642590,0sleep30-21swapper/321:32:483
53862580,0sleep30-21swapper/320:20:213
79872560,0sleep20-21swapper/221:20:142
132492550,0sleep10-21swapper/121:23:441
12442550,0sleep30-21swapper/300:28:193
204932190,0sleep1211rcuc/123:05:171
163322170,0sleep00-21swapper/021:49:280
155422170,0sleep20-21swapper/222:12:552
289622150,2chrt141rcu_preempt23:11:011
420699100,2cyclictest6387-21munin-run19:15:022
42109997,1cyclictest26525-21awk22:20:213
42109994,3cyclictest19982-21systemd-journal22:00:353
42019995,3cyclictest508-21dbus-daemon19:26:391
42019994,3cyclictest19982-21systemd-journal22:25:121
41979995,3cyclictest19982-21systemd-journal21:22:370
41979995,3cyclictest12-21ksoftirqd/023:55:010
42109983,3cyclictest19982-21systemd-journal20:18:233
42109983,3cyclictest19982-21systemd-journal19:52:563
42069984,3cyclictest19982-21systemd-journal00:10:002
42069983,3cyclictest19982-21systemd-journal20:16:462
42069981,4cyclictest30196-21munin-run22:00:002
42069980,5cyclictest508-21dbus-daemon19:40:012
42019983,3cyclictest19982-21systemd-journal00:27:501
41979986,1cyclictest25126-21users00:20:200
41979985,2cyclictest12-21ksoftirqd/022:45:010
41979984,3cyclictest508-21dbus-daemon19:24:590
41979984,3cyclictest508-21dbus-daemon00:37:270
41979984,3cyclictest11736-21in:imuxsock23:17:460
41979983,4cyclictest12-21ksoftirqd/022:45:150
41979983,3cyclictest19982-21systemd-journal20:53:510
41979983,3cyclictest19982-21systemd-journal20:29:380
41979983,2cyclictest21684-21sleep21:00:000
27204280,1sleep00-21swapper/022:21:060
22496280,0sleep20-21swapper/222:42:262
42109974,2cyclictest29741-11brltty21:09:163
42109974,2cyclictest11736-21in:imuxsock20:50:003
42109973,3cyclictest5313-21df22:05:113
42109973,3cyclictest508-21dbus-daemon23:58:143
42109973,3cyclictest508-21dbus-daemon20:36:433
42109973,3cyclictest508-21dbus-daemon00:12:253
42109973,3cyclictest19982-21systemd-journal22:42:143
42109973,3cyclictest19982-21systemd-journal00:33:353
42109973,3cyclictest0-21swapper/321:57:593
42109973,3cyclictest0-21swapper/321:22:493
42109973,2cyclictest19982-21systemd-journal20:41:523
42109973,1cyclictest0-21swapper/323:41:143
42109973,1cyclictest0-21swapper/323:04:453
42109973,1cyclictest0-21swapper/322:37:233
42109972,4cyclictest13388-21snmpd00:15:513
42109972,2cyclictest3191-21ssh22:52:213
42109971,4cyclictest19982-21systemd-journal22:55:403
42069974,2cyclictest12767-21cron20:40:002
42069974,2cyclictest11736-21in:imuxsock23:24:282
42069973,3cyclictest508-21dbus-daemon20:05:272
42069973,3cyclictest19982-21systemd-journal00:22:522
42069973,1cyclictest0-21swapper/221:52:432
42069972,3cyclictest19982-21systemd-journal22:03:562
42069971,3cyclictest29610-21basename20:05:012
42019975,1cyclictest0-21swapper/121:55:011
42019974,2cyclictest11736-21in:imuxsock23:35:011
42019973,3cyclictest508-21dbus-daemon22:41:541
42019973,3cyclictest508-21dbus-daemon21:15:001
42019973,3cyclictest18303-21ntpq21:50:151
42019973,3cyclictest16969-21lldpd23:24:321
42019973,3cyclictest13388-21snmpd20:15:321
42019973,3cyclictest13388-21snmpd19:16:491
42019973,1cyclictest0-21swapper/123:01:051
42019973,1cyclictest0-21swapper/122:55:431
42019973,1cyclictest0-21swapper/122:53:121
42019973,1cyclictest0-21swapper/122:47:071
42019972,1cyclictest0-21swapper/122:00:021
42019971,2cyclictest16969-21lldpd00:21:321
42019970,3cyclictest29741-11brltty22:21:521
41979976,1cyclictest12-21ksoftirqd/000:00:010
41979974,2cyclictest13388-21snmpd00:34:120
41979974,2cyclictest11466-21cpuspeed22:10:110
41979973,3cyclictest508-21dbus-daemon21:16:460
41979973,3cyclictest508-21dbus-daemon20:08:470
41979973,3cyclictest508-21dbus-daemon19:17:280
41979973,3cyclictest30581-21cat23:35:230
41979973,3cyclictest29741-11brltty21:32:370
41979973,3cyclictest20283-21sshd19:43:530
41979973,3cyclictest19982-21systemd-journal21:44:440
41979973,3cyclictest19982-21systemd-journal21:36:230
41979973,3cyclictest0-21swapper/023:34:390
41979973,3cyclictest0-21swapper/022:00:300
41979973,1cyclictest0-21swapper/022:56:170
41979973,1cyclictest0-21swapper/021:58:550
41979971,3cyclictest29599-21munin-run20:05:000
26275270,0sleep10-21swapper/121:32:251
42109966,0cyclictest0-21swapper/322:30:283
42109963,2cyclictest508-21dbus-daemon21:42:393
42109963,2cyclictest502-21systemd-logind21:50:353
42109963,2cyclictest22477-21head21:00:133
42109963,2cyclictest21689-21idleruntime-cro21:00:003
42109963,2cyclictest18663-21cat19:40:173
42109963,2cyclictest17501-21ssh23:25:573
42109963,2cyclictest17109-21ntp_kernel_err19:35:203
42109963,2cyclictest14912-21ssh21:25:063
42109963,2cyclictest14297-21ssh23:47:273
42109963,2cyclictest12617-21ssh21:45:353
42109963,2cyclictest10278-21sh23:20:443
42109962,3cyclictest9888-21df19:20:113
42109962,3cyclictest7936-21if_err_enp4s019:15:173
42109962,3cyclictest5090-21cat19:10:183
42109962,3cyclictest508-21dbus-daemon20:00:193
42109962,3cyclictest508-21dbus-daemon00:05:203
42109962,3cyclictest31318-40logrotate00:00:003
42109962,3cyclictest28047-21grep23:10:183
42109962,3cyclictest18657-21basename22:15:183
42109962,3cyclictest13388-21snmpd23:35:183
42109962,3cyclictest13388-21snmpd21:37:283
42109962,3cyclictest13388-21snmpd20:51:333
42109962,3cyclictest13388-21snmpd19:55:403
42109962,3cyclictest13388-21snmpd19:31:433
42109962,3cyclictest13342-21seq19:25:523
42109962,3cyclictest11761-21expr22:10:123
42109962,3cyclictest0-21swapper/323:30:103
42109962,3cyclictest0-21swapper/321:10:223
42109962,1cyclictest0-21swapper/323:51:343
42109962,1cyclictest0-21swapper/323:15:233
42109962,1cyclictest0-21swapper/322:25:053
42109961,4cyclictest0-21swapper/323:05:163
42109961,3cyclictest19982-21systemd-journal19:48:453
42109961,3cyclictest19982-21systemd-journal00:24:313
42109961,2cyclictest27342-21ssh22:45:363
42109960,6cyclictest0-21swapper/321:15:013
42109960,2cyclictest601-21ntp_states20:10:163
42069964,1cyclictest19982-21systemd-journal20:00:012
42069963,2cyclictest668-21runrttasks21:05:142
42069963,2cyclictest668-21runrttasks20:46:592
42069963,2cyclictest6271-21ssh21:40:472
42069963,2cyclictest25592-21ssh21:31:472
42069963,2cyclictest13388-21snmpd19:40:102
42069963,2cyclictest11802-21cat19:25:122
42069963,2cyclictest11736-21in:imuxsock20:41:442
42069963,2cyclictest11630-21rm22:59:232
42069963,1cyclictest0-21swapper/223:00:392
42069962,3cyclictest8799-21expr20:30:112
42069962,3cyclictest508-21dbus-daemon19:50:502
42069962,3cyclictest32511-21cat00:00:142
42069962,3cyclictest30069-21smartctl21:35:122
42069962,3cyclictest27994-21cat23:10:192
42069962,3cyclictest26109-21cat22:45:172
42069962,3cyclictest21297-21seq20:55:362
42069962,3cyclictest19982-21systemd-journal21:15:572
42069962,3cyclictest18115-21cat23:50:132
42069962,3cyclictest16172-21netstat23:25:182
42069962,3cyclictest14920-21ntp_states19:30:222
42069962,3cyclictest13388-21snmpd23:46:052
42069962,3cyclictest13388-21snmpd23:31:342
42069962,3cyclictest13388-21snmpd22:33:102
42069962,3cyclictest13388-21snmpd22:25:102
42069962,3cyclictest13388-21snmpd21:45:052
42069962,3cyclictest13388-21snmpd19:46:492
42069962,3cyclictest13388-21snmpd19:23:552
42069962,3cyclictest13388-21snmpd00:25:552
42069962,3cyclictest13388-21snmpd00:17:272
42069962,3cyclictest13388-21snmpd00:11:472
42069962,3cyclictest12769-21cat22:35:122
42069962,3cyclictest0-21swapper/223:17:122
42069962,3cyclictest0-21swapper/222:15:252
42069962,3cyclictest0-21swapper/222:08:462
42069962,3cyclictest0-21swapper/221:12:432
42069962,1cyclictest0-21swapper/223:37:542
42069962,1cyclictest0-21swapper/222:23:062
42069961,3cyclictest19982-21systemd-journal23:55:512
42069961,3cyclictest19982-21systemd-journal20:27:582
42069961,3cyclictest19982-21systemd-journal20:20:022
42069960,6cyclictest0-21swapper/223:40:092
42069960,6cyclictest0-21swapper/223:05:312
42069960,3cyclictest1068-21grep22:50:202
42069960,0cyclictest0-21swapper/200:35:372
42019966,0cyclictest0-21swapper/120:50:231
42019963,2cyclictest7107-21ssh22:30:201
42019963,2cyclictest508-21dbus-daemon21:01:211
42019963,2cyclictest31402-21sed20:05:271
42019963,2cyclictest25757-21awk23:55:141
42019963,2cyclictest15938-21basename19:35:011
42019963,2cyclictest13390-21sh22:10:411
42019963,2cyclictest13388-21snmpd20:57:071
42019963,1cyclictest0-21swapper/122:35:311
42019962,3cyclictest9394-21cat00:35:121
42019962,3cyclictest508-21dbus-daemon19:35:491
42019962,3cyclictest3911-21cat00:30:131
42019962,3cyclictest29741-11brltty00:02:511
42019962,3cyclictest24553-21df_inode21:05:151
42019962,3cyclictest19982-21systemd-journal20:30:531
42019962,3cyclictest19982-21systemd-journal20:02:061
42019962,3cyclictest19982-21systemd-journal00:05:011
42019962,3cyclictest18619-21expr19:40:181
42019962,3cyclictest18582-21ntpq00:15:201
42019962,3cyclictest16969-21lldpd23:26:181
42019962,3cyclictest1563-21cat21:15:131
42019962,3cyclictest13388-21snmpd21:35:151
42019962,3cyclictest13388-21snmpd20:40:181
42019962,3cyclictest13388-21snmpd20:26:171
42019962,3cyclictest13388-21snmpd20:20:561
42019962,3cyclictest13388-21snmpd19:52:291
42019962,3cyclictest13388-21snmpd19:13:011
42019962,3cyclictest13388-21snmpd00:10:091
42019962,3cyclictest11736-21in:imuxsock20:46:441
42019962,1cyclictest0-21swapper/123:46:421
42019962,1cyclictest0-21swapper/123:36:011
42019962,1cyclictest0-21swapper/122:16:351
42019962,1cyclictest0-21swapper/122:09:461
42019962,1cyclictest0-21swapper/121:40:131
42019960,6cyclictest0-21swapper/123:51:531
42019960,6cyclictest0-21swapper/119:55:321
42019960,5cyclictest13388-21snmpd20:37:301
42019960,2cyclictest16969-21lldpd23:41:321
41979966,0cyclictest0-21swapper/022:16:120
41979963,2cyclictest8007-21ssh23:20:030
41979963,2cyclictest7016-21rm00:05:190
41979963,2cyclictest26967-21cut23:10:110
41979963,2cyclictest2445-21sshd22:27:100
41979963,2cyclictest23581-21tr19:50:230
41979963,2cyclictest2306-21fschecks_count20:15:120
41979963,2cyclictest16847-21cat19:35:180
41979963,2cyclictest16003-21sh23:01:580
41979963,2cyclictest1580-21sh00:00:580
41979963,2cyclictest14938-21sh21:25:070
41979963,2cyclictest1454-21chrt20:13:040
41979963,2cyclictest13311-21taskset19:25:260
41979963,2cyclictest0-21swapper/023:40:060
41979962,3cyclictest5628-21cat22:05:140
41979962,3cyclictest5398-21open_inodes19:10:210
41979962,3cyclictest29727-21seq00:25:100
41979962,3cyclictest24541-21expr21:05:140
41979962,3cyclictest15859-21cat23:25:150
41979962,3cyclictest13394-21expr20:40:120
41979962,3cyclictest13388-21snmpd23:05:340
41979962,3cyclictest13388-21snmpd22:51:430
41979962,3cyclictest13388-21snmpd22:30:060
41979962,3cyclictest13388-21snmpd21:50:210
41979962,3cyclictest13388-21snmpd21:10:270
41979962,3cyclictest13388-21snmpd20:48:490
41979962,3cyclictest13388-21snmpd19:30:110
41979962,3cyclictest12577-21cut22:35:120
41979962,3cyclictest1-21systemd23:46:090
41979962,3cyclictest12018-21smart_sda20:35:200
41979962,1cyclictest0-21swapper/000:15:140
41979960,3cyclictest13086-21rm00:10:210
19759260,0sleep20-21swapper/221:28:132
18243260,0sleep20-21swapper/220:50:182
42109953,1cyclictest6365-21apt-get20:25:163
42109952,2cyclictest13388-21snmpd20:30:083
42109951,3cyclictest0-21swapper/300:35:053
42109951,2cyclictest19982-21systemd-journal20:05:023
42069952,2cyclictest8148-21grep19:15:182
42069952,2cyclictest502-21systemd-logind20:10:032
42069951,3cyclictest22829-21tail21:00:152
42069951,3cyclictest0-21swapper/200:30:032
42019952,2cyclictest9544-21cpu19:20:091
42019952,2cyclictest10735-21cat21:45:131
42019951,3cyclictest13388-21snmpd19:45:051
41979952,2cyclictest25645-21expr19:55:220
41979952,2cyclictest13388-21snmpd19:45:190
41979951,3cyclictest13388-21snmpd20:30:030
41979951,3cyclictest13388-21snmpd20:20:140
41979950,3cyclictest19982-21systemd-journal21:00:050
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional