You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 16:02
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackaslot8.osadl.org (updated Sat Apr 27, 2024 00:44:24)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25132320288,20sleep20-21swapper/219:08:562
24222282215,22sleep00-21swapper/019:07:460
25952273240,20sleep30-21swapper/319:09:593
23012261227,22sleep10-21swapper/119:06:261
268502680,0sleep30-21swapper/321:52:103
118502640,0sleep20-21swapper/221:42:442
323492630,0sleep20-21swapper/222:57:452
211772630,0sleep30-21swapper/323:52:433
135712590,0sleep30-21swapper/300:10:013
255942570,0sleep00-21swapper/021:10:140
203762560,0sleep10-21swapper/123:10:251
136512550,0sleep30-21swapper/323:27:003
262522540,0sleep20-21swapper/221:30:502
107442410,0sleep20-21swapper/223:45:452
70882180,0sleep00-21swapper/021:19:190
111552180,0sleep00-21swapper/022:23:400
94992140,0sleep30-21swapper/319:20:223
87372140,0sleep00-21swapper/021:40:220
85082140,0sleep10-21swapper/122:42:231
97082130,0sleep00-21swapper/022:01:480
44812130,0sleep00-21swapper/000:27:200
123542130,0sleep30-21swapper/320:40:143
2698991210,1cyclictest12-21ksoftirqd/000:00:000
76772110,0sleep10-21swapper/100:05:141
269899114,4cyclictest10410-21munin-run23:05:000
271299108,1cyclictest34-21ksoftirqd/322:25:013
271299105,3cyclictest19982-21systemd-journal22:52:353
270799108,1cyclictest28-21ksoftirqd/222:00:022
4117290,0sleep00-21swapper/019:10:220
27129998,1cyclictest34-21ksoftirqd/322:00:013
27129994,3cyclictest19982-21systemd-journal00:37:443
27039994,3cyclictest19982-21systemd-journal19:11:281
18906290,0sleep10-21swapper/121:26:131
27129984,3cyclictest508-21dbus-daemon23:36:233
27129984,3cyclictest21464-21ntpq21:00:173
27129984,3cyclictest19982-21systemd-journal20:17:483
27129983,3cyclictest19982-21systemd-journal19:46:453
27079987,1cyclictest28-21ksoftirqd/200:10:002
27079985,2cyclictest508-21dbus-daemon19:46:322
27079984,3cyclictest19982-21systemd-journal22:12:072
27079984,3cyclictest19982-21systemd-journal21:19:332
27079982,3cyclictest11745-21munin-run22:45:002
27039984,3cyclictest19982-21systemd-journal21:11:371
26989985,2cyclictest12-21ksoftirqd/020:15:020
26989983,3cyclictest19982-21systemd-journal20:19:290
26989983,3cyclictest19982-21systemd-journal00:05:500
26989980,7cyclictest14818-21ssh21:24:180
22876280,1sleep022882-21cpuspeed_turbos21:05:130
22856280,0sleep00-21swapper/022:10:170
9228270,0sleep20-21swapper/219:20:212
29407270,0sleep20-21swapper/220:05:212
28444270,0sleep10-21swapper/121:53:281
27129975,1cyclictest6796-21cron00:29:593
27129975,1cyclictest23431-21ssh21:29:593
27129974,1cyclictest19982-21systemd-journal20:45:203
27129973,3cyclictest19982-21systemd-journal23:21:483
27129973,3cyclictest19982-21systemd-journal20:22:023
27129973,3cyclictest19982-21systemd-journal00:33:513
27129973,3cyclictest13388-21snmpd23:00:063
27129973,3cyclictest13388-21snmpd19:38:173
27129973,3cyclictest0-21swapper/321:16:383
27129973,1cyclictest0-21swapper/322:43:583
27129973,1cyclictest0-21swapper/322:01:423
27129973,1cyclictest0-21swapper/300:00:333
27129972,3cyclictest19982-21systemd-journal23:15:583
27129971,4cyclictest19982-21systemd-journal19:30:153
27079974,2cyclictest502-21systemd-logind21:50:522
27079974,2cyclictest19982-21systemd-journal23:53:042
27079974,2cyclictest19982-21systemd-journal22:10:012
27079974,2cyclictest19982-21systemd-journal22:10:012
27079973,3cyclictest508-21dbus-daemon20:35:012
27079973,3cyclictest508-21dbus-daemon19:40:012
27079973,3cyclictest31058-21smart_sda22:15:202
27079973,3cyclictest19982-21systemd-journal22:51:462
27079973,3cyclictest19982-21systemd-journal20:39:052
27079973,3cyclictest0-21swapper/223:04:402
27079972,3cyclictest19982-21systemd-journal00:18:242
27079971,3cyclictest30270-21rm00:21:582
27079971,3cyclictest25580-21munin-run20:00:012
27079970,7cyclictest29741-11brltty23:33:282
27079970,7cyclictest0-21swapper/222:34:102
27079970,2cyclictest18126-21ls23:10:002
27039974,2cyclictest668-21runrttasks22:34:381
27039973,3cyclictest19982-21systemd-journal21:40:021
27039973,3cyclictest19982-21systemd-journal21:07:021
27039973,3cyclictest19982-21systemd-journal20:35:511
27039973,3cyclictest13388-21snmpd21:33:221
27039973,3cyclictest0-21swapper/121:56:131
27039973,2cyclictest19982-21systemd-journal00:00:011
27039973,1cyclictest0-21swapper/121:49:401
27039973,1cyclictest0-21swapper/121:44:061
27039973,1cyclictest0-21swapper/100:17:011
27039972,3cyclictest19982-21systemd-journal22:00:021
27039972,3cyclictest16969-21lldpd00:00:061
27039970,3cyclictest14444-21idleruntime-cro19:35:011
26989974,2cyclictest508-21dbus-daemon19:41:050
26989974,2cyclictest508-21dbus-daemon00:00:350
26989974,2cyclictest19982-21systemd-journal19:54:510
26989973,3cyclictest16435-21df20:50:120
26989973,1cyclictest0-21swapper/023:20:330
26989973,1cyclictest0-21swapper/022:42:010
26989973,1cyclictest0-21swapper/021:36:160
26989973,1cyclictest0-21swapper/000:10:350
26989971,4cyclictest19982-21systemd-journal22:06:420
26989971,4cyclictest19982-21systemd-journal22:06:420
26989971,3cyclictest26702-21munin-run00:20:000
26989970,5cyclictest5744-21perf22:00:010
2181270,0sleep00-21swapper/022:17:580
27129965,1cyclictest26565-21kworker/3:023:55:233
27129963,2cyclictest8318-21sh23:45:033
27129963,2cyclictest668-21runrttasks22:09:453
27129963,2cyclictest668-21runrttasks22:09:453
27129963,2cyclictest668-21runrttasks21:20:533
27129963,2cyclictest668-21runrttasks19:54:163
27129963,2cyclictest508-21dbus-daemon22:30:543
27129963,2cyclictest508-21dbus-daemon20:35:223
27129963,2cyclictest18112-21grep23:30:123
27129963,2cyclictest13714-21timerwakeupswit22:45:213
27129963,2cyclictest11736-21in:imuxsock21:38:453
27129963,2cyclictest11606-21irqstats23:05:153
27129962,3cyclictest7779-21cat20:30:153
27129962,3cyclictest34-21ksoftirqd/319:29:503
27129962,3cyclictest30969-21cat20:10:133
27129962,3cyclictest26273-21fschecks_count20:00:133
27129962,3cyclictest24220-21expr21:30:113
27129962,3cyclictest19982-21systemd-journal20:55:013
27129962,3cyclictest13388-21snmpd22:25:073
27129962,3cyclictest13388-21snmpd22:12:553
27129962,3cyclictest13388-21snmpd21:11:383
27129962,3cyclictest13388-21snmpd20:58:383
27129962,3cyclictest13388-21snmpd20:28:063
27129962,3cyclictest13388-21snmpd20:05:503
27129962,3cyclictest13388-21snmpd19:10:193
27129962,3cyclictest13388-21snmpd00:07:393
27129962,3cyclictest0-21swapper/321:40:573
27129962,1cyclictest0-21swapper/322:15:043
27129962,1cyclictest0-21swapper/321:45:243
27129962,1cyclictest0-21swapper/300:20:533
27129961,3cyclictest19982-21systemd-journal22:35:293
27129961,3cyclictest19982-21systemd-journal21:09:333
27129961,3cyclictest19982-21systemd-journal19:16:543
27129960,6cyclictest0-21swapper/300:18:533
27129960,5cyclictest18575-21/usr/sbin/munin23:10:173
27079963,2cyclictest8861-21sh22:21:452
27079963,2cyclictest508-21dbus-daemon23:20:072
27079963,2cyclictest21380-21apt-get19:50:092
27079963,2cyclictest15586-21rm00:35:552
27079963,2cyclictest11736-21in:imuxsock21:26:382
27079963,2cyclictest0-21swapper/200:10:172
27079963,1cyclictest0-21swapper/223:25:292
27079962,3cyclictest7317-21awk19:15:222
27079962,3cyclictest6407-21cat22:00:132
27079962,3cyclictest4844-21seq20:25:092
27079962,3cyclictest357-21ntpq21:35:182
27079962,3cyclictest29828-21cat22:35:182
27079962,3cyclictest25578-21expr21:10:142
27079962,3cyclictest21203-21cat21:00:132
27079962,3cyclictest19982-21systemd-journal20:01:072
27079962,3cyclictest1739-21cat00:25:192
27079962,3cyclictest14518-21sshd22:45:512
27079962,3cyclictest13388-21snmpd23:55:302
27079962,3cyclictest13388-21snmpd23:40:062
27079962,3cyclictest13388-21snmpd20:53:262
27079962,3cyclictest13388-21snmpd19:27:132
27079962,3cyclictest13388-21snmpd19:12:582
27079962,3cyclictest13388-21snmpd00:32:012
27079962,3cyclictest12292-21cat20:40:142
27079962,3cyclictest0-21swapper/223:35:272
27079962,2cyclictest16969-21lldpd19:33:282
27079962,1cyclictest0-21swapper/221:46:322
27079961,3cyclictest19982-21systemd-journal23:12:132
27079961,3cyclictest19982-21systemd-journal20:12:482
27079960,4cyclictest19982-21systemd-journal20:45:212
27079960,4cyclictest19982-21systemd-journal00:01:002
27079960,3cyclictest30835-21rm23:17:192
27079960,3cyclictest14352-21ntp_states22:25:182
27079960,3cyclictest11967-21rm21:21:532
27039964,1cyclictest11446-21smart_sda19:25:231
27039963,3cyclictest26770-21kworker/1:121:20:071
27039963,3cyclictest13144-21kworker/1:223:25:591
27039963,2cyclictest987-21cpu00:25:121
27039963,2cyclictest508-21dbus-daemon00:20:361
27039963,2cyclictest30950-21cat20:10:131
27039963,2cyclictest29100-21tr20:05:191
27039963,2cyclictest27509-21chrt20:01:321
27039963,2cyclictest19982-21systemd-journal22:35:551
27039963,2cyclictest17499-21taskset23:50:191
27039963,2cyclictest1608-21sshd22:17:301
27039963,2cyclictest1-21systemd23:43:541
27039963,2cyclictest10904-21sh23:45:531
27039963,1cyclictest0-21swapper/122:46:081
27039962,3cyclictest6156-21cat22:20:151
27039962,3cyclictest5300-21tune2fs20:25:131
27039962,3cyclictest508-21dbus-daemon20:00:011
27039962,3cyclictest2958-21expr20:20:111
27039962,3cyclictest28266-21tune2fs22:55:151
27039962,3cyclictest20243-21sh21:00:001
27039962,3cyclictest19048-21grep19:45:011
27039962,3cyclictest16734-21cat20:50:141
27039962,3cyclictest14013-21cat22:25:151
27039962,3cyclictest13388-21snmpd23:36:181
27039962,3cyclictest13388-21snmpd23:30:381
27039962,3cyclictest13388-21snmpd23:20:231
27039962,3cyclictest13388-21snmpd22:13:241
27039962,3cyclictest13388-21snmpd21:15:131
27039962,3cyclictest13388-21snmpd20:18:511
27039962,3cyclictest13388-21snmpd19:50:381
27039962,3cyclictest11856-21expr20:40:111
27039962,1cyclictest0-21swapper/123:15:211
27039962,1cyclictest0-21swapper/123:00:061
27039962,1cyclictest0-21swapper/122:50:111
27039962,1cyclictest0-21swapper/122:07:381
27039962,1cyclictest0-21swapper/122:07:381
27039961,4cyclictest11736-21in:imuxsock00:11:261
27039961,4cyclictest0-21swapper/100:30:521
27039961,3cyclictest19982-21systemd-journal19:23:351
27039960,6cyclictest0-21swapper/123:05:311
27039960,4cyclictest19982-21systemd-journal20:30:451
26989966,0cyclictest0-21swapper/023:35:400
26989963,2cyclictest668-21runrttasks20:20:260
26989963,2cyclictest668-21runrttasks19:55:010
26989963,2cyclictest502-21systemd-logind23:45:350
26989963,2cyclictest29873-21rm22:55:410
26989963,2cyclictest29741-11brltty20:44:050
26989963,2cyclictest19642-21cat20:55:210
26989963,2cyclictest16753-21sh22:26:480
26989963,2cyclictest14840-21sh23:27:590
26989963,2cyclictest13388-21snmpd23:41:370
26989963,2cyclictest13314-21ssh00:35:050
26989963,1cyclictest0-21swapper/023:30:300
26989962,3cyclictest9755-21df20:35:130
26989962,3cyclictest8311-21cat19:20:110
26989962,3cyclictest508-21dbus-daemon20:01:320
26989962,3cyclictest23382-21fschecks_count21:50:160
26989962,3cyclictest20428-21df22:50:130
26989962,3cyclictest19982-21systemd-journal23:10:000
26989962,3cyclictest13388-21snmpd23:50:120
26989962,3cyclictest13388-21snmpd21:32:050
26989962,3cyclictest13388-21snmpd21:26:020
26989962,3cyclictest13388-21snmpd21:01:010
26989962,3cyclictest13388-21snmpd20:47:240
26989962,3cyclictest13388-21snmpd20:30:360
26989962,3cyclictest13388-21snmpd19:48:590
26989962,3cyclictest13388-21snmpd19:30:140
26989962,3cyclictest13388-21snmpd19:28:310
26989962,3cyclictest13388-21snmpd19:15:380
26989962,3cyclictest0-21swapper/022:45:100
26989962,1cyclictest0-21swapper/022:36:130
26989962,1cyclictest0-21swapper/000:20:230
26989961,4cyclictest7850-21ls00:30:130
26989961,4cyclictest0-21swapper/023:15:200
26989961,3cyclictest19982-21systemd-journal23:06:460
26989961,3cyclictest19982-21systemd-journal19:35:150
26989960,5cyclictest24819-21rm22:31:590
26989960,3cyclictest15201-21ssh21:45:130
27129952,2cyclictest27566-21ssh22:55:023
27129952,2cyclictest17047-21wc19:40:133
27129952,2cyclictest13388-21snmpd23:40:093
27129951,3cyclictest24073-21tune2fs19:55:163
27079952,2cyclictest506-21expr20:15:102
27079952,2cyclictest22754-21cpu21:05:132
27079951,3cyclictest18664-21df20:55:122
27079951,3cyclictest17125-21cat19:40:152
27079950,3cyclictest19982-21systemd-journal20:20:062
27039952,2cyclictest5297-21idleruntime19:15:011
27039952,2cyclictest19473-21cat19:45:111
27039952,2cyclictest14675-21acpi19:35:091
27039952,2cyclictest13942-21cat20:45:131
27039952,2cyclictest13386-21acpi00:35:101
27039952,2cyclictest0-21swapper/121:00:121
26989952,2cyclictest5125-21expr20:25:130
26989952,2cyclictest28613-21head20:05:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional