You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-22 - 06:39
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack2slot0.osadl.org (updated Fri Sep 22, 2023 00:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
316822980,0sleep30-21swapper/322:06:163
132292830,0sleep313230-21sshd22:42:013
243532550,0sleep30-21swapper/300:03:113
16652540,0sleep30-21swapper/323:58:343
160412530,0sleep10-21swapper/123:48:191
128832530,0sleep10-21swapper/119:50:271
100862520,0sleep20-21swapper/221:48:522
219352510,0sleep20-21swapper/221:38:082
112392510,0sleep10-21swapper/123:01:131
316162480,0sleep20-21swapper/223:31:422
69962470,0sleep20-21swapper/221:21:542
199882380,1sleep341-21ksoftirqd/300:21:573
271812319,7sleep30-21swapper/319:07:333
2715623110,7sleep20-21swapper/219:07:162
273662308,7sleep00-21swapper/019:09:550
268992275,7sleep10-21swapper/119:05:321
55182200,0sleep00-21swapper/022:14:180
209132180,0sleep20-21swapper/221:57:342
31332160,0sleep10-21swapper/121:40:431
288882160,0sleep20-21swapper/222:05:392
247512160,0sleep00-21swapper/023:36:520
64562150,0sleep2311rcuc/200:32:212
271822150,0sleep00-21swapper/000:03:480
256852150,0sleep10-21swapper/123:24:041
12852150,0sleep00-21swapper/023:32:080
27481991412,1cyclictest1023-21sshd22:30:271
238772140,0sleep30-21swapper/323:43:203
161342140,0sleep10-21swapper/122:55:361
15952140,0sleep20-21swapper/221:34:032
144282140,0sleep10-21swapper/121:36:291
67912120,0sleep30-21swapper/300:12:443
2747699120,1cyclictest653-21ModemManager21:12:480
219262120,0sleep30-21swapper/321:57:473
2749399110,10cyclictest0-21swapper/323:26:123
2749399110,0cyclictest0-21swapper/323:38:223
27486991110,0cyclictest0-21swapper/200:28:272
2748699110,10cyclictest26140-21lspci22:44:472
2748699110,10cyclictest0-21swapper/223:38:272
2748699110,10cyclictest0-21swapper/200:04:472
27481991110,0cyclictest0-21swapper/123:32:071
27481991110,0cyclictest0-21swapper/123:18:571
27481991110,0cyclictest0-21swapper/121:25:571
2748199110,1cyclictest1-21systemd00:05:571
2748199110,10cyclictest0-21swapper/122:51:471
2748199110,10cyclictest0-21swapper/122:04:461
2748199110,10cyclictest0-21swapper/121:19:371
2748199110,10cyclictest0-21swapper/100:27:171
27476991110,0cyclictest0-21swapper/000:11:080
2749399100,9cyclictest0-21swapper/321:19:123
2749399100,0cyclictest0-21swapper/323:49:223
2749399100,0cyclictest0-21swapper/323:32:523
2749399100,0cyclictest0-21swapper/322:20:423
2749399100,0cyclictest0-21swapper/321:43:123
2748699109,0cyclictest0-21swapper/200:20:572
2748699109,0cyclictest0-21swapper/200:12:172
2748699100,9cyclictest0-21swapper/221:17:472
2748199109,0cyclictest0-21swapper/123:25:261
2748199109,0cyclictest0-21swapper/100:16:371
2748199109,0cyclictest0-21swapper/100:01:371
2748199100,0cyclictest0-21swapper/121:57:471
2748199100,0cyclictest0-21swapper/100:36:471
2747699109,0cyclictest0-21swapper/023:45:080
2747699109,0cyclictest0-21swapper/023:12:280
2747699109,0cyclictest0-21swapper/022:39:280
2747699109,0cyclictest0-21swapper/021:52:080
2747699109,0cyclictest0-21swapper/000:35:380
2747699109,0cyclictest0-21swapper/000:29:180
2747699108,1cyclictest17784-21sshd23:09:180
2747699100,9cyclictest0-21swapper/023:27:280
2747699100,9cyclictest0-21swapper/021:31:080
2747699100,0cyclictest0-21swapper/000:18:380
32071290,0sleep30-21swapper/323:12:043
274939998,0cyclictest0-21swapper/321:36:023
274939998,0cyclictest0-21swapper/321:14:423
274939998,0cyclictest0-21swapper/320:30:003
274939998,0cyclictest0-21swapper/300:28:013
274939998,0cyclictest0-21swapper/300:09:523
274939997,1cyclictest1107-21sshd00:31:123
274869990,0cyclictest0-21swapper/222:03:472
274869990,0cyclictest0-21swapper/221:44:172
274819998,0cyclictest0-21swapper/123:43:071
274819998,0cyclictest0-21swapper/123:37:371
274819998,0cyclictest0-21swapper/122:21:071
274819998,0cyclictest0-21swapper/121:14:161
274819998,0cyclictest0-21swapper/120:30:271
274819998,0cyclictest0-21swapper/120:15:271
274819998,0cyclictest0-21swapper/100:30:271
274819996,2cyclictest680-21polkitd22:46:361
274769998,0cyclictest0-21swapper/022:45:080
274769998,0cyclictest0-21swapper/022:42:180
274769998,0cyclictest0-21swapper/022:06:580
274769998,0cyclictest0-21swapper/022:00:470
274769998,0cyclictest0-21swapper/021:21:280
274769996,2cyclictest28249-21kworker/0:223:52:360
31706280,0sleep10-21swapper/122:26:001
28655280,1sleep341-21ksoftirqd/300:17:083
274939987,0cyclictest0-21swapper/323:20:423
274939987,0cyclictest0-21swapper/322:11:213
274939987,0cyclictest0-21swapper/320:07:313
274939986,1cyclictest31858-21grepconf.sh22:39:213
274939985,2cyclictest650-21avahi-daemon23:51:573
274939985,2cyclictest650-21avahi-daemon23:15:453
274939985,2cyclictest650-21avahi-daemon22:26:543
274939985,2cyclictest650-21avahi-daemon22:16:423
274939985,2cyclictest650-21avahi-daemon22:01:003
274939983,2cyclictest656-21systemd-logind21:32:003
274869987,0cyclictest0-21swapper/223:19:372
274869987,0cyclictest0-21swapper/222:28:372
274869985,2cyclictest650-21avahi-daemon22:55:382
274869985,2cyclictest650-21avahi-daemon21:51:542
274869984,3cyclictest650-21avahi-daemon22:16:302
274819987,0cyclictest0-21swapper/123:52:571
274819987,0cyclictest0-21swapper/123:06:271
274819987,0cyclictest0-21swapper/122:14:371
274819985,2cyclictest650-21avahi-daemon22:18:001
274819985,2cyclictest650-21avahi-daemon21:52:311
274819985,2cyclictest650-21avahi-daemon00:23:491
274819985,2cyclictest650-21avahi-daemon00:13:311
274769987,0cyclictest0-21swapper/022:15:080
274769987,0cyclictest0-21swapper/000:06:470
274769986,1cyclictest5094-21lspci23:59:180
274769985,2cyclictest650-21avahi-daemon23:40:260
274769985,2cyclictest650-21avahi-daemon22:28:510
274769980,7cyclictest3570-21sshd22:59:530
274769980,4cyclictest1759-21awk19:25:000
5563270,1sleep2311rcuc/200:05:462
274939976,0cyclictest0-21swapper/322:47:023
274939975,1cyclictest650-21avahi-daemon22:51:003
274939975,1cyclictest650-21avahi-daemon21:46:183
274939974,2cyclictest661-21dbus-daemon21:52:113
274939974,2cyclictest650-21avahi-daemon22:32:183
274939974,2cyclictest650-21avahi-daemon21:22:103
274939974,2cyclictest650-21avahi-daemon00:35:543
274939973,3cyclictest661-21dbus-daemon21:25:063
274939972,4cyclictest614-13auditd23:08:233
274869976,0cyclictest0-21swapper/200:16:362
274869975,1cyclictest680-21polkitd23:02:372
274869975,1cyclictest650-21avahi-daemon23:05:182
274869975,1cyclictest650-21avahi-daemon22:49:192
274869975,1cyclictest618-13audispd23:40:452
274869975,1cyclictest19797-21sshd23:22:472
274869975,1cyclictest0-21swapper/223:12:072
274869974,2cyclictest661-21dbus-daemon23:52:022
274869974,2cyclictest656-21systemd-logind22:20:072
274869974,2cyclictest650-21avahi-daemon23:55:092
274869974,2cyclictest650-21avahi-daemon22:35:042
274869974,2cyclictest650-21avahi-daemon22:32:592
274869974,2cyclictest650-21avahi-daemon19:30:002
274869974,2cyclictest650-21avahi-daemon00:36:502
274869974,2cyclictest20729-21gdbus22:50:492
274869973,1cyclictest0-21swapper/223:47:502
274869973,1cyclictest0-21swapper/221:27:032
274869972,2cyclictest3039-21sshd23:25:502
274869972,2cyclictest17496-21sshd22:10:082
274869970,0cyclictest0-21swapper/220:10:272
274819976,0cyclictest0-21swapper/122:05:371
274819975,1cyclictest650-21avahi-daemon23:11:141
274819974,2cyclictest661-21dbus-daemon22:43:481
274819974,2cyclictest661-21dbus-daemon21:45:511
274819974,2cyclictest650-21avahi-daemon23:55:141
274819974,2cyclictest650-21avahi-daemon21:21:431
274819973,3cyclictest650-21avahi-daemon21:32:091
274819970,6cyclictest0-21swapper/121:02:371
274819970,6cyclictest0-21swapper/119:46:351
274819970,6cyclictest0-21swapper/119:19:361
274769976,0cyclictest0-21swapper/023:20:480
274769976,0cyclictest0-21swapper/000:21:480
274769975,1cyclictest650-21avahi-daemon21:41:550
274769974,2cyclictest650-21avahi-daemon22:33:340
274769974,2cyclictest650-21avahi-daemon21:45:470
274769974,2cyclictest650-21avahi-daemon21:35:200
274769974,2cyclictest650-21avahi-daemon21:15:410
274769974,2cyclictest650-21avahi-daemon00:30:440
274939965,0cyclictest0-21swapper/319:50:213
274939964,1cyclictest5109-21sshd23:00:103
274939964,1cyclictest20303-21sshd22:56:323
274939963,2cyclictest12152-21sadc21:10:003
274939963,2cyclictest1013-21snmpd19:37:353
274939963,2cyclictest1013-21snmpd19:31:193
274939963,2cyclictest1013-21snmpd19:14:413
274939960,5cyclictest0-21swapper/320:46:523
274939960,5cyclictest0-21swapper/320:36:023
274939960,5cyclictest0-21swapper/319:58:203
274939960,5cyclictest0-21swapper/319:43:513
274869964,1cyclictest661-21dbus-daemon19:24:592
274869963,2cyclictest13748-21sshd21:10:182
274869963,2cyclictest1013-21snmpd20:26:422
274869963,2cyclictest1013-21snmpd20:21:532
274819965,0cyclictest0-21swapper/120:39:371
274819964,1cyclictest680-21polkitd22:35:431
274819963,2cyclictest1013-21snmpd20:45:061
274819960,5cyclictest0-21swapper/120:05:171
274769965,0cyclictest0-21swapper/022:50:170
274769964,1cyclictest686-21gdbus22:20:430
274769964,1cyclictest680-21polkitd20:29:560
274769964,1cyclictest661-21dbus-daemon19:20:000
274769964,1cyclictest650-21avahi-daemon21:55:160
274769963,2cyclictest661-21dbus-daemon21:25:160
274769963,2cyclictest650-21avahi-daemon23:00:040
274769963,2cyclictest20729-21gdbus23:15:180
21685260,1sleep021684-21sed20:10:270
7494253,0sleep03987-21kworker/0:120:55:300
4724250,0sleep00-21swapper/020:50:210
274939954,0cyclictest0-21swapper/320:11:513
274939954,0cyclictest0-21swapper/319:21:013
274939953,1cyclictest661-21dbus-daemon19:45:003
274939953,1cyclictest646-21lsmd19:15:193
274939953,1cyclictest5304-21sensors_temp20:50:273
274939953,1cyclictest16724-21cat20:00:233
274939953,1cyclictest1013-21snmpd21:03:493
274939953,1cyclictest1013-21snmpd20:58:183
274939953,1cyclictest1013-21snmpd20:41:163
274939953,1cyclictest1013-21snmpd20:21:273
274939953,1cyclictest1013-21snmpd19:26:353
274939953,1cyclictest1000-21runrttasks20:25:323
274939950,0cyclictest0-21swapper/320:17:213
274869954,0cyclictest0-21swapper/219:45:162
274869953,1cyclictest30753-21cat19:15:232
274869953,1cyclictest14683-21cat19:55:202
274869953,1cyclictest1013-21snmpd20:59:522
274869953,1cyclictest1013-21snmpd20:41:342
274869953,1cyclictest1013-21snmpd20:38:042
274869953,1cyclictest1013-21snmpd20:32:282
274869953,1cyclictest1013-21snmpd20:18:122
274869953,1cyclictest1013-21snmpd20:05:572
274869953,1cyclictest1013-21snmpd19:52:182
274869953,1cyclictest1013-21snmpd19:30:052
274869953,1cyclictest0-21swapper/220:45:192
274869952,2cyclictest28574-21pmu-power19:10:222
274869952,2cyclictest1013-21snmpd19:37:322
274869951,3cyclictest8068-21seq19:40:012
274869950,4cyclictest10364-21/usr/sbin/munin21:05:192
274869950,0cyclictest0-21swapper/221:00:072
274819953,1cyclictest543-21cat20:40:231
274819953,1cyclictest28127-21cat19:10:181
274819953,1cyclictest24870-21cat20:20:181
274819953,1cyclictest15226-21sendmail_mailst19:55:251
274819953,1cyclictest10364-21/usr/sbin/munin21:05:181
274819953,1cyclictest1013-21snmpd20:55:191
274819953,1cyclictest1013-21snmpd20:53:041
274819953,1cyclictest1013-21snmpd20:12:081
274819953,1cyclictest1013-21snmpd20:03:001
274819953,1cyclictest1013-21snmpd19:27:591
274819953,1cyclictest1013-21snmpd19:24:131
274819952,2cyclictest7876-21grep19:40:001
274819952,2cyclictest661-21dbus-daemon19:40:001
274819952,2cyclictest4956-21tr19:30:241
274819950,0cyclictest0-21swapper/120:26:271
274769953,1cyclictest6548-21cat19:35:220
274769953,1cyclictest3777-21/usr/sbin/munin19:30:000
274769953,1cyclictest28165-21cat19:10:180
274769953,1cyclictest2583-21gltestperf20:45:200
274769953,1cyclictest1013-21snmpd21:05:070
274769953,1cyclictest1013-21snmpd20:37:120
274769953,1cyclictest1013-21snmpd20:22:330
274769953,1cyclictest1013-21snmpd20:15:180
274769953,1cyclictest1013-21snmpd20:00:390
274769953,1cyclictest1013-21snmpd19:56:450
274769953,1cyclictest1013-21snmpd19:46:230
274769953,1cyclictest1013-21snmpd19:40:110
274769952,2cyclictest8798-21cat21:00:200
274769952,2cyclictest13762-21chrt19:52:470
274769952,2cyclictest1013-21snmpd20:08:450
274769952,2cyclictest1013-21snmpd19:33:470
274869942,1cyclictest4378-21tr20:50:172
274869942,1cyclictest16623-21hostname20:00:222
274769944,0cyclictest28196-21kworker/0:020:40:120
274769942,1cyclictest28509-21cpuspeed_turbos20:30:190
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional