You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-28 - 07:48
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 792 highest latencies:
System rack2slot0.osadl.org (updated Sun Apr 28, 2024 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
160452880,0sleep20-21swapper/221:21:112
190542770,2sleep32920199cyclictest00:12:503
182302580,1sleep318225-21sshd23:36:333
213172570,0sleep00-21swapper/023:36:550
129182550,0sleep30-21swapper/300:19:353
203332540,1sleep120323-21sshd22:36:161
107902540,1sleep110786-21lspci21:24:151
319652530,0sleep20-21swapper/222:23:232
2885725241,7sleep00-21swapper/019:07:240
252982500,1sleep21095-21nfsd21:15:102
252982500,1sleep21095-21nfsd21:15:102
181942500,0sleep2311rcuc/222:53:552
97062490,1sleep09-21ksoftirqd/000:26:330
311262490,0sleep10-21swapper/122:19:461
124232490,0sleep30-21swapper/323:46:393
266022480,0sleep20-21swapper/221:43:422
196712480,0sleep20-21swapper/200:39:042
173812480,0sleep10-21swapper/123:57:541
90632470,0sleep30-21swapper/321:27:333
323712460,1sleep132369-21lspci21:37:121
251062460,0sleep20-21swapper/222:26:072
30492450,0sleep00-21swapper/022:37:590
212872350,0sleep30-21swapper/322:54:163
287202319,7sleep20-21swapper/219:05:462
287992308,7sleep10-21swapper/119:06:411
2877422210,7sleep30-21swapper/319:06:233
186402190,1sleep018632-21sshd21:21:290
295382180,1sleep1700-21gdbus00:02:551
69452160,1sleep20-21swapper/221:30:482
57742160,0sleep20-21swapper/200:07:362
2918299160,1cyclictest1-21systemd00:19:120
123672160,0sleep10-21swapper/123:00:191
2918299150,1cyclictest15495-21lspci22:28:420
13792150,1sleep00-21swapper/021:19:410
13792150,1sleep00-21swapper/021:19:410
121932150,1sleep012192-21bash22:31:500
110482150,1sleep30-21swapper/323:10:503
110482150,1sleep30-21swapper/323:10:503
36892140,0sleep00-21swapper/022:16:400
29186991413,0cyclictest8028-21lspci23:53:191
29182991412,1cyclictest19111-21cp00:05:220
273882140,0sleep20-21swapper/221:54:272
265822140,0sleep00-21swapper/000:32:140
227792140,0sleep10-21swapper/122:29:311
184492140,0sleep00-21swapper/022:04:070
14602140,0sleep00-21swapper/000:36:500
59952130,0sleep20-21swapper/223:31:402
54472130,0sleep10-21swapper/122:48:571
44822130,0sleep10-21swapper/123:35:071
29201991311,1cyclictest14497-21sshd22:14:223
2918699130,12cyclictest32311-21sshd00:29:121
2918299130,0cyclictest0-21swapper/021:44:220
249002130,1sleep324884-21sshd00:28:203
187102130,0sleep30-21swapper/323:50:513
29201991210,1cyclictest620-13audispd21:21:123
2920199120,1cyclictest646-21dbus-daemon22:04:323
2920199120,1cyclictest31982-21sshd22:16:123
29195991210,1cyclictest1-21systemd22:31:182
2919599120,1cyclictest29407-21id22:37:182
2919599120,1cyclictest19003-21sshd22:43:182
2919599120,1cyclictest1-21systemd23:28:382
2919599120,11cyclictest8976-21sshd00:04:182
2919599120,0cyclictest0-21swapper/221:45:482
2918699120,1cyclictest13942-21sshd00:19:421
2918699120,11cyclictest0-21swapper/122:22:021
2918699120,11cyclictest0-21swapper/122:06:521
2918299129,2cyclictest0-21swapper/023:20:220
2918299127,4cyclictest10236-21sshd21:31:110
2918299120,11cyclictest14747-21bash23:43:220
2918299120,11cyclictest0-21swapper/021:52:520
235452120,0sleep10-21swapper/123:33:391
211132120,0sleep10-21swapper/122:40:001
2920199119,1cyclictest26709-21sshd00:24:533
29201991110,0cyclictest0-21swapper/323:59:433
29201991110,0cyclictest0-21swapper/322:37:423
29195991110,0cyclictest0-21swapper/200:30:082
2919599110,10cyclictest27351-21sshd23:44:482
2919599110,10cyclictest0-21swapper/221:27:182
2919599110,0cyclictest0-21swapper/222:46:182
2918699119,1cyclictest646-21dbus-daemon00:34:521
29186991110,0cyclictest0-21swapper/123:46:221
29186991110,0cyclictest0-21swapper/122:58:421
29186991110,0cyclictest0-21swapper/121:34:421
2918699110,10cyclictest0-21swapper/122:14:521
2918699110,10cyclictest0-21swapper/121:17:321
2918699110,10cyclictest0-21swapper/121:17:321
2918299119,1cyclictest15798-21grepconf.sh21:35:210
2918299119,1cyclictest0-21swapper/022:11:520
2918299118,2cyclictest0-21swapper/019:46:210
2918299114,2cyclictest649-21avahi-daemon22:05:500
2918299114,1cyclictest700-21gdbus23:31:540
2918299114,1cyclictest684-21polkitd22:44:260
2918299114,1cyclictest684-21polkitd21:47:520
2918299114,1cyclictest684-21polkitd00:04:030
2918299114,1cyclictest649-21avahi-daemon23:59:540
2918299114,1cyclictest649-21avahi-daemon00:23:360
2918299114,1cyclictest646-21dbus-daemon22:22:130
2918299114,1cyclictest28109-21sshd22:47:510
2918299113,4cyclictest17008-21awk20:05:000
29182991110,0cyclictest0-21swapper/023:51:320
29182991110,0cyclictest0-21swapper/023:13:320
29182991110,0cyclictest0-21swapper/023:13:320
2918299110,10cyclictest0-21swapper/023:00:020
263072110,0sleep10-21swapper/121:11:411
2920199109,0cyclictest0-21swapper/323:31:333
2920199109,0cyclictest0-21swapper/321:41:223
2920199109,0cyclictest0-21swapper/321:15:523
2920199109,0cyclictest0-21swapper/321:15:523
2920199109,0cyclictest0-21swapper/300:31:133
2920199100,0cyclictest0-21swapper/322:06:223
2919599109,0cyclictest0-21swapper/223:58:382
2919599109,0cyclictest0-21swapper/223:08:082
2919599109,0cyclictest0-21swapper/221:57:582
2919599109,0cyclictest0-21swapper/221:37:582
2919599109,0cyclictest0-21swapper/221:13:082
2919599100,0cyclictest0-21swapper/223:14:582
2919599100,0cyclictest0-21swapper/223:14:582
2919599100,0cyclictest0-21swapper/222:09:382
2918699109,0cyclictest0-21swapper/123:41:221
2918699109,0cyclictest0-21swapper/123:14:021
2918699109,0cyclictest0-21swapper/123:14:021
2918699109,0cyclictest0-21swapper/121:41:521
2918699108,1cyclictest21931-21lspci23:26:171
2918699100,0cyclictest0-21swapper/121:48:321
2918299109,0cyclictest0-21swapper/022:58:120
2918299109,0cyclictest0-21swapper/020:55:210
2918299104,1cyclictest9380-21sshd00:11:410
2918299104,1cyclictest649-21avahi-daemon23:45:250
2918299104,1cyclictest649-21avahi-daemon23:15:290
2918299104,1cyclictest649-21avahi-daemon22:50:210
2918299104,1cyclictest649-21avahi-daemon21:26:350
2918299104,1cyclictest646-21dbus-daemon23:26:390
2918299104,1cyclictest646-21dbus-daemon21:55:250
2918299104,1cyclictest6132-21sshd21:13:030
285072100,0sleep30-21swapper/322:40:423
292019998,0cyclictest0-21swapper/323:24:433
292019998,0cyclictest0-21swapper/322:24:323
292019998,0cyclictest0-21swapper/321:34:123
292019997,1cyclictest9598-21lspci23:17:533
292019995,3cyclictest649-21avahi-daemon22:30:383
291959998,0cyclictest0-21swapper/223:19:182
291959998,0cyclictest0-21swapper/222:16:582
291959998,0cyclictest0-21swapper/200:26:582
291959998,0cyclictest0-21swapper/200:20:382
291869998,0cyclictest9204-21lspci00:08:011
291869998,0cyclictest6766-21lspci22:31:131
291869991,1cyclictest131rcu_sched21:55:451
291829994,1cyclictest1-21systemd23:05:210
292019987,0cyclictest0-21swapper/300:07:533
292019986,1cyclictest18213-21lspci22:46:443
292019985,2cyclictest649-21avahi-daemon21:45:353
292019984,3cyclictest646-21dbus-daemon21:59:223
292019980,7cyclictest20520-21sshd23:44:013
291959987,0cyclictest0-21swapper/223:52:582
291959987,0cyclictest0-21swapper/223:39:482
291959987,0cyclictest0-21swapper/222:11:282
291959987,0cyclictest0-21swapper/222:01:382
291959987,0cyclictest0-21swapper/220:56:582
291959984,3cyclictest646-21dbus-daemon23:20:262
291869987,0cyclictest9280-21lspci21:27:341
291869987,0cyclictest17204-21lspci23:15:101
291869987,0cyclictest0-21swapper/100:38:021
291869986,1cyclictest25-21ksoftirqd/123:20:191
291829987,0cyclictest0-21swapper/021:05:010
291829987,0cyclictest0-21swapper/019:31:310
291829983,1cyclictest697-21gdbus20:45:000
291829983,1cyclictest17299-21snmpd19:14:420
2531280,0sleep30-21swapper/321:12:393
292019975,1cyclictest75550irq/24-eno1-rx-00:36:103
292019975,1cyclictest620-13audispd23:25:173
292019975,1cyclictest15917-21lspci23:07:533
292019974,2cyclictest649-21avahi-daemon22:55:083
292019974,2cyclictest646-21dbus-daemon00:01:043
292019973,3cyclictest684-21polkitd23:04:473
292019973,3cyclictest646-21dbus-daemon21:37:073
292019973,2cyclictest14241-21sshd22:25:013
291959975,1cyclictest15291-21sshd23:46:582
291959975,1cyclictest0-21swapper/223:04:282
291959973,3cyclictest646-21dbus-daemon00:11:072
291959973,1cyclictest0-21swapper/222:55:212
291959970,6cyclictest3986-21sshd00:18:322
291959970,6cyclictest0-21swapper/219:45:382
291869975,1cyclictest9528-21sadc19:40:001
291869975,1cyclictest649-21avahi-daemon22:52:371
291869975,1cyclictest649-21avahi-daemon00:10:031
291869975,1cyclictest25-21ksoftirqd/123:05:041
291869975,1cyclictest25-21ksoftirqd/121:54:431
291869975,1cyclictest25-21ksoftirqd/100:21:161
291869974,2cyclictest684-21polkitd22:02:061
292019964,1cyclictest684-21polkitd21:04:553
292019964,1cyclictest648-21systemd-logind21:50:103
292019963,2cyclictest17299-21snmpd20:12:233
292019963,2cyclictest17299-21snmpd19:52:473
291959965,0cyclictest0-21swapper/219:30:072
291959960,5cyclictest0-21swapper/220:33:382
291959960,5cyclictest0-21swapper/219:16:472
291869965,0cyclictest0-21swapper/121:00:221
291869964,1cyclictest9338-21systemd-cgroups21:05:001
291869964,1cyclictest25-21ksoftirqd/121:00:001
291869963,2cyclictest17299-21snmpd19:50:101
291869960,5cyclictest0-21swapper/119:41:321
291829965,0cyclictest0-21swapper/020:16:010
291829965,0cyclictest0-21swapper/019:36:310
291829964,1cyclictest3429-21idleruntime-cro19:25:000
291829960,5cyclictest0-21swapper/019:57:310
292019954,0cyclictest0-21swapper/320:16:323
292019953,1cyclictest9804-21cat21:05:143
292019953,1cyclictest6194-21cat19:30:173
292019953,1cyclictest5778-21cat20:55:263
292019953,1cyclictest4154-21cat19:25:153
292019953,1cyclictest4154-21cat19:25:153
292019953,1cyclictest31930-21grep20:40:143
292019953,1cyclictest30674-21grep19:10:163
292019953,1cyclictest27898-21cat20:30:113
292019953,1cyclictest2109-21mii-tool19:20:153
292019953,1cyclictest17495-21diskstats20:05:103
292019953,1cyclictest17299-21snmpd20:35:033
292019953,1cyclictest17299-21snmpd19:48:073
292019953,1cyclictest17299-21snmpd19:40:073
292019953,1cyclictest17299-21snmpd19:36:193
292019953,1cyclictest17299-21snmpd19:16:363
292019953,1cyclictest14940-21crond20:00:003
292019953,1cyclictest1109-21ntpd20:25:173
292019953,1cyclictest1109-21ntpd20:20:233
292019952,2cyclictest17299-21snmpd20:46:183
292019950,4cyclictest0-21swapper/320:02:423
292019950,0cyclictest0-21swapper/320:50:123
291959953,1cyclictest17299-21snmpd21:05:342
291959953,1cyclictest17299-21snmpd21:00:432
291959953,1cyclictest17299-21snmpd20:52:302
291959953,1cyclictest17299-21snmpd20:39:032
291959953,1cyclictest17299-21snmpd20:28:302
291959953,1cyclictest17299-21snmpd20:15:142
291959953,1cyclictest17299-21snmpd20:10:232
291959953,1cyclictest17299-21snmpd20:05:022
291959953,1cyclictest17299-21snmpd20:01:562
291959953,1cyclictest17299-21snmpd19:50:522
291959953,1cyclictest17299-21snmpd19:41:402
291959953,1cyclictest17299-21snmpd19:25:042
291959953,1cyclictest17299-21snmpd19:25:042
291959953,1cyclictest17299-21snmpd19:11:062
291959953,1cyclictest1692-21cat20:45:122
291959953,1cyclictest14485-21grep19:55:312
291959953,1cyclictest1058-21sendmail19:35:162
291959952,2cyclictest17299-21snmpd20:40:572
291959952,1cyclictest17299-21snmpd20:20:322
291869953,1cyclictest30129-21missed_timers20:35:181
291869953,1cyclictest2126-21cat19:20:151
291869953,1cyclictest19779-21cat20:10:181
291869953,1cyclictest17674-21cat20:05:121
291869953,1cyclictest17299-21snmpd20:40:301
291869953,1cyclictest17299-21snmpd20:26:001
291869953,1cyclictest17299-21snmpd20:01:051
291869953,1cyclictest17299-21snmpd19:58:111
291869953,1cyclictest17299-21snmpd19:49:221
291869953,1cyclictest17299-21snmpd19:26:071
291869953,1cyclictest17299-21snmpd19:26:071
291869953,1cyclictest17299-21snmpd19:15:181
291869953,1cyclictest1058-21sendmail20:47:321
291869953,1cyclictest1058-21sendmail20:15:141
291869953,1cyclictest0-21swapper/120:50:261
291869952,2cyclictest646-21dbus-daemon20:35:001
291869952,2cyclictest29921-21cat19:10:101
291869952,2cyclictest23445-21tr20:20:131
291869952,2cyclictest17299-21snmpd19:30:101
291829954,0cyclictest0-21swapper/020:05:010
291829954,0cyclictest0-21swapper/019:26:310
291829954,0cyclictest0-21swapper/019:26:310
291829953,1cyclictest17299-21snmpd21:00:100
291829953,1cyclictest17299-21snmpd20:38:180
291829953,1cyclictest17299-21snmpd20:31:570
291829953,1cyclictest17299-21snmpd20:27:540
291829953,1cyclictest17299-21snmpd20:10:410
291829953,1cyclictest17299-21snmpd19:51:100
291829953,1cyclictest17299-21snmpd19:40:190
291829953,1cyclictest17299-21snmpd19:15:120
291829953,1cyclictest1-21systemd20:40:000
291829953,1cyclictest1053-21lldpd20:21:060
291959941,2cyclictest1901-21df_inode19:20:132
291829942,1cyclictest17299-21snmpd20:50:180
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional