You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-01-13 - 12:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Mon Jan 13, 2025 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
87382930,0sleep18739-21sshd21:57:231
221222920,1sleep122094-21sshd22:27:081
60032750,1sleep125-21ksoftirqd/122:34:161
298082720,0sleep20-21swapper/200:36:372
177172650,0sleep10-21swapper/100:15:181
260832570,0sleep00-21swapper/023:33:160
88522560,0sleep28822-21sshd21:28:562
293962550,1sleep20-21swapper/223:53:322
86132540,1sleep1646-21dbus-daemon21:48:551
64302530,0sleep30-21swapper/321:42:553
314642530,0sleep2311rcuc/223:16:322
250212530,1sleep00-21swapper/022:50:140
120642520,1sleep10-21swapper/123:29:121
56182510,0sleep00-21swapper/023:54:170
224942510,1sleep122492-21lspci21:44:211
17322510,0sleep10-21swapper/120:15:161
143862510,0sleep30-21swapper/322:57:533
33812490,0sleep00-21swapper/023:36:550
301642490,0sleep00-21swapper/022:24:580
254992490,1sleep2311rcuc/222:01:422
140342490,0sleep20-21swapper/200:26:282
110552490,0sleep30-21swapper/323:00:223
294172480,0sleep00-21swapper/023:24:580
126842480,0sleep10-21swapper/122:37:411
119312480,0sleep30-21swapper/323:17:413
87912470,2sleep3600299cyclictest22:00:133
133052470,0sleep10-21swapper/122:57:471
229182410,0sleep222902-21sshd22:44:182
133892400,0sleep10-21swapper/123:37:481
159412390,0sleep10-21swapper/100:38:281
67182360,0sleep30-21swapper/322:31:263
56682287,7sleep20-21swapper/219:07:152
554122413,7sleep00-21swapper/019:05:410
580722311,7sleep30-21swapper/319:09:003
579022210,7sleep10-21swapper/119:08:461
8342210,0sleep20-21swapper/221:16:472
55642200,0sleep30-21swapper/321:17:123
324162190,0sleep032400-21sshd22:48:050
32062190,0sleep30-21swapper/300:02:353
14132170,0sleep30-21swapper/323:51:013
94162160,0sleep10-21swapper/120:35:131
222132160,1sleep222185-21sshd23:44:192
218292160,2sleep2600199cyclictest23:01:222
173502160,0sleep317352-21bash00:12:273
154742160,0sleep115458-21sshd00:09:291
118262160,0sleep00-21swapper/019:20:170
306162150,0sleep20-21swapper/223:05:012
67092140,1sleep2311rcuc/222:54:252
6002991412,1cyclictest620-13audispd21:21:363
6001991410,3cyclictest0-21swapper/223:24:022
600199140,13cyclictest0-21swapper/222:56:522
300362140,1sleep030032-21sshd23:56:230
266622140,0sleep31093-21nfsd23:07:343
134642140,0sleep30-21swapper/321:49:213
128912140,0sleep3391rcuc/321:52:043
600299130,2cyclictest646-21dbus-daemon23:28:473
600199130,11cyclictest26708-21sshd21:21:532
293992130,0sleep0111rcuc/022:04:560
275812130,0sleep20-21swapper/200:04:452
254762130,0sleep00-21swapper/000:36:120
153672130,0sleep20-21swapper/200:06:342
122602130,0sleep00-21swapper/021:57:420
6002991210,1cyclictest21132-21sshd00:27:063
600299120,1cyclictest0-21swapper/323:48:363
600299120,11cyclictest15886-21bash00:06:373
6001991210,1cyclictest12894-21sshd22:37:432
6001991210,1cyclictest0-21swapper/221:53:522
600199120,11cyclictest25602-21sshd21:47:332
600199120,11cyclictest22408-21lspci21:55:432
600199120,11cyclictest1-21systemd21:12:232
599499120,1cyclictest5421-21sshd00:25:421
599499120,11cyclictest0-21swapper/123:05:421
5989991211,0cyclictest18820-21sshd23:44:010
5989991210,1cyclictest17004-21lspci23:15:150
598999120,11cyclictest0-21swapper/022:42:500
600299119,1cyclictest1-21systemd21:32:263
600299110,10cyclictest0-21swapper/323:55:263
600299110,10cyclictest0-21swapper/322:45:373
600299110,10cyclictest0-21swapper/322:25:373
600299110,10cyclictest0-21swapper/322:16:563
600299110,10cyclictest0-21swapper/321:36:553
600199119,1cyclictest25174-21sshd23:38:522
6001991110,0cyclictest0-21swapper/223:56:522
600199110,10cyclictest0-21swapper/200:31:032
600199110,0cyclictest0-21swapper/222:32:422
599499119,1cyclictest26087-21lspci22:21:411
599499110,10cyclictest0-21swapper/122:07:311
599499110,0cyclictest0-21swapper/122:15:321
598999119,1cyclictest23735-21lspci21:24:300
598999114,3cyclictest21497-21bash22:10:000
5989991110,0cyclictest10141-21lspci22:57:300
598999110,0cyclictest0-21swapper/022:25:200
96202100,0sleep1241ktimersoftd/121:17:341
600299109,0cyclictest0-21swapper/323:24:263
600299109,0cyclictest0-21swapper/322:52:563
600299109,0cyclictest0-21swapper/322:43:063
600299109,0cyclictest0-21swapper/322:08:563
600299109,0cyclictest0-21swapper/321:12:053
600299109,0cyclictest0-21swapper/300:17:473
600299100,0cyclictest0-21swapper/323:11:273
600299100,0cyclictest0-21swapper/319:27:163
600199109,0cyclictest0-21swapper/221:41:422
600199108,1cyclictest30905-21sshd21:36:332
600199108,1cyclictest16950-21lspci22:06:422
600199108,1cyclictest16426-21lspci00:12:222
600199108,1cyclictest0-21swapper/222:14:432
599499109,0cyclictest0-21swapper/123:33:331
599499109,0cyclictest0-21swapper/123:18:431
599499109,0cyclictest0-21swapper/120:05:021
599499109,0cyclictest0-21swapper/100:23:131
598999109,0cyclictest6403-21lspci23:11:280
598999109,0cyclictest27671-21lspci00:19:050
598999109,0cyclictest0-21swapper/021:11:500
598999109,0cyclictest0-21swapper/000:29:200
598999109,0cyclictest0-21swapper/000:02:000
598999108,1cyclictest21458-21sshd22:18:300
598999108,1cyclictest1-21systemd22:10:300
598999108,1cyclictest0-21swapper/000:06:210
598999100,3cyclictest131rcu_sched22:32:040
598999100,0cyclictest0-21swapper/000:31:510
60029998,0cyclictest0-21swapper/300:33:573
60019998,0cyclictest0-21swapper/223:34:322
60019997,1cyclictest27472-21hddtemp_smartct20:00:112
59949998,0cyclictest0-21swapper/123:11:521
59949998,0cyclictest0-21swapper/100:13:521
59949991,4cyclictest684-21polkitd23:00:501
59899998,0cyclictest28399-21lspci21:36:190
59899998,0cyclictest14576-21lspci23:09:250
59899998,0cyclictest0-21swapper/023:00:410
59899998,0cyclictest0-21swapper/021:31:290
59899998,0cyclictest0-21swapper/021:18:090
59899997,1cyclictest9-21ksoftirqd/021:25:010
59899993,1cyclictest9-21ksoftirqd/021:47:140
9868280,1sleep3401ktimersoftd/323:34:423
60029987,0cyclictest0-21swapper/322:10:473
60029986,1cyclictest8582-21lspci23:43:053
60029986,1cyclictest700-21gdbus23:39:173
60029985,2cyclictest649-21avahi-daemon22:38:313
60029985,2cyclictest649-21avahi-daemon21:58:533
60029984,3cyclictest646-21dbus-daemon00:23:353
60029980,7cyclictest23966-21sshd00:36:023
60019987,0cyclictest0-21swapper/222:27:432
60019986,1cyclictest25264-21sshd21:30:182
60019985,2cyclictest700-21gdbus22:23:292
60019985,2cyclictest649-21avahi-daemon23:14:462
60019984,3cyclictest649-21avahi-daemon00:18:522
60019984,3cyclictest646-21dbus-daemon23:27:142
59949987,0cyclictest0-21swapper/123:49:021
59949987,0cyclictest0-21swapper/123:24:521
59949987,0cyclictest0-21swapper/122:46:021
59949987,0cyclictest0-21swapper/121:38:021
59949987,0cyclictest0-21swapper/121:29:411
59949987,0cyclictest0-21swapper/121:22:421
59949987,0cyclictest0-21swapper/120:10:211
59949987,0cyclictest0-21swapper/100:30:031
59949986,1cyclictest25-21ksoftirqd/122:53:471
59949985,2cyclictest649-21avahi-daemon00:00:111
59949984,3cyclictest646-21dbus-daemon21:32:321
59899987,0cyclictest0-21swapper/022:37:100
59899986,1cyclictest9-21ksoftirqd/000:20:570
59899986,1cyclictest6263-21lspci23:28:400
59899985,2cyclictest700-21gdbus00:12:250
59899985,2cyclictest649-21avahi-daemon23:48:150
59899980,4cyclictest670-21packagekitd19:49:590
59899980,4cyclictest18735-21perf19:39:590
60029976,0cyclictest0-21swapper/321:08:163
60029976,0cyclictest0-21swapper/319:19:553
60029975,1cyclictest2550-21sshd21:25:283
60029973,3cyclictest646-21dbus-daemon22:20:253
60019976,0cyclictest0-21swapper/220:30:222
60019975,1cyclictest19817-21lspci22:15:242
60019974,2cyclictest649-21avahi-daemon23:45:562
60019974,2cyclictest649-21avahi-daemon22:45:072
60019973,3cyclictest700-21gdbus00:20:392
59949975,1cyclictest33050irq/27-ahci[00021:51:501
59949975,1cyclictest29264-21lspci22:10:351
59949975,1cyclictest23022-21kworker/1:422:41:591
59949975,1cyclictest22868-21kworker/1:321:10:541
59949975,1cyclictest17581-21kworker/1:123:51:241
59949974,2cyclictest6914-21sshd23:57:121
59949974,2cyclictest684-21polkitd22:01:191
59949974,2cyclictest649-21avahi-daemon23:40:521
59899975,1cyclictest9-21ksoftirqd/021:50:040
59899975,1cyclictest9-21ksoftirqd/021:40:190
60029965,0cyclictest0-21swapper/320:03:163
60029964,1cyclictest2682-21sleep20:20:013
60029964,1cyclictest17299-21snmpd19:21:333
60029964,1cyclictest17133-21grep20:55:213
60029964,1cyclictest15361-21mii-tool19:30:173
60029962,3cyclictest20754-21dump-pmu-power19:45:003
60019964,1cyclictest700-21gdbus19:30:002
60019964,1cyclictest646-21dbus-daemon21:09:482
60019964,1cyclictest646-21dbus-daemon19:40:002
60019964,1cyclictest19360-21grep19:40:132
60019960,5cyclictest0-21swapper/220:35:312
59949964,1cyclictest646-21dbus-daemon19:30:001
59949964,1cyclictest23229-21sshd21:09:441
59949964,1cyclictest11917-21ntp_states20:40:161
59949963,2cyclictest17299-21snmpd20:01:461
59949960,5cyclictest0-21swapper/120:49:221
59949960,5cyclictest0-21swapper/119:48:211
59899963,2cyclictest17299-21snmpd19:58:230
59899963,2cyclictest17299-21snmpd19:16:010
59899960,5cyclictest0-21swapper/021:07:590
60029953,1cyclictest9467-21cat20:35:143
60029953,1cyclictest684-21polkitd19:50:013
60029953,1cyclictest6813-21grep19:10:153
60029953,1cyclictest5420-21cat20:25:133
60029953,1cyclictest17299-21snmpd21:00:423
60029953,1cyclictest17299-21snmpd20:53:023
60029953,1cyclictest17299-21snmpd20:49:233
60029953,1cyclictest17299-21snmpd20:33:573
60029953,1cyclictest17299-21snmpd20:11:403
60029953,1cyclictest17299-21snmpd19:57:523
60029953,1cyclictest17299-21snmpd19:48:463
60029952,2cyclictest17299-21snmpd20:22:113
60029952,2cyclictest17299-21snmpd19:36:253
60029950,4cyclictest11922-21sshd20:40:163
60019953,1cyclictest649-21avahi-daemon20:10:192
60019953,1cyclictest646-21dbus-daemon19:34:542
60019953,1cyclictest646-21dbus-daemon19:10:002
60019953,1cyclictest29624-21cat20:05:142
60019953,1cyclictest25053-21/usr/sbin/munin19:55:182
60019953,1cyclictest1887-21grep20:15:182
60019953,1cyclictest17299-21snmpd21:01:302
60019953,1cyclictest17299-21snmpd20:55:512
60019953,1cyclictest17299-21snmpd20:46:062
60019953,1cyclictest17299-21snmpd20:40:032
60019953,1cyclictest17299-21snmpd20:25:172
60019953,1cyclictest17299-21snmpd20:20:082
60019953,1cyclictest17299-21snmpd19:52:382
60019953,1cyclictest17299-21snmpd19:45:552
60019953,1cyclictest17299-21snmpd19:22:212
60019953,1cyclictest17299-21snmpd19:15:012
60019953,1cyclictest14207-21cat20:50:092
59949955,0cyclictest30964-21kworker/1:020:34:181
59949954,1cyclictest5889-21kworker/1:219:20:111
59949954,0cyclictest0-21swapper/119:44:021
59949953,1cyclictest5889-21kworker/1:219:10:111
59949953,1cyclictest17402-21cat19:35:121
59949953,1cyclictest17299-21snmpd21:04:121
59949953,1cyclictest17299-21snmpd20:51:591
59949953,1cyclictest17299-21snmpd20:25:561
59949953,1cyclictest17299-21snmpd20:24:391
59949953,1cyclictest17299-21snmpd19:55:081
59949953,1cyclictest17299-21snmpd19:50:111
59949953,1cyclictest17299-21snmpd19:33:001
59949953,1cyclictest16208-21cat20:55:141
59949952,2cyclictest8952-21cat19:15:121
59899953,1cyclictest9503-21cat20:35:140
59899953,1cyclictest7478-21cat20:30:190
59899953,1cyclictest27582-21cat20:00:120
59899953,1cyclictest17299-21snmpd21:03:550
59899953,1cyclictest17299-21snmpd20:59:220
59899953,1cyclictest17299-21snmpd20:46:240
59899953,1cyclictest17299-21snmpd20:15:110
59899953,1cyclictest17299-21snmpd20:13:310
59899953,1cyclictest17299-21snmpd20:07:530
59899953,1cyclictest17299-21snmpd19:31:160
59899953,1cyclictest1053-21lldpd20:21:060
59899953,1cyclictest0-21swapper/019:10:150
59899952,2cyclictest19593-21sed19:40:150
59899952,2cyclictest17299-21snmpd20:44:290
59899952,2cyclictest17299-21snmpd19:54:260
59899952,2cyclictest15293-21taskset20:52:150
60029942,1cyclictest29173-21cpu20:05:123
59899942,1cyclictest8118-21munin-node20:25:090
59899942,1cyclictest646-21dbus-daemon19:25:010
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional