You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-03 - 08:52
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Thu Jul 03, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24092940,0sleep10-21swapper/122:49:241
195902940,0sleep30-21swapper/323:18:303
225702870,0sleep10-21swapper/123:33:541
44562590,0sleep00-21swapper/000:28:530
163252570,1sleep20-21swapper/221:59:022
61922550,0sleep20-21swapper/222:01:032
126462550,1sleep112631-21sshd23:29:581
296302540,0sleep20-21swapper/223:16:212
169442540,1sleep10-21swapper/121:16:321
126652540,0sleep00-21swapper/023:23:560
235372530,0sleep00-21swapper/021:53:410
49872520,0sleep30-21swapper/300:32:403
93322510,0sleep20-21swapper/200:29:262
90922510,1sleep19087-21lspci21:55:171
29562490,0sleep20-21swapper/222:34:072
274922490,0sleep30-21swapper/321:11:093
33322480,0sleep20-21swapper/223:47:222
33322480,0sleep20-21swapper/223:47:212
317452480,0sleep20-21swapper/223:40:492
123012460,0sleep012295-21bash23:42:030
193512430,1sleep3648-21systemd-logind23:27:323
304102420,1sleep330407-21lspci22:21:313
303012370,2sleep02808299cyclictest00:24:560
194772340,0sleep20-21swapper/200:34:232
261512319,7sleep20-21swapper/219:05:042
276772297,7sleep00-21swapper/019:06:380
279102287,7sleep10-21swapper/119:09:361
275752287,7sleep30-21swapper/319:05:253
28095992423,0cyclictest10375-21lspci22:19:412
177752210,1sleep117768-21lspci23:06:021
65442200,0sleep0111rcuc/022:46:390
98982170,0sleep29897-21grep00:09:562
306092160,1sleep330554-21sshd00:15:133
2809599165,1cyclictest33-21ksoftirqd/221:33:102
142162160,0sleep10-21swapper/122:32:061
53572150,1sleep1231rcuc/123:14:071
284372150,0sleep30-21swapper/323:37:283
28095991514,0cyclictest21821-21lspci23:52:102
28088991513,1cyclictest18572-21sshd21:25:471
2808299150,14cyclictest649-21avahi-daemon23:57:150
216692150,0sleep00-21swapper/000:01:210
215422150,0sleep30-21swapper/322:14:423
148462150,0sleep30-21swapper/321:40:333
12462150,2sleep22809599cyclictest21:36:152
57722140,1sleep15774-21bash21:30:371
3442140,0sleep00-21swapper/022:58:200
278462140,0sleep10-21swapper/100:31:291
121132140,0sleep2311rcuc/222:56:222
34942130,0sleep33492-21sshd23:10:503
289962130,3sleep0101ktimersoftd/022:51:520
28099991311,1cyclictest0-21swapper/323:34:313
28095991312,0cyclictest13657-21lspci23:20:562
2809599130,1cyclictest1095-21nfsd00:36:422
2809599130,0cyclictest0-21swapper/223:04:122
2808899130,1cyclictest646-21dbus-daemon21:21:181
2808299130,1cyclictest13391-21sshd21:43:350
125572130,0sleep30-21swapper/322:41:013
28099991210,1cyclictest5116-21sshd23:53:413
2809999120,11cyclictest681-21gdbus22:25:413
2809999120,11cyclictest23234-21bash22:39:023
2809599123,3cyclictest33-21ksoftirqd/221:26:352
28095991211,0cyclictest30360-21lspci00:02:132
28095991211,0cyclictest22699-21lspci21:14:072
2809599120,1cyclictest9388-21sshd22:40:412
2809599120,11cyclictest19301-21sshd21:22:522
2808299124,4cyclictest20648-21munin-run22:44:590
28082991210,1cyclictest0-21swapper/021:34:050
28082991210,1cyclictest0-21swapper/021:18:150
2808299120,11cyclictest20365-21sshd21:59:250
264502120,0sleep00-21swapper/023:00:440
2809999119,1cyclictest6839-21sshd00:06:213
2809999119,1cyclictest14266-21sshd21:37:313
2809999118,1cyclictest21071-21sshd21:23:013
28099991110,0cyclictest0-21swapper/322:54:413
28099991110,0cyclictest0-21swapper/300:29:213
2809999110,10cyclictest0-21swapper/300:39:423
2809999110,0cyclictest0-21swapper/321:51:313
2809599119,1cyclictest17390-21lspci21:19:412
2809599116,2cyclictest33-21ksoftirqd/200:11:492
2809599114,1cyclictest33-21ksoftirqd/223:30:162
28095991110,0cyclictest3541-21lspci22:22:022
28095991110,0cyclictest0-21swapper/223:38:312
2809599110,10cyclictest0-21swapper/200:18:512
2809599110,0cyclictest0-21swapper/223:29:422
2808899119,1cyclictest1947-21sshd22:00:381
28088991110,0cyclictest26243-21sshd00:08:181
28088991110,0cyclictest0-21swapper/122:40:271
2808899110,10cyclictest0-21swapper/122:10:381
2808899110,10cyclictest0-21swapper/121:44:471
2808899110,10cyclictest0-21swapper/119:50:371
2808899110,0cyclictest0-21swapper/121:37:081
2808299119,1cyclictest3068-21irqstats19:25:150
2808299119,1cyclictest18666-21sshd22:14:250
2808299119,1cyclictest10977-21lspci22:07:350
2808299112,5cyclictest8407-21crond19:40:010
28082991110,0cyclictest0-21swapper/022:18:050
2808299110,10cyclictest0-21swapper/023:11:050
2808299110,10cyclictest0-21swapper/020:50:150
2809999109,0cyclictest0-21swapper/322:31:113
2809999109,0cyclictest0-21swapper/321:29:203
2809999109,0cyclictest0-21swapper/321:03:403
2809999109,0cyclictest0-21swapper/300:11:323
2809999108,1cyclictest29972-21tty21:45:123
2809999108,1cyclictest0-21swapper/322:06:013
2809999100,0cyclictest0-21swapper/323:23:213
2809999100,0cyclictest0-21swapper/300:21:523
2809599109,0cyclictest0-21swapper/223:06:012
2809599108,1cyclictest13275-21sshd21:52:412
2809599108,0cyclictest121rcu_preempt22:50:212
2809599101,1cyclictest16778-21bash22:14:152
2809599100,0cyclictest131rcu_sched23:11:072
2809599100,0cyclictest0-21swapper/223:58:112
2808899109,0cyclictest0-21swapper/123:40:391
2808899109,0cyclictest0-21swapper/123:16:291
2808899100,0cyclictest0-21swapper/123:57:581
2808899100,0cyclictest0-21swapper/123:48:081
2808899100,0cyclictest0-21swapper/123:48:081
2808899100,0cyclictest0-21swapper/121:12:181
2808899100,0cyclictest0-21swapper/100:36:291
2808899100,0cyclictest0-21swapper/100:23:481
2808299109,0cyclictest0-21swapper/023:32:550
2808299109,0cyclictest0-21swapper/022:35:050
2808299109,0cyclictest0-21swapper/021:25:550
2808299109,0cyclictest0-21swapper/000:33:250
2808299109,0cyclictest0-21swapper/000:12:450
2808299100,0cyclictest0-21swapper/023:17:360
2808299100,0cyclictest0-21swapper/021:12:260
136172100,0sleep00-21swapper/023:39:100
280999998,0cyclictest0-21swapper/323:56:013
280999998,0cyclictest0-21swapper/322:48:423
280999998,0cyclictest0-21swapper/319:35:003
280999997,1cyclictest23714-21id23:46:123
280999997,1cyclictest23714-21id23:46:113
280999990,0cyclictest0-21swapper/320:11:513
280999990,0cyclictest0-21swapper/320:01:503
280959998,0cyclictest0-21swapper/221:46:222
280959997,1cyclictest33-21ksoftirqd/222:05:262
280959996,1cyclictest33-21ksoftirqd/222:40:002
280959992,1cyclictest33-21ksoftirqd/222:45:372
280959992,1cyclictest33-21ksoftirqd/200:21:002
280959991,1cyclictest33-21ksoftirqd/222:25:152
280959990,2cyclictest0-21swapper/219:15:002
280829997,1cyclictest20105-21/usr/sbin/munin20:10:150
280829996,2cyclictest649-21avahi-daemon22:20:580
280829996,2cyclictest21773-21kworker/0:000:35:220
280999987,0cyclictest0-21swapper/323:08:313
280999987,0cyclictest0-21swapper/321:32:313
280999987,0cyclictest0-21swapper/320:52:503
280999987,0cyclictest0-21swapper/300:01:113
280999986,1cyclictest5875-21sshd22:01:013
280999986,1cyclictest41-21ksoftirqd/321:56:103
280959983,4cyclictest646-21dbus-daemon21:40:032
280889987,0cyclictest28986-21sshd22:57:571
280889987,0cyclictest10667-21bash23:20:381
280889987,0cyclictest0-21swapper/123:50:281
280889987,0cyclictest0-21swapper/119:31:371
280889987,0cyclictest0-21swapper/100:15:481
280889986,1cyclictest16541-21lspci22:53:481
280889986,1cyclictest10434-21ntpdc00:00:191
280889985,2cyclictest649-21avahi-daemon22:05:581
280829987,0cyclictest0-21swapper/022:02:360
280829987,0cyclictest0-21swapper/021:22:450
280829987,0cyclictest0-21swapper/000:15:050
280829986,1cyclictest5772-21lspci22:28:180
280829986,1cyclictest31185-21sshd23:46:550
280829986,1cyclictest31185-21sshd23:46:550
280829986,1cyclictest25317-21lspci23:09:560
280999975,1cyclictest670-21packagekitd23:00:553
280999975,1cyclictest29437-21sleep20:35:013
280999975,1cyclictest1529-21sshd23:44:083
280999975,1cyclictest13659-21sshd22:56:313
280999974,2cyclictest684-21polkitd21:17:143
280999974,2cyclictest649-21avahi-daemon22:15:163
280959976,0cyclictest0-21swapper/221:08:012
280889975,1cyclictest684-21polkitd22:28:451
280889975,1cyclictest649-21avahi-daemon21:45:051
280889975,1cyclictest6077-21id21:51:591
280889975,1cyclictest4333-21lspci23:38:161
280889975,1cyclictest15500-21lspci23:02:501
280889974,2cyclictest649-21avahi-daemon22:36:331
280889974,2cyclictest31883-21sshd00:25:051
280889974,2cyclictest1011-21sshd00:11:541
280889973,3cyclictest16227-21sshd22:20:141
280889973,1cyclictest8414-21idleruntime-cro19:40:011
280889970,6cyclictest0-21swapper/120:06:171
280829976,1cyclictest3564-21lspci22:31:050
280829975,1cyclictest9-21ksoftirqd/000:05:140
280829975,1cyclictest684-21polkitd23:28:250
280829975,1cyclictest649-21avahi-daemon21:46:250
280829975,1cyclictest649-21avahi-daemon21:35:110
280829974,2cyclictest646-21dbus-daemon23:50:430
11706270,0sleep10-21swapper/122:16:441
280999965,0cyclictest0-21swapper/319:43:403
280999965,0cyclictest0-21swapper/319:15:403
280999964,1cyclictest23315-21latency_hist20:20:003
280999964,1cyclictest23315-21latency_hist20:20:003
280999964,1cyclictest12859-21sshd21:08:123
280999963,2cyclictest17299-21snmpd20:59:373
280959964,1cyclictest33-21ksoftirqd/219:20:012
280959964,1cyclictest26646-21smart_sda20:25:182
280959963,2cyclictest17299-21snmpd20:17:562
280959963,2cyclictest17299-21snmpd20:17:562
280959960,5cyclictest0-21swapper/219:10:412
280889965,0cyclictest0-21swapper/120:41:571
280889963,2cyclictest646-21dbus-daemon21:08:521
280889963,2cyclictest17299-21snmpd20:30:081
280889963,2cyclictest17299-21snmpd20:12:261
280889960,5cyclictest0-21swapper/120:25:571
280889960,3cyclictest31632load19:25:151
280829965,0cyclictest0-21swapper/019:49:150
280829964,1cyclictest646-21dbus-daemon21:08:060
280829963,2cyclictest1034-21in:imjournal20:35:000
280999953,1cyclictest681-21gdbus19:30:003
280999953,1cyclictest32191-21cat20:40:143
280999953,1cyclictest30115-21cat20:35:143
280999953,1cyclictest24039-21cat20:20:143
280999953,1cyclictest17941-21cat20:05:163
280999953,1cyclictest17299-21snmpd20:25:023
280999953,1cyclictest17299-21snmpd19:55:133
280999953,1cyclictest17299-21snmpd19:52:403
280999953,1cyclictest17299-21snmpd19:45:113
280999953,1cyclictest17299-21snmpd19:13:303
280999952,2cyclictest646-21dbus-daemon19:20:013
280999952,2cyclictest3085-21taskset20:48:543
280999952,2cyclictest17299-21snmpd19:29:363
280959953,1cyclictest9148-21cat19:40:152
280959953,1cyclictest7070-21cat19:35:142
280959953,1cyclictest682-21lsmd20:10:032
280959953,1cyclictest5949-21cat20:55:172
280959953,1cyclictest3792-21grep20:50:122
280959953,1cyclictest33-21ksoftirqd/219:30:002
280959953,1cyclictest17299-21snmpd21:02:002
280959953,1cyclictest17299-21snmpd20:41:232
280959953,1cyclictest17299-21snmpd20:35:592
280959953,1cyclictest17299-21snmpd20:20:332
280959953,1cyclictest17299-21snmpd20:08:282
280959953,1cyclictest17299-21snmpd20:02:442
280959953,1cyclictest17299-21snmpd19:56:282
280959953,1cyclictest17299-21snmpd19:50:072
280959953,1cyclictest17299-21snmpd19:48:232
280959953,1cyclictest1049-21rpcbind20:31:322
280959951,3cyclictest2637-21tr19:25:122
280959950,0cyclictest0-21swapper/220:46:422
280889953,1cyclictest684-21polkitd21:01:001
280889953,1cyclictest30811-21mii-tool19:15:011
280889953,1cyclictest30153-21cat20:35:141
280889953,1cyclictest17299-21snmpd20:55:101
280889953,1cyclictest17299-21snmpd20:50:141
280889953,1cyclictest17299-21snmpd20:21:451
280889953,1cyclictest17299-21snmpd20:15:021
280889953,1cyclictest17299-21snmpd20:15:021
280889953,1cyclictest17299-21snmpd20:02:051
280889953,1cyclictest17299-21snmpd19:56:011
280889953,1cyclictest17299-21snmpd19:47:251
280889953,1cyclictest17299-21snmpd19:41:041
280889953,1cyclictest17299-21snmpd19:10:431
280889952,2cyclictest2682-21unixbench_multi20:45:231
280829954,0cyclictest0-21swapper/020:35:160
280829954,0cyclictest0-21swapper/019:53:360
280829954,0cyclictest0-21swapper/019:10:560
280829953,1cyclictest32195-21cat20:40:140
280829953,1cyclictest25586-21/usr/sbin/munin20:25:190
280829953,1cyclictest2226-21ntpdc20:45:190
280829953,1cyclictest18487-21sendmail_mailtr20:05:200
280829953,1cyclictest17299-21snmpd21:02:300
280829953,1cyclictest17299-21snmpd20:55:180
280829953,1cyclictest17299-21snmpd20:15:480
280829953,1cyclictest17299-21snmpd20:15:470
280829953,1cyclictest17299-21snmpd19:55:160
280829953,1cyclictest17299-21snmpd19:41:370
280829953,1cyclictest17299-21snmpd19:30:480
280829953,1cyclictest17299-21snmpd19:15:420
280829953,1cyclictest1053-21lldpd20:20:140
280829953,1cyclictest1053-21lldpd20:02:010
280889942,1cyclictest17299-21snmpd19:20:121
280829942,1cyclictest1441-21ls19:20:170
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional