You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-09 - 05:49
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack2slot0.osadl.org (updated Fri May 09, 2025 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1812921020,0sleep018128-21bash23:33:250
138742930,1sleep113871-21sshd22:15:431
314992800,1sleep09-21ksoftirqd/022:33:400
233382790,1sleep023340-21bash22:39:210
323512780,2sleep21173199cyclictest00:07:232
179772770,0sleep30-21swapper/322:51:463
108872760,1sleep341-21ksoftirqd/300:29:233
137972690,0sleep00-21swapper/000:26:040
298742570,0sleep10-21swapper/122:20:271
168262570,1sleep316825-21bash00:30:023
94852550,1sleep19478-21lspci21:30:161
74852530,0sleep30-21swapper/321:52:333
83662510,1sleep11-21systemd23:58:131
9772500,0sleep00-21swapper/023:06:010
141242500,0sleep20-21swapper/221:30:422
114342500,0sleep21-21systemd21:56:102
201752490,0sleep020157-21sshd23:40:010
164232490,0sleep20-21swapper/220:40:002
306532480,1sleep130655-21bash23:44:191
154512470,0sleep10-21swapper/123:26:411
176982430,0sleep10-21swapper/121:18:191
175022430,0sleep10-21swapper/120:40:151
1139423126,3sleep20-21swapper/219:07:202
1124422918,7sleep00-21swapper/019:05:260
113492288,6sleep10-21swapper/119:06:471
100642274,7sleep30-21swapper/319:05:123
74042210,1sleep3391rcuc/323:45:123
41842200,0sleep20-21swapper/222:56:492
221682180,1sleep0646-21dbus-daemon22:52:110
161182180,1sleep11011-21sshd22:54:531
52032170,0sleep10-21swapper/123:51:241
34312170,0sleep00-21swapper/022:05:080
67002160,0sleep2311rcuc/221:23:422
312802160,0sleep30-21swapper/300:03:563
309972160,1sleep230993-21sshd23:54:012
61862150,0sleep00-21swapper/023:58:000
222162150,1sleep30-21swapper/322:10:133
199192150,0sleep219908-21lspci22:13:122
1174099158,6cyclictest648-21systemd-logind22:00:553
291532140,0sleep229147-21lspci23:18:332
198472140,0sleep3401ktimersoftd/322:10:003
159582140,0sleep115959-21bash22:03:101
147442140,0sleep20-21swapper/223:01:022
1174099140,13cyclictest0-21swapper/322:15:243
236002130,0sleep00-21swapper/000:09:570
145782130,0sleep214565-21cp21:18:002
1174099136,1cyclictest649-21avahi-daemon21:45:153
1174099135,2cyclictest649-21avahi-daemon23:43:523
1174099135,2cyclictest4475-21sshd22:37:263
11740991310,2cyclictest0-21swapper/321:27:543
1174099130,1cyclictest15741-21tty22:28:553
1174099130,12cyclictest0-21swapper/322:56:343
11731991311,1cyclictest8231-21lspci00:29:032
1173199130,1cyclictest1-21systemd21:37:332
1171899130,12cyclictest24142-21sshd00:34:360
1171899130,12cyclictest14384-21id00:19:170
285572120,0sleep128559-21bash22:10:471
1174099128,3cyclictest0-21swapper/321:42:243
1174099128,3cyclictest0-21swapper/300:05:053
1174099126,1cyclictest616-17auditd21:17:243
1174099126,1cyclictest12419-21sshd21:20:573
1174099125,1cyclictest700-21gdbus23:36:463
1174099125,1cyclictest649-21avahi-daemon23:08:013
1174099125,1cyclictest649-21avahi-daemon23:03:253
1174099124,2cyclictest700-21gdbus21:34:483
1174099124,2cyclictest649-21avahi-daemon22:22:163
1174099124,2cyclictest649-21avahi-daemon00:12:233
1174099124,2cyclictest649-21avahi-daemon00:12:223
1174099124,2cyclictest28790-21sshd21:13:083
1174099124,2cyclictest2509-21sshd23:15:483
1174099124,2cyclictest20157-21sshd22:45:313
1174099123,3cyclictest700-21gdbus00:16:193
11740991210,1cyclictest0-21swapper/323:59:243
11740991210,1cyclictest0-21swapper/300:22:053
11731991210,1cyclictest21877-21sshd22:39:132
11731991210,1cyclictest13501-21sshd22:31:522
1173199120,1cyclictest0-21swapper/222:44:522
1173199120,11cyclictest0-21swapper/222:52:132
11723991210,1cyclictest27957-21sshd22:55:561
1172399120,11cyclictest9111-21rm23:48:361
11718991210,1cyclictest0-21swapper/023:28:460
1171899120,1cyclictest17117-21bash23:52:360
1174099114,1cyclictest700-21gdbus23:11:203
1174099114,1cyclictest684-21polkitd23:22:053
1174099114,1cyclictest684-21polkitd00:37:393
1174099114,1cyclictest649-21avahi-daemon23:50:123
1174099114,1cyclictest649-21avahi-daemon23:31:413
1174099114,1cyclictest649-21avahi-daemon22:40:413
1174099114,1cyclictest649-21avahi-daemon22:31:463
1174099114,1cyclictest649-21avahi-daemon21:58:213
1174099114,1cyclictest649-21avahi-daemon21:35:213
1174099113,1cyclictest646-21dbus-daemon23:25:583
11731991110,0cyclictest0-21swapper/200:31:522
1173199110,10cyclictest0-21swapper/221:45:232
1173199110,10cyclictest0-21swapper/200:12:032
1173199110,10cyclictest0-21swapper/200:12:022
1173199110,0cyclictest0-21swapper/222:18:222
1173199110,0cyclictest0-21swapper/200:20:322
1172399110,10cyclictest0-21swapper/123:31:371
1172399110,0cyclictest0-21swapper/122:38:271
1171899110,0cyclictest0-21swapper/023:46:570
1171899110,0cyclictest0-21swapper/022:11:560
1173199109,0cyclictest0-21swapper/223:55:032
1173199109,0cyclictest0-21swapper/221:54:222
1173199109,0cyclictest0-21swapper/221:09:232
1173199109,0cyclictest0-21swapper/220:05:232
1173199108,1cyclictest646-21dbus-daemon23:49:222
1173199108,1cyclictest0-21swapper/223:23:522
1173199100,0cyclictest0-21swapper/220:30:032
1173199100,0cyclictest0-21swapper/200:17:422
1173199100,0cyclictest0-21swapper/200:03:322
1172399109,0cyclictest25136-21lspci23:37:161
1172399109,0cyclictest0-21swapper/123:06:071
1172399109,0cyclictest0-21swapper/122:28:171
1171899109,0cyclictest0-21swapper/023:03:160
1171899109,0cyclictest0-21swapper/022:47:260
1171899109,0cyclictest0-21swapper/022:29:570
1171899109,0cyclictest0-21swapper/021:38:570
1171899109,0cyclictest0-21swapper/000:37:260
1171899108,1cyclictest31578-21lspci00:03:560
1171899100,9cyclictest347-21sshd21:32:360
117319998,0cyclictest0-21swapper/220:28:522
117319998,0cyclictest0-21swapper/219:50:532
117319998,0cyclictest0-21swapper/219:15:222
117319998,0cyclictest0-21swapper/200:37:332
117239998,0cyclictest0-21swapper/122:48:361
117239998,0cyclictest0-21swapper/121:50:471
117239997,1cyclictest25-21ksoftirqd/121:29:231
117239997,1cyclictest0-21swapper/123:03:171
117239990,1cyclictest21092-21tty22:42:221
117189998,0cyclictest0-21swapper/000:22:060
117189997,2cyclictest7594-21kworker/0:221:51:430
117189997,2cyclictest28435-21kworker/0:022:57:040
117189997,1cyclictest18050-21sshd22:22:360
117189996,3cyclictest29428-21kworker/0:322:02:090
117189996,3cyclictest24720-21kworker/0:123:24:000
117189996,3cyclictest23209-21kworker/0:200:10:050
117189996,3cyclictest23209-21kworker/0:200:10:040
117189996,3cyclictest22906-21kworker/0:123:11:080
117189996,2cyclictest31706-21kworker/0:222:40:110
117189996,2cyclictest31706-21kworker/0:222:18:310
117189996,2cyclictest31598-21kworker/0:321:21:250
10884290,1sleep210881-21lspci23:13:272
18264280,1sleep218265-21cpu23:30:142
12772280,1sleep2311rcuc/222:25:182
117319987,0cyclictest0-21swapper/222:49:222
117319987,0cyclictest0-21swapper/221:02:122
117319987,0cyclictest0-21swapper/220:42:532
117319986,1cyclictest4378-21sshd22:24:332
117319985,2cyclictest649-21avahi-daemon23:42:532
117319985,2cyclictest649-21avahi-daemon23:25:122
117319985,2cyclictest649-21avahi-daemon21:43:282
117319984,3cyclictest700-21gdbus23:35:082
117239987,0cyclictest0-21swapper/121:40:061
117239987,0cyclictest0-21swapper/121:20:071
117239986,1cyclictest8376-21lspci21:46:141
117239986,1cyclictest7575-21sshd21:59:081
117239986,1cyclictest25846-21lspci00:13:441
117239986,1cyclictest25846-21lspci00:13:431
117239986,1cyclictest25-21ksoftirqd/123:17:061
117239986,1cyclictest25-21ksoftirqd/122:31:511
117239986,1cyclictest25-21ksoftirqd/122:05:461
117239986,1cyclictest25-21ksoftirqd/100:38:011
117239986,1cyclictest10269-21sshd00:01:361
117239985,2cyclictest649-21avahi-daemon21:36:401
117239984,1cyclictest25-21ksoftirqd/123:20:141
117239983,4cyclictest684-21polkitd00:33:061
117239980,0cyclictest131rcu_sched00:19:391
117189986,2cyclictest6340-21kworker/0:323:15:030
117189986,2cyclictest386-21kworker/0:021:40:500
117189986,2cyclictest31598-21kworker/0:321:25:030
117189986,2cyclictest29428-21kworker/0:321:55:060
117189986,2cyclictest29428-21kworker/0:321:45:430
117189986,2cyclictest28468-21kworker/0:221:10:190
117189986,2cyclictest28416-21kworker/0:121:16:200
117189986,2cyclictest11749-21kworker/0:123:35:120
19611270,5sleep1648-21systemd-logind00:05:591
117409976,0cyclictest0-21swapper/321:09:453
117409976,0cyclictest0-21swapper/319:19:553
117319975,1cyclictest649-21avahi-daemon21:25:482
117319975,1cyclictest33-21ksoftirqd/222:00:232
117319974,2cyclictest5284-21sshd21:10:222
117319973,3cyclictest646-21dbus-daemon23:07:342
117319972,3cyclictest8232-21sshd22:05:312
117239975,1cyclictest649-21avahi-daemon21:13:351
117239975,1cyclictest29970-21sshd21:08:361
117239975,1cyclictest25-21ksoftirqd/123:12:181
117239975,1cyclictest25-21ksoftirqd/100:20:101
117239975,1cyclictest10174-21lspci00:25:391
117189975,2cyclictest28416-21kworker/0:121:08:460
117409965,0cyclictest0-21swapper/320:20:143
117409963,2cyclictest17299-21snmpd20:32:063
117409963,2cyclictest17299-21snmpd20:08:473
117409960,5cyclictest0-21swapper/320:43:053
117409960,5cyclictest0-21swapper/319:14:143
117319965,0cyclictest0-21swapper/219:43:432
117319960,5cyclictest0-21swapper/220:21:232
117319960,5cyclictest0-21swapper/220:14:322
117239965,0cyclictest0-21swapper/119:30:161
117239964,1cyclictest684-21polkitd20:40:001
117239963,2cyclictest17299-21snmpd20:46:391
117239963,2cyclictest17299-21snmpd20:20:531
117189966,0cyclictest18414-21kworker/0:020:55:150
117189966,0cyclictest18414-21kworker/0:020:50:100
117189966,0cyclictest18328-21kworker/0:020:05:150
117189966,0cyclictest14395-21kworker/0:120:40:180
117189963,2cyclictest17299-21snmpd20:48:390
117409953,1cyclictest646-21dbus-daemon21:00:003
117409953,1cyclictest26996-21grep19:45:143
117409953,1cyclictest19122-21cat20:45:153
117409953,1cyclictest19031-21cat19:25:163
117409953,1cyclictest17299-21snmpd20:50:143
117409953,1cyclictest17299-21snmpd20:35:383
117409953,1cyclictest17299-21snmpd20:25:283
117409953,1cyclictest17299-21snmpd20:16:143
117409953,1cyclictest17299-21snmpd20:01:433
117409953,1cyclictest17299-21snmpd19:55:063
117409953,1cyclictest17299-21snmpd19:50:283
117409953,1cyclictest17299-21snmpd19:41:103
117409953,1cyclictest17299-21snmpd19:35:333
117409953,1cyclictest17299-21snmpd19:30:423
117409953,1cyclictest17299-21snmpd19:21:453
117409952,2cyclictest17299-21snmpd20:13:553
117409950,0cyclictest0-21swapper/320:57:353
117319954,0cyclictest0-21swapper/219:25:322
117319954,0cyclictest0-21swapper/219:21:012
117319953,1cyclictest831-21cat20:00:132
117319953,1cyclictest31611-21ls19:55:172
117319953,1cyclictest17299-21snmpd20:57:452
117319953,1cyclictest17299-21snmpd20:51:052
117319953,1cyclictest17299-21snmpd20:45:512
117319953,1cyclictest17299-21snmpd20:15:352
117319953,1cyclictest17299-21snmpd19:46:572
117319953,1cyclictest17299-21snmpd19:39:152
117319953,1cyclictest17299-21snmpd19:33:132
117319953,1cyclictest17299-21snmpd19:10:082
117239954,0cyclictest0-21swapper/121:00:161
117239954,0cyclictest0-21swapper/119:13:351
117239953,1cyclictest25115-21cat19:40:131
117239953,1cyclictest17299-21snmpd20:56:091
117239953,1cyclictest17299-21snmpd20:52:561
117239953,1cyclictest17299-21snmpd20:31:321
117239953,1cyclictest17299-21snmpd20:29:161
117239953,1cyclictest17299-21snmpd20:17:221
117239953,1cyclictest17299-21snmpd20:12:161
117239953,1cyclictest17299-21snmpd20:05:111
117239953,1cyclictest17299-21snmpd19:55:501
117239953,1cyclictest17299-21snmpd19:27:091
117239953,1cyclictest17299-21snmpd19:22:361
117239953,1cyclictest14936-21cat19:15:151
117239953,1cyclictest0-21swapper/119:35:131
117239952,2cyclictest1259-21ntp_states20:00:151
117189955,0cyclictest18414-21kworker/0:021:00:130
117189955,0cyclictest18328-21kworker/0:020:20:490
117189955,0cyclictest18328-21kworker/0:020:15:240
117189955,0cyclictest18328-21kworker/0:020:10:010
117189955,0cyclictest18328-21kworker/0:020:00:460
117189955,0cyclictest18328-21kworker/0:019:50:100
117189955,0cyclictest18328-21kworker/0:019:45:010
117189955,0cyclictest18328-21kworker/0:019:40:110
117189955,0cyclictest18328-21kworker/0:019:35:000
117189955,0cyclictest18328-21kworker/0:019:30:190
117189955,0cyclictest13677-21kworker/0:219:20:090
117189955,0cyclictest11607-21kworker/0:119:10:180
117189955,0cyclictest10296-21kworker/0:220:30:130
117189953,1cyclictest17299-21snmpd20:26:130
117189953,1cyclictest17299-21snmpd19:25:510
117189953,1cyclictest17299-21snmpd19:15:130
117189953,1cyclictest15096-21cat20:35:120
117189950,4cyclictest0-21swapper/019:55:060
117239942,1cyclictest684-21polkitd19:44:591
117239942,1cyclictest28852-21ls19:50:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional