You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 21:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack2slot0.osadl.org (updated Thu Apr 25, 2024 12:43:48)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
77192820,0sleep27720-21sshd10:27:432
134502580,0sleep00-21swapper/009:19:000
284472560,0sleep20-21swapper/211:59:322
133522550,0sleep30-21swapper/309:24:483
44882540,0sleep10-21swapper/110:30:191
22832530,0sleep20-21swapper/208:45:142
226932520,1sleep122689-21sshd11:47:161
187182520,1sleep31-21systemd10:28:443
228142510,0sleep10-21swapper/112:16:451
95142500,0sleep20-21swapper/209:05:012
83582500,0sleep20-21swapper/209:48:062
305692500,0sleep30-21swapper/309:40:543
170802500,1sleep0111rcuc/011:40:550
168962500,0sleep10-21swapper/110:28:351
238252490,0sleep10-21swapper/109:31:311
128012490,0sleep00-21swapper/010:06:540
202102480,0sleep30-21swapper/311:44:103
11842480,1sleep12680099cyclictest12:08:511
93832470,0sleep29385-21bash11:17:462
196652470,0sleep219666-21lspci09:55:112
29612460,0sleep20-21swapper/211:03:162
241892450,0sleep30-21swapper/309:49:353
92352440,1sleep19233-21lspci11:51:491
92352440,1sleep19233-21lspci11:51:491
2666924125,6sleep20-21swapper/207:09:502
96152400,2sleep02679599cyclictest10:03:380
264612308,7sleep30-21swapper/307:07:153
296312290,1sleep32681299cyclictest11:56:363
266122229,7sleep10-21swapper/107:09:091
2640922210,7sleep00-21swapper/007:06:360
26800991918,0cyclictest241ktimersoftd/110:19:341
153202190,0sleep0111rcuc/010:34:170
88822180,1sleep233-21ksoftirqd/212:06:322
27582180,1sleep341-21ksoftirqd/310:33:093
136232180,0sleep20-21swapper/211:46:262
295592170,0sleep10-21swapper/111:42:041
287202170,0sleep10-21swapper/112:02:271
88802160,0sleep10-21swapper/109:54:091
87762160,0sleep10-21swapper/109:12:451
26800991615,0cyclictest523-40kipmi011:25:181
26800991614,1cyclictest4997-21kworker/1:211:30:581
278212150,0sleep20-21swapper/209:43:542
26800991515,0cyclictest10980-21kworker/1:009:43:401
26800991514,0cyclictest3070-21kworker/1:107:40:161
26800991513,1cyclictest3130-21kworker/1:412:10:501
236452150,0sleep00-21swapper/011:19:000
101982150,0sleep20-21swapper/212:21:262
76242140,0sleep30-21swapper/310:39:263
58412140,0sleep30-21swapper/311:51:313
58412140,0sleep30-21swapper/311:51:303
41472140,1sleep14149-21id10:36:081
319572140,0sleep00-21swapper/009:29:210
2681299140,12cyclictest1-21systemd10:03:473
2680699140,2cyclictest648-21systemd-logind09:35:242
26800991414,0cyclictest9417-21kworker/1:109:05:121
26800991413,0cyclictest8305-21kworker/1:309:55:181
26800991413,0cyclictest24861-21kworker/1:111:20:331
26800991412,1cyclictest700-21gdbus09:25:151
26800991412,1cyclictest4108-21kworker/1:111:01:101
26800991412,1cyclictest20365-21kworker/1:112:24:221
26800991412,1cyclictest15995-21kworker/1:312:33:111
2679599142,11cyclictest0-21swapper/011:49:100
24772140,2sleep02679599cyclictest12:08:590
96112130,0sleep20-21swapper/209:12:492
2681299130,1cyclictest30174-21sshd11:27:483
26800991312,0cyclictest3913-21kworker/1:411:06:521
26800991312,0cyclictest33050irq/27-ahci[00010:41:011
26800991312,0cyclictest23620-21kworker/1:110:05:421
26800991312,0cyclictest23568-21kworker/1:010:45:341
26800991311,1cyclictest3070-21kworker/1:107:35:231
111612130,0sleep0111rcuc/011:52:010
111612130,0sleep0111rcuc/011:52:010
26812991210,1cyclictest4040-21sshd12:09:083
26812991210,1cyclictest1-21systemd09:53:583
2681299120,1cyclictest30568-21bash11:16:483
2681299120,11cyclictest9945-21sshd11:00:383
2681299120,11cyclictest0-21swapper/312:18:273
26806991210,1cyclictest646-21dbus-daemon10:43:242
26806991210,1cyclictest3919-21id12:26:452
26806991210,1cyclictest29697-21sshd11:42:052
26806991210,1cyclictest2750-21sshd11:06:042
2680699120,1cyclictest0-21swapper/210:57:152
2680699120,11cyclictest30685-21sshd10:38:352
2680699120,0cyclictest17225-21sshd09:16:252
2680099123,1cyclictest25-21ksoftirqd/109:36:021
26800991212,0cyclictest523-40kipmi008:06:171
26800991212,0cyclictest21398-21kworker/1:208:15:161
26800991211,0cyclictest29239-21kworker/1:010:58:011
26800991211,0cyclictest28317-21lspci10:53:061
26800991211,0cyclictest21398-21kworker/1:208:20:181
26800991210,1cyclictest3130-21kworker/1:411:56:481
26800991210,1cyclictest29051-21kworker/1:011:36:001
2680099120,11cyclictest0-21swapper/112:26:071
2680099120,11cyclictest0-21swapper/110:10:471
26795991210,1cyclictest23853-21sshd11:05:110
2679599120,1cyclictest431-21sshd12:17:410
2679599120,1cyclictest21166-21bash11:27:010
2679599120,11cyclictest4042-21bash11:36:510
2681299119,1cyclictest25274-21sshd09:34:383
2681299119,1cyclictest12622-21sshd09:57:383
26812991110,0cyclictest12621-21lspci11:07:013
26812991110,0cyclictest0-21swapper/311:13:083
2681299110,10cyclictest22015-21lspci09:19:483
26806991110,0cyclictest0-21swapper/211:34:042
26806991110,0cyclictest0-21swapper/210:23:352
26806991110,0cyclictest0-21swapper/209:54:452
2680699110,10cyclictest0-21swapper/210:04:352
26800991111,0cyclictest29199-21kworker/1:409:45:241
26800991110,1cyclictest14125-21kworker/1:009:19:241
26800991110,0cyclictest21398-21kworker/1:208:25:091
2679599119,1cyclictest0-21swapper/010:37:010
26795991110,0cyclictest0-21swapper/010:58:400
26795991110,0cyclictest0-21swapper/009:41:410
2679599110,10cyclictest0-21swapper/009:56:510
2679599110,10cyclictest0-21swapper/009:53:110
2679599110,0cyclictest0-21swapper/010:43:410
20972110,1sleep10-21swapper/112:38:241
63592100,0sleep00-21swapper/010:54:050
5052100,0sleep2321ktimersoftd/212:35:162
2681299109,0cyclictest0-21swapper/312:23:283
2681299109,0cyclictest0-21swapper/310:21:383
2681299109,0cyclictest0-21swapper/309:25:083
2681299108,1cyclictest41-21ksoftirqd/310:50:013
2681299108,1cyclictest27944-21bash12:25:583
2681299108,1cyclictest22135-21lspci09:10:573
2681299100,0cyclictest0-21swapper/310:08:083
2680699109,0cyclictest0-21swapper/212:31:442
2680699109,0cyclictest0-21swapper/212:00:352
2680699109,0cyclictest0-21swapper/210:30:452
2680699108,1cyclictest25059-21sshd09:22:552
2680099102,1cyclictest25-21ksoftirqd/111:12:561
26800991010,0cyclictest31891-21kworker/1:311:19:001
26800991010,0cyclictest14991-21kworker/1:210:24:461
2680099100,9cyclictest0-21swapper/108:50:461
2680099100,0cyclictest0-21swapper/107:55:161
2679599109,0cyclictest0-21swapper/012:25:110
2679599109,0cyclictest0-21swapper/011:14:110
2679599109,0cyclictest0-21swapper/009:01:100
2679599106,3cyclictest4672-21kworker/0:310:22:370
2679599100,0cyclictest0-21swapper/012:22:410
2679599100,0cyclictest0-21swapper/011:21:300
2679599100,0cyclictest0-21swapper/008:40:310
2679599100,0cyclictest0-21swapper/008:40:300
29576290,0sleep3391rcuc/311:36:133
268129998,0cyclictest0-21swapper/311:45:383
268129997,1cyclictest41-21ksoftirqd/309:39:593
268129997,1cyclictest31329-21sshd10:44:283
268069998,0cyclictest0-21swapper/210:08:552
268069993,4cyclictest1912-21sshd12:14:552
268009998,0cyclictest0-21swapper/110:03:571
268009994,1cyclictest25-21ksoftirqd/109:20:341
267959998,0cyclictest0-21swapper/012:35:110
267959998,0cyclictest0-21swapper/011:57:110
267959998,0cyclictest0-21swapper/009:24:210
267959997,2cyclictest30965-21kworker/0:109:39:570
267959997,2cyclictest17088-21kworker/0:012:14:390
267959997,1cyclictest10155-21bash10:25:010
267959997,1cyclictest0-21swapper/012:30:110
267959996,2cyclictest27871-21kworker/0:410:46:590
268129987,0cyclictest0-21swapper/311:31:273
268129987,0cyclictest0-21swapper/308:45:183
268129986,1cyclictest1999-21lspci10:15:123
268129985,2cyclictest700-21gdbus12:30:323
268129985,2cyclictest649-21avahi-daemon10:10:323
268069987,0cyclictest0-21swapper/210:51:552
268069986,1cyclictest23162-21lspci09:34:262
268069986,1cyclictest1188-21lspci11:22:352
268069986,1cyclictest0-21swapper/209:29:252
268069985,2cyclictest649-21avahi-daemon10:15:402
268009987,0cyclictest27508-21kworker/1:108:30:221
267959986,2cyclictest24201-21kworker/0:209:45:090
267959986,2cyclictest22748-21kworker/0:109:31:430
267959986,2cyclictest19190-21kworker/0:210:15:070
267959986,2cyclictest16360-21kworker/0:312:00:550
267959986,2cyclictest13871-21kworker/0:311:01:370
267959986,2cyclictest12387-21kworker/0:411:30:030
267959986,2cyclictest12143-21kworker/0:209:10:290
267959986,2cyclictest10247-21kworker/0:410:10:170
268129975,1cyclictest684-21polkitd11:21:563
268129975,1cyclictest41-21ksoftirqd/312:11:263
268129975,1cyclictest3851-21lspci10:50:503
268129975,1cyclictest10351-21sshd12:36:093
268129974,2cyclictest684-21polkitd12:00:113
268129972,4cyclictest616-13auditd10:56:053
268069976,0cyclictest0-21swapper/211:35:552
268069976,0cyclictest0-21swapper/211:26:052
268069976,0cyclictest0-21swapper/207:45:042
268069975,1cyclictest684-21polkitd11:10:052
268069975,1cyclictest32099-21lspci10:11:542
268069975,1cyclictest0-21swapper/211:50:052
268069975,1cyclictest0-21swapper/211:50:042
268069974,2cyclictest648-21systemd-logind12:16:262
268069973,3cyclictest6042-21sshd10:45:072
268009977,0cyclictest17326-21kworker/1:008:11:481
268009976,0cyclictest31578-21kworker/1:008:44:441
268009976,0cyclictest31578-21kworker/1:008:44:441
267959977,0cyclictest19401-21kworker/0:108:16:550
267959976,0cyclictest0-21swapper/007:10:490
268129964,1cyclictest17299-21snmpd08:00:113
268129963,2cyclictest17299-21snmpd08:07:393
268129963,2cyclictest17299-21snmpd07:53:143
268129963,2cyclictest17299-21snmpd07:26:103
268129960,5cyclictest0-21swapper/308:51:583
268069965,0cyclictest0-21swapper/208:38:552
268069965,0cyclictest0-21swapper/208:08:542
268069965,0cyclictest0-21swapper/208:03:542
268069963,2cyclictest17299-21snmpd09:06:172
268069963,2cyclictest17299-21snmpd08:28:262
268069962,1cyclictest0-21swapper/208:55:322
268069962,1cyclictest0-21swapper/207:19:362
268009966,0cyclictest31347-21kworker/1:207:24:301
268009966,0cyclictest3070-21kworker/1:107:54:081
268009965,0cyclictest0-21swapper/108:48:451
268009962,3cyclictest616-13auditd07:20:001
268009960,5cyclictest0-21swapper/107:49:461
267959966,0cyclictest9180-21kworker/0:207:55:470
267959966,0cyclictest19401-21kworker/0:108:32:310
267959966,0cyclictest19401-21kworker/0:108:25:490
267959966,0cyclictest19401-21kworker/0:108:10:190
267959965,0cyclictest19401-21kworker/0:108:20:010
267959964,1cyclictest649-21avahi-daemon07:30:000
267959960,5cyclictest0-21swapper/007:34:410
27984250,0sleep20-21swapper/207:10:182
268129954,0cyclictest0-21swapper/307:55:583
268129953,1cyclictest684-21polkitd07:10:003
268129953,1cyclictest17299-21snmpd09:05:503
268129953,1cyclictest17299-21snmpd08:55:333
268129953,1cyclictest17299-21snmpd08:35:183
268129953,1cyclictest17299-21snmpd08:31:093
268129953,1cyclictest17299-21snmpd08:26:363
268129953,1cyclictest17299-21snmpd08:20:573
268129953,1cyclictest17299-21snmpd08:12:263
268129953,1cyclictest17299-21snmpd07:43:083
268129953,1cyclictest17299-21snmpd07:35:323
268129953,1cyclictest17299-21snmpd07:32:263
268129953,1cyclictest17299-21snmpd07:19:373
268129953,1cyclictest1058-21sendmail08:15:193
268129953,1cyclictest1058-21sendmail07:23:403
268129952,2cyclictest17299-21snmpd07:46:463
268069953,1cyclictest700-21gdbus08:20:012
268069953,1cyclictest5851-21cat07:35:152
268069953,1cyclictest32099-21cat07:20:142
268069953,1cyclictest31828-21/usr/sbin/munin08:40:092
268069953,1cyclictest31828-21/usr/sbin/munin08:40:092
268069953,1cyclictest17299-21snmpd08:50:402
268069953,1cyclictest17299-21snmpd08:17:032
268069953,1cyclictest17299-21snmpd08:12:052
268069953,1cyclictest17299-21snmpd07:52:322
268069953,1cyclictest17299-21snmpd07:40:202
268069953,1cyclictest17299-21snmpd07:30:162
268069953,1cyclictest17299-21snmpd07:29:132
268069953,1cyclictest1053-21lldpd07:57:502
268069952,2cyclictest17299-21snmpd08:33:012
268009953,1cyclictest31347-21kworker/1:207:25:141
268009953,1cyclictest17299-21snmpd08:55:251
268009953,1cyclictest17299-21snmpd08:37:341
268009953,1cyclictest17299-21snmpd08:02:111
268009953,1cyclictest17299-21snmpd07:30:011
268009953,1cyclictest17299-21snmpd07:10:361
268009953,1cyclictest1109-21ntpd09:00:151
267959955,0cyclictest9180-21kworker/0:208:05:210
267959955,0cyclictest9180-21kworker/0:208:00:470
267959955,0cyclictest9180-21kworker/0:207:50:170
267959955,0cyclictest9180-21kworker/0:207:45:010
267959955,0cyclictest5338-21kworker/0:309:05:130
267959955,0cyclictest5338-21kworker/0:308:55:030
267959955,0cyclictest3541-21kworker/0:008:50:470
267959955,0cyclictest3072-21kworker/0:107:40:250
267959955,0cyclictest26682-21kworker/0:007:20:130
267959955,0cyclictest19401-21kworker/0:108:48:130
267959955,0cyclictest19401-21kworker/0:108:35:230
267959953,1cyclictest17299-21snmpd07:35:130
267959950,4cyclictest31171-21sshd07:17:480
268129942,1cyclictest8109-21cat09:00:123
268129942,1cyclictest41-21ksoftirqd/308:40:083
268129942,1cyclictest41-21ksoftirqd/308:40:083
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional