You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-02-23 - 07:23
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Fri Feb 23, 2024 00:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
52192233158,25sleep00-21swapper/019:09:100
51642233157,27sleep20-21swapper/219:08:282
49602223157,26sleep10-21swapper/119:05:491
52572202164,24sleep30-21swapper/319:09:413
205752220,0sleep20-21swapper/200:29:402
537399150,14cyclictest11980-21dump-pmu-power20:30:000
28692150,0sleep10-21swapper/100:05:321
5396991313,0cyclictest35-21ksoftirqd/321:25:213
204722130,0sleep10-21swapper/121:39:011
5396991212,0cyclictest35-21ksoftirqd/323:50:283
5396991211,1cyclictest35-21ksoftirqd/319:45:003
5396991211,1cyclictest35-21ksoftirqd/300:35:003
5390991210,1cyclictest28-21ksoftirqd/219:25:002
5390991210,1cyclictest28-21ksoftirqd/219:15:002
539099120,11cyclictest0-21swapper/222:38:402
5373991210,1cyclictest2527-21grep20:10:000
539699119,1cyclictest35-21ksoftirqd/320:30:003
5396991111,0cyclictest35-21ksoftirqd/323:25:003
539099119,2cyclictest22274-21sh22:23:582
539099119,1cyclictest28-21ksoftirqd/222:45:002
537399119,1cyclictest9-21ksoftirqd/023:10:230
537399119,1cyclictest9-21ksoftirqd/000:35:250
537399113,4cyclictest1538-21latency_hist00:05:010
5373991110,1cyclictest9-21ksoftirqd/023:55:000
539699109,1cyclictest35-21ksoftirqd/300:25:243
539699108,1cyclictest35-21ksoftirqd/321:35:303
5396991010,0cyclictest35-21ksoftirqd/300:05:343
539099109,1cyclictest28-21ksoftirqd/221:40:012
539099108,1cyclictest28-21ksoftirqd/200:15:002
5390991010,0cyclictest0-21swapper/221:52:212
537399109,1cyclictest9-21ksoftirqd/023:40:000
537399109,1cyclictest9-21ksoftirqd/022:20:280
537399109,1cyclictest9-21ksoftirqd/021:25:220
537399109,1cyclictest9-21ksoftirqd/000:20:210
537399108,1cyclictest9-21ksoftirqd/022:40:250
537399108,1cyclictest9-21ksoftirqd/021:40:230
537399100,4cyclictest0-21swapper/023:00:190
53969999,0cyclictest35-21ksoftirqd/322:50:293
53969999,0cyclictest35-21ksoftirqd/322:40:203
53969999,0cyclictest35-21ksoftirqd/322:25:243
53969999,0cyclictest35-21ksoftirqd/321:50:233
53969999,0cyclictest35-21ksoftirqd/320:50:013
53969998,1cyclictest35-21ksoftirqd/323:05:253
53969998,1cyclictest35-21ksoftirqd/300:25:003
53969990,6cyclictest0-21swapper/323:38:213
53969990,5cyclictest0-21swapper/321:55:243
53969990,3cyclictest25164-21ssh00:35:213
53909998,1cyclictest28-21ksoftirqd/223:05:012
53909998,1cyclictest28-21ksoftirqd/200:00:012
53909997,1cyclictest28-21ksoftirqd/222:55:012
53909997,1cyclictest28-21ksoftirqd/220:04:592
53909990,8cyclictest61250irq/122-eno120:42:092
53739999,0cyclictest9-21ksoftirqd/023:40:200
53739999,0cyclictest9-21ksoftirqd/021:55:310
53739998,1cyclictest9-21ksoftirqd/023:25:210
53739998,1cyclictest9-21ksoftirqd/022:50:230
53739998,1cyclictest9-21ksoftirqd/021:30:270
53739998,1cyclictest9-21ksoftirqd/021:15:000
53739998,1cyclictest9-21ksoftirqd/000:30:240
53739997,1cyclictest9-21ksoftirqd/022:55:190
53739997,1cyclictest9-21ksoftirqd/022:25:230
53739997,1cyclictest9-21ksoftirqd/022:13:200
53739997,1cyclictest9-21ksoftirqd/021:20:200
53739993,5cyclictest5368-21cyclictest22:08:440
53969988,0cyclictest35-21ksoftirqd/323:15:273
53969987,1cyclictest534-21nscd23:27:523
53969987,1cyclictest35-21ksoftirqd/321:19:153
53969987,1cyclictest35-21ksoftirqd/319:50:523
53969986,1cyclictest770-21snmpd23:34:403
53969986,1cyclictest770-21snmpd20:08:303
53969981,2cyclictest0-21swapper/323:47:113
53969980,1cyclictest3675-21irqstats20:10:243
53909987,1cyclictest7754-21munin-node23:42:442
53909987,1cyclictest28-21ksoftirqd/200:00:242
53909986,1cyclictest770-21snmpd21:03:542
53909986,1cyclictest770-21snmpd00:36:512
53909986,1cyclictest61250irq/122-eno123:32:452
53909986,1cyclictest61250irq/122-eno123:25:272
53909986,1cyclictest61250irq/122-eno123:20:222
53909986,1cyclictest1422-21ntpd21:45:292
53909986,1cyclictest1422-21ntpd21:05:292
53909986,1cyclictest13369-21ntpq20:30:272
53909985,1cyclictest28-21ksoftirqd/221:55:002
53909981,1cyclictest0-21swapper/221:31:242
53909980,7cyclictest25331-21gpgv19:50:012
53909980,7cyclictest0-21swapper/222:17:092
53909980,5cyclictest0-21swapper/223:49:342
53739988,0cyclictest9-21ksoftirqd/022:35:080
53739988,0cyclictest9-21ksoftirqd/019:15:010
53739987,1cyclictest9-21ksoftirqd/022:05:000
53739987,1cyclictest9-21ksoftirqd/020:00:230
53739986,1cyclictest9-21ksoftirqd/023:30:190
53739986,1cyclictest770-21snmpd21:45:460
53739986,1cyclictest770-21snmpd21:15:120
53739986,1cyclictest770-21snmpd19:58:120
53739986,1cyclictest770-21snmpd19:50:180
53739980,7cyclictest29049-21ssh22:31:160
53739980,6cyclictest0-21swapper/023:23:010
53969977,0cyclictest35-21ksoftirqd/322:05:223
53969977,0cyclictest35-21ksoftirqd/319:35:223
53969977,0cyclictest35-21ksoftirqd/300:10:263
53969976,1cyclictest770-21snmpd21:42:433
53969976,1cyclictest35-21ksoftirqd/322:00:203
53969976,1cyclictest35-21ksoftirqd/321:45:233
53969976,1cyclictest17841-21cat20:40:273
53969975,1cyclictest770-21snmpd21:23:543
53969975,1cyclictest770-21snmpd20:31:103
53969975,1cyclictest770-21snmpd20:20:433
53969975,1cyclictest770-21snmpd20:03:553
53969975,1cyclictest770-21snmpd19:17:083
53969975,1cyclictest770-21snmpd00:01:113
53969975,1cyclictest35-21ksoftirqd/323:55:253
53969975,1cyclictest35-21ksoftirqd/320:55:223
53969975,1cyclictest21764-21ssh22:22:323
53969973,2cyclictest259-21systemd-journal22:39:593
53969971,3cyclictest0-21swapper/319:30:233
53969971,2cyclictest0-21swapper/319:10:243
53969970,4cyclictest0-21swapper/323:00:073
53969970,3cyclictest0-21swapper/322:59:183
53969970,3cyclictest0-21swapper/322:16:253
53969970,3cyclictest0-21swapper/321:05:203
53969970,3cyclictest0-21swapper/300:15:223
53969970,2cyclictest0-21swapper/322:12:093
53909976,1cyclictest770-21snmpd22:02:522
53909976,1cyclictest770-21snmpd00:16:512
53909976,1cyclictest61250irq/122-eno122:32:542
53909976,1cyclictest61250irq/122-eno122:25:052
53909976,1cyclictest61250irq/122-eno121:25:442
53909976,1cyclictest61250irq/122-eno120:50:222
53909976,1cyclictest61250irq/122-eno100:09:592
53909976,0cyclictest61250irq/122-eno123:50:182
53909975,1cyclictest26039-21ntpq23:10:292
53909975,1cyclictest1422-21ntpd19:15:292
53909975,1cyclictest13236-21ssh23:35:502
53909975,1cyclictest12904-21ssh22:10:282
53909970,5cyclictest0-21swapper/222:05:102
53909970,3cyclictest0-21swapper/222:55:162
53909970,3cyclictest0-21swapper/221:22:052
53909970,1cyclictest0-21swapper/221:10:182
53829974,1cyclictest0-21swapper/121:10:451
53829972,3cyclictest0-21swapper/122:43:341
53829971,6cyclictest0-21swapper/100:33:511
53829971,3cyclictest0-21swapper/123:30:301
53829970,3cyclictest0-21swapper/122:25:191
53829970,1cyclictest0-21swapper/100:00:271
53739977,0cyclictest9-21ksoftirqd/020:15:290
53739976,1cyclictest9-21ksoftirqd/023:45:220
53739976,1cyclictest9-21ksoftirqd/023:15:290
53739976,1cyclictest9-21ksoftirqd/022:15:180
53739976,1cyclictest9-21ksoftirqd/020:10:180
53739976,1cyclictest9-21ksoftirqd/000:15:230
53739975,1cyclictest9-21ksoftirqd/020:57:530
53739975,1cyclictest770-21snmpd20:30:130
53739975,1cyclictest770-21snmpd20:21:460
53739975,1cyclictest770-21snmpd19:45:420
53739975,1cyclictest29236-21df_inode21:50:220
53739975,1cyclictest15910-21/usr/sbin/munin19:30:330
53739970,6cyclictest8271-21ssh00:12:450
53739970,6cyclictest8240-21ssh22:46:540
53739970,6cyclictest4555-21ssh00:08:010
53739970,6cyclictest26777-21basename23:55:220
53739970,6cyclictest23750-21ssh23:07:550
53739970,6cyclictest20392-21munin-run19:40:000
53739970,6cyclictest0-21swapper/019:20:200
53739970,6cyclictest0-21swapper/000:25:140
8471260,0sleep10-21swapper/122:05:231
53969965,1cyclictest35-21ksoftirqd/320:35:263
53969965,1cyclictest17619-21ssh23:42:283
53969965,1cyclictest13528-21ssh21:30:033
53969965,1cyclictest12159-21ntpq19:20:233
53969965,1cyclictest0-21swapper/322:32:233
53969964,1cyclictest770-21snmpd20:16:433
53969963,1cyclictest259-21systemd-journal19:30:003
53969962,1cyclictest5919-21apt-get22:45:193
53969962,1cyclictest24743-21ssh23:10:023
53969961,3cyclictest0-21swapper/321:00:213
53909966,0cyclictest61250irq/122-eno123:15:102
53909966,0cyclictest61250irq/122-eno123:05:192
53909966,0cyclictest61250irq/122-eno122:45:072
53909966,0cyclictest61250irq/122-eno121:40:452
53909966,0cyclictest61250irq/122-eno121:15:052
53909966,0cyclictest61250irq/122-eno120:56:282
53909966,0cyclictest61250irq/122-eno120:27:162
53909966,0cyclictest61250irq/122-eno120:20:302
53909966,0cyclictest61250irq/122-eno120:15:152
53909966,0cyclictest61250irq/122-eno120:10:212
53909966,0cyclictest61250irq/122-eno119:52:522
53909966,0cyclictest61250irq/122-eno100:30:222
53909965,1cyclictest61250irq/122-eno119:35:212
53909965,1cyclictest28-21ksoftirqd/220:50:012
53909965,1cyclictest13252-21ssh00:20:052
53909964,1cyclictest29271-21ntpq19:55:262
53909964,1cyclictest28-21ksoftirqd/219:30:202
53909964,1cyclictest28-21ksoftirqd/219:30:002
53909960,6cyclictest0-21swapper/220:37:052
53909960,1cyclictest0-21swapper/220:05:182
53829965,1cyclictest0-21swapper/120:31:221
53829961,1cyclictest0-21swapper/100:10:241
53829960,6cyclictest0-21swapper/122:15:001
53829960,6cyclictest0-21swapper/121:21:091
53829960,6cyclictest0-21swapper/100:25:481
53829960,5cyclictest0-21swapper/122:50:181
53829960,5cyclictest0-21swapper/122:00:221
53829960,5cyclictest0-21swapper/120:20:161
53829960,5cyclictest0-21swapper/120:10:341
53829960,4cyclictest0-21swapper/123:05:211
53829960,4cyclictest0-21swapper/121:15:271
53829960,3cyclictest0-21swapper/123:45:051
53829960,3cyclictest0-21swapper/123:35:391
53829960,3cyclictest0-21swapper/122:59:451
53829960,3cyclictest0-21swapper/122:36:491
53829960,3cyclictest0-21swapper/122:15:061
53829960,3cyclictest0-21swapper/119:40:001
53829960,1cyclictest0-21swapper/120:35:291
53829960,1cyclictest0-21swapper/120:18:521
53739966,0cyclictest9-21ksoftirqd/019:25:250
53739966,0cyclictest0-21swapper/021:00:180
53739964,1cyclictest23190-21timerandwakeup20:50:280
53739960,6cyclictest0-21swapper/020:49:100
53739960,5cyclictest783-21sshd21:08:520
53739960,5cyclictest5583-21/usr/sbin/munin19:10:300
53739960,2cyclictest17424-21apt-get21:35:210
53739960,2cyclictest0-21swapper/019:40:200
53739960,0cyclictest0-21swapper/020:35:220
53969955,0cyclictest7750-21kworker/3:019:55:013
53969951,1cyclictest31140-21apt-get21:10:183
53909953,1cyclictest21210-21grep19:40:232
53829952,1cyclictest0-21swapper/123:20:021
53829952,0cyclictest0-21swapper/119:30:311
53829951,2cyclictest0-21swapper/123:50:351
53829950,5cyclictest0-21swapper/123:18:371
53829950,5cyclictest0-21swapper/122:30:111
53829950,5cyclictest0-21swapper/122:21:121
53829950,5cyclictest0-21swapper/121:00:301
53829950,5cyclictest0-21swapper/120:51:441
53829950,5cyclictest0-21swapper/120:02:161
53829950,3cyclictest0-21swapper/121:50:201
53829950,3cyclictest0-21swapper/121:30:271
53829950,3cyclictest0-21swapper/119:15:001
53829950,3cyclictest0-21swapper/100:15:331
53829950,2cyclictest0-21swapper/121:49:121
53829950,2cyclictest0-21swapper/100:38:121
53829950,1cyclictest0-21swapper/123:57:551
53829950,1cyclictest0-21swapper/123:25:181
53829950,1cyclictest0-21swapper/121:05:201
53829950,1cyclictest0-21swapper/100:20:201
53829950,0cyclictest0-21swapper/123:41:361
53829950,0cyclictest0-21swapper/121:56:041
53739950,2cyclictest0-21swapper/020:40:220
19833250,1sleep10-21swapper/123:02:331
53969943,1cyclictest35-21ksoftirqd/320:50:213
53969943,1cyclictest35-21ksoftirqd/319:45:203
53829944,0cyclictest0-21swapper/120:26:531
53829943,0cyclictest0-21swapper/121:25:271
53829942,1cyclictest13348-21chrt19:25:111
53829941,2cyclictest0-21swapper/119:55:201
53829940,4cyclictest0-21swapper/119:52:121
53829940,3cyclictest0-21swapper/120:42:171
53829940,3cyclictest0-21swapper/119:45:271
53829940,2cyclictest0-21swapper/123:10:231
53829940,2cyclictest0-21swapper/121:40:281
53829940,1cyclictest0-21swapper/122:45:341
53829940,1cyclictest0-21swapper/119:20:191
53829940,1cyclictest0-21swapper/119:15:001
53829940,0cyclictest0-21swapper/120:49:401
53829940,0cyclictest0-21swapper/119:40:291
53829931,1cyclictest0-21swapper/120:55:201
53829930,1cyclictest0-21swapper/120:05:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional