You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 10:59
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Apr 24, 2024 00:45:09)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
203312213150,21sleep20-21swapper/219:09:042
202922209172,24sleep30-21swapper/319:08:323
201282201162,25sleep00-21swapper/019:06:240
203472197158,26sleep10-21swapper/119:09:151
110552650,0sleep00-21swapper/021:51:450
4372600,0sleep00-21swapper/000:35:060
20500991717,0cyclictest35-21ksoftirqd/323:04:093
2050099169,7cyclictest35-21ksoftirqd/300:09:323
20500991616,0cyclictest35-21ksoftirqd/321:59:173
20500991616,0cyclictest35-21ksoftirqd/321:22:253
20500991616,0cyclictest35-21ksoftirqd/321:12:333
142132160,0sleep10-21swapper/121:55:221
20500991515,0cyclictest35-21ksoftirqd/323:40:383
20500991515,0cyclictest35-21ksoftirqd/322:18:263
20500991515,0cyclictest35-21ksoftirqd/321:25:453
2050099145,8cyclictest35-21ksoftirqd/323:15:113
20500991414,0cyclictest35-21ksoftirqd/323:55:233
20500991414,0cyclictest35-21ksoftirqd/323:52:313
2050099137,5cyclictest35-21ksoftirqd/322:45:263
2050099137,5cyclictest35-21ksoftirqd/322:11:163
2050099135,7cyclictest35-21ksoftirqd/321:40:213
20500991313,0cyclictest35-21ksoftirqd/323:34:403
20500991313,0cyclictest35-21ksoftirqd/323:27:163
20500991313,0cyclictest35-21ksoftirqd/323:21:053
20500991313,0cyclictest35-21ksoftirqd/322:32:323
20500991313,0cyclictest35-21ksoftirqd/300:11:483
20500991312,1cyclictest35-21ksoftirqd/300:00:583
20500991212,0cyclictest35-21ksoftirqd/322:05:143
20500991212,0cyclictest35-21ksoftirqd/321:51:393
2049399120,0cyclictest11617-21diskmemload00:10:082
2047799123,4cyclictest28927-21perf00:30:000
2047799123,4cyclictest20489-21perf20:20:000
2047799120,12cyclictest0-21swapper/022:55:100
2050099119,2cyclictest5510-21systemctl19:45:223
2050099119,1cyclictest29438-21ntpq23:45:203
2050099118,2cyclictest22213-21df00:20:143
2050099118,2cyclictest22213-21df00:20:143
2050099118,2cyclictest0-21swapper/322:28:293
2050099116,5cyclictest35-21ksoftirqd/300:30:293
2050099114,7cyclictest35-21ksoftirqd/322:21:093
20500991111,0cyclictest35-21ksoftirqd/323:37:043
20500991111,0cyclictest35-21ksoftirqd/323:11:533
20500991111,0cyclictest35-21ksoftirqd/322:50:533
20500991111,0cyclictest35-21ksoftirqd/322:40:403
20500991111,0cyclictest35-21ksoftirqd/321:35:213
20500991111,0cyclictest35-21ksoftirqd/321:30:233
2049399119,1cyclictest28-21ksoftirqd/221:55:002
2047799110,7cyclictest11617-21diskmemload23:55:130
87142100,0sleep10-21swapper/122:34:291
2050099108,1cyclictest35-21ksoftirqd/320:05:223
2050099108,1cyclictest0-21swapper/320:40:153
2050099107,2cyclictest25037-21pmu-power22:55:213
20500991010,0cyclictest35-21ksoftirqd/323:05:163
20500991010,0cyclictest35-21ksoftirqd/322:00:183
20500991010,0cyclictest35-21ksoftirqd/321:48:503
20500991010,0cyclictest35-21ksoftirqd/321:15:253
20500991010,0cyclictest35-21ksoftirqd/320:15:213
20500991010,0cyclictest35-21ksoftirqd/319:15:113
20500991010,0cyclictest35-21ksoftirqd/300:35:203
20500991010,0cyclictest35-21ksoftirqd/300:25:163
20500991010,0cyclictest35-21ksoftirqd/300:15:243
2050099101,8cyclictest9206-21apt-get22:35:133
2050099101,8cyclictest27537-21hddtemp_smartct19:25:123
2050099101,8cyclictest12496-21/usr/sbin/munin20:00:203
2050099101,6cyclictest341rcuc/320:55:213
2050099101,1cyclictest8216-21unixbench_singl19:50:273
2049399100,9cyclictest61250irq/122-eno100:31:482
2049399100,10cyclictest0-21swapper/223:12:362
2049399100,10cyclictest0-21swapper/222:35:082
2049399100,10cyclictest0-21swapper/200:35:562
2047799102,4cyclictest31445-21perf19:35:000
205009998,1cyclictest35-21ksoftirqd/321:05:173
205009998,1cyclictest35-21ksoftirqd/321:00:183
205009991,7cyclictest30184-21/usr/sbin/munin19:30:173
205009990,8cyclictest2414-21/usr/sbin/munin20:50:163
204939998,1cyclictest28-21ksoftirqd/219:15:002
204939995,3cyclictest0-21swapper/221:25:542
204879991,5cyclictest0-21swapper/123:05:281
204779993,5cyclictest20034-21cpuspeed_turbos22:05:140
204779992,6cyclictest32668-21perf00:35:000
16045290,0sleep00-21swapper/022:00:030
205009988,0cyclictest35-21ksoftirqd/320:35:153
205009988,0cyclictest35-21ksoftirqd/320:20:243
205009988,0cyclictest35-21ksoftirqd/319:55:103
205009988,0cyclictest35-21ksoftirqd/319:40:023
205009988,0cyclictest35-21ksoftirqd/319:21:303
205009987,0cyclictest35-21ksoftirqd/320:10:103
205009980,8cyclictest35-21ksoftirqd/320:45:113
205009980,8cyclictest35-21ksoftirqd/320:25:193
205009980,8cyclictest35-21ksoftirqd/319:35:133
205009980,8cyclictest35-21ksoftirqd/319:10:153
205009980,1cyclictest26202-21hddtemp_smartct20:30:143
205009980,1cyclictest26202-21hddtemp_smartct20:30:133
204939988,0cyclictest0-21swapper/223:16:262
204939987,1cyclictest28-21ksoftirqd/219:30:002
204939986,1cyclictest61250irq/122-eno123:45:172
204939986,1cyclictest61250irq/122-eno122:40:172
204939986,1cyclictest61250irq/122-eno121:15:222
204939985,2cyclictest61250irq/122-eno122:00:332
204939982,5cyclictest20474-21cyclictest22:27:272
204939981,6cyclictest21555-21sh21:21:392
204939980,4cyclictest3083-21apt-get23:55:132
204939980,4cyclictest10018-21apt-get23:20:102
204939980,3cyclictest0-21swapper/222:00:002
204879980,5cyclictest0-21swapper/123:55:301
204779987,1cyclictest9-21ksoftirqd/021:23:570
204779987,0cyclictest9-21ksoftirqd/022:16:010
204779986,1cyclictest9741-1kworker/u9:000:13:050
204779986,1cyclictest9-21ksoftirqd/020:05:000
204779986,1cyclictest8849-21snmpd19:12:050
204779986,1cyclictest24314-21cat22:10:150
204779983,4cyclictest322962chrt19:35:170
204779981,6cyclictest12504-21ssh21:10:120
204779980,7cyclictest28006-21cstates23:00:140
204779980,7cyclictest24057-21ssh23:39:200
4714270,0sleep10-21swapper/121:44:311
204939976,1cyclictest61250irq/122-eno123:41:162
204939976,1cyclictest61250irq/122-eno123:32:322
204939976,1cyclictest61250irq/122-eno123:28:112
204939976,1cyclictest61250irq/122-eno122:59:472
204939976,1cyclictest61250irq/122-eno122:30:112
204939976,1cyclictest61250irq/122-eno100:03:042
204939976,1cyclictest28-21ksoftirqd/200:05:002
204939976,0cyclictest61250irq/122-eno123:00:012
204939975,1cyclictest8849-21snmpd21:36:412
204939975,1cyclictest8849-21snmpd20:57:012
204939975,1cyclictest8849-21snmpd00:20:352
204939975,1cyclictest8849-21snmpd00:20:352
204939975,1cyclictest8849-21snmpd00:16:012
204939975,1cyclictest61250irq/122-eno121:45:112
204939975,1cyclictest61250irq/122-eno121:40:192
204939975,1cyclictest61250irq/122-eno121:10:072
204939975,1cyclictest61250irq/122-eno120:10:152
204939975,1cyclictest21578-21ssh22:05:292
204939975,1cyclictest1422-21ntpd22:15:292
204939972,4cyclictest7148-21apt-get21:00:132
204939971,2cyclictest0-21swapper/222:10:102
204939970,5cyclictest790-21lldpd20:43:272
204879972,2cyclictest0-21swapper/121:51:251
204879970,7cyclictest0-21swapper/123:39:201
204879970,6cyclictest0-21swapper/123:18:481
204879970,6cyclictest0-21swapper/121:47:151
204879970,6cyclictest0-21swapper/121:15:231
204879970,6cyclictest0-21swapper/120:10:141
204879970,6cyclictest0-21swapper/119:51:211
204879970,4cyclictest0-21swapper/122:10:501
204879970,4cyclictest0-21swapper/100:17:581
204879970,3cyclictest0-21swapper/122:05:111
204879970,3cyclictest0-21swapper/120:45:001
204879970,3cyclictest0-21swapper/100:10:081
204879970,1cyclictest0-21swapper/121:10:101
204879970,1cyclictest0-21swapper/121:03:011
204779976,1cyclictest8849-21snmpd23:45:030
204779976,1cyclictest8849-21snmpd21:07:280
204779976,1cyclictest8849-21snmpd20:24:300
204779976,1cyclictest8849-21snmpd00:15:070
204779976,1cyclictest16124-21expr21:15:140
204779975,1cyclictest10833-21ssh00:05:150
204779973,0cyclictest0-21swapper/000:00:140
204779972,1cyclictest21695-21/usr/sbin/munin00:20:260
204779972,1cyclictest21695-21/usr/sbin/munin00:20:250
204779971,6cyclictest19775-21ssh23:32:240
204779971,6cyclictest0-21swapper/019:41:440
204779971,4cyclictest0-21swapper/023:20:110
204779971,1cyclictest5540-21ssh22:30:110
204779970,6cyclictest5367-21ssh23:12:530
204779970,6cyclictest31273-21ssh23:05:060
204779970,6cyclictest18530-21ssh22:46:020
204779970,6cyclictest16305-21ssh23:27:550
204779970,6cyclictest13707-21hddtemp_smartct22:40:170
204779970,6cyclictest11617-21diskmemload23:50:550
204779970,6cyclictest11617-21diskmemload21:30:140
204779970,6cyclictest11617-21diskmemload21:25:220
204779970,6cyclictest0-21swapper/022:25:220
204779970,6cyclictest0-21swapper/021:55:220
204779970,6cyclictest0-21swapper/020:05:060
204779970,3cyclictest0-21swapper/021:45:290
204779970,1cyclictest901-21ssh21:39:070
204779970,1cyclictest26905-21ssh23:41:550
204779970,1cyclictest23084-21ssh22:53:460
204779970,1cyclictest10865-21timerwakeupswit22:35:270
204779970,1cyclictest0-21swapper/023:15:220
204779970,1cyclictest0-21swapper/021:41:000
204939966,0cyclictest61250irq/122-eno123:35:112
204939966,0cyclictest61250irq/122-eno122:50:032
204939966,0cyclictest61250irq/122-eno122:45:102
204939966,0cyclictest61250irq/122-eno122:20:042
204939966,0cyclictest61250irq/122-eno121:06:172
204939966,0cyclictest61250irq/122-eno120:25:412
204939966,0cyclictest61250irq/122-eno120:23:302
204939966,0cyclictest61250irq/122-eno120:05:132
204939966,0cyclictest61250irq/122-eno119:55:062
204939966,0cyclictest61250irq/122-eno119:50:022
204939966,0cyclictest61250irq/122-eno100:25:272
204939965,1cyclictest8849-21snmpd19:38:532
204939965,1cyclictest61250irq/122-eno121:30:222
204939965,1cyclictest28-21ksoftirqd/220:50:142
204939965,0cyclictest61250irq/122-eno123:05:022
204939964,1cyclictest61250irq/122-eno120:00:102
204939964,1cyclictest61250irq/122-eno119:45:162
204939964,1cyclictest61250irq/122-eno119:15:112
204939963,1cyclictest259-21systemd-journal19:20:012
204939961,3cyclictest0-21swapper/223:50:132
204939960,6cyclictest0-21swapper/220:37:582
204939960,6cyclictest0-21swapper/219:31:592
204939960,0cyclictest0-21swapper/220:15:122
204879965,0cyclictest0-21swapper/122:47:241
204879961,3cyclictest0-21swapper/122:35:131
204879961,3cyclictest0-21swapper/121:36:561
204879961,0cyclictest0-21swapper/100:21:341
204879961,0cyclictest0-21swapper/100:21:341
204879960,6cyclictest0-21swapper/123:48:491
204879960,6cyclictest0-21swapper/120:57:521
204879960,6cyclictest0-21swapper/120:31:391
204879960,6cyclictest0-21swapper/120:31:391
204879960,6cyclictest0-21swapper/119:38:471
204879960,6cyclictest0-21swapper/119:34:591
204879960,6cyclictest0-21swapper/100:01:471
204879960,5cyclictest0-21swapper/123:54:461
204879960,5cyclictest0-21swapper/121:25:451
204879960,5cyclictest0-21swapper/120:18:001
204879960,5cyclictest0-21swapper/119:11:311
204879960,4cyclictest0-21swapper/122:55:221
204879960,3cyclictest0-21swapper/123:31:511
204879960,3cyclictest0-21swapper/123:27:031
204879960,2cyclictest0-21swapper/123:20:231
204879960,2cyclictest0-21swapper/121:20:251
204879960,0cyclictest0-21swapper/121:33:251
204779965,1cyclictest8849-21snmpd20:48:430
204779964,1cyclictest8868-21/usr/sbin/munin19:55:200
204779964,1cyclictest8849-21snmpd20:33:100
204779964,1cyclictest8849-21snmpd20:33:090
204779962,1cyclictest11617-21diskmemload22:20:110
204779960,6cyclictest0-21swapper/020:52:060
204779960,6cyclictest0-21swapper/019:24:540
204779960,5cyclictest0-21swapper/020:35:150
204779960,2cyclictest0-21swapper/020:55:210
204779960,0cyclictest0-21swapper/019:47:240
204939955,0cyclictest61250irq/122-eno120:45:182
204939955,0cyclictest61250irq/122-eno119:40:142
204939953,1cyclictest61250irq/122-eno120:30:082
204939953,1cyclictest61250irq/122-eno120:30:082
204879955,0cyclictest0-21swapper/119:21:121
204879955,0cyclictest0-21swapper/100:30:451
204879953,1cyclictest188112chrt22:03:081
204879953,1cyclictest0-21swapper/120:00:191
204879952,2cyclictest0-21swapper/121:10:001
204879951,3cyclictest0-21swapper/120:25:091
204879951,1cyclictest0-21swapper/123:40:121
204879950,5cyclictest0-21swapper/123:12:081
204879950,5cyclictest0-21swapper/120:09:011
204879950,5cyclictest0-21swapper/119:27:391
204879950,5cyclictest0-21swapper/100:25:161
204879950,4cyclictest0-21swapper/119:45:161
204879950,3cyclictest0-21swapper/120:20:201
204879950,3cyclictest0-21swapper/120:00:001
204879950,3cyclictest0-21swapper/119:16:141
204879950,2cyclictest0-21swapper/122:40:071
204879950,2cyclictest0-21swapper/122:28:371
204879950,2cyclictest0-21swapper/120:50:121
204879950,1cyclictest0-21swapper/122:20:101
204879950,1cyclictest0-21swapper/122:16:451
204879950,1cyclictest0-21swapper/119:40:231
204879950,1cyclictest0-21swapper/100:05:081
204879950,0cyclictest0-21swapper/123:00:141
204879950,0cyclictest0-21swapper/120:45:131
204779953,1cyclictest9-21ksoftirqd/021:00:130
204779951,1cyclictest15947-21apt-get20:10:090
204779950,4cyclictest0-21swapper/019:25:080
204779950,3cyclictest0-21swapper/020:25:120
204779950,1cyclictest0-21swapper/019:15:150
204779950,0cyclictest0-21swapper/020:41:440
204779950,0cyclictest0-21swapper/019:52:430
204879940,3cyclictest0-21swapper/100:35:111
204879940,2cyclictest0-21swapper/122:50:041
204879940,1cyclictest0-21swapper/120:35:141
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional