You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 14:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Thu Apr 25, 2024 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
198622202162,26sleep30-21swapper/307:05:223
205382201149,41sleep10-21swapper/107:06:541
205692199162,24sleep20-21swapper/207:07:182
186632198157,27sleep00-21swapper/007:05:030
276252670,0sleep00-21swapper/010:10:230
2086399240,10cyclictest14123-21diskmemload10:15:090
11982210,0sleep20-21swapper/212:30:482
312212180,1sleep3341rcuc/308:35:223
260402160,0sleep10-21swapper/111:36:071
137192160,0sleep10-21swapper/112:05:111
63892150,0sleep10-21swapper/108:50:261
2086399150,15cyclictest0-21swapper/009:17:070
2088999132,10cyclictest22112-21idleruntime07:10:153
20889991311,2cyclictest0-21swapper/310:17:313
20889991311,1cyclictest2905-21/usr/sbin/munin12:35:233
20889991311,1cyclictest10170-21awk10:30:213
20889991310,2cyclictest32328-21fschecks_time12:30:163
20889991310,2cyclictest31432-21taskset09:32:003
20889991310,2cyclictest1429-21df_inode10:20:133
2087299130,12cyclictest0-21swapper/108:00:131
2088999128,3cyclictest14310-21sendmail_mailst11:20:203
2088999127,4cyclictest10968-21apt-get07:55:083
2088999122,9cyclictest23909-21perl10:50:133
20889991211,1cyclictest20104-21ssh12:14:013
20889991210,1cyclictest30683-21unixbench-2d07:25:273
20889991210,1cyclictest26211-21grep10:10:123
20889991210,1cyclictest25922-21fschecks_count08:25:133
2088999119,2cyclictest0-21swapper/311:43:223
2088999118,2cyclictest21777-21ntp_states08:15:223
2088999112,8cyclictest26882-21/usr/sbin/munin10:55:133
2088999112,8cyclictest0-21swapper/309:05:003
2088999112,2cyclictest17145-21ntp_states10:40:203
2088999112,1cyclictest4266-21ssh11:07:173
2088999112,1cyclictest341rcuc/309:38:313
2088999112,1cyclictest16866-21ntp_states08:05:193
20889991110,1cyclictest30171-21ssh12:26:193
20889991110,1cyclictest14123-21diskmemload11:17:223
20889991110,1cyclictest0-21swapper/312:15:093
20889991110,1cyclictest0-21swapper/311:55:193
20889991110,1cyclictest0-21swapper/311:30:103
20889991110,1cyclictest0-21swapper/310:45:113
20889991110,1cyclictest0-21swapper/309:20:123
2088999111,9cyclictest5283-21df_inode10:25:133
2088999111,9cyclictest29513-21taskset08:31:123
2088999111,9cyclictest14123-21diskmemload09:26:573
2088999111,4cyclictest21533-21cat09:20:003
2087999119,1cyclictest28-21ksoftirqd/207:59:592
20879991110,1cyclictest28-21ksoftirqd/211:40:192
2086399119,1cyclictest9-21ksoftirqd/010:49:590
2086399113,4cyclictest32452-21latency_hist09:35:000
2086399113,4cyclictest29858-21perf08:35:000
20863991111,0cyclictest9-21ksoftirqd/010:55:090
20863991110,1cyclictest9-21ksoftirqd/008:10:010
37332108,1sleep228-21ksoftirqd/211:05:422
2088999109,1cyclictest0-21swapper/312:01:233
2088999109,1cyclictest0-21swapper/310:05:203
2088999109,1cyclictest0-21swapper/309:11:063
2088999108,1cyclictest32489-21ntp_states11:45:223
2088999105,3cyclictest0-21swapper/311:12:093
2088999103,6cyclictest11958-21perl09:50:153
2088999102,1cyclictest6127-21ssh09:41:263
2088999102,1cyclictest3207-21grep08:45:133
2088999102,1cyclictest15920-21ssh12:07:263
2088999100,1cyclictest35-21ksoftirqd/310:04:273
2087999109,1cyclictest28-21ksoftirqd/210:20:122
2087999109,1cyclictest28-21ksoftirqd/207:15:012
2087999108,1cyclictest28-21ksoftirqd/212:25:012
2087999100,8cyclictest0-21swapper/211:20:432
2086399104,5cyclictest1585-21cut11:05:000
2086399102,4cyclictest1132-21perf07:35:000
172032100,0sleep20-21swapper/209:56:452
208899999,0cyclictest35-21ksoftirqd/309:08:533
208899999,0cyclictest35-21ksoftirqd/308:54:243
208899999,0cyclictest35-21ksoftirqd/307:42:383
208899998,1cyclictest14123-21diskmemload11:01:073
208899998,1cyclictest0-21swapper/307:35:123
208899998,1cyclictest0-21swapper/307:15:243
208899997,2cyclictest13823-21/usr/sbin/munin10:35:243
208899997,1cyclictest14123-21diskmemload11:50:333
208899995,3cyclictest15393-21expr09:55:143
208899991,8cyclictest341rcuc/312:20:213
208899991,8cyclictest14123-21diskmemload11:37:283
208899991,8cyclictest0-21swapper/311:25:253
208899990,8cyclictest14123-21diskmemload09:45:513
208799998,1cyclictest28-21ksoftirqd/212:25:132
208799998,1cyclictest28-21ksoftirqd/212:15:162
208799998,1cyclictest28-21ksoftirqd/209:40:002
208799998,1cyclictest28-21ksoftirqd/209:15:002
208799998,1cyclictest28-21ksoftirqd/208:10:002
208799998,1cyclictest28-21ksoftirqd/207:15:002
208799997,1cyclictest28-21ksoftirqd/211:55:112
208799997,1cyclictest28-21ksoftirqd/211:20:002
208799990,9cyclictest0-21swapper/210:43:502
208799990,6cyclictest259-21systemd-journal07:29:552
208799990,4cyclictest8849-21snmpd11:52:372
208639998,1cyclictest9-21ksoftirqd/012:20:160
208639998,1cyclictest9-21ksoftirqd/009:45:120
208639998,1cyclictest9-21ksoftirqd/007:40:230
208639998,1cyclictest9-21ksoftirqd/007:15:220
208639998,1cyclictest534-21nscd10:03:390
208639997,1cyclictest9-21ksoftirqd/011:40:160
208639997,1cyclictest9-21ksoftirqd/010:50:150
208639997,1cyclictest9-21ksoftirqd/009:35:230
208639993,4cyclictest259-21systemd-journal10:00:000
208899988,0cyclictest35-21ksoftirqd/308:40:073
208899988,0cyclictest35-21ksoftirqd/308:10:063
208899988,0cyclictest35-21ksoftirqd/308:00:023
208899988,0cyclictest35-21ksoftirqd/307:50:083
208899988,0cyclictest35-21ksoftirqd/307:45:023
208899988,0cyclictest35-21ksoftirqd/307:20:063
208899980,8cyclictest35-21ksoftirqd/308:55:023
208899980,8cyclictest35-21ksoftirqd/308:20:033
208899980,8cyclictest35-21ksoftirqd/307:30:083
208799987,1cyclictest534-21nscd12:08:442
208799987,1cyclictest28-21ksoftirqd/212:10:152
208799987,1cyclictest28-21ksoftirqd/211:10:142
208799987,1cyclictest28-21ksoftirqd/210:15:002
208799986,1cyclictest61250irq/122-eno112:03:382
208799986,1cyclictest61250irq/122-eno110:35:492
208799986,1cyclictest61250irq/122-eno110:05:132
208799986,1cyclictest61250irq/122-eno109:10:002
208799986,1cyclictest61250irq/122-eno108:40:162
208799986,1cyclictest61250irq/122-eno107:45:152
208799986,1cyclictest28-21ksoftirqd/209:25:152
208799980,7cyclictest0-21swapper/211:26:142
208729981,6cyclictest0-21swapper/111:12:231
208729980,4cyclictest0-21swapper/110:35:421
208639988,0cyclictest9-21ksoftirqd/012:25:210
208639988,0cyclictest9-21ksoftirqd/011:35:210
208639987,1cyclictest9-21ksoftirqd/012:00:110
208639987,1cyclictest9-21ksoftirqd/011:50:240
208639987,0cyclictest9-21ksoftirqd/010:35:110
208639986,1cyclictest9-21ksoftirqd/010:25:110
208639986,1cyclictest9-21ksoftirqd/009:50:170
208639986,1cyclictest8849-21snmpd07:50:560
208639986,1cyclictest10240-21ntpq11:15:200
208639984,2cyclictest259-21systemd-journal12:40:010
208639984,0cyclictest0-21swapper/009:05:240
208639984,0cyclictest0-21swapper/007:55:140
208639982,3cyclictest15507-21cat08:05:010
208639981,1cyclictest16704-21ssh12:09:460
208639980,7cyclictest14390-21ssh09:10:080
208639980,7cyclictest0-21swapper/011:14:170
208639980,5cyclictest25442-21apt-get09:25:100
208639980,2cyclictest0-21swapper/009:00:090
26750270,0sleep10-21swapper/107:20:111
208799977,0cyclictest28-21ksoftirqd/209:15:122
208799976,1cyclictest8849-21snmpd11:47:102
208799976,1cyclictest61250irq/122-eno110:28:572
208799976,1cyclictest61250irq/122-eno110:19:162
208799976,1cyclictest61250irq/122-eno109:30:182
208799976,1cyclictest61250irq/122-eno109:20:102
208799976,1cyclictest28-21ksoftirqd/210:50:002
208799976,1cyclictest28-21ksoftirqd/210:30:192
208799976,1cyclictest28-21ksoftirqd/207:20:102
208799976,0cyclictest61250irq/122-eno111:30:152
208799976,0cyclictest61250irq/122-eno110:50:462
208799975,1cyclictest8849-21snmpd11:00:152
208799975,1cyclictest5796-21cat08:50:182
208799975,1cyclictest28-21ksoftirqd/211:35:012
208799975,1cyclictest28-21ksoftirqd/207:40:132
208799974,2cyclictest14123-21diskmemload10:55:202
208799972,2cyclictest61250irq/122-eno109:51:522
208729971,3cyclictest0-21swapper/109:14:521
208729970,6cyclictest0-21swapper/112:04:461
208729970,5cyclictest0-21swapper/107:10:001
208729970,4cyclictest0-21swapper/112:31:471
208729970,4cyclictest0-21swapper/110:26:251
208729970,4cyclictest0-21swapper/110:02:211
208729970,1cyclictest0-21swapper/110:14:341
208639976,1cyclictest9-21ksoftirqd/010:40:120
208639976,1cyclictest9-21ksoftirqd/008:55:110
208639976,1cyclictest9-21ksoftirqd/007:50:000
208639976,1cyclictest9-21ksoftirqd/007:10:100
208639976,1cyclictest8849-21snmpd08:07:490
208639976,1cyclictest18589-21ssh11:26:130
208639975,1cyclictest18281-21ntpq12:10:200
208639974,2cyclictest22690-21sed09:20:170
208639972,4cyclictest31564-21cpuspeed_turbos11:45:150
208639970,6cyclictest29946-21cat07:25:220
208639970,6cyclictest25286-21ssh10:08:520
208639970,5cyclictest20277-21rm11:30:120
208639970,1cyclictest8053-21ssh11:55:430
208639970,1cyclictest6089-21ssh09:41:190
208639970,1cyclictest14123-21diskmemload12:33:520
208639970,1cyclictest14123-21diskmemload10:31:520
208639970,1cyclictest0-21swapper/011:06:470
208639970,0cyclictest0-21swapper/011:21:010
22859260,0sleep10-21swapper/111:33:081
208799966,0cyclictest61250irq/122-eno110:00:062
208799966,0cyclictest61250irq/122-eno109:40:032
208799966,0cyclictest61250irq/122-eno109:02:162
208799966,0cyclictest61250irq/122-eno108:45:562
208799966,0cyclictest61250irq/122-eno108:20:202
208799966,0cyclictest61250irq/122-eno108:15:102
208799966,0cyclictest61250irq/122-eno108:03:212
208799966,0cyclictest61250irq/122-eno107:30:102
208799965,1cyclictest8849-21snmpd08:31:402
208799964,1cyclictest61250irq/122-eno112:35:102
208799962,2cyclictest259-21systemd-journal07:50:012
208799961,2cyclictest0-21swapper/208:55:092
208799961,2cyclictest0-21swapper/208:25:102
208799960,1cyclictest0-21swapper/209:45:102
208729962,1cyclictest0-21swapper/109:59:411
208729961,3cyclictest0-21swapper/111:00:111
208729960,6cyclictest0-21swapper/111:47:181
208729960,6cyclictest0-21swapper/111:25:001
208729960,6cyclictest0-21swapper/111:17:481
208729960,6cyclictest0-21swapper/110:21:491
208729960,6cyclictest0-21swapper/109:39:031
208729960,6cyclictest0-21swapper/109:19:051
208729960,6cyclictest0-21swapper/108:58:561
208729960,6cyclictest0-21swapper/108:07:281
208729960,4cyclictest0-21swapper/111:08:491
208729960,4cyclictest0-21swapper/110:45:151
208729960,4cyclictest0-21swapper/109:40:171
208729960,4cyclictest0-21swapper/109:25:171
208729960,3cyclictest0-21swapper/112:17:051
208729960,1cyclictest0-21swapper/109:46:251
208729960,1cyclictest0-21swapper/107:57:391
208729960,1cyclictest0-21swapper/107:27:441
208639965,1cyclictest9-21ksoftirqd/008:45:010
208639965,1cyclictest26501-21ntpq08:25:190
208639965,1cyclictest19560-1kworker/u9:012:15:010
208639964,1cyclictest0-21swapper/008:45:230
208639963,1cyclictest8849-21snmpd07:36:560
208639960,0cyclictest0-21swapper/010:20:050
208639960,0cyclictest0-21swapper/008:15:200
208639960,0cyclictest0-21swapper/007:23:140
208799955,0cyclictest61250irq/122-eno108:35:172
208799955,0cyclictest61250irq/122-eno107:35:132
208799954,1cyclictest28-21ksoftirqd/208:10:002
208729955,0cyclictest0-21swapper/112:21:021
208729955,0cyclictest0-21swapper/109:04:311
208729955,0cyclictest0-21swapper/107:15:141
208729953,1cyclictest17983-21chrt10:41:041
208729953,1cyclictest137942sleep109:52:301
208729951,1cyclictest0-21swapper/110:20:001
208729950,5cyclictest0-21swapper/111:43:331
208729950,5cyclictest0-21swapper/110:55:271
208729950,5cyclictest0-21swapper/108:15:171
208729950,5cyclictest0-21swapper/107:40:161
208729950,5cyclictest0-21swapper/107:39:561
208729950,4cyclictest0-21swapper/112:11:051
208729950,4cyclictest0-21swapper/111:50:371
208729950,4cyclictest0-21swapper/111:25:431
208729950,4cyclictest0-21swapper/109:20:061
208729950,4cyclictest0-21swapper/108:31:031
208729950,3cyclictest0-21swapper/112:35:071
208729950,3cyclictest0-21swapper/110:52:251
208729950,2cyclictest0-21swapper/111:57:371
208729950,2cyclictest0-21swapper/110:30:191
208729950,2cyclictest0-21swapper/110:08:131
208729950,2cyclictest0-21swapper/109:30:081
208729950,2cyclictest0-21swapper/109:05:151
208729950,1cyclictest0-21swapper/107:50:101
208729950,0cyclictest0-21swapper/108:35:151
208639954,1cyclictest8849-21snmpd08:22:520
208639950,4cyclictest0-21swapper/008:50:150
208639950,0cyclictest0-21swapper/008:35:120
208729941,1cyclictest0-21swapper/108:45:011
208729940,4cyclictest0-21swapper/107:45:071
208729940,2cyclictest0-21swapper/112:25:101
208729940,2cyclictest0-21swapper/108:10:111
208729940,0cyclictest0-21swapper/108:40:191
25486230,1sleep10-21swapper/108:25:121
208729931,1cyclictest0-21swapper/108:20:101
208729931,1cyclictest0-21swapper/107:30:111
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional