You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-21 - 22:36
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the 376 highest latencies:
System rack1slot1.osadl.org (updated Sun Jul 21, 2024 12:45:10)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
28542221158,24sleep10-21swapper/107:09:471
27392212149,22sleep00-21swapper/007:08:180
26242202162,26sleep20-21swapper/207:06:472
28612200162,24sleep30-21swapper/307:09:543
149952700,0sleep00-21swapper/012:38:520
188782630,0sleep10-21swapper/111:11:181
33142580,0sleep10-21swapper/110:05:011
298099170,16cyclictest10575-21aten_r1power_po10:15:120
298099160,15cyclictest8586-21ssh12:30:120
298099160,15cyclictest6906-21apt-get09:25:080
298099160,15cyclictest28446-21diskmemload10:55:200
298099160,15cyclictest28446-21diskmemload09:56:270
298099160,15cyclictest28446-21diskmemload09:50:540
298099160,15cyclictest16622-21latency_hist08:45:000
298099160,15cyclictest14211-21irqstats11:05:160
2980991511,3cyclictest28446-21diskmemload11:18:420
298099150,15cyclictest0-21swapper/011:25:250
298099150,14cyclictest5746-21ssh10:54:170
298099150,14cyclictest28446-21diskmemload11:40:130
298099150,14cyclictest28446-21diskmemload11:40:130
298099150,14cyclictest28446-21diskmemload10:30:300
298099150,14cyclictest28446-21diskmemload09:22:480
298099150,14cyclictest28446-21diskmemload09:22:470
298099150,12cyclictest28146-21df08:00:130
298099141,12cyclictest9986-21cat08:30:130
298099141,12cyclictest9086-21df_inode07:20:130
298099140,14cyclictest28446-21diskmemload11:45:130
298099140,14cyclictest0-21swapper/011:59:400
298099140,14cyclictest0-21swapper/011:30:150
298099140,14cyclictest0-21swapper/008:10:110
298099140,13cyclictest31088-21ssh09:12:100
298099140,13cyclictest28446-21diskmemload11:35:090
298099140,13cyclictest28446-21diskmemload10:40:180
298099140,13cyclictest28446-21diskmemload10:02:160
298099140,13cyclictest20211-21ssh10:28:100
298099140,13cyclictest12345-21ssh11:02:510
298099140,13cyclictest0-21swapper/012:20:220
298099140,13cyclictest0-21swapper/012:15:170
298099140,13cyclictest0-21swapper/007:55:150
298099130,13cyclictest0-21swapper/012:26:330
298099130,13cyclictest0-21swapper/007:50:180
298099130,12cyclictest28446-21diskmemload12:10:500
298099130,12cyclictest28446-21diskmemload10:45:510
298099130,12cyclictest28446-21diskmemload10:35:050
298099130,12cyclictest28446-21diskmemload09:46:460
298099130,12cyclictest28446-21diskmemload09:36:220
298099130,12cyclictest28446-21diskmemload09:33:050
298099130,12cyclictest28446-21diskmemload09:15:390
298099130,12cyclictest0-21swapper/011:20:140
298099130,12cyclictest0-21swapper/011:10:190
298099130,12cyclictest0-21swapper/010:05:260
298099130,10cyclictest32264-21latency_hist08:10:000
298099122,10cyclictest0-21swapper/008:15:170
298099120,9cyclictest11068-21aten_r1power_vo07:25:110
298099120,9cyclictest0-21swapper/011:50:130
298099120,12cyclictest28446-21diskmemload10:10:380
298099120,12cyclictest0-21swapper/008:39:250
298099120,12cyclictest0-21swapper/007:30:160
298099120,11cyclictest28446-21diskmemload12:00:330
298099120,11cyclictest14140-21ssh10:20:130
298099120,11cyclictest14140-21ssh10:20:120
298099120,11cyclictest0-21swapper/012:05:170
298099120,11cyclictest0-21swapper/007:15:210
298099110,8cyclictest0-21swapper/009:05:110
298099110,11cyclictest0-21swapper/009:40:100
298099110,10cyclictest0-21swapper/008:50:180
300199100,8cyclictest13063-21kworker/u8:010:18:093
299299100,1cyclictest19745-21snmpd12:39:532
298099105,4cyclictest19745-21snmpd07:46:590
298099100,10cyclictest0-21swapper/008:45:110
30019999,0cyclictest35-21ksoftirqd/309:37:403
30019997,1cyclictest35-21ksoftirqd/307:24:593
29809992,6cyclictest5333-21munin-node07:15:010
23833290,0sleep20-21swapper/211:20:092
2352290,0sleep328446-21diskmemload10:03:163
13112290,2sleep121-21ksoftirqd/111:50:151
30019988,0cyclictest35-21ksoftirqd/309:13:363
30019988,0cyclictest341rcuc/312:25:243
30019987,1cyclictest35-21ksoftirqd/312:35:233
30019987,1cyclictest35-21ksoftirqd/312:00:003
30019987,1cyclictest35-21ksoftirqd/311:19:593
30019987,1cyclictest35-21ksoftirqd/309:50:143
30019987,1cyclictest35-21ksoftirqd/309:30:013
30019987,1cyclictest35-21ksoftirqd/309:15:143
30019987,1cyclictest35-21ksoftirqd/308:40:013
30019987,1cyclictest35-21ksoftirqd/308:15:003
30019986,1cyclictest35-21ksoftirqd/311:40:133
30019986,1cyclictest35-21ksoftirqd/311:40:123
30019986,1cyclictest19745-21snmpd10:57:173
30019986,1cyclictest19745-21snmpd10:28:013
30019986,1cyclictest19745-21snmpd07:44:053
30019983,2cyclictest259-21systemd-journal07:39:543
30019982,4cyclictest28334-21/usr/sbin/munin12:10:193
30019980,6cyclictest261962sleep312:09:203
30019980,5cyclictest0-21swapper/308:40:153
29929988,0cyclictest28-21ksoftirqd/210:03:052
29929988,0cyclictest0-21swapper/210:12:502
29929988,0cyclictest0-21swapper/209:31:372
29929986,1cyclictest61250irq/122-eno111:55:242
29929986,1cyclictest61250irq/122-eno111:00:462
29929986,1cyclictest61250irq/122-eno109:59:422
29929986,1cyclictest19745-21snmpd11:25:412
29929986,1cyclictest19745-21snmpd10:27:162
29929986,1cyclictest19745-21snmpd09:15:082
29929986,1cyclictest0-21swapper/211:15:132
29929980,8cyclictest0-21swapper/212:19:152
29929980,6cyclictest0-21swapper/210:21:512
29929980,6cyclictest0-21swapper/210:21:502
29869981,6cyclictest0-21swapper/109:53:541
29869980,4cyclictest0-21swapper/108:30:001
29809980,7cyclictest8031-21which08:25:140
29809980,7cyclictest4866-21apt-get08:20:110
29809980,7cyclictest23976-21apt-get09:00:100
29809980,7cyclictest21741-21aten_r1power_vo08:55:110
29809980,7cyclictest18214-21apt07:40:100
29809980,7cyclictest16206-21tune2fs07:35:160
2118280,1sleep10-21swapper/110:02:301
30019977,0cyclictest35-21ksoftirqd/311:35:213
30019977,0cyclictest35-21ksoftirqd/311:05:173
30019977,0cyclictest35-21ksoftirqd/307:15:013
30019976,1cyclictest35-21ksoftirqd/312:15:113
30019976,1cyclictest35-21ksoftirqd/311:30:153
30019976,1cyclictest35-21ksoftirqd/311:20:133
30019976,1cyclictest35-21ksoftirqd/310:50:223
30019976,1cyclictest35-21ksoftirqd/310:30:143
30019976,1cyclictest35-21ksoftirqd/310:20:143
30019976,1cyclictest35-21ksoftirqd/310:20:143
30019976,1cyclictest35-21ksoftirqd/310:10:163
30019976,1cyclictest35-21ksoftirqd/309:40:013
30019976,1cyclictest35-21ksoftirqd/308:05:193
30019976,1cyclictest19745-21snmpd11:50:463
30019975,1cyclictest35-21ksoftirqd/310:35:183
30019975,1cyclictest35-21ksoftirqd/308:55:273
30019975,1cyclictest19745-21snmpd10:48:473
30019975,1cyclictest19745-21snmpd07:30:293
30019973,2cyclictest9209-21cut12:30:173
30019972,5cyclictest6455-21kworker/u8:009:31:233
30019971,5cyclictest534-21nscd08:25:183
30019971,5cyclictest31012-21kworker/u8:210:07:213
30019971,3cyclictest0-21swapper/309:00:123
30019970,4cyclictest0-21swapper/311:45:083
29929976,1cyclictest61250irq/122-eno112:26:252
29929976,1cyclictest61250irq/122-eno112:10:142
29929976,1cyclictest61250irq/122-eno111:39:152
29929976,1cyclictest61250irq/122-eno111:31:562
29929976,1cyclictest61250irq/122-eno110:55:132
29929976,1cyclictest61250irq/122-eno110:49:042
29929976,1cyclictest61250irq/122-eno110:37:572
29929976,1cyclictest61250irq/122-eno110:30:292
29929976,1cyclictest61250irq/122-eno110:07:062
29929976,1cyclictest61250irq/122-eno109:50:142
29929976,1cyclictest61250irq/122-eno109:45:172
29929976,1cyclictest61250irq/122-eno109:24:362
29929976,1cyclictest61250irq/122-eno109:24:362
29929976,1cyclictest61250irq/122-eno108:28:002
29929976,0cyclictest61250irq/122-eno107:35:142
29929975,1cyclictest61250irq/122-eno112:30:172
29929975,1cyclictest19745-21snmpd10:41:292
29929975,1cyclictest18287-21ssh09:40:112
29929975,1cyclictest15339-21ssh11:06:142
29929975,1cyclictest14713-21ssh11:51:312
29929971,6cyclictest5333-21munin-node12:20:572
29929970,3cyclictest0-21swapper/211:41:232
29929970,3cyclictest0-21swapper/211:41:232
29929970,2cyclictest0-21swapper/208:35:162
29929970,1cyclictest0-21swapper/212:07:582
29929970,1cyclictest0-21swapper/209:00:562
29869971,6cyclictest0-21swapper/110:21:251
29869971,6cyclictest0-21swapper/110:21:251
29869971,6cyclictest0-21swapper/109:47:031
29869971,4cyclictest0-21swapper/112:31:101
29869971,1cyclictest0-21swapper/111:31:261
29869970,6cyclictest0-21swapper/112:11:031
29869970,6cyclictest0-21swapper/109:43:511
29869970,6cyclictest0-21swapper/109:35:221
29869970,5cyclictest0-21swapper/111:40:381
29869970,5cyclictest0-21swapper/111:40:371
29869970,5cyclictest0-21swapper/111:28:511
29869970,4cyclictest0-21swapper/111:03:031
29869970,3cyclictest0-21swapper/110:55:091
29869970,3cyclictest0-21swapper/110:53:571
29869970,1cyclictest0-21swapper/109:11:471
29869970,1cyclictest0-21swapper/107:34:351
30019966,0cyclictest35-21ksoftirqd/312:20:143
30019966,0cyclictest35-21ksoftirqd/309:20:123
30019966,0cyclictest35-21ksoftirqd/309:20:113
30019966,0cyclictest35-21ksoftirqd/308:00:163
30019965,1cyclictest35-21ksoftirqd/311:25:253
30019965,1cyclictest35-21ksoftirqd/311:10:143
30019965,1cyclictest35-21ksoftirqd/310:40:153
30019965,1cyclictest35-21ksoftirqd/309:45:133
30019965,1cyclictest35-21ksoftirqd/308:20:143
30019965,1cyclictest35-21ksoftirqd/307:45:123
30019965,1cyclictest35-21ksoftirqd/307:25:113
30019965,1cyclictest35-21ksoftirqd/307:10:183
30019965,1cyclictest19595-21ssh12:00:043
30019965,0cyclictest35-21ksoftirqd/311:00:203
30019964,1cyclictest28446-21diskmemload09:55:423
30019964,1cyclictest19745-21snmpd08:19:393
30019961,3cyclictest35-21ksoftirqd/309:05:173
29929966,0cyclictest61250irq/122-eno111:45:062
29929966,0cyclictest61250irq/122-eno109:36:252
29929966,0cyclictest61250irq/122-eno109:26:372
29929966,0cyclictest61250irq/122-eno108:21:282
29929966,0cyclictest61250irq/122-eno108:05:162
29929966,0cyclictest61250irq/122-eno107:53:232
29929966,0cyclictest61250irq/122-eno107:44:032
29929966,0cyclictest61250irq/122-eno107:22:432
29929965,1cyclictest61250irq/122-eno108:40:152
29929965,1cyclictest61250irq/122-eno108:04:342
29929964,1cyclictest61250irq/122-eno112:00:112
29929964,1cyclictest61250irq/122-eno111:10:102
29929964,1cyclictest61250irq/122-eno110:50:102
29929964,1cyclictest61250irq/122-eno109:10:102
29929964,1cyclictest61250irq/122-eno108:45:142
29929964,1cyclictest61250irq/122-eno108:30:112
29929964,1cyclictest61250irq/122-eno107:20:002
29929964,1cyclictest61250irq/122-eno107:10:092
29929964,1cyclictest26159-21cat07:55:142
29929962,1cyclictest283-21systemd-udevd10:15:152
29929961,1cyclictest0-21swapper/207:45:162
29929960,6cyclictest0-21swapper/208:12:512
29929960,1cyclictest0-21swapper/209:05:102
29929960,1cyclictest0-21swapper/208:50:112
29929960,1cyclictest0-21swapper/208:16:152
29929960,1cyclictest0-21swapper/207:26:262
29869966,0cyclictest0-21swapper/112:05:171
29869965,1cyclictest0-21swapper/110:25:451
29869963,1cyclictest0-21swapper/111:15:011
29869961,2cyclictest0-21swapper/112:25:021
29869960,6cyclictest0-21swapper/111:24:201
29869960,6cyclictest0-21swapper/110:43:411
29869960,6cyclictest0-21swapper/107:56:311
29869960,6cyclictest0-21swapper/107:54:541
29869960,6cyclictest0-21swapper/107:22:581
29869960,6cyclictest0-21swapper/107:17:591
29869960,5cyclictest0-21swapper/112:15:581
29869960,5cyclictest0-21swapper/110:10:141
29869960,5cyclictest0-21swapper/108:42:341
29869960,5cyclictest0-21swapper/108:34:331
29869960,5cyclictest0-21swapper/108:20:151
29869960,4cyclictest0-21swapper/112:21:121
29869960,4cyclictest0-21swapper/107:35:151
29869960,3cyclictest0-21swapper/111:05:161
29869960,3cyclictest0-21swapper/110:31:311
29869960,2cyclictest0-21swapper/112:40:001
29869960,2cyclictest0-21swapper/111:35:211
29869960,2cyclictest0-21swapper/110:50:001
29869960,1cyclictest0-21swapper/109:20:171
29869960,1cyclictest0-21swapper/109:20:171
29869960,1cyclictest0-21swapper/108:51:291
29869960,0cyclictest0-21swapper/109:55:501
30019955,0cyclictest35-21ksoftirqd/308:50:123
30019954,1cyclictest35-21ksoftirqd/308:45:143
30019954,1cyclictest35-21ksoftirqd/307:55:113
30019953,1cyclictest19745-21snmpd07:52:303
29929955,0cyclictest61250irq/122-eno107:30:112
29869950,5cyclictest0-21swapper/110:35:101
29869950,5cyclictest0-21swapper/109:26:061
29869950,5cyclictest0-21swapper/108:45:161
29869950,5cyclictest0-21swapper/108:07:421
29869950,5cyclictest0-21swapper/107:29:461
29869950,4cyclictest0-21swapper/109:16:281
29869950,4cyclictest0-21swapper/108:35:431
29869950,3cyclictest26326-21taskset09:05:091
29869950,3cyclictest0-21swapper/110:16:171
29869950,2cyclictest0-21swapper/111:47:491
29869950,1cyclictest0-21swapper/112:00:041
29869950,1cyclictest0-21swapper/111:55:271
29869950,1cyclictest0-21swapper/109:30:241
29869950,0cyclictest0-21swapper/109:02:561
30019940,1cyclictest0-21swapper/308:30:153
29929944,0cyclictest61250irq/122-eno108:55:022
29869941,3cyclictest0-21swapper/107:11:461
29869940,3cyclictest0-21swapper/108:55:121
29869932,1cyclictest223812sleep107:46:151
29869930,2cyclictest0-21swapper/108:15:141
29869930,2cyclictest0-21swapper/108:00:111
29869930,2cyclictest0-21swapper/107:40:101
29869930,1cyclictest0-21swapper/108:10:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional