You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-24 - 17:24
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of the highest latencies:
System rack1slot1.osadl.org (updated Wed Apr 24, 2024 12:45:07)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
119312226156,57sleep30-21swapper/307:08:293
118102209172,24sleep10-21swapper/107:06:541
99342200160,26sleep20-21swapper/207:05:012
119532197158,26sleep00-21swapper/007:08:450
68402780,0sleep10-21swapper/108:15:151
66202670,0sleep232018-21diskmemload12:15:132
12155991616,0cyclictest28-21ksoftirqd/211:35:192
12155991616,0cyclictest28-21ksoftirqd/210:07:222
37402140,0sleep20-21swapper/210:44:032
162082130,0sleep20-21swapper/211:44:532
12144991211,1cyclictest9-21ksoftirqd/012:15:010
12144991210,1cyclictest9-21ksoftirqd/009:25:000
1215599119,1cyclictest28-21ksoftirqd/212:10:102
12155991111,0cyclictest28-21ksoftirqd/209:22:382
1214899111,5cyclictest0-21swapper/107:10:101
1214499119,1cyclictest9-21ksoftirqd/007:30:000
12144991110,1cyclictest9-21ksoftirqd/012:22:370
12144991110,1cyclictest9-21ksoftirqd/012:22:360
62922100,0sleep10-21swapper/109:18:141
312112100,0sleep10-21swapper/110:36:051
16872100,0sleep20-21swapper/211:25:082
1215599109,1cyclictest28-21ksoftirqd/210:25:122
1215599109,1cyclictest28-21ksoftirqd/210:22:172
12155991010,0cyclictest28-21ksoftirqd/211:15:062
1214899101,8cyclictest20797-21taskset09:37:041
1214499109,1cyclictest9-21ksoftirqd/011:00:220
1214499109,1cyclictest9-21ksoftirqd/010:10:170
1214499109,1cyclictest9-21ksoftirqd/009:35:140
1214499108,1cyclictest9-21ksoftirqd/007:15:010
1214499104,5cyclictest21176-21perf07:35:000
12144991010,0cyclictest9-21ksoftirqd/010:35:170
121629997,1cyclictest35-21ksoftirqd/309:40:133
121559999,0cyclictest28-21ksoftirqd/212:35:152
121559999,0cyclictest28-21ksoftirqd/211:30:112
121559999,0cyclictest28-21ksoftirqd/210:37:352
121559999,0cyclictest28-21ksoftirqd/209:30:092
121559999,0cyclictest28-21ksoftirqd/209:18:472
121559999,0cyclictest0-21swapper/210:00:532
121559998,1cyclictest28-21ksoftirqd/211:55:152
121559998,1cyclictest28-21ksoftirqd/211:15:002
121559998,1cyclictest28-21ksoftirqd/211:05:112
121559998,1cyclictest28-21ksoftirqd/210:59:552
121559998,1cyclictest28-21ksoftirqd/209:45:142
121559998,1cyclictest28-21ksoftirqd/209:40:212
121559998,1cyclictest28-21ksoftirqd/209:27:162
121559998,1cyclictest28-21ksoftirqd/209:11:462
121559998,1cyclictest28-21ksoftirqd/207:15:012
121559990,6cyclictest0-21swapper/210:50:162
121449999,0cyclictest9-21ksoftirqd/011:40:120
121449997,1cyclictest9-21ksoftirqd/012:15:130
121449997,1cyclictest9-21ksoftirqd/011:59:590
121449991,4cyclictest26428-21perf11:15:000
121449990,4cyclictest17639-21latency_hist08:40:000
3174280,0sleep10-21swapper/109:56:391
121629986,1cyclictest8849-21snmpd11:37:313
121629986,1cyclictest8849-21snmpd08:58:383
121629986,1cyclictest8849-21snmpd08:04:343
121629986,1cyclictest28506-21cat12:00:173
121629980,7cyclictest22372-21apt-get08:50:013
121629980,6cyclictest32018-21diskmemload09:22:363
121629980,3cyclictest0-21swapper/310:20:123
121559988,0cyclictest28-21ksoftirqd/212:05:462
121559988,0cyclictest28-21ksoftirqd/211:49:112
121559988,0cyclictest28-21ksoftirqd/210:45:182
121559988,0cyclictest28-21ksoftirqd/210:15:382
121559988,0cyclictest28-21ksoftirqd/209:55:192
121559988,0cyclictest28-21ksoftirqd/209:35:152
121559988,0cyclictest28-21ksoftirqd/208:45:232
121559987,1cyclictest28-21ksoftirqd/212:34:032
121559987,1cyclictest28-21ksoftirqd/212:24:242
121559987,1cyclictest28-21ksoftirqd/212:24:242
121559987,1cyclictest28-21ksoftirqd/211:20:112
121559987,1cyclictest28-21ksoftirqd/211:02:472
121559987,0cyclictest28-21ksoftirqd/210:30:522
121559986,1cyclictest61250irq/122-eno112:25:132
121559986,1cyclictest28-21ksoftirqd/210:10:182
121559985,1cyclictest61250irq/122-eno109:54:552
121559980,7cyclictest8849-21snmpd11:50:142
121489980,5cyclictest0-21swapper/109:14:091
121489980,2cyclictest0-21swapper/111:15:211
121449988,0cyclictest9-21ksoftirqd/011:30:100
121449988,0cyclictest9-21ksoftirqd/010:05:390
121449988,0cyclictest9-21ksoftirqd/008:50:010
121449987,1cyclictest9-21ksoftirqd/012:05:130
121449987,1cyclictest9-21ksoftirqd/010:40:000
121449987,1cyclictest9-21ksoftirqd/010:35:000
121449987,1cyclictest9-21ksoftirqd/008:45:010
121449986,1cyclictest9-21ksoftirqd/011:05:240
121449986,1cyclictest9-21ksoftirqd/010:55:140
121449986,1cyclictest9-21ksoftirqd/009:45:200
121449984,3cyclictest32013-21basename09:10:000
121449983,0cyclictest0-21swapper/011:35:110
121449981,3cyclictest32018-21diskmemload12:35:140
121449980,4cyclictest7783-21apt10:50:000
121449980,4cyclictest12926-21latency_hist08:30:000
121629976,1cyclictest35-21ksoftirqd/309:20:013
121629975,1cyclictest8849-21snmpd10:06:433
121629975,1cyclictest8849-21snmpd08:43:143
121629975,1cyclictest8849-21snmpd08:37:293
121629975,1cyclictest8849-21snmpd08:19:163
121629975,1cyclictest8849-21snmpd08:12:493
121629975,1cyclictest8849-21snmpd08:09:103
121629975,1cyclictest8849-21snmpd07:55:193
121629975,1cyclictest25151-21ssh11:11:283
121629975,1cyclictest1790-21ssh09:10:463
121629975,1cyclictest13510-21ssh10:10:233
121629975,1cyclictest0-21swapper/312:23:543
121629975,1cyclictest0-21swapper/312:23:543
121629974,1cyclictest259-21systemd-journal10:39:553
121629973,3cyclictest3907-21smartctl12:10:223
121629972,4cyclictest757-21runrttasks10:42:583
121629972,2cyclictest0-21swapper/312:07:243
121629971,4cyclictest32018-21diskmemload12:38:383
121629970,7cyclictest0-21swapper/312:18:093
121629970,6cyclictest0-21swapper/310:50:153
121629970,5cyclictest76042sleep310:49:323
121629970,5cyclictest0-21swapper/311:42:143
121629970,5cyclictest0-21swapper/309:30:013
121629970,3cyclictest0-21swapper/309:25:263
121629970,2cyclictest0-21swapper/311:54:293
121559977,0cyclictest28-21ksoftirqd/208:00:152
121559976,1cyclictest28-21ksoftirqd/212:00:352
121559976,1cyclictest28-21ksoftirqd/207:40:012
121559976,1cyclictest28-21ksoftirqd/207:20:082
121559975,2cyclictest28-21ksoftirqd/207:59:482
121559975,1cyclictest8849-21snmpd09:07:062
121559975,1cyclictest28-21ksoftirqd/208:55:242
121559970,2cyclictest0-21swapper/208:10:122
121559970,1cyclictest0-21swapper/208:24:002
121489971,6cyclictest0-21swapper/112:39:361
121489971,6cyclictest0-21swapper/112:25:031
121489971,6cyclictest0-21swapper/112:10:501
121489971,6cyclictest0-21swapper/108:56:591
121489971,1cyclictest0-21swapper/107:22:491
121489970,4cyclictest0-21swapper/110:29:181
121489970,4cyclictest0-21swapper/110:21:291
121489970,4cyclictest0-21swapper/110:11:481
121489970,3cyclictest0-21swapper/112:01:191
121489970,3cyclictest0-21swapper/109:51:031
121489970,2cyclictest0-21swapper/111:45:111
121489970,1cyclictest0-21swapper/111:20:111
121489970,1cyclictest0-21swapper/109:21:271
121449977,0cyclictest9-21ksoftirqd/012:33:360
121449977,0cyclictest9-21ksoftirqd/011:25:240
121449977,0cyclictest9-21ksoftirqd/009:50:200
121449976,1cyclictest9-21ksoftirqd/012:00:140
121449976,1cyclictest9-21ksoftirqd/011:45:110
121449976,1cyclictest9-21ksoftirqd/011:20:070
121449976,1cyclictest9-21ksoftirqd/009:40:110
121449976,1cyclictest9-21ksoftirqd/009:00:170
121449976,1cyclictest9-21ksoftirqd/007:15:000
121449976,1cyclictest8849-21snmpd07:40:090
121449976,1cyclictest8849-21snmpd07:40:090
121449976,0cyclictest32018-21diskmemload09:58:040
121449973,3cyclictest28813-21cron07:55:010
121449972,4cyclictest8086-21apt-get10:50:150
121449970,6cyclictest0-21swapper/010:15:180
121449970,3cyclictest0-21swapper/008:45:130
121449970,1cyclictest9082-1kworker/u9:009:30:380
121449970,1cyclictest3749-21telnet08:10:120
121449970,1cyclictest3495-21/usr/sbin/munin09:15:160
121449970,1cyclictest29053-21/usr/sbin/munin07:55:120
121449970,1cyclictest28127-1kworker/u9:010:00:320
121449970,1cyclictest22656-21ssh10:23:290
121449970,1cyclictest18555-1kworker/u9:111:50:070
121449970,1cyclictest10886-21ssh09:25:030
121449970,1cyclictest0-21swapper/011:16:070
121449970,1cyclictest0-21swapper/010:27:390
9462260,0sleep10-21swapper/108:20:181
27558260,0sleep20-21swapper/209:00:122
21992260,0sleep10-21swapper/111:08:051
121629966,0cyclictest14494-21kworker/3:209:03:343
121629965,1cyclictest29277-21ssh11:17:393
121629965,1cyclictest21661-21ssh11:07:063
121629965,1cyclictest20745-21ssh09:36:573
121629965,1cyclictest16484-21ssh11:45:013
121629965,1cyclictest16027-21ssh12:27:453
121629964,1cyclictest8849-21snmpd09:51:583
121629964,1cyclictest8849-21snmpd07:21:273
121629964,1cyclictest8849-21snmpd07:17:253
121629964,1cyclictest35-21ksoftirqd/310:55:193
121629964,1cyclictest30966-21tail09:05:193
121629964,1cyclictest27586-21ssh10:31:163
121629964,1cyclictest19549-21ntp_states07:25:193
121629963,2cyclictest22353-21memory07:35:123
121629962,2cyclictest32018-21diskmemload10:26:473
121629960,6cyclictest32018-21diskmemload11:01:333
121629960,6cyclictest18711-21ssh10:17:543
121629960,4cyclictest0-21swapper/311:30:363
121629960,3cyclictest17423-21/usr/sbin/munin12:30:153
121629960,3cyclictest0-21swapper/311:55:353
121629960,3cyclictest0-21swapper/309:56:233
121629960,2cyclictest0-21swapper/311:25:113
121629960,2cyclictest0-21swapper/311:20:263
121629960,2cyclictest0-21swapper/310:02:253
121629960,1cyclictest0-21swapper/309:46:003
121559966,0cyclictest61250irq/122-eno108:15:272
121559966,0cyclictest61250irq/122-eno107:53:392
121559966,0cyclictest61250irq/122-eno107:30:092
121559966,0cyclictest61250irq/122-eno107:19:402
121559966,0cyclictest28-21ksoftirqd/208:40:112
121559965,1cyclictest61250irq/122-eno107:47:062
121559964,1cyclictest61250irq/122-eno108:30:242
121559964,1cyclictest61250irq/122-eno107:25:192
121559964,1cyclictest28-21ksoftirqd/208:50:222
121559960,5cyclictest0-21swapper/208:29:532
121489966,0cyclictest0-21swapper/110:47:001
121489963,1cyclictest0-21swapper/110:30:421
121489961,3cyclictest0-21swapper/110:50:251
121489961,2cyclictest0-21swapper/112:05:071
121489960,6cyclictest0-21swapper/109:33:251
121489960,5cyclictest0-21swapper/109:03:511
121489960,5cyclictest0-21swapper/108:45:061
121489960,3cyclictest0-21swapper/110:58:551
121489960,3cyclictest0-21swapper/110:05:231
121489960,2cyclictest0-21swapper/111:42:171
121489960,2cyclictest0-21swapper/111:28:301
121489960,1cyclictest0-21swapper/109:42:051
121489960,1cyclictest0-21swapper/109:27:121
121449965,1cyclictest9-21ksoftirqd/008:16:530
121449965,1cyclictest8849-21snmpd08:23:590
121449963,1cyclictest259-21systemd-journal09:10:000
121449960,3cyclictest0-21swapper/008:30:130
121449960,0cyclictest0-21swapper/012:25:090
121449960,0cyclictest0-21swapper/008:56:200
121449960,0cyclictest0-21swapper/007:45:070
121449960,0cyclictest0-21swapper/007:24:160
121629954,1cyclictest20812-21sshd07:31:133
121629953,1cyclictest27867-21ntp_states07:50:203
121629952,2cyclictest20253-21apt-get08:45:133
121629951,3cyclictest9607-21ntp_offset08:20:213
121629951,2cyclictest0-21swapper/307:15:003
121629950,3cyclictest13168-21apt-get08:30:133
121559955,0cyclictest61250irq/122-eno108:35:112
121559955,0cyclictest0-21swapper/207:41:512
121559955,0cyclictest0-21swapper/207:41:502
121559950,1cyclictest1351-21/usr/sbin/munin08:05:112
121489951,3cyclictest0-21swapper/108:35:111
121489951,2cyclictest0-21swapper/108:05:101
121489951,1cyclictest0-21swapper/109:47:181
121489950,5cyclictest0-21swapper/111:55:531
121489950,5cyclictest0-21swapper/109:05:191
121489950,5cyclictest0-21swapper/107:39:481
121489950,4cyclictest11164-21chrt11:36:031
121489950,4cyclictest0-21swapper/111:30:141
121489950,3cyclictest0-21swapper/112:20:151
121489950,3cyclictest0-21swapper/112:20:141
121489950,3cyclictest0-21swapper/111:01:261
121489950,2cyclictest0-21swapper/112:33:121
121489950,2cyclictest0-21swapper/112:16:531
121489950,2cyclictest0-21swapper/111:52:581
121489950,2cyclictest0-21swapper/111:10:181
121489950,1cyclictest0-21swapper/110:15:121
121489950,1cyclictest0-21swapper/110:00:181
121489950,0cyclictest0-21swapper/110:41:021
121489950,0cyclictest0-21swapper/108:01:381
121489950,0cyclictest0-21swapper/107:54:251
121489950,0cyclictest0-21swapper/107:45:081
121449955,0cyclictest0-21swapper/007:35:060
121449954,1cyclictest9-21ksoftirqd/008:05:130
121449954,1cyclictest9-21ksoftirqd/008:00:120
121629943,1cyclictest35-21ksoftirqd/307:43:403
121629943,1cyclictest35-21ksoftirqd/307:43:403
121629942,1cyclictest11939-21ntp_kernel_err08:25:233
121629941,1cyclictest25462-21netstat07:45:133
121489943,1cyclictest56852sleep108:13:141
121489943,1cyclictest20247-21chrt07:26:561
121489941,2cyclictest0-21swapper/108:25:141
121489941,1cyclictest0-21swapper/108:30:131
121489940,3cyclictest0-21swapper/107:16:291
23018230,1sleep10-21swapper/108:50:151
121489931,1cyclictest0-21swapper/108:45:001
121489931,1cyclictest0-21swapper/107:55:111
121489930,3cyclictest23802-21taskset07:41:111
121489930,3cyclictest23802-21taskset07:41:101
121489930,2cyclictest0-21swapper/107:30:191
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional