You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-11-13 - 22:18
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Characteristics of all highest latencies:
System rack1slot1.osadl.org (updated Wed Nov 13, 2024 12:45:17)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
84502205159,32sleep20-21swapper/207:08:152
84492199162,24sleep10-21swapper/107:08:141
83872199162,24sleep30-21swapper/307:07:273
84752198160,25sleep00-21swapper/007:08:340
12502660,0sleep10-21swapper/109:05:191
869599201,13cyclictest28-21ksoftirqd/212:35:182
222812150,0sleep10-21swapper/109:32:391
8695991414,0cyclictest28-21ksoftirqd/212:30:152
8695991412,1cyclictest28-21ksoftirqd/209:14:592
248542140,0sleep20-21swapper/211:35:042
8695991311,1cyclictest28-21ksoftirqd/207:19:592
8695991211,1cyclictest28-21ksoftirqd/208:19:592
8695991210,1cyclictest28-21ksoftirqd/211:00:232
8695991210,1cyclictest28-21ksoftirqd/210:05:002
8695991210,1cyclictest28-21ksoftirqd/209:50:222
869599120,11cyclictest327-21fschecks_count09:45:132
868099123,4cyclictest32559-21cut12:25:000
8680991211,1cyclictest9-21ksoftirqd/011:45:010
8680991210,1cyclictest9-21ksoftirqd/008:00:000
8700991110,1cyclictest35-21ksoftirqd/308:05:003
869599119,1cyclictest28-21ksoftirqd/209:35:232
8695991111,0cyclictest28-21ksoftirqd/211:40:162
8695991110,1cyclictest28-21ksoftirqd/208:55:002
869599110,4cyclictest0-21swapper/210:05:102
8680991110,1cyclictest9-21ksoftirqd/011:20:000
868099111,5cyclictest1909-21diskmemload10:25:000
869599109,1cyclictest557-21nscd09:18:332
869599109,1cyclictest28-21ksoftirqd/211:30:152
869599109,1cyclictest28-21ksoftirqd/210:15:092
869599109,1cyclictest28-21ksoftirqd/209:42:082
869599108,1cyclictest28-21ksoftirqd/207:45:002
869599100,9cyclictest0-21swapper/208:10:152
869599100,1cyclictest0-21swapper/209:22:092
868099109,1cyclictest9-21ksoftirqd/010:25:150
868099109,1cyclictest10260-21ls09:20:010
868099109,0cyclictest101rcuc/007:15:010
868099108,1cyclictest9-21ksoftirqd/010:10:010
868099102,4cyclictest5835-21perf09:14:590
86959999,0cyclictest28-21ksoftirqd/211:50:212
86959998,1cyclictest28-21ksoftirqd/212:20:112
86959998,1cyclictest28-21ksoftirqd/212:09:432
86959998,1cyclictest28-21ksoftirqd/211:45:102
86959998,1cyclictest28-21ksoftirqd/210:45:112
86959998,1cyclictest28-21ksoftirqd/210:22:352
86959998,1cyclictest28-21ksoftirqd/210:10:002
86959998,1cyclictest28-21ksoftirqd/207:35:172
86959997,1cyclictest28-21ksoftirqd/211:10:142
86959997,1cyclictest28-21ksoftirqd/210:43:022
86809998,1cyclictest9-21ksoftirqd/012:33:570
86809998,1cyclictest9-21ksoftirqd/011:35:000
86809998,1cyclictest9-21ksoftirqd/007:40:000
86809993,5cyclictest19033-21perf09:30:000
86809990,5cyclictest1909-21diskmemload12:35:160
86809990,4cyclictest1909-21diskmemload11:30:000
86809990,3cyclictest0-21swapper/012:28:140
86809990,1cyclictest278-21systemd-udevd09:45:090
87009987,1cyclictest35-21ksoftirqd/309:27:533
87009986,1cyclictest793-21snmpd10:17:103
87009986,1cyclictest793-21snmpd07:45:213
87009986,1cyclictest35-21ksoftirqd/308:45:003
87009985,0cyclictest1909-21diskmemload10:34:073
87009980,4cyclictest28747-21/usr/sbin/munin12:20:133
86959988,0cyclictest28-21ksoftirqd/211:58:212
86959987,1cyclictest28-21ksoftirqd/212:15:122
86959987,1cyclictest0-21swapper/210:53:162
86959986,1cyclictest793-21snmpd12:25:272
86959986,1cyclictest793-21snmpd10:58:582
86959986,1cyclictest60950irq/123-eno111:18:022
86959986,1cyclictest60950irq/123-eno111:05:472
86959986,1cyclictest60950irq/123-eno108:40:152
86959986,1cyclictest28-21ksoftirqd/212:10:232
86959986,1cyclictest28-21ksoftirqd/211:20:122
86959986,1cyclictest28-21ksoftirqd/209:26:332
86959986,1cyclictest28-21ksoftirqd/207:50:132
86959981,6cyclictest0-21swapper/210:36:522
86959980,3cyclictest0-21swapper/212:01:532
86919986,1cyclictest0-21swapper/111:49:191
86919981,1cyclictest0-21swapper/109:47:351
86809988,0cyclictest9-21ksoftirqd/008:20:150
86809987,1cyclictest9-21ksoftirqd/011:00:000
86809987,1cyclictest9-21ksoftirqd/010:55:000
86809987,1cyclictest9-21ksoftirqd/009:55:000
86809986,1cyclictest9-21ksoftirqd/008:40:000
86809986,1cyclictest9-21ksoftirqd/008:28:460
86809986,1cyclictest793-21snmpd10:15:330
86809986,1cyclictest793-21snmpd08:10:380
86809985,1cyclictest254-21systemd-journal11:14:550
86809982,5cyclictest0-21swapper/007:55:000
86809980,7cyclictest3393-21ssh11:47:570
86809980,7cyclictest16124-21ssh12:04:270
86809980,7cyclictest14643-21ssh11:20:230
86809980,7cyclictest12916-21ssh09:21:350
86809980,7cyclictest12105-21ssh10:00:130
86809980,6cyclictest254-21systemd-journal09:45:000
87009976,1cyclictest35-21ksoftirqd/307:28:273
87009975,1cyclictest793-21snmpd10:40:313
87009975,1cyclictest793-21snmpd10:13:483
87009975,1cyclictest793-21snmpd07:15:053
87009975,1cyclictest30651-21ssh10:20:343
87009975,1cyclictest26728-21ssh10:55:263
87009975,1cyclictest2210-21ssh09:46:433
87009975,1cyclictest1088-21ls08:00:003
87009975,1cyclictest10081-21ssh09:19:493
87009974,2cyclictest793-21snmpd07:13:353
87009974,1cyclictest1909-21diskmemload10:50:543
87009972,3cyclictest2669-21apt-get12:30:103
87009971,5cyclictest14508-21kworker/3:209:14:253
87009970,4cyclictest11229-21munin-node09:40:053
87009970,4cyclictest0-21swapper/312:15:143
87009970,3cyclictest0-21swapper/310:35:123
87009970,2cyclictest0-21swapper/311:54:283
86959976,1cyclictest60950irq/123-eno109:55:112
86959976,1cyclictest28-21ksoftirqd/209:32:402
86959976,1cyclictest28-21ksoftirqd/208:45:152
86959976,1cyclictest28-21ksoftirqd/208:30:282
86959976,1cyclictest28-21ksoftirqd/208:25:142
86959976,1cyclictest28-21ksoftirqd/207:40:152
86959975,1cyclictest60950irq/123-eno111:25:142
86959975,1cyclictest60950irq/123-eno110:30:192
86959975,1cyclictest28-21ksoftirqd/208:05:002
86959974,1cyclictest254-21systemd-journal07:29:592
86959973,2cyclictest254-21systemd-journal07:15:002
86959970,6cyclictest11230-21kworker/2:007:59:412
86959970,2cyclictest1909-21diskmemload10:25:122
86959970,1cyclictest0-21swapper/208:35:122
86919973,2cyclictest0-21swapper/112:32:331
86919970,6cyclictest0-21swapper/107:27:281
86919970,4cyclictest0-21swapper/112:15:141
86919970,1cyclictest0-21swapper/108:37:391
86919970,1cyclictest0-21swapper/108:20:571
86809976,1cyclictest5829-21ssh11:50:240
86809975,1cyclictest9-21ksoftirqd/007:25:030
86809975,1cyclictest9-21ksoftirqd/007:20:170
86809975,1cyclictest793-21snmpd08:53:560
86809975,1cyclictest17374-21ssh10:05:160
86809973,0cyclictest30511-21tune2fs09:00:150
86809972,3cyclictest254-21systemd-journal09:59:090
86809972,2cyclictest0-21swapper/008:45:120
86809971,5cyclictest847-21ssh11:05:150
86809971,5cyclictest3554-1kworker/u9:010:30:110
86809971,4cyclictest21405-1kworker/u9:109:35:100
86809970,6cyclictest23673-1kworker/u9:212:15:030
86809970,6cyclictest17678-21ssh10:45:150
86809970,6cyclictest10472-21ssh11:55:330
86809970,6cyclictest0-21swapper/010:40:120
86809970,6cyclictest0-21swapper/009:30:150
86809970,4cyclictest8569-21apt-get10:35:100
86809970,1cyclictest0-21swapper/011:37:470
86809970,1cyclictest0-21swapper/011:00:160
86809970,1cyclictest0-21swapper/008:15:130
7270270,0sleep10-21swapper/109:54:031
87009965,1cyclictest871-21ssh12:26:243
87009965,1cyclictest7950-21ssh09:55:043
87009965,1cyclictest793-21snmpd12:39:013
87009965,1cyclictest793-21snmpd09:05:113
87009965,1cyclictest793-21snmpd08:17:573
87009965,1cyclictest5440-21cat11:10:153
87009965,1cyclictest22773-21ssh11:30:353
87009965,1cyclictest18832-21ssh11:25:463
87009965,1cyclictest17827-21perf08:35:003
87009965,1cyclictest14991-21ssh11:21:113
87009965,1cyclictest13807-21ssh09:23:263
87009965,1cyclictest11781-21ssh11:58:433
87009964,1cyclictest793-21snmpd08:35:573
87009964,1cyclictest2822-21ssh11:46:333
87009964,1cyclictest19590-21ssh12:08:063
87009963,1cyclictest35-21ksoftirqd/309:38:093
87009963,1cyclictest1909-21diskmemload10:47:123
87009962,3cyclictest1909-21diskmemload11:17:313
87009961,2cyclictest1909-21diskmemload11:08:413
87009960,4cyclictest0-21swapper/309:30:133
87009960,3cyclictest3895-21apt-get09:50:113
87009960,3cyclictest14747-21python08:25:213
87009960,3cyclictest0-21swapper/310:01:553
87009960,2cyclictest568-21nscd10:05:173
87009960,2cyclictest0-21swapper/311:44:263
87009960,1cyclictest0-21swapper/311:35:103
86959966,0cyclictest60950irq/123-eno109:05:122
86959965,1cyclictest60950irq/123-eno108:55:142
86959965,1cyclictest60950irq/123-eno107:30:102
86959964,1cyclictest28-21ksoftirqd/208:05:092
86959964,1cyclictest28-21ksoftirqd/207:20:192
86959963,2cyclictest11129-21basename08:20:132
86959960,5cyclictest0-21swapper/209:00:112
86919965,1cyclictest0-21swapper/112:39:591
86919965,1cyclictest0-21swapper/111:55:241
86919962,3cyclictest0-21swapper/112:22:391
86919960,6cyclictest0-21swapper/112:11:091
86919960,6cyclictest0-21swapper/111:25:031
86919960,6cyclictest0-21swapper/111:18:411
86919960,6cyclictest0-21swapper/111:05:581
86919960,6cyclictest0-21swapper/110:55:371
86919960,6cyclictest0-21swapper/109:35:531
86919960,6cyclictest0-21swapper/109:12:341
86919960,6cyclictest0-21swapper/108:34:331
86919960,6cyclictest0-21swapper/108:08:301
86919960,6cyclictest0-21swapper/108:00:051
86919960,6cyclictest0-21swapper/107:49:261
86919960,5cyclictest0-21swapper/111:44:081
86919960,5cyclictest0-21swapper/110:40:151
86919960,5cyclictest0-21swapper/110:00:101
86919960,4cyclictest0-21swapper/111:37:171
86919960,4cyclictest0-21swapper/111:30:171
86919960,4cyclictest0-21swapper/110:13:491
86919960,4cyclictest0-21swapper/107:10:171
86919960,3cyclictest0-21swapper/112:07:421
86919960,3cyclictest0-21swapper/110:36:421
86919960,1cyclictest0-21swapper/108:11:111
86919960,0cyclictest0-21swapper/110:20:491
86809965,1cyclictest793-21snmpd09:06:070
86809965,1cyclictest16582-21cat08:30:150
86809964,1cyclictest9-21ksoftirqd/007:45:000
86809964,1cyclictest793-21snmpd08:05:140
86809963,2cyclictest20420-21apt-get08:40:120
86809960,6cyclictest0-21swapper/012:05:130
86809960,6cyclictest0-21swapper/008:55:480
86809960,3cyclictest0-21swapper/012:10:460
86809960,1cyclictest254-21systemd-journal08:04:560
86809960,1cyclictest0-21swapper/007:12:010
87009954,1cyclictest35-21ksoftirqd/307:30:113
87009954,1cyclictest28612-21ntpq08:55:173
87009953,1cyclictest1128-21perl10:25:143
87009952,2cyclictest25128-21apt-get08:50:123
87009952,1cyclictest12633-21/usr/sbin/munin12:00:203
87009951,3cyclictest1909-21diskmemload12:10:253
87009950,5cyclictest0-21swapper/307:50:113
87009950,3cyclictest0-21swapper/308:05:133
87009950,2cyclictest0-21swapper/307:20:153
87009950,1cyclictest0-21swapper/311:01:343
87009950,0cyclictest0-21swapper/308:14:023
86919955,0cyclictest0-21swapper/109:21:471
86919955,0cyclictest0-21swapper/108:53:181
86919954,1cyclictest0-21swapper/107:15:141
86919951,3cyclictest0-21swapper/110:50:021
86919951,2cyclictest0-21swapper/110:45:101
86919951,1cyclictest0-21swapper/109:00:121
86919950,5cyclictest0-21swapper/112:25:211
86919950,5cyclictest0-21swapper/108:46:541
86919950,5cyclictest0-21swapper/107:36:291
86919950,5cyclictest0-21swapper/107:30:161
86919950,4cyclictest0-21swapper/111:21:261
86919950,4cyclictest0-21swapper/110:31:161
86919950,3cyclictest0-21swapper/111:10:461
86919950,3cyclictest0-21swapper/110:17:311
86919950,2cyclictest0-21swapper/109:19:591
86919950,2cyclictest0-21swapper/108:15:181
86919950,1cyclictest0-21swapper/112:01:411
86919950,1cyclictest0-21swapper/111:52:031
86919950,1cyclictest0-21swapper/110:06:511
86919950,0cyclictest0-21swapper/109:43:121
86919950,0cyclictest0-21swapper/107:21:021
86809954,1cyclictest19356-21telnet07:30:120
86809950,0cyclictest0-21swapper/007:40:100
87009943,1cyclictest25083-21ntp_states07:40:173
87009943,1cyclictest23845-21tail08:45:183
87009942,1cyclictest11149-21egrep08:20:133
87009941,1cyclictest30564-21fw_packets09:00:143
87009941,1cyclictest22429-21/usr/sbin/munin07:35:153
86919944,0cyclictest0-21swapper/108:41:421
86919944,0cyclictest0-21swapper/107:50:031
86919942,1cyclictest0-21swapper/110:25:151
86919941,2cyclictest0-21swapper/109:25:121
86919941,1cyclictest0-21swapper/108:56:031
86919940,3cyclictest0-21swapper/108:25:121
86919940,3cyclictest0-21swapper/107:40:111
86919940,2cyclictest0-21swapper/111:00:131
86919940,2cyclictest0-21swapper/109:58:521
86919930,1cyclictest0-21swapper/107:55:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional