You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-01 - 17:47
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Mar 01, 2024 12:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
263232207192,10sleep10-21swapper/107:07:431
263542186169,12sleep00-21swapper/007:08:070
262802186170,12sleep30-21swapper/307:07:103
263962179161,13sleep20-21swapper/207:08:412
82222440,0sleep10-21swapper/110:15:281
250572420,0sleep10-21swapper/109:47:531
185712420,0sleep018574-21cpuspeed_turbos11:20:200
262292390,0sleep00-21swapper/008:10:240
31972110,0sleep30-21swapper/312:09:153
222032100,0sleep20-21swapper/209:27:492
266749971,3cyclictest32265-21perf08:25:010
266879966,0cyclictest40-21ksoftirqd/311:30:293
266879965,1cyclictest40-21ksoftirqd/307:35:013
266879964,1cyclictest40-21ksoftirqd/311:55:233
266879964,1cyclictest40-21ksoftirqd/311:55:233
266879963,3cyclictest40-21ksoftirqd/309:18:323
266839965,1cyclictest12293-21irqstats09:40:292
266839960,6cyclictest0-21swapper/211:35:082
266749960,6cyclictest0-21swapper/010:33:410
266749960,3cyclictest29796-21perf08:20:000
3897250,0sleep10-21swapper/112:29:031
266879955,0cyclictest40-21ksoftirqd/311:05:273
266879955,0cyclictest40-21ksoftirqd/310:00:263
266879955,0cyclictest40-21ksoftirqd/309:10:213
266879955,0cyclictest40-21ksoftirqd/308:50:223
266879955,0cyclictest40-21ksoftirqd/308:35:283
266879955,0cyclictest40-21ksoftirqd/307:45:353
266879954,1cyclictest40-21ksoftirqd/310:10:313
266879954,1cyclictest40-21ksoftirqd/307:50:253
266879954,1cyclictest2926-21cat08:30:273
266879953,2cyclictest40-21ksoftirqd/312:10:283
266879953,2cyclictest40-21ksoftirqd/312:04:063
266879953,2cyclictest40-21ksoftirqd/310:48:463
266879953,2cyclictest40-21ksoftirqd/309:00:213
266879952,3cyclictest40-21ksoftirqd/311:16:463
266879952,3cyclictest40-21ksoftirqd/309:58:083
266879952,3cyclictest40-21ksoftirqd/309:25:223
266879950,5cyclictest0-21swapper/309:33:013
266879950,4cyclictest21173-21ntp_states08:00:273
266879950,4cyclictest17207-21ssh11:00:203
266879950,4cyclictest0-21swapper/307:55:173
266839950,5cyclictest23535-21ssh09:10:222
266839950,5cyclictest0-21swapper/210:53:312
266839950,5cyclictest0-21swapper/210:00:422
266839950,5cyclictest0-21swapper/209:51:232
266839950,5cyclictest0-21swapper/209:49:032
266839950,4cyclictest29231-21munin-node07:15:012
266839950,0cyclictest0-21swapper/209:34:222
266789950,5cyclictest0-21swapper/110:21:461
266789950,5cyclictest0-21swapper/109:41:011
266749955,0cyclictest0-21swapper/010:49:580
266749952,3cyclictest0-21swapper/011:34:010
266749952,3cyclictest0-21swapper/011:00:260
266749950,5cyclictest0-21swapper/012:18:170
266749950,4cyclictest32491-21apt-get08:25:210
266749950,4cyclictest2577-21irqstats11:10:250
266749950,4cyclictest24814-21munin-run08:10:010
266749950,4cyclictest22306-21diskmemload11:40:230
266749950,4cyclictest20544-21apt-get12:00:200
266749950,4cyclictest14709-21latency_hist07:50:010
266749950,4cyclictest0-21swapper/009:10:180
16955250,0sleep30-21swapper/310:40:233
266879944,0cyclictest40-21ksoftirqd/312:25:183
266879944,0cyclictest40-21ksoftirqd/311:50:093
266879944,0cyclictest40-21ksoftirqd/311:45:223
266879944,0cyclictest40-21ksoftirqd/311:40:363
266879944,0cyclictest40-21ksoftirqd/311:25:213
266879944,0cyclictest40-21ksoftirqd/311:10:223
266879944,0cyclictest40-21ksoftirqd/310:55:223
266879944,0cyclictest40-21ksoftirqd/310:15:203
266879944,0cyclictest40-21ksoftirqd/308:55:013
266879944,0cyclictest40-21ksoftirqd/308:50:003
266879944,0cyclictest40-21ksoftirqd/308:40:273
266879944,0cyclictest40-21ksoftirqd/308:25:233
266879944,0cyclictest40-21ksoftirqd/308:15:263
266879944,0cyclictest40-21ksoftirqd/308:10:193
266879944,0cyclictest40-21ksoftirqd/308:05:263
266879944,0cyclictest40-21ksoftirqd/307:40:243
266879944,0cyclictest40-21ksoftirqd/307:10:273
266879944,0cyclictest391ktimersoftd/312:35:213
266879944,0cyclictest391ktimersoftd/310:30:223
266879944,0cyclictest391ktimersoftd/310:25:303
266879944,0cyclictest391ktimersoftd/307:35:243
266879943,1cyclictest40-21ksoftirqd/310:35:223
266879942,2cyclictest40-21ksoftirqd/311:35:093
266879940,4cyclictest8867-21tune2fs09:20:203
266879940,4cyclictest391ktimersoftd/309:50:213
266879940,4cyclictest0-21swapper/312:15:133
266879940,4cyclictest0-21swapper/311:20:193
266879940,4cyclictest0-21swapper/309:45:233
266879940,4cyclictest0-21swapper/309:35:223
266879940,3cyclictest610-21df07:20:273
266879940,3cyclictest53692sleep312:30:013
266879940,3cyclictest32523-21ssh10:50:023
266879940,3cyclictest22537-21df_inode10:05:273
266879940,3cyclictest11201-21ssh09:40:233
266879940,0cyclictest0-21swapper/312:20:473
266879940,0cyclictest0-21swapper/310:21:123
266839944,0cyclictest0-21swapper/212:34:032
266839944,0cyclictest0-21swapper/212:06:422
266839944,0cyclictest0-21swapper/211:19:072
266839944,0cyclictest0-21swapper/211:07:122
266839944,0cyclictest0-21swapper/210:10:452
266839942,2cyclictest7174-21ssh09:55:432
266839942,1cyclictest9954-21/usr/sbin/munin08:45:232
266839942,1cyclictest759-21snmpd11:22:282
266839942,1cyclictest0-21swapper/209:00:182
266839941,3cyclictest759-21snmpd12:39:052
266839941,2cyclictest0-21swapper/210:35:202
266839941,2cyclictest0-21swapper/208:15:192
266839940,4cyclictest6501-21ssh11:51:012
266839940,4cyclictest5034-21/usr/sbin/munin07:30:252
266839940,4cyclictest30032-21apt-get07:15:182
266839940,4cyclictest0-21swapper/212:25:162
266839940,4cyclictest0-21swapper/211:45:182
266839940,4cyclictest0-21swapper/211:10:202
266839940,4cyclictest0-21swapper/210:45:182
266839940,4cyclictest0-21swapper/210:42:102
266839940,4cyclictest0-21swapper/210:31:302
266839940,4cyclictest0-21swapper/210:25:192
266839940,4cyclictest0-21swapper/210:20:212
266839940,4cyclictest0-21swapper/210:15:172
266839940,4cyclictest0-21swapper/209:20:172
266839940,4cyclictest0-21swapper/209:19:522
266839940,4cyclictest0-21swapper/208:55:002
266839940,4cyclictest0-21swapper/208:30:222
266839940,4cyclictest0-21swapper/208:05:242
266839940,3cyclictest7605-21ssh12:11:112
266839940,3cyclictest7412-21latency_hist08:40:012
266839940,3cyclictest20640-21cut12:00:192
266839940,3cyclictest10741-21date11:35:012
266839940,3cyclictest0-21swapper/207:40:202
266839940,1cyclictest32486-21/usr/sbin/munin08:25:292
266839940,1cyclictest19657-21munin-run08:00:012
266839940,1cyclictest19628-21grep11:40:222
266839940,1cyclictest18399-21memory11:00:252
266839940,1cyclictest12986-21/usr/sbin/munin12:15:212
266839940,0cyclictest0-21swapper/209:38:092
266789944,0cyclictest0-21swapper/112:15:241
266789944,0cyclictest0-21swapper/111:21:421
266789944,0cyclictest0-21swapper/111:09:471
266789944,0cyclictest0-21swapper/110:30:371
266789944,0cyclictest0-21swapper/109:21:581
266789941,2cyclictest0-21swapper/111:55:231
266789941,2cyclictest0-21swapper/111:55:231
266789941,1cyclictest0-21swapper/112:05:231
266789941,1cyclictest0-21swapper/108:40:191
266789940,4cyclictest0-21swapper/111:34:221
266789940,4cyclictest0-21swapper/111:16:371
266789940,4cyclictest0-21swapper/110:43:441
266789940,4cyclictest0-21swapper/109:28:481
266789940,2cyclictest0-21swapper/110:45:191
266789940,0cyclictest0-21swapper/112:34:191
266749944,0cyclictest0-21swapper/011:07:430
266749944,0cyclictest0-21swapper/010:58:510
266749944,0cyclictest0-21swapper/010:28:000
266749943,1cyclictest16043-21ssh10:40:200
266749942,1cyclictest7367-21ssh09:37:440
266749942,1cyclictest30774-21fw_packets07:15:220
266749942,1cyclictest25212-21latency_hist09:30:010
266749942,1cyclictest10817-21ssh12:13:450
266749941,1cyclictest0-21swapper/007:40:200
266749940,4cyclictest9816-21python09:20:260
266749940,4cyclictest1778-21ssh11:29:410
266749940,4cyclictest15379-21ssh11:18:140
266749940,4cyclictest0-21swapper/012:28:550
266749940,4cyclictest0-21swapper/011:54:420
266749940,4cyclictest0-21swapper/010:35:190
266749940,4cyclictest0-21swapper/010:10:210
266749940,4cyclictest0-21swapper/009:30:200
266749940,4cyclictest0-21swapper/009:00:180
266749940,4cyclictest0-21swapper/007:13:010
266749940,3cyclictest5357-21ssh12:30:000
266749940,3cyclictest26954-21ssh12:23:130
266749940,3cyclictest20567-21fschecks_count09:45:280
266749940,3cyclictest16849-21ssh09:43:170
266749940,3cyclictest14907-21perl12:35:240
266749940,3cyclictest13885-21rm10:19:450
266749940,3cyclictest13355-21ssh10:00:130
266749940,3cyclictest13206-21head08:50:310
266749940,3cyclictest11846-21ssh11:55:040
266749940,3cyclictest11846-21ssh11:55:030
266749940,3cyclictest0-21swapper/009:53:540
266749940,0cyclictest0-21swapper/008:00:090
266879933,0cyclictest40-21ksoftirqd/307:15:013
266879930,3cyclictest0-21swapper/309:05:213
266879930,3cyclictest0-21swapper/308:20:173
266879930,3cyclictest0-21swapper/307:25:233
266839931,1cyclictest759-21snmpd08:20:152
266839931,1cyclictest759-21snmpd08:10:032
266839931,1cyclictest14692-21cron07:50:012
266839930,3cyclictest8649-21sh10:55:122
266839930,3cyclictest26407-21cat11:25:012
266839930,3cyclictest0-21swapper/210:05:252
266839930,3cyclictest0-21swapper/209:05:072
266839930,3cyclictest0-21swapper/208:50:202
266839930,3cyclictest0-21swapper/208:40:192
266839930,3cyclictest0-21swapper/208:00:092
266839930,3cyclictest0-21swapper/207:45:052
266839930,3cyclictest0-21swapper/207:35:042
266839930,3cyclictest0-21swapper/207:20:212
266839930,2cyclictest0-21swapper/212:20:162
266839930,1cyclictest3902-21cut07:25:412
266839930,1cyclictest12038-21ssh11:55:132
266839930,1cyclictest12038-21ssh11:55:132
266789933,0cyclictest0-21swapper/111:02:221
266789933,0cyclictest0-21swapper/109:17:271
266789931,1cyclictest0-21swapper/112:35:201
266789931,1cyclictest0-21swapper/112:10:181
266789931,1cyclictest0-21swapper/111:50:181
266789931,1cyclictest0-21swapper/111:45:181
266789931,1cyclictest0-21swapper/111:35:221
266789931,1cyclictest0-21swapper/110:50:181
266789931,1cyclictest0-21swapper/110:35:201
266789931,1cyclictest0-21swapper/110:10:211
266789931,1cyclictest0-21swapper/110:05:251
266789931,1cyclictest0-21swapper/110:00:201
266789931,1cyclictest0-21swapper/109:55:241
266789931,1cyclictest0-21swapper/109:35:221
266789931,1cyclictest0-21swapper/109:10:191
266789931,1cyclictest0-21swapper/108:35:191
266789931,1cyclictest0-21swapper/108:30:231
266789931,1cyclictest0-21swapper/108:25:211
266789931,1cyclictest0-21swapper/108:15:191
266789931,1cyclictest0-21swapper/108:10:161
266789931,1cyclictest0-21swapper/108:00:191
266789931,1cyclictest0-21swapper/107:55:181
266789931,1cyclictest0-21swapper/107:45:191
266789931,1cyclictest0-21swapper/107:10:191
266789930,2cyclictest9635-21chrt10:55:221
266789930,2cyclictest17583-21chrt09:00:071
266789930,2cyclictest0-21swapper/111:25:021
266789930,2cyclictest0-21swapper/109:50:211
266789930,2cyclictest0-21swapper/107:35:211
266789930,2cyclictest0-21swapper/107:15:181
266789930,1cyclictest0-21swapper/107:25:241
266749932,1cyclictest759-21snmpd07:57:120
266749932,1cyclictest31490-21ssh09:15:070
266749932,1cyclictest220-21systemd-journal12:05:010
266749932,1cyclictest21533-21ssh10:05:030
266749931,1cyclictest7490-21apt-get08:40:190
266749930,3cyclictest4978-21wget09:55:250
266749930,3cyclictest449-21cstates07:20:250
266749930,3cyclictest27878-21grep11:45:180
266749930,3cyclictest0-21swapper/011:35:110
266749930,3cyclictest0-21swapper/010:50:020
266749930,3cyclictest0-21swapper/010:20:210
266749930,3cyclictest0-21swapper/009:05:210
266749930,3cyclictest0-21swapper/008:55:010
266749930,3cyclictest0-21swapper/008:45:000
266749930,3cyclictest0-21swapper/008:35:200
266749930,3cyclictest0-21swapper/008:30:230
266749930,3cyclictest0-21swapper/007:50:170
266749930,3cyclictest0-21swapper/007:35:210
266749930,3cyclictest0-21swapper/007:30:170
266749930,3cyclictest0-21swapper/007:25:240
266789921,1cyclictest325152chrt07:20:131
266789920,1cyclictest25383-21taskset10:25:371
266789920,1cyclictest21349-21chrt12:20:141
266789920,1cyclictest19513-21chrt11:40:191
266789920,1cyclictest0-21swapper/112:00:201
266789920,1cyclictest0-21swapper/111:10:201
266789920,1cyclictest0-21swapper/109:30:191
266789920,1cyclictest0-21swapper/109:05:201
266789920,1cyclictest0-21swapper/108:55:011
266789920,1cyclictest0-21swapper/108:50:201
266789920,1cyclictest0-21swapper/108:45:171
266789920,1cyclictest0-21swapper/108:20:181
266789920,1cyclictest0-21swapper/108:05:021
266789920,1cyclictest0-21swapper/107:50:191
266789920,1cyclictest0-21swapper/107:40:201
266789920,1cyclictest0-21swapper/107:30:171
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional