You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-26 - 22:21
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6 (updated Tue Sep 26, 2023 12:45:05)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
60189913878,17cyclictest14-21ksoftirqd/007:25:230
60189913872,17cyclictest14-21ksoftirqd/011:05:210
60189913370,18cyclictest14-21ksoftirqd/010:50:200
60189912867,18cyclictest14-21ksoftirqd/008:00:210
6020991198,82cyclictest0-21swapper/109:40:201
60209911612,78cyclictest0-21swapper/107:20:211
6020991158,83cyclictest0-21swapper/108:15:221
60189911416,27cyclictest0-21swapper/011:15:190
60209911310,79cyclictest0-21swapper/112:25:211
6020991127,79cyclictest0-21swapper/107:55:241
6020991117,77cyclictest0-21swapper/108:25:171
60209911111,81cyclictest0-21swapper/109:30:191
6020991108,81cyclictest0-21swapper/107:35:181
6020991108,78cyclictest0-21swapper/112:00:221
6020991107,78cyclictest0-21swapper/107:10:211
6020991107,78cyclictest0-21swapper/107:10:211
60189911010,50cyclictest6725-21taskset08:40:180
6020991098,80cyclictest0-21swapper/108:45:251
6020991097,79cyclictest0-21swapper/111:25:221
6020991097,78cyclictest0-21swapper/107:25:211
6020991096,79cyclictest0-21swapper/110:25:201
60209910925,65cyclictest0-21swapper/107:15:211
60189910981,16cyclictest14-21ksoftirqd/010:55:170
6020991088,77cyclictest0-21swapper/112:05:171
60209910810,73cyclictest0-21swapper/110:10:201
60189910878,16cyclictest14-21ksoftirqd/011:40:190
60189910878,16cyclictest14-21ksoftirqd/011:40:190
60189910837,19cyclictest0-21swapper/007:40:190
6020991079,75cyclictest0-21swapper/111:20:241
6020991078,78cyclictest0-21swapper/109:05:221
6020991077,75cyclictest0-21swapper/111:30:231
60209910711,77cyclictest0-21swapper/110:05:221
6020991068,76cyclictest0-21swapper/110:20:211
6020991068,74cyclictest0-21swapper/109:00:191
6020991067,78cyclictest0-21swapper/109:25:201
6020991067,76cyclictest0-21swapper/108:10:201
6020991067,75cyclictest0-21swapper/109:15:221
60209910610,76cyclictest0-21swapper/112:10:211
60189910675,18cyclictest14-21ksoftirqd/009:50:220
6020991058,78cyclictest0-21swapper/110:40:141
6020991057,74cyclictest0-21swapper/108:35:201
60189910515,29cyclictest0-21swapper/011:35:170
60189910510,51cyclictest17017-21diskmemload09:10:240
6020991047,77cyclictest0-21swapper/107:40:221
6018991037,50cyclictest0-21swapper/010:45:210
60189910277,15cyclictest14-21ksoftirqd/009:45:200
60189910274,19cyclictest14-21ksoftirqd/010:35:180
60189910274,17cyclictest14-21ksoftirqd/009:20:190
60189910272,16cyclictest14-21ksoftirqd/011:25:200
60189910271,19cyclictest14-21ksoftirqd/010:05:230
60189910271,18cyclictest14-21ksoftirqd/011:10:160
60189910215,23cyclictest0-21swapper/008:20:200
6020991017,72cyclictest0-21swapper/108:50:191
60189910171,18cyclictest14-21ksoftirqd/011:00:210
6020991007,71cyclictest0-21swapper/107:30:231
60189910074,16cyclictest14-21ksoftirqd/008:45:220
60189910068,18cyclictest14-21ksoftirqd/007:20:190
602099996,71cyclictest0-21swapper/109:55:221
6018999971,19cyclictest14-21ksoftirqd/012:10:180
6018999971,19cyclictest14-21ksoftirqd/011:50:200
6018999970,18cyclictest14-21ksoftirqd/007:50:190
602099978,66cyclictest0-21swapper/111:45:191
602099977,69cyclictest0-21swapper/112:35:211
602099977,16cyclictest0-21swapper/110:15:201
6018999771,16cyclictest14-21ksoftirqd/010:15:180
6018999669,18cyclictest14-21ksoftirqd/010:10:220
602099957,18cyclictest0-21swapper/108:05:221
602099947,16cyclictest0-21swapper/111:35:201
6018999463,18cyclictest14-21ksoftirqd/010:00:230
602099937,18cyclictest0-21swapper/110:00:221
602099937,17cyclictest0-21swapper/111:40:221
602099937,17cyclictest0-21swapper/111:40:221
602099936,17cyclictest0-21swapper/109:35:201
602099927,17cyclictest0-21swapper/109:45:231
602099917,18cyclictest0-21swapper/111:55:201
602099917,18cyclictest0-21swapper/111:55:201
602099917,17cyclictest0-21swapper/108:20:231
6018999162,20cyclictest14-21ksoftirqd/009:15:210
602099907,18cyclictest0-21swapper/107:45:231
602099899,16cyclictest0-21swapper/111:10:171
602099898,16cyclictest0-21swapper/112:15:211
602099886,16cyclictest0-21swapper/112:30:231
6018998859,17cyclictest0-21swapper/008:30:250
602099845,11cyclictest0-21swapper/110:50:291
602099839,15cyclictest0-21swapper/110:45:221
50312837,58sleep05119-21/usr/sbin/munin07:05:370
602099827,17cyclictest0-21swapper/110:35:211
602099827,16cyclictest0-21swapper/109:20:211
602099826,15cyclictest0-21swapper/107:50:221
602099807,16cyclictest0-21swapper/111:15:201
602099806,17cyclictest0-21swapper/108:55:221
602099805,19cyclictest25846-21apt-get11:05:201
6020998023,52cyclictest7077-21cat08:40:291
6020998015,19cyclictest510-21snmpd11:00:301
438727940,23sleep10-21swapper/107:05:261
602099788,63cyclictest0-21swapper/110:30:221
6020997817,22cyclictest25073-21wc08:00:281
602099777,61cyclictest0-21swapper/112:20:181
6018997746,17cyclictest0-21swapper/008:50:190
602099766,62cyclictest0-21swapper/109:10:231
6018997643,21cyclictest14-21ksoftirqd/011:45:230
6018997643,21cyclictest14-21ksoftirqd/008:55:210
6018997638,28cyclictest14-21ksoftirqd/010:20:230
602099757,24cyclictest2871-21apt-get08:30:241
6018997545,18cyclictest13317-21apt-get10:30:210
6018997429,31cyclictest14-21ksoftirqd/009:59:010
602099726,22cyclictest9173-21apt-get11:50:201
6018997243,24cyclictest14-21ksoftirqd/011:55:230
6018997243,24cyclictest14-21ksoftirqd/011:55:230
6018997221,24cyclictest255-21systemd-journal07:33:270
6018997134,28cyclictest14-21ksoftirqd/012:15:190
6018997039,24cyclictest14-21ksoftirqd/012:35:380
6018997025,33cyclictest14-21ksoftirqd/007:45:210
6018996936,26cyclictest14-21ksoftirqd/012:30:250
6018996930,29cyclictest14-21ksoftirqd/012:05:210
6018996928,32cyclictest14-21ksoftirqd/012:20:190
602099686,20cyclictest22354-21apt-get10:55:191
602099684,19cyclictest32319-21python309:50:441
6018996828,31cyclictest14-21ksoftirqd/008:10:230
6018996725,33cyclictest14-21ksoftirqd/009:25:240
6018996721,37cyclictest14-21ksoftirqd/009:30:210
6018996536,9cyclictest14-21ksoftirqd/008:35:280
6018996531,29cyclictest14-21ksoftirqd/009:35:320
6018996512,11cyclictest14-21ksoftirqd/007:37:340
6018996232,24cyclictest510-21snmpd12:29:300
6018996222,33cyclictest0-21swapper/009:08:500
6018996217,19cyclictest30236-21aten2.4-expect08:15:270
6018996212,23cyclictest2262-21aten2.4-expect11:30:280
6018996144,10cyclictest14-21ksoftirqd/008:05:290
6018996142,11cyclictest14-21ksoftirqd/011:20:350
6018996132,21cyclictest14-21ksoftirqd/007:57:300
6018996131,22cyclictest255-21systemd-journal08:30:010
6018996120,34cyclictest28163-21aten2.4-expect09:40:270
6018996042,11cyclictest14-21ksoftirqd/012:00:370
6018996042,10cyclictest14-21ksoftirqd/009:00:360
6018996042,10cyclictest14-21ksoftirqd/007:10:240
6018996042,10cyclictest14-21ksoftirqd/007:10:240
6018996035,13cyclictest14-21ksoftirqd/010:30:010
6018995940,11cyclictest14-21ksoftirqd/007:15:290
6018995934,18cyclictest14-21ksoftirqd/010:40:350
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:263
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
none15:32:262
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional