You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-05-02 - 02:06
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack5slot2.osadl.org (updated Fri May 02, 2025 00:44:40)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
208232203187,11sleep10-21swapper/119:08:031
206962201185,11sleep30-21swapper/319:06:263
209432197182,11sleep20-21swapper/219:09:372
206932193176,12sleep00-21swapper/019:06:230
182472440,0sleep10-21swapper/121:59:371
27312430,0sleep00-21swapper/021:51:050
93072120,0sleep00-21swapper/023:33:250
108222100,1sleep3381rcuc/319:50:213
211489990,9cyclictest4137-21perf20:45:013
211489990,8cyclictest9296-21apt-get20:55:163
211489990,8cyclictest8337-21apt-get23:00:133
211489990,8cyclictest27769-21cut21:15:153
211489990,8cyclictest26664-21apt-get00:15:123
211489990,8cyclictest24234-21apt-get20:20:143
211489990,8cyclictest0-21swapper/321:25:163
211489990,5cyclictest14340-21apt-get20:00:143
211489982,5cyclictest25406-21cat19:15:173
211489980,7cyclictest9208-21sh21:38:403
211489980,7cyclictest5437-21apt-get23:15:143
211489980,7cyclictest4891-21munin-run23:15:013
211489980,7cyclictest32295-21apt-get23:45:153
211489980,7cyclictest31920-21apt-get19:30:123
211489980,7cyclictest29483-21apt-get00:00:123
211489980,7cyclictest26991-21apt-get19:20:133
211489980,7cyclictest23802-21apt-get22:35:123
211489980,7cyclictest23757-21apt-get00:30:123
211489980,7cyclictest23269-21cron22:35:003
211489980,7cyclictest19271-21apt-get20:10:153
211489980,7cyclictest18185-21apt-get23:05:133
211489980,7cyclictest16878-21apt00:10:133
211489980,7cyclictest16487-21diskmemload21:10:153
211489980,7cyclictest12755-21ssh23:51:033
211489980,7cyclictest11852-21apt-get19:55:143
211489980,7cyclictest11805-21dpkg21:40:013
211489980,7cyclictest0-21swapper/323:30:143
211489980,7cyclictest0-21swapper/320:50:143
211439981,6cyclictest0-21swapper/221:00:162
211349982,4cyclictest4944-21ssh00:04:070
211349982,4cyclictest31389-21sh21:33:280
211349982,4cyclictest29723-21smartctl23:10:210
211349982,4cyclictest15486-21ssh23:52:470
211349982,4cyclictest0-21swapper/000:11:450
211349982,3cyclictest5975-21ssh23:47:590
211349982,3cyclictest30984-21rm23:44:410
211349982,2cyclictest7266-21ssh00:21:030
211349982,2cyclictest3884-21chrt20:42:050
211349982,2cyclictest31015-21ssh00:16:500
211349982,2cyclictest25142-21ssh21:46:020
211349982,2cyclictest24539-21ssh23:57:100
211349982,2cyclictest1981-21ssh21:35:140
211349982,2cyclictest15801-21ssh00:09:470
211349982,2cyclictest14310-21ssh21:57:080
211489971,5cyclictest14251-21apt-get21:05:143
211489970,7cyclictest747-21memory21:50:193
211489970,7cyclictest16487-21diskmemload23:40:403
211489970,7cyclictest16487-21diskmemload22:10:113
211489970,7cyclictest11785-21apt-get21:00:163
211489970,7cyclictest0-21swapper/320:45:163
211489970,7cyclictest0-21swapper/319:45:173
211489970,6cyclictest8281-21ntp_states00:05:193
211489970,6cyclictest4691-21df_inode00:20:153
211489970,6cyclictest4649-21ssh21:20:183
211489970,6cyclictest4457-21apt-get19:40:203
211489970,6cyclictest29457-21taskset19:25:133
211489970,6cyclictest29365-21apt-get20:30:133
211489970,6cyclictest28036-21ntp_states22:20:193
211489970,6cyclictest26701-21apt-get20:25:143
211489970,6cyclictest24545-21apt-get21:30:173
211489970,6cyclictest24127-21users21:45:243
211489970,6cyclictest21987-21perl19:10:173
211489970,6cyclictest21034-21apt-get22:50:143
211489970,6cyclictest19612-21ssh23:55:113
211489970,6cyclictest17022-21cut20:05:163
211489970,6cyclictest16487-21diskmemload22:15:133
211489970,6cyclictest16487-21diskmemload22:00:133
211489970,6cyclictest15274-21apt-get23:20:143
211489970,6cyclictest14995-21if_eth400:25:153
211489970,6cyclictest12334-21apt-get23:35:133
211489970,6cyclictest1162-21ssh00:35:133
211489970,6cyclictest11137-21apt-get22:45:133
211489970,6cyclictest10188-21tune2fs21:55:163
211489970,6cyclictest0-21swapper/323:25:123
211489970,6cyclictest0-21swapper/320:35:123
211349975,2cyclictest26701-21apt-get20:25:140
211349974,3cyclictest0-21swapper/020:55:160
211349973,4cyclictest21045-21ssh22:50:140
211349973,3cyclictest5446-21irqstats19:40:240
211349973,1cyclictest22537-21ntp_states19:10:200
211349972,3cyclictest664-21ssh22:55:260
211349972,3cyclictest31828-21/usr/sbin/munin20:35:170
211349972,3cyclictest25676-21ssh23:25:140
211349972,3cyclictest22888-21ssh22:01:140
211349972,3cyclictest18323-21python20:05:230
211349972,3cyclictest1813-21df22:40:140
211349972,3cyclictest15931-21ssh21:41:290
211349972,3cyclictest14064-21cat21:05:020
211349972,2cyclictest8813-21ssh23:16:130
211349972,2cyclictest3761-21ssh22:25:010
211349972,2cyclictest29586-21sh22:20:570
211349972,2cyclictest29473-21ssh22:37:390
211349972,2cyclictest29229-21chrt22:05:090
211349972,2cyclictest26612-21ssh21:15:020
211349972,2cyclictest21857-21egrep20:15:150
211349972,2cyclictest17379-21ssh21:25:530
211349972,2cyclictest16888-21ssh00:25:560
211349972,2cyclictest16299-21ssh22:30:320
211349972,2cyclictest15500-21ssh22:46:490
211349972,1cyclictest9970-21ssh22:11:040
211349972,1cyclictest14335-21ssh23:35:220
211349972,1cyclictest10039-21python23:00:210
211349971,4cyclictest19333-21ssh21:10:320
211349971,3cyclictest7275-21ssh21:20:480
211349971,3cyclictest0-21swapper/022:16:370
211349971,3cyclictest0-21swapper/000:33:510
211349971,2cyclictest0-21swapper/000:35:590
211349970,6cyclictest0-21swapper/020:45:160
211489960,6cyclictest31769-21cut22:55:163
211489960,6cyclictest22983-21awk20:15:203
211489960,6cyclictest16487-21diskmemload22:05:023
211489960,6cyclictest0-21swapper/322:40:083
211489960,6cyclictest0-21swapper/322:25:153
211489960,5cyclictest0-21swapper/319:35:123
211349964,2cyclictest4206-21munin-plugin-st19:40:010
211349964,2cyclictest31920-21apt-get19:30:120
211349964,2cyclictest31697-21perf19:30:000
211349964,2cyclictest29348-21apt-get20:30:010
211349964,2cyclictest14251-21apt-get21:05:140
211349963,2cyclictest24125-21cut19:15:010
211349963,2cyclictest10652-21ntp_states19:50:190
211349962,3cyclictest29219-21latency_hist19:25:010
211349962,1cyclictest7756-21hddtemp_smartct19:45:200
211349962,1cyclictest20542-21ntp_states20:10:210
211349962,1cyclictest18720-21df23:05:150
211349962,1cyclictest16377-21rm23:20:180
211349961,4cyclictest0-21swapper/020:20:140
211349961,2cyclictest0-21swapper/020:53:230
211439954,1cyclictest0-21swapper/221:16:382
211439950,5cyclictest61-21kswapd000:10:022
211439950,5cyclictest0-21swapper/222:56:182
211439950,5cyclictest0-21swapper/221:20:152
211439950,4cyclictest31960-21apt-get23:45:022
211399951,3cyclictest0-21swapper/123:45:141
211399951,2cyclictest0-21swapper/120:30:131
211399950,5cyclictest0-21swapper/123:25:141
211399950,5cyclictest0-21swapper/123:12:091
211399950,5cyclictest0-21swapper/100:01:371
211349953,2cyclictest12571-21cut19:55:170
211349953,2cyclictest0-21swapper/020:00:150
211439944,0cyclictest0-21swapper/222:02:192
211439944,0cyclictest0-21swapper/200:21:512
211439943,1cyclictest26698-21/usr/sbin/munin20:25:142
211439943,1cyclictest12674-21cut19:55:182
211439942,2cyclictest21098-21ssh21:44:462
211439942,1cyclictest32055-21ssh22:05:472
211439941,3cyclictest57250irq/125-eth022:40:132
211439941,2cyclictest0-21swapper/220:05:152
211439940,4cyclictest509-21nscd23:35:462
211439940,4cyclictest0-21swapper/223:30:152
211439940,4cyclictest0-21swapper/223:19:162
211439940,4cyclictest0-21swapper/223:02:222
211439940,4cyclictest0-21swapper/222:30:142
211439940,4cyclictest0-21swapper/221:55:142
211439940,4cyclictest0-21swapper/221:35:162
211439940,4cyclictest0-21swapper/221:33:282
211439940,4cyclictest0-21swapper/221:26:522
211439940,4cyclictest0-21swapper/220:20:152
211439940,4cyclictest0-21swapper/219:15:132
211439940,4cyclictest0-21swapper/200:25:132
211439940,4cyclictest0-21swapper/200:15:122
211439940,3cyclictest6848-21latency_hist19:45:002
211439940,3cyclictest428-21rm00:34:542
211439940,3cyclictest29424-21sed19:25:012
211439940,3cyclictest27646-21sed23:10:002
211439940,3cyclictest2717-21ssh00:02:402
211439940,3cyclictest17412-21sh23:20:252
211439940,3cyclictest11806-21cut19:55:012
211439940,3cyclictest0-21swapper/222:50:142
211439940,2cyclictest0-21swapper/222:38:032
211439940,1cyclictest6764-21/usr/sbin/munin22:10:182
211439940,1cyclictest28036-21ntp_states22:20:192
211439940,1cyclictest26295-21memory23:25:172
211439940,1cyclictest23086-21hddtemp_smartct23:40:152
211439940,0cyclictest0-21swapper/223:53:552
211399944,0cyclictest0-21swapper/123:51:261
211399944,0cyclictest0-21swapper/122:40:341
211399944,0cyclictest0-21swapper/122:26:441
211399941,2cyclictest0-21swapper/123:40:111
211399941,2cyclictest0-21swapper/123:20:131
211399941,2cyclictest0-21swapper/123:05:141
211399941,2cyclictest0-21swapper/122:30:141
211399941,2cyclictest0-21swapper/122:20:121
211399941,2cyclictest0-21swapper/122:05:151
211399941,2cyclictest0-21swapper/121:40:151
211399941,2cyclictest0-21swapper/120:00:151
211399941,2cyclictest0-21swapper/119:45:161
211399941,2cyclictest0-21swapper/119:25:131
211399941,2cyclictest0-21swapper/100:10:011
211399941,1cyclictest0-21swapper/120:05:141
211399941,1cyclictest0-21swapper/119:55:151
211399941,1cyclictest0-21swapper/100:15:111
211399940,4cyclictest0-21swapper/120:35:071
211399940,4cyclictest0-21swapper/119:19:451
211399940,4cyclictest0-21swapper/100:31:531
211399940,2cyclictest0-21swapper/123:55:121
211399940,2cyclictest0-21swapper/119:20:121
211399940,2cyclictest0-21swapper/100:35:131
211399940,0cyclictest0-21swapper/122:14:321
10253240,0sleep10-21swapper/123:17:091
211439932,1cyclictest30997-21snmpd20:50:112
211439932,1cyclictest30997-21snmpd20:40:212
211439932,1cyclictest30997-21snmpd19:45:122
211439931,1cyclictest0-21swapper/220:15:152
211439930,3cyclictest7717-21sed00:05:152
211439930,3cyclictest434-21sed20:35:182
211439930,3cyclictest3802-21sh22:25:042
211439930,3cyclictest309-21perl21:50:152
211439930,3cyclictest16756-21sh21:10:042
211439930,3cyclictest16396-21ssh22:15:002
211439930,3cyclictest0-21swapper/223:55:012
211439930,3cyclictest0-21swapper/223:10:122
211439930,3cyclictest0-21swapper/221:45:092
211439930,3cyclictest0-21swapper/221:05:142
211439930,3cyclictest0-21swapper/220:55:152
211439930,3cyclictest0-21swapper/220:45:192
211439930,3cyclictest0-21swapper/220:30:002
211439930,3cyclictest0-21swapper/220:10:172
211439930,3cyclictest0-21swapper/220:00:132
211439930,3cyclictest0-21swapper/219:35:112
211439930,3cyclictest0-21swapper/219:30:132
211439930,3cyclictest0-21swapper/219:25:132
211439930,3cyclictest0-21swapper/219:10:132
211439930,3cyclictest0-21swapper/200:35:122
211439930,2cyclictest0-21swapper/222:45:022
211399933,0cyclictest0-21swapper/122:51:191
211399932,1cyclictest0-21swapper/120:40:171
211399931,1cyclictest0-21swapper/123:00:141
211399931,1cyclictest0-21swapper/122:55:121
211399931,1cyclictest0-21swapper/122:45:131
211399931,1cyclictest0-21swapper/121:45:151
211399931,1cyclictest0-21swapper/121:35:161
211399931,1cyclictest0-21swapper/120:55:161
211399931,1cyclictest0-21swapper/120:50:151
211399931,1cyclictest0-21swapper/120:25:141
211399931,1cyclictest0-21swapper/120:20:151
211399931,1cyclictest0-21swapper/119:35:111
211399930,2cyclictest1368-21chrt19:30:371
211399930,2cyclictest0-21swapper/122:15:131
211399930,2cyclictest0-21swapper/122:00:121
211399930,2cyclictest0-21swapper/121:30:161
211399930,2cyclictest0-21swapper/120:10:141
211399921,1cyclictest0-21swapper/121:50:141
211399921,1cyclictest0-21swapper/121:20:181
211399921,1cyclictest0-21swapper/121:15:131
211399921,1cyclictest0-21swapper/120:45:171
211399921,1cyclictest0-21swapper/119:40:201
211399921,1cyclictest0-21swapper/100:25:011
211399920,2cyclictest12073-21taskset23:35:021
211399920,2cyclictest0-21swapper/121:25:161
211399920,1cyclictest41292sleep100:20:141
211399920,1cyclictest21734-21chrt20:15:091
211399920,1cyclictest14242-21chrt21:05:091
211399920,1cyclictest0-21swapper/123:30:151
211399920,1cyclictest0-21swapper/122:35:131
211399920,1cyclictest0-21swapper/121:10:161
211399920,1cyclictest0-21swapper/121:00:151
211399920,1cyclictest0-21swapper/119:50:141
211399920,1cyclictest0-21swapper/119:10:131
211399920,1cyclictest0-21swapper/100:05:131
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional