You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 07:01
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack5slot2.osadl.org (updated Fri Apr 26, 2024 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47872204189,11sleep10-21swapper/119:08:191
46412196180,11sleep30-21swapper/319:06:303
47912188170,13sleep00-21swapper/019:08:230
48852181164,12sleep20-21swapper/219:09:372
35202480,0sleep20-21swapper/222:28:342
120992460,0sleep10-21swapper/122:33:451
304892450,0sleep20-21swapper/223:43:072
237842450,0sleep00-21swapper/022:20:300
126712450,0sleep00-21swapper/023:51:340
120392420,0sleep10-21swapper/123:51:041
245422410,0sleep224544-21cpuspeed_turbos23:20:142
51049961,3cyclictest0-21swapper/100:00:091
51029960,3cyclictest26103-21munin-run21:25:020
51109955,0cyclictest19425-21kworker/3:123:06:583
51109955,0cyclictest19425-21kworker/3:122:55:463
51109955,0cyclictest19425-21kworker/3:121:37:253
51109955,0cyclictest19425-21kworker/3:120:30:143
51109955,0cyclictest19425-21kworker/3:119:45:283
51109955,0cyclictest19425-21kworker/3:100:36:343
51109954,1cyclictest17352-21grep00:35:013
51109950,5cyclictest0-21swapper/323:34:393
51109950,5cyclictest0-21swapper/323:11:323
51109950,5cyclictest0-21swapper/321:14:413
51109950,4cyclictest7920-21ntp_states19:15:013
51109950,4cyclictest21200-21apt-get20:45:113
51109950,4cyclictest10627-21memory00:10:173
51109950,4cyclictest0-21swapper/323:00:113
51069954,1cyclictest29287-21hddtemp_smartct19:55:162
51069950,5cyclictest0-21swapper/220:00:112
51049952,2cyclictest0-21swapper/119:40:101
51049951,3cyclictest0-21swapper/122:45:121
51049951,2cyclictest0-21swapper/119:55:111
51049951,2cyclictest0-21swapper/119:35:101
51029955,0cyclictest0-21swapper/022:14:390
51029951,3cyclictest0-21swapper/000:25:510
51029951,2cyclictest0-21swapper/000:35:120
51029950,5cyclictest0-21swapper/023:10:050
51029950,5cyclictest0-21swapper/000:13:220
51029950,4cyclictest28448-21apt-get19:55:100
51029950,4cyclictest15769-21perl22:55:190
51029950,4cyclictest0-21swapper/023:40:100
51029950,4cyclictest0-21swapper/023:15:100
16725250,0sleep10-21swapper/123:35:111
12323250,0sleep10-21swapper/100:11:051
8241240,0sleep20-21swapper/223:49:382
6217240,0sleep20-21swapper/221:12:372
51109944,0cyclictest19425-21kworker/3:121:59:503
51109944,0cyclictest19425-21kworker/3:121:26:133
51109944,0cyclictest19425-21kworker/3:120:41:263
51109944,0cyclictest19425-21kworker/3:119:56:393
51109944,0cyclictest19425-21kworker/3:119:23:043
51109944,0cyclictest19425-21kworker/3:119:11:543
51109944,0cyclictest19425-21kworker/3:100:25:203
51109941,2cyclictest0-21swapper/321:50:123
51109941,1cyclictest0-21swapper/322:10:083
51109941,0cyclictest0-21swapper/319:30:093
51109940,4cyclictest910-21diskmemload00:15:323
51109940,4cyclictest16540-21perl23:15:133
51109940,4cyclictest13784-21df22:15:143
51109940,4cyclictest0-21swapper/323:50:483
51109940,4cyclictest0-21swapper/323:44:033
51109940,4cyclictest0-21swapper/322:45:133
51109940,4cyclictest0-21swapper/322:05:123
51109940,4cyclictest0-21swapper/322:00:023
51109940,4cyclictest0-21swapper/321:45:133
51109940,4cyclictest0-21swapper/321:45:123
51109940,4cyclictest0-21swapper/321:15:123
51109940,4cyclictest0-21swapper/320:35:103
51109940,4cyclictest0-21swapper/320:05:013
51109940,4cyclictest0-21swapper/319:50:093
51109940,4cyclictest0-21swapper/300:20:083
51109940,3cyclictest955-21cat20:05:003
51109940,3cyclictest7284-21if_eth120:15:163
51109940,3cyclictest6473-21ssh23:48:123
51109940,3cyclictest32625-21/usr/sbin/munin23:25:133
51109940,3cyclictest31095-21/usr/sbin/munin21:05:113
51109940,3cyclictest29918-21basename22:25:103
51109940,3cyclictest28631-21apt-get21:00:113
51109940,3cyclictest25109-21hddtemp_smartct23:20:163
51109940,3cyclictest24802-21latency_hist23:40:013
51109940,3cyclictest21393-21taskset22:20:033
51109940,3cyclictest20835-21apt19:40:113
51109940,3cyclictest14059-21/usr/sbin/munin22:35:113
51109940,3cyclictest1323-21ssh00:05:113
51109940,3cyclictest11295-21apt-get20:25:103
51109940,3cyclictest10265-21ssh21:34:533
51109940,3cyclictest0-21swapper/320:50:103
51109940,3cyclictest0-21swapper/320:10:013
51109940,3cyclictest0-21swapper/319:35:093
51109940,1cyclictest23536-21irqstats22:40:173
51109940,1cyclictest19425-21kworker/3:123:55:503
51069944,0cyclictest0-21swapper/222:42:092
51069944,0cyclictest0-21swapper/219:20:212
51069942,1cyclictest57250irq/125-eth022:05:132
51069942,1cyclictest3602-21snmpd21:56:412
51069941,3cyclictest18375-21sh22:56:302
51069941,1cyclictest0-21swapper/200:15:092
51069940,4cyclictest61-21kswapd023:25:012
51069940,4cyclictest31582-21perl22:45:162
51069940,4cyclictest23277-21apt-get23:00:112
51069940,4cyclictest18728-21ntp_states23:55:192
51069940,4cyclictest1164-21ssh21:29:192
51069940,4cyclictest0-21swapper/223:50:102
51069940,4cyclictest0-21swapper/223:32:332
51069940,4cyclictest0-21swapper/223:08:462
51069940,4cyclictest0-21swapper/222:51:232
51069940,4cyclictest0-21swapper/222:35:082
51069940,4cyclictest0-21swapper/222:23:472
51069940,4cyclictest0-21swapper/222:03:012
51069940,4cyclictest0-21swapper/221:43:332
51069940,4cyclictest0-21swapper/221:35:392
51069940,4cyclictest0-21swapper/220:45:122
51069940,4cyclictest0-21swapper/200:30:122
51069940,4cyclictest0-21swapper/200:00:132
51069940,3cyclictest6229-21sh00:27:382
51069940,3cyclictest2917-21ps00:05:222
51069940,3cyclictest21139-21sed20:45:012
51069940,3cyclictest18695-21hddtemp_smartct00:35:162
51069940,3cyclictest17313-21diskstats23:35:122
51069940,3cyclictest13765-21/usr/sbin/munin20:30:202
51069940,0cyclictest0-21swapper/221:46:342
51069940,0cyclictest0-21swapper/221:46:342
51049944,0cyclictest0-21swapper/123:25:551
51049944,0cyclictest0-21swapper/122:08:481
51049944,0cyclictest0-21swapper/121:52:551
51049944,0cyclictest0-21swapper/121:44:211
51049944,0cyclictest0-21swapper/120:05:321
51049944,0cyclictest0-21swapper/100:36:281
51049941,2cyclictest0-21swapper/123:30:111
51049941,2cyclictest0-21swapper/123:20:121
51049941,2cyclictest0-21swapper/123:10:101
51049941,2cyclictest0-21swapper/121:30:101
51049941,2cyclictest0-21swapper/121:15:131
51049941,2cyclictest0-21swapper/120:50:111
51049941,2cyclictest0-21swapper/120:35:091
51049941,2cyclictest0-21swapper/120:20:111
51049941,2cyclictest0-21swapper/120:00:121
51049941,2cyclictest0-21swapper/119:25:121
51049941,2cyclictest0-21swapper/100:15:081
51049941,2cyclictest0-21swapper/100:05:101
51049941,1cyclictest0-21swapper/119:10:121
51049940,4cyclictest0-21swapper/122:13:361
51049940,4cyclictest0-21swapper/121:06:131
51049940,3cyclictest0-21swapper/121:25:111
51049940,3cyclictest0-21swapper/120:15:091
51049940,2cyclictest0-21swapper/123:55:231
51049940,2cyclictest0-21swapper/122:25:101
51049940,2cyclictest0-21swapper/121:55:101
51049940,0cyclictest0-21swapper/100:34:521
51029944,0cyclictest0-21swapper/022:29:460
51029944,0cyclictest0-21swapper/021:56:180
51029944,0cyclictest0-21swapper/000:34:110
51029943,1cyclictest11333-21ssh21:35:150
51029942,2cyclictest12752-21ssh22:53:370
51029942,1cyclictest4364-21latency_hist22:10:010
51029942,1cyclictest3602-21snmpd23:20:550
51029941,3cyclictest3602-21snmpd21:42:160
51029941,1cyclictest0-21swapper/023:00:110
51029940,4cyclictest149512sleep019:25:230
51029940,4cyclictest0-21swapper/023:48:020
51029940,4cyclictest0-21swapper/021:30:100
51029940,4cyclictest0-21swapper/021:15:120
51029940,4cyclictest0-21swapper/020:05:130
51029940,4cyclictest0-21swapper/019:40:210
51029940,4cyclictest0-21swapper/000:22:110
51029940,4cyclictest0-21swapper/000:00:560
51029940,3cyclictest28534-21/usr/sbin/munin21:45:170
51029940,3cyclictest28534-21/usr/sbin/munin21:45:160
51029940,3cyclictest26566-21ssh22:42:030
51029940,3cyclictest21317-21ssh22:39:280
51029940,3cyclictest0-21swapper/023:55:110
51029940,3cyclictest0-21swapper/019:30:090
51029940,1cyclictest21158-21perf22:20:010
51029940,1cyclictest2056-21latency_hist21:30:020
51029940,1cyclictest16010-21munin-run20:35:010
51029940,0cyclictest0-21swapper/021:54:000
19230240,0sleep30-21swapper/321:40:113
13927240,0sleep3511099cyclictest22:54:333
51109933,0cyclictest0-21swapper/321:20:043
51109931,1cyclictest0-21swapper/320:55:113
51109930,3cyclictest13407-21apt-get19:25:113
51109930,3cyclictest0-21swapper/322:30:013
51109930,3cyclictest0-21swapper/320:20:103
51109930,3cyclictest0-21swapper/300:00:063
51069932,1cyclictest28627-21/usr/sbin/munin21:00:202
51069932,1cyclictest25618-21ssh00:20:052
51069931,1cyclictest3602-21snmpd21:15:132
51069931,1cyclictest20837-21apt-get19:40:102
51069931,1cyclictest0-21swapper/220:25:102
51069930,3cyclictest5206-21apt19:10:122
51069930,3cyclictest4580-21irqstats21:50:162
51069930,3cyclictest3711-21apt-config20:10:002
51069930,3cyclictest26658-21df20:55:132
51069930,3cyclictest23308-21apt-get19:45:122
51069930,3cyclictest18877-21diskstats19:35:122
51069930,3cyclictest18110-21apt-get21:20:092
51069930,3cyclictest16766-21diskstats20:35:122
51069930,3cyclictest16464-21/usr/sbin/munin19:30:142
51069930,3cyclictest1040-21dpkg20:05:002
51069930,3cyclictest0-21swapper/223:15:042
51069930,3cyclictest0-21swapper/223:10:002
51069930,3cyclictest0-21swapper/222:30:132
51069930,3cyclictest0-21swapper/222:15:062
51069930,3cyclictest0-21swapper/222:10:072
51069930,3cyclictest0-21swapper/221:30:112
51069930,3cyclictest0-21swapper/221:05:102
51069930,3cyclictest0-21swapper/220:20:112
51069930,3cyclictest0-21swapper/220:15:102
51069930,3cyclictest0-21swapper/219:50:102
51069930,3cyclictest0-21swapper/219:25:132
51069930,3cyclictest0-21swapper/219:15:002
51069930,3cyclictest0-21swapper/200:10:102
51069930,1cyclictest23934-21ls20:50:132
51049933,0cyclictest0-21swapper/122:52:521
51049933,0cyclictest0-21swapper/121:02:161
51049933,0cyclictest0-21swapper/119:52:001
51049932,1cyclictest0-21swapper/122:55:141
51049931,2cyclictest0-21swapper/123:40:091
51049931,2cyclictest0-21swapper/122:00:091
51049931,2cyclictest0-21swapper/119:20:111
51049931,1cyclictest0-21swapper/123:15:091
51049931,1cyclictest0-21swapper/123:05:111
51049931,1cyclictest0-21swapper/122:40:101
51049931,1cyclictest0-21swapper/122:20:111
51049931,1cyclictest0-21swapper/122:15:111
51049931,1cyclictest0-21swapper/121:45:131
51049931,1cyclictest0-21swapper/121:45:131
51049931,1cyclictest0-21swapper/121:20:101
51049931,1cyclictest0-21swapper/120:55:121
51049931,1cyclictest0-21swapper/120:45:111
51049931,1cyclictest0-21swapper/120:30:121
51049931,1cyclictest0-21swapper/120:10:091
51049931,1cyclictest0-21swapper/119:45:111
51049931,1cyclictest0-21swapper/100:25:121
51049930,2cyclictest10867-21chrt21:35:121
51049930,2cyclictest0-21swapper/123:45:091
51049930,2cyclictest0-21swapper/119:30:101
51029932,1cyclictest6086-21cron20:15:000
51029932,1cyclictest3602-21snmpd19:12:270
51029932,1cyclictest10064-21ntpq20:20:180
51029931,1cyclictest3602-21snmpd23:05:050
51029931,1cyclictest0-21swapper/022:45:130
51029931,0cyclictest0-21swapper/022:00:090
51029930,3cyclictest0-21swapper/023:35:110
51029930,3cyclictest0-21swapper/023:30:020
51029930,3cyclictest0-21swapper/023:25:000
51029930,3cyclictest0-21swapper/022:30:010
51029930,3cyclictest0-21swapper/021:05:060
51029930,3cyclictest0-21swapper/021:00:370
51029930,3cyclictest0-21swapper/020:55:120
51029930,3cyclictest0-21swapper/020:50:100
51029930,3cyclictest0-21swapper/020:45:010
51029930,3cyclictest0-21swapper/020:40:000
51029930,3cyclictest0-21swapper/020:35:100
51029930,3cyclictest0-21swapper/020:25:100
51029930,3cyclictest0-21swapper/020:10:100
51029930,3cyclictest0-21swapper/020:00:120
51029930,3cyclictest0-21swapper/019:50:130
51029930,3cyclictest0-21swapper/019:45:110
51029930,3cyclictest0-21swapper/019:35:100
51029930,3cyclictest0-21swapper/019:20:110
51029930,3cyclictest0-21swapper/019:15:060
51029930,3cyclictest0-21swapper/000:15:080
51029930,3cyclictest0-21swapper/000:05:110
51029930,2cyclictest0-21swapper/021:10:070
12357230,0sleep10-21swapper/120:25:181
51049922,0cyclictest0-21swapper/123:00:101
51049921,1cyclictest0-21swapper/122:35:091
51049921,1cyclictest0-21swapper/120:40:081
51049921,1cyclictest0-21swapper/119:15:101
51049921,1cyclictest0-21swapper/100:20:091
51049920,1cyclictest0-21swapper/121:10:101
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional