You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-25 - 16:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack3slot6s.osadl.org (updated Thu Apr 25, 2024 12:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1308211187,19sleep00-21swapper/007:05:510
1573211099,6sleep10-21swapper/107:09:171
1366210895,6sleep30-21swapper/307:06:383
1554210695,6sleep20-21swapper/207:09:022
84772760,0sleep30-21swapper/310:44:043
67372300,0sleep00-21swapper/008:40:130
165999253,20cyclictest0-21swapper/211:58:042
165999252,18cyclictest0-21swapper/209:11:032
165999230,21cyclictest0-21swapper/208:50:132
165999220,17cyclictest0-21swapper/210:33:032
1658992219,2cyclictest18628-21kworker/u8:012:12:051
165999210,4cyclictest0-21swapper/211:50:042
1658992118,2cyclictest16465-21kworker/u8:011:01:041
1658992118,2cyclictest14302-21kworker/u8:112:39:051
35362200,1sleep3381ktimersoftd/309:29:093
311552200,1sleep031153-21ssh10:33:320
251712200,2sleep337-21rcuc/309:16:383
1659992017,2cyclictest25850-21kworker/u8:107:20:032
1659992017,2cyclictest2049-21kworker/u8:111:12:042
1659992017,2cyclictest18623-21kworker/u8:111:44:032
165999200,2cyclictest0-21swapper/210:25:102
165899203,2cyclictest0-21swapper/111:50:051
1658992017,2cyclictest7573-21kworker/u8:109:39:031
1658992017,2cyclictest30751-21kworker/u8:010:37:041
1658992017,2cyclictest27592-21kworker/u8:009:55:021
1658992017,2cyclictest18628-21kworker/u8:012:19:051
1658992017,2cyclictest12220-21kworker/u8:011:28:041
110542200,1sleep1221ktimersoftd/110:45:431
1660991916,2cyclictest7573-21kworker/u8:110:07:023
1659991916,2cyclictest6225-21kworker/u8:008:45:042
1659991916,2cyclictest4485-21kworker/u8:310:42:042
1659991916,2cyclictest29849-21kworker/u8:212:16:032
1659991916,2cyclictest23413-21kworker/u8:112:14:042
1659991916,2cyclictest17479-21kworker/u8:110:24:042
165999190,2cyclictest0-21swapper/209:59:042
165999190,17cyclictest0-21swapper/209:30:042
1658991916,2cyclictest7604-21kworker/u8:007:39:041
1658991916,2cyclictest7261-21kworker/u8:211:46:041
1658991916,2cyclictest4485-21kworker/u8:310:40:041
1658991916,2cyclictest27592-21kworker/u8:010:01:041
1658991916,2cyclictest22375-21kworker/u8:209:18:041
1658991916,2cyclictest1688-21kworker/u8:209:31:031
1658991916,2cyclictest16465-21kworker/u8:010:53:041
1658991916,2cyclictest16297-21kworker/u8:009:13:041
1658991916,2cyclictest10819-21kworker/u8:010:11:031
1660991815,2cyclictest18040-21kworker/u8:007:55:023
1660991815,2cyclictest13426-21kworker/u8:209:45:043
166099180,2cyclictest4614-21sh11:50:043
1659991815,2cyclictest7573-21kworker/u8:110:10:042
1659991815,2cyclictest7573-21kworker/u8:110:05:042
1659991815,2cyclictest6225-21kworker/u8:008:44:032
1659991815,2cyclictest25850-21kworker/u8:107:17:042
1659991815,2cyclictest22375-21kworker/u8:208:56:042
1659991815,2cyclictest18040-21kworker/u8:007:59:042
1659991815,2cyclictest12220-21kworker/u8:011:30:042
165999180,13cyclictest0-21swapper/212:03:052
1658991815,2cyclictest22375-21kworker/u8:208:29:031
1658991815,2cyclictest22375-21kworker/u8:208:29:031
1658991815,2cyclictest18040-21kworker/u8:008:09:041
1658991815,2cyclictest18040-21kworker/u8:007:58:041
1658991815,2cyclictest12316-21kworker/u8:207:48:031
165899180,16cyclictest0-21swapper/109:45:041
165799180,13cyclictest0-21swapper/009:19:050
1660991714,2cyclictest9392-21kworker/u8:110:47:033
1660991714,2cyclictest18628-21kworker/u8:012:18:043
1660991714,2cyclictest13127-21kworker/u8:111:59:053
1660991714,2cyclictest12220-21kworker/u8:011:24:053
1659991714,2cyclictest9392-21kworker/u8:110:49:042
1659991714,2cyclictest7604-21kworker/u8:007:28:042
1659991714,2cyclictest3636-21kworker/u8:110:39:042
1659991714,2cyclictest3228-21kworker/u8:112:25:052
1659991714,2cyclictest30525-21kworker/u8:008:23:022
1659991714,2cyclictest27901-21kworker/u8:211:08:042
1659991714,2cyclictest27901-21kworker/u8:211:08:042
1659991714,2cyclictest26472-21kworker/u8:108:19:032
1659991714,2cyclictest18040-21kworker/u8:008:01:042
1659991714,2cyclictest15819-21kworker/u8:107:54:042
1659991714,2cyclictest13426-21kworker/u8:209:54:042
1659991713,2cyclictest13426-21kworker/u8:209:46:042
165999170,2cyclictest0-21swapper/211:15:042
165999170,2cyclictest0-21swapper/210:04:042
1658991714,2cyclictest8795-21kworker/u8:212:32:041
1658991714,2cyclictest7261-21kworker/u8:212:09:041
1658991714,2cyclictest29136-21kworker/u8:109:23:031
1658991714,2cyclictest27901-21kworker/u8:211:07:051
1658991714,2cyclictest27901-21kworker/u8:211:07:051
1658991714,2cyclictest26472-21kworker/u8:108:13:021
1658991714,2cyclictest22375-21kworker/u8:208:59:031
1658991714,2cyclictest22375-21kworker/u8:208:51:041
1658991714,2cyclictest22375-21kworker/u8:208:34:041
1658991714,2cyclictest18040-21kworker/u8:007:50:041
1658991714,2cyclictest1409-21kworker/u8:007:13:041
165899170,2cyclictest0-21swapper/110:07:031
1660991613,2cyclictest16465-21kworker/u8:010:59:053
1659991613,2cyclictest22375-21kworker/u8:208:31:042
1659991613,2cyclictest2007-21kworker/u8:108:38:042
1659991613,2cyclictest16465-21kworker/u8:010:52:052
165999160,9cyclictest0-21swapper/212:05:052
165999160,2cyclictest0-21swapper/211:36:042
165999160,2cyclictest0-21swapper/211:04:042
165999160,2cyclictest0-21swapper/209:21:042
165999160,14cyclictest0-21swapper/212:25:002
1658991613,2cyclictest6225-21kworker/u8:008:41:031
1658991613,2cyclictest3540-21kworker/u8:210:16:041
1658991613,2cyclictest3228-21kworker/u8:112:24:041
1658991613,2cyclictest22375-21kworker/u8:209:09:031
1658991613,2cyclictest18040-21kworker/u8:008:00:041
1658991613,2cyclictest17479-21kworker/u8:110:21:031
1658991613,2cyclictest16465-21kworker/u8:010:55:031
165799160,6cyclictest5883-21gdm-simple-gree10:42:590
165799160,15cyclictest0-21swapper/009:58:440
1660991513,1cyclictest0-21swapper/312:12:053
1660991512,2cyclictest7573-21kworker/u8:109:42:033
1660991512,2cyclictest7261-21kworker/u8:212:06:043
1660991512,2cyclictest7261-21kworker/u8:211:37:053
1660991512,2cyclictest22375-21kworker/u8:208:52:033
1660991512,2cyclictest0-21swapper/311:00:513
166099151,12cyclictest28778-21ntp_states11:05:233
166099151,12cyclictest28778-21ntp_states11:05:223
166099151,12cyclictest27526-21apt-get09:20:103
166099151,12cyclictest14092-40update-apt-xapi07:40:073
166099150,2cyclictest0-21swapper/309:30:213
166099150,13cyclictest0-21swapper/312:35:013
1659991512,2cyclictest3540-21kworker/u8:210:18:042
1659991512,2cyclictest22375-21kworker/u8:209:06:042
1659991512,2cyclictest18040-21kworker/u8:007:49:042
1659991512,2cyclictest16465-21kworker/u8:010:56:032
165999151,12cyclictest17785-21taskset12:38:562
165999150,2cyclictest0-21swapper/211:24:052
165999150,12cyclictest0-21swapper/209:17:032
1658991512,2cyclictest9653-21kworker/u8:108:47:041
1658991512,2cyclictest30525-21kworker/u8:008:21:031
1658991512,2cyclictest25850-21kworker/u8:107:21:031
1658991512,2cyclictest23158-21kworker/u8:210:27:031
1658991512,2cyclictest22375-21kworker/u8:209:02:041
1658991512,2cyclictest2007-21kworker/u8:108:35:031
1658991512,2cyclictest12316-21kworker/u8:207:41:041
165899150,2cyclictest0-21swapper/111:36:041
165899150,2cyclictest0-21swapper/111:24:051
165899150,2cyclictest0-21swapper/111:15:041
165799151,12cyclictest31486-21ssh11:43:550
1657991510,3cyclictest0-21swapper/010:00:130
165799150,13cyclictest0-21swapper/011:39:440
1660991411,2cyclictest7573-21kworker/u8:109:38:043
1660991411,2cyclictest30525-21kworker/u8:008:22:043
1660991411,2cyclictest23158-21kworker/u8:210:30:043
1660991411,2cyclictest22375-21kworker/u8:209:04:043
1660991411,2cyclictest22375-21kworker/u8:208:32:043
1660991411,2cyclictest22375-21kworker/u8:208:26:043
1660991411,2cyclictest22375-21kworker/u8:208:26:043
1660991411,2cyclictest2049-21kworker/u8:111:13:043
1660991411,2cyclictest2007-21kworker/u8:108:39:033
1660991411,2cyclictest18623-21kworker/u8:111:33:053
1660991411,2cyclictest12316-21kworker/u8:207:46:043
1660991411,2cyclictest10819-21kworker/u8:010:22:043
1660991410,2cyclictest10338-21tr07:30:103
166099140,12cyclictest17952-21diskmemload11:26:063
166099140,12cyclictest0-21swapper/312:32:213
166099140,12cyclictest0-21swapper/310:10:303
165999140,2cyclictest0-21swapper/209:40:032
165999140,13cyclictest0-21swapper/211:25:302
165999140,12cyclictest0-21swapper/212:30:222
1658991411,2cyclictest27901-21kworker/u8:211:11:051
1658991411,2cyclictest0-21swapper/109:50:301
165899140,2cyclictest0-21swapper/112:02:041
165899140,2cyclictest0-21swapper/109:40:041
165899140,2cyclictest0-21swapper/107:25:041
165899140,13cyclictest0-21swapper/111:41:571
165899140,13cyclictest0-21swapper/109:26:581
165799142,7cyclictest5878-21metacity09:25:590
1657991410,2cyclictest17952-21diskmemload12:19:160
165799140,3cyclictest10604-21munin-node0
165799140,3cyclictest0-21swapper/009:12:330
165799140,2cyclictest0-21swapper/012:33:130
165799140,2cyclictest0-21swapper/010:59:250
165799140,2cyclictest0-21swapper/007:55:150
165799140,13cyclictest0-21swapper/012:11:140
165799140,12cyclictest0-21swapper/011:50:120
165799140,12cyclictest0-21swapper/010:25:450
137132140,2sleep017952-21diskmemload11:59:590
1660991310,2cyclictest9653-21kworker/u8:108:48:043
1660991310,2cyclictest7604-21kworker/u8:007:36:043
1660991310,2cyclictest3540-21kworker/u8:210:15:043
1660991310,2cyclictest3228-21kworker/u8:112:23:053
1660991310,2cyclictest30751-21kworker/u8:010:35:033
1660991310,2cyclictest22375-21kworker/u8:208:06:043
1660991310,2cyclictest18040-21kworker/u8:008:02:043
1660991310,2cyclictest17479-21kworker/u8:110:25:043
1660991310,2cyclictest15819-21kworker/u8:107:51:043
1660991310,2cyclictest0-21swapper/312:25:163
1660991310,2cyclictest0-21swapper/311:40:163
1660991310,2cyclictest0-21swapper/311:15:523
1660991310,2cyclictest0-21swapper/309:55:043
166099130,2cyclictest23467-21diskstats09:50:153
166099130,2cyclictest0-21swapper/309:10:143
166099130,2cyclictest0-21swapper/309:05:173
166099130,12cyclictest0-21swapper/310:50:023
166099130,11cyclictest0-21swapper/310:00:163
165999139,2cyclictest0-21swapper/208:25:252
165999139,2cyclictest0-21swapper/208:25:252
165999130,2cyclictest0-21swapper/211:45:162
165999130,2cyclictest0-21swapper/208:05:102
165999130,12cyclictest0-21swapper/209:29:042
165999130,11cyclictest10210-21aten2.4_r3power07:30:102
1658991310,2cyclictest17952-21diskmemload11:55:021
1658991310,2cyclictest0-21swapper/112:25:301
1658991310,2cyclictest0-21swapper/110:34:141
165899130,12cyclictest0-21swapper/111:31:341
165799139,3cyclictest23275-21munin-node0
1657991310,2cyclictest17797-21ssh11:29:140
1657991310,2cyclictest0-21swapper/012:35:280
1657991310,2cyclictest0-21swapper/012:26:140
1657991310,2cyclictest0-21swapper/012:22:240
1657991310,2cyclictest0-21swapper/012:05:350
1657991310,2cyclictest0-21swapper/011:45:280
1657991310,2cyclictest0-21swapper/010:22:320
1657991310,2cyclictest0-21swapper/009:45:500
1657991310,2cyclictest0-21swapper/009:35:490
1657991310,2cyclictest0-21swapper/009:30:370
165799130,2cyclictest26206-21ssh11:02:550
165799130,2cyclictest0-21swapper/010:16:290
165799130,12cyclictest0-21swapper/011:30:370
165799130,12cyclictest0-21swapper/011:15:540
165799130,12cyclictest0-21swapper/010:36:350
165799130,12cyclictest0-21swapper/009:51:210
265062120,8sleep00-21swapper/008:10:130
166099129,2cyclictest7261-21kworker/u8:211:47:033
166099129,2cyclictest18040-21kworker/u8:008:10:043
166099120,2cyclictest0-21swapper/307:15:183
166099120,11cyclictest0-21swapper/312:02:273
165999129,2cyclictest17952-21diskmemload09:37:152
165999122,7cyclictest0-21swapper/209:02:022
165999121,9cyclictest14724-21sed07:40:132
165799129,2cyclictest13503-21copy09:40:010
165799129,2cyclictest0-21swapper/010:46:020
165799129,2cyclictest0-21swapper/010:05:170
165799129,2cyclictest0-21swapper/009:00:140
165799129,2cyclictest0-21swapper/008:35:150
165799129,2cyclictest0-21swapper/008:20:310
165799129,2cyclictest0-21swapper/008:15:240
165799129,2cyclictest0-21swapper/007:50:170
165799129,2cyclictest0-21swapper/007:10:180
165799122,7cyclictest0-21swapper/008:48:590
165799122,7cyclictest0-21swapper/008:28:590
165799122,7cyclictest0-21swapper/008:28:590
165799122,7cyclictest0-21swapper/008:05:590
165799122,7cyclictest0-21swapper/007:37:590
165799120,7cyclictest0-21swapper/010:50:040
165799120,2cyclictest29197-21ssh09:20:360
165799120,2cyclictest0-21swapper/011:06:260
165799120,2cyclictest0-21swapper/011:06:250
165799120,2cyclictest0-21swapper/007:25:070
165799120,11cyclictest0-21swapper/012:02:580
165799120,11cyclictest0-21swapper/011:20:170
165799120,11cyclictest0-21swapper/011:10:590
165799120,11cyclictest0-21swapper/007:45:180
166099117,3cyclictest26472-21kworker/u8:108:17:043
165899110,2cyclictest0-21swapper/108:15:031
165899110,10cyclictest0-21swapper/107:16:041
165799110,7cyclictest0-21swapper/008:30:240
165799110,2cyclictest0-21swapper/008:55:260
165999106,2cyclictest11878-21apt07:35:012
165999105,3cyclictest26690-21df08:10:132
165999105,3cyclictest0-21swapper/207:10:142
165899100,2cyclictest0-21swapper/107:30:041
165799106,2cyclictest0-21swapper/007:30:150
165799105,3cyclictest0-21swapper/007:17:590
165799102,7cyclictest0-21swapper/008:54:590
16609995,3cyclictest6093-21telnet07:20:113
16609995,2cyclictest9275-21timerandwakeup07:25:333
16609994,3cyclictest7373-21timerwakeupswit08:40:253
16609990,3cyclictest0-21swapper/308:59:033
16579994,3cyclictest14363-21aten2.4_r3power07:40:110
16579990,2cyclictest0-21swapper/007:20:450
16609984,2cyclictest4312-21nscd07:10:113
16579980,2cyclictest0-21swapper/009:07:570
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional