You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-27 - 13:53

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sat Apr 27, 2024 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
578321670,1sleep35782-21ssh23:09:103
81782120109,6sleep10-21swapper/119:08:241
79692114103,6sleep20-21swapper/219:05:462
8170210584,16sleep30-21swapper/319:08:193
8051210594,6sleep00-21swapper/019:06:470
139852780,1sleep1221ktimersoftd/119:20:291
34762750,2sleep123-21ksoftirqd/120:15:271
157782750,0sleep00-21swapper/019:25:290
133612710,1sleep30-21swapper/320:40:203
102452700,0sleep00-21swapper/022:04:210
244902670,1sleep30-21swapper/321:45:003
243252500,0sleep20-21swapper/200:39:122
243252500,0sleep20-21swapper/200:39:122
833199310,2cyclictest0-21swapper/223:05:102
833199231,2cyclictest0-21swapper/222:12:042
832999230,2cyclictest0-21swapper/020:45:020
833199220,2cyclictest0-21swapper/220:45:032
172382220,1sleep30-21swapper/322:45:293
833299201,2cyclictest0-21swapper/321:58:043
8331992017,2cyclictest1003-21kworker/u8:223:43:042
833199200,18cyclictest0-21swapper/223:45:112
8330992017,2cyclictest27263-21kworker/u8:121:58:041
8332991916,2cyclictest866-21kworker/u8:022:17:043
8332991916,2cyclictest866-21kworker/u8:022:17:033
8332991916,2cyclictest32024-21kworker/u8:223:12:043
8332991916,2cyclictest31649-21kworker/u8:021:22:043
8332991916,2cyclictest23138-21kworker/u8:123:46:043
8332991916,2cyclictest18626-21kworker/u8:121:13:043
8332991916,2cyclictest13910-21kworker/u8:020:45:033
833199192,2cyclictest330350irq/24-eth121:58:042
8331991916,2cyclictest814-21kworker/u8:200:14:042
8331991916,2cyclictest6455-21kworker/u8:222:40:042
8331991916,2cyclictest494-21kworker/u8:219:11:042
8331991916,2cyclictest494-21kworker/u8:219:11:042
8331991916,2cyclictest3896-21kworker/u8:221:27:042
8331991916,2cyclictest330350irq/24-eth122:50:122
8331991916,2cyclictest27496-21kworker/u8:000:19:042
8331991916,2cyclictest27263-21kworker/u8:121:49:042
8330991916,2cyclictest23138-21kworker/u8:123:49:041
8332991815,2cyclictest32135-21kworker/u8:120:38:043
8332991815,2cyclictest32135-21kworker/u8:120:17:043
8332991815,2cyclictest28736-21kworker/u8:220:02:053
8332991815,2cyclictest28666-21kworker/u8:023:37:043
8332991815,2cyclictest20788-21kworker/u8:119:55:033
8332991815,2cyclictest15515-21kworker/u8:221:51:043
833299180,2cyclictest0-21swapper/323:18:043
833299180,16cyclictest0-21swapper/323:56:043
8331991815,2cyclictest6727-21kworker/u8:023:53:042
8331991815,2cyclictest6406-21kworker/u8:222:22:042
8331991815,2cyclictest6406-21kworker/u8:222:01:042
8331991815,2cyclictest32135-21kworker/u8:120:40:042
8331991815,2cyclictest32135-21kworker/u8:120:39:042
8331991815,2cyclictest32135-21kworker/u8:120:08:042
8331991815,2cyclictest23501-21kworker/u8:119:25:042
8331991815,2cyclictest23138-21kworker/u8:100:02:042
8331991815,2cyclictest20788-21kworker/u8:119:51:052
8331991815,2cyclictest16737-21kworker/u8:319:33:042
8331991815,2cyclictest10375-21kworker/u8:121:39:042
833199180,2cyclictest0-21swapper/223:18:042
8330991815,2cyclictest6455-21kworker/u8:222:46:041
8330991815,2cyclictest27263-21kworker/u8:121:53:041
8332991714,2cyclictest6455-21kworker/u8:222:53:043
8332991714,2cyclictest6406-21kworker/u8:222:29:043
8332991714,2cyclictest3896-21kworker/u8:221:28:043
8332991714,2cyclictest3664-21kworker/u8:020:21:033
8332991714,2cyclictest32135-21kworker/u8:120:29:043
8332991714,2cyclictest27263-21kworker/u8:121:48:043
8332991714,2cyclictest23501-21kworker/u8:119:18:043
8332991714,2cyclictest20420-21kworker/u8:022:58:043
8332991714,2cyclictest16737-21kworker/u8:319:40:043
8332991714,2cyclictest16737-21kworker/u8:319:39:043
8332991714,2cyclictest16203-21kworker/u8:221:01:043
8332991714,2cyclictest13910-21kworker/u8:020:52:053
8332991714,2cyclictest1315-21kworker/u8:022:30:043
833299171,14cyclictest25545-21fschecks_count23:30:143
833299170,2cyclictest18735-21ssh22:13:043
833299170,2cyclictest0-21swapper/323:23:043
8331991714,2cyclictest6406-21kworker/u8:222:27:042
8331991714,2cyclictest6208-21kworker/u8:100:32:042
8331991714,2cyclictest6208-21kworker/u8:100:32:042
8331991714,2cyclictest6208-21kworker/u8:100:26:042
8331991714,2cyclictest6208-21kworker/u8:100:21:042
8331991714,2cyclictest3664-21kworker/u8:020:34:042
8331991714,2cyclictest3664-21kworker/u8:020:24:042
8331991714,2cyclictest31649-21kworker/u8:021:19:052
8331991714,2cyclictest28736-21kworker/u8:220:14:042
8331991714,2cyclictest27257-21kworker/u8:122:37:042
8331991714,2cyclictest20788-21kworker/u8:119:43:042
8331991714,2cyclictest16703-21kworker/u8:020:00:042
833199171,2cyclictest0-21swapper/222:46:042
833199170,12cyclictest0-21swapper/223:20:042
833199170,12cyclictest0-21swapper/200:05:042
8330991714,2cyclictest6455-21kworker/u8:222:52:051
8330991714,2cyclictest31649-21kworker/u8:021:24:041
12062170,0sleep20-21swapper/223:04:332
8332991613,2cyclictest866-21kworker/u8:022:04:043
8332991613,2cyclictest31649-21kworker/u8:021:17:053
8332991613,2cyclictest23501-21kworker/u8:119:22:043
8332991613,2cyclictest23501-21kworker/u8:119:10:043
8332991613,2cyclictest23501-21kworker/u8:119:10:043
8332991613,2cyclictest18626-21kworker/u8:121:09:033
8332991613,2cyclictest10906-21kworker/u8:000:28:053
833299160,2cyclictest27675-21sh00:07:043
8331991613,2cyclictest32024-21kworker/u8:223:25:052
8331991613,2cyclictest24588-21kworker/u8:221:11:032
8331991613,2cyclictest23501-21kworker/u8:119:21:042
8331991613,2cyclictest21952-21kworker/u8:021:03:042
8331991613,2cyclictest16737-21kworker/u8:319:38:042
8331991613,2cyclictest16703-21kworker/u8:019:56:042
8331991613,2cyclictest13910-21kworker/u8:020:51:042
833199161,2cyclictest21622-21kworker/2:021:42:052
833199160,2cyclictest0-21swapper/223:33:042
8330991613,2cyclictest32024-21kworker/u8:223:24:041
8330991613,2cyclictest28736-21kworker/u8:220:04:021
8330991613,2cyclictest28666-21kworker/u8:023:38:041
8330991613,2cyclictest23138-21kworker/u8:123:56:041
8330991613,2cyclictest10375-21kworker/u8:121:41:041
832999162,8cyclictest24573-21ssh22:20:000
832999162,8cyclictest24573-21ssh22:20:000
833299151,3cyclictest0-21swapper/300:10:573
8332991512,2cyclictest10375-21kworker/u8:121:30:043
8332991512,2cyclictest0-21swapper/323:50:133
8332991512,2cyclictest0-21swapper/323:28:543
833299150,2cyclictest0-21swapper/322:06:043
833299150,14cyclictest12225-21ssh22:40:243
833299150,13cyclictest0-21swapper/300:04:053
833199151,2cyclictest29392-21apt-get21:50:122
8331991512,2cyclictest10375-21kworker/u8:121:31:042
8331991512,2cyclictest0-21swapper/222:55:212
833199150,3cyclictest0-21swapper/222:05:052
8330991512,2cyclictest6406-21kworker/u8:222:23:041
8330991512,2cyclictest32024-21kworker/u8:223:32:041
8330991512,2cyclictest32024-21kworker/u8:223:05:041
8330991512,2cyclictest27496-21kworker/u8:000:11:041
8330991512,2cyclictest27257-21kworker/u8:122:34:041
8330991512,2cyclictest16703-21kworker/u8:019:46:041
833099150,2cyclictest0-21swapper/123:10:181
833099150,14cyclictest0-21swapper/120:10:081
833099150,13cyclictest21759-21smartctl23:25:291
833099150,13cyclictest0-21swapper/121:26:311
832999152,7cyclictest0-21swapper/021:15:000
832999152,7cyclictest0-21swapper/020:25:000
832999151,12cyclictest5095-21runrttasks00:08:580
832999151,12cyclictest24292-21diskmemload22:05:470
832999151,12cyclictest0-21swapper/022:26:490
8329991510,3cyclictest0-21swapper/022:35:060
8332991411,2cyclictest1315-21kworker/u8:022:35:053
8332991411,2cyclictest0-21swapper/323:41:343
833299140,2cyclictest0-21swapper/322:23:043
833299140,2cyclictest0-21swapper/320:57:033
833299140,2cyclictest0-21swapper/319:50:043
833299140,2cyclictest0-21swapper/319:46:043
833299140,2cyclictest0-21swapper/300:33:033
833299140,2cyclictest0-21swapper/300:33:033
833299140,2cyclictest0-21swapper/300:15:433
833299140,12cyclictest0-21swapper/300:35:053
833299140,12cyclictest0-21swapper/300:35:053
833199143,9cyclictest0-21swapper/222:15:042
833199143,9cyclictest0-21swapper/222:15:042
8331991411,2cyclictest24292-21diskmemload23:58:512
833199140,2cyclictest0-21swapper/222:30:112
833199140,2cyclictest0-21swapper/220:57:032
833199140,12cyclictest24292-21diskmemload23:37:582
8330991411,2cyclictest6406-21kworker/u8:222:28:051
8330991411,2cyclictest32024-21kworker/u8:223:04:041
8330991411,2cyclictest31649-21kworker/u8:021:18:041
8330991411,2cyclictest24292-21diskmemload00:35:221
8330991411,2cyclictest24292-21diskmemload00:35:211
8330991411,2cyclictest15535-21kworker/u8:200:04:041
833099140,12cyclictest24292-21diskmemload22:17:131
833099140,12cyclictest24292-21diskmemload22:17:131
833099140,12cyclictest12131-21processes22:40:201
833099140,12cyclictest0-21swapper/123:40:011
833099140,12cyclictest0-21swapper/122:35:061
832999142,6cyclictest22323-21copy21:05:000
8329991410,2cyclictest17807-21timerandwakeup19:30:270
832999140,3cyclictest0-21swapper/021:53:440
832999140,12cyclictest10955-21fschecks_count19:15:130
8332991310,2cyclictest0-21swapper/300:21:393
833299130,2cyclictest0-21swapper/320:31:043
833299130,2cyclictest0-21swapper/319:30:183
833299130,12cyclictest0-21swapper/323:01:133
833299130,11cyclictest0-21swapper/321:35:123
833199130,2cyclictest0-21swapper/221:20:032
833199130,2cyclictest0-21swapper/221:08:042
833199130,2cyclictest0-21swapper/220:27:032
833199130,2cyclictest0-21swapper/219:17:042
8330991310,2cyclictest6727-21kworker/u8:023:54:051
8330991310,2cyclictest6406-21kworker/u8:222:07:051
8330991310,2cyclictest494-21kworker/u8:219:26:041
8330991310,2cyclictest494-21kworker/u8:219:12:041
8330991310,2cyclictest494-21kworker/u8:219:12:041
8330991310,2cyclictest24588-21kworker/u8:221:12:041
8330991310,2cyclictest16203-21kworker/u8:220:56:041
8330991310,2cyclictest15535-21kworker/u8:200:06:041
8330991310,2cyclictest10375-21kworker/u8:121:32:041
8330991310,2cyclictest0-21swapper/121:46:481
8330991310,2cyclictest0-21swapper/100:20:311
833099130,2cyclictest0-21swapper/121:36:281
833099130,2cyclictest0-21swapper/120:45:121
833099130,2cyclictest0-21swapper/100:15:031
832999139,2cyclictest0-21swapper/023:17:170
832999131,9cyclictest30419-21apt-get20:05:000
832999131,7cyclictest14249-21copy20:45:000
8329991310,2cyclictest0-21swapper/021:15:400
832999130,2cyclictest0-21swapper/023:26:380
832999130,2cyclictest0-21swapper/022:20:090
832999130,12cyclictest0-21swapper/022:30:100
832999130,11cyclictest27639-21ssh21:47:390
832999130,11cyclictest24334-21rm00:04:080
832999130,11cyclictest24292-21diskmemload22:45:070
832999130,11cyclictest0-21swapper/022:58:190
832999130,11cyclictest0-21swapper/000:22:100
220122130,2sleep00-21swapper/022:50:360
833299120,2cyclictest0-21swapper/319:28:053
833199120,3cyclictest0-21swapper/223:10:122
833199120,2cyclictest0-21swapper/220:16:052
833199120,2cyclictest0-21swapper/219:45:042
833099129,2cyclictest6208-21kworker/u8:100:31:041
833099129,2cyclictest6208-21kworker/u8:100:31:041
833099129,2cyclictest494-21kworker/u8:219:30:041
833099129,2cyclictest3664-21kworker/u8:020:33:041
833099129,2cyclictest3664-21kworker/u8:020:25:041
833099129,2cyclictest32135-21kworker/u8:120:07:041
833099129,2cyclictest21952-21kworker/u8:021:02:041
833099129,2cyclictest13910-21kworker/u8:020:44:051
833099129,2cyclictest0-21swapper/122:10:201
833099129,2cyclictest0-21swapper/100:25:041
833099120,11cyclictest0-21swapper/122:55:411
833099120,11cyclictest0-21swapper/122:00:421
833099120,11cyclictest0-21swapper/120:20:231
833099120,10cyclictest0-21swapper/123:15:441
832999129,2cyclictest9885-21ssh23:48:080
832999129,2cyclictest0-21swapper/022:12:270
832999129,2cyclictest0-21swapper/021:56:160
832999129,2cyclictest0-21swapper/021:38:490
832999129,2cyclictest0-21swapper/021:25:300
832999129,2cyclictest0-21swapper/021:20:500
832999129,2cyclictest0-21swapper/020:35:180
832999127,3cyclictest9256-21ntpq20:30:180
832999127,3cyclictest20486-21ssh00:35:070
832999127,3cyclictest20486-21ssh00:35:070
832999120,2cyclictest0-21swapper/023:04:500
832999120,11cyclictest0-21swapper/023:55:180
832999120,11cyclictest0-21swapper/023:50:300
832999120,11cyclictest0-21swapper/023:20:400
832999120,11cyclictest0-21swapper/000:32:040
832999120,11cyclictest0-21swapper/000:32:040
832999120,10cyclictest24292-21diskmemload00:11:470
224862120,2sleep00-21swapper/021:41:490
144192120,2sleep014422-21ssh21:33:490
102032120,1sleep00-21swapper/023:13:490
833299118,2cyclictest0-21swapper/320:05:123
833299110,2cyclictest0-21swapper/320:13:043
833099118,2cyclictest32135-21kworker/u8:120:37:041
833099118,2cyclictest20788-21kworker/u8:119:54:041
833099118,2cyclictest20788-21kworker/u8:119:42:041
833099118,2cyclictest16703-21kworker/u8:019:58:041
833099118,2cyclictest13910-21kworker/u8:020:54:041
832999118,2cyclictest24292-21diskmemload23:41:090
832999118,2cyclictest0-21swapper/023:05:240
832999118,2cyclictest0-21swapper/022:44:080
832999118,2cyclictest0-21swapper/000:16:580
832999116,3cyclictest2161-21sort20:15:010
832999111,6cyclictest11292-21ssh00:25:110
832999111,6cyclictest0-21swapper/019:50:260
832999110,2cyclictest0-21swapper/023:37:450
832999110,10cyclictest0-21swapper/019:10:210
832999110,10cyclictest0-21swapper/019:10:210
833099107,2cyclictest16737-21kworker/u8:319:37:031
832999101,6cyclictest0-21swapper/020:15:240
832999101,6cyclictest0-21swapper/019:20:260
832999101,3cyclictest0-21swapper/020:05:080
832999100,3cyclictest0-21swapper/020:50:140
832999100,2cyclictest0-21swapper/023:33:360
83309996,2cyclictest221ktimersoftd/121:05:221
83309995,3cyclictest11116-21hddtemp_smartct19:15:141
83299996,2cyclictest0-21swapper/019:45:010
83299994,3cyclictest26745-21telnet19:55:140
83299994,3cyclictest21653-21rt-features19:40:310
83299994,3cyclictest20249-21latency_hist21:00:000
83299984,2cyclictest19653-21mailstats19:35:260
83299983,3cyclictest6434-21aten2.4_r3power20:25:120
83299983,3cyclictest20542-21aten2.4-expect21:00:100
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional