You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 03:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Sat Jul 27, 2024 00:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
32754211894,19sleep00-21swapper/019:09:070
352211597,12sleep30-21swapper/319:09:583
32745210897,6sleep10-21swapper/119:09:001
3248629786,6sleep20-21swapper/219:05:412
102752750,0sleep00-21swapper/022:46:580
170272700,0sleep20-21swapper/221:45:112
298152240,0sleep00-21swapper/023:08:390
382992017,2cyclictest2875-21kworker/u8:021:32:041
382992017,2cyclictest10018-21kworker/u8:221:42:041
145522200,1sleep00-21swapper/000:00:540
64302190,0sleep10-21swapper/123:52:491
384991916,2cyclictest15145-21kworker/u8:121:51:043
302532190,0sleep00-21swapper/021:59:520
66542180,0sleep10-21swapper/120:45:111
382991815,2cyclictest25201-21kworker/u8:223:17:041
384991714,2cyclictest8082-21kworker/u8:023:21:043
38499170,2cyclictest0-21swapper/321:32:043
383991714,2cyclictest6882-21kworker/u8:122:53:042
383991714,2cyclictest30885-21kworker/u8:022:38:042
382991714,2cyclictest28734-21kworker/u8:121:24:041
382991714,2cyclictest15729-21kworker/u8:223:42:041
275052170,1sleep0101ktimersoftd/021:20:350
384991613,2cyclictest8177-21kworker/u8:020:48:043
384991613,2cyclictest381ktimersoftd/321:10:083
38499161,13cyclictest0-21swapper/323:05:133
38499160,2cyclictest0-21swapper/321:42:043
38499160,14cyclictest32263-21ssh00:20:193
38499160,14cyclictest0-21swapper/321:24:043
382991613,2cyclictest3147-21kworker/u8:123:30:041
38299160,14cyclictest0-21swapper/121:00:141
384991512,2cyclictest3147-21kworker/u8:123:38:043
384991512,2cyclictest24974-21kworker/u8:022:01:043
38499151,12cyclictest5812-21cat20:40:283
38499151,12cyclictest25799-21ssh23:04:413
38499151,12cyclictest0-21swapper/322:08:503
38499151,12cyclictest0-21swapper/322:08:493
38499151,12cyclictest0-21swapper/320:05:073
38499150,2cyclictest0-21swapper/323:17:043
38499150,14cyclictest0-21swapper/323:42:043
38499150,13cyclictest16339-21diskmemload21:48:203
38499150,13cyclictest0-21swapper/300:04:173
38399152,11cyclictest0-21swapper/221:28:232
38399151,3cyclictest0-21swapper/223:45:202
383991512,2cyclictest4530-21kworker/u8:221:10:042
383991512,2cyclictest11839-21kworker/u8:222:16:042
383991511,3cyclictest0-21swapper/223:17:102
38399150,2cyclictest0-21swapper/223:35:002
38399150,2cyclictest0-21swapper/221:42:042
38399150,2cyclictest0-21swapper/221:32:042
38399150,13cyclictest16339-21diskmemload23:43:002
38399150,13cyclictest0-21swapper/222:57:292
382991512,2cyclictest6882-21kworker/u8:123:03:041
382991512,2cyclictest3383-21kworker/u8:000:33:041
382991512,2cyclictest24974-21kworker/u8:021:58:041
382991512,2cyclictest20008-21kworker/u8:222:03:041
38299150,3cyclictest7747-21apt-get23:55:051
38199151,12cyclictest11871-21sensors_fan19:35:250
38199150,13cyclictest0-21swapper/019:10:170
384991411,2cyclictest6852-21kworker/u8:019:34:043
384991411,2cyclictest30602-21kworker/u8:219:27:043
384991411,2cyclictest19203-21kworker/u8:022:57:043
384991411,2cyclictest0-21swapper/322:31:133
384991411,2cyclictest0-21swapper/300:30:053
384991410,3cyclictest6882-21kworker/u8:122:54:043
38499140,3cyclictest2736-21df_abs20:35:123
38499140,2cyclictest17659-21ssh00:05:133
38499140,2cyclictest0-21swapper/323:30:043
38499140,2cyclictest0-21swapper/321:26:483
38499140,13cyclictest0-21swapper/320:15:263
38499140,12cyclictest16339-21diskmemload23:52:073
38499140,12cyclictest16339-21diskmemload22:48:133
38499140,12cyclictest16339-21diskmemload00:35:363
38499140,12cyclictest0-21swapper/322:35:273
38499140,12cyclictest0-21swapper/319:10:213
38399144,2cyclictest0-21swapper/223:55:142
38399141,2cyclictest19550-21diskmemload22:22:112
383991411,2cyclictest24974-21kworker/u8:022:06:042
383991411,2cyclictest24974-21kworker/u8:022:06:042
383991411,2cyclictest0-21swapper/221:38:302
383991411,2cyclictest0-21swapper/200:17:502
38399140,2cyclictest16339-21diskmemload23:05:392
38399140,2cyclictest0-21swapper/223:13:022
38399140,2cyclictest0-21swapper/221:55:212
38399140,2cyclictest0-21swapper/221:05:212
38399140,13cyclictest0-21swapper/222:11:402
38399140,13cyclictest0-21swapper/222:11:402
38399140,13cyclictest0-21swapper/221:20:102
38399140,13cyclictest0-21swapper/221:18:402
38399140,12cyclictest16339-21diskmemload23:22:492
38399140,12cyclictest16339-21diskmemload00:23:172
38399140,12cyclictest0-21swapper/220:35:212
38399140,12cyclictest0-21swapper/200:31:372
38399140,12cyclictest0-21swapper/200:27:402
382991411,2cyclictest6690-21kworker/u8:122:12:041
382991411,2cyclictest6690-21kworker/u8:122:12:031
382991411,2cyclictest3147-21kworker/u8:123:20:041
382991411,2cyclictest28734-21kworker/u8:121:37:041
382991411,2cyclictest17370-21kworker/u8:122:35:041
382991411,2cyclictest17370-21kworker/u8:122:34:041
382991411,2cyclictest17370-21kworker/u8:122:27:041
382991411,2cyclictest0-21swapper/121:25:261
382991411,2cyclictest0-21swapper/121:11:041
38299140,12cyclictest3304-21latency19:15:161
38199149,3cyclictest27228-21fschecks_count20:15:150
381991411,2cyclictest0-21swapper/021:50:370
381991411,2cyclictest0-21swapper/019:30:170
38199140,13cyclictest0-21swapper/019:45:170
38199140,12cyclictest16339-21diskmemload21:30:170
38199140,12cyclictest0-21swapper/022:09:180
38199140,12cyclictest0-21swapper/022:09:180
38199140,12cyclictest0-21swapper/020:20:110
295052140,0sleep20-21swapper/222:33:252
384991310,2cyclictest636-21kworker/u8:119:22:043
384991310,2cyclictest30602-21kworker/u8:219:53:033
384991310,2cyclictest24332-21kworker/u8:100:16:043
384991310,2cyclictest22887-21kworker/u8:120:13:033
384991310,2cyclictest11839-21kworker/u8:222:15:043
384991310,2cyclictest0-21swapper/321:36:153
384991310,2cyclictest0-21swapper/319:40:213
384991310,2cyclictest0-21swapper/300:25:173
384991310,2cyclictest0-21swapper/300:10:313
38499130,2cyclictest0-21swapper/322:40:073
38499130,2cyclictest0-21swapper/322:28:173
38499130,12cyclictest30675-21copy23:10:023
38499130,12cyclictest16339-21diskmemload23:25:073
38499130,12cyclictest16339-21diskmemload21:56:243
38499130,12cyclictest0-21swapper/323:55:253
38499130,12cyclictest0-21swapper/323:45:163
38499130,12cyclictest0-21swapper/322:23:073
38499130,12cyclictest0-21swapper/321:16:203
38499130,12cyclictest0-21swapper/320:25:243
38399138,3cyclictest0-21swapper/200:37:202
383991310,2cyclictest16339-21diskmemload23:00:552
383991310,2cyclictest16339-21diskmemload21:50:312
383991310,2cyclictest0-21swapper/222:40:242
383991310,2cyclictest0-21swapper/222:25:132
383991310,2cyclictest0-21swapper/220:10:112
383991310,2cyclictest0-21swapper/220:00:282
383991310,2cyclictest0-21swapper/200:00:482
38399130,2cyclictest16339-21diskmemload23:53:042
38399130,2cyclictest16339-21diskmemload23:25:082
38399130,2cyclictest0-21swapper/220:25:112
38399130,2cyclictest0-21swapper/219:10:242
38399130,2cyclictest0-21swapper/200:11:142
38399130,12cyclictest0-21swapper/223:35:092
38399130,12cyclictest0-21swapper/200:07:162
38399130,11cyclictest0-21swapper/221:00:262
38399130,11cyclictest0-21swapper/220:45:232
382991310,2cyclictest24332-21kworker/u8:100:24:041
382991310,2cyclictest18881-21kworker/u8:020:05:041
382991310,2cyclictest15729-21kworker/u8:223:45:041
382991310,2cyclictest0-21swapper/122:42:041
382991310,2cyclictest0-21swapper/122:09:241
382991310,2cyclictest0-21swapper/122:09:241
382991310,2cyclictest0-21swapper/119:25:261
38299130,11cyclictest0-21swapper/122:20:351
38199139,3cyclictest10948-21entropy20:55:140
381991310,2cyclictest0-21swapper/023:44:030
381991310,2cyclictest0-21swapper/023:38:580
381991310,2cyclictest0-21swapper/023:00:280
381991310,2cyclictest0-21swapper/022:23:280
381991310,2cyclictest0-21swapper/022:10:080
381991310,2cyclictest0-21swapper/022:10:080
381991310,2cyclictest0-21swapper/021:40:450
381991310,2cyclictest0-21swapper/021:29:250
381991310,2cyclictest0-21swapper/021:11:090
381991310,2cyclictest0-21swapper/000:39:020
38199130,2cyclictest0-21swapper/021:35:190
38199130,12cyclictest3728-21ssh22:40:200
38199130,12cyclictest0-21swapper/022:25:220
38199130,12cyclictest0-21swapper/022:19:220
38199130,12cyclictest0-21swapper/021:46:470
38199130,11cyclictest24974-21kworker/u8:022:00:040
38499129,2cyclictest10283-21kworker/u8:120:56:043
38499120,2cyclictest0-21swapper/322:12:283
38499120,2cyclictest0-21swapper/322:12:283
38499120,11cyclictest0-21swapper/319:15:153
38399129,2cyclictest8177-21kworker/u8:020:54:042
38399129,2cyclictest0-21swapper/220:20:192
38399129,2cyclictest0-21swapper/220:15:202
38399129,2cyclictest0-21swapper/219:40:292
38399127,3cyclictest0-21swapper/219:25:202
38399121,3cyclictest18780-21munin-node2
38399121,3cyclictest0-21swapper/220:40:122
38399120,2cyclictest0-21swapper/222:00:042
38399120,11cyclictest0-21swapper/222:45:102
38399120,11cyclictest0-21swapper/220:30:152
38399120,11cyclictest0-21swapper/219:50:112
38399120,11cyclictest0-21swapper/219:30:222
38299129,2cyclictest6852-21kworker/u8:019:40:041
38299129,2cyclictest30885-21kworker/u8:022:46:041
38299129,2cyclictest2148-21kworker/u8:120:36:041
38299129,2cyclictest0-21swapper/123:10:351
38299129,2cyclictest0-21swapper/122:56:151
38299129,2cyclictest0-21swapper/121:47:161
38299129,2cyclictest0-21swapper/100:02:151
38299120,2cyclictest0-21swapper/122:53:441
38299120,2cyclictest0-21swapper/121:50:081
38299120,2cyclictest0-21swapper/100:06:551
38299120,1cyclictest0-21swapper/123:05:241
38299120,11cyclictest15424-21ssh00:37:161
38299120,11cyclictest0-21swapper/121:17:061
38299120,11cyclictest0-21swapper/120:25:251
38299120,11cyclictest0-21swapper/119:30:271
38299120,11cyclictest0-21swapper/100:16:151
38299120,10cyclictest0-21swapper/123:27:161
38199129,2cyclictest17345-21perl19:50:130
38199129,2cyclictest14562-21apt-get21:05:110
38199129,2cyclictest0-21swapper/023:55:160
38199129,2cyclictest0-21swapper/023:48:270
38199129,2cyclictest0-21swapper/022:52:560
38199129,2cyclictest0-21swapper/000:25:170
38199129,2cyclictest0-21swapper/000:20:140
38199120,2cyclictest0-21swapper/023:25:450
38199120,2cyclictest0-21swapper/023:22:480
38199120,2cyclictest0-21swapper/020:05:190
38199120,2cyclictest0-21swapper/019:25:110
38199120,2cyclictest0-21swapper/000:09:050
38199120,11cyclictest302-21ssh22:36:090
38199120,11cyclictest0-21swapper/023:30:220
38199120,11cyclictest0-21swapper/023:15:230
38199120,11cyclictest0-21swapper/022:55:190
38199120,11cyclictest0-21swapper/022:31:160
38199120,11cyclictest0-21swapper/021:15:240
38199120,11cyclictest0-21swapper/020:00:170
319682120,2sleep00-21swapper/023:10:200
38499118,2cyclictest8177-21kworker/u8:020:51:033
38499118,2cyclictest18881-21kworker/u8:020:30:043
38499118,2cyclictest14099-21kworker/u8:021:02:043
38499118,2cyclictest0-21swapper/320:00:103
38499118,2cyclictest0-21swapper/319:35:293
38399116,3cyclictest11542-21memory19:35:172
38399116,3cyclictest0-21swapper/220:05:122
38399111,3cyclictest0-21swapper/219:45:252
38399110,9cyclictest0-21swapper/219:20:222
38399110,9cyclictest0-21swapper/219:15:132
38299118,2cyclictest6852-21kworker/u8:019:35:041
38299118,2cyclictest636-21kworker/u8:119:24:041
38299118,2cyclictest28369-21kworker/u8:220:34:041
38299118,2cyclictest22887-21kworker/u8:120:15:031
38299110,2cyclictest0-21swapper/123:35:551
38299110,10cyclictest0-21swapper/100:28:461
38199118,2cyclictest0-21swapper/023:50:230
38199118,2cyclictest0-21swapper/019:20:110
38199118,2cyclictest0-21swapper/000:30:240
38199110,10cyclictest30602-21kworker/u8:219:15:040
38199110,10cyclictest0-21swapper/000:16:570
247542110,1sleep00-21swapper/000:12:290
236442110,2sleep116339-21diskmemload00:10:381
38499107,2cyclictest0-21swapper/321:05:203
38499107,2cyclictest0-21swapper/319:45:163
38499100,9cyclictest0-21swapper/319:55:203
38399100,8cyclictest10938-21sed20:55:142
38299107,2cyclictest8177-21kworker/u8:020:53:041
38299107,2cyclictest30602-21kworker/u8:219:14:041
38299107,2cyclictest22887-21kworker/u8:120:11:031
38299107,2cyclictest18881-21kworker/u8:020:21:041
38299107,2cyclictest18881-21kworker/u8:019:56:041
38299107,2cyclictest0-21swapper/122:17:361
38299105,3cyclictest270-21jbd2/sda1-819:50:141
38299100,2cyclictest0-21swapper/120:55:141
38299100,1cyclictest0-21swapper/120:00:111
38199107,2cyclictest0-21swapper/020:35:190
38199105,3cyclictest25297-21fschecks_time20:10:140
38199105,3cyclictest1080-21latency20:30:170
38199100,9cyclictest18881-21kworker/u8:019:58:040
3829996,2cyclictest4530-21kworker/u8:220:42:041
3829996,2cyclictest14099-21kworker/u8:021:07:041
3829994,3cyclictest15485-21latency19:45:161
3819996,2cyclictest0-21swapper/019:40:210
3819995,2cyclictest6699-21aten2.4_r3power20:45:110
3819994,3cyclictest31379-21fschecks_time20:25:140
3819990,8cyclictest4502-21dbus-daemon20:52:170
3849983,3cyclictest30112-21timerwakeupswit20:20:293
3819984,2cyclictest4650-21cpuspeed_turbos20:40:130
3819980,2cyclictest0-21swapper/021:00:270
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional