You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-25 - 05:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Thu Jul 25, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
30718211395,12sleep30-21swapper/319:09:223
307092113102,6sleep10-21swapper/119:09:161
28772211187,17sleep20-21swapper/219:05:002
30635210695,6sleep00-21swapper/019:08:190
18512750,1sleep01854-21latency23:50:150
311232740,0sleep00-21swapper/021:27:130
3079799250,23cyclictest0-21swapper/321:20:013
3079499250,23cyclictest0-21swapper/021:20:040
165142250,0sleep30-21swapper/319:55:003
3079699240,23cyclictest0-21swapper/221:20:042
129902240,1sleep30-21swapper/322:17:263
3079599230,22cyclictest0-21swapper/121:20:051
295142230,0sleep00-21swapper/023:10:180
3079799221,19cyclictest14288-21diskmemload23:40:093
3079699221,19cyclictest5732-21ssh22:45:102
3079799211,2cyclictest0-21swapper/319:25:113
3079799210,19cyclictest0-21swapper/320:10:103
3079599210,19cyclictest0-21swapper/123:30:101
3079599210,19cyclictest0-21swapper/120:10:101
3079599200,15cyclictest0-21swapper/123:47:031
30794992017,2cyclictest0-21swapper/022:10:090
3079599190,2cyclictest0-21swapper/119:25:111
3079599190,14cyclictest0-21swapper/123:16:041
238002190,0sleep10-21swapper/123:39:421
162452190,1sleep1221ktimersoftd/100:07:001
3079799180,16cyclictest0-21swapper/323:30:103
30795991815,2cyclictest15828-21kworker/u8:221:12:041
30795991714,2cyclictest19737-21kworker/u8:123:06:041
30795991714,2cyclictest19458-21kworker/u8:222:33:041
30795991714,2cyclictest10621-21kworker/u8:323:28:041
30795991713,2cyclictest359-21kworker/u8:222:41:041
30797991612,2cyclictest0-21swapper/321:18:283
3079799161,13cyclictest0-21swapper/321:30:143
3079799160,13cyclictest0-21swapper/319:40:153
3079699162,7cyclictest0-21swapper/221:45:002
30796991611,3cyclictest32155-21users20:30:272
30795991613,2cyclictest14411-21kworker/u8:223:12:041
30797991510,3cyclictest0-21swapper/323:55:073
30797991510,3cyclictest0-21swapper/322:07:453
30797991510,3cyclictest0-21swapper/321:57:303
3079799150,13cyclictest624-21ssh00:31:133
3079799150,13cyclictest30293-21sh21:25:513
3079799150,13cyclictest10372-21ssh22:50:113
3079799150,13cyclictest0-21swapper/323:17:023
3079699152,7cyclictest0-21swapper/219:25:002
30796991512,2cyclictest0-21swapper/223:43:372
30796991511,2cyclictest12000-21ssh22:15:482
3079699150,13cyclictest18232-21kworker/u8:000:18:042
3079699150,13cyclictest14288-21diskmemload22:08:472
3079699150,13cyclictest0-21swapper/223:19:552
3079699150,13cyclictest0-21swapper/222:39:072
3079699150,13cyclictest0-21swapper/200:34:372
3079599150,2cyclictest0-21swapper/121:33:041
3079499150,2cyclictest18742-21apt-get20:00:100
3079499150,13cyclictest0-21swapper/023:41:200
3079499150,13cyclictest0-21swapper/023:25:000
3079499150,13cyclictest0-21swapper/022:26:000
30797991411,2cyclictest0-21swapper/300:07:083
3079799140,2cyclictest0-21swapper/321:11:083
3079799140,13cyclictest0-21swapper/323:10:183
3079799140,12cyclictest7481-21ssh22:10:583
3079799140,12cyclictest14288-21diskmemload22:28:543
3079799140,12cyclictest14288-21diskmemload00:26:443
3079799140,12cyclictest0-21swapper/323:23:143
3079799140,12cyclictest0-21swapper/322:56:083
3079799140,12cyclictest0-21swapper/322:33:413
3079799140,12cyclictest0-21swapper/322:20:133
3079799140,12cyclictest0-21swapper/300:15:423
3079699149,3cyclictest0-21swapper/222:13:392
3079699149,3cyclictest0-21swapper/200:11:472
3079699142,6cyclictest0-21swapper/222:40:002
3079699141,7cyclictest0-21swapper/219:20:002
30796991411,2cyclictest0-21swapper/223:58:372
30796991411,2cyclictest0-21swapper/222:20:102
30796991411,2cyclictest0-21swapper/221:58:572
30796991411,2cyclictest0-21swapper/221:15:472
3079699140,2cyclictest0-21swapper/223:20:572
3079699140,13cyclictest0-21swapper/223:52:072
3079699140,12cyclictest22478-21ssh22:27:492
3079699140,12cyclictest0-21swapper/223:35:572
3079699140,12cyclictest0-21swapper/223:30:262
3079699140,12cyclictest0-21swapper/223:10:312
3079699140,12cyclictest0-21swapper/222:50:092
3079699140,12cyclictest0-21swapper/222:30:112
3079699140,12cyclictest0-21swapper/221:30:102
30795991411,2cyclictest9474-21kworker/u8:021:48:041
30795991411,2cyclictest4495-21kworker/u8:120:58:041
30795991411,2cyclictest28539-21kworker/u8:021:26:041
3079599140,2cyclictest0-21swapper/123:00:131
3079599140,2cyclictest0-21swapper/120:40:221
3079599140,2cyclictest0-21swapper/120:40:221
3079599140,13cyclictest0-21swapper/121:54:421
3079599140,12cyclictest31937-21ssh00:29:371
3079599140,12cyclictest0-21swapper/121:55:161
30794991411,2cyclictest0-21swapper/022:10:000
30794991411,2cyclictest0-21swapper/021:15:350
30794991411,2cyclictest0-21swapper/020:25:100
30794991411,2cyclictest0-21swapper/000:21:400
3079499140,13cyclictest0-21swapper/021:45:100
3079499140,12cyclictest14754-21ssh00:04:490
3079799138,3cyclictest0-21swapper/300:13:033
30797991310,2cyclictest7904-21ssh21:36:543
30797991310,2cyclictest14288-21diskmemload23:05:443
30797991310,2cyclictest14288-21diskmemload21:48:313
30797991310,2cyclictest13337-21ssh23:27:353
30797991310,2cyclictest0-21swapper/323:47:283
30797991310,2cyclictest0-21swapper/322:36:113
30797991310,2cyclictest0-21swapper/321:51:193
30797991310,2cyclictest0-21swapper/319:20:083
30797991310,2cyclictest0-21swapper/300:00:023
3079799130,2cyclictest0-21swapper/323:35:153
3079799130,2cyclictest0-21swapper/322:45:053
3079799130,2cyclictest0-21swapper/300:37:023
3079799130,12cyclictest0-21swapper/323:04:083
3079799130,12cyclictest0-21swapper/322:40:443
3079799130,12cyclictest0-21swapper/320:50:283
3079699138,3cyclictest20732-21munin-node2
3079699131,3cyclictest0-21swapper/219:45:272
30796991310,2cyclictest14288-21diskmemload23:45:132
30796991310,2cyclictest0-21swapper/200:23:382
3079699130,2cyclictest0-21swapper/221:10:342
3079699130,2cyclictest0-21swapper/220:50:162
3079699130,1cyclictest0-21swapper/220:40:172
3079699130,1cyclictest0-21swapper/220:40:172
3079699130,12cyclictest0-21swapper/222:56:462
3079699130,12cyclictest0-21swapper/222:00:072
3079699130,12cyclictest0-21swapper/200:28:072
3079699130,11cyclictest14288-21diskmemload00:38:292
3079699130,11cyclictest14288-21diskmemload00:06:322
3079699130,11cyclictest0-21swapper/220:45:112
30795991310,2cyclictest31445-21kworker/u8:022:05:041
30795991310,2cyclictest27935-21kworker/u8:200:33:041
30795991310,2cyclictest24561-21kworker/u8:219:12:051
30795991310,2cyclictest24488-21kworker/u8:020:33:041
30795991310,2cyclictest2422-21kworker/u8:221:42:041
30795991310,2cyclictest12420-21kworker/u8:119:50:041
30795991310,2cyclictest0-21swapper/121:37:021
30795991310,2cyclictest0-21swapper/100:38:301
3079599130,9cyclictest0-21swapper/122:10:041
3079599130,2cyclictest0-21swapper/123:20:161
3079599130,12cyclictest0-21swapper/100:23:211
3079599130,12cyclictest0-21swapper/100:00:141
3079499131,2cyclictest22581-21ssh21:53:140
30794991310,2cyclictest14288-21diskmemload23:05:260
30794991310,2cyclictest14288-21diskmemload21:55:160
30794991310,2cyclictest14288-21diskmemload00:15:500
30794991310,2cyclictest0-21swapper/023:55:120
30794991310,2cyclictest0-21swapper/023:15:350
30794991310,2cyclictest0-21swapper/022:45:590
30794991310,2cyclictest0-21swapper/022:34:430
30794991310,2cyclictest0-21swapper/022:04:070
30794991310,2cyclictest0-21swapper/019:25:110
30794991310,2cyclictest0-21swapper/019:10:200
30794991310,2cyclictest0-21swapper/000:31:260
3079499130,2cyclictest0-21swapper/023:45:130
3079499130,2cyclictest0-21swapper/023:00:590
3079499130,2cyclictest0-21swapper/022:22:100
3079499130,2cyclictest0-21swapper/019:20:100
3079499130,2cyclictest0-21swapper/000:11:190
3079499130,12cyclictest0-21swapper/023:38:490
3079499130,12cyclictest0-21swapper/023:25:110
3079499130,11cyclictest3278-21sh00:35:180
3079499130,11cyclictest0-21swapper/019:45:170
237972130,3sleep123960-21latency_hist22:30:001
3079799129,2cyclictest0-21swapper/322:00:383
3079799129,2cyclictest0-21swapper/320:25:113
3079799129,2cyclictest0-21swapper/320:05:183
3079799129,2cyclictest0-21swapper/319:55:123
3079799129,2cyclictest0-21swapper/300:20:183
3079799123,6cyclictest14288-21diskmemload21:40:253
3079799120,2cyclictest0-21swapper/320:20:203
3079799120,2cyclictest0-21swapper/319:45:123
3079799120,11cyclictest0-21swapper/323:50:123
3079799120,11cyclictest0-21swapper/320:45:143
3079799120,11cyclictest0-21swapper/320:15:223
3079699129,2cyclictest0-21swapper/223:25:112
3079699129,2cyclictest0-21swapper/223:05:082
3079699129,2cyclictest0-21swapper/220:35:232
3079699127,3cyclictest20791-21mailstats23:00:232
3079699122,7cyclictest0-21swapper/221:40:012
3079699121,9cyclictest28534-21munin-run20:25:002
3079699121,9cyclictest16722-21munin-node2
3079699121,9cyclictest0-21swapper/219:40:142
3079699121,3cyclictest0-21swapper/220:25:122
3079699121,3cyclictest0-21swapper/200:00:192
3079699120,2cyclictest0-21swapper/221:50:592
3079699120,2cyclictest0-21swapper/221:47:192
3079699120,2cyclictest0-21swapper/221:25:202
3079699120,2cyclictest0-21swapper/220:10:122
3079699120,2cyclictest0-21swapper/219:10:282
3079699120,11cyclictest0-21swapper/221:05:362
3079699120,11cyclictest0-21swapper/220:15:282
3079699120,11cyclictest0-21swapper/219:30:092
3079599129,2cyclictest24561-21kworker/u8:219:24:041
3079599129,2cyclictest24488-21kworker/u8:020:22:041
3079599129,2cyclictest24488-21kworker/u8:020:15:031
3079599129,2cyclictest18901-21kworker/u8:020:03:041
3079599129,2cyclictest0-21swapper/123:56:371
3079599129,2cyclictest0-21swapper/122:51:071
3079599129,2cyclictest0-21swapper/121:15:271
3079599129,2cyclictest0-21swapper/100:16:551
3079599122,6cyclictest0-21swapper/120:50:001
3079599120,2cyclictest0-21swapper/123:40:431
3079599120,2cyclictest0-21swapper/122:20:531
3079599120,2cyclictest0-21swapper/122:16:371
3079599120,2cyclictest0-21swapper/122:00:331
3079599120,2cyclictest0-21swapper/100:12:271
3079599120,11cyclictest0-21swapper/123:50:471
3079599120,10cyclictest0-21swapper/122:45:231
3079599120,10cyclictest0-21swapper/120:05:101
3079499129,2cyclictest0-21swapper/022:36:400
3079499129,2cyclictest0-21swapper/021:11:410
3079499129,2cyclictest0-21swapper/021:05:250
3079499129,2cyclictest0-21swapper/000:27:290
3079499129,2cyclictest0-21swapper/000:05:250
3079499122,7cyclictest0-21swapper/021:03:590
3079499122,7cyclictest0-21swapper/020:53:020
3079499120,2cyclictest0-21swapper/022:40:010
3079499120,2cyclictest0-21swapper/022:15:090
3079499120,2cyclictest0-21swapper/021:35:230
3079499120,2cyclictest0-21swapper/020:55:170
3079499120,2cyclictest0-21swapper/020:35:310
3079499120,2cyclictest0-21swapper/020:15:160
3079499120,11cyclictest0-21swapper/023:30:500
3079499120,11cyclictest0-21swapper/022:58:390
3079499120,11cyclictest0-21swapper/022:50:160
3079499120,11cyclictest0-21swapper/021:41:340
3079499120,11cyclictest0-21swapper/021:31:150
3079499120,11cyclictest0-21swapper/020:05:150
3079499120,11cyclictest0-21swapper/019:50:230
3079799111,6cyclictest0-21swapper/321:05:363
3079799110,2cyclictest0-21swapper/319:30:123
3079699116,3cyclictest14991-21grep19:50:132
3079699116,3cyclictest0-21swapper/220:55:142
3079699116,3cyclictest0-21swapper/219:25:122
3079699111,3cyclictest10508-21munin-node2
3079699111,2cyclictest18742-21apt-get20:00:102
3079699110,9cyclictest0-21swapper/219:35:122
3079599118,2cyclictest8486-21kworker/u8:219:58:041
3079599118,2cyclictest6436-21kworker/u8:022:55:041
3079599118,2cyclictest6414-21kworker/u8:019:38:041
3079599118,2cyclictest6414-21kworker/u8:019:31:041
3079599118,2cyclictest26991-21kworker/u8:119:17:031
3079599118,2cyclictest12420-21kworker/u8:119:47:041
3079599118,2cyclictest0-21swapper/122:38:331
3079599111,6cyclictest0-21swapper/121:10:011
3079499118,2cyclictest0-21swapper/019:40:170
3079499118,2cyclictest0-21swapper/019:39:190
3079499112,6cyclictest0-21swapper/019:55:580
3079499112,6cyclictest0-21swapper/019:16:590
3079499110,9cyclictest27745-21pzem_energy20:20:210
3079799105,3cyclictest12284-21sh21:05:003
3079799101,6cyclictest0-21swapper/320:00:253
3079599107,2cyclictest4495-21kworker/u8:120:54:041
3079599107,2cyclictest28812-21kworker/u8:221:01:041
3079599107,2cyclictest24488-21kworker/u8:020:26:041
3079599101,7cyclictest5095-21runrttasks19:42:151
3079499107,2cyclictest6859-21aten2.4_r3power19:30:100
3079499102,7cyclictest0-21swapper/020:30:590
3079499102,6cyclictest0-21swapper/020:11:590
307979996,2cyclictest0-21swapper/320:34:113
307979992,5cyclictest0-21swapper/321:00:013
307979992,5cyclictest0-21swapper/319:37:343
307979991,3cyclictest0-21swapper/320:40:113
307979991,3cyclictest0-21swapper/320:40:113
307979990,8cyclictest0-21swapper/320:39:283
307959992,6cyclictest0-21swapper/120:35:261
1557290,1sleep30-21swapper/319:15:233
307979983,3cyclictest31014-21aten2.4_r3power19:10:113
307949983,3cyclictest4530-21cpu20:45:120
307949981,4cyclictest0-21swapper/020:45:000
307949981,4cyclictest0-21swapper/020:45:000
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional