You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-14 - 18:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack3slot6s.osadl.org (updated Sun Apr 14, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
57422111100,6sleep20-21swapper/219:06:322
5988211088,17sleep10-21swapper/119:09:241
5729211087,18sleep00-21swapper/019:06:220
5727210796,6sleep30-21swapper/319:06:213
256672820,0sleep00-21swapper/021:13:300
32792800,0sleep00-21swapper/022:34:270
46182740,1sleep30-21swapper/300:20:163
606499221,19cyclictest0-21swapper/300:15:093
6062992118,2cyclictest0-21swapper/100:20:021
606299210,19cyclictest0-21swapper/100:15:091
606199210,19cyclictest0-21swapper/019:40:090
110972210,0sleep30-21swapper/300:27:223
606299200,15cyclictest0-21swapper/122:15:041
606299200,15cyclictest0-21swapper/100:26:041
6062991916,2cyclictest28070-21kworker/u8:020:19:041
606299190,2cyclictest0-21swapper/119:15:091
606299190,14cyclictest0-21swapper/121:33:041
6061991911,6cyclictest24516-21chrt22:21:040
606299183,9cyclictest0-21swapper/121:17:041
606299183,2cyclictest0-21swapper/121:55:041
606299182,2cyclictest0-21swapper/123:57:041
606299182,2cyclictest0-21swapper/123:53:041
6062991815,2cyclictest8838-21kworker/u8:022:54:041
6062991815,2cyclictest2832-21kworker/u8:223:46:041
6062991815,2cyclictest24097-21kworker/u8:220:00:041
6062991815,2cyclictest17198-21kworker/u8:123:42:041
6062991815,2cyclictest13842-21kworker/u8:020:53:041
606299181,2cyclictest21973-21diskmemload23:11:041
606299180,13cyclictest0-21swapper/120:37:031
606299180,13cyclictest0-21swapper/120:37:031
606299172,2cyclictest0-21swapper/122:31:041
606299172,2cyclictest0-21swapper/100:13:041
6062991714,2cyclictest30191-21kworker/u8:219:30:041
606299171,2cyclictest0-21swapper/123:25:041
606299171,2cyclictest0-21swapper/123:23:041
606299171,2cyclictest0-21swapper/122:58:041
606299171,2cyclictest0-21swapper/119:50:041
606299171,2cyclictest0-21swapper/119:26:041
606299170,2cyclictest0-21swapper/122:07:031
606299170,2cyclictest0-21swapper/120:12:041
6061991712,3cyclictest17945-21ssh22:50:080
606499161,3cyclictest6408-21chrt22:36:393
606499161,3cyclictest19944-21apt-get21:05:073
606399161,3cyclictest12228-21ssh00:29:172
6063991611,3cyclictest17420-21python19:35:242
606399161,13cyclictest0-21swapper/221:00:002
606299162,2cyclictest0-21swapper/119:40:041
6062991613,2cyclictest22235-21kworker/u8:121:11:041
606299161,2cyclictest0-21swapper/121:24:041
606299161,2cyclictest0-21swapper/120:43:031
606299161,2cyclictest0-21swapper/119:21:041
606299160,7cyclictest0-21swapper/122:04:041
606299160,2cyclictest0-21swapper/123:03:031
606299160,2cyclictest0-21swapper/121:02:041
606299160,2cyclictest0-21swapper/120:57:041
606299160,2cyclictest0-21swapper/120:28:041
606299160,2cyclictest0-21swapper/100:39:041
606299160,2cyclictest0-21swapper/100:04:041
606299160,15cyclictest0-21swapper/120:09:031
606299160,12cyclictest0-21swapper/121:26:041
6061991611,3cyclictest27392-21nscd23:25:080
148542160,2sleep3606499cyclictest23:55:433
606499152,7cyclictest0-21swapper/322:25:003
606499151,3cyclictest26285-21ssh23:34:213
606499151,2cyclictest31709-21apt-get21:55:093
6064991511,2cyclictest0-21swapper/323:50:063
6064991510,3cyclictest8348-21cut19:15:103
606299152,2cyclictest0-21swapper/123:06:041
606299151,2cyclictest0-21swapper/122:45:041
6062991510,3cyclictest26561-21ssh00:09:581
606299150,4cyclictest0-21swapper/120:20:041
606299150,3cyclictest21632-21kworker/1:223:30:041
606299150,2cyclictest0-21swapper/123:36:041
606299150,2cyclictest0-21swapper/122:11:041
606299150,2cyclictest0-21swapper/121:35:041
606299150,2cyclictest0-21swapper/121:06:041
606299150,2cyclictest0-21swapper/120:33:041
606299150,13cyclictest21973-21diskmemload22:26:581
606199159,3cyclictest31601-21ssh21:20:110
16512150,2sleep00-21swapper/023:06:510
606499149,3cyclictest2912-21seq22:33:513
606499142,7cyclictest0-21swapper/322:30:003
606499141,3cyclictest29327-21ssh23:01:293
606499141,2cyclictest16149-21apt-get20:55:103
6064991411,2cyclictest0-21swapper/300:10:483
606499140,3cyclictest6168-21ssh23:46:373
606499140,12cyclictest929-21ssh23:40:503
606499140,12cyclictest5095-21runrttasks21:23:313
606499140,12cyclictest21973-21diskmemload21:32:253
606499140,12cyclictest0-21swapper/323:29:213
606499140,12cyclictest0-21swapper/322:58:473
606499140,12cyclictest0-21swapper/322:51:553
606499140,12cyclictest0-21swapper/322:43:233
606499140,12cyclictest0-21swapper/322:19:593
606499140,12cyclictest0-21swapper/321:37:173
606499140,12cyclictest0-21swapper/321:27:443
606499140,12cyclictest0-21swapper/300:00:213
606399149,3cyclictest27710-21munin-node2
606399142,6cyclictest0-21swapper/220:35:002
6063991411,2cyclictest0-21swapper/223:29:572
606399141,11cyclictest10040-21users23:50:252
606399140,2cyclictest0-21swapper/221:42:272
606399140,12cyclictest7295-21cut19:10:212
606399140,12cyclictest31890-21cpu21:55:102
606399140,12cyclictest0-21swapper/223:08:272
606399140,12cyclictest0-21swapper/220:35:202
606399140,12cyclictest0-21swapper/220:35:202
606299149,3cyclictest0-21swapper/119:45:161
606299140,2cyclictest0-21swapper/123:16:041
606299140,2cyclictest0-21swapper/119:58:041
606299140,2cyclictest0-21swapper/119:36:051
606299140,2cyclictest0-21swapper/100:32:181
606299140,12cyclictest11319-21ssh22:42:071
606299140,12cyclictest0-21swapper/121:47:101
606199142,6cyclictest0-21swapper/022:00:000
606199140,12cyclictest0-21swapper/000:31:290
79452130,3sleep09-21ksoftirqd/021:29:290
6064991310,2cyclictest21973-21diskmemload23:35:103
6064991310,2cyclictest21973-21diskmemload22:05:523
6064991310,2cyclictest21973-21diskmemload00:35:583
6064991310,2cyclictest0-21swapper/323:22:283
6064991310,2cyclictest0-21swapper/322:48:243
6064991310,2cyclictest0-21swapper/322:10:163
6064991310,2cyclictest0-21swapper/321:42:293
6064991310,2cyclictest0-21swapper/320:35:143
6064991310,2cyclictest0-21swapper/320:35:143
6064991310,2cyclictest0-21swapper/300:34:043
6064991310,2cyclictest0-21swapper/300:07:153
606499130,2cyclictest23909-21ssh21:10:333
606499130,2cyclictest21973-21diskmemload23:07:033
606499130,2cyclictest0-21swapper/322:01:293
606499130,2cyclictest0-21swapper/321:47:003
606499130,12cyclictest0-21swapper/321:15:133
606499130,11cyclictest0-21swapper/323:18:163
606499130,11cyclictest0-21swapper/320:15:263
606399138,3cyclictest0-21swapper/200:20:072
606399132,6cyclictest0-21swapper/221:55:002
606399132,6cyclictest0-21swapper/220:45:002
606399132,6cyclictest0-21swapper/220:10:002
606399132,6cyclictest0-21swapper/200:35:002
606399131,3cyclictest0-21swapper/219:55:292
606399131,10cyclictest8178-21apt23:50:002
6063991310,2cyclictest12910-21sendmail23:20:002
6063991310,2cyclictest0-21swapper/222:37:272
6063991310,2cyclictest0-21swapper/222:03:572
6063991310,2cyclictest0-21swapper/221:30:102
6063991310,2cyclictest0-21swapper/221:21:472
606399130,2cyclictest0-21swapper/223:30:092
606399130,2cyclictest0-21swapper/223:10:232
606399130,12cyclictest0-21swapper/222:40:172
606399130,12cyclictest0-21swapper/221:46:472
606399130,11cyclictest0-21swapper/219:20:272
606299130,2cyclictest0-21swapper/119:12:051
606299130,11cyclictest0-21swapper/122:20:061
6061991310,2cyclictest21973-21diskmemload21:17:590
6061991310,2cyclictest15126-21kworker/u8:121:54:040
6061991310,2cyclictest12105-21ssh00:29:040
606199130,2cyclictest0-21swapper/020:55:100
606199130,2cyclictest0-21swapper/000:35:360
606199130,1cyclictest0-21swapper/020:15:100
606199130,11cyclictest29684-21ssh00:12:290
251522130,2sleep025163-21sshd00:07:360
606499122,7cyclictest0-21swapper/320:33:013
606499120,2cyclictest0-21swapper/321:50:533
606499120,2cyclictest0-21swapper/320:00:243
606499120,11cyclictest0-21swapper/323:11:053
606499120,11cyclictest0-21swapper/320:50:253
606499120,11cyclictest0-21swapper/319:40:073
606399129,2cyclictest0-21swapper/222:30:372
606399129,2cyclictest0-21swapper/222:10:152
606399129,2cyclictest0-21swapper/221:35:152
606399127,3cyclictest25744-21seq22:58:122
606399127,3cyclictest20362-21munin-node2
606399127,3cyclictest18447-21kernelversion00:00:152
606399123,5cyclictest0-21swapper/219:30:222
606399122,6cyclictest17577-21ssh23:25:002
606399121,9cyclictest4520-21cron22:20:002
606399121,9cyclictest3769-21apt-get21:25:092
606399121,9cyclictest26598-21munin-run00:10:002
606399121,9cyclictest19944-21apt-get21:05:002
606399121,9cyclictest0-21swapper/223:40:082
606399121,9cyclictest0-21swapper/219:25:132
606399121,9cyclictest0-21swapper/200:00:002
606399121,3cyclictest30401-21munin-node2
606399120,3cyclictest27065-21telnet00:10:112
606399120,3cyclictest0-21swapper/222:50:182
606399120,3cyclictest0-21swapper/220:20:242
606399120,11cyclictest0-21swapper/223:00:162
606399120,11cyclictest0-21swapper/222:08:112
606399120,11cyclictest0-21swapper/220:25:182
606399120,11cyclictest0-21swapper/219:40:062
606399120,10cyclictest19206-21taskset00:35:412
606399120,10cyclictest15173-21rm22:45:512
606299122,5cyclictest0-21swapper/120:45:001
606299120,2cyclictest0-21swapper/121:40:111
606299120,11cyclictest0-21swapper/121:51:551
606199129,2cyclictest0-21swapper/023:23:390
606199129,2cyclictest0-21swapper/023:11:180
606199129,2cyclictest0-21swapper/021:41:190
606199122,7cyclictest0-21swapper/021:47:590
606199121,10cyclictest7635-21ssh22:03:440
606199120,2cyclictest0-21swapper/023:48:580
606199120,2cyclictest0-21swapper/022:16:280
606199120,2cyclictest0-21swapper/020:00:200
606199120,11cyclictest0-21swapper/023:57:480
606199120,11cyclictest0-21swapper/023:53:080
606199120,11cyclictest0-21swapper/023:16:180
606199120,11cyclictest0-21swapper/022:55:090
606199120,11cyclictest0-21swapper/020:20:240
606199120,10cyclictest0-21swapper/023:05:000
40272120,3sleep14244-21sh22:35:091
606499118,2cyclictest0-21swapper/321:00:163
606499118,2cyclictest0-21swapper/320:45:113
606499118,2cyclictest0-21swapper/320:29:593
606499118,2cyclictest0-21swapper/320:12:163
606499118,2cyclictest0-21swapper/319:50:123
606499112,6cyclictest0-21swapper/320:05:013
606499112,6cyclictest0-21swapper/319:57:013
606499111,7cyclictest0-21swapper/320:23:583
606499111,4cyclictest0-21swapper/319:50:003
606399118,2cyclictest0-21swapper/223:35:422
606399117,2cyclictest0-21swapper/221:10:092
606399111,3cyclictest0-21swapper/222:20:082
606399111,2cyclictest0-21swapper/200:15:102
606399110,9cyclictest0-21swapper/220:15:142
606399110,9cyclictest0-21swapper/220:00:132
606399110,3cyclictest22067-21wc21:10:002
606399110,2cyclictest0-21swapper/222:26:482
606399110,2cyclictest0-21swapper/220:45:092
606199118,2cyclictest0-21swapper/023:44:590
606199118,2cyclictest0-21swapper/022:36:180
606199118,2cyclictest0-21swapper/000:23:180
606199116,3cyclictest13459-21tr21:35:100
606199116,3cyclictest0-21swapper/019:45:180
606199113,5cyclictest0-21swapper/021:34:580
606199112,5cyclictest0-21swapper/022:40:590
606199111,8cyclictest0-21swapper/022:30:000
606199110,9cyclictest0-21swapper/000:00:200
606199110,2cyclictest29768-21ssh23:37:290
606199110,1cyclictest0-21swapper/021:00:090
606199110,10cyclictest0-21swapper/023:34:590
606199110,10cyclictest0-21swapper/022:11:490
606199110,10cyclictest0-21swapper/020:40:150
606499107,2cyclictest0-21swapper/319:20:153
606499105,3cyclictest4120-21rsyslogd19:30:003
606499105,3cyclictest10487-21df_abs20:40:113
606499101,5cyclictest0-21swapper/319:10:223
606499100,7cyclictest0-21swapper/319:32:583
606399106,2cyclictest0-21swapper/219:15:102
606399100,8cyclictest0-21swapper/220:50:162
606399100,3cyclictest22386-21aten2.4-expect19:50:102
606199107,2cyclictest0-21swapper/022:46:210
606199107,2cyclictest0-21swapper/022:05:080
606199105,3cyclictest28742-21df_abs20:05:100
606199105,3cyclictest17642-21grep19:35:250
606199101,8cyclictest26159-21http20:00:000
606199100,9cyclictest0-21swapper/000:18:490
60649994,3cyclictest17058-21latency19:35:153
60619994,3cyclictest8454-21df20:35:110
60619994,3cyclictest8454-21df20:35:110
60619994,3cyclictest8353-21aten2.4_r3power19:15:100
60619994,3cyclictest6652-21fschecks_time20:30:120
60619994,3cyclictest23208-21sshd19:50:160
60619994,3cyclictest12844-21fschecks_time19:25:130
60619994,3cyclictest12445-21cpuspeed_turbos20:45:100
60619992,5cyclictest8052-21cron19:15:000
60619984,2cyclictest14352-21telnet19:30:090
60619983,3cyclictest5015-21cut20:25:180
60619983,3cyclictest30845-21grep20:10:120
60619983,3cyclictest20698-21tune2fs21:05:120
60619983,3cyclictest14202-21cut20:50:090
60619983,3cyclictest11428-21mailstats19:20:280
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional