You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-26 - 11:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack3slot6s.osadl.org (updated Fri Apr 26, 2024 00:43:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
34132122111,6sleep30-21swapper/319:06:323
36212115104,6sleep00-21swapper/019:09:110
3618210695,6sleep20-21swapper/219:09:092
3381210686,14sleep10-21swapper/119:06:071
314092810,0sleep10-21swapper/121:21:201
371599340,24cyclictest0-21swapper/322:00:103
3713992824,2cyclictest0-21swapper/122:45:121
321192250,0sleep20-21swapper/221:22:302
371499222,6cyclictest0-21swapper/223:40:002
194752220,0sleep30-21swapper/322:54:103
371499211,2cyclictest0-21swapper/220:10:102
371499210,4cyclictest0-21swapper/223:14:052
3714992017,2cyclictest15765-21kworker/u8:100:37:052
3714992014,1cyclictest0-21swapper/200:20:082
3713992017,2cyclictest14659-21kworker/u8:022:26:051
3714991916,2cyclictest6377-21kworker/u8:222:52:052
3714991916,2cyclictest17832-21kworker/u8:200:03:052
3714991916,2cyclictest0-21swapper/223:25:102
3713991916,2cyclictest10611-21kworker/u8:000:38:041
3713991916,2cyclictest10247-21kworker/u8:023:24:041
371299190,18cyclictest0-21swapper/022:00:100
3714991815,2cyclictest5641-21kworker/u8:121:35:052
3714991815,2cyclictest3214-21kworker/u8:022:07:042
3714991815,2cyclictest3214-21kworker/u8:022:01:052
3714991815,2cyclictest27157-21kworker/u8:122:27:042
3714991815,2cyclictest20413-21kworker/u8:222:32:042
3714991815,2cyclictest14130-21kworker/u8:020:06:052
371599171,14cyclictest15226-21sendmail-msp21:40:013
3714991714,2cyclictest6377-21kworker/u8:222:45:052
3714991714,2cyclictest3997-21kworker/u8:119:28:052
3714991714,2cyclictest22952-21kworker/u8:000:19:052
3714991714,2cyclictest20354-21kworker/u8:223:49:032
3714991714,2cyclictest14659-21kworker/u8:022:16:052
3714991714,2cyclictest11659-21kworker/u8:021:52:052
3714991714,2cyclictest10247-21kworker/u8:023:32:042
371499170,12cyclictest0-21swapper/222:22:042
3713991714,2cyclictest12098-21kworker/u8:221:31:041
313662170,2sleep123-21ksoftirqd/123:05:551
371599160,14cyclictest0-21swapper/319:15:003
3714991613,2cyclictest3860-21kworker/u8:121:04:042
3714991613,2cyclictest28349-21kworker/u8:220:30:052
3714991613,2cyclictest1357-21kworker/u8:019:13:052
3714991613,2cyclictest1211-21kworker/u8:020:24:042
3714991613,2cyclictest1178-21kworker/u8:023:55:042
3714991613,2cyclictest11659-21kworker/u8:021:46:052
3714991613,2cyclictest10176-21kworker/u8:219:37:042
371499160,4cyclictest0-21swapper/223:38:052
371499160,12cyclictest0-21swapper/220:56:052
371499160,12cyclictest0-21swapper/220:46:042
371499160,11cyclictest0-21swapper/223:16:052
371399160,2cyclictest0-21swapper/120:55:121
371599150,13cyclictest10673-21munin-run22:09:593
371599150,13cyclictest0-21swapper/300:16:403
3714991512,2cyclictest439-21kworker/u8:023:02:052
3714991512,2cyclictest28349-21kworker/u8:220:28:052
3714991512,2cyclictest22952-21kworker/u8:000:10:042
3714991512,2cyclictest14130-21kworker/u8:020:03:042
3714991512,2cyclictest14130-21kworker/u8:019:57:032
3714991512,2cyclictest10176-21kworker/u8:219:34:042
371499150,3cyclictest0-21swapper/221:20:002
371399151,3cyclictest30606-21sh00:15:221
3713991512,2cyclictest11659-21kworker/u8:021:51:051
3713991512,2cyclictest10611-21kworker/u8:000:30:051
371399151,12cyclictest24109-21ssh21:14:401
371399150,2cyclictest0-21swapper/121:35:351
371399150,2cyclictest0-21swapper/121:17:051
371299151,12cyclictest5095-21runrttasks23:46:590
18272150,3sleep10-21swapper/100:20:111
3715991411,2cyclictest0-21swapper/323:39:203
371599140,3cyclictest0-21swapper/321:16:163
371599140,2cyclictest0-21swapper/320:20:123
371599140,13cyclictest0-21swapper/323:29:503
371599140,12cyclictest2893-21sed21:25:303
371599140,12cyclictest0-21swapper/323:49:553
371599140,12cyclictest0-21swapper/321:40:203
371499149,3cyclictest31790-21ssh23:06:372
371499149,3cyclictest0-21swapper/222:38:302
3714991411,2cyclictest29054-21kworker/u8:200:25:042
371499140,3cyclictest0-21swapper/223:24:422
371499140,3cyclictest0-21swapper/200:33:482
371499140,2cyclictest0-21swapper/222:13:052
371499140,2cyclictest0-21swapper/221:44:342
371499140,2cyclictest0-21swapper/221:10:052
371499140,12cyclictest0-21swapper/221:57:012
371399149,3cyclictest0-21swapper/122:01:551
3713991411,2cyclictest12098-21kworker/u8:221:25:041
3713991411,2cyclictest0-21swapper/122:09:041
371399140,12cyclictest6767-21df_abs23:15:121
371399140,12cyclictest3227-21ssh22:35:291
371399140,12cyclictest19760-21diskmemload22:41:031
371399140,12cyclictest19760-21diskmemload00:10:271
371299140,12cyclictest19760-21diskmemload23:08:440
371599139,2cyclictest0-21swapper/300:37:253
3715991310,2cyclictest3859-21ssh23:11:303
3715991310,2cyclictest0-21swapper/323:42:403
3715991310,2cyclictest0-21swapper/323:15:113
3715991310,2cyclictest0-21swapper/322:10:203
3715991310,2cyclictest0-21swapper/321:52:473
3715991310,2cyclictest0-21swapper/321:30:293
3715991310,2cyclictest0-21swapper/321:00:153
3715991310,2cyclictest0-21swapper/320:25:183
3715991310,2cyclictest0-21swapper/320:15:173
371599130,2cyclictest0-21swapper/323:57:593
371599130,2cyclictest0-21swapper/300:10:493
371599130,2cyclictest0-21swapper/300:05:533
371599130,12cyclictest31183-21ssh21:55:493
371599130,12cyclictest0-21swapper/323:51:053
371599130,12cyclictest0-21swapper/322:30:253
371599130,12cyclictest0-21swapper/322:25:103
371599130,12cyclictest0-21swapper/320:45:233
371599130,12cyclictest0-21swapper/300:25:143
371599130,11cyclictest19760-21diskmemload23:06:113
371599130,11cyclictest19760-21diskmemload23:02:293
371599130,11cyclictest0-21swapper/321:46:443
371499131,6cyclictest0-21swapper/219:45:002
3714991310,2cyclictest0-21swapper/222:43:302
3714991310,2cyclictest0-21swapper/219:50:122
3714991310,2cyclictest0-21swapper/200:05:012
371499130,2cyclictest0-21swapper/222:55:402
371499130,2cyclictest0-21swapper/221:30:042
371499130,11cyclictest0-21swapper/220:50:262
371399139,2cyclictest0-21swapper/120:50:241
371399132,7cyclictest0-21swapper/120:46:261
371399132,6cyclictest0-21swapper/122:10:001
371399132,6cyclictest0-21swapper/119:45:001
371399131,9cyclictest19760-21diskmemload23:31:561
3713991310,2cyclictest439-21kworker/u8:023:03:051
3713991310,2cyclictest20413-21kworker/u8:222:24:041
3713991310,2cyclictest0-21swapper/122:59:081
3713991310,2cyclictest0-21swapper/122:50:311
3713991310,2cyclictest0-21swapper/122:31:061
3713991310,2cyclictest0-21swapper/121:56:361
3713991310,2cyclictest0-21swapper/120:20:161
3713991310,2cyclictest0-21swapper/119:50:161
371399130,2cyclictest0-21swapper/123:45:081
371399130,2cyclictest0-21swapper/123:29:371
371399130,12cyclictest0-21swapper/123:53:221
371399130,12cyclictest0-21swapper/121:05:151
371399130,12cyclictest0-21swapper/121:05:141
371399130,12cyclictest0-21swapper/100:27:571
371299132,6cyclictest0-21swapper/020:55:000
3712991310,2cyclictest19760-21diskmemload23:28:550
3712991310,2cyclictest0-21swapper/023:15:360
3712991310,2cyclictest0-21swapper/000:10:030
3712991310,2cyclictest0-21swapper/000:00:210
371299130,2cyclictest19760-21diskmemload00:20:180
371299130,2cyclictest0-21swapper/023:55:150
371299130,2cyclictest0-21swapper/022:08:130
371299130,12cyclictest0-21swapper/023:50:100
371299130,12cyclictest0-21swapper/023:31:560
371299130,11cyclictest18533-21fschecks_time21:05:140
371299130,11cyclictest18533-21fschecks_time21:05:140
371299130,11cyclictest0-21swapper/023:39:330
371299130,11cyclictest0-21swapper/022:51:220
371299130,11cyclictest0-21swapper/019:10:120
371299130,11cyclictest0-21swapper/000:30:330
35742130,2sleep30-21swapper/322:36:033
371599129,2cyclictest0-21swapper/322:20:333
371599129,2cyclictest0-21swapper/322:16:083
371599129,2cyclictest0-21swapper/320:55:123
371599129,2cyclictest0-21swapper/319:15:133
371599129,2cyclictest0-21swapper/300:00:063
371599123,6cyclictest0-21swapper/320:31:233
371599122,5cyclictest0-21swapper/319:24:593
371599120,2cyclictest0-21swapper/322:45:023
371599120,2cyclictest0-21swapper/320:40:113
371599120,2cyclictest0-21swapper/319:45:223
371599120,11cyclictest0-21swapper/323:30:183
371599120,11cyclictest0-21swapper/323:20:293
371599120,11cyclictest0-21swapper/322:55:253
371599120,11cyclictest0-21swapper/322:40:043
371599120,11cyclictest0-21swapper/321:21:153
371599120,11cyclictest0-21swapper/321:10:153
371599120,11cyclictest0-21swapper/320:50:173
371599120,11cyclictest0-21swapper/300:20:103
371599120,10cyclictest12572-21ssh00:30:323
371499121,9cyclictest0-21swapper/221:25:302
371499121,3cyclictest6468-21dpkg23:50:092
371499121,3cyclictest0-21swapper/220:35:122
371499120,2cyclictest0-21swapper/220:19:042
371499120,2cyclictest0-21swapper/219:20:252
371499120,11cyclictest0-21swapper/220:40:122
371499120,10cyclictest0-21swapper/221:05:132
371499120,10cyclictest0-21swapper/221:05:122
371399129,2cyclictest0-21swapper/123:55:481
371399129,2cyclictest0-21swapper/121:45:091
371399129,2cyclictest0-21swapper/100:05:131
371399129,2cyclictest0-21swapper/100:00:111
371399120,2cyclictest0-21swapper/122:15:121
371399120,2cyclictest0-21swapper/120:25:171
371399120,2cyclictest0-21swapper/120:10:061
371399120,2cyclictest0-21swapper/120:00:271
371399120,2cyclictest0-21swapper/119:40:161
371399120,2cyclictest0-21swapper/119:15:271
371399120,11cyclictest0-21swapper/123:40:581
371399120,11cyclictest0-21swapper/123:10:181
371399120,11cyclictest0-21swapper/121:40:021
371399120,11cyclictest0-21swapper/119:55:161
371399120,11cyclictest0-21swapper/119:35:201
371299129,2cyclictest0-21swapper/023:20:340
371299129,2cyclictest0-21swapper/021:44:350
371299129,2cyclictest0-21swapper/000:25:430
371299127,3cyclictest31287-21sensors_temp20:15:260
371299122,7cyclictest0-21swapper/022:26:590
371299122,6cyclictest0-21swapper/022:35:240
371299122,6cyclictest0-21swapper/021:40:010
371299122,5cyclictest0-21swapper/020:04:590
371299121,6cyclictest19760-21diskmemload22:24:590
371299120,7cyclictest0-21swapper/021:10:010
371299120,2cyclictest0-21swapper/023:40:260
371299120,2cyclictest0-21swapper/023:11:310
371299120,2cyclictest0-21swapper/022:43:040
371299120,2cyclictest0-21swapper/022:17:360
371299120,2cyclictest0-21swapper/021:17:200
371299120,2cyclictest0-21swapper/000:35:100
371299120,2cyclictest0-21swapper/000:15:010
371299120,2cyclictest0-21swapper/000:05:190
371299120,11cyclictest0-21swapper/023:02:560
266712120,2sleep10-21swapper/123:35:501
128602120,2sleep00-21swapper/022:10:580
371599112,5cyclictest28053-21copy20:10:013
371599112,5cyclictest0-21swapper/319:56:143
371599111,6cyclictest0-21swapper/319:55:003
371499112,6cyclictest0-21swapper/219:20:002
371499111,8cyclictest0-21swapper/219:45:112
371399118,2cyclictest20177-21kworker/u8:120:17:051
371399118,2cyclictest0-21swapper/120:40:251
371399110,2cyclictest0-21swapper/120:36:491
371399110,10cyclictest0-21swapper/121:02:361
371299118,2cyclictest0-21swapper/019:45:160
371299116,3cyclictest222572sleep021:46:250
371299112,5cyclictest0-21swapper/022:30:310
371299110,9cyclictest19760-21diskmemload22:45:460
371299110,9cyclictest19760-21diskmemload21:32:300
371299110,10cyclictest0-21swapper/022:58:470
318092110,1sleep00-21swapper/021:22:000
371599107,2cyclictest0-21swapper/320:00:253
371599103,3cyclictest5673-21gnome-session20:35:043
371599100,2cyclictest32647-21snmpd21:06:303
371599100,2cyclictest32647-21snmpd21:06:293
371399107,2cyclictest3997-21kworker/u8:119:23:041
371399107,2cyclictest10176-21kworker/u8:219:32:051
371399105,3cyclictest4225-21nscd19:25:131
371399105,3cyclictest26182-21aten2.4-expect20:05:131
371399101,6cyclictest0-21swapper/119:11:061
371299107,2cyclictest0-21swapper/020:25:110
371299105,3cyclictest9967-21munin-node0
371299105,3cyclictest500-21sh21:58:460
371299105,3cyclictest4876-21Xorg19:19:590
371299105,3cyclictest27934-21ssh21:53:080
371299105,3cyclictest22291-21aten2.4-expect19:55:120
371299102,6cyclictest0-21swapper/019:20:280
371299102,5cyclictest0-21swapper/020:30:280
371299101,7cyclictest1617-21aten2.4-expect21:25:120
371299100,8cyclictest0-21swapper/021:00:010
371299100,3cyclictest6364-21fschecks_count20:35:130
37159996,2cyclictest0-21swapper/320:13:503
37159996,2cyclictest0-21swapper/319:25:153
37159994,3cyclictest16434-21cut19:40:133
37159994,3cyclictest0-21swapper/319:35:283
37139996,2cyclictest1211-21kworker/u8:020:33:051
37129995,2cyclictest32468-21grep20:20:130
37129994,3cyclictest4409-21lldpd20:06:030
37129994,3cyclictest28255-21aten2.4_r3power20:10:110
37129994,3cyclictest14351-21tr19:35:120
37129994,3cyclictest13359-21timerandwakeup19:30:350
37129994,3cyclictest11884-21cron19:30:000
37129992,5cyclictest0-21swapper/020:42:070
37129990,2cyclictest0-21swapper/019:50:040
37159983,3cyclictest11888-21apt-get19:30:063
37129985,2cyclictest0-21swapper/019:40:120
37129981,4cyclictest16278-21tr21:00:140
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional