You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-09-30 - 12:44

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Sat Sep 30, 2023 00:43:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
65188212072,36sleep30-21swapper/319:06:073
63636211271,35sleep10-21swapper/119:05:051
65475210967,18sleep00-21swapper/019:09:450
65252210360,17sleep20-21swapper/219:06:542
65665996463,1cyclictest227627-21sensors23:25:293
65665996362,1cyclictest1036-21snmpd19:29:433
6566599620,1cyclictest0-21swapper/323:20:273
6565899620,62cyclictest0-21swapper/100:21:221
6565599620,62cyclictest0-21swapper/022:00:280
6566599610,60cyclictest0-21swapper/323:30:263
6566599610,60cyclictest0-21swapper/320:39:563
65663996059,1cyclictest276317-21sensors00:25:262
65655996059,1cyclictest195118-21sensors22:45:280
65658995958,1cyclictest84263-21sensors19:50:301
65663995857,1cyclictest0-21swapper/200:11:202
65658995857,1cyclictest69666-21sensors19:15:301
6565899580,1cyclictest0-21swapper/122:35:291
6565899580,1cyclictest0-21swapper/121:50:261
65655995857,1cyclictest182903-21sensors22:30:250
65655995857,1cyclictest113485-21sensors21:00:290
65655995857,1cyclictest0-21swapper/021:20:260
6566599579,40cyclictest0-21swapper/322:51:193
65663995756,1cyclictest195126-21sensors22:45:282
65658995756,1cyclictest121911-21sensors21:15:291
65655995756,1cyclictest207303-21sensors23:00:270
65655995756,1cyclictest0-21swapper/021:10:260
65665995655,1cyclictest1036-21snmpd20:54:593
65663995654,1cyclictest82173-21sensors19:45:282
65658995655,1cyclictest0-21swapper/123:30:291
65658995554,1cyclictest162579-21sensors22:05:261
65663995450,4cyclictest0-21swapper/200:15:292
65665995352,1cyclictest247889-21sensors23:50:283
65665995352,1cyclictest0-21swapper/300:05:293
65663995352,1cyclictest134099-21sensors21:30:262
65663995352,1cyclictest0-21swapper/200:30:262
65655995352,1cyclictest0-21swapper/022:40:260
65665995251,1cyclictest142215-21sensors21:40:253
65665995251,1cyclictest142215-21sensors21:40:253
65665995251,1cyclictest107232-21sensors20:45:323
65663995150,1cyclictest96788-21sensors20:20:282
65663995150,1cyclictest0-21swapper/221:20:262
65658995149,1cyclictest182014-21diskstats22:30:171
65655995150,1cyclictest75919-21sensors19:30:270
65665995049,1cyclictest0-21swapper/320:44:583
65658995048,1cyclictest80084-21sensors19:40:261
65655995049,1cyclictest88442-21sensors20:00:300
65663994948,1cyclictest0-21swapper/200:35:252
65655994948,1cyclictest235720-21sensors23:35:280
65663994846,2cyclictest0-21swapper/221:25:272
65658994847,1cyclictest219497-21sensors23:15:291
65655994847,1cyclictest0-21swapper/021:35:270
65655994847,1cyclictest0-21swapper/020:25:280
65665994746,1cyclictest0-21swapper/322:30:253
65655994746,1cyclictest0-21swapper/022:15:290
65658994645,1cyclictest117836-21sensors21:10:261
65658994544,1cyclictest166665-21sensors22:10:301
65658994544,1cyclictest1036-21snmpd20:14:531
65658994443,1cyclictest94712-21sensors20:15:311
65655994443,1cyclictest80090-21sensors19:40:270
65655994443,1cyclictest1036-21snmpd21:55:120
65665994342,1cyclictest0-21swapper/322:10:293
65655994342,1cyclictest215400-21sensors23:10:230
65655994342,1cyclictest146303-21sensors21:45:260
65665994241,1cyclictest94706-21sensors20:15:303
65658994241,1cyclictest107227-21sensors20:45:311
65658994241,1cyclictest0-21swapper/119:55:271
65665994140,1cyclictest1036-21snmpd00:36:253
65665994140,1cyclictest0-21swapper/322:40:193
65663994140,1cyclictest0-21swapper/222:25:302
65658994140,1cyclictest1036-21snmpd21:45:091
65665994039,1cyclictest272297-21sensors00:20:303
65663994039,1cyclictest93013-21kworker/2:121:08:062
65663994038,1cyclictest111394-21sensors20:55:292
65655994039,1cyclictest0-21swapper/023:05:290
65665993938,1cyclictest0-21swapper/320:30:293
65663993938,1cyclictest61270-21kworker/2:219:27:452
65663993938,1cyclictest249493-21kworker/2:200:00:282
65658993937,1cyclictest178864-21sensors22:25:301
65655993938,1cyclictest134091-21sensors21:30:270
65663993837,1cyclictest61270-21kworker/2:220:03:552
65655993837,1cyclictest272291-21sensors00:20:300
65655993837,1cyclictest0-21swapper/022:50:260
65665993736,1cyclictest219507-21sensors23:15:293
65663993736,1cyclictest61270-21kworker/2:219:12:442
65663993733,4cyclictest93013-21kworker/2:120:34:082
65655993736,1cyclictest1036-21snmpd22:35:180
65663993635,1cyclictest93013-21kworker/2:121:13:342
65663993635,1cyclictest187001-21sensors22:35:292
65658993635,1cyclictest1036-21snmpd00:31:241
65665993534,1cyclictest1036-21snmpd19:19:413
65663993534,1cyclictest93013-21kworker/2:122:12:172
65663993534,1cyclictest93013-21kworker/2:120:17:552
65655993433,1cyclictest0-21swapper/022:25:290
65663993311,22cyclictest0-21swapper/219:36:202
65658993332,1cyclictest0-21swapper/121:55:281
65663993231,1cyclictest227171-21kworker/2:123:54:202
65663993231,1cyclictest200170-21kworker/2:223:20:322
65663993231,1cyclictest167653-21kworker/2:022:16:012
65655993231,1cyclictest0-21swapper/021:05:250
65663993130,1cyclictest93013-21kworker/2:121:58:172
65663993130,1cyclictest93013-21kworker/2:121:04:102
65658993130,1cyclictest247893-21sensors23:50:281
65655993130,1cyclictest82179-21sensors19:45:280
65655993130,1cyclictest0-21swapper/020:15:310
65665993029,1cyclictest0-21swapper/300:16:213
65663993030,0cyclictest61270-21kworker/2:219:30:182
65663993026,1cyclictest176167-21kworker/2:122:24:332
65658993029,1cyclictest0-21swapper/119:45:281
165999300,2ntpd14-21ksoftirqd/020:57:560
65665992928,1cyclictest84265-21sensors19:50:303
65665992928,1cyclictest0-21swapper/322:55:273
65663992928,1cyclictest61270-21kworker/2:219:55:242
65663992928,1cyclictest200170-21kworker/2:223:19:312
65663992928,1cyclictest200170-21kworker/2:223:04:302
65663992928,1cyclictest0-21swapper/223:40:262
65663992928,1cyclictest0-21swapper/221:45:262
65663992928,1cyclictest0-21swapper/221:35:062
65655992928,1cyclictest0-21swapper/021:15:290
65655992928,1cyclictest0-21swapper/020:05:250
65663992827,1cyclictest93013-21kworker/2:120:47:062
65658992827,1cyclictest0-21swapper/120:24:531
165999280,2ntpd14-21ksoftirqd/019:29:380
65665992726,1cyclictest0-21swapper/323:40:313
6566599270,4cyclictest0-21swapper/320:01:423
65663992726,1cyclictest249493-21kworker/2:223:57:552
65663992726,1cyclictest227171-21kworker/2:123:49:132
65663992726,1cyclictest227171-21kworker/2:123:39:192
165999270,2ntpd14-21ksoftirqd/020:40:050
65665992625,1cyclictest251959-21sensors23:55:303
65665992625,1cyclictest0-21swapper/319:49:473
65663992625,1cyclictest93013-21kworker/2:121:54:112
65663992625,1cyclictest93013-21kworker/2:121:16:382
65663992625,1cyclictest93013-21kworker/2:120:52:342
65663992625,1cyclictest200170-21kworker/2:223:10:482
65663992625,1cyclictest0-21swapper/220:35:282
65663992625,1cyclictest0-21swapper/200:06:192
6565899260,25cyclictest0-21swapper/100:12:191
65663992524,1cyclictest195847-21kworker/2:022:50:502
65663992523,1cyclictest176167-21kworker/2:122:30:212
65658992524,1cyclictest0-21swapper/120:35:281
6565899250,25cyclictest0-21swapper/123:14:091
65655992521,1cyclictest280567-21ls00:30:290
6565599250,25cyclictest0-21swapper/020:34:410
65663992423,1cyclictest93013-21kworker/2:122:00:192
65658992423,1cyclictest0-21swapper/123:40:261
65663992322,1cyclictest61270-21kworker/2:219:42:572
65663992318,5cyclictest93013-21kworker/2:122:07:192
65655992322,1cyclictest174797-21sensors22:20:280
65655992322,1cyclictest109309-21sensors20:50:280
165999230,2ntpd14-21ksoftirqd/022:09:150
165999230,2ntpd14-21ksoftirqd/019:11:480
165999230,2ntpd14-21ksoftirqd/000:12:110
65665992221,1cyclictest1036-21snmpd21:05:013
65663992221,1cyclictest93013-21kworker/2:121:41:342
65663992221,1cyclictest93013-21kworker/2:121:41:332
65663992221,1cyclictest200170-21kworker/2:222:59:332
65663992221,1cyclictest176167-21kworker/2:122:42:402
165999220,2ntpd14-21ksoftirqd/023:55:050
165999220,2ntpd14-21ksoftirqd/023:20:060
65663992111,10cyclictest0-21swapper/223:07:502
65663992019,1cyclictest61270-21kworker/2:219:50:272
65663992019,1cyclictest61270-21kworker/2:219:19:332
65655992019,1cyclictest150364-21sensors21:50:260
6566599190,4cyclictest0-21swapper/319:57:493
65663991918,1cyclictest61270-21kworker/2:220:11:472
65663991918,1cyclictest61270-21kworker/2:220:07:412
65663991918,1cyclictest61270-21kworker/2:219:21:472
65663991918,1cyclictest258219-21kworker/2:100:20:162
65663991918,1cyclictest227171-21kworker/2:123:32:292
65663991918,1cyclictest227171-21kworker/2:123:29:142
6565599190,4cyclictest0-21swapper/019:16:520
6565599190,4cyclictest0-21swapper/000:07:340
6565599190,4cyclictest0-21swapper/000:01:040
6566599180,18cyclictest0-21swapper/321:32:573
65663991817,1cyclictest93013-21kworker/2:120:28:102
65658991817,1cyclictest0-21swapper/123:25:291
6565899180,17cyclictest0-21swapper/121:35:191
6565899180,17cyclictest0-21swapper/100:07:311
65665991716,1cyclictest0-21swapper/321:50:103
65665991716,1cyclictest0-21swapper/320:25:293
6566599170,17cyclictest0-21swapper/323:10:203
6565899177,10cyclictest0-21swapper/123:03:021
65658991716,1cyclictest0-21swapper/120:30:291
65658991714,2cyclictest1036-21snmpd22:18:221
6565899170,17cyclictest0-21swapper/122:01:281
6565899170,17cyclictest0-21swapper/100:26:591
6565899170,16cyclictest0-21swapper/122:49:501
6565899170,16cyclictest0-21swapper/121:03:271
6565899170,16cyclictest0-21swapper/120:25:231
6565899170,16cyclictest0-21swapper/120:08:541
6565899170,16cyclictest0-21swapper/119:22:471
6565599170,17cyclictest0-21swapper/023:26:480
65665991613,2cyclictest1036-21snmpd23:36:543
65665991613,2cyclictest1036-21snmpd21:45:213
6566599160,16cyclictest0-21swapper/322:02:103
6566599160,16cyclictest0-21swapper/321:59:133
6565899160,1cyclictest0-21swapper/123:39:331
6565899160,16cyclictest0-21swapper/120:40:411
6565599160,7cyclictest0-21swapper/023:19:480
6565599160,16cyclictest0-21swapper/023:44:000
6565599160,16cyclictest0-21swapper/019:56:190
65665991514,1cyclictest1036-21snmpd23:05:243
6566599150,6cyclictest0-21swapper/321:14:573
6566599150,6cyclictest0-21swapper/320:14:103
6566599150,1cyclictest0-21swapper/319:40:243
65663991514,1cyclictest93013-21kworker/2:120:41:502
65658991514,1cyclictest75917-21sensors19:30:271
65658991513,1cyclictest78710-21munin-run19:40:001
6565899150,7cyclictest0-21swapper/122:50:051
6565899150,7cyclictest0-21swapper/122:21:071
6565899150,6cyclictest0-21swapper/121:27:121
6565899150,6cyclictest0-21swapper/121:05:291
65655991512,2cyclictest1036-21snmpd21:40:160
65655991512,2cyclictest1036-21snmpd21:40:150
6565599150,7cyclictest0-21swapper/023:31:230
6565599150,7cyclictest0-21swapper/022:14:370
6565599150,7cyclictest0-21swapper/020:36:130
6566599144,10cyclictest0-21swapper/321:02:533
65665991413,1cyclictest1036-21snmpd22:05:133
6566599140,6cyclictest0-21swapper/321:26:343
1813272140,0sleep30-21swapper/322:29:563
6566599129,2cyclictest1036-21snmpd21:38:243
65665991211,1cyclictest1036-21snmpd23:02:503
6566599120,12cyclictest0-21swapper/322:37:483
6565899129,2cyclictest202770-21cat22:55:201
65658991211,1cyclictest0-21swapper/121:40:261
65658991211,1cyclictest0-21swapper/121:40:251
6565899120,11cyclictest134-21kswapd023:22:481
6565599129,2cyclictest1036-21snmpd19:20:110
6566599119,2cyclictest1036-21snmpd21:24:273
6566599119,2cyclictest1036-21snmpd19:38:213
6566599118,2cyclictest1036-21snmpd00:10:493
6566599114,4cyclictest71568-21ntp_kernel_pll_19:20:263
65665991110,1cyclictest1036-21snmpd20:08:373
6565899119,2cyclictest1036-21snmpd23:49:031
6565899119,1cyclictest1036-21snmpd20:59:091
6565899119,1cyclictest1036-21snmpd00:38:141
6565899119,1cyclictest1026-21nmbd21:30:281
6565899118,2cyclictest1036-21snmpd19:11:141
6565899110,10cyclictest0-21swapper/121:20:411
6565899110,10cyclictest0-21swapper/100:15:231
6565599119,2cyclictest1036-21snmpd23:47:250
6565599119,1cyclictest1036-21snmpd22:55:320
6565599119,1cyclictest1036-21snmpd20:45:590
6565599119,1cyclictest1036-21snmpd00:37:530
6565599118,2cyclictest77567-21cat19:35:210
6566599100,5cyclictest0-21swapper/322:22:403
6566599100,1cyclictest0-21swapper/300:03:373
6566599100,10cyclictest0-21swapper/322:17:073
6566599100,10cyclictest0-21swapper/320:59:213
6566599100,10cyclictest0-21swapper/320:21:253
6566599100,10cyclictest0-21swapper/300:31:463
6565899109,1cyclictest251966-21sensors23:55:301
6565899107,2cyclictest1036-21snmpd23:05:291
6565899100,10cyclictest0-21swapper/122:42:171
6565899100,10cyclictest0-21swapper/100:02:511
6565599109,1cyclictest0-21swapper/023:50:250
6565599100,10cyclictest0-21swapper/021:25:030
6565599100,10cyclictest0-21swapper/020:12:370
6565599100,10cyclictest0-21swapper/019:50:350
6565599100,10cyclictest0-21swapper/000:27:470
165999100,1ntpd14-21ksoftirqd/000:17:400
656659990,9cyclictest0-21swapper/323:46:183
656659990,9cyclictest0-21swapper/321:18:593
656659990,4cyclictest0-21swapper/319:31:143
656589996,2cyclictest1036-21snmpd20:53:441
656559997,1cyclictest1026-21nmbd20:21:270
656659986,2cyclictest1036-21snmpd22:48:173
656589986,2cyclictest1036-21snmpd20:01:511
16599980,1ntpd276113-21ntpq00:25:233
656659973,4cyclictest0-21swapper/319:11:023
656589970,6cyclictest74046-21sed19:25:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional