You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-03-03 - 21:23

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack0slot7s.osadl.org (updated Sun Mar 03, 2024 00:43:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2728794212187,24sleep30-21swapper/319:06:233
2728006211770,19sleep10-21swapper/119:05:251
2728845211066,34sleep20-21swapper/219:07:022
2728892210466,32sleep00-21swapper/019:07:360
272923799979,40cyclictest0-21swapper/323:43:583
272923299681,66cyclictest2847208-21/usr/sbin/munin00:05:312
2729225996564,1cyclictest2762575-21sensors20:30:310
2729225996361,1cyclictest2323729-21snmpd19:54:420
2729232996261,1cyclictest0-21swapper/200:15:232
2729232996260,2cyclictest2799955-21cat22:05:192
2729228996260,1cyclictest2323729-21snmpd20:09:431
2729232996160,1cyclictest0-21swapper/219:10:282
272923299610,60cyclictest391rcuc/219:20:282
272923299600,59cyclictest0-21swapper/220:20:522
2729232995958,1cyclictest2792965-21sensors21:45:322
2729232995958,1cyclictest0-21swapper/200:35:202
2729232995957,1cyclictest2796724-21ntpq21:55:252
2729228995957,1cyclictest0-21swapper/120:39:491
2729228995856,1cyclictest2323729-21snmpd21:19:551
272922899580,57cyclictest0-21swapper/120:44:511
2729225995857,1cyclictest2771078-21kworker/0:1+events22:45:360
2729225995857,1cyclictest2745522-21kworker/0:2+events20:22:340
171399580,51ntpd0-21swapper/320:55:333
2729237995755,1cyclictest2752706-21sensors20:05:293
2729237995755,1cyclictest0-21swapper/321:25:273
2729232995757,0cyclictest0-21swapper/200:25:372
2729232995756,1cyclictest0-21swapper/223:15:482
2729232995756,1cyclictest0-21swapper/220:40:302
2729232995754,2cyclictest2812200-21/usr/sbin/munin22:35:212
2729228995755,1cyclictest0-21swapper/123:50:281
2729225995756,1cyclictest2745522-21kworker/0:2+events20:35:220
2729225995756,1cyclictest2715294-21kworker/0:0+events19:20:280
2729225995755,1cyclictest2323729-21snmpd19:10:290
2729237995655,1cyclictest0-21swapper/321:20:273
2729237995654,1cyclictest0-21swapper/321:10:293
2729232995655,1cyclictest0-21swapper/223:30:212
2729232995655,0cyclictest0-21swapper/220:30:292
2729228995654,1cyclictest2814664-21sensors22:40:281
2729225995654,1cyclictest2771078-21kworker/0:1+events22:05:190
2729237995554,1cyclictest2323729-21snmpd21:39:583
2729237995554,1cyclictest0-21swapper/320:25:303
2729237995553,1cyclictest2323729-21snmpd22:30:093
2729232995554,1cyclictest0-21swapper/222:52:252
2729232995553,1cyclictest2822393-21ntpq23:00:262
2729232995553,1cyclictest2748597-21ntpq19:55:262
2729228995553,1cyclictest0-21swapper/122:20:271
2729225995555,0cyclictest0-21swapper/000:15:230
2729237995453,1cyclictest0-21swapper/321:50:283
2729237995453,1cyclictest0-21swapper/320:45:283
2729237995452,1cyclictest2858119-21sensors00:30:363
2729237995452,1cyclictest2814666-21sensors22:40:273
2729232995453,1cyclictest2688212-21kworker/u8:1+flush-8:021:05:252
2729232995453,1cyclictest0-21swapper/221:30:202
2729232995453,1cyclictest0-21swapper/220:45:232
2729232995453,1cyclictest0-21swapper/200:00:212
2729232995452,2cyclictest0-21swapper/219:16:222
2729232995451,2cyclictest2833037-21chrt23:28:572
2729232995451,2cyclictest2833037-21chrt23:28:572
2729228995452,1cyclictest2854171-21sensors00:20:391
2729228995452,1cyclictest2729122-21kworker/1:2+events_power_efficient19:42:551
2729225995452,1cyclictest2771078-21kworker/0:1+events21:45:310
2729225995452,1cyclictest2771078-21kworker/0:1+events00:35:200
2729232995353,0cyclictest0-21swapper/221:20:272
2729232995353,0cyclictest0-21swapper/219:39:452
2729232995352,1cyclictest0-21swapper/223:35:572
2729232995352,1cyclictest0-21swapper/223:20:242
2729232995352,1cyclictest0-21swapper/222:15:332
2729232995352,1cyclictest0-21swapper/222:10:572
2729232995352,0cyclictest0-21swapper/220:35:322
2729232995351,1cyclictest2777890-21kworker/2:0-events21:25:232
2729225995351,1cyclictest2771078-21kworker/0:1+events23:15:480
2729225995351,1cyclictest2771078-21kworker/0:1+events21:55:250
2729232995251,1cyclictest0-21swapper/223:55:232
2729232995251,1cyclictest0-21swapper/223:50:272
2729232995251,1cyclictest0-21swapper/223:45:092
2729232995251,1cyclictest0-21swapper/222:42:212
2729232995251,1cyclictest0-21swapper/221:15:292
2729232995251,1cyclictest0-21swapper/221:04:542
2729232995251,1cyclictest0-21swapper/220:55:512
2729232995251,1cyclictest0-21swapper/220:15:032
2729232995251,1cyclictest0-21swapper/220:10:482
2729232995251,1cyclictest0-21swapper/220:06:522
2729232995251,1cyclictest0-21swapper/220:01:562
2729232995251,1cyclictest0-21swapper/219:52:522
2729232995251,1cyclictest0-21swapper/219:33:572
2729232995251,1cyclictest0-21swapper/200:10:452
2729232995250,1cyclictest945-21NetworkManager22:32:272
2729228995251,1cyclictest2796907-21sensors21:55:281
2729225995251,1cyclictest2745522-21kworker/0:2+events20:40:300
2729232995151,0cyclictest0-21swapper/222:55:192
2729232995150,1cyclictest0-21swapper/223:40:532
2729232995150,1cyclictest0-21swapper/223:05:132
2729232995150,1cyclictest0-21swapper/222:45:252
2729232995150,1cyclictest0-21swapper/222:01:442
2729232995150,1cyclictest0-21swapper/221:54:542
2729232995150,1cyclictest0-21swapper/221:11:132
2729232995150,1cyclictest0-21swapper/220:51:152
2729232995150,1cyclictest0-21swapper/220:28:132
2729232995150,1cyclictest0-21swapper/219:43:492
2729232995150,1cyclictest0-21swapper/219:25:242
2729232995150,1cyclictest0-21swapper/200:31:452
2729232995149,1cyclictest2688212-21kworker/u8:1+flush-8:022:21:012
2729228995150,1cyclictest0-21swapper/121:10:291
2729228995149,1cyclictest2776957-21sensors21:05:321
2729225995151,0cyclictest0-21swapper/000:25:360
2729237995048,1cyclictest0-21swapper/319:50:243
2729232995049,1cyclictest0-21swapper/223:14:472
2729232995049,1cyclictest0-21swapper/221:40:132
2729232995049,1cyclictest0-21swapper/221:35:272
2729232995049,1cyclictest0-21swapper/219:45:232
2729225995048,1cyclictest2783799-21kworker/0:0+events21:30:200
2729225995048,1cyclictest2771078-21kworker/0:1+events23:00:260
2729225995048,1cyclictest2771078-21kworker/0:1+events22:35:210
2729225995048,1cyclictest2771078-21kworker/0:1+events21:20:270
2729237994948,1cyclictest0-21swapper/321:58:053
2729237994947,1cyclictest0-21swapper/323:55:283
2729232994948,1cyclictest0-21swapper/222:25:272
2729232994948,1cyclictest0-21swapper/200:20:092
2729228994947,1cyclictest2792967-21sensors21:45:321
2729228994947,1cyclictest2323729-21snmpd19:14:351
2729225994949,0cyclictest0-21swapper/023:30:210
2729225994948,1cyclictest2771078-21kworker/0:1+events00:00:210
2729225994948,1cyclictest2745522-21kworker/0:2+events21:05:240
2729225994947,1cyclictest2771078-21kworker/0:1+events23:20:250
2729225994947,1cyclictest2771078-21kworker/0:1+events22:15:340
2729237994847,1cyclictest0-21swapper/323:05:163
2729228994846,1cyclictest0-21swapper/122:00:301
2729225994847,1cyclictest2771078-21kworker/0:1+events23:35:570
2729225994847,1cyclictest2771078-21kworker/0:1+events22:52:250
2729225994847,1cyclictest2745522-21kworker/0:2+events19:55:260
2729225994846,1cyclictest2771078-21kworker/0:1+events23:45:080
2729225994846,1cyclictest2771078-21kworker/0:1+events21:25:230
2729237994746,1cyclictest0-21swapper/319:25:213
2729237994745,1cyclictest2806778-21sensors22:20:273
2729237994745,1cyclictest2323729-21snmpd23:15:183
2729237994745,1cyclictest0-21swapper/300:35:213
2729225994747,0cyclictest2771078-21kworker/0:1+events22:10:570
2729225994747,0cyclictest0-21swapper/020:45:230
2729225994746,1cyclictest2771078-21kworker/0:1+events23:55:240
2729225994746,1cyclictest2771078-21kworker/0:1+events22:42:210
2729225994746,1cyclictest2745522-21kworker/0:2+events20:59:270
2729225994746,1cyclictest2745522-21kworker/0:2+events20:06:520
2729225994746,1cyclictest2745522-21kworker/0:2+events20:01:560
2729225994746,1cyclictest2715294-21kworker/0:0+events19:39:450
2729225994746,1cyclictest2715294-21kworker/0:0+events19:33:570
2729225994746,0cyclictest2715294-21kworker/0:0+events19:16:210
2729225994745,1cyclictest2771078-21kworker/0:1+events22:55:200
2729225994745,1cyclictest2771078-21kworker/0:1+events22:30:140
2729225994745,1cyclictest2771078-21kworker/0:1+events00:05:280
2729225994745,1cyclictest2745522-21kworker/0:2+events20:15:040
2729225994745,1cyclictest2715294-21kworker/0:0+events19:25:240
2729237994645,1cyclictest0-21swapper/322:25:203
2729237994645,1cyclictest0-21swapper/321:30:203
2729237994645,1cyclictest0-21swapper/300:25:233
2729237994644,1cyclictest0-21swapper/323:35:263
2729228994645,1cyclictest2323729-21snmpd20:29:481
2729228994644,1cyclictest2852900-21kworker/1:0+events_power_efficient00:28:371
2729225994646,0cyclictest2771078-21kworker/0:1+events00:10:460
2729225994646,0cyclictest2745522-21kworker/0:2+events20:10:470
2729225994645,1cyclictest2771078-21kworker/0:1+events23:50:270
2729225994645,1cyclictest2771078-21kworker/0:1+events23:42:260
2729225994645,1cyclictest2771078-21kworker/0:1+events23:05:230
2729225994645,1cyclictest2771078-21kworker/0:1+events22:22:540
2729225994645,1cyclictest2771078-21kworker/0:1+events21:54:540
2729225994645,1cyclictest2771078-21kworker/0:1+events21:15:290
2729225994645,1cyclictest2745522-21kworker/0:2+events21:04:540
2729225994645,1cyclictest2745522-21kworker/0:2+events20:51:140
2729225994645,1cyclictest2745522-21kworker/0:2+events20:28:130
2729225994644,1cyclictest2771078-21kworker/0:1+events23:25:220
2729225994644,1cyclictest2771078-21kworker/0:1+events23:25:220
2729225994644,1cyclictest2771078-21kworker/0:1+events21:11:130
2729237994544,1cyclictest0-21swapper/323:45:263
2729237994544,1cyclictest0-21swapper/323:25:193
2729237994544,1cyclictest0-21swapper/323:25:193
2729237994544,1cyclictest0-21swapper/323:00:273
2729237994544,1cyclictest0-21swapper/322:50:283
2729237994544,1cyclictest0-21swapper/322:06:563
2729237994544,1cyclictest0-21swapper/321:15:243
2729237994544,1cyclictest0-21swapper/321:09:593
2729237994544,1cyclictest0-21swapper/300:05:343
2729237994542,2cyclictest2834777-21runrttasks23:30:563
2729225994545,0cyclictest2771078-21kworker/0:1+events22:01:450
2729225994544,1cyclictest2771078-21kworker/0:1+events00:31:450
2729225994543,1cyclictest2771078-21kworker/0:1+events21:40:130
2729225994543,1cyclictest2771078-21kworker/0:1+events21:35:280
2729225994543,1cyclictest2715294-21kworker/0:0+events19:40:140
2729237994443,1cyclictest0-21swapper/321:44:233
2729237994442,1cyclictest0-21swapper/319:55:283
2729228994443,1cyclictest0-21swapper/121:30:311
2729225994443,1cyclictest2771078-21kworker/0:1+events23:12:440
2729225994443,1cyclictest2771078-21kworker/0:1+events22:28:520
2729225994443,1cyclictest2715294-21kworker/0:0+events19:45:230
2729225994443,0cyclictest2771078-21kworker/0:1+events00:20:090
2729237994342,1cyclictest2323729-21snmpd19:34:393
2729237994342,1cyclictest0-21swapper/320:35:293
2729237994342,1cyclictest0-21swapper/320:00:313
2729237994341,1cyclictest0-21swapper/320:10:273
2729228994342,1cyclictest0-21swapper/123:25:301
2729228994342,1cyclictest0-21swapper/123:25:301
2729237994241,1cyclictest0-21swapper/323:10:233
2729237994241,1cyclictest0-21swapper/322:56:553
2729237994241,1cyclictest0-21swapper/322:15:263
2729237994241,1cyclictest0-21swapper/322:00:553
2729237994241,1cyclictest0-21swapper/300:21:553
2729237994240,1cyclictest0-21swapper/320:50:233
2729237994240,1cyclictest0-21swapper/320:30:253
2729228994241,1cyclictest0-21swapper/122:55:321
2729228994240,1cyclictest2729122-21kworker/1:2+events_power_efficient21:35:281
2729228994240,1cyclictest2729122-21kworker/1:2+events_power_efficient21:20:421
2729228994240,1cyclictest0-21swapper/122:10:041
2729237994139,1cyclictest0-21swapper/300:15:303
2729228994140,1cyclictest2729122-21kworker/1:2+events_power_efficient20:54:011
2729237994039,1cyclictest0-21swapper/322:45:273
2729237994039,1cyclictest0-21swapper/322:35:243
2729237994039,1cyclictest0-21swapper/300:10:413
2729237994038,1cyclictest0-21swapper/320:42:393
2729237994038,1cyclictest0-21swapper/319:45:243
2729228994038,1cyclictest2790972-21sensors21:40:291
2729237993837,1cyclictest0-21swapper/319:10:283
2729237993836,1cyclictest0-21swapper/319:15:503
2729228993836,1cyclictest2774760-21sensors21:00:281
2729237993635,1cyclictest2758626-21sensors20:20:273
2729237993635,1cyclictest0-21swapper/323:51:423
2729237993635,1cyclictest0-21swapper/321:01:463
2729228993634,1cyclictest2824544-21sensors23:05:321
2729228993634,1cyclictest0-21swapper/100:05:271
2729237993534,1cyclictest0-21swapper/300:02:553
2729228993533,1cyclictest2852900-21kworker/1:0+events_power_efficient00:35:221
2729228993432,1cyclictest2323729-21snmpd20:19:461
2729228993130,1cyclictest2729122-21kworker/1:2+events_power_efficient22:25:221
2729228993129,1cyclictest2738889-21sensors19:30:271
2729228993029,1cyclictest2815386-21kworker/1:1+events_power_efficient23:19:591
2729228993028,1cyclictest2834411-21sensors23:30:311
2729228992928,1cyclictest2729122-21kworker/1:2+events_power_efficient19:55:271
2729228992725,1cyclictest2323729-21snmpd23:45:231
2729228992423,1cyclictest0-21swapper/122:15:301
2729228992422,1cyclictest2323729-21snmpd22:35:101
2729237992221,1cyclictest0-21swapper/319:42:563
2729228992221,1cyclictest0-21swapper/121:50:281
2729228992019,1cyclictest0-21swapper/122:05:271
2729228992019,1cyclictest0-21swapper/120:14:451
2729228991817,1cyclictest0-21swapper/120:00:311
2729228991816,1cyclictest2815386-21kworker/1:1+events_power_efficient22:54:591
272922899180,3cyclictest0-21swapper/100:18:371
2729237991716,1cyclictest0-21swapper/321:45:323
2729228991715,1cyclictest2815386-21kworker/1:1+events_power_efficient23:40:291
272922899170,16cyclictest0-21swapper/122:45:211
272922899170,16cyclictest0-21swapper/100:33:011
272923799160,1cyclictest0-21swapper/323:20:293
272922899160,1cyclictest0-21swapper/123:20:131
272922899160,1cyclictest0-21swapper/123:01:371
272922899155,9cyclictest0-21swapper/100:11:531
272922899155,10cyclictest0-21swapper/119:26:111
272922899150,14cyclictest0-21swapper/120:20:241
272923799145,4cyclictest2802422-21awk22:10:233
272923799140,13cyclictest0-21swapper/319:20:183
272922899144,4cyclictest0-21swapper/120:33:071
2729228991413,1cyclictest2810724-21sensors22:30:281
2729228991413,1cyclictest2729122-21kworker/1:2+events_power_efficient19:20:221
2729228991312,1cyclictest0-21swapper/123:10:161
2729237991210,1cyclictest2323730-21nmbd20:16:143
272922899129,2cyclictest2323729-21snmpd23:36:351
272922899122,4cyclictest0-21swapper/120:58:571
2729228991110,1cyclictest2729122-21kworker/1:2+events_power_efficient21:28:381
272922899110,11cyclictest0-21swapper/120:45:231
272923799100,10cyclictest0-21swapper/319:38:083
272922899108,1cyclictest0-21swapper/123:59:241
272922899107,2cyclictest2739938-21cpuspeed_turbos19:35:211
272922899100,9cyclictest0-21swapper/100:00:121
27292289998,1cyclictest2729122-21kworker/1:2+events_power_efficient19:45:281
27292289996,2cyclictest2323729-21snmpd19:51:301
27292289985,2cyclictest2323730-21nmbd19:15:451
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional