You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-13 - 21:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4s.osadl.org (updated Sat Jul 13, 2024 12:44:42)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
405399169167,1cyclictest0-21swapper/207:20:372
404699139131,7cyclictest0-21swapper/007:10:080
37092116103,9sleep30-21swapper/307:08:023
35992115102,10sleep20-21swapper/207:06:362
38232113104,6sleep00-21swapper/007:09:310
404999111107,1cyclictest0-21swapper/107:10:081
3593210895,10sleep10-21swapper/107:06:311
4049998682,3cyclictest6481-21kworker/u16:0+events_unbound07:40:381
207282820,1sleep30-21swapper/307:20:353
4046997671,3cyclictest6481-21kworker/u16:0+events_unbound07:40:030
4046997369,3cyclictest6481-21kworker/u16:0+events_unbound09:00:020
4046996561,3cyclictest6481-21kworker/u16:0+events_unbound08:10:310
4046996151,9cyclictest0-21swapper/007:20:370
4046996056,3cyclictest6481-21kworker/u16:0+events_unbound10:35:320
4046995955,3cyclictest6481-21kworker/u16:0+events_unbound12:30:020
4046995955,3cyclictest28466-21kworker/u16:2+events_unbound11:30:030
4046995955,3cyclictest28466-21kworker/u16:2+events_unbound11:30:020
4046995951,7cyclictest6481-21kworker/u16:0+events_unbound12:25:360
4053995853,4cyclictest6481-21kworker/u16:0+events_unbound07:40:352
4049995753,3cyclictest17586-21kworker/u16:3+events_unbound07:55:381
4053995550,3cyclictest6481-21kworker/u16:0+events_unbound07:15:012
4049995550,3cyclictest6481-21kworker/u16:0+events_unbound08:25:141
4046995551,3cyclictest28466-21kworker/u16:2+events_unbound11:40:250
4046995450,3cyclictest6481-21kworker/u16:0+events_unbound07:15:140
4049995349,3cyclictest6481-21kworker/u16:0+events_unbound12:25:341
4046995349,3cyclictest6481-21kworker/u16:0+events_unbound11:20:010
4046995349,3cyclictest28466-21kworker/u16:2+events_unbound08:55:380
4053995047,2cyclictest0-21swapper/207:10:082
4049995046,3cyclictest17586-21kworker/u16:3+events_unbound07:50:291
4049995045,4cyclictest17586-21kworker/u16:3+events_unbound08:20:021
4046995046,3cyclictest6481-21kworker/u16:0+events_unbound08:45:350
4049994945,3cyclictest28466-21kworker/u16:2+events_unbound09:40:011
4046994945,3cyclictest6481-21kworker/u16:0+events_unbound07:40:000
4046994845,2cyclictest6481-21kworker/u16:0+events_unbound12:15:330
4046994840,7cyclictest28466-21kworker/u16:2+events_unbound10:10:300
4049994642,3cyclictest17586-21kworker/u16:3+events_unbound07:35:311
4046994643,2cyclictest6481-21kworker/u16:0+events_unbound07:30:330
4049994541,3cyclictest28466-21kworker/u16:2+events_unbound11:00:131
4049994540,4cyclictest28466-21kworker/u16:2+events_unbound10:30:111
4049994538,6cyclictest28466-21kworker/u16:2+events_unbound12:19:571
4046994541,3cyclictest6481-21kworker/u16:0+events_unbound11:55:360
4053994440,3cyclictest28466-21kworker/u16:2+events_unbound10:55:342
4049994439,4cyclictest28466-21kworker/u16:2+events_unbound11:25:111
4046994440,3cyclictest6481-21kworker/u16:0+events_unbound12:20:130
4049994339,3cyclictest6481-21kworker/u16:0+events_unbound10:15:171
4053994238,3cyclictest28466-21kworker/u16:2+events_unbound12:35:022
4049994238,3cyclictest6481-21kworker/u16:0+events_unbound11:35:221
4049994238,3cyclictest6481-21kworker/u16:0+events_unbound11:35:221
4049994238,3cyclictest6481-21kworker/u16:0+events_unbound08:10:201
4046994238,3cyclictest6481-21kworker/u16:0+events_unbound08:25:310
4046994238,3cyclictest17586-21kworker/u16:3+events_unbound08:05:360
4046994136,4cyclictest17586-21kworker/u16:3+events_unbound08:15:030
4049994036,3cyclictest6481-21kworker/u16:0+events_unbound08:00:011
4046994036,3cyclictest6481-21kworker/u16:0+events_unbound12:35:340
4053993935,3cyclictest6481-21kworker/u16:0+events_unbound10:50:332
4053993935,3cyclictest6481-21kworker/u16:0+events_unbound08:50:182
4049993935,3cyclictest6481-21kworker/u16:0+events_unbound10:10:141
4049993935,3cyclictest6481-21kworker/u16:0+events_unbound10:00:171
4049993935,3cyclictest28466-21kworker/u16:2+events_unbound11:45:111
4046993935,3cyclictest6481-21kworker/u16:0+events_unbound08:30:130
4046993835,2cyclictest17586-21kworker/u16:3+events_unbound07:25:160
4053993733,3cyclictest28466-21kworker/u16:2+events_unbound11:30:012
4049993733,3cyclictest28466-21kworker/u16:2+events_unbound12:20:021
4046993735,2cyclictest28466-21kworker/u16:2+events_unbound09:40:190
4046993733,3cyclictest6481-21kworker/u16:0+events_unbound09:05:080
4046993732,4cyclictest28466-21kworker/u16:2+events_unbound10:05:090
4053993631,3cyclictest6481-21kworker/u16:0+events_unbound10:18:392
4049993632,3cyclictest28466-21kworker/u16:2+events_unbound11:10:271
4049993630,5cyclictest6481-21kworker/u16:0+events_unbound09:05:101
404999360,35cyclictest9729-21switchtime10:55:341
4049993531,3cyclictest6481-21kworker/u16:0+events_unbound11:15:171
4049993531,3cyclictest17586-21kworker/u16:3+events_unbound08:15:131
4049993527,7cyclictest28466-21kworker/u16:2+events_unbound12:00:031
4046993531,3cyclictest6481-21kworker/u16:0+events_unbound09:25:130
4046993531,3cyclictest28466-21kworker/u16:2+events_unbound12:00:290
4049993430,3cyclictest28466-21kworker/u16:2+events_unbound08:40:191
4049993423,7cyclictest28466-21kworker/u16:2+events_unbound12:31:181
4049993420,9cyclictest6481-21kworker/u16:0+events_unbound10:24:441
4046993431,3cyclictest6481-21kworker/u16:0+events_unbound10:26:470
4046993431,3cyclictest6481-21kworker/u16:0+events_unbound09:45:180
4046993431,3cyclictest6481-21kworker/u16:0+events_unbound08:35:350
4046993431,2cyclictest6481-21kworker/u16:0+events_unbound09:20:260
4046993430,3cyclictest6481-21kworker/u16:0+events_unbound10:15:190
4049993329,3cyclictest28466-21kworker/u16:2+events_unbound12:10:191
4049993329,3cyclictest28466-21kworker/u16:2+events_unbound11:05:321
4049993329,3cyclictest28466-21kworker/u16:2+events_unbound09:50:141
4049993329,3cyclictest17586-21kworker/u16:3+events_unbound07:45:181
4049993319,9cyclictest6481-21kworker/u16:0+events_unbound08:06:461
4046993330,3cyclictest6481-21kworker/u16:0+events_unbound10:01:220
4046993330,2cyclictest28466-21kworker/u16:2+events_unbound09:35:370
4046993329,3cyclictest6481-21kworker/u16:0+events_unbound09:55:380
4046993329,3cyclictest28466-21kworker/u16:2+events_unbound10:45:330
4049993228,3cyclictest6481-21kworker/u16:0+events_unbound09:55:341
4049993227,3cyclictest17586-21kworker/u16:3+events_unbound07:20:001
4053993127,3cyclictest28466-21kworker/u16:2+events_unbound09:30:302
4049993127,3cyclictest6481-21kworker/u16:0+events_unbound11:20:201
4049993127,3cyclictest28466-21kworker/u16:2+events_unbound08:50:141
4049993126,4cyclictest17586-21kworker/u16:3+events_unbound07:20:251
4049993117,11cyclictest6481-21kworker/u16:0+events_unbound10:38:571
4046993127,3cyclictest6481-21kworker/u16:0+events_unbound09:15:330
4046993127,3cyclictest6481-21kworker/u16:0+events_unbound09:15:330
4049993026,3cyclictest6481-21kworker/u16:0+events_unbound12:35:141
4046993026,3cyclictest6481-21kworker/u16:0+events_unbound10:40:270
4046993026,3cyclictest28466-21kworker/u16:2+events_unbound12:05:120
4046993026,3cyclictest28466-21kworker/u16:2+events_unbound11:10:210
4046993022,7cyclictest6481-21kworker/u16:0+events_unbound10:50:180
4053992925,3cyclictest28466-21kworker/u16:2+events_unbound12:10:332
4049992925,3cyclictest6481-21kworker/u16:0+events_unbound08:45:151
4049992925,3cyclictest28466-21kworker/u16:2+events_unbound09:35:231
4049992925,3cyclictest17586-21kworker/u16:3+events_unbound07:25:201
4046992926,3cyclictest28466-21kworker/u16:2+events_unbound11:45:290
404699290,28cyclictest1833-21kthreadcore10:20:220
4053992824,3cyclictest6481-21kworker/u16:0+events_unbound11:20:322
4053992824,3cyclictest6481-21kworker/u16:0+events_unbound11:15:332
4053992824,3cyclictest28466-21kworker/u16:2+events_unbound09:40:172
4053992823,4cyclictest28466-21kworker/u16:2+events_unbound12:00:342
4049992824,3cyclictest28466-21kworker/u16:2+events_unbound11:30:271
4049992824,3cyclictest28466-21kworker/u16:2+events_unbound11:30:271
4049992818,8cyclictest6481-21kworker/u16:0+events_unbound09:25:011
4046992825,3cyclictest28466-21kworker/u16:2+events_unbound10:55:170
4046992824,3cyclictest28466-21kworker/u16:2+events_unbound10:30:350
4046992824,3cyclictest17586-21kworker/u16:3+events_unbound07:55:420
4053992723,3cyclictest6481-21kworker/u16:0+events_unbound08:00:292
4053992723,3cyclictest28466-21kworker/u16:2+events_unbound12:05:332
4053992722,3cyclictest6481-21kworker/u16:0+events_unbound10:20:172
4046992724,3cyclictest28466-21kworker/u16:2+events_unbound09:10:250
4053992622,3cyclictest6481-21kworker/u16:0+events_unbound10:39:592
4053992622,3cyclictest6481-21kworker/u16:0+events_unbound10:01:092
4049992622,3cyclictest28466-21kworker/u16:2+events_unbound09:10:231
4049992620,5cyclictest6481-21kworker/u16:0+events_unbound09:30:091
4049992617,8cyclictest6481-21kworker/u16:0+events_unbound11:58:371
4046992623,3cyclictest17586-21kworker/u16:3+events_unbound07:50:170
4053992521,3cyclictest6481-21kworker/u16:0+events_unbound12:20:352
4053992521,3cyclictest6481-21kworker/u16:0+events_unbound12:15:302
4053992521,3cyclictest6481-21kworker/u16:0+events_unbound09:50:332
404999255,13cyclictest6481-21kworker/u16:0+events_unbound09:49:101
4046992522,3cyclictest17586-21kworker/u16:3+events_unbound08:20:120
4046992520,4cyclictest28466-21kworker/u16:2+events_unbound09:30:270
4053992420,3cyclictest17586-21kworker/u16:3+events_unbound08:20:152
4053992419,3cyclictest6481-21kworker/u16:0+events_unbound08:35:182
4049992413,11cyclictest0-21swapper/109:16:491
4049992413,11cyclictest0-21swapper/109:16:481
4046992421,3cyclictest28466-21kworker/u16:2+events_unbound11:25:190
4046992420,3cyclictest28466-21kworker/u16:2+events_unbound11:00:290
4046992420,3cyclictest28466-21kworker/u16:2+events_unbound08:51:020
4053992319,3cyclictest6481-21kworker/u16:0+events_unbound09:20:372
4053992319,3cyclictest28466-21kworker/u16:2+events_unbound09:10:382
404999237,16cyclictest6481-21kworker/u16:0+events_unbound10:43:121
4049992218,3cyclictest6481-21kworker/u16:0+events_unbound10:27:181
4049992211,11cyclictest0-21swapper/112:06:391
4049992211,11cyclictest0-21swapper/111:44:461
4049992211,11cyclictest0-21swapper/108:33:401
4049992210,8cyclictest0-21swapper/110:45:121
4053992117,3cyclictest6481-21kworker/u16:0+events_unbound08:30:362
4053992117,3cyclictest28466-21kworker/u16:2+events_unbound09:00:172
404999219,12cyclictest0-21swapper/110:51:481
4049992110,11cyclictest0-21swapper/109:29:251
4049992110,11cyclictest0-21swapper/108:35:581
4049992110,11cyclictest0-21swapper/107:34:361
4046992117,3cyclictest28466-21kworker/u16:2+events_unbound11:50:200
4046992016,3cyclictest6481-21kworker/u16:0+events_unbound11:20:120
4046992016,3cyclictest6481-21kworker/u16:0+events_unbound08:00:540
4046992016,3cyclictest28466-21kworker/u16:2+events_unbound11:05:200
4049991915,3cyclictest6481-21kworker/u16:0+events_unbound10:05:331
4049991911,8cyclictest0-21swapper/111:53:001
4049991911,8cyclictest0-21swapper/109:01:021
4053991814,3cyclictest6481-21kworker/u16:0+events_unbound08:10:182
4053991814,3cyclictest28466-21kworker/u16:2+events_unbound09:05:312
4053991814,3cyclictest17586-21kworker/u16:3+events_unbound07:55:222
4046991814,3cyclictest28466-21kworker/u16:2+events_unbound09:55:000
4046991814,3cyclictest28466-21kworker/u16:2+events_unbound08:40:360
4053991714,2cyclictest6481-21kworker/u16:0+events_unbound11:35:022
4053991714,2cyclictest6481-21kworker/u16:0+events_unbound11:35:012
4053991713,3cyclictest6481-21kworker/u16:0+events_unbound08:45:212
4053991713,3cyclictest17586-21kworker/u16:3+events_unbound07:25:382
404999176,11cyclictest0-21swapper/108:56:131
4053991612,3cyclictest28466-21kworker/u16:2+events_unbound11:50:272
4053991612,3cyclictest28466-21kworker/u16:2+events_unbound08:40:352
4046991613,2cyclictest24090-21munin-run11:40:010
4046991613,2cyclictest24090-21munin-run11:40:010
4053991511,3cyclictest28466-21kworker/u16:2+events_unbound11:30:212
4053991511,3cyclictest28466-21kworker/u16:2+events_unbound11:30:212
4053991511,3cyclictest28466-21kworker/u16:2+events_unbound10:30:312
4053991511,3cyclictest17586-21kworker/u16:3+events_unbound08:05:232
405399149,4cyclictest28466-21kworker/u16:2+events_unbound11:45:272
4053991410,3cyclictest28466-21kworker/u16:2+events_unbound10:45:172
4053991410,3cyclictest17586-21kworker/u16:3+events_unbound07:35:332
404699142,10cyclictest0-21swapper/007:49:030
405399139,3cyclictest6481-21kworker/u16:0+events_unbound09:15:192
405399139,3cyclictest6481-21kworker/u16:0+events_unbound09:15:192
404699132,8cyclictest31318-21munin-run12:15:010
405399128,3cyclictest6481-21kworker/u16:0+events_unbound12:25:132
405399118,2cyclictest26930-21grep11:10:382
405399117,3cyclictest6481-21kworker/u16:0+events_unbound08:25:102
405399117,3cyclictest20518-21cut10:10:222
405399117,3cyclictest17586-21kworker/u16:3+events_unbound08:15:192
405399117,3cyclictest17586-21kworker/u16:3+events_unbound07:50:152
405399110,10cyclictest0-21swapper/208:55:292
405399106,3cyclictest28466-21kworker/u16:2+events_unbound09:45:342
405399106,3cyclictest17586-21kworker/u16:3+events_unbound07:45:202
405399104,5cyclictest12994-21apt-get10:05:092
405399100,8cyclictest22897-21cut10:40:252
405399100,8cyclictest16676-21apt-key09:40:002
40539995,3cyclictest11294-21fschecks_time11:00:192
40539994,4cyclictest6398-21cut10:25:282
40539994,4cyclictest4228-21systemd-journal09:25:272
40539994,4cyclictest18705-21cut12:30:282
40539990,8cyclictest0-21swapper/209:59:192
40539990,4cyclictest19023-21cut11:05:262
40539983,4cyclictest12809-21cut11:55:292
40539980,7cyclictest24349-21apt-get11:40:112
40539980,7cyclictest0-21swapper/207:30:092
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
none08:51:277
878270,4sleep30-21swapper/311:20:133
27206274,2sleep34627-21kworker/3:0+events09:20:253
12464270,5sleep30-21swapper/311:30:023
12464270,5sleep30-21swapper/311:30:023
10449271,4sleep30-21swapper/312:25:133
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
none08:51:276
9105260,4sleep30-21swapper/310:30:103
4464260,2sleep30-21swapper/312:19:193
31130260,2sleep30-21swapper/312:12:503
31053260,2sleep30-21swapper/307:59:003
28417260,4sleep30-21swapper/309:50:113
2810260,2sleep30-21swapper/308:57:193
2175260,4sleep30-21swapper/308:30:183
21560260,4sleep30-21swapper/309:40:333
20043260,4sleep30-21swapper/307:50:103
18641260,4sleep30-21swapper/311:35:143
18641260,4sleep30-21swapper/311:35:143
18023260,4sleep30-21swapper/308:40:373
16732260,4sleep30-21swapper/308:15:113
16188260,4sleep30-21swapper/312:30:023
1345260,2sleep30-21swapper/308:28:143
12078260,4sleep30-21swapper/307:15:113
none08:51:275
none08:51:275
none08:51:275
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional