You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-07-27 - 08:13

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Sat Jul 27, 2024 00:45:44)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1338499131131,0cyclictest1725250irq/36-eth1-rx-19:50:435
1335499110110,0cyclictest3-21ksoftirqd/020:32:500
13384998988,1cyclictest0-21swapper/519:47:495
13390998481,2cyclictest0-21swapper/622:13:426
13397996969,0cyclictest1725250irq/36-eth1-rx-21:35:107
13369996564,1cyclictest0-21swapper/321:35:103
1304324513,18sleep20-21swapper/219:08:152
1299424312,17sleep00-21swapper/019:07:320
129092408,17sleep70-21swapper/719:06:197
1302723414,17sleep40-21swapper/419:08:014
1243323413,17sleep10-21swapper/119:05:251
1306223313,17sleep30-21swapper/319:08:323
13363993131,0cyclictest29-21ksoftirqd/219:32:032
13363993131,0cyclictest29-21ksoftirqd/219:32:032
130932298,18sleep50-21swapper/519:08:585
1287922614,8sleep60-21swapper/619:05:546
13354991814,1cyclictest21288-21awk21:20:000
1339099170,2cyclictest0-21swapper/620:36:156
1337899170,2cyclictest0-21swapper/421:42:304
1337899160,13cyclictest0-21swapper/419:11:304
1335499163,10cyclictest0-21swapper/021:43:110
13397991411,2cyclictest0-21swapper/722:37:457
1339799140,13cyclictest0-21swapper/721:59:467
1335699140,2cyclictest0-21swapper/121:06:411
1335499140,12cyclictest0-21swapper/021:20:200
83142130,0sleep03997-21runrttasks23:58:080
68812130,0sleep33997-21runrttasks23:28:403
1339799130,12cyclictest0-21swapper/723:46:467
1339799130,12cyclictest0-21swapper/719:48:157
1337899130,2cyclictest0-21swapper/419:34:014
1337899130,2cyclictest0-21swapper/419:34:014
1337899130,13cyclictest0-21swapper/419:16:004
1335499130,2cyclictest0-21swapper/019:35:000
1335499130,2cyclictest0-21swapper/019:35:000
1339799120,2cyclictest0-21swapper/722:16:167
1339099120,1cyclictest0-21swapper/621:34:456
1337899129,2cyclictest0-21swapper/420:30:464
13378991211,1cyclictest31975-21cat23:50:154
1335499129,2cyclictest437250latency_hist19:55:000
1335499129,2cyclictest0-21swapper/000:35:010
1335499122,4cyclictest0-21swapper/022:23:310
13354991210,1cyclictest11741-21ssh21:39:590
1339799118,2cyclictest0-21swapper/719:21:157
1339799110,10cyclictest0-21swapper/721:22:167
1339099119,2cyclictest0-21swapper/623:44:156
1339099113,7cyclictest0-21swapper/623:03:516
1336999119,1cyclictest30554-21snmpd22:16:163
13369991111,0cyclictest30554-21snmpd19:47:453
1336399111,9cyclictest0-21swapper/220:05:192
1335499118,2cyclictest0-21swapper/021:57:060
1335499116,5cyclictest0-21swapper/019:42:070
1335499112,3cyclictest0-21swapper/022:01:090
1335499111,9cyclictest0-21swapper/022:14:590
1335499110,9cyclictest0-21swapper/022:57:100
1335499110,9cyclictest0-21swapper/019:25:000
1335499110,1cyclictest0-21swapper/020:10:000
1335499110,10cyclictest5721-21latency_hist00:25:010
1339799107,2cyclictest0-21swapper/722:45:157
1339799107,2cyclictest0-21swapper/721:08:467
1339799107,2cyclictest0-21swapper/720:56:457
1339799107,2cyclictest0-21swapper/720:03:457
1339099101,2cyclictest0-21swapper/620:54:596
1337899107,3cyclictest0-21swapper/422:05:004
1337899103,4cyclictest0-21swapper/420:25:454
1336999100,9cyclictest0-21swapper/320:45:113
1335499108,2cyclictest0-21swapper/023:00:110
1335499107,2cyclictest0-21swapper/023:15:200
1335499107,2cyclictest0-21swapper/023:07:330
1335499107,2cyclictest0-21swapper/022:09:590
13354991010,0cyclictest30554-21snmpd20:35:160
13354991010,0cyclictest30554-21snmpd19:37:450
1335499100,9cyclictest0-21swapper/023:23:020
1335499100,9cyclictest0-21swapper/022:42:410
1335499100,9cyclictest0-21swapper/021:51:200
1335499100,9cyclictest0-21swapper/000:28:150
1335499100,9cyclictest0-21swapper/000:12:350
1335499100,9cyclictest0-21swapper/000:09:290
1335499100,8cyclictest0-21swapper/023:45:580
1335499100,8cyclictest0-21swapper/023:35:110
1335499100,8cyclictest0-21swapper/023:35:100
1335499100,8cyclictest0-21swapper/021:45:190
1335499100,8cyclictest0-21swapper/021:25:410
1335499100,8cyclictest0-21swapper/020:46:100
1335499100,7cyclictest0-21swapper/019:15:000
1335499100,1cyclictest0-21swapper/020:55:250
1335499100,1cyclictest0-21swapper/019:30:000
1335499100,1cyclictest0-21swapper/019:30:000
133979994,4cyclictest0-21swapper/721:25:317
133979991,7cyclictest0-21swapper/721:50:367
133979991,7cyclictest0-21swapper/720:37:267
133909997,2cyclictest0-21swapper/621:19:456
133909996,2cyclictest0-21swapper/621:46:216
133909993,3cyclictest0-21swapper/619:38:016
133909991,7cyclictest0-21swapper/622:55:006
133849990,8cyclictest0-21swapper/522:01:085
133849990,2cyclictest0-21swapper/522:43:015
133789990,2cyclictest0-21swapper/422:49:004
133789990,2cyclictest0-21swapper/422:39:304
133699998,1cyclictest30554-21snmpd21:59:463
133699998,0cyclictest30554-21snmpd23:46:463
133699998,0cyclictest30554-21snmpd22:36:163
133699990,8cyclictest0-21swapper/323:04:463
133699990,8cyclictest0-21swapper/319:40:153
133699990,8cyclictest0-21swapper/300:15:403
133639991,7cyclictest0-21swapper/222:12:502
133639991,7cyclictest0-21swapper/219:55:262
133639991,7cyclictest0-21swapper/200:15:262
133639991,7cyclictest0-21swapper/200:05:222
133639990,2cyclictest0-21swapper/223:48:002
133639990,2cyclictest0-21swapper/223:01:492
133569991,7cyclictest0-21swapper/122:23:101
133569991,7cyclictest0-21swapper/120:00:171
133549998,1cyclictest0-21swapper/023:54:260
133549998,1cyclictest0-21swapper/019:20:000
133549998,1cyclictest0-21swapper/000:38:150
133549998,1cyclictest0-21swapper/000:00:140
133549997,1cyclictest19843-21ssh23:10:240
133549996,2cyclictest0-21swapper/021:32:110
133549996,1cyclictest0-21swapper/022:55:000
133549996,1cyclictest0-21swapper/022:37:370
133549996,1cyclictest0-21swapper/021:10:230
133549996,1cyclictest0-21swapper/019:59:370
133549996,1cyclictest0-21swapper/019:49:550
133549995,2cyclictest0-21swapper/022:30:350
133549990,9cyclictest0-21swapper/022:17:350
133549990,8cyclictest26975-21latency_hist22:49:590
133549990,8cyclictest0-21swapper/023:40:110
133549990,8cyclictest0-21swapper/023:31:460
133549990,8cyclictest0-21swapper/021:00:230
133549990,8cyclictest0-21swapper/020:55:000
133549990,8cyclictest0-21swapper/020:40:190
133549990,8cyclictest0-21swapper/020:05:000
133549990,7cyclictest0-21swapper/020:19:030
133549990,6cyclictest1446250latency_hist20:15:000
133549990,2cyclictest0-21swapper/020:20:210
133549990,1cyclictest9869-21mrtg21:10:000
32072280,1sleep40-21swapper/422:54:144
26918280,1sleep50-21swapper/523:17:225
25753280,1sleep60-21swapper/621:50:346
21264280,1sleep40-21swapper/421:47:194
133979986,1cyclictest0-21swapper/723:26:197
133979983,4cyclictest0-21swapper/723:34:467
133979983,4cyclictest0-21swapper/723:18:007
133979983,4cyclictest0-21swapper/723:13:177
133979983,4cyclictest0-21swapper/720:42:457
133979983,4cyclictest0-21swapper/719:40:307
133979983,4cyclictest0-21swapper/700:19:317
133979982,5cyclictest0-21swapper/721:41:167
133979982,5cyclictest0-21swapper/719:58:457
133909985,3cyclictest0-21swapper/620:11:096
133909985,2cyclictest0-21swapper/600:30:466
133909985,2cyclictest0-21swapper/600:23:406
133909983,4cyclictest0-21swapper/623:15:146
133909983,4cyclictest0-21swapper/622:55:166
133909983,4cyclictest0-21swapper/621:10:126
133909983,4cyclictest0-21swapper/619:32:306
133909983,4cyclictest0-21swapper/619:32:306
133909982,4cyclictest0-21swapper/623:55:166
133909982,3cyclictest0-21swapper/619:51:006
133909981,6cyclictest0-21swapper/619:12:306
133909981,6cyclictest0-21swapper/600:15:016
133909980,6cyclictest0-21swapper/623:46:386
133909980,6cyclictest0-21swapper/622:38:316
133909980,6cyclictest0-21swapper/622:18:306
133909980,6cyclictest0-21swapper/600:18:036
133849982,4cyclictest0-21swapper/521:47:455
133849980,7cyclictest0-21swapper/520:45:125
133849980,1cyclictest0-21swapper/519:55:305
133789983,4cyclictest0-21swapper/423:49:014
133789983,4cyclictest0-21swapper/421:35:004
133789983,4cyclictest0-21swapper/421:10:014
133789982,3cyclictest0-21swapper/419:55:154
133789981,6cyclictest0-21swapper/420:50:164
133789981,4cyclictest0-21swapper/419:39:454
133789981,3cyclictest0-21swapper/423:39:454
133789981,3cyclictest0-21swapper/423:39:454
133789981,2cyclictest0-21swapper/422:13:004
133789980,7cyclictest0-21swapper/423:58:014
133789980,5cyclictest0-21swapper/419:25:454
133789980,5cyclictest0-21swapper/419:25:454
133789980,5cyclictest0-21swapper/400:18:014
133789980,2cyclictest0-21swapper/422:04:154
133789980,2cyclictest0-21swapper/419:54:154
133789980,1cyclictest45-21ksoftirqd/422:32:004
133789980,1cyclictest0-21swapper/400:01:314
133699987,0cyclictest30554-21snmpd21:32:313
133699986,1cyclictest0-21swapper/321:50:393
133699981,6cyclictest0-21swapper/319:10:123
133699981,6cyclictest0-21swapper/300:20:123
133699980,7cyclictest0-21swapper/323:59:003
133699980,7cyclictest0-21swapper/323:33:543
133699980,7cyclictest0-21swapper/323:16:213
133699980,7cyclictest0-21swapper/323:09:023
133699980,7cyclictest0-21swapper/322:20:403
133699980,7cyclictest0-21swapper/320:20:003
133639981,6cyclictest0-21swapper/223:20:142
133639981,6cyclictest0-21swapper/223:15:022
133639981,6cyclictest0-21swapper/222:55:172
133639981,6cyclictest0-21swapper/222:35:262
133639981,6cyclictest0-21swapper/222:30:202
133639981,6cyclictest0-21swapper/222:25:152
133639981,6cyclictest0-21swapper/221:37:532
133639981,6cyclictest0-21swapper/221:20:182
133639981,6cyclictest0-21swapper/221:10:132
133639981,6cyclictest0-21swapper/221:00:172
133639981,6cyclictest0-21swapper/220:50:182
133639981,6cyclictest0-21swapper/220:45:152
133639981,6cyclictest0-21swapper/220:40:222
133639981,6cyclictest0-21swapper/220:35:212
133639981,6cyclictest0-21swapper/220:20:172
133639981,6cyclictest0-21swapper/220:10:222
133639981,6cyclictest0-21swapper/219:50:152
133639981,6cyclictest0-21swapper/219:25:192
133639981,6cyclictest0-21swapper/219:25:192
133639981,6cyclictest0-21swapper/200:35:182
133639981,6cyclictest0-21swapper/200:30:132
133639981,6cyclictest0-21swapper/200:25:212
133639981,6cyclictest0-21swapper/200:10:252
133639980,7cyclictest0-21swapper/223:11:352
133639980,7cyclictest0-21swapper/221:05:052
133639980,7cyclictest0-21swapper/200:22:472
133639980,6cyclictest0-21swapper/223:59:112
133639980,6cyclictest0-21swapper/221:45:262
133639980,6cyclictest0-21swapper/221:31:422
133639980,6cyclictest0-21swapper/200:02:002
133569986,1cyclictest0-21swapper/123:30:321
133569983,4cyclictest0-21swapper/123:15:151
133569983,4cyclictest0-21swapper/100:05:181
133569981,6cyclictest0-21swapper/100:24:481
133569980,6cyclictest0-21swapper/123:10:421
133549981,6cyclictest0-21swapper/023:25:120
133549981,6cyclictest0-21swapper/020:25:110
133549980,7cyclictest0-21swapper/000:15:370
133549980,1cyclictest0-21swapper/022:25:190
9067270,1sleep50-21swapper/520:00:315
8629270,1sleep60-21swapper/621:35:376
5418270,1sleep50-21swapper/523:55:185
32440270,1sleep50-21swapper/521:56:575
133979975,1cyclictest4844-21tr22:30:097
133979975,1cyclictest28495-21wc19:35:247
133979975,1cyclictest22719-21ssh23:41:567
133979975,1cyclictest18997-21latency21:45:167
133979974,2cyclictest0-21swapper/722:24:317
133979974,2cyclictest0-21swapper/700:09:007
133979974,1cyclictest1713650irq/39-eth022:06:057
133979973,3cyclictest0-21swapper/723:56:007
133979973,3cyclictest0-21swapper/723:36:467
133979973,3cyclictest0-21swapper/723:36:467
133979973,3cyclictest0-21swapper/723:09:307
133979973,3cyclictest0-21swapper/700:39:167
133979973,3cyclictest0-21swapper/700:25:167
133979973,3cyclictest0-21swapper/700:02:157
133979972,5cyclictest0-21swapper/700:13:457
133979972,4cyclictest0-21swapper/723:20:457
133979972,4cyclictest0-21swapper/722:25:017
133979972,4cyclictest0-21swapper/722:01:167
133979972,4cyclictest0-21swapper/721:15:167
133979972,4cyclictest0-21swapper/721:13:017
133979972,4cyclictest0-21swapper/721:00:467
133979972,4cyclictest0-21swapper/720:52:007
133979972,4cyclictest0-21swapper/719:32:007
133979972,4cyclictest0-21swapper/719:32:007
133979972,4cyclictest0-21swapper/700:22:167
133979971,5cyclictest0-21swapper/722:52:307
133979971,5cyclictest0-21swapper/720:48:157
133979971,5cyclictest0-21swapper/720:35:007
133979971,4cyclictest0-21swapper/722:13:317
133979970,6cyclictest0-21swapper/720:25:197
133909975,2cyclictest0-21swapper/600:29:296
133909975,1cyclictest17904-21cpu23:10:106
133909973,3cyclictest0-21swapper/619:23:006
133909972,4cyclictest0-21swapper/622:42:466
133909972,4cyclictest0-21swapper/622:31:166
133909972,4cyclictest0-21swapper/621:20:126
133909972,4cyclictest0-21swapper/620:16:306
133909972,4cyclictest0-21swapper/619:44:316
133909972,3cyclictest0-21swapper/619:55:216
133909972,2cyclictest0-21swapper/620:33:006
133909971,4cyclictest0-21swapper/623:20:186
133909970,6cyclictest564-21sh21:57:476
133909970,6cyclictest23178-21open_inodes19:25:196
133909970,6cyclictest23178-21open_inodes19:25:196
133909970,6cyclictest19253-21latency_hist19:20:006
133909970,6cyclictest14734-21fschecks_time23:35:116
133909970,6cyclictest14734-21fschecks_time23:35:106
133909970,6cyclictest10381-21sh23:30:346
133909970,6cyclictest0-21swapper/622:25:376
133909970,6cyclictest0-21swapper/622:05:316
133909970,6cyclictest0-21swapper/622:04:466
133909970,6cyclictest0-21swapper/620:40:306
133909970,6cyclictest0-21swapper/620:06:036
133909970,6cyclictest0-21swapper/619:46:286
133909970,6cyclictest0-21swapper/600:01:126
133909970,1cyclictest0-21swapper/623:05:506
133849973,4cyclictest0-21swapper/522:06:305
133849973,2cyclictest0-21swapper/523:47:235
133849973,1cyclictest53-21ksoftirqd/521:50:175
133849971,3cyclictest0-21swapper/523:37:195
133849971,3cyclictest0-21swapper/523:37:195
133849971,3cyclictest0-21swapper/523:10:185
133849971,3cyclictest0-21swapper/522:14:595
133849971,3cyclictest0-21swapper/500:10:065
133849971,3cyclictest0-21swapper/500:05:195
133849971,3cyclictest0-21swapper/500:00:115
133849970,6cyclictest323-21processes22:25:265
133849970,6cyclictest25534-21munin-node19:30:175
133849970,6cyclictest25534-21munin-node19:30:175
133849970,6cyclictest13315-21mdstat23:05:175
133849970,6cyclictest113-21kswapd022:22:205
133849970,6cyclictest0-21swapper/523:42:595
133849970,6cyclictest0-21swapper/522:58:135
133849970,6cyclictest0-21swapper/522:53:015
133849970,6cyclictest0-21swapper/522:47:505
133849970,6cyclictest0-21swapper/522:37:285
133849970,2cyclictest0-21swapper/500:19:565
133849970,1cyclictest0-21swapper/521:25:485
133849970,1cyclictest0-21swapper/500:35:145
133789975,2cyclictest0-21swapper/421:32:344
133789975,1cyclictest23262-21timerandwakeup00:10:274
133789972,4cyclictest0-21swapper/423:30:154
133789972,4cyclictest0-21swapper/421:26:004
133789972,4cyclictest0-21swapper/421:00:014
133789972,4cyclictest0-21swapper/420:20:154
133789971,5cyclictest0-21swapper/421:16:004
133789971,3cyclictest0-21swapper/423:20:314
133789970,6cyclictest6598-21cstates00:25:104
133789970,6cyclictest30287-21cstates20:45:114
133789970,6cyclictest29895-21latency_hist20:45:014
133789970,6cyclictest16357-21timerandwakeup20:15:254
133789970,6cyclictest0-21swapper/423:40:204
133789970,6cyclictest0-21swapper/423:25:224
133789970,6cyclictest0-21swapper/423:11:194
133789970,6cyclictest0-21swapper/423:07:484
133789970,6cyclictest0-21swapper/423:02:024
133789970,6cyclictest0-21swapper/422:55:454
133789970,6cyclictest0-21swapper/422:42:454
133789970,6cyclictest0-21swapper/422:28:054
133789970,6cyclictest0-21swapper/422:21:004
133789970,6cyclictest0-21swapper/422:17:084
133789970,6cyclictest0-21swapper/421:57:004
133789970,6cyclictest0-21swapper/421:05:234
133789970,6cyclictest0-21swapper/419:47:104
133789970,6cyclictest0-21swapper/419:24:004
133789970,6cyclictest0-21swapper/400:35:364
133789970,6cyclictest0-21swapper/400:30:054
133789970,6cyclictest0-21swapper/400:05:154
133789970,5cyclictest0-21swapper/420:35:164
133699976,0cyclictest30554-21snmpd21:11:163
133699971,5cyclictest0-21swapper/323:23:063
133699971,5cyclictest0-21swapper/322:45:073
133699971,5cyclictest0-21swapper/322:25:263
133699971,5cyclictest0-21swapper/321:40:023
133699971,5cyclictest0-21swapper/320:40:123
133699970,6cyclictest0-21swapper/323:40:093
133699970,6cyclictest0-21swapper/323:35:173
133699970,6cyclictest0-21swapper/323:35:173
133699970,6cyclictest0-21swapper/323:11:243
133699970,6cyclictest0-21swapper/322:55:263
133699970,6cyclictest0-21swapper/322:41:073
133699970,6cyclictest0-21swapper/322:31:263
133699970,6cyclictest0-21swapper/322:10:113
133699970,6cyclictest0-21swapper/322:06:123
133699970,6cyclictest0-21swapper/322:00:283
133699970,6cyclictest0-21swapper/321:25:373
133699970,6cyclictest0-21swapper/321:20:433
133699970,6cyclictest0-21swapper/321:15:083
133699970,6cyclictest0-21swapper/321:00:233
133699970,6cyclictest0-21swapper/320:50:123
133699970,6cyclictest0-21swapper/320:30:123
133699970,6cyclictest0-21swapper/320:20:133
133699970,6cyclictest0-21swapper/320:10:133
133699970,6cyclictest0-21swapper/320:05:253
133699970,6cyclictest0-21swapper/320:00:223
133699970,6cyclictest0-21swapper/319:50:123
133699970,6cyclictest0-21swapper/319:30:103
133699970,6cyclictest0-21swapper/319:30:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional