You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-03-28 - 07:11

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #0, slot #1

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Xeon E3-1230 V2 @3300 MHz, Linux 3.18.36-rt37 (Profile)

Latency plot of shadow in rack #0, slot #1
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack0slot1s.osadl.org (updated Tue Mar 28, 2023 00:45:46)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3266925434,17sleep30-21swapper/319:05:203
86924736,8sleep00-21swapper/019:06:450
75324523,18sleep70-21swapper/719:05:247
107424525,17sleep50-21swapper/519:09:395
3130024432,8sleep40-21swapper/419:05:054
81724222,17sleep60-21swapper/619:06:046
3248224228,9sleep10-21swapper/119:05:181
99423717,17sleep20-21swapper/219:08:332
1339992217,4cyclictest0-21swapper/520:25:115
1339992217,2cyclictest0-21swapper/523:40:265
1339992116,2cyclictest0-21swapper/522:39:565
1339992115,4cyclictest0-21swapper/521:08:565
1333992120,1cyclictest0-21swapper/423:28:154
1339992014,5cyclictest0-21swapper/522:06:265
1346991914,4cyclictest0-21swapper/621:44:566
1339991916,2cyclictest0-21swapper/523:27:565
1339991916,2cyclictest0-21swapper/500:39:265
1339991914,4cyclictest0-21swapper/523:30:265
1339991914,4cyclictest0-21swapper/520:51:265
1339991914,4cyclictest0-21swapper/519:10:165
1339991914,2cyclictest0-21swapper/522:25:185
1339991913,4cyclictest0-21swapper/521:25:255
1339991913,4cyclictest0-21swapper/521:25:255
1339991913,4cyclictest0-21swapper/520:19:415
133399191,17cyclictest0-21swapper/421:50:204
1339991814,2cyclictest0-21swapper/521:31:265
1339991814,2cyclictest0-21swapper/521:31:265
1339991814,1cyclictest0-21swapper/520:30:255
1339991813,4cyclictest0-21swapper/523:54:575
1339991813,4cyclictest0-21swapper/523:22:565
1339991813,4cyclictest0-21swapper/523:08:565
1339991813,4cyclictest0-21swapper/522:24:565
1339991813,4cyclictest0-21swapper/521:40:565
1333991814,3cyclictest0-21swapper/420:10:164
1346991714,2cyclictest0-21swapper/600:20:006
1339991714,2cyclictest0-21swapper/500:30:265
1339991713,3cyclictest0-21swapper/500:12:275
1339991712,2cyclictest0-21swapper/522:30:565
1339991712,2cyclictest0-21swapper/521:17:565
1339991712,2cyclictest0-21swapper/500:29:265
1333991714,2cyclictest0-21swapper/420:02:404
1333991713,1cyclictest0-21swapper/400:10:004
1329991712,4cyclictest0-21swapper/322:30:003
1316991712,2cyclictest0-21swapper/100:00:261
135099160,13cyclictest0-21swapper/719:55:157
1339991613,2cyclictest0-21swapper/521:55:255
1339991612,4cyclictest0-21swapper/523:10:115
1339991611,4cyclictest0-21swapper/500:17:265
1339991610,5cyclictest0-21swapper/522:54:265
133999160,13cyclictest0-21swapper/522:55:115
133999160,13cyclictest0-21swapper/521:24:105
1333991611,4cyclictest0-21swapper/421:15:154
133399160,2cyclictest0-21swapper/420:35:564
1322991613,1cyclictest0-21swapper/219:40:172
1310991614,1cyclictest0-21swapper/000:40:000
1346991511,1cyclictest0-21swapper/600:11:566
1339991513,1cyclictest0-21swapper/523:40:005
1339991512,2cyclictest0-21swapper/522:15:565
1339991512,2cyclictest0-21swapper/521:10:565
1339991512,2cyclictest0-21swapper/520:08:115
1339991512,2cyclictest0-21swapper/500:09:575
1339991511,3cyclictest0-21swapper/500:23:265
1339991511,1cyclictest0-21swapper/522:40:115
1339991510,4cyclictest0-21swapper/523:58:565
1339991510,4cyclictest0-21swapper/519:47:265
133999150,1cyclictest0-21swapper/520:38:415
1333991511,1cyclictest0-21swapper/422:45:264
1316991513,1cyclictest22760-21perf20:50:001
1316991511,3cyclictest0-21swapper/120:07:561
1310991513,1cyclictest0-21swapper/020:10:000
135099140,2cyclictest0-21swapper/723:26:117
135099140,13cyclictest0-21swapper/700:36:417
133999149,2cyclictest0-21swapper/521:39:265
1339991412,1cyclictest0-21swapper/519:25:265
1339991410,3cyclictest0-21swapper/519:32:565
133999140,11cyclictest0-21swapper/519:56:565
1333991412,2cyclictest0-21swapper/421:08:264
133399140,13cyclictest0-21swapper/419:27:264
1329991412,1cyclictest0-21swapper/320:50:143
1316991412,1cyclictest0-21swapper/121:10:001
131099140,10cyclictest13182-21munin-run23:34:590
135099130,1cyclictest0-21swapper/721:31:567
135099130,1cyclictest0-21swapper/721:31:567
133999139,3cyclictest0-21swapper/522:46:265
133999137,3cyclictest0-21swapper/520:41:265
133399139,1cyclictest28055-21munin-run21:00:004
133399130,2cyclictest0-21swapper/422:31:264
1316991312,1cyclictest2461-21snmpd19:40:551
1316991312,0cyclictest2461-21snmpd22:53:261
1316991312,0cyclictest2461-21snmpd22:04:561
131099131,11cyclictest0-21swapper/020:50:000
131099131,10cyclictest0-21swapper/022:59:590
1310991310,2cyclictest0-21swapper/020:55:000
131099130,10cyclictest0-21swapper/019:50:000
135099120,1cyclictest0-21swapper/721:38:407
1346991210,2cyclictest0-21swapper/620:29:256
133999129,2cyclictest0-21swapper/523:47:565
133999129,2cyclictest0-21swapper/523:17:265
1339991210,2cyclictest0-21swapper/523:01:565
133999120,12cyclictest0-21swapper/520:56:115
1329991211,0cyclictest2461-21snmpd00:18:563
131699129,2cyclictest14533-21df22:35:121
1316991211,0cyclictest2461-21snmpd21:28:411
1316991211,0cyclictest2461-21snmpd21:28:401
131099121,8cyclictest0-21swapper/019:30:000
131099121,2cyclictest0-21swapper/020:40:000
131099120,9cyclictest0-21swapper/021:10:000
131099120,9cyclictest0-21swapper/019:24:590
134699116,2cyclictest0-21swapper/622:43:266
133999116,4cyclictest0-21swapper/519:37:255
1339991110,1cyclictest0-21swapper/520:10:565
133399119,1cyclictest0-21swapper/419:50:144
133399118,3cyclictest0-21swapper/422:17:254
133399118,2cyclictest0-21swapper/422:55:264
133399116,4cyclictest0-21swapper/421:49:564
1333991110,1cyclictest0-21swapper/421:58:414
1333991110,1cyclictest0-21swapper/420:42:414
133399110,11cyclictest0-21swapper/420:21:414
1316991110,0cyclictest2461-21snmpd23:48:111
1316991110,0cyclictest2461-21snmpd19:34:111
131099117,1cyclictest26423-21awk23:59:590
131099111,9cyclictest0-21swapper/022:05:000
131099111,9cyclictest0-21swapper/021:55:200
131099111,9cyclictest0-21swapper/020:45:000
131099111,8cyclictest0-21swapper/020:25:000
131099111,7cyclictest0-21swapper/023:50:010
131099110,7cyclictest1661750cat22:40:010
131099110,7cyclictest1464450cat21:35:000
135099107,2cyclictest0-21swapper/723:24:407
135099107,2cyclictest0-21swapper/722:03:567
135099107,2cyclictest0-21swapper/720:55:167
135099107,2cyclictest0-21swapper/719:36:567
134699107,2cyclictest0-21swapper/623:23:556
134699104,3cyclictest0-21swapper/600:05:206
133999105,4cyclictest0-21swapper/522:12:265
133399109,1cyclictest0-21swapper/400:30:124
133399109,1cyclictest0-21swapper/400:29:124
133399106,3cyclictest0-21swapper/420:25:264
133399105,4cyclictest0-21swapper/420:05:114
131699109,0cyclictest2461-21snmpd00:18:111
131699108,1cyclictest2461-21snmpd23:59:411
131699107,1cyclictest7035-21portstat_300023:20:201
131699103,5cyclictest0-21swapper/119:20:561
131699101,6cyclictest0-21swapper/120:04:261
1316991010,0cyclictest2461-21snmpd23:34:111
1316991010,0cyclictest2461-21snmpd00:05:561
131099109,0cyclictest0-21swapper/021:45:010
131099108,2cyclictest0-21swapper/000:00:270
131099107,1cyclictest0-21swapper/022:50:010
131099107,1cyclictest0-21swapper/020:14:590
131099107,1cyclictest0-21swapper/019:59:590
131099106,2cyclictest0-21swapper/022:51:310
131099106,1cyclictest7885-21mrtg23:25:000
131099106,1cyclictest5241-21mrtg23:19:590
131099105,4cyclictest0-21swapper/023:25:120
131099101,8cyclictest0-21swapper/023:04:590
131099100,9cyclictest31963-21latency_hist00:10:000
131099100,9cyclictest0-21swapper/020:30:220
131099100,8cyclictest0-21swapper/023:52:260
131099100,8cyclictest0-21swapper/023:40:060
131099100,7cyclictest9977-21latency_hist00:30:010
131099100,7cyclictest4685-21mrtg00:19:590
131099100,7cyclictest2582-21latency_hist23:15:000
131099100,7cyclictest0-21swapper/021:00:000
131099100,7cyclictest0-21swapper/019:30:150
131099100,1cyclictest0-21swapper/022:20:120
13509993,4cyclictest0-21swapper/723:50:217
13509990,2cyclictest0-21swapper/719:30:157
13469991,2cyclictest0-21swapper/600:39:116
13399996,2cyclictest0-21swapper/519:42:255
13399992,4cyclictest0-21swapper/500:00:225
13399990,2cyclictest0-21swapper/519:22:265
13339998,1cyclictest0-21swapper/420:32:114
13339996,2cyclictest0-21swapper/419:14:264
13339995,3cyclictest0-21swapper/400:14:264
13339990,2cyclictest0-21swapper/423:03:264
13339990,2cyclictest0-21swapper/419:48:264
13299991,3cyclictest0-21swapper/300:05:203
13229993,4cyclictest0-21swapper/222:50:202
13229991,7cyclictest0-21swapper/221:10:192
13229991,7cyclictest0-21swapper/220:15:182
13229991,7cyclictest0-21swapper/219:20:262
13169999,0cyclictest2461-21snmpd23:44:261
13169999,0cyclictest2461-21snmpd22:07:261
13169999,0cyclictest2461-21snmpd19:47:411
13169996,2cyclictest13466-21portstat_8021:30:201
13169996,2cyclictest13466-21portstat_8021:30:201
13169993,2cyclictest0-21swapper/121:17:381
13169992,4cyclictest0-21swapper/122:19:061
13169991,7cyclictest0-21swapper/121:45:191
13169991,7cyclictest0-21swapper/121:40:261
13169991,7cyclictest0-21swapper/120:20:141
13169991,7cyclictest0-21swapper/119:35:361
13169991,7cyclictest0-21swapper/119:15:131
13109999,0cyclictest2461-21snmpd00:23:570
13109997,1cyclictest0-21swapper/022:30:010
13109997,1cyclictest0-21swapper/021:20:010
13109996,1cyclictest0-21swapper/022:05:180
13109995,3cyclictest0-21swapper/021:31:180
13109995,1cyclictest6884-21sa120:20:000
13109991,7cyclictest0-21swapper/023:35:210
13109991,7cyclictest0-21swapper/022:40:180
13109991,7cyclictest0-21swapper/021:45:210
13109990,8cyclictest31287-21latency_hist20:05:000
13109990,8cyclictest17185-21rateup21:40:010
13109990,8cyclictest0-21swapper/021:20:570
13109990,8cyclictest0-21swapper/000:30:270
13109990,7cyclictest0-21swapper/022:10:160
13109990,7cyclictest0-21swapper/021:26:510
13109990,7cyclictest0-21swapper/021:26:510
13109990,7cyclictest0-21swapper/021:10:230
13109990,7cyclictest0-21swapper/021:00:440
13109990,7cyclictest0-21swapper/019:45:000
13109990,6cyclictest0-21swapper/019:40:000
13109990,1cyclictest3962-21latency_hist19:15:000
13509985,2cyclictest0-21swapper/721:11:567
13509983,4cyclictest0-21swapper/700:02:267
13509983,2cyclictest0-21swapper/723:15:147
13509980,7cyclictest0-21swapper/723:55:227
13509980,1cyclictest0-21swapper/721:44:257
13469985,2cyclictest0-21swapper/623:50:566
13469984,2cyclictest0-21swapper/600:21:566
13469983,4cyclictest0-21swapper/623:16:116
13469983,4cyclictest0-21swapper/621:24:566
13469983,4cyclictest0-21swapper/620:04:266
13469980,2cyclictest0-21swapper/619:17:566
13399983,3cyclictest0-21swapper/521:00:145
13399983,2cyclictest0-21swapper/520:03:115
13399980,2cyclictest0-21swapper/519:50:565
13339987,1cyclictest0-21swapper/423:16:424
13339985,2cyclictest0-21swapper/419:19:404
13339984,3cyclictest0-21swapper/423:38:574
13339983,4cyclictest0-21swapper/421:30:164
13339983,4cyclictest0-21swapper/421:30:154
13339983,4cyclictest0-21swapper/419:43:264
13339983,4cyclictest0-21swapper/419:34:264
13339983,4cyclictest0-21swapper/419:20:224
13339981,6cyclictest0-21swapper/400:00:274
13339980,5cyclictest0-21swapper/419:56:104
13339980,2cyclictest0-21swapper/423:06:124
13339980,1cyclictest0-21swapper/422:37:414
13299981,6cyclictest0-21swapper/323:20:193
13299981,6cyclictest0-21swapper/323:05:193
13299981,6cyclictest0-21swapper/300:20:193
13229988,0cyclictest2461-21snmpd23:02:122
13229983,4cyclictest0-21swapper/222:10:162
13229981,6cyclictest0-21swapper/223:05:142
13229981,6cyclictest0-21swapper/222:03:532
13229981,6cyclictest0-21swapper/220:45:192
13229981,6cyclictest0-21swapper/220:40:352
13229981,6cyclictest0-21swapper/220:30:112
13229980,7cyclictest0-21swapper/223:15:202
13169988,0cyclictest2461-21snmpd20:10:261
13169987,1cyclictest2461-21snmpd22:40:261
13169983,4cyclictest0-21swapper/122:25:201
13169983,4cyclictest0-21swapper/119:10:151
13169982,5cyclictest0-21swapper/123:39:071
13169982,5cyclictest0-21swapper/120:36:061
13169982,2cyclictest0-21swapper/100:27:371
13169981,6cyclictest0-21swapper/123:50:201
13169981,6cyclictest0-21swapper/123:00:281
13169981,6cyclictest0-21swapper/122:55:201
13169981,6cyclictest0-21swapper/122:30:241
13169981,6cyclictest0-21swapper/122:20:121
13169981,6cyclictest0-21swapper/122:10:121
13169981,6cyclictest0-21swapper/121:55:221
13169981,6cyclictest0-21swapper/121:50:141
13169981,6cyclictest0-21swapper/121:35:201
13169981,6cyclictest0-21swapper/121:24:331
13169981,6cyclictest0-21swapper/121:00:111
13169981,6cyclictest0-21swapper/120:40:351
13169981,6cyclictest0-21swapper/120:25:111
13169981,6cyclictest0-21swapper/119:50:241
13169981,6cyclictest0-21swapper/100:35:201
13169981,6cyclictest0-21swapper/100:30:251
13169981,6cyclictest0-21swapper/100:20:171
13169981,3cyclictest0-21swapper/120:56:421
13169980,7cyclictest0-21swapper/122:45:251
13169980,7cyclictest0-21swapper/120:50:201
13169980,4cyclictest0-21swapper/119:28:481
13109986,2cyclictest0-21swapper/019:50:190
13109985,1cyclictest0-21swapper/022:15:390
13109983,4cyclictest0-21swapper/020:25:140
13109981,6cyclictest0-21swapper/022:30:190
13109981,6cyclictest0-21swapper/021:50:130
13109981,6cyclictest0-21swapper/019:15:190
13109980,6cyclictest0-21swapper/023:06:390
13109980,3cyclictest0-21swapper/000:14:410
18152270,1sleep70-21swapper/723:40:457
13509975,1cyclictest18090-21cstates20:40:237
13509972,4cyclictest0-21swapper/722:45:017
13509972,4cyclictest0-21swapper/720:10:167
13509972,4cyclictest0-21swapper/719:15:157
13509972,4cyclictest0-21swapper/700:20:257
13509971,4cyclictest0-21swapper/721:27:117
13509971,4cyclictest0-21swapper/721:27:117
13509970,6cyclictest4954-21tr22:15:197
13509970,6cyclictest0-21swapper/719:50:177
13509970,5cyclictest0-21swapper/700:05:417
13509970,4cyclictest0-21swapper/700:19:567
13509970,1cyclictest0-21swapper/721:23:267
13469973,3cyclictest0-21swapper/623:25:406
13469973,3cyclictest0-21swapper/622:30:226
13469973,1cyclictest0-21swapper/620:40:266
13469972,4cyclictest0-21swapper/622:48:416
13469971,5cyclictest0-21swapper/623:02:276
13469970,6cyclictest0-21swapper/623:46:526
13469970,6cyclictest0-21swapper/622:50:246
13469970,6cyclictest0-21swapper/622:07:396
13469970,6cyclictest0-21swapper/621:32:326
13469970,6cyclictest0-21swapper/621:32:326
13469970,6cyclictest0-21swapper/621:18:006
13469970,6cyclictest0-21swapper/621:14:416
13469970,6cyclictest0-21swapper/620:05:046
13469970,6cyclictest0-21swapper/619:58:416
13469970,6cyclictest0-21swapper/619:50:426
13469970,6cyclictest0-21swapper/619:46:556
13469970,6cyclictest0-21swapper/619:40:456
13469970,6cyclictest0-21swapper/619:25:436
13469970,6cyclictest0-21swapper/600:34:166
13469970,6cyclictest0-21swapper/600:04:206
13469970,4cyclictest0-21swapper/622:28:566
13469970,1cyclictest0-21swapper/621:56:266
13469970,1cyclictest0-21swapper/621:03:256
13399971,5cyclictest0-21swapper/520:21:175
13399971,5cyclictest0-21swapper/519:15:005
13339976,1cyclictest0-21swapper/421:11:114
13339975,1cyclictest7712-21swap22:20:234
13339975,1cyclictest24458-21ntpdc20:50:174
13339972,4cyclictest0-21swapper/423:45:154
13339972,3cyclictest0-21swapper/423:56:214
13339971,2cyclictest0-21swapper/422:00:134
13339970,6cyclictest18175-21latency_hist19:40:004
13339970,6cyclictest10595-21missed_timers21:25:194
13339970,6cyclictest10595-21missed_timers21:25:184
13339970,6cyclictest0-21swapper/423:50:394
13339970,6cyclictest0-21swapper/422:41:404
13339970,5cyclictest0-21swapper/422:10:264
13339970,5cyclictest0-21swapper/422:09:264
13339970,4cyclictest0-21swapper/423:21:424
13339970,4cyclictest0-21swapper/421:00:574
13339970,4cyclictest0-21swapper/420:16:564
13339970,4cyclictest0-21swapper/400:18:414
13299975,1cyclictest4367-21munin-node19:15:013
13299975,1cyclictest28413-21munin-node00:00:303
13299975,1cyclictest2749-21grep22:10:223
13299975,1cyclictest17929-21fschecks_count21:40:193
13299973,3cyclictest0-21swapper/322:40:153
13299973,1cyclictest0-21swapper/321:30:153
13299973,1cyclictest0-21swapper/321:30:153
13299971,5cyclictest0-21swapper/322:55:213
13299971,5cyclictest0-21swapper/322:25:003
13299971,5cyclictest0-21swapper/322:15:223
13299971,5cyclictest0-21swapper/321:50:203
13299970,6cyclictest31259-21cpuspeed_turbos21:05:113
13299970,6cyclictest19110-21fschecks_time19:40:163
13299970,6cyclictest0-21swapper/323:15:123
13299970,6cyclictest0-21swapper/322:50:243
13299970,6cyclictest0-21swapper/322:35:193
13299970,6cyclictest0-21swapper/322:33:393
13299970,6cyclictest0-21swapper/322:05:523
13299970,6cyclictest0-21swapper/321:35:183
13299970,6cyclictest0-21swapper/321:21:163
13299970,6cyclictest0-21swapper/321:15:223
13299970,6cyclictest0-21swapper/321:00:013
13299970,6cyclictest0-21swapper/320:32:213
13299970,6cyclictest0-21swapper/320:16:593
13299970,6cyclictest0-21swapper/320:00:183
13299970,6cyclictest0-21swapper/319:46:323
13299970,6cyclictest0-21swapper/300:30:533
13229975,1cyclictest529-21md0_raid123:31:462
13229975,1cyclictest14627-21latency23:35:172
13229975,1cyclictest0-21swapper/200:00:222
13229972,4cyclictest0-21swapper/200:25:152
13229971,5cyclictest0-21swapper/222:35:012
13229971,5cyclictest0-21swapper/222:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional