You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2023-01-31 - 05:38

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #5, slot #4

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel

x86 Intel Core i7-E610 @2530 MHz, Linux 5.4.17-rt9 (Profile)

Latency plot of shadow in rack #5, slot #4
Data to construct the above plot have been generated using the RT test utility cyclictest.
Command line: cyclictest -l100000000 -m -n -a -t3 -p99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: ondemand
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack5slot4s.osadl.org (updated Tue Jan 31, 2023 00:44:55)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2811599141140,1cyclictest0-21swapper/219:14:412
1002221150,0sleep30-21swapper/322:40:503
22754210521,80sleep00-21swapper/019:05:060
27672210290,9sleep10-21swapper/119:06:231
27025210186,11sleep20-21swapper/219:05:282
256952860,0sleep30-21swapper/320:00:293
227802850,0sleep09-21ksoftirqd/022:50:160
286452830,0sleep00-21swapper/022:15:360
272352790,0sleep00-21swapper/020:05:180
263792790,0sleep20-21swapper/200:20:342
30602760,1sleep03062-21kthreadcore00:25:250
223882760,0sleep00-21swapper/022:30:300
96692730,0sleep00-21swapper/022:40:390
2782527061,6sleep30-21swapper/319:08:223
28110996765,1cyclictest0-21swapper/119:14:411
243622640,0sleep00-21swapper/023:43:050
28105994941,8cyclictest0-21swapper/019:14:410
191362330,0sleep00-21swapper/023:21:350
274132280,1sleep30-21swapper/323:25:343
101542280,1sleep00-21swapper/021:49:460
2811099230,22cyclictest0-21swapper/123:20:171
157452220,0sleep10-21swapper/100:32:221
2811099192,12cyclictest6359-21munin-run20:44:591
28110991911,6cyclictest21-21ksoftirqd/123:25:221
2811099190,17cyclictest538-21systemd-logind19:45:301
2811099190,17cyclictest352-21systemd-journal20:33:401
2810599190,17cyclictest352-21systemd-journal23:54:320
24952190,1sleep3341rcuc/322:20:263
2811599180,17cyclictest538-21systemd-logind22:25:402
2811599180,16cyclictest352-21systemd-journal23:50:292
2811599180,16cyclictest352-21systemd-journal21:31:492
2811099188,5cyclictest0-21swapper/122:25:341
2811099184,9cyclictest0-21swapper/122:05:101
2811099184,11cyclictest30226-21ssh22:17:171
2811099183,10cyclictest9288-21ssh21:13:151
2811099182,13cyclictest22479-21ssh23:40:521
2811099181,16cyclictest0-21swapper/123:45:231
2811099180,13cyclictest32141-21idleruntime-cro00:25:011
28105991810,6cyclictest0-21swapper/020:30:220
181962180,0sleep20-21swapper/219:55:232
2811599170,16cyclictest352-21systemd-journal21:15:002
2811599170,16cyclictest352-21systemd-journal19:24:552
2811599170,15cyclictest352-21systemd-journal22:35:002
2811599170,15cyclictest352-21systemd-journal21:24:332
2811099177,6cyclictest21-21ksoftirqd/123:50:201
2811099174,8cyclictest7104-21ssh00:28:021
2811099174,8cyclictest0-21swapper/121:00:351
2811099174,8cyclictest0-21swapper/120:04:131
2811099174,6cyclictest0-21swapper/123:07:401
2811099174,6cyclictest0-21swapper/122:52:021
2811099174,6cyclictest0-21swapper/122:43:271
2811099172,10cyclictest0-21swapper/120:25:441
28110991714,2cyclictest6241-21ssh00:10:201
2811099171,13cyclictest24775-21strings21:20:331
2811099170,16cyclictest352-21systemd-journal20:46:281
2811099170,15cyclictest538-21systemd-logind19:35:281
2811099170,15cyclictest352-21systemd-journal20:54:391
2810599170,15cyclictest352-21systemd-journal22:20:390
2810599170,15cyclictest352-21systemd-journal21:33:390
2810599170,15cyclictest352-21systemd-journal21:19:550
2811599160,15cyclictest538-21systemd-logind21:40:392
2811599160,15cyclictest352-21systemd-journal22:52:332
2811599160,15cyclictest352-21systemd-journal22:00:302
2811599160,14cyclictest352-21systemd-journal20:35:002
2811099165,6cyclictest15911-21ssh21:50:311
2811099165,6cyclictest0-21swapper/123:30:041
2811099165,6cyclictest0-21swapper/123:15:231
2811099165,6cyclictest0-21swapper/121:17:211
2811099165,6cyclictest0-21swapper/121:07:301
2811099165,6cyclictest0-21swapper/120:07:101
2811099165,6cyclictest0-21swapper/119:50:581
2811099165,6cyclictest0-21swapper/100:17:411
2811099165,6cyclictest0-21swapper/100:00:281
2811099164,10cyclictest0-21swapper/119:28:391
2811099163,8cyclictest0-21swapper/122:30:261
2811099163,6cyclictest0-21swapper/122:48:201
2811099163,10cyclictest4831-21ssh22:04:371
28110991614,1cyclictest0-21swapper/122:10:201
2811099160,14cyclictest352-21systemd-journal21:36:331
2811099160,11cyclictest2538-21ssh22:55:261
2810599165,6cyclictest0-21swapper/020:49:030
2810599163,8cyclictest32098-21ssh23:46:170
2810599160,15cyclictest352-21systemd-journal21:13:300
2810599160,15cyclictest352-21systemd-journal20:25:310
2810599160,15cyclictest352-21systemd-journal20:21:280
2810599160,15cyclictest352-21systemd-journal20:03:280
2810599160,14cyclictest352-21systemd-journal23:32:400
2810599160,14cyclictest352-21systemd-journal19:54:390
198862160,0sleep30-21swapper/300:35:293
166792160,0sleep0101rcuc/020:50:290
2811599150,14cyclictest352-21systemd-journal22:44:322
2811599150,14cyclictest352-21systemd-journal22:35:002
2811599150,14cyclictest352-21systemd-journal20:27:012
2811599150,14cyclictest352-21systemd-journal19:15:012
2811099157,6cyclictest0-21swapper/122:20:351
2811099155,6cyclictest0-21swapper/123:58:361
2811099155,6cyclictest0-21swapper/121:56:131
2811099154,6cyclictest8736-21apt-get23:00:171
2811099154,6cyclictest0-21swapper/123:36:431
2811099154,6cyclictest0-21swapper/123:14:181
2811099154,6cyclictest0-21swapper/121:46:001
2811099154,6cyclictest0-21swapper/121:44:271
2811099154,6cyclictest0-21swapper/121:32:571
2811099154,6cyclictest0-21swapper/121:26:181
2811099154,6cyclictest0-21swapper/120:35:231
2811099154,6cyclictest0-21swapper/120:15:561
2811099154,6cyclictest0-21swapper/120:11:071
2811099154,6cyclictest0-21swapper/119:55:141
2811099154,6cyclictest0-21swapper/119:40:261
2811099154,6cyclictest0-21swapper/119:30:091
2811099154,6cyclictest0-21swapper/119:17:271
2811099154,6cyclictest0-21swapper/100:06:191
2811099150,10cyclictest11878-21/usr/sbin/munin20:20:371
2810599154,6cyclictest12278-21ssh00:12:030
2810599154,6cyclictest0-21swapper/023:35:260
2810599154,6cyclictest0-21swapper/023:28:540
2810599152,8cyclictest23115-21apt-get00:20:020
2810599152,8cyclictest0-21swapper/022:05:220
2810599152,11cyclictest0-21swapper/022:14:370
33912140,2sleep228-21ksoftirqd/220:40:312
297032140,3sleep228-21ksoftirqd/222:16:372
2811599140,13cyclictest352-21systemd-journal21:38:282
2811599140,13cyclictest352-21systemd-journal20:10:012
2811599140,13cyclictest352-21systemd-journal19:34:312
2811099143,6cyclictest0-21swapper/120:55:301
2811099143,6cyclictest0-21swapper/119:20:041
2811099143,6cyclictest0-21swapper/100:36:061
2811099140,12cyclictest28016-21ssh22:35:151
2810599149,3cyclictest0-21swapper/020:35:170
2810599144,8cyclictest0-21swapper/022:25:400
2810599144,6cyclictest9282-21sensors_temp19:45:320
2810599144,5cyclictest0-21swapper/000:00:280
2810599143,6cyclictest32416-21/usr/sbin/munin19:40:250
2810599143,6cyclictest0-21swapper/021:50:230
2810599143,6cyclictest0-21swapper/019:38:160
2810599143,6cyclictest0-21swapper/019:30:220
2810599143,6cyclictest0-21swapper/019:16:180
2810599142,11cyclictest977-21ssh21:45:000
2810599141,8cyclictest0-21swapper/019:25:150
2810599141,10cyclictest1623-21sort21:10:000
2810599140,12cyclictest352-21systemd-journal21:05:000
216142144,5sleep30-21swapper/320:28:383
2811599139,3cyclictest25740-21latency00:00:312
28115991310,2cyclictest3374-21ssh21:27:192
2811599130,12cyclictest352-21systemd-journal23:59:002
2811599130,12cyclictest352-21systemd-journal23:25:022
2811599130,12cyclictest352-21systemd-journal21:04:322
2811599130,12cyclictest352-21systemd-journal20:21:012
2810599136,6cyclictest9-21ksoftirqd/020:44:590
2810599133,8cyclictest0-21swapper/020:56:470
2810599132,6cyclictest0-21swapper/000:15:250
28105991311,1cyclictest9-1ksoftirqd/021:30:010
2810599130,8cyclictest5182-21munin-run22:05:000
2810599130,12cyclictest352-21systemd-journal23:17:390
2810599130,12cyclictest352-21systemd-journal20:16:310
2810599130,11cyclictest352-21systemd-journal23:05:330
2810599130,11cyclictest352-21systemd-journal23:00:440
28115991211,1cyclictest26091-21ssh23:09:242
2811599120,11cyclictest3888-21ssh00:07:132
2811599120,11cyclictest352-21systemd-journal23:16:302
2811599120,11cyclictest30747-21ssh23:10:302
2811599120,11cyclictest0-21swapper/223:40:502
2811599120,11cyclictest0-21swapper/200:10:322
2811599120,10cyclictest352-21systemd-journal21:45:022
2811599120,10cyclictest26216-21taskset23:45:052
2811599120,10cyclictest0-21swapper/200:35:292
2810599129,2cyclictest332-21diskstats20:10:230
2810599124,6cyclictest0-21swapper/023:11:420
2810599124,6cyclictest0-21swapper/022:56:540
2810599124,6cyclictest0-21swapper/022:47:050
2810599124,6cyclictest0-21swapper/021:20:210
2810599124,6cyclictest0-21swapper/000:08:380
2810599122,5cyclictest0-21swapper/023:55:250
2810599121,6cyclictest0-21swapper/022:39:560
2810599121,6cyclictest0-21swapper/000:30:110
2810599120,2cyclictest25883-21ssh00:39:500
2810599120,11cyclictest352-21systemd-journal21:37:280
2810599120,10cyclictest352-21systemd-journal21:55:320
2810599120,10cyclictest352-21systemd-journal19:20:030
2811599116,4cyclictest5388-21grep22:20:332
2811599115,2cyclictest15468-21grep00:15:232
28115991110,1cyclictest0-21swapper/221:57:202
2811599110,9cyclictest352-21systemd-journal22:05:392
2811599110,9cyclictest352-21systemd-journal20:54:592
2811599110,9cyclictest352-21systemd-journal19:50:002
2811599110,10cyclictest0-21swapper/220:55:162
2811599110,10cyclictest0-21swapper/200:25:562
2811599109,1cyclictest0-21swapper/223:36:052
2811599109,1cyclictest0-21swapper/220:10:242
2811599105,3cyclictest28929-21cat20:35:242
2811599100,9cyclictest352-21systemd-journal22:55:322
2811599100,9cyclictest352-21systemd-journal20:49:312
2811599100,9cyclictest352-21systemd-journal20:19:552
2811599100,9cyclictest352-21systemd-journal19:54:012
2811599100,9cyclictest352-21systemd-journal19:42:022
2811599100,9cyclictest352-21systemd-journal19:29:012
2811599100,9cyclictest1592-21diskmemload22:14:322
2811599100,9cyclictest0-21swapper/223:20:022
2811599100,9cyclictest0-21swapper/221:15:102
2811599100,9cyclictest0-21swapper/200:31:352
2811599100,1cyclictest0-21swapper/223:32:262
2811599100,1cyclictest0-21swapper/223:01:012
2811599100,1cyclictest0-21swapper/222:45:022
2811599100,1cyclictest0-21swapper/221:50:072
32430290,2sleep3111-21kworker/3:122:55:203
281159998,1cyclictest0-21swapper/219:35:172
281159990,8cyclictest352-21systemd-journal20:03:012
281159990,7cyclictest352-21systemd-journal21:05:222
281059990,8cyclictest352-21systemd-journal19:55:080
24109290,0sleep30-21swapper/322:50:233
3062280,0sleep30-21swapper/321:45:253
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:327
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
none16:00:326
7142260,1sleep3111-21kworker/3:123:34:153
23474260,0sleep30-21swapper/319:30:243
21933260,1sleep30-21swapper/300:18:283
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
none16:00:325
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional