You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-08-13 - 02:34

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-6100U @2300 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #7, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack7slot7s.osadl.org (updated Sat Aug 13, 2022 00:44:41)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1740218462,116sleep30-21swapper/319:08:553
1681218061,113sleep10-21swapper/119:08:101
1532210162,10sleep20-21swapper/219:06:182
164828961,24sleep00-21swapper/019:07:440
191582740,2sleep10-21swapper/119:45:181
140212710,2sleep20-21swapper/219:35:182
57012680,1sleep0211299cyclictest00:38:060
130712650,1sleep20-21swapper/200:21:412
246292620,0sleep00-21swapper/023:08:250
156872600,1sleep20-21swapper/222:03:082
46892220,2sleep10-21swapper/123:35:261
2113992016,2cyclictest0-21swapper/123:15:141
211399200,1cyclictest0-21swapper/122:55:141
78532190,2sleep30-21swapper/321:38:343
211299185,6cyclictest26769-21ssh23:30:000
298132160,1sleep30-21swapper/322:51:193
2114991512,2cyclictest17966-21ssh22:44:482
2113991512,2cyclictest0-21swapper/100:07:221
2113991511,3cyclictest2542-21munin-run23:15:001
292292140,1sleep20-21swapper/222:30:552
211399146,7cyclictest0-21swapper/123:25:181
211399140,3cyclictest32605-21ssh22:13:401
211299141,9cyclictest0-21swapper/021:55:140
211299141,9cyclictest0-21swapper/019:25:140
211299141,9cyclictest0-21swapper/019:25:130
206642140,13sleep157450irq/127-enp2s0-20:57:431
211599130,12cyclictest0-21swapper/322:49:303
211399134,1cyclictest0-21swapper/100:20:201
211399132,10cyclictest25-21ksoftirqd/122:20:161
211399130,9cyclictest25-21ksoftirqd/123:40:061
211399130,9cyclictest25-21ksoftirqd/122:35:461
211399130,3cyclictest24827-21ssh22:08:571
211299130,11cyclictest0-21swapper/000:07:280
303212120,2sleep20-21swapper/222:11:482
211399127,4cyclictest16850irq/16-i801_smb20:39:581
211399127,4cyclictest16850irq/16-i801_smb19:30:271
211399127,4cyclictest16850irq/16-i801_smb00:25:241
211399126,5cyclictest16850irq/16-i801_smb00:30:271
211399124,3cyclictest39-21rcuop/223:30:171
211399120,9cyclictest25-21ksoftirqd/121:47:371
211399120,8cyclictest25-21ksoftirqd/123:46:401
211399120,0cyclictest0-21swapper/100:39:301
211299121,9cyclictest0-21swapper/020:05:160
211299120,8cyclictest25982-21apache_accesses21:10:130
211599119,1cyclictest0-21swapper/321:15:543
211599119,1cyclictest0-21swapper/319:10:133
211599116,4cyclictest16850irq/16-i801_smb22:20:173
211599115,5cyclictest16850irq/16-i801_smb22:05:143
211499114,6cyclictest57650irq/129-enp2s0-23:40:212
211399119,1cyclictest0-21swapper/123:55:221
211399119,1cyclictest0-21swapper/120:05:171
211399117,3cyclictest16850irq/16-i801_smb22:15:211
211399116,4cyclictest16850irq/16-i801_smb22:50:231
211399116,4cyclictest16850irq/16-i801_smb20:50:231
211399112,8cyclictest25-21ksoftirqd/123:08:331
211399112,8cyclictest25-21ksoftirqd/121:57:321
211399111,6cyclictest19982-21unixbench_multi21:25:251
211399110,7cyclictest0-21swapper/100:10:201
211399110,6cyclictest0-21swapper/122:40:211
211399110,3cyclictest16442-21ssh22:03:441
211399110,10cyclictest25-21ksoftirqd/100:00:181
211299111,5cyclictest9204-21munin-run00:20:010
211299110,9cyclictest0-21swapper/020:20:140
211299110,7cyclictest0-21swapper/000:30:000
211599108,1cyclictest0-21swapper/322:03:193
211599106,3cyclictest16850irq/16-i801_smb23:40:333
211599106,3cyclictest16850irq/16-i801_smb21:40:233
211599106,3cyclictest16850irq/16-i801_smb19:40:243
211599105,4cyclictest16850irq/16-i801_smb23:05:263
211599105,4cyclictest16850irq/16-i801_smb19:49:483
211599104,1cyclictest10205-21sendmail-msp23:00:003
211599104,1cyclictest0-21swapper/323:25:223
211599103,6cyclictest25482-21perf21:10:003
211599102,2cyclictest5730-21ssh22:36:283
211599101,5cyclictest0-21swapper/323:10:003
211599100,7cyclictest0-21swapper/322:10:483
211599100,6cyclictest0-21swapper/322:43:223
211599100,5cyclictest1934-21latency_hist21:55:013
211499106,3cyclictest9659-21tr21:20:002
211499106,3cyclictest4194-21ntp_states23:55:222
211499104,5cyclictest57550irq/128-enp2s0-00:05:192
211499104,3cyclictest57550irq/128-enp2s0-23:38:052
211499101,3cyclictest0-21swapper/221:07:492
211499100,4cyclictest0-21swapper/200:00:212
211399108,1cyclictest0-21swapper/119:50:131
211399107,3cyclictest16850irq/16-i801_smb23:50:231
211399107,2cyclictest13644-21ssh23:01:041
211399106,4cyclictest16850irq/16-i801_smb21:40:221
211399106,3cyclictest16850irq/16-i801_smb21:15:051
211399106,3cyclictest16850irq/16-i801_smb20:40:241
211399106,3cyclictest16850irq/16-i801_smb19:35:251
211399106,3cyclictest16850irq/16-i801_smb19:20:251
211399104,5cyclictest16850irq/16-i801_smb21:00:011
211399103,3cyclictest57550irq/128-enp2s0-22:25:111
211399102,4cyclictest39-21rcuop/220:10:201
211399102,2cyclictest0-21swapper/121:21:431
211399101,8cyclictest25-21ksoftirqd/123:21:481
211399101,8cyclictest25-21ksoftirqd/122:30:031
211399100,9cyclictest25-21ksoftirqd/121:14:421
211399100,9cyclictest25-21ksoftirqd/100:17:541
211399100,9cyclictest0-21swapper/121:39:301
211399100,7cyclictest25-21ksoftirqd/122:45:331
211399100,4cyclictest5088-21df_inode19:15:211
211299104,5cyclictest3-21ksoftirqd/020:25:180
211299103,6cyclictest10571-21basename23:40:000
211299103,6cyclictest0-21swapper/020:55:120
211299101,5cyclictest0-21swapper/022:40:140
211299100,9cyclictest0-21swapper/023:50:110
211299100,8cyclictest0-21swapper/022:38:490
211299100,7cyclictest0-21swapper/022:55:200
211299100,3cyclictest0-21swapper/023:10:240
32107290,1sleep30-21swapper/321:13:473
24201290,1sleep30-21swapper/323:47:583
23774290,1sleep30-21swapper/321:48:203
21159997,1cyclictest0-21swapper/323:50:223
21159997,1cyclictest0-21swapper/323:30:263
21159997,1cyclictest0-21swapper/321:00:283
21159997,1cyclictest0-21swapper/320:45:233
21159997,1cyclictest0-21swapper/300:15:253
21159996,3cyclictest16850irq/16-i801_smb20:50:243
21159995,3cyclictest16850irq/16-i801_smb23:20:273
21159995,3cyclictest16850irq/16-i801_smb20:24:553
21159994,4cyclictest57350irq/126-enp2s0-00:05:313
21159993,5cyclictest57450irq/127-enp2s0-22:15:133
21159993,1cyclictest26184-21systemd-udevd00:10:063
21159990,8cyclictest29285-21grep20:05:273
21159990,8cyclictest18013-21idleruntime-cro00:05:013
21159990,8cyclictest0-21swapper/321:32:033
21159990,8cyclictest0-21swapper/320:10:253
21159990,7cyclictest234-21systemd-journal21:25:063
21159990,7cyclictest11377-21ssh21:20:203
21159990,7cyclictest0-21swapper/322:25:153
21159990,7cyclictest0-21swapper/319:35:153
21159990,5cyclictest0-21swapper/323:55:213
21159990,5cyclictest0-21swapper/300:23:273
21159990,2cyclictest0-21swapper/322:34:273
21149997,1cyclictest0-21swapper/222:05:142
21149996,2cyclictest2277-21/usr/sbin/munin19:10:132
21149995,3cyclictest9086-21/usr/sbin/munin19:25:152
21149995,3cyclictest9086-21/usr/sbin/munin19:25:152
21149995,3cyclictest10081-21munin-run22:40:002
21149995,1cyclictest57650irq/129-enp2s0-23:20:172
21149995,1cyclictest26488-21/usr/sbin/munin21:50:242
21149994,4cyclictest57650irq/129-enp2s0-22:25:272
21149994,4cyclictest57650irq/129-enp2s0-21:33:242
21149994,4cyclictest57550irq/128-enp2s0-00:36:472
21149994,4cyclictest19109-21/usr/sbin/munin23:45:232
21149994,2cyclictest26842-21sensors00:30:272
21149993,5cyclictest57350irq/126-enp2s0-23:25:162
21149993,5cyclictest26590-21perf23:10:002
21149993,3cyclictest57550irq/128-enp2s0-23:12:052
21149993,3cyclictest57550irq/128-enp2s0-22:52:562
21149993,3cyclictest57550irq/128-enp2s0-21:43:492
21149992,4cyclictest0-21swapper/222:45:462
21149991,2cyclictest0-21swapper/221:35:172
21149990,8cyclictest0-21swapper/223:00:182
21149990,6cyclictest0-21swapper/223:31:322
21149990,6cyclictest0-21swapper/221:20:182
21149990,5cyclictest0-21swapper/222:55:162
21139996,2cyclictest1766-21perf21:55:001
21139995,3cyclictest57350irq/126-enp2s0-19:10:131
21139995,3cyclictest16850irq/16-i801_smb19:25:231
21139995,3cyclictest16850irq/16-i801_smb19:25:231
21139992,2cyclictest10-21rcuop/021:30:231
21139990,8cyclictest25-21ksoftirqd/119:59:591
21139990,8cyclictest25-21ksoftirqd/119:40:161
21129997,1cyclictest3-21ksoftirqd/023:40:170
21129994,4cyclictest0-21swapper/022:08:570
21129994,4cyclictest0-21swapper/022:02:330
21129993,3cyclictest3-21ksoftirqd/000:10:130
21129993,3cyclictest0-21swapper/022:25:190
21129992,4cyclictest0-21swapper/022:50:140
21129991,5cyclictest0-21swapper/021:30:190
21129990,9cyclictest0-21swapper/000:20:230
21129990,8cyclictest16979-21ssh21:44:220
21129990,8cyclictest0-21swapper/023:30:410
21129990,8cyclictest0-21swapper/023:21:210
21129990,8cyclictest0-21swapper/022:34:220
21129990,8cyclictest0-21swapper/022:20:150
21129990,8cyclictest0-21swapper/022:10:160
21129990,8cyclictest0-21swapper/021:25:120
21129990,7cyclictest0-21swapper/023:18:420
21129990,6cyclictest18725-21apt-get22:45:140
21129990,5cyclictest0-21swapper/022:17:210
21129990,5cyclictest0-21swapper/020:45:150
21129990,1cyclictest0-21swapper/023:45:180
2042290,1sleep30-21swapper/321:55:043
388280,0sleep00-21swapper/020:15:160
21159986,1cyclictest0-21swapper/320:15:243
21159984,4cyclictest16850irq/16-i801_smb19:50:243
21159983,1cyclictest604-21/usr/sbin/munin00:35:203
21159982,4cyclictest7178-21grep20:30:213
21159981,3cyclictest0-21swapper/323:35:253
21159980,7cyclictest476-21dbus-daemon19:55:233
21159980,7cyclictest0-21swapper/323:16:243
21159980,7cyclictest0-21swapper/320:55:153
21159980,7cyclictest0-21swapper/320:40:133
21159980,7cyclictest0-21swapper/320:35:203
21159980,7cyclictest0-21swapper/300:30:223
21159980,6cyclictest9354-21cut19:25:163
21159980,6cyclictest9354-21cut19:25:163
21159980,6cyclictest5168-21uniq19:15:223
21159980,6cyclictest4676-21wget20:25:153
21159980,6cyclictest11679-21cpuspeed_turbos19:30:183
21159980,4cyclictest17681-21cpuspeed_turbos00:25:153
21159980,2cyclictest11000-21ssh23:00:183
21149987,1cyclictest0-21swapper/219:20:242
21149985,0cyclictest0-21swapper/220:15:142
21149984,3cyclictest57550irq/128-enp2s0-00:10:182
21149984,0cyclictest0-21swapper/221:00:222
21149984,0cyclictest0-21swapper/220:45:182
21149984,0cyclictest0-21swapper/220:05:212
21149984,0cyclictest0-21swapper/219:55:172
21149984,0cyclictest0-21swapper/219:15:252
21149983,4cyclictest57650irq/129-enp2s0-21:46:092
21149983,4cyclictest556-21snmpd23:52:082
21149983,2cyclictest0-21swapper/200:15:142
21149982,5cyclictest57650irq/129-enp2s0-21:25:272
21149982,5cyclictest25947-21/usr/sbin/munin21:10:232
21149982,5cyclictest0-21swapper/219:50:172
21149981,3cyclictest0-21swapper/200:25:132
21149981,2cyclictest2268-21ssh21:55:132
21149980,7cyclictest234-21systemd-journal20:34:552
21149980,7cyclictest0-21swapper/220:40:162
21149980,7cyclictest0-21swapper/220:10:212
21149980,6cyclictest2406-21/usr/sbin/munin22:15:112
21149980,4cyclictest0-21swapper/223:15:132
21149980,3cyclictest17248-21ssh22:24:192
21139985,3cyclictest16850irq/16-i801_smb20:30:271
21139985,3cyclictest16850irq/16-i801_smb20:25:231
21139984,3cyclictest32464-21wget20:15:151
21139983,4cyclictest16850irq/16-i801_smb20:50:001
21139981,6cyclictest0-21swapper/120:00:291
21139980,7cyclictest4459-21wc20:24:591
21129984,1cyclictest0-21swapper/021:50:100
21129983,1cyclictest0-21swapper/021:15:150
21129981,4cyclictest174-1kworker/0:1H19:15:300
21129980,8cyclictest0-21swapper/020:35:170
21129980,7cyclictest0-21swapper/023:55:130
21129980,6cyclictest2328-21ssh21:35:150
21129980,6cyclictest0-21swapper/023:00:300
21129980,5cyclictest0-21swapper/021:47:020
21129980,5cyclictest0-21swapper/021:20:230
21129980,5cyclictest0-21swapper/000:33:510
21129980,5cyclictest0-21swapper/000:00:340
21159972,4cyclictest57350irq/126-enp2s0-19:20:173
21159970,5cyclictest25422-21chrt20:00:173
21149976,1cyclictest0-21swapper/219:40:222
21149976,1cyclictest0-21swapper/219:30:272
21149974,2cyclictest25399-21/usr/sbin/munin20:00:202
21149973,3cyclictest18791-21/usr/sbin/munin20:55:142
21149973,1cyclictest9170-21/usr/sbin/munin20:35:242
21149970,6cyclictest0-21swapper/220:50:172
21149970,6cyclictest0-21swapper/220:25:142
21149970,6cyclictest0-21swapper/220:20:122
21139974,2cyclictest0-21swapper/121:10:001
21129977,0cyclictest0-21swapper/021:00:280
21129972,1cyclictest0-21swapper/021:05:030
21129970,7cyclictest0-21swapper/020:10:230
21129970,7cyclictest0-21swapper/020:00:270
21129970,7cyclictest0-21swapper/019:45:220
21129970,6cyclictest0-21swapper/020:50:020
21129970,6cyclictest0-21swapper/020:40:230
21129970,6cyclictest0-21swapper/019:55:130
21129970,6cyclictest0-21swapper/019:50:140
21129970,6cyclictest0-21swapper/019:40:190
21129970,6cyclictest0-21swapper/019:35:140
21129970,6cyclictest0-21swapper/019:30:200
21129970,6cyclictest0-21swapper/019:20:160
21129970,6cyclictest0-21swapper/019:10:120
21129970,1cyclictest0-21swapper/020:30:190
21149961,4cyclictest18278-21/usr/sbin/munin19:45:112
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional