You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2022-07-03 - 20:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  

x86 Intel Core i3-6100U @2300 MHz, Linux 4.9.47-rt37 (Profile)

Latency plot of shadow in rack #7, slot #7
Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Command line: cyclictest -l100000000 -m -Sp99 -i200 -h400 -q
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack7slot7s.osadl.org (updated Sun Jul 03, 2022 12:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22320218561,93sleep10-21swapper/107:06:521
22556218064,88sleep30-21swapper/307:09:563
2743621090,0sleep00-21swapper/011:55:210
2226229665,29sleep00-21swapper/007:06:070
124302930,2sleep02284699cyclictest11:07:020
2048628662,13sleep20-21swapper/207:05:122
58632810,1sleep20-21swapper/209:44:372
213082780,5sleep32284999cyclictest11:31:563
209922710,1sleep10-21swapper/109:14:331
90132670,4sleep32284999cyclictest09:26:163
211722630,1sleep10-21swapper/111:12:251
244682250,2sleep221085-21apache211:54:102
2284899251,23cyclictest61650irq/126-enp2s0-10:47:062
239442230,1sleep30-21swapper/312:32:563
2284699231,12cyclictest25303-21kworker/0:110:20:250
2284699226,6cyclictest29461-21munin-run08:35:010
2284899205,13cyclictest61650irq/126-enp2s0-10:58:222
325702190,2sleep20-21swapper/211:39:252
2284999190,1cyclictest0-21swapper/308:55:123
2284999190,16cyclictest61650irq/126-enp2s0-11:00:133
22848991916,2cyclictest1794-21apt-get12:00:122
299722180,2sleep10-21swapper/111:57:011
22849991815,2cyclictest61650irq/126-enp2s0-09:14:433
22848991815,2cyclictest6648-21apt-get07:45:122
2284699182,12cyclictest30797-21kworker/0:312:20:170
2284699182,11cyclictest25303-21kworker/0:110:08:440
2284699181,13cyclictest30797-21kworker/0:312:02:280
276442170,1sleep30-21swapper/309:18:193
22849991714,2cyclictest2456-21apt-get12:20:133
2284999170,16cyclictest61750irq/127-enp2s0-10:55:343
2284699172,9cyclictest25303-21kworker/0:109:25:050
2284699172,12cyclictest25303-21kworker/0:109:57:410
2284699172,10cyclictest30797-21kworker/0:310:48:010
2284699170,14cyclictest25303-21kworker/0:110:10:120
238852160,1sleep10-21swapper/109:55:131
2284699162,8cyclictest25303-21kworker/0:107:30:210
2284699162,11cyclictest30797-21kworker/0:312:30:520
2284699162,11cyclictest30797-21kworker/0:312:19:410
2284699162,11cyclictest25303-21kworker/0:108:55:170
2284699162,10cyclictest30797-21kworker/0:311:49:170
2284699162,10cyclictest25303-21kworker/0:110:37:120
2284699162,10cyclictest25303-21kworker/0:108:06:210
2284699161,9cyclictest25303-21kworker/0:109:05:160
2284699161,9cyclictest25303-21kworker/0:109:05:160
2284699161,8cyclictest25303-21kworker/0:110:00:440
2284699161,13cyclictest30797-21kworker/0:312:39:280
2284699161,11cyclictest30797-21kworker/0:311:15:570
2284699161,11cyclictest30797-21kworker/0:311:12:530
2284699160,12cyclictest30797-21kworker/0:310:55:490
2284999150,14cyclictest61750irq/127-enp2s0-09:44:073
22848991510,4cyclictest559-21snmpd11:59:512
2284699153,9cyclictest30797-21kworker/0:311:50:250
2284699153,8cyclictest25303-21kworker/0:107:15:320
2284699152,9cyclictest30797-21kworker/0:311:37:040
2284699152,8cyclictest25303-21kworker/0:107:55:170
2284699152,8cyclictest25303-21kworker/0:107:25:210
2284699152,7cyclictest25303-21kworker/0:110:17:330
2284699151,9cyclictest30797-21kworker/0:312:11:490
2284699151,9cyclictest25303-21kworker/0:107:42:170
2284699151,13cyclictest25303-21kworker/0:110:26:530
2284699151,13cyclictest25303-21kworker/0:108:36:050
2284699151,13cyclictest25303-21kworker/0:108:25:010
2284699151,11cyclictest30797-21kworker/0:311:31:120
2284699151,11cyclictest30797-21kworker/0:311:25:250
2284699151,11cyclictest30797-21kworker/0:311:25:240
2284699151,11cyclictest25303-21kworker/0:109:40:570
2284699151,11cyclictest25303-21kworker/0:109:33:560
2284699151,11cyclictest25303-21kworker/0:109:17:490
2284699151,10cyclictest30797-21kworker/0:311:40:130
2284699151,10cyclictest30797-21kworker/0:311:01:320
2284699151,10cyclictest25303-21kworker/0:110:34:080
2284699151,10cyclictest25303-21kworker/0:109:23:370
2284699150,13cyclictest30797-21kworker/0:310:41:120
217742150,13sleep161750irq/127-enp2s0-11:32:201
2284999148,5cyclictest16550irq/16-i801_smb12:35:233
2284899148,4cyclictest559-21snmpd10:06:412
2284699142,8cyclictest25303-21kworker/0:107:23:400
2284699142,7cyclictest25303-21kworker/0:108:20:000
2284699142,11cyclictest30797-21kworker/0:310:50:230
2284699141,9cyclictest25303-21kworker/0:109:47:050
2284699141,7cyclictest30797-21kworker/0:312:27:330
2284699141,11cyclictest25303-21kworker/0:107:10:090
2284699141,10cyclictest30797-21kworker/0:312:06:320
2284699141,10cyclictest25303-21kworker/0:109:00:250
2284699140,11cyclictest30797-21kworker/0:311:20:570
2284999138,4cyclictest16550irq/16-i801_smb11:35:223
2284799134,7cyclictest4093-21perf07:39:591
22847991311,1cyclictest0-21swapper/110:20:201
2284699133,6cyclictest25303-21kworker/0:107:50:080
2284699132,9cyclictest25303-21kworker/0:107:35:170
2284699132,7cyclictest25303-21kworker/0:108:14:530
2284699132,10cyclictest25303-21kworker/0:109:50:290
2284699131,8cyclictest25303-21kworker/0:109:11:080
2284699131,7cyclictest25303-21kworker/0:108:40:120
2284699130,9cyclictest25303-21kworker/0:109:37:120
2284699130,9cyclictest25303-21kworker/0:108:50:250
2284699130,8cyclictest25303-21kworker/0:108:15:120
2284999127,4cyclictest16550irq/16-i801_smb10:20:233
2284999127,4cyclictest16550irq/16-i801_smb08:50:213
2284899126,4cyclictest559-21snmpd11:40:162
2284699124,6cyclictest25303-21kworker/0:108:00:010
2284699121,6cyclictest25303-21kworker/0:107:49:240
2284699120,7cyclictest25303-21kworker/0:108:45:080
15862122,8sleep161750irq/127-enp2s0-12:00:031
124122120,10sleep312426-21sh11:07:023
2284999117,3cyclictest16550irq/16-i801_smb07:55:233
2284999116,4cyclictest16550irq/16-i801_smb09:50:263
2284999116,4cyclictest16550irq/16-i801_smb09:05:233
2284999116,4cyclictest16550irq/16-i801_smb09:05:223
2284999116,4cyclictest16550irq/16-i801_smb08:35:233
2284899117,3cyclictest72-21kswapd011:20:112
2284899117,3cyclictest559-21snmpd09:46:042
2284899116,3cyclictest26977-21apt-get12:35:142
2284899116,3cyclictest17420-21apache_accesses11:30:122
2284899113,2cyclictest10-21rcuop/010:00:162
2284799119,1cyclictest0-21swapper/111:01:091
2284799119,1cyclictest0-21swapper/107:15:291
2284799118,2cyclictest0-21swapper/112:05:121
2284799118,2cyclictest0-21swapper/109:30:271
2284799117,3cyclictest16550irq/16-i801_smb12:15:241
2284799117,3cyclictest13409-21diskmemload11:51:531
2284799116,4cyclictest16550irq/16-i801_smb10:05:231
2284999107,3cyclictest16550irq/16-i801_smb08:10:223
2284999107,3cyclictest16550irq/16-i801_smb07:35:213
2284999106,4cyclictest16550irq/16-i801_smb11:29:303
2284999106,4cyclictest16550irq/16-i801_smb11:29:303
2284999106,4cyclictest16550irq/16-i801_smb08:18:533
2284999106,3cyclictest16550irq/16-i801_smb11:55:223
2284999106,3cyclictest16550irq/16-i801_smb10:40:233
2284999106,3cyclictest16550irq/16-i801_smb09:55:243
2284999106,3cyclictest16550irq/16-i801_smb09:00:233
2284999106,3cyclictest16550irq/16-i801_smb08:00:223
2284999106,3cyclictest16550irq/16-i801_smb07:30:233
2284999106,3cyclictest16550irq/16-i801_smb07:20:213
2284999105,4cyclictest16550irq/16-i801_smb07:43:483
2284999104,5cyclictest61950irq/129-enp2s0-11:15:213
2284999100,5cyclictest0-21swapper/312:13:173
2284999100,5cyclictest0-21swapper/310:10:033
2284999100,5cyclictest0-21swapper/309:23:233
2284899107,2cyclictest31472-21apt-get10:20:132
2284899106,3cyclictest31202-21awk10:00:002
2284899106,3cyclictest29575-21munin-run07:25:002
2284899105,4cyclictest559-21snmpd11:03:132
2284899105,3cyclictest559-21snmpd09:36:282
2284899105,2cyclictest61850irq/128-enp2s0-10:51:512
2284899104,5cyclictest61950irq/129-enp2s0-11:45:372
2284899104,5cyclictest61750irq/127-enp2s0-12:30:202
2284899104,5cyclictest61650irq/126-enp2s0-12:05:132
2284899104,3cyclictest61750irq/127-enp2s0-11:15:192
2284899104,2cyclictest0-21swapper/209:25:142
2284899102,7cyclictest36-21ksoftirqd/211:07:452
2284899102,7cyclictest36-21ksoftirqd/210:27:312
2284899102,5cyclictest0-21swapper/210:11:072
2284899101,7cyclictest22546-21apt08:20:002
2284899100,7cyclictest36-21ksoftirqd/212:24:032
2284899100,7cyclictest36-21ksoftirqd/210:43:232
2284899100,7cyclictest36-21ksoftirqd/209:13:162
2284799109,1cyclictest0-21swapper/109:54:431
2284799108,1cyclictest0-21swapper/111:20:121
2284799107,2cyclictest24096-21sh12:13:241
2284799106,3cyclictest16550irq/16-i801_smb10:00:251
2284799104,3cyclictest0-21swapper/111:25:221
2284799104,3cyclictest0-21swapper/111:25:221
2284799101,2cyclictest0-21swapper/110:45:211
2284799100,7cyclictest25629-21ssh11:35:131
2284799100,5cyclictest61650irq/126-enp2s0-09:20:101
2284799100,5cyclictest0-21swapper/109:40:261
9844290,1sleep10-21swapper/110:26:021
23351290,1sleep10-21swapper/110:15:061
228499996,3cyclictest16550irq/16-i801_smb11:50:233
228499996,3cyclictest16550irq/16-i801_smb11:44:313
228499996,3cyclictest16550irq/16-i801_smb10:50:223
228499996,2cyclictest16550irq/16-i801_smb07:25:213
228499995,4cyclictest16550irq/16-i801_smb10:30:243
228499995,3cyclictest16550irq/16-i801_smb11:45:243
228499995,3cyclictest16550irq/16-i801_smb10:45:213
228499995,3cyclictest16550irq/16-i801_smb10:15:233
228499995,3cyclictest16550irq/16-i801_smb09:30:253
228499995,3cyclictest16550irq/16-i801_smb08:40:233
228499995,3cyclictest16550irq/16-i801_smb08:20:213
228499995,3cyclictest16550irq/16-i801_smb07:50:223
228499995,3cyclictest16550irq/16-i801_smb07:15:353
228499994,4cyclictest61650irq/126-enp2s0-09:37:023
228499994,4cyclictest16550irq/16-i801_smb10:35:223
228499994,4cyclictest16550irq/16-i801_smb07:45:223
228499990,8cyclictest0-21swapper/308:30:013
228499990,4cyclictest0-21swapper/312:15:063
228499990,2cyclictest0-21swapper/312:00:223
228489996,2cyclictest16317-21grep09:30:282
228489996,2cyclictest12357-21ls12:25:252
228489995,3cyclictest27256-21systemctl07:20:002
228489994,4cyclictest61850irq/128-enp2s0-08:30:122
228489993,6cyclictest61950irq/129-enp2s0-11:10:032
228489993,5cyclictest1348-21runrttasks09:23:172
228489993,3cyclictest61650irq/126-enp2s0-10:16:262
228489993,3cyclictest61650irq/126-enp2s0-09:15:122
228489993,2cyclictest0-21swapper/210:37:562
228489993,1cyclictest9980-21hddtemp_smartct11:25:172
228489993,1cyclictest9980-21hddtemp_smartct11:25:172
228489992,5cyclictest61650irq/126-enp2s0-10:32:572
228489990,8cyclictest36-21ksoftirqd/212:10:212
228489990,6cyclictest36-21ksoftirqd/212:17:422
228489990,2cyclictest0-21swapper/209:50:212
228479997,1cyclictest0-21swapper/112:34:401
228479997,1cyclictest0-21swapper/111:40:171
228479997,1cyclictest0-21swapper/110:50:271
228479997,1cyclictest0-21swapper/110:40:131
228479997,1cyclictest0-21swapper/110:30:471
228479997,1cyclictest0-21swapper/108:47:061
228479997,1cyclictest0-21swapper/107:51:221
228479997,1cyclictest0-21swapper/107:45:211
228479997,1cyclictest0-21swapper/107:40:231
228479997,1cyclictest0-21swapper/107:30:231
228479995,3cyclictest16550irq/16-i801_smb12:20:221
228479994,4cyclictest61750irq/127-enp2s0-09:15:191
228479992,2cyclictest61650irq/126-enp2s0-12:38:551
228479991,0cyclictest0-21swapper/107:10:121
228479990,8cyclictest0-21swapper/109:35:161
228479990,7cyclictest0-21swapper/108:05:211
228479990,5cyclictest0-21swapper/112:25:091
228479990,5cyclictest0-21swapper/110:55:151
228479990,5cyclictest0-21swapper/110:36:391
228479990,2cyclictest0-21swapper/110:10:011
14305290,1sleep10-21swapper/111:08:331
228499984,3cyclictest61850irq/128-enp2s0-12:09:343
228499984,3cyclictest16550irq/16-i801_smb08:30:233
228499983,4cyclictest61750irq/127-enp2s0-10:05:133
228499981,4cyclictest0-21swapper/308:45:143
228499980,7cyclictest25087-21cat07:15:013
228499980,7cyclictest10588-21ssh12:25:133
228499980,7cyclictest0-21swapper/311:10:113
228499980,7cyclictest0-21swapper/310:28:433
228499980,7cyclictest0-21swapper/310:04:503
228499980,7cyclictest0-21swapper/309:46:453
228499980,6cyclictest16126-21grep08:05:143
228499980,4cyclictest0-21swapper/311:20:123
228489987,1cyclictest0-21swapper/208:45:242
228489987,1cyclictest0-21swapper/208:35:232
228489985,2cyclictest23468-21tune2fs08:20:162
228489985,2cyclictest20180-21apt08:15:002
228489985,2cyclictest10988-21ls07:55:002
228489984,3cyclictest61950irq/129-enp2s0-07:40:232
228489984,3cyclictest1744-21munin-run07:34:592
228489984,3cyclictest14880-21sensors08:00:212
228489984,3cyclictest13407-21apt09:10:012
228489984,3cyclictest13407-21apt09:10:012
228489984,2cyclictest8557-21cron09:00:002
228489984,1cyclictest1965-21/usr/sbin/munin07:35:162
228489980,6cyclictest32251-21grep08:40:142
228489980,4cyclictest0-21swapper/208:55:192
228479987,0cyclictest0-21swapper/108:55:481
228479987,0cyclictest0-21swapper/108:26:351
228479986,1cyclictest0-21swapper/108:15:221
228479984,3cyclictest61950irq/129-enp2s0-07:25:161
228479984,3cyclictest61750irq/127-enp2s0-09:25:191
228479984,3cyclictest31991-21/usr/sbin/munin08:40:131
228479984,3cyclictest29675-21/usr/sbin/munin08:35:181
228479982,0cyclictest0-21swapper/109:45:131
228479980,7cyclictest0-21swapper/111:16:461
228479980,7cyclictest0-21swapper/107:20:111
228479980,5cyclictest559-21snmpd07:55:131
228479980,4cyclictest235-21systemd-journal08:33:311
228479980,4cyclictest0-21swapper/111:47:251
228489974,2cyclictest6296-21idleruntime-cro08:55:002
228489974,2cyclictest50-21rcuop/308:25:162
228489974,2cyclictest29814-21apache_processe07:25:112
228489974,2cyclictest12514-21awk07:55:222
228489972,3cyclictest23999-21ntp_states07:10:212
228489970,6cyclictest0-21swapper/208:05:192
228479973,0cyclictest0-21swapper/108:10:241
228479970,6cyclictest9686-21cut09:00:151
228479970,6cyclictest61650irq/126-enp2s0-08:00:181
228479970,6cyclictest0-21swapper/108:50:111
228479970,6cyclictest0-21swapper/108:20:151
228479970,2cyclictest0-21swapper/109:05:211
228479970,2cyclictest0-21swapper/109:05:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional