You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-09-11 - 16:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Wed Sep 11, 2024 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2443991030,5rtkit-daemon2442-21rtkit-daemon07:59:201
5409991014,26cyclictest0-21swapper/010:54:250
540999964,26cyclictest0-21swapper/008:04:170
5409999539,50cyclictest21226-21grep10:39:160
5409999418,10cyclictest23998-21aten_r1power_po07:34:170
540999937,19cyclictest0-21swapper/007:24:060
5409999318,12cyclictest0-21swapper/009:09:030
540999924,25cyclictest0-21swapper/008:31:530
5409999221,13cyclictest0-21swapper/006:42:060
541599914,79cyclictest20557-21munin-run06:24:091
541599914,79cyclictest20557-21munin-run06:24:091
540999906,27cyclictest0-21swapper/009:19:120
540999905,26cyclictest0-21swapper/007:52:170
540999904,27cyclictest0-21swapper/009:49:180
541599893,78cyclictest0-21swapper/106:19:091
541599893,78cyclictest0-21swapper/106:19:091
540999894,62cyclictest0-21swapper/007:39:220
540999894,27cyclictest0-21swapper/011:14:230
540999894,27cyclictest0-21swapper/011:14:230
540999894,27cyclictest0-21swapper/010:24:310
540999894,26cyclictest0-21swapper/009:47:060
540999894,26cyclictest0-21swapper/008:11:470
5409998918,12cyclictest0-21swapper/008:16:500
541599884,77cyclictest0-21swapper/107:14:081
541599883,52cyclictest12132-21cpuspeed_turbos08:14:181
540999885,24cyclictest0-21swapper/010:19:110
540999884,29cyclictest0-21swapper/008:44:200
540999884,27cyclictest0-21swapper/009:03:190
540999884,26cyclictest0-21swapper/009:59:140
540999884,26cyclictest0-21swapper/008:21:510
540999884,24cyclictest0-21swapper/006:54:190
541599873,77cyclictest25158-21unixbench_multi06:29:431
540999875,74cyclictest0-21swapper/010:49:190
5409998730,50cyclictest24989-21wc06:29:420
5409998718,12cyclictest0-21swapper/006:34:210
541599864,76cyclictest0-21swapper/109:29:141
541599864,75cyclictest0-21swapper/109:49:191
540999866,71cyclictest0-21swapper/007:31:180
540999864,75cyclictest0-21swapper/008:49:160
540999864,27cyclictest0-21swapper/009:39:140
540999864,26cyclictest0-21swapper/008:39:040
540999864,25cyclictest0-21swapper/011:09:100
5409998625,54cyclictest0-21swapper/007:59:330
5409998624,56cyclictest0-21swapper/008:24:360
5409998624,56cyclictest0-21swapper/008:24:360
5409998622,12cyclictest0-21swapper/009:24:230
541599853,75cyclictest23352-21grep10:44:131
540999855,73cyclictest0-21swapper/008:54:290
540999854,28cyclictest12213-21gltestperf07:09:260
540999854,26cyclictest0-21swapper/009:54:330
540999854,26cyclictest0-21swapper/009:54:330
540999854,26cyclictest0-21swapper/007:46:430
540999854,26cyclictest0-21swapper/007:46:430
541599844,73cyclictest0-21swapper/109:04:031
541599844,73cyclictest0-21swapper/107:39:061
541599843,74cyclictest0-21swapper/111:02:381
541599843,73cyclictest27410-21cut09:49:011
541599843,73cyclictest13371-21munin-node06:09:211
541599843,73cyclictest1304-21runrttasks11:19:261
540999846,9cyclictest98550irq/46-eth005:54:270
540999844,74cyclictest0-21swapper/007:24:310
540999844,72cyclictest0-21swapper/010:04:230
540999844,27cyclictest0-21swapper/010:59:110
540999844,26cyclictest0-21swapper/009:18:180
540999844,26cyclictest0-21swapper/006:14:210
540999844,26cyclictest0-21swapper/006:14:210
5409998416,13cyclictest0-21swapper/006:06:250
5409998415,14cyclictest0-21swapper/010:30:390
541599834,73cyclictest0-21swapper/110:57:331
541599834,72cyclictest6479-21fschecks_time05:54:281
541599833,74cyclictest26832-21df07:39:201
541599833,73cyclictest9434-21processes10:14:301
540999837,13cyclictest0-21swapper/008:40:210
540999835,13cyclictest0-21swapper/006:44:190
540999834,27cyclictest0-21swapper/006:50:220
540999834,15cyclictest0-21swapper/009:34:230
540999834,13cyclictest0-21swapper/007:14:190
5409998326,50cyclictest7150irq/45-ahci10:14:200
541599824,72cyclictest0-21swapper/109:24:261
541599824,57cyclictest0-21swapper/109:56:231
541599824,57cyclictest0-21swapper/109:56:231
541599823,71cyclictest2625-21munin-run10:04:001
540999824,70cyclictest0-21swapper/010:44:300
540999824,26cyclictest0-21swapper/006:24:200
540999824,12cyclictest0-21swapper/006:59:430
540999824,12cyclictest0-21swapper/006:59:430
5409998218,10cyclictest9231-21fschecks_time11:19:140
5409998214,11cyclictest0-21swapper/009:29:200
541599804,69cyclictest0-21swapper/109:19:141
541599803,71cyclictest11847-21irqstats06:04:321
541599803,70cyclictest30779-21cat06:44:081
541599803,70cyclictest12725-21latency_hist10:24:001
541599803,70cyclictest0-21swapper/110:53:571
540999809,8cyclictest98550irq/46-eth007:04:300
541599794,69cyclictest0-21swapper/107:55:211
541599793,69cyclictest1179-21cpu06:49:211
541599793,68cyclictest10065-21cpu09:14:151
541599793,67cyclictest0-21swapper/110:34:291
541599793,67cyclictest0-21swapper/110:34:291
541599793,60cyclictest0-21swapper/109:34:281
541599793,57cyclictest0-21swapper/111:08:581
541599793,49cyclictest6981-21cpu08:04:171
541599792,71cyclictest13780-21munin-node07:14:211
540999794,67cyclictest0-21swapper/010:09:140
540999794,13cyclictest0-21swapper/009:09:180
540999794,13cyclictest0-21swapper/009:09:180
540999793,70cyclictest10055-21unixbench_singl05:59:430
5409997912,8cyclictest1606-21munin-node07:54:420
541599785,60cyclictest23418-21yum-updatesd-he07:31:181
541599784,67cyclictest0-21swapper/108:51:391
541599784,66cyclictest0-21swapper/107:04:161
541599784,51cyclictest0-21swapper/107:26:391
541599784,49cyclictest0-21swapper/107:49:231
541599783,69cyclictest8507-21irqstats09:09:251
541599783,69cyclictest8507-21irqstats09:09:251
541599783,69cyclictest23663-21iostat_ios09:39:261
541599783,68cyclictest5978-21diskstats10:09:171
541599783,68cyclictest17234-21perl07:19:271
541599783,68cyclictest0-21swapper/107:44:281
541599783,68cyclictest0-21swapper/107:44:281
540999789,10cyclictest98550irq/46-eth006:09:370
540999783,21cyclictest0-21swapper/010:37:130
540999783,21cyclictest0-21swapper/010:37:130
5409997818,13cyclictest1783-21grep11:04:150
5409997817,9cyclictest0-21swapper/005:54:090
541599774,66cyclictest0-21swapper/108:34:281
541599773,68cyclictest7040-21runrttasks09:08:131
541599773,59cyclictest0-21swapper/106:34:201
541599768,48cyclictest0-21swapper/106:54:191
541599763,67cyclictest0-21swapper/110:24:221
541599763,67cyclictest0-21swapper/108:19:141
541599763,66cyclictest1283-21snmpd10:07:081
541599763,66cyclictest0-21swapper/108:44:251
541599763,65cyclictest20224-21fschecks_time08:29:221
5415997620,39cyclictest2141-21cat08:59:031
541599753,65cyclictest0-21swapper/108:28:141
541599753,65cyclictest0-21swapper/108:28:141
541599744,64cyclictest0-21swapper/108:09:291
541599743,64cyclictest0-21swapper/106:59:261
541599743,64cyclictest0-21swapper/106:59:261
541599743,63cyclictest30878-21runrttasks06:44:151
541599743,63cyclictest0-21swapper/111:14:401
541599743,63cyclictest0-21swapper/111:14:401
541599739,44cyclictest0-21swapper/105:59:221
541599734,43cyclictest0-21swapper/110:40:291
541599733,64cyclictest0-21swapper/110:29:251
5409997310,11cyclictest0-21swapper/006:19:210
5409997310,11cyclictest0-21swapper/006:19:210
541599723,63cyclictest0-21swapper/106:26:031
541599723,62cyclictest3419-21munin-node11:09:141
541599723,41cyclictest0-21swapper/108:39:181
541699694,29cyclictest0-21swapper/206:09:202
541599693,7cyclictest5521-21cat05:54:101
5416996132,12cyclictest0-21swapper/208:49:142
5417996045,9cyclictest30560-21switchtime07:44:373
5417996045,9cyclictest30560-21switchtime07:44:373
5416996032,12cyclictest0-21swapper/206:59:322
5416996032,12cyclictest0-21swapper/206:59:322
541799594,48cyclictest0-21swapper/307:29:403
221202593,49sleep322247-21cpuspeed_turbos08:34:163
5417995821,31cyclictest0-21swapper/306:04:303
541799574,46cyclictest0-21swapper/306:29:363
5416995730,12cyclictest0-21swapper/207:04:262
541799564,46cyclictest0-21swapper/308:39:313
541799564,45cyclictest0-21swapper/308:29:243
541799564,45cyclictest0-21swapper/308:24:043
541799564,45cyclictest0-21swapper/306:58:243
5416995630,12cyclictest0-21swapper/206:24:262
5416995630,11cyclictest0-21swapper/209:14:182
211302563,45sleep20-21swapper/210:39:162
541799554,45cyclictest0-21swapper/310:14:173
541799554,44cyclictest7117-21proc_pri05:54:393
541799554,44cyclictest0-21swapper/309:54:343
541799554,44cyclictest0-21swapper/309:54:343
541799554,44cyclictest0-21swapper/309:38:383
541799554,44cyclictest0-21swapper/308:44:353
541799554,44cyclictest0-21swapper/308:24:263
541799554,44cyclictest0-21swapper/308:24:263
541699553,45cyclictest0-21swapper/210:04:162
27522553,8sleep32816-21idleruntime07:54:273
274332552,10sleep20-21swapper/207:39:272
253282552,9sleep20-21swapper/208:39:232
541799544,44cyclictest0-21swapper/306:51:043
541799543,45cyclictest0-21swapper/310:34:153
541799543,45cyclictest0-21swapper/310:34:153
541799543,44cyclictest0-21swapper/310:54:193
5416995419,10cyclictest12118-21fschecks_time07:09:252
147912543,13sleep20-21swapper/207:14:292
121412545,42sleep312258-21cut07:09:263
541799534,44cyclictest0-21swapper/310:22:103
541799534,43cyclictest0-21swapper/307:39:223
541799534,43cyclictest0-21swapper/306:09:203
541799533,44cyclictest0-21swapper/311:16:013
541799533,44cyclictest0-21swapper/311:16:013
541699533,28cyclictest15252-21latency_hist10:28:592
26622534,42sleep20-21swapper/207:54:262
9902523,10sleep30-21swapper/307:49:443
541799524,42cyclictest0-21swapper/310:04:123
541799523,43cyclictest0-21swapper/309:39:273
5417995223,13cyclictest0-21swapper/309:14:023
5417995223,13cyclictest0-21swapper/309:14:023
5416995225,21cyclictest0-21swapper/210:34:132
5416995225,21cyclictest0-21swapper/210:34:132
541799513,42cyclictest0-21swapper/307:34:173
541799513,41cyclictest16635-21tr07:19:213
541799513,41cyclictest14107-21cpuspeed_turbos07:14:213
36682512,39sleep20-21swapper/206:54:182
214562512,10sleep20-21swapper/208:31:012
209502513,41sleep20-21swapper/207:26:582
541699505,38cyclictest0-21swapper/209:29:022
541699503,40cyclictest0-21swapper/208:34:132
233612502,10sleep20-21swapper/207:30:282
145912502,10sleep30-21swapper/309:22:563
100882502,40sleep20-21swapper/210:17:362
78742492,9sleep20-21swapper/205:58:362
541799493,40cyclictest0-21swapper/310:49:103
5417994917,9cyclictest5913-21latency_hist11:13:583
5416994933,10cyclictest25784-21grep07:34:392
5416994933,10cyclictest25372-21cpuspeed_turbos09:44:152
157202492,10sleep20-21swapper/206:14:122
157202492,10sleep20-21swapper/206:14:122
127422493,9sleep20-21swapper/208:14:252
541799485,28cyclictest0-21swapper/309:04:203
541799484,35cyclictest0-21swapper/309:14:363
5417994835,8cyclictest12798-21head08:14:243
5416994835,8cyclictest7767-21head08:04:252
5416994835,8cyclictest32293-21grep07:49:242
5416994834,9cyclictest6310-21grep11:14:102
5416994834,9cyclictest6310-21grep11:14:102
5416994833,9cyclictest27840-21grep08:44:212
5416994831,11cyclictest31883-21grep06:44:272
221632482,11sleep20-21swapper/209:37:462
164682482,9sleep20-21swapper/208:21:542
104372482,39sleep30-21swapper/311:19:473
73752472,10sleep30-21swapper/310:10:113
541799474,27cyclictest0-21swapper/309:59:353
541799474,27cyclictest0-21swapper/309:27:023
541799474,27cyclictest0-21swapper/308:01:453
541799474,27cyclictest0-21swapper/306:26:283
541799474,27cyclictest0-21swapper/305:59:313
541799474,26cyclictest0-21swapper/310:27:113
5417994720,12cyclictest0-21swapper/311:04:073
541699475,35cyclictest0-21swapper/206:34:092
5416994732,10cyclictest29109-21cut06:39:252
541699473,39cyclictest0-21swapper/210:49:232
5416994727,9cyclictest0-21swapper/208:56:192
297492472,10sleep30-21swapper/309:52:463
280772472,10sleep30-21swapper/306:38:353
278752472,9sleep20-21swapper/206:35:562
253212472,10sleep20-21swapper/210:48:222
245222472,10sleep30-21swapper/310:44:293
76242462,9sleep20-21swapper/210:13:252
541799467,25cyclictest0-21swapper/309:44:313
541799465,26cyclictest0-21swapper/306:39:343
541799465,26cyclictest0-21swapper/306:16:273
541799465,26cyclictest0-21swapper/306:16:273
5417994631,9cyclictest31442-21fschecks_time10:59:173
541699464,35cyclictest0-21swapper/210:33:592
541699464,35cyclictest0-21swapper/209:59:302
5416994633,8cyclictest5160-21cut07:59:252
5416994632,9cyclictest4247-21fschecks_time11:09:162
541699463,38cyclictest4813-21munin-node09:04:302
541699463,38cyclictest0-21swapper/211:04:152
44812462,11sleep20-21swapper/209:02:522
19902462,10sleep30-21swapper/308:58:543
195962462,10sleep20-21swapper/209:32:142
114972462,37sleep20-21swapper/208:12:562
541799454,26cyclictest0-21swapper/310:42:133
541799454,26cyclictest0-21swapper/307:26:393
541799454,25cyclictest0-21swapper/307:06:363
541799454,25cyclictest0-21swapper/306:44:413
5417994518,11cyclictest0-21swapper/308:04:163
541699454,33cyclictest0-21swapper/209:19:122
541699454,25cyclictest0-21swapper/206:09:092
43952452,9sleep30-21swapper/309:01:443
33782453,35sleep20-21swapper/206:53:292
245282452,9sleep20-21swapper/209:40:442
174302452,36sleep30-21swapper/309:29:053
125182452,36sleep20-21swapper/210:21:222
114212452,10sleep30-21swapper/308:11:563
541799449,10cyclictest98550irq/46-eth010:29:123
541799444,23cyclictest30675-21iostat08:49:253
541799443,25cyclictest0-21swapper/306:59:293
541799443,25cyclictest0-21swapper/306:59:293
541699444,24cyclictest0-21swapper/209:09:162
541699444,24cyclictest0-21swapper/209:09:162
5416994430,9cyclictest10294-21grep11:19:302
541699443,35cyclictest0-21swapper/205:59:262
5416994427,12cyclictest0-21swapper/207:44:332
5416994427,12cyclictest0-21swapper/207:44:332
5416994425,9cyclictest0-21swapper/209:54:372
5416994425,9cyclictest0-21swapper/209:54:372
5416994425,9cyclictest0-21swapper/209:53:442
5416994425,9cyclictest0-21swapper/208:26:062
5416994425,9cyclictest0-21swapper/208:26:062
3012442,36sleep20-21swapper/211:01:482
203512442,36sleep20-21swapper/206:21:372
203512442,36sleep20-21swapper/206:21:372
541799435,33cyclictest0-21swapper/306:19:213
541799435,33cyclictest0-21swapper/306:19:213
184602432,9sleep20-21swapper/207:22:302
53862423,30sleep35548-21sort05:54:103
541699413,32cyclictest0-21swapper/210:54:052
5416993818,9cyclictest0-21swapper/205:54:102
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional