You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2024-04-16 - 16:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 16, 2024 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
114612960,4sleep041ktimersoftd/008:32:440
114612960,4sleep041ktimersoftd/008:32:440
18917999217,20cyclictest0-21swapper/007:57:350
18919998822,58cyclictest0-21swapper/208:22:402
18919998736,32cyclictest6811-21crond06:12:262
18919998736,32cyclictest6811-21crond06:12:262
18918998430,46cyclictest0-21swapper/109:07:201
18918998340,37cyclictest13414-21unixbench_multi10:42:531
18918998326,50cyclictest30615-21fschecks_time06:57:571
18918998320,56cyclictest0-21swapper/108:57:211
18919998224,49cyclictest0-21swapper/206:32:422
18919998223,32cyclictest0-21swapper/206:37:522
18919998129,44cyclictest1286-21runrttasks08:52:552
18919998127,46cyclictest0-21swapper/207:37:552
18918998125,49cyclictest0-21swapper/107:37:531
18919998032,33cyclictest580-21grep10:17:532
18918998025,48cyclictest0-21swapper/107:17:101
18919997959,13cyclictest1329-21aten_r1power_cu10:22:262
18919997929,11cyclictest11285-21grep09:37:312
18919997928,43cyclictest21681-21diskstats09:57:362
18919997927,44cyclictest0-21swapper/205:57:432
18918997934,14cyclictest18297-21cut08:47:321
18919997831,39cyclictest0-21swapper/209:02:342
18919997826,43cyclictest0-21swapper/210:37:372
18919997823,47cyclictest0-21swapper/205:43:012
18918997837,34cyclictest30261-21nscd11:02:151
18918997834,28cyclictest32205-21df_abs05:57:471
18918997827,44cyclictest0-21swapper/109:27:191
18918997827,44cyclictest0-21swapper/109:27:191
18919997730,40cyclictest9002-21snmpd05:40:342
18919997730,40cyclictest10444-21tail08:32:322
18919997730,40cyclictest10444-21tail08:32:322
18919997729,40cyclictest0-21swapper/207:05:202
18919997729,40cyclictest0-21swapper/207:05:202
18919997727,42cyclictest18891-21latency_hist05:32:292
18919997726,43cyclictest30621-21munin-node09:12:422
18918997730,41cyclictest12181-21chrt06:22:461
18918997729,41cyclictest10416-21cpuspeed07:22:411
18919997628,40cyclictest0-21swapper/207:27:542
18919997627,36cyclictest0-21swapper/210:27:532
18919997627,29cyclictest0-21swapper/208:17:362
18919997626,43cyclictest0-21swapper/209:17:342
18918997627,42cyclictest0-21swapper/110:47:271
18919997532,37cyclictest16373-21cat06:28:132
18919997530,38cyclictest0-21swapper/207:22:372
18919997530,37cyclictest14873-21users08:38:012
18919997528,39cyclictest0-21swapper/210:07:532
18919997526,30cyclictest0-21swapper/206:02:572
18919997526,28cyclictest8466-21basename09:32:292
18919997525,42cyclictest0-21swapper/209:07:432
18918997535,32cyclictest444-21timerwakeupswit08:08:081
18918997529,37cyclictest0-21swapper/107:56:081
18918997528,39cyclictest30692-21basename09:12:311
18918997526,41cyclictest17136-21if_err_eth009:47:401
242299740,8rtkit-daemon0-21swapper/206:58:163
18919997430,37cyclictest1286-21runrttasks09:31:332
18919997429,38cyclictest0-21swapper/210:57:162
18919997428,39cyclictest1286-21runrttasks10:58:022
18919997420,36cyclictest0-21swapper/210:17:092
18919997420,36cyclictest0-21swapper/210:17:092
18918997433,34cyclictest2937-21munin-node08:12:581
18918997431,36cyclictest17171-21munin-node06:33:161
18918997429,38cyclictest23308-21sa107:52:221
18918997429,38cyclictest23308-21sa107:52:221
18918997426,32cyclictest0-21swapper/107:02:381
18918997426,32cyclictest0-21swapper/107:02:381
18918997425,18cyclictest0-21swapper/106:07:261
18918997424,34cyclictest0-21swapper/109:42:521
18918997423,43cyclictest210901munin-node09:57:311
18919997327,38cyclictest0-21swapper/208:43:122
18919997326,34cyclictest0-21swapper/207:08:052
18918997349,17cyclictest0-21swapper/105:47:471
18918997333,26cyclictest12621-21taskset08:36:201
18918997333,26cyclictest12621-21taskset08:36:201
18918997330,37cyclictest27675-21swap07:58:111
18918997329,35cyclictest8793-21latency_hist10:37:161
18918997328,17cyclictest720-21aten2.4-expect09:17:281
18918997327,39cyclictest9002-21snmpd06:20:391
18919997222,42cyclictest17466-21chrt07:36:512
18918997230,35cyclictest0-21swapper/105:39:341
18918997228,37cyclictest23143-21fschecks_time06:42:541
18918997227,38cyclictest0-21swapper/108:42:511
18918997224,40cyclictest18191-21python10:52:481
18919997140,24cyclictest18140-21aten2.4-expect08:47:312
18919997126,37cyclictest31117-21munin-node08:07:452
18919997120,30cyclictest0-21swapper/207:17:252
18918997139,25cyclictest2362-21gltestperf10:22:371
18918997128,36cyclictest0-21swapper/110:12:311
18918997128,36cyclictest0-21swapper/110:12:311
18918997128,36cyclictest0-21swapper/105:32:401
18918997128,29cyclictest0-21swapper/107:28:111
18918997125,15cyclictest0-21swapper/106:40:221
18918997124,32cyclictest0-21swapper/110:37:531
18919997030,12cyclictest3629-21yum-updatesd-he08:17:062
18919997028,33cyclictest1286-21runrttasks08:02:332
18919997027,36cyclictest0-21swapper/206:52:532
18919997025,37cyclictest9002-21snmpd10:42:392
18919997025,29cyclictest0-21swapper/210:06:522
18919997024,40cyclictest0-21swapper/209:27:192
18919997024,40cyclictest0-21swapper/209:27:192
18919997022,31cyclictest0-21swapper/206:18:162
18919997019,44cyclictest0-21swapper/207:18:202
18919997017,47cyclictest0-21swapper/206:22:452
18918997050,13cyclictest634-21unixbench_singl10:17:541
18918997031,33cyclictest6067-21sshd10:29:431
18918997031,33cyclictest0-21swapper/109:27:491
18918997029,35cyclictest26572-21df_abs10:07:321
18918997026,31cyclictest0-21swapper/110:02:441
18919996947,16cyclictest0-21swapper/209:42:342
18919996939,23cyclictest30021-21tune2fs05:52:472
18919996928,26cyclictest16188-21aten2.4-expect09:47:292
18919996926,28cyclictest0-21swapper/206:42:572
18919996920,41cyclictest0-21swapper/208:27:442
18918996951,12cyclictest28945-21fschecks_time09:07:361
18918996929,34cyclictest16393-21iostat07:32:551
18918996928,35cyclictest4498-21forks08:17:441
18918996925,37cyclictest0-21swapper/109:37:541
18918996924,38cyclictest0-21swapper/106:52:571
18918996922,40cyclictest0-21swapper/108:37:351
18918996921,42cyclictest0-21swapper/105:42:301
18918996915,48cyclictest0-21swapper/109:36:581
18919996839,23cyclictest31028-21latency06:58:072
18919996835,26cyclictest25044-21ps07:53:072
18919996826,37cyclictest0-21swapper/210:47:302
18919996823,40cyclictest0-21swapper/205:35:572
18919996820,41cyclictest0-21swapper/207:43:012
18919996820,40cyclictest0-21swapper/209:52:542
18918996829,26cyclictest9465-21sendmail_mailtr08:27:521
18918996824,30cyclictest0-21swapper/106:27:541
18918996816,46cyclictest0-21swapper/109:52:291
18918996816,30cyclictest0-21swapper/107:20:561
18918996814,48cyclictest0-21swapper/108:22:421
242299670,4rtkit-daemon2421-21rtkit-daemon10:40:000
242299670,4rtkit-daemon2421-21rtkit-daemon09:37:250
18919996734,27cyclictest0-21swapper/207:58:372
18919996726,13cyclictest0-21swapper/206:12:382
18919996726,13cyclictest0-21swapper/206:12:382
18918996750,11cyclictest4173-21sensors_temp07:08:101
18918996733,27cyclictest8019-21gltestperf06:12:491
18918996733,27cyclictest8019-21gltestperf06:12:491
18918996727,34cyclictest25920-21iostat06:47:571
18918996722,39cyclictest0-21swapper/108:02:331
18919996637,23cyclictest7417-21grep10:32:362
18919996637,22cyclictest23149-21runrttasks07:50:242
18919996637,22cyclictest23149-21runrttasks07:50:242
18918996521,29cyclictest0-21swapper/106:07:341
18918996521,29cyclictest0-21swapper/106:07:341
31862646,50sleep00-21swapper/007:07:480
18919996436,22cyclictest0-21swapper/206:47:522
18919996429,28cyclictest0-21swapper/205:47:522
18918996415,43cyclictest0-21swapper/107:46:201
18919996339,17cyclictest23047-21munin-node08:58:012
18918996322,34cyclictest30143-21perl05:52:481
18918996235,22cyclictest0-21swapper/105:32:281
18918996235,22cyclictest0-21swapper/105:32:281
18918996233,22cyclictest24912-21tail08:58:021
18919996037,16cyclictest0-21swapper/205:32:282
63022575,44sleep00-21swapper/006:08:110
63022575,44sleep00-21swapper/006:08:110
197532570,5sleep041ktimersoftd/008:47:550
202322562,9sleep30-21swapper/308:51:463
18920995638,12cyclictest29027-21tr10:12:333
18920995638,12cyclictest29027-21tr10:12:333
1891799558,26cyclictest0-21swapper/007:27:390
1891799555,12cyclictest0-21swapper/010:47:500
1891799554,34cyclictest0-21swapper/010:52:480
18917995525,23cyclictest0-21swapper/007:12:460
54712542,46sleep00-21swapper/009:24:240
54712542,46sleep00-21swapper/009:24:240
18920995336,11cyclictest15681-21gltestperf06:27:543
18920995335,11cyclictest8367-21tail10:32:523
18920995335,11cyclictest5526-21head06:07:503
18920995335,11cyclictest5526-21head06:07:503
18917995312,26cyclictest0-21swapper/005:33:550
99562522,43sleep00-21swapper/008:29:300
18920995220,14cyclictest0-21swapper/305:40:093
313552512,41sleep00-21swapper/010:17:290
300812512,42sleep00-21swapper/009:08:320
229732512,9sleep30-21swapper/307:48:063
229732512,9sleep30-21swapper/307:48:063
18920995131,12cyclictest29556-21gltestperf08:02:513
18920995121,13cyclictest0-21swapper/306:12:573
18920995121,13cyclictest0-21swapper/306:12:573
1891799514,40cyclictest0-21swapper/007:46:500
1891799514,28cyclictest0-21swapper/008:52:490
18917995121,13cyclictest0-21swapper/010:42:390
18917995121,13cyclictest0-21swapper/009:17:310
18917995121,13cyclictest0-21swapper/008:07:570
18917995114,24cyclictest1180-21lldpd09:27:550
151262512,42sleep30-21swapper/308:41:063
123422512,9sleep30-21swapper/307:26:013
213022502,9sleep30-21swapper/305:35:583
1892099505,36cyclictest0-21swapper/306:32:373
1892099504,28cyclictest0-21swapper/309:37:343
1892099504,28cyclictest0-21swapper/309:33:453
1892099503,39cyclictest653-21needreboot05:58:013
18920995020,13cyclictest0-21swapper/310:07:333
18920995017,26cyclictest23606-21netstat06:43:043
1891799505,27cyclictest0-21swapper/009:02:570
1891799504,28cyclictest0-21swapper/008:17:220
1891799504,28cyclictest0-21swapper/006:47:540
1891799504,28cyclictest0-21swapper/005:52:420
1891799504,27cyclictest0-21swapper/010:12:440
1891799504,27cyclictest0-21swapper/010:12:440
1891799504,27cyclictest0-21swapper/008:03:110
18917995033,10cyclictest28424-21crond10:12:170
18917995033,10cyclictest1680-21tr10:22:300
18917995020,12cyclictest0-21swapper/009:57:440
168632502,9sleep30-21swapper/308:42:523
124742502,40sleep30-21swapper/308:34:253
124742502,40sleep30-21swapper/308:34:253
112552502,9sleep30-21swapper/310:41:343
81362492,9sleep30-21swapper/309:31:173
1892099494,28cyclictest0-21swapper/309:17:033
1892099494,28cyclictest0-21swapper/307:12:383
1892099494,28cyclictest0-21swapper/305:52:553
1892099494,27cyclictest0-21swapper/310:17:453
1892099494,27cyclictest0-21swapper/309:47:273
1892099494,27cyclictest0-21swapper/309:17:473
1892099494,27cyclictest0-21swapper/307:42:343
1892099494,27cyclictest0-21swapper/307:37:553
1892099494,27cyclictest0-21swapper/307:18:133
1892099494,27cyclictest0-21swapper/306:53:033
1892099494,27cyclictest0-21swapper/305:48:073
1892099493,27cyclictest0-21swapper/310:02:553
18920994920,12cyclictest0-21swapper/307:02:513
18920994920,12cyclictest0-21swapper/307:02:513
18920994919,12cyclictest0-21swapper/307:27:403
1891799494,28cyclictest0-21swapper/010:27:300
1891799494,28cyclictest0-21swapper/009:42:490
1891799494,28cyclictest0-21swapper/006:38:100
1891799494,27cyclictest0-21swapper/009:12:360
1891799494,25cyclictest11434-21taskset07:23:030
121002492,40sleep30-21swapper/306:22:333
75822482,39sleep00-21swapper/008:26:280
207832482,9sleep30-21swapper/309:56:283
1892099485,17cyclictest0-21swapper/308:57:213
1892099484,27cyclictest0-21swapper/307:57:453
1892099484,26cyclictest0-21swapper/310:42:423
1892099484,26cyclictest0-21swapper/310:27:283
1892099484,26cyclictest0-21swapper/308:32:213
1892099483,27cyclictest0-21swapper/309:42:443
1892099483,27cyclictest0-21swapper/308:22:373
1892099483,27cyclictest0-21swapper/308:12:223
1892099483,27cyclictest0-21swapper/307:53:013
18920994820,11cyclictest0-21swapper/310:27:173
18920994818,12cyclictest0-21swapper/309:22:413
18920994818,12cyclictest0-21swapper/309:22:413
1891799485,27cyclictest0-21swapper/005:32:280
1891799485,27cyclictest0-21swapper/005:32:280
1891799484,36cyclictest0-21swapper/006:52:450
1891799484,27cyclictest0-21swapper/007:52:350
1891799484,27cyclictest0-21swapper/007:33:010
1891799484,27cyclictest0-21swapper/006:42:440
1891799484,27cyclictest0-21swapper/005:57:490
1891799484,26cyclictest0-21swapper/008:42:450
1891799484,26cyclictest0-21swapper/005:47:400
18917994827,15cyclictest0-21swapper/006:27:460
18917994818,13cyclictest0-21swapper/007:38:100
186272482,9sleep30-21swapper/310:53:523
117492482,40sleep00-21swapper/006:20:560
264152472,37sleep00-21swapper/005:46:470
1892099474,26cyclictest0-21swapper/309:11:393
18920994730,10cyclictest24862-21grep08:58:023
1892099473,27cyclictest0-21swapper/307:33:043
1891799474,36cyclictest0-21swapper/006:12:570
1891799474,36cyclictest0-21swapper/006:12:570
1891799474,26cyclictest18168-21gltestperf06:32:540
1891799474,26cyclictest0-21swapper/011:01:420
1891799473,39cyclictest0-21swapper/008:17:330
1891799473,29cyclictest0-21swapper/007:18:170
18917994719,11cyclictest0-21swapper/006:07:270
143032472,9sleep00-21swapper/006:26:040
1892099464,26cyclictest0-21swapper/308:21:483
1892099464,26cyclictest0-21swapper/306:07:273
1892099464,24cyclictest0-21swapper/306:22:263
1892099463,36cyclictest0-21swapper/306:37:343
18920994629,11cyclictest22955-21unixbench_multi09:57:563
18920994618,11cyclictest0-21swapper/309:06:393
1891799464,36cyclictest0-21swapper/007:03:190
1891799464,36cyclictest0-21swapper/007:03:190
1891799464,26cyclictest0-21swapper/008:57:500
1891799464,24cyclictest0-21swapper/009:52:300
1891799463,38cyclictest0-21swapper/009:35:370
1891799463,37cyclictest0-21swapper/005:37:560
18917994629,10cyclictest30121-21tr06:57:460
18917994622,16cyclictest0-21swapper/010:32:240
1892099454,24cyclictest0-21swapper/307:07:373
1892099453,22cyclictest0-21swapper/310:57:263
1891799454,34cyclictest0-21swapper/008:38:030
1891799454,25cyclictest0-21swapper/009:47:280
1892099444,16cyclictest0-21swapper/310:47:263
18920994414,12cyclictest0-21swapper/306:47:383
1891799443,36cyclictest0-21swapper/010:02:330
18920994325,12cyclictest0-21swapper/308:12:463
18920994224,10cyclictest24308-21aten_r1power_po05:42:413
1891799404,11cyclictest0-21swapper/007:51:390
1891799404,11cyclictest0-21swapper/007:51:390
1892099384,15cyclictest0-21swapper/305:32:283
1892099384,15cyclictest0-21swapper/305:32:283
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional