You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-03 - 15:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Dec 03, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25434999739,15cyclictest0-21swapper/011:12:420
25434999739,13cyclictest0-21swapper/010:58:330
25434999030,15cyclictest0-21swapper/009:47:440
243799890,11rtkit-daemon0-21swapper/008:13:273
244282860,5sleep024429-21basename07:53:370
243799860,7rtkit-daemon0-21swapper/006:53:453
243799850,4rtkit-daemon2436-21rtkit-daemon10:27:141
25439998413,63cyclictest0-21swapper/107:59:491
243799730,6rtkit-daemon0-21swapper/007:38:431
25434997251,13cyclictest0-21swapper/011:18:310
25439997118,43cyclictest0-21swapper/111:08:191
8112660,6sleep20-21swapper/210:23:542
2544399664,54cyclictest0-21swapper/307:28:283
2544399664,54cyclictest0-21swapper/307:28:283
243799660,7rtkit-daemon0-21swapper/308:40:562
2544399654,53cyclictest0-21swapper/310:23:423
25439996513,33cyclictest0-21swapper/109:18:001
2544399644,52cyclictest0-21swapper/312:13:293
25439996419,37cyclictest16992-21crond07:38:271
25439996415,40cyclictest231871munin-node08:58:501
243799640,6rtkit-daemon0-21swapper/008:03:421
243799640,6rtkit-daemon0-21swapper/008:03:421
2544399634,51cyclictest0-21swapper/307:23:273
2543999639,40cyclictest0-21swapper/108:52:561
2543999639,40cyclictest0-21swapper/108:52:561
25439996210,45cyclictest0-21swapper/111:03:191
243799620,6rtkit-daemon0-21swapper/310:18:522
243799620,6rtkit-daemon0-21swapper/308:13:422
25439996113,27cyclictest24509-21munin-node11:13:481
25439996112,41cyclictest5075-21latency10:33:431
243799610,6rtkit-daemon0-21swapper/008:18:561
243799610,6rtkit-daemon0-21swapper/006:53:301
243799610,5rtkit-daemon3106-21wc10:28:510
243799610,5rtkit-daemon0-21swapper/007:28:281
2544399604,48cyclictest6252-21iostat_ios09:28:453
25439996042,10cyclictest17933-21fschecks_time09:53:391
25439996015,36cyclictest31710-21chrt08:08:381
25439996012,40cyclictest0-21swapper/111:10:581
25439996011,41cyclictest0-21swapper/109:52:141
25434996042,12cyclictest0-21swapper/007:43:440
25434996040,13cyclictest0-21swapper/009:53:550
25439995913,32cyclictest10930-21crond10:48:191
25439995911,41cyclictest0-21swapper/107:23:551
25439995910,41cyclictest0-21swapper/109:08:571
25434995938,14cyclictest0-21swapper/010:18:210
25434995938,14cyclictest0-21swapper/010:18:210
243799590,6rtkit-daemon0-21swapper/008:31:331
25441995838,13cyclictest0-21swapper/207:13:502
2543999588,44cyclictest0-21swapper/109:04:271
25439995816,36cyclictest31453-21sshd06:58:511
25439995816,35cyclictest0-21swapper/110:23:061
25439995814,37cyclictest0-21swapper/111:48:311
25439995814,36cyclictest1243-21snmpd10:18:091
25439995814,36cyclictest1243-21snmpd10:18:091
243799580,7rtkit-daemon0-21swapper/308:33:262
243799580,5rtkit-daemon2436-21rtkit-daemon08:32:113
285482572,47sleep00-21swapper/007:59:030
25439995738,11cyclictest3207-21tr09:23:371
25439995718,33cyclictest1369-21runrttasks11:33:311
25439995717,33cyclictest0-21swapper/107:09:371
25439995714,27cyclictest7691-21munin-node07:18:551
25439995710,41cyclictest0-21swapper/107:47:441
25434995737,13cyclictest0-21swapper/007:38:280
2544399562,37cyclictest0-21swapper/308:04:103
2544399562,37cyclictest0-21swapper/308:04:103
2544199564,27cyclictest0-21swapper/211:03:342
25439995619,29cyclictest17687-21fschecks_count12:08:341
25439995614,35cyclictest1243-21snmpd10:03:071
25439995611,39cyclictest0-21swapper/109:33:461
25439995611,28cyclictest0-21swapper/110:48:301
25439995610,30cyclictest0-21swapper/109:43:271
25434995612,35cyclictest0-21swapper/008:03:380
25434995612,35cyclictest0-21swapper/008:03:380
243799560,7rtkit-daemon2436-21rtkit-daemon11:48:181
35942553,11sleep30-21swapper/309:23:423
2543999559,40cyclictest0-21swapper/111:18:501
25439995537,10cyclictest17227-21needreboot08:43:481
25439995525,12cyclictest28695-21gltestperf11:23:401
25439995520,27cyclictest1216-21tail07:03:481
25439995514,35cyclictest0-21swapper/110:08:481
25439995514,34cyclictest2923-21netstat08:13:511
25439995513,33cyclictest9947-21cut11:53:281
25443995436,10cyclictest15045-21grep12:03:323
25441995429,9cyclictest6141-21sadc10:38:192
25441995423,13cyclictest0-21swapper/211:53:512
25439995422,25cyclictest22772-21tail10:03:411
25439995415,32cyclictest11079-21sed09:38:471
25439995414,34cyclictest7583-21chrt08:23:501
25439995414,34cyclictest0-21swapper/111:40:371
25439995414,34cyclictest0-21swapper/111:40:371
25439995413,34cyclictest6378-21munin-node10:38:441
2543499544,42cyclictest0-21swapper/009:08:370
2543499544,41cyclictest0-21swapper/009:28:450
243799540,6rtkit-daemon0-21swapper/306:54:452
179562542,9sleep00-21swapper/008:45:420
2544399534,43cyclictest0-21swapper/309:11:273
2544399533,43cyclictest25543-21munin-node10:08:463
2544399532,38cyclictest0-21swapper/308:57:453
2544199535,26cyclictest0-21swapper/208:03:382
2544199535,26cyclictest0-21swapper/208:03:382
25441995330,16cyclictest0-21swapper/207:18:422
2543999538,38cyclictest32746-21munin-node09:18:361
2543999536,41cyclictest0-21swapper/107:32:211
25439995315,24cyclictest0-21swapper/108:53:361
25439995310,37cyclictest0-21swapper/109:28:561
25434995331,15cyclictest0-21swapper/009:58:390
204702533,44sleep020540-21cat11:08:190
49902522,6sleep05067-21sort09:28:230
297222523,42sleep00-21swapper/006:54:040
2544399525,27cyclictest0-21swapper/311:13:173
2544399524,41cyclictest0-21swapper/306:48:493
2544399524,29cyclictest0-21swapper/311:18:443
2544399524,28cyclictest0-21swapper/308:58:393
25443995235,11cyclictest19130-21fschecks_time08:48:443
25443995235,11cyclictest19130-21fschecks_time08:48:443
25443995229,16cyclictest0-21swapper/308:33:533
2544199524,39cyclictest12172-21crond09:43:232
25441995225,10cyclictest12315-21munin-node11:58:282
2543999529,16cyclictest0-21swapper/112:13:401
2543999525,30cyclictest0-21swapper/107:53:581
25439995220,12cyclictest0-21swapper/108:38:471
25439995215,32cyclictest0-21swapper/110:28:321
25439995215,31cyclictest1369-21runrttasks07:51:491
25439995211,35cyclictest13715-21aten2.4-expect10:53:341
25439995211,35cyclictest13715-21aten2.4-expect10:53:341
2543499527,37cyclictest25427-21cyclictest11:33:300
2543499524,41cyclictest0-21swapper/011:39:490
2543499524,41cyclictest0-21swapper/011:39:490
2543499524,41cyclictest0-21swapper/009:03:460
2543499524,30cyclictest0-21swapper/011:13:330
2543499524,13cyclictest0-21swapper/007:27:410
2543499524,13cyclictest0-21swapper/007:27:410
25434995231,16cyclictest0-21swapper/009:17:320
25434995219,14cyclictest0-21swapper/007:53:260
2544399515,28cyclictest0-21swapper/307:58:273
2544399514,28cyclictest0-21swapper/310:33:533
2544399514,28cyclictest0-21swapper/309:48:373
2544399514,28cyclictest0-21swapper/308:23:263
2544399514,27cyclictest0-21swapper/307:48:423
25443995133,12cyclictest9634-21gltestperf10:43:393
25443995133,12cyclictest2509-21head08:13:453
2544399513,29cyclictest0-21swapper/310:58:463
2544399513,28cyclictest0-21swapper/311:38:223
2544399513,28cyclictest0-21swapper/311:38:223
2544199514,29cyclictest0-21swapper/212:03:492
2544199514,29cyclictest0-21swapper/207:03:572
2544199514,25cyclictest0-21swapper/207:43:452
25441995130,14cyclictest0-21swapper/210:38:342
25441995130,14cyclictest0-21swapper/207:58:492
25441995126,7cyclictest30029-21latency_hist11:28:192
25441995121,13cyclictest0-21swapper/211:48:422
25441995121,13cyclictest0-21swapper/208:18:482
25439995114,30cyclictest0-21swapper/107:13:421
25439995113,31cyclictest15979-21ntp_offset12:03:451
25439995112,32cyclictest28170-21telnet06:53:431
2543499515,39cyclictest0-21swapper/010:33:510
2543499514,40cyclictest0-21swapper/009:38:390
2543499514,29cyclictest0-21swapper/007:38:450
2543499514,13cyclictest0-21swapper/006:52:350
25434995134,11cyclictest12757-21chrt10:48:520
2543499513,42cyclictest0-21swapper/008:38:540
2543499513,12cyclictest0-21swapper/010:43:490
25434995121,13cyclictest0-21swapper/007:18:500
25434995120,13cyclictest0-21swapper/010:08:330
243799510,5rtkit-daemon2436-21rtkit-daemon11:28:421
192322513,40sleep30-21swapper/312:13:163
49842502,9sleep20-21swapper/207:12:282
47272502,9sleep20-21swapper/209:24:582
304992502,9sleep20-21swapper/206:58:422
2544399504,28cyclictest0-21swapper/311:33:403
2544399504,26cyclictest0-21swapper/311:23:193
2544399504,25cyclictest0-21swapper/311:13:303
2544399504,25cyclictest0-21swapper/308:47:273
25443995033,11cyclictest19987-21grep11:03:513
2544399503,25cyclictest0-21swapper/311:28:283
25443995020,11cyclictest0-21swapper/308:39:473
2544199505,27cyclictest0-21swapper/211:43:232
2544199504,29cyclictest0-21swapper/210:03:552
2544199504,28cyclictest0-21swapper/212:08:382
2544199504,28cyclictest0-21swapper/211:38:482
2544199504,28cyclictest0-21swapper/211:38:482
2544199504,28cyclictest0-21swapper/210:13:382
2544199504,28cyclictest0-21swapper/210:13:382
2544199504,28cyclictest0-21swapper/209:38:512
2544199504,28cyclictest0-21swapper/209:28:372
2544199504,28cyclictest0-21swapper/208:48:552
2544199504,28cyclictest0-21swapper/208:48:552
2544199504,27cyclictest0-21swapper/207:33:282
25441995020,13cyclictest0-21swapper/208:43:342
2543999504,28cyclictest0-21swapper/106:48:291
2543999504,28cyclictest0-21swapper/106:48:291
2543999504,27cyclictest0-21swapper/111:58:241
2543499506,38cyclictest0-21swapper/011:28:330
2543499505,27cyclictest0-21swapper/008:33:470
2543499504,28cyclictest0-21swapper/012:08:160
2543499504,28cyclictest0-21swapper/011:48:310
2543499504,28cyclictest0-21swapper/008:13:570
2543499504,27cyclictest0-21swapper/008:27:510
2543499504,26cyclictest0-21swapper/010:53:430
2543499504,26cyclictest0-21swapper/010:53:430
25434995034,11cyclictest0-21swapper/010:18:440
25434995032,11cyclictest32287-21grep08:08:440
2543499503,35cyclictest0-21swapper/009:48:540
25434995020,14cyclictest0-21swapper/010:24:280
25434995019,13cyclictest0-21swapper/011:23:550
126362503,39sleep312754-21cat10:48:523
2544399494,30cyclictest0-21swapper/307:08:413
2544399494,28cyclictest0-21swapper/307:08:293
2544399494,27cyclictest0-21swapper/309:53:383
2544399494,27cyclictest0-21swapper/307:33:483
2544399494,13cyclictest0-21swapper/309:33:533
25443994933,10cyclictest20484-21cut07:43:463
25443994920,14cyclictest0-21swapper/309:43:403
25443994916,13cyclictest0-21swapper/310:53:343
25443994916,13cyclictest0-21swapper/310:53:343
2544199499,33cyclictest21711-21crond10:03:212
2544199495,26cyclictest0-21swapper/209:49:442
2544199494,29cyclictest0-21swapper/211:18:312
2544199494,28cyclictest0-21swapper/209:18:442
2544199494,27cyclictest0-21swapper/207:48:422
25441994934,9cyclictest14375-21grep10:53:412
25441994934,9cyclictest14375-21grep10:53:412
25441994930,13cyclictest0-21swapper/210:48:202
2544199493,28cyclictest0-21swapper/210:58:532
25441994919,13cyclictest0-21swapper/209:08:372
25441994918,14cyclictest0-21swapper/208:53:582
25439994916,26cyclictest0-21swapper/108:33:581
2543499495,37cyclictest0-21swapper/007:03:570
2543499495,26cyclictest0-21swapper/011:53:280
2543499495,26cyclictest0-21swapper/007:32:420
2543499494,38cyclictest0-21swapper/008:18:410
2543499494,37cyclictest0-21swapper/011:58:370
2543499494,28cyclictest0-21swapper/006:58:570
2543499494,27cyclictest0-21swapper/008:58:250
25434994920,14cyclictest0-21swapper/008:32:270
25434994918,13cyclictest0-21swapper/010:40:330
2544399485,24cyclictest0-21swapper/307:29:013
2544399484,29cyclictest0-21swapper/310:33:123
2544399484,28cyclictest0-21swapper/309:38:483
2544399484,26cyclictest0-21swapper/311:53:473
2544399484,26cyclictest0-21swapper/307:13:473
2544399484,25cyclictest0-21swapper/311:48:233
2544399483,9cyclictest1812-21grep09:18:553
2544399483,27cyclictest0-21swapper/310:13:383
2544399483,27cyclictest0-21swapper/310:13:383
25443994817,13cyclictest0-21swapper/306:58:503
2544199488,14cyclictest0-21swapper/210:28:332
2544199486,24cyclictest17180-21munin-node09:53:482
2544199484,36cyclictest0-21swapper/210:08:332
2544199484,27cyclictest0-21swapper/212:13:342
2544199484,27cyclictest0-21swapper/211:33:402
2544199484,27cyclictest0-21swapper/211:28:352
2544199484,15cyclictest0-21swapper/211:13:422
2543499485,26cyclictest0-21swapper/009:19:570
2543499484,38cyclictest0-21swapper/009:33:580
2543499484,37cyclictest0-21swapper/012:13:350
2543499484,27cyclictest0-21swapper/007:13:440
2543499484,26cyclictest0-21swapper/006:48:290
2543499484,26cyclictest0-21swapper/006:48:290
25434994821,13cyclictest0-21swapper/008:48:260
25434994821,13cyclictest0-21swapper/008:48:260
25434994820,11cyclictest24942-21grep08:58:570
2544399474,37cyclictest0-21swapper/307:39:013
2544399474,36cyclictest0-21swapper/310:03:393
2544399474,36cyclictest0-21swapper/309:58:513
2544399474,27cyclictest0-21swapper/306:48:303
2544399474,27cyclictest0-21swapper/306:48:303
2544399474,26cyclictest0-21swapper/311:43:223
25443994715,13cyclictest0-21swapper/309:18:233
2544199474,27cyclictest0-21swapper/208:23:372
25441994720,9cyclictest10992-21latency_hist08:33:252
25441994717,13cyclictest0-21swapper/209:13:552
2543499475,35cyclictest0-21swapper/010:03:320
2543499474,36cyclictest0-21swapper/011:43:560
25434994731,11cyclictest0-21swapper/007:08:550
191602472,9sleep20-21swapper/207:40:262
132012472,9sleep20-21swapper/210:51:492
2544399464,25cyclictest0-21swapper/311:58:243
25443994629,10cyclictest26934-21aten_r1power_po07:58:403
25443994618,22cyclictest25586-21munin-node09:03:503
2544199465,34cyclictest0-21swapper/207:33:382
2544199464,35cyclictest0-21swapper/208:58:422
2544199464,34cyclictest0-21swapper/209:33:532
2544199464,26cyclictest0-21swapper/209:05:462
2544199464,24cyclictest0-21swapper/207:58:262
2544199463,25cyclictest11097-21sshd07:23:512
2544199463,25cyclictest11097-21sshd07:23:512
25441994617,12cyclictest0-21swapper/208:08:542
2543499464,15cyclictest0-21swapper/012:08:260
2544399454,34cyclictest0-21swapper/310:18:543
2544399453,36cyclictest8515-21yum-updatesd-he10:43:143
2544199454,33cyclictest0-21swapper/211:08:302
2544199454,25cyclictest0-21swapper/206:52:352
2544399445,12cyclictest0-21swapper/308:23:383
252282424,31sleep20-21swapper/206:46:132
252282424,31sleep20-21swapper/206:46:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional