You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-21 - 20:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Fri Nov 21, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
496099874,65cyclictest0-21swapper/310:14:583
496099863,64cyclictest1369-21runrttasks09:59:493
496099863,63cyclictest0-21swapper/308:35:023
496099844,60cyclictest0-21swapper/309:40:093
243799820,4rtkit-daemon2436-21rtkit-daemon10:49:432
243799820,4rtkit-daemon2436-21rtkit-daemon10:49:432
496099814,61cyclictest0-21swapper/312:00:063
496099813,62cyclictest1185-21sshd12:10:533
496099803,62cyclictest20985-21switchtime07:30:183
496099793,69cyclictest0-21swapper/307:50:153
496099784,67cyclictest0-21swapper/311:20:043
496099783,68cyclictest26106-21fschecks_time11:04:543
496099783,67cyclictest0-21swapper/307:10:143
496099783,41cyclictest24412-21basename07:39:573
496099774,65cyclictest0-21swapper/311:44:533
496099773,67cyclictest8826-21ntp_kernel_pll_07:05:123
496099773,67cyclictest0-21swapper/307:27:463
496099773,66cyclictest8302-21chrt10:28:303
278122770,5sleep127813-21grep10:00:031
243799770,8rtkit-daemon0-21swapper/111:14:350
496099764,65cyclictest0-21swapper/308:59:503
496099764,55cyclictest0-21swapper/307:34:543
496099763,66cyclictest26780-21sort12:14:463
496099763,66cyclictest26780-21sort12:14:463
496099763,66cyclictest22854-21memory12:04:583
496099763,65cyclictest0-21swapper/310:23:533
496099763,56cyclictest23766-21perl08:45:003
496099763,56cyclictest23766-21perl08:45:003
243799760,7rtkit-daemon0-21swapper/109:54:010
496099754,55cyclictest0-21swapper/308:40:073
496099754,54cyclictest0-21swapper/312:19:523
496099753,66cyclictest26363-21latency_hist09:59:393
496099753,65cyclictest9052-21unixbench-2d11:35:083
496099753,65cyclictest14271-21perl08:25:013
496099753,64cyclictest14364-21taskset09:34:133
496099752,57cyclictest1165-21lldpd07:59:533
243799750,8rtkit-daemon0-21swapper/107:07:220
496099744,63cyclictest0-21swapper/309:09:003
496099744,52cyclictest0-21swapper/307:49:433
496099743,63cyclictest16986-21aten_r1power_cu11:54:473
496099742,51cyclictest30145-21date08:59:423
243799740,7rtkit-daemon18-21rcuc/109:35:090
243799740,4rtkit-daemon2436-21rtkit-daemon08:52:031
496099734,58cyclictest0-21swapper/309:20:073
496099734,54cyclictest0-21swapper/307:19:553
496099734,54cyclictest0-21swapper/307:19:553
496099733,62cyclictest1243-21snmpd11:49:363
496099733,62cyclictest1243-21snmpd11:15:223
496099733,51cyclictest2703-21munin-node09:10:023
243799730,5rtkit-daemon18046-21iostat_ios09:40:010
243799730,5rtkit-daemon10519-21diskstats07:09:590
496099724,52cyclictest0-21swapper/310:54:583
496099724,42cyclictest0-21swapper/310:34:373
496099723,62cyclictest13076-21fschecks_time07:15:013
496099723,61cyclictest0-21swapper/310:05:383
496099723,58cyclictest3046-21df_abs11:24:503
496099723,57cyclictest5251-21cut06:59:583
496099723,53cyclictest10891-21iostat_ios09:25:023
496099723,53cyclictest10891-21iostat_ios09:25:023
243799720,6rtkit-daemon8346-21idleruntime11:34:570
243799720,6rtkit-daemon0-21swapper/111:56:180
243799720,6rtkit-daemon0-21swapper/111:19:420
243799720,6rtkit-daemon0-21swapper/110:52:510
243799720,6rtkit-daemon0-21swapper/110:52:510
243799720,6rtkit-daemon0-21swapper/109:04:020
243799720,5rtkit-daemon0-21swapper/109:05:550
496099714,60cyclictest0-21swapper/309:35:003
496099714,60cyclictest0-21swapper/307:59:433
496099714,51cyclictest0-21swapper/308:54:043
496099714,51cyclictest0-21swapper/308:10:063
496099714,50cyclictest0-21swapper/311:31:543
496099713,61cyclictest23598-21yum09:50:133
496099713,61cyclictest0-21swapper/310:39:503
496099713,53cyclictest0-21swapper/311:04:303
496099712,64cyclictest0-21swapper/310:36:113
243799710,6rtkit-daemon0-21swapper/111:27:420
243799710,6rtkit-daemon0-21swapper/109:18:390
243799710,6rtkit-daemon0-21swapper/109:12:550
243799710,6rtkit-daemon0-21swapper/108:58:330
243799710,6rtkit-daemon0-21swapper/108:54:400
243799710,6rtkit-daemon0-21swapper/108:35:560
243799710,5rtkit-daemon15552-21munin-node11:49:560
496099703,60cyclictest1369-21runrttasks11:40:213
496099703,60cyclictest0-21swapper/310:53:563
496099703,60cyclictest0-21swapper/310:53:563
496099703,59cyclictest1369-21runrttasks08:32:423
496099703,44cyclictest0-21swapper/311:14:303
243799700,7rtkit-daemon0-21swapper/109:55:450
243799700,6rtkit-daemon0-21swapper/112:26:470
243799700,6rtkit-daemon0-21swapper/111:39:410
243799700,5rtkit-daemon2460-21udisks-daemon08:23:340
243799700,5rtkit-daemon21018-21cstates08:39:560
496099693,53cyclictest3941-21hostname08:04:553
496099693,53cyclictest3941-21hostname08:04:553
496099693,51cyclictest0-21swapper/309:44:493
496099693,43cyclictest114550irq/46-eth010:09:573
496099693,43cyclictest114550irq/46-eth010:09:573
243799690,7rtkit-daemon0-21swapper/107:02:220
243799690,7rtkit-daemon0-21swapper/008:44:561
243799690,7rtkit-daemon0-21swapper/008:44:561
243799690,6rtkit-daemon0-21swapper/111:18:500
243799690,6rtkit-daemon0-21swapper/109:34:090
243799690,6rtkit-daemon0-21swapper/109:24:470
243799690,6rtkit-daemon0-21swapper/109:24:470
243799690,6rtkit-daemon0-21swapper/108:29:040
243799690,6rtkit-daemon0-21swapper/008:23:123
243799690,5rtkit-daemon0-21swapper/111:46:040
496099684,57cyclictest0-21swapper/310:44:513
496099684,57cyclictest0-21swapper/309:19:123
243799680,7rtkit-daemon0-21swapper/111:05:280
243799680,6rtkit-daemon15283-21df07:19:590
243799680,6rtkit-daemon15283-21df07:19:590
243799680,6rtkit-daemon0-21swapper/112:02:030
243799680,6rtkit-daemon0-21swapper/109:45:010
243799680,6rtkit-daemon0-21swapper/109:23:470
243799680,6rtkit-daemon0-21swapper/108:46:480
243799680,6rtkit-daemon0-21swapper/108:46:480
496099674,50cyclictest0-21swapper/312:24:433
496099673,42cyclictest0-21swapper/308:19:023
243799670,7rtkit-daemon0-21swapper/111:02:580
243799670,7rtkit-daemon0-21swapper/007:25:141
243799670,6rtkit-daemon0-21swapper/110:05:530
243799670,6rtkit-daemon0-21swapper/108:16:570
243799670,6rtkit-daemon0-21swapper/107:31:290
243799670,6rtkit-daemon0-21swapper/107:24:510
243799670,6rtkit-daemon0-21swapper/012:20:471
243799670,10rtkit-daemon0-21swapper/107:15:141
243799660,8rtkit-daemon0-21swapper/011:59:481
243799660,6rtkit-daemon0-21swapper/112:21:320
243799660,6rtkit-daemon0-21swapper/110:48:130
243799660,6rtkit-daemon0-21swapper/107:15:290
243799660,6rtkit-daemon0-21swapper/009:20:471
243799660,6rtkit-daemon0-21swapper/007:30:061
4959996539,12cyclictest0-21swapper/211:40:032
243799650,8rtkit-daemon0-21swapper/007:06:071
243799650,7rtkit-daemon0-21swapper/011:50:331
243799650,6rtkit-daemon0-21swapper/108:34:410
243799640,6rtkit-daemon0-21swapper/007:20:071
243799640,6rtkit-daemon0-21swapper/007:20:071
243799630,6rtkit-daemon0-21swapper/008:23:571
495899624,51cyclictest0-21swapper/110:54:361
495899624,51cyclictest0-21swapper/110:54:361
4958996221,25cyclictest5242-21open_inodes08:05:121
4958996221,25cyclictest5242-21open_inodes08:05:121
4959996113,29cyclictest0-21swapper/207:09:462
495899615,11cyclictest1369-21runrttasks09:59:181
4958996146,9cyclictest19662-21sendmail_mailqu08:35:121
49252613,13sleep00-21swapper/006:59:450
4959995927,14cyclictest0-21swapper/208:05:022
4959995927,14cyclictest0-21swapper/208:05:022
235952593,50sleep223696-21tune2fs08:45:002
235952593,50sleep223696-21tune2fs08:45:002
4958995824,15cyclictest0-21swapper/110:10:011
4958995824,15cyclictest0-21swapper/110:10:011
496099574,46cyclictest0-21swapper/306:59:463
4959995736,8cyclictest12-21rcu_preempt08:55:162
4959995734,11cyclictest0-21swapper/210:54:492
4959995730,10cyclictest3278-21runrttasks09:09:562
495699573,48cyclictest0-21swapper/007:54:520
243799570,7rtkit-daemon0-21swapper/308:15:342
177542574,12sleep20-21swapper/211:54:562
495899565,31cyclictest0-21swapper/108:59:411
4958995640,10cyclictest13803-21cpuspeed_turbos08:24:561
495699564,45cyclictest0-21swapper/007:45:000
49522563,45sleep00-21swapper/008:05:070
49522563,45sleep00-21swapper/008:05:070
243799560,6rtkit-daemon1002-21rsyslogd07:14:441
495999554,30cyclictest0-21swapper/211:54:332
4959995533,10cyclictest0-21swapper/209:19:582
4959995530,11cyclictest0-21swapper/209:00:102
495999553,30cyclictest0-21swapper/210:40:042
4959995510,27cyclictest0-21swapper/210:44:482
495899553,45cyclictest0-21swapper/111:03:201
4958995525,12cyclictest0-21swapper/109:44:541
319062553,8sleep132011-21diskstats07:54:561
84382542,10sleep00-21swapper/008:14:180
62802543,43sleep00-21swapper/010:24:490
495999544,41cyclictest0-21swapper/210:04:382
495999544,31cyclictest0-21swapper/207:55:042
4959995437,10cyclictest3826-21cut11:25:002
4959995436,10cyclictest32272-21crond11:19:342
4959995430,11cyclictest0-21swapper/210:29:592
4959995418,14cyclictest0-21swapper/207:39:442
243799540,7rtkit-daemon0-21swapper/008:18:341
168232544,43sleep20-21swapper/208:30:042
71952532,11sleep20-21swapper/209:19:062
495999534,41cyclictest0-21swapper/207:00:092
495999534,30cyclictest0-21swapper/207:14:572
4959995329,10cyclictest0-21swapper/212:20:042
495899536,27cyclictest0-21swapper/108:04:001
495899534,29cyclictest0-21swapper/109:50:091
495899534,28cyclictest0-21swapper/107:44:431
495899534,28cyclictest0-21swapper/107:03:501
4958995320,14cyclictest0-21swapper/110:34:241
495699533,44cyclictest0-21swapper/009:59:490
4956995324,22cyclictest0-21swapper/010:24:370
284872532,45sleep20-21swapper/207:45:462
495999524,40cyclictest0-21swapper/207:19:552
495999524,40cyclictest0-21swapper/207:19:552
495999524,31cyclictest0-21swapper/207:53:532
495999523,44cyclictest0-21swapper/211:20:072
4959995229,11cyclictest0-21swapper/210:34:512
4959995228,11cyclictest0-21swapper/208:50:102
495899525,29cyclictest0-21swapper/112:10:081
495899525,28cyclictest0-21swapper/111:27:541
495899525,27cyclictest9545-21turbostat.cron11:39:341
495899525,27cyclictest0-21swapper/109:14:111
495899524,29cyclictest0-21swapper/110:20:101
495899524,29cyclictest0-21swapper/109:40:111
495899524,29cyclictest0-21swapper/109:35:001
495899524,28cyclictest0-21swapper/111:49:351
495899524,28cyclictest0-21swapper/109:14:591
495899524,12cyclictest0-21swapper/107:35:331
495899523,29cyclictest0-21swapper/107:45:121
4958995220,13cyclictest0-21swapper/110:14:481
248882522,43sleep20-21swapper/211:01:392
243799520,5rtkit-daemon0-21swapper/011:29:571
110142523,9sleep10-21swapper/110:34:461
495999514,40cyclictest0-21swapper/208:10:102
495999514,30cyclictest0-21swapper/207:59:552
4959995113,32cyclictest281ktimersoftd/212:24:562
495899515,29cyclictest0-21swapper/111:19:301
495899515,26cyclictest0-21swapper/109:08:001
495899514,28cyclictest0-21swapper/110:55:091
495899514,28cyclictest0-21swapper/109:25:081
495899514,28cyclictest0-21swapper/109:25:081
495899514,27cyclictest0-21swapper/112:04:381
495899514,27cyclictest0-21swapper/111:09:371
243799510,5rtkit-daemon0-21swapper/008:40:031
141422512,42sleep20-21swapper/209:31:192
7172502,9sleep00-21swapper/010:10:180
7172502,9sleep00-21swapper/010:10:180
495999505,29cyclictest0-21swapper/210:04:542
495999504,39cyclictest0-21swapper/209:35:002
495999504,30cyclictest0-21swapper/211:09:372
495999504,30cyclictest0-21swapper/207:30:152
495999504,26cyclictest0-21swapper/209:45:592
495999504,25cyclictest0-21swapper/210:15:032
495999503,27cyclictest0-21swapper/208:25:102
4959995028,15cyclictest0-21swapper/211:59:452
4959995023,13cyclictest0-21swapper/209:24:522
4959995023,13cyclictest0-21swapper/209:24:522
4959995019,12cyclictest0-21swapper/207:44:442
495899506,26cyclictest0-21swapper/110:44:251
495899505,29cyclictest0-21swapper/111:59:331
495899505,28cyclictest0-21swapper/110:49:261
495899504,28cyclictest0-21swapper/112:14:401
495899504,28cyclictest0-21swapper/112:14:401
495899504,25cyclictest11933-21latency_hist11:44:351
495899503,28cyclictest0-21swapper/110:29:231
495899503,25cyclictest0-21swapper/111:10:101
4958995028,12cyclictest13962-21grep09:30:141
4958995020,13cyclictest0-21swapper/111:19:471
495699507,38cyclictest0-21swapper/012:14:530
495699507,38cyclictest0-21swapper/012:14:530
495699504,40cyclictest0-21swapper/010:59:360
495699503,42cyclictest0-21swapper/010:39:500
495699503,41cyclictest0-21swapper/012:09:460
495699503,41cyclictest0-21swapper/007:40:140
4956995021,13cyclictest0-21swapper/010:14:490
36702502,42sleep00-21swapper/008:04:270
309182502,41sleep00-21swapper/007:51:040
201132502,9sleep20-21swapper/208:36:052
495999495,15cyclictest0-21swapper/212:09:392
495999494,29cyclictest0-21swapper/211:35:022
495999494,28cyclictest0-21swapper/207:13:052
495999494,26cyclictest0-21swapper/212:04:462
495999494,26cyclictest0-21swapper/211:30:092
495999494,24cyclictest0-21swapper/210:19:512
495999493,28cyclictest0-21swapper/208:20:122
495999493,27cyclictest0-21swapper/212:14:572
495999493,27cyclictest0-21swapper/212:14:572
495999493,27cyclictest0-21swapper/209:54:582
495999493,12cyclictest0-21swapper/208:44:062
4959994923,19cyclictest1369-21runrttasks11:44:492
4959994918,12cyclictest0-21swapper/210:10:572
4959994918,12cyclictest0-21swapper/210:10:572
495899494,27cyclictest0-21swapper/107:54:431
495899494,26cyclictest0-21swapper/108:29:541
495899494,26cyclictest0-21swapper/106:59:451
495699493,40cyclictest0-21swapper/007:35:080
495999485,34cyclictest0-21swapper/209:04:522
495999484,36cyclictest0-21swapper/207:25:122
495999484,26cyclictest0-21swapper/211:09:502
495999484,25cyclictest0-21swapper/210:24:492
495899484,26cyclictest0-21swapper/112:29:131
4958994830,10cyclictest7118-21grep08:10:031
495699484,38cyclictest0-21swapper/010:29:570
495699483,40cyclictest0-21swapper/012:04:500
495699483,40cyclictest0-21swapper/011:30:090
128982482,39sleep00-21swapper/010:36:100
495999474,25cyclictest0-21swapper/209:39:512
495999473,25cyclictest0-21swapper/209:50:092
323002473,9sleep10-21swapper/109:03:571
295542473,37sleep10-21swapper/110:04:551
4959994016,9cyclictest0-21swapper/206:59:462
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional