You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-15 - 16:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Dec 15, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1586299925,26cyclictest0-21swapper/007:16:510
1586299914,27cyclictest0-21swapper/011:33:110
1586499903,33cyclictest1287-21snmpd07:28:301
1586299904,36cyclictest0-21swapper/010:18:090
1586299904,27cyclictest0-21swapper/009:07:100
1586299903,23cyclictest3721-21tr07:48:030
1586299895,27cyclictest0-21swapper/011:52:350
1586299895,24cyclictest24899-21grep10:47:570
15862998919,11cyclictest0-21swapper/012:17:500
15864998833,48cyclictest997-21cut09:57:581
1586299884,27cyclictest0-21swapper/010:42:500
15864998736,45cyclictest22413-21unixbench_singl11:48:081
1586299874,27cyclictest0-21swapper/007:08:080
1586299874,26cyclictest0-21swapper/009:37:150
1586299874,25cyclictest0-21swapper/011:22:310
15864998634,45cyclictest9362-21cut11:22:521
1586299864,26cyclictest0-21swapper/011:03:020
1586299864,26cyclictest0-21swapper/010:03:090
1586299864,21cyclictest12020-21latency_hist12:37:370
1586499853,32cyclictest1287-21snmpd07:26:531
1586499853,32cyclictest0-21swapper/110:08:111
1586299854,26cyclictest0-21swapper/011:07:480
1586499843,75cyclictest0-21swapper/107:12:431
1586499843,11cyclictest0-21swapper/108:28:151
15864998418,11cyclictest0-21swapper/111:52:561
15864998418,11cyclictest0-21swapper/111:52:561
1586299844,26cyclictest0-21swapper/008:52:070
1586299844,23cyclictest0-21swapper/009:57:560
15862998421,8cyclictest12208-21latency_hist08:07:470
15862998417,8cyclictest18146-21latency_hist09:27:440
1586499833,30cyclictest24074-21sadc10:47:411
1586299834,27cyclictest0-21swapper/009:42:550
1586299834,27cyclictest0-21swapper/009:42:550
15862998319,11cyclictest0-21swapper/011:27:470
1586499824,30cyclictest0-21swapper/108:38:031
15864998230,34cyclictest0-21swapper/109:07:531
1586499823,36cyclictest0-21swapper/111:13:081
1586499823,36cyclictest0-21swapper/111:13:081
15864998227,8cyclictest8447-21gltestperf10:12:581
1586299824,26cyclictest0-21swapper/008:12:010
1586299824,25cyclictest0-21swapper/011:58:280
1586299824,25cyclictest0-21swapper/011:58:280
1586499814,36cyclictest0-21swapper/111:32:481
1586499814,31cyclictest0-21swapper/109:07:451
1586299814,25cyclictest0-21swapper/010:12:200
1586299814,24cyclictest30613-21cpuspeed07:37:580
15862998121,7cyclictest7417-21latency_hist07:57:480
1586499804,32cyclictest0-21swapper/111:37:571
15864998030,9cyclictest5588-21cpuspeed_turbos07:52:581
1586299804,26cyclictest0-21swapper/008:37:470
15862998020,12cyclictest0-21swapper/009:32:440
1586499794,32cyclictest0-21swapper/110:22:411
15864997821,10cyclictest17953-21fschecks_time08:18:011
15864997821,10cyclictest17953-21fschecks_time08:18:011
1586299785,12cyclictest0-21swapper/008:57:460
1586299784,26cyclictest0-21swapper/009:02:090
1586299784,13cyclictest0-21swapper/009:17:450
1586499774,31cyclictest0-21swapper/108:07:561
1586499774,28cyclictest24496-21munin-node09:38:071
1586499773,35cyclictest0-21swapper/110:47:511
1586499773,35cyclictest0-21swapper/108:27:471
1586499773,31cyclictest0-21swapper/112:32:361
15864997726,8cyclictest5478-21cstates12:22:481
15864997722,9cyclictest12994-21fschecks_count10:22:561
1586299773,38cyclictest0-21swapper/011:12:490
1586299773,38cyclictest0-21swapper/011:12:490
1586499763,35cyclictest0-21swapper/110:53:101
1586499763,25cyclictest0-21swapper/110:42:421
15864997626,9cyclictest17037-21kernelversion09:23:031
15864997623,11cyclictest0-21swapper/108:58:111
15864997621,10cyclictest26236-21gltestperf11:57:541
15864997621,10cyclictest26236-21gltestperf11:57:541
1586499754,34cyclictest0-21swapper/110:32:581
1586499754,31cyclictest32420-21cat12:12:381
1586499753,30cyclictest0-21swapper/108:02:481
15864997525,10cyclictest4410-21unixbench_multi12:18:061
15864997525,10cyclictest10766-21fschecks_time08:03:031
1586499752,33cyclictest1287-21snmpd07:12:551
1586499744,31cyclictest0-21swapper/111:42:411
1586499744,12cyclictest0-21swapper/110:28:251
1586499744,12cyclictest0-21swapper/110:28:251
1586499743,9cyclictest10611-21perl12:32:521
1586499743,34cyclictest0-21swapper/107:47:571
15864997328,9cyclictest604-21cpuspeed_turbos07:42:571
1586499725,32cyclictest0-21swapper/108:43:131
1586499725,25cyclictest0-21swapper/111:27:471
1586499723,30cyclictest32489-21irqstats11:02:591
15864997224,10cyclictest31506-21needreboot09:53:041
15864997222,12cyclictest0-21swapper/109:33:121
1586499722,33cyclictest31566-21telnet08:47:531
1586499694,23cyclictest0-21swapper/111:21:541
1586499693,29cyclictest2589-21iostat_ios11:07:591
1586499684,31cyclictest0-21swapper/111:01:111
151102679,14sleep20-21swapper/207:03:102
1586499665,32cyclictest0-21swapper/107:40:391
1586299654,13cyclictest0-21swapper/008:17:470
272152624,13sleep20-21swapper/208:37:592
1586499603,8cyclictest32680-21aten_r1power_fr12:12:491
1586699584,47cyclictest27781-21munin-run07:32:483
1586499584,14cyclictest0-21swapper/109:43:121
1586499584,14cyclictest0-21swapper/109:43:121
248599570,6rtkit-daemon2484-21rtkit-daemon10:47:292
248599570,5rtkit-daemon2484-21rtkit-daemon10:28:072
248599570,5rtkit-daemon2484-21rtkit-daemon10:28:072
1586699574,44cyclictest4972-21munin-run10:07:423
248599560,6rtkit-daemon2484-21rtkit-daemon09:27:542
248599560,5rtkit-daemon2484-21rtkit-daemon07:47:362
1586699565,44cyclictest24028-21yum-updatesd-he10:47:263
1586699563,46cyclictest20847-21munin-node07:18:063
15865995620,20cyclictest0-21swapper/209:23:062
14302562,11sleep30-21swapper/311:07:433
248599550,6rtkit-daemon2484-21rtkit-daemon11:58:032
248599550,6rtkit-daemon2484-21rtkit-daemon11:58:032
248599550,5rtkit-daemon2484-21rtkit-daemon12:26:402
1586699554,44cyclictest0-21swapper/309:17:533
1586699553,46cyclictest1287-21snmpd07:26:533
248599540,6rtkit-daemon2484-21rtkit-daemon07:18:072
248599540,5rtkit-daemon2484-21rtkit-daemon11:53:112
248599540,5rtkit-daemon2484-21rtkit-daemon11:53:112
248599540,5rtkit-daemon2484-21rtkit-daemon11:47:562
248599540,5rtkit-daemon2484-21rtkit-daemon11:17:502
248599540,5rtkit-daemon2484-21rtkit-daemon08:47:332
248599540,5rtkit-daemon2484-21rtkit-daemon07:48:062
1586699544,43cyclictest11107-21munin-node11:28:083
1586699543,45cyclictest1287-21snmpd10:02:183
1586699543,44cyclictest5262-21munin-node07:53:073
1586699543,44cyclictest1287-21snmpd07:11:503
311732532,9sleep30-21swapper/311:01:543
248599530,6rtkit-daemon2484-21rtkit-daemon11:43:042
248599530,6rtkit-daemon2484-21rtkit-daemon08:47:562
248599530,6rtkit-daemon2484-21rtkit-daemon07:37:582
248599530,6rtkit-daemon2484-21rtkit-daemon07:33:062
248599530,6rtkit-daemon2484-21rtkit-daemon07:33:062
248599530,5rtkit-daemon2484-21rtkit-daemon12:12:552
248599530,5rtkit-daemon2484-21rtkit-daemon11:38:042
248599530,5rtkit-daemon2484-21rtkit-daemon11:27:492
248599530,5rtkit-daemon2484-21rtkit-daemon10:53:062
248599530,5rtkit-daemon2484-21rtkit-daemon10:47:512
248599530,5rtkit-daemon2484-21rtkit-daemon10:18:002
248599530,5rtkit-daemon2484-21rtkit-daemon09:53:012
248599530,5rtkit-daemon2484-21rtkit-daemon09:38:012
248599530,5rtkit-daemon2484-21rtkit-daemon09:32:542
248599530,5rtkit-daemon2484-21rtkit-daemon09:13:102
166642532,9sleep30-21swapper/308:13:383
1586699534,42cyclictest9025-21python10:13:093
1586699534,42cyclictest6905-21df_abs09:02:583
1586699533,43cyclictest31349-21memory12:07:583
1586699533,43cyclictest1287-21snmpd07:51:583
12862533,42sleep20-21swapper/209:58:032
96262522,10sleep30-21swapper/308:00:203
248599520,5rtkit-daemon2484-21rtkit-daemon12:33:022
248599520,5rtkit-daemon2484-21rtkit-daemon12:17:552
248599520,5rtkit-daemon2484-21rtkit-daemon10:08:082
248599520,5rtkit-daemon2484-21rtkit-daemon09:17:552
248599520,5rtkit-daemon2484-21rtkit-daemon08:17:572
248599520,5rtkit-daemon2484-21rtkit-daemon08:17:572
248599520,5rtkit-daemon2484-21rtkit-daemon08:02:582
248599520,5rtkit-daemon2484-21rtkit-daemon07:52:582
1586699524,41cyclictest25533-21munin-node09:42:533
1586699524,41cyclictest25533-21munin-node09:42:533
1586699524,41cyclictest13157-21perl08:08:013
1586699524,41cyclictest0-21swapper/312:02:543
1586699524,40cyclictest5774-21diskstats10:07:563
1586699524,40cyclictest16914-21iostat_ios11:37:583
1586699523,42cyclictest0-21swapper/312:02:373
1586699523,42cyclictest0-21swapper/312:02:373
1586699522,44cyclictest0-21swapper/308:47:573
1586599523,25cyclictest0-21swapper/209:07:532
15862995222,12cyclictest0-21swapper/008:28:030
34652512,10sleep30-21swapper/308:53:363
299862514,41sleep00-21swapper/009:51:360
248599510,5rtkit-daemon2484-21rtkit-daemon07:30:142
1586699516,38cyclictest15316-21sh10:27:553
1586699516,38cyclictest15316-21sh10:27:553
1586699514,40cyclictest19033-21sh07:13:033
15866995134,11cyclictest20347-21grep10:37:583
1586699513,41cyclictest301-21telnet12:12:503
1586699513,41cyclictest1006-21fschecks_time07:43:013
1586699513,40cyclictest23226-21cpu11:52:493
1586699513,40cyclictest23226-21cpu11:52:493
15866995113,30cyclictest0-21swapper/312:32:463
15865995136,9cyclictest23749-21head08:28:152
1586599513,42cyclictest1287-21snmpd08:12:292
15865995113,29cyclictest8583-21latency_hist09:07:462
1586299513,30cyclictest0-21swapper/008:27:460
248599500,5rtkit-daemon2484-21rtkit-daemon11:32:572
248599500,5rtkit-daemon2484-21rtkit-daemon11:02:502
248599500,5rtkit-daemon2484-21rtkit-daemon08:22:572
1586699504,39cyclictest29237-21open_inodes09:48:063
1586699503,40cyclictest1287-21snmpd10:22:223
15865995034,10cyclictest2932-21aten2.4-expect10:02:512
15864995023,12cyclictest0-21swapper/109:22:441
1586299503,41cyclictest0-21swapper/012:08:100
15862995021,12cyclictest0-21swapper/011:52:530
15862995021,12cyclictest0-21swapper/011:52:530
15862995021,12cyclictest0-21swapper/007:18:000
108182502,9sleep20-21swapper/211:27:002
60482492,9sleep30-21swapper/311:17:013
60482492,9sleep30-21swapper/311:17:013
248599490,7rtkit-daemon2484-21rtkit-daemon10:37:592
248599490,5rtkit-daemon2484-21rtkit-daemon12:07:482
1586699495,37cyclictest17711-21diskstats10:32:553
15866994934,10cyclictest21357-21fschecks_time11:47:533
1586699492,42cyclictest0-21swapper/311:33:103
15865994920,10cyclictest9634-21latency_hist12:32:372
15864994930,9cyclictest0-21swapper/108:32:551
1586299493,27cyclictest1419-21runrttasks10:40:040
15862994920,12cyclictest0-21swapper/009:12:110
105972492,9sleep30-21swapper/311:24:073
94432483,39sleep00-21swapper/012:30:120
70702482,10sleep30-21swapper/312:25:243
310352483,39sleep00-21swapper/008:44:220
1586699484,37cyclictest0-21swapper/308:23:093
15866994831,11cyclictest7819-21cpuspeed_turbos12:27:483
15866994822,7cyclictest32674-21cat07:42:493
1586699482,41cyclictest0-21swapper/308:38:113
15865994833,10cyclictest12990-21grep10:22:562
15865994832,9cyclictest8414-21gltestperf10:12:582
15865994832,10cyclictest16994-21wc07:08:032
1586299485,27cyclictest0-21swapper/007:36:550
1586299485,27cyclictest0-21swapper/007:36:550
1586299485,26cyclictest0-21swapper/008:18:020
1586299485,26cyclictest0-21swapper/008:18:020
1586299485,25cyclictest0-21swapper/010:12:580
1586299483,11cyclictest0-21swapper/012:12:500
155102484,37sleep00-21swapper/007:03:440
248599470,5rtkit-daemon2484-21rtkit-daemon07:16:522
238492473,38sleep30-21swapper/308:28:573
1586699474,37cyclictest19451-21munin-node09:12:523
1586699474,37cyclictest1419-21runrttasks08:58:103
1586699474,36cyclictest0-21swapper/310:47:513
15865994733,9cyclictest25056-21grep08:33:002
1586599473,38cyclictest0-21swapper/212:06:502
1586599473,37cyclictest17228-21telnet10:32:502
15864994735,8cyclictest12895-21unixbench_multi09:13:131
1586299476,25cyclictest0-21swapper/007:43:150
1586299474,27cyclictest0-21swapper/011:23:040
1586299474,26cyclictest0-21swapper/012:26:310
1586299474,26cyclictest0-21swapper/012:02:590
1586299474,26cyclictest0-21swapper/009:55:220
1586299474,26cyclictest0-21swapper/008:01:590
1586299474,26cyclictest0-21swapper/007:31:540
1586299474,25cyclictest0-21swapper/010:25:360
1586299474,25cyclictest0-21swapper/009:17:570
1586299474,25cyclictest0-21swapper/008:42:060
15862994730,12cyclictest0-21swapper/011:42:470
83592462,9sleep30-21swapper/311:21:003
47492462,9sleep20-21swapper/211:12:572
47492462,9sleep20-21swapper/211:12:572
310802462,10sleep30-21swapper/308:44:573
300552463,9sleep20-21swapper/209:52:312
290662463,36sleep00-21swapper/010:57:480
263202462,37sleep30-21swapper/308:35:063
248599460,4rtkit-daemon2484-21rtkit-daemon07:58:052
1586699465,36cyclictest0-21swapper/308:18:073
1586699465,36cyclictest0-21swapper/308:18:073
1586699464,36cyclictest20420-21sshd11:47:323
1586699464,36cyclictest0-21swapper/309:42:443
1586699464,27cyclictest0-21swapper/309:22:563
1586699464,24cyclictest3875-21ls12:17:573
1586699463,38cyclictest0-21swapper/309:37:443
1586699462,38cyclictest0-21swapper/307:33:143
1586699462,38cyclictest0-21swapper/307:33:143
15865994628,13cyclictest0-21swapper/208:58:022
1586299464,37cyclictest0-21swapper/010:33:020
1586299464,26cyclictest0-21swapper/010:32:230
1586299464,26cyclictest0-21swapper/010:32:230
15862994620,11cyclictest0-21swapper/010:57:410
15862994618,11cyclictest0-21swapper/009:38:130
15862994615,13cyclictest0-21swapper/007:22:570
36552452,10sleep20-21swapper/211:11:532
253382452,37sleep20-21swapper/207:27:152
203002453,9sleep30-21swapper/309:29:473
15866994530,11cyclictest30582-21cpuspeed_turbos09:52:533
15865994530,9cyclictest1563-21aten_r1power_en08:52:542
15864994531,9cyclictest22050-21needreboot07:18:091
15864994530,10cyclictest4013-21needreboot10:03:031
1586499453,38cyclictest0-21swapper/112:03:091
15862994520,11cyclictest0-21swapper/011:38:080
155752454,34sleep30-21swapper/307:04:363
133762452,36sleep30-21swapper/310:23:023
9272443,34sleep30-21swapper/311:04:363
248599440,4rtkit-daemon2484-21rtkit-daemon08:12:572
1586699444,34cyclictest10628-21diskstats08:03:023
1586699444,27cyclictest0-21swapper/310:53:013
15865994428,10cyclictest30664-21cat10:58:092
1586499445,35cyclictest0-21swapper/107:36:481
1586499445,35cyclictest0-21swapper/107:36:481
248599430,4rtkit-daemon2484-21rtkit-daemon09:45:312
248599430,4rtkit-daemon2484-21rtkit-daemon09:45:312
1586499436,33cyclictest0-21swapper/109:50:501
1586499433,34cyclictest0-21swapper/109:27:551
15864994328,10cyclictest2405-21gltestperf08:53:021
109212432,10sleep30-21swapper/309:12:103
1586499413,31cyclictest16058-21cat07:07:511
15864994127,9cyclictest14886-21head08:12:551
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional