You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-18 - 04:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat Jul 18, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6582991053,13cyclictest0-21swapper/021:58:180
2194991050,8rtkit-daemon0-21swapper/220:31:482
2194991040,6rtkit-daemon22497-21yum-updatesd-he20:03:112
2194991030,5rtkit-daemon0-21swapper/219:53:122
2194991020,7rtkit-daemon0-21swapper/220:53:172
6587991004,44cyclictest0-21swapper/120:53:431
2194991000,7rtkit-daemon0-21swapper/220:18:112
2194991000,5rtkit-daemon1124-21snmpd18:29:382
219499990,6rtkit-daemon0-21swapper/218:43:292
219499990,4rtkit-daemon0-21swapper/220:33:102
219499980,4rtkit-daemon0-21swapper/219:22:582
6590999745,45cyclictest22541-21df_inode22:23:073
219499970,5rtkit-daemon0-21swapper/218:23:002
658799953,44cyclictest0-21swapper/121:45:201
658799946,34cyclictest0-21swapper/121:03:201
658799944,43cyclictest0-21swapper/121:02:101
658299943,84cyclictest0-21swapper/021:22:000
659099934,42cyclictest0-21swapper/320:53:273
658799935,41cyclictest0-21swapper/122:23:471
658799934,45cyclictest0-21swapper/123:03:041
658799934,37cyclictest8951-21crond18:27:591
658799934,37cyclictest8951-21crond18:27:591
658799933,43cyclictest0-21swapper/122:09:341
658299933,84cyclictest0-21swapper/022:38:130
658299933,13cyclictest0-21swapper/020:58:180
658799925,42cyclictest0-21swapper/123:51:481
658799924,41cyclictest14715-21munin-node22:13:021
658799923,49cyclictest0-21swapper/118:53:231
658299924,35cyclictest19034-21yum-updatesd-he23:03:080
6582999233,9cyclictest1227-21runrttasks21:28:110
658299923,82cyclictest0-21swapper/023:16:230
658299923,82cyclictest0-21swapper/023:16:230
6590999133,11cyclictest30051-21grep22:33:093
6590999133,11cyclictest30051-21grep22:33:093
658799915,38cyclictest0-21swapper/122:41:231
658799914,43cyclictest0-21swapper/123:09:581
658299914,13cyclictest0-21swapper/021:53:200
658299914,13cyclictest0-21swapper/021:53:200
658299913,82cyclictest0-21swapper/022:33:520
658299913,82cyclictest0-21swapper/022:33:520
6590999032,8cyclictest5499-21hwlatdetect23:28:093
659099903,44cyclictest8873-21cut19:33:173
6590999020,14cyclictest0-21swapper/321:23:103
658799904,45cyclictest0-21swapper/121:28:061
658799904,39cyclictest0-21swapper/120:42:451
658799903,48cyclictest0-21swapper/120:48:071
6582999032,11cyclictest22811-21uname21:38:180
658299902,39cyclictest31608-21diskmemload22:13:470
6590998920,8cyclictest27003-21rm22:28:183
658299894,79cyclictest0-21swapper/023:41:330
658299893,37cyclictest0-21swapper/022:53:030
219499890,11rtkit-daemon0-21swapper/220:18:183
658799885,38cyclictest0-21swapper/122:43:241
658799884,40cyclictest0-21swapper/122:03:251
658799884,39cyclictest0-21swapper/120:32:211
658799883,46cyclictest0-21swapper/121:14:551
658799883,46cyclictest0-21swapper/121:14:551
658299883,79cyclictest0-21swapper/021:16:270
658299883,79cyclictest0-21swapper/021:16:270
658299883,78cyclictest0-21swapper/023:29:480
658299883,12cyclictest0-21swapper/020:41:300
658299882,40cyclictest24311-21ssh23:08:440
219499880,4rtkit-daemon0-21swapper/218:23:233
219499880,4rtkit-daemon0-21swapper/218:23:233
6590998734,12cyclictest23656-21aten_r1power_vo18:58:113
6590998721,10cyclictest9673-21sendmail_mailtr23:33:183
658799875,40cyclictest0-21swapper/121:53:031
658799875,40cyclictest0-21swapper/121:53:031
658799874,39cyclictest9508-21ntp_states23:33:151
658799873,44cyclictest0-21swapper/122:28:031
658299873,35cyclictest0-21swapper/022:10:050
219499870,8rtkit-daemon0-21swapper/220:55:020
659099864,29cyclictest0-21swapper/321:17:453
659099864,29cyclictest0-21swapper/321:17:453
659099864,27cyclictest0-21swapper/323:38:593
6590998623,10cyclictest355-21munin-node22:38:113
6590998620,11cyclictest28640-21yum-updatesd-he21:03:153
658799863,38cyclictest7134-21munin-run22:02:511
658299868,11cyclictest0-21swapper/023:33:370
658299863,77cyclictest0-21swapper/022:19:090
658299863,76cyclictest0-21swapper/021:36:510
658299863,34cyclictest0-21swapper/022:58:000
658299862,40cyclictest31608-21diskmemload22:32:290
659099854,23cyclictest0-21swapper/321:37:503
6587998534,9cyclictest22898-21ssh21:38:201
658799853,46cyclictest0-21swapper/121:23:401
658299853,13cyclictest0-21swapper/020:43:250
219499850,8rtkit-daemon0-21swapper/218:48:143
659099843,39cyclictest1550-21nscd23:16:213
659099843,39cyclictest1550-21nscd23:16:213
6590998421,13cyclictest0-21swapper/320:42:353
658799843,45cyclictest0-21swapper/122:58:141
658299844,36cyclictest0-21swapper/020:31:080
658299843,38cyclictest0-21swapper/020:23:170
6582998424,12cyclictest0-21swapper/020:48:160
6582998415,27cyclictest12184-21python21:23:240
219499840,8rtkit-daemon0-21swapper/219:58:123
659099834,12cyclictest0-21swapper/321:45:493
6590998333,10cyclictest22865-21grep18:53:313
6590998321,8cyclictest31608-21diskmemload22:03:063
658799835,43cyclictest0-21swapper/118:47:081
658799833,40cyclictest14229-21ssh23:40:031
658799833,11cyclictest0-21swapper/123:21:361
658299833,12cyclictest0-21swapper/022:43:240
219499830,10rtkit-daemon0-21swapper/220:36:253
659099823,31cyclictest0-21swapper/321:18:003
658799823,41cyclictest0-21swapper/123:25:591
658299823,40cyclictest0-21swapper/018:23:150
658299823,40cyclictest0-21swapper/018:23:150
658299823,39cyclictest0-21swapper/023:19:300
6582998226,13cyclictest0-21swapper/021:47:450
219499820,5rtkit-daemon14937-21ssh20:43:173
658799813,44cyclictest0-21swapper/119:28:091
658799813,43cyclictest0-21swapper/121:08:051
658799812,44cyclictest0-21swapper/119:47:071
219499810,9rtkit-daemon0-21swapper/220:28:553
219499810,8rtkit-daemon0-21swapper/219:43:123
219499810,8rtkit-daemon0-21swapper/219:12:583
219499810,8rtkit-daemon0-21swapper/219:12:583
659099803,38cyclictest0-21swapper/323:22:513
6590998024,9cyclictest14281-21munin-node21:28:093
6590998021,9cyclictest32174-21ssh21:08:073
658799805,41cyclictest0-21swapper/121:20:581
658299803,43cyclictest0-21swapper/023:52:050
658299803,40cyclictest0-21swapper/021:08:490
658299803,38cyclictest0-21swapper/020:03:270
658299803,36cyclictest7858-21yum-updatesd-he22:03:190
658299803,36cyclictest0-21swapper/020:18:070
658299802,37cyclictest0-21swapper/022:48:380
6582998012,8cyclictest0-21swapper/021:03:130
219499800,5rtkit-daemon31240-21entropy19:13:133
659099794,28cyclictest0-21swapper/323:00:553
6590997914,20cyclictest20752-21ssh20:52:353
658299793,35cyclictest0-21swapper/018:33:100
219499790,6rtkit-daemon22497-21yum-updatesd-he20:03:263
658799783,39cyclictest20267-21rm22:18:361
6582997831,9cyclictest10036-21gltestperf18:28:210
658299783,40cyclictest0-21swapper/023:44:530
219499780,6rtkit-daemon0-21swapper/220:23:113
6587997722,9cyclictest11137-21idleruntime-cro22:52:501
219499770,5rtkit-daemon15579-21df_abs19:48:123
219499770,5rtkit-daemon15579-21df_abs19:48:123
219499760,4rtkit-daemon0-21swapper/219:03:143
658299753,39cyclictest0-21swapper/020:34:340
6582997520,21cyclictest0-21swapper/019:16:310
219499750,6rtkit-daemon0-21swapper/218:33:003
659099749,20cyclictest0-21swapper/321:58:493
6590997323,9cyclictest25344-21df_inode20:58:103
658299733,37cyclictest0-21swapper/021:52:070
658299733,37cyclictest0-21swapper/021:52:070
219499730,6rtkit-daemon0-21swapper/219:38:123
6582997216,47cyclictest0-21swapper/023:23:070
219499720,5rtkit-daemon0-21swapper/219:53:193
219499700,5rtkit-daemon0-21swapper/218:43:143
658999654,26cyclictest0-21swapper/222:37:512
658999654,26cyclictest0-21swapper/222:37:512
658799624,50cyclictest0-21swapper/120:44:001
6589996016,13cyclictest0-21swapper/222:52:502
658799603,51cyclictest0-21swapper/119:33:261
6589995914,13cyclictest0-21swapper/220:48:052
658799594,48cyclictest0-21swapper/122:33:091
658799594,48cyclictest0-21swapper/122:33:091
659099583,40cyclictest0-21swapper/321:55:523
659099583,40cyclictest0-21swapper/321:55:523
658999584,12cyclictest0-21swapper/220:42:442
658799574,46cyclictest0-21swapper/123:15:491
658799574,46cyclictest0-21swapper/123:15:491
658799573,48cyclictest0-21swapper/122:53:091
658799572,49cyclictest0-21swapper/119:53:171
658299574,46cyclictest0-21swapper/022:23:050
166702573,47sleep216774-21grep19:48:302
166702573,47sleep216774-21grep19:48:302
6589995636,10cyclictest19345-21tr23:48:012
658799563,47cyclictest0-21swapper/118:33:171
295532564,11sleep20-21swapper/223:17:582
209042563,12sleep20-21swapper/218:52:592
658999559,9cyclictest107550irq/46-eth020:44:202
658799554,45cyclictest0-21swapper/123:45:181
658799553,46cyclictest0-21swapper/118:38:221
658999544,41cyclictest24096-21grep23:08:222
6589995436,12cyclictest15578-21df_abs22:58:032
6589995436,10cyclictest18638-21grep21:33:102
6589995423,25cyclictest0-21swapper/221:57:102
6589995423,25cyclictest0-21swapper/221:57:102
6589995418,11cyclictest16028-21cut23:43:042
658799544,43cyclictest0-21swapper/121:33:001
6587995417,30cyclictest32505-21fschecks_count20:23:131
246712543,12sleep20-21swapper/221:42:152
243272543,45sleep21124-21snmpd22:24:572
136472544,11sleep20-21swapper/218:36:592
659099533,45cyclictest0-21swapper/322:22:373
659099533,43cyclictest18671-21munin-node23:03:173
6590995322,13cyclictest0-21swapper/322:52:053
658999534,42cyclictest0-21swapper/221:06:082
658999534,27cyclictest1227-21runrttasks21:52:472
658999534,27cyclictest1227-21runrttasks21:52:472
6589995338,9cyclictest27899-21grep20:13:162
6589995336,11cyclictest464-21grep21:08:142
658999533,27cyclictest25722-21hwlatdetect20:58:152
6589995322,13cyclictest0-21swapper/222:28:022
6589995321,10cyclictest10806-21aten_r1power_vo21:23:052
658799534,43cyclictest0-21swapper/123:29:451
658799533,45cyclictest0-21swapper/119:23:121
658799533,44cyclictest9095-21runrttasks20:35:191
658799533,44cyclictest0-21swapper/119:38:091
658799532,45cyclictest0-21swapper/120:13:291
188132537,38sleep10-21swapper/118:48:111
122352533,9sleep20-21swapper/219:39:432
6590995223,13cyclictest0-21swapper/323:11:163
6589995234,10cyclictest26013-21grep21:43:112
6589995213,28cyclictest0-21swapper/222:03:242
658799524,42cyclictest0-21swapper/121:50:081
658799524,42cyclictest0-21swapper/121:50:081
658799524,41cyclictest0-21swapper/119:48:161
658799524,41cyclictest0-21swapper/119:48:161
658799523,44cyclictest0-21swapper/119:15:431
291352523,43sleep20-21swapper/223:17:222
291352523,43sleep20-21swapper/223:17:222
274222525,40sleep00-21swapper/020:13:110
263242523,42sleep10-21swapper/119:03:141
138372524,41sleep20-21swapper/223:38:512
6590995117,13cyclictest0-21swapper/321:38:143
658999516,35cyclictest0-21swapper/223:33:102
658999516,27cyclictest0-21swapper/223:28:102
658999515,26cyclictest0-21swapper/222:39:502
658999514,25cyclictest0-21swapper/222:18:162
658999514,25cyclictest0-21swapper/222:08:082
658999514,23cyclictest32181-21grep20:23:092
6589995131,13cyclictest26259-21cpuspeed_turbos19:03:122
6589995110,7cyclictest107550irq/46-eth022:43:232
658799512,43cyclictest0-21swapper/119:18:071
207272514,41sleep00-21swapper/018:51:000
6590995033,11cyclictest4364-21needreboot19:23:213
659099503,28cyclictest0-21swapper/323:43:443
6590995017,7cyclictest31608-21diskmemload23:22:053
658999504,40cyclictest0-21swapper/222:01:352
6589995031,11cyclictest13475-21fschecks_time19:43:142
6589995031,10cyclictest7520-21grep18:23:172
6589995031,10cyclictest7520-21grep18:23:172
6587995015,21cyclictest31596-21latency_hist20:22:551
102372503,10sleep20-21swapper/221:22:312
658999495,36cyclictest19423-21perl23:03:092
6589994926,15cyclictest0-21swapper/223:23:112
6589994916,26cyclictest281ktimersoftd/222:55:282
658799493,41cyclictest0-21swapper/120:08:081
658799493,41cyclictest0-21swapper/120:06:241
658799493,41cyclictest0-21swapper/119:58:151
658799493,41cyclictest0-21swapper/118:28:131
658799493,40cyclictest0-21swapper/119:09:071
658799493,40cyclictest0-21swapper/119:09:071
658299494,37cyclictest0-21swapper/020:02:570
658299493,41cyclictest0-21swapper/019:26:260
658299493,29cyclictest0-21swapper/019:43:130
658299492,41cyclictest0-21swapper/019:53:260
659099483,28cyclictest113432latency_hist18:33:013
659099483,13cyclictest0-21swapper/322:53:013
658999485,12cyclictest0-21swapper/221:15:162
658999485,12cyclictest0-21swapper/221:15:162
658999484,36cyclictest0-21swapper/221:28:212
658999483,28cyclictest0-21swapper/218:53:222
6582994833,9cyclictest26364-21grep20:08:300
658299482,41cyclictest0-21swapper/019:08:160
658299482,41cyclictest0-21swapper/019:08:160
6582994819,12cyclictest16117-21latency_hist18:43:000
255462483,10sleep20-21swapper/219:01:382
659099473,38cyclictest0-21swapper/321:48:113
659099473,38cyclictest0-21swapper/321:48:113
6590994722,9cyclictest7720-21turbostat19:32:563
6590994721,7cyclictest4108-21ssh22:42:523
6590994720,12cyclictest0-21swapper/322:08:233
6590994719,13cyclictest0-21swapper/320:09:543
658999474,27cyclictest0-21swapper/222:13:012
658999474,25cyclictest0-21swapper/220:09:242
658999474,25cyclictest0-21swapper/219:08:332
658999474,25cyclictest0-21swapper/219:08:332
6589994730,10cyclictest22034-21sh20:02:562
6589994729,11cyclictest9082-21cat19:33:212
6589994720,10cyclictest30686-21aten2.4-expect19:13:072
658299475,35cyclictest0-21swapper/018:58:160
6582994721,12cyclictest0-21swapper/018:43:280
121842474,36sleep00-21swapper/019:39:050
659099464,14cyclictest0-21swapper/322:16:423
659099463,20cyclictest0-21swapper/323:48:043
658999463,26cyclictest0-21swapper/219:28:222
6589994615,14cyclictest0-21swapper/218:38:092
658799465,33cyclictest0-21swapper/118:23:011
6582994621,12cyclictest0-21swapper/019:52:570
6582994621,12cyclictest0-21swapper/019:52:570
63442464,6sleep00-21swapper/018:20:170
229312466,34sleep00-21swapper/018:53:380
6590994530,9cyclictest27352-21cpuspeed_turbos20:13:103
6582994522,9cyclictest26911-21iostat19:03:200
6589994422,11cyclictest0-21swapper/219:23:092
658299442,11cyclictest0-21swapper/019:33:280
659099434,33cyclictest0-21swapper/318:38:193
6587994329,9cyclictest24326-21gltestperf18:58:181
658299433,36cyclictest0-21swapper/019:28:210
6582994125,12cyclictest0-21swapper/019:18:020
6590994017,9cyclictest1225-21diskstats19:18:143
6590993520,9cyclictest6724-21latency_hist18:23:013
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional