You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-05-06 - 09:09

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed May 06, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991260,5rtkit-daemon2484-21rtkit-daemon16:55:270
2485991230,6rtkit-daemon2484-21rtkit-daemon21:33:470
2485991230,6rtkit-daemon2484-21rtkit-daemon21:33:470
2485991220,4rtkit-daemon2484-21rtkit-daemon21:20:020
2485991200,4rtkit-daemon2484-21rtkit-daemon20:31:270
2485991190,4rtkit-daemon2484-21rtkit-daemon17:40:180
2485991170,4rtkit-daemon2484-21rtkit-daemon19:34:140
2485991170,4rtkit-daemon2484-21rtkit-daemon19:34:140
2485991140,4rtkit-daemon2484-21rtkit-daemon20:24:040
103739910310,28cyclictest0-21swapper/022:19:570
2485991000,4rtkit-daemon2484-21rtkit-daemon20:03:431
10373991004,28cyclictest0-21swapper/019:00:250
103739910011,23cyclictest32350-21grep21:59:580
1037399989,23cyclictest6200-21munin-run22:09:430
1037399984,27cyclictest9843-21munin-node22:14:580
1037399984,27cyclictest9843-21munin-node22:14:580
10373999719,10cyclictest2119-21ssh21:15:010
10373999718,11cyclictest25135-21rm19:25:110
10373999712,25cyclictest0-21swapper/019:20:220
1037399965,26cyclictest0-21swapper/020:13:560
1037399965,26cyclictest0-21swapper/020:13:560
1037399964,25cyclictest0-21swapper/020:54:470
1037399964,25cyclictest0-21swapper/020:54:470
1037399964,23cyclictest26885-21ssh21:50:170
10373999618,14cyclictest0-21swapper/017:25:230
1037399955,28cyclictest0-21swapper/017:20:060
1037399955,28cyclictest0-21swapper/017:20:060
1037399954,28cyclictest7141-21ssh22:10:020
10373999525,9cyclictest121850irq/46-eth021:05:020
10373999519,13cyclictest0-21swapper/019:55:080
1037399945,29cyclictest0-21swapper/017:35:050
1037399944,26cyclictest13879-21munin-node19:10:090
248599930,6rtkit-daemon0-21swapper/018:56:300
1037399936,33cyclictest0-21swapper/020:40:520
1037399936,28cyclictest0-21swapper/017:12:310
1037399935,26cyclictest0-21swapper/021:39:340
1037399934,30cyclictest0-21swapper/021:00:130
1037399934,26cyclictest0-21swapper/020:56:030
1037399925,28cyclictest0-21swapper/020:35:180
1037399925,27cyclictest1419-21runrttasks19:38:540
1037399925,26cyclictest6912-21chrt17:54:540
1037399924,28cyclictest0-21swapper/021:25:000
1037399924,27cyclictest3634-21yum-updatesd-he19:40:240
10373999231,12cyclictest21637-21latency_hist21:44:460
1037399923,28cyclictest0-21swapper/017:30:090
10373999214,26cyclictest0-21swapper/020:15:210
1037699914,12cyclictest0-21swapper/121:45:031
1037399914,26cyclictest0-21swapper/021:49:450
1037399905,28cyclictest0-21swapper/017:45:200
1037399905,27cyclictest0-21swapper/020:45:140
1037399904,26cyclictest3108-21diskmemload20:05:060
10373999021,10cyclictest3108-21diskmemload19:50:060
10373999011,24cyclictest16292-21awk18:14:530
1037699894,13cyclictest0-21swapper/117:55:171
1037699894,11cyclictest0-21swapper/119:55:071
248599880,5rtkit-daemon2484-21rtkit-daemon20:04:581
1037699884,8cyclictest31682-21ssh21:10:091
1037399884,28cyclictest0-21swapper/019:15:150
10373998822,10cyclictest121850irq/46-eth019:45:220
1037699874,48cyclictest0-21swapper/120:10:251
1037699874,48cyclictest0-21swapper/120:10:251
1037699874,12cyclictest0-21swapper/122:12:111
1037699873,12cyclictest0-21swapper/121:41:231
1037399874,30cyclictest0-21swapper/018:30:160
16922860,3sleep015-21rcuc/018:50:120
16922860,3sleep015-21rcuc/018:50:120
1037699864,9cyclictest15835-21runrttasks19:10:331
1037399865,26cyclictest0-21swapper/021:11:470
1037399864,27cyclictest0-21swapper/019:05:030
1037399864,24cyclictest7045-21aten_r1power_fr17:55:050
1037699857,50cyclictest0-21swapper/119:46:551
1037699854,12cyclictest0-21swapper/121:58:071
1037699854,12cyclictest0-21swapper/118:05:191
1037699854,12cyclictest0-21swapper/118:05:191
1037699854,11cyclictest0-21swapper/120:21:521
1037699854,11cyclictest0-21swapper/119:51:181
1037699853,9cyclictest10948-21diskstats19:05:071
1037699853,12cyclictest0-21swapper/119:23:471
1037399855,25cyclictest1243-21lldpd18:35:080
1037699844,72cyclictest0-21swapper/119:34:491
1037699844,72cyclictest0-21swapper/119:34:491
1037699844,12cyclictest0-21swapper/119:15:011
1037699844,12cyclictest0-21swapper/116:56:241
1037699844,11cyclictest0-21swapper/121:15:231
1037699844,11cyclictest0-21swapper/119:00:031
1037699844,10cyclictest7752-21grep20:35:071
1037699843,9cyclictest0-21swapper/118:55:111
1037699843,59cyclictest13002-21sshd20:43:251
1037699843,11cyclictest0-21swapper/120:26:521
10376998417,46cyclictest25753-21ssh21:00:351
10376998415,46cyclictest26215-21aten2.4-expect18:35:041
1037399846,28cyclictest0-21swapper/020:02:590
1037399845,28cyclictest0-21swapper/020:26:110
1037699834,61cyclictest0-21swapper/121:36:291
1037699834,13cyclictest0-21swapper/121:29:171
1037699834,13cyclictest0-21swapper/118:50:061
1037699834,13cyclictest0-21swapper/118:50:061
1037699834,12cyclictest0-21swapper/122:23:261
1037699834,12cyclictest0-21swapper/121:59:551
1037699834,12cyclictest0-21swapper/121:09:451
1037699834,12cyclictest0-21swapper/119:41:521
1037699834,11cyclictest0-21swapper/120:58:501
1037699834,11cyclictest0-21swapper/120:34:261
1037699833,8cyclictest4851-21munin-node22:05:181
1037699833,8cyclictest11627-21unixbench_multi22:15:161
1037699833,8cyclictest11627-21unixbench_multi22:15:161
1037699833,12cyclictest0-21swapper/121:29:591
1037699833,12cyclictest0-21swapper/121:29:591
10376998316,47cyclictest25623-21open_inodes19:25:191
1037699824,12cyclictest0-21swapper/117:46:321
1037699824,11cyclictest0-21swapper/121:52:071
1037699824,11cyclictest0-21swapper/117:20:061
1037699824,11cyclictest0-21swapper/117:20:061
1037699823,11cyclictest0-21swapper/120:45:271
1037699823,10cyclictest10478-21memory18:00:161
1037699818,51cyclictest0-21swapper/120:50:261
1037699818,51cyclictest0-21swapper/120:50:261
1037699814,12cyclictest0-21swapper/117:10:221
1037699814,11cyclictest0-21swapper/117:25:091
1037699805,55cyclictest0-21swapper/120:15:071
1037699803,12cyclictest0-21swapper/117:15:161
1037699794,12cyclictest0-21swapper/119:38:171
1037699784,51cyclictest0-21swapper/118:45:181
1037699784,11cyclictest0-21swapper/118:40:261
1037699783,12cyclictest0-21swapper/118:15:101
10376997818,39cyclictest3108-21diskmemload21:20:521
1037699773,58cyclictest0-21swapper/117:05:071
1037699764,8cyclictest15522-21processes18:10:201
1037699764,12cyclictest0-21swapper/117:40:291
1037699763,12cyclictest0-21swapper/118:24:531
1037699763,12cyclictest0-21swapper/117:34:551
10376997616,53cyclictest4581-21munin-node17:50:061
10376997612,43cyclictest121850irq/46-eth017:35:071
1037899743,64cyclictest0-21swapper/318:15:093
1037699734,11cyclictest0-21swapper/118:30:031
1037699733,62cyclictest23329-21sshd18:28:281
1037699733,12cyclictest0-21swapper/117:04:551
1037699713,14cyclictest0-21swapper/116:54:561
1037899653,55cyclictest10400-21df_abs22:14:583
1037899653,55cyclictest10400-21df_abs22:14:583
166532633,13sleep30-21swapper/320:00:133
261242604,48sleep30-21swapper/318:35:043
1037799603,48cyclictest0-21swapper/220:20:232
317682593,11sleep20-21swapper/219:35:092
233532594,10sleep00-21swapper/018:28:490
10378995922,14cyclictest0-21swapper/321:34:453
10378995922,14cyclictest0-21swapper/321:34:453
10378995832,12cyclictest0-21swapper/319:35:313
1037799584,46cyclictest0-21swapper/219:45:002
273182574,45sleep20-21swapper/221:50:522
10377995720,31cyclictest1419-21runrttasks20:51:562
10377995720,31cyclictest1419-21runrttasks20:51:562
292262562,10sleep30-21swapper/317:32:053
1037899563,46cyclictest3108-21diskmemload21:14:313
1037799565,43cyclictest0-21swapper/221:04:582
35252552,9sleep20-21swapper/221:15:212
10378995538,9cyclictest5354-21cpuspeed_turbos21:19:593
10378995533,8cyclictest7311-21ssh19:45:233
1037899552,46cyclictest3108-21diskmemload19:00:043
1037799556,42cyclictest0-21swapper/220:35:072
1037799554,45cyclictest1419-21runrttasks22:20:242
1037799554,44cyclictest0-21swapper/217:25:082
10377995512,37cyclictest9907-21switchtime21:25:142
10373995522,14cyclictest0-21swapper/021:55:180
10373995520,15cyclictest0-21swapper/017:15:230
165242542,9sleep20-21swapper/219:12:522
10378995439,9cyclictest25145-21gltestperf19:25:113
1037899543,44cyclictest0-21swapper/321:40:223
1037799544,44cyclictest0-21swapper/222:10:102
1037799544,43cyclictest0-21swapper/217:50:232
1037799543,44cyclictest0-21swapper/220:00:152
10377995413,26cyclictest21347-21df_abs19:20:062
1037399544,28cyclictest0-21swapper/018:40:060
10373995417,14cyclictest0-21swapper/018:46:430
310272532,10sleep30-21swapper/320:20:403
10378995332,8cyclictest14660-21uniq19:10:093
10378995329,11cyclictest0-21swapper/320:25:173
1037799535,41cyclictest0-21swapper/220:11:412
1037799535,41cyclictest0-21swapper/220:11:412
1037799533,45cyclictest3108-21diskmemload21:47:422
10373995322,14cyclictest0-21swapper/018:15:090
10373995319,12cyclictest0-21swapper/018:00:140
232172522,10sleep30-21swapper/318:27:023
193062522,10sleep20-21swapper/219:15:422
10378995224,23cyclictest0-21swapper/322:09:533
1037799525,42cyclictest3255-21latency_hist20:29:472
1037799525,42cyclictest0-21swapper/221:19:572
1037799524,42cyclictest4623-21grep20:30:112
10377995234,11cyclictest4346-21grep22:05:102
1037799523,43cyclictest0-21swapper/221:40:382
1037799523,27cyclictest0-21swapper/222:19:442
1037799523,27cyclictest0-21swapper/222:19:442
10377995221,11cyclictest0-21swapper/219:50:222
10377995220,9cyclictest11902-21yum-updatesd-he20:40:252
10377995219,12cyclictest0-21swapper/221:55:182
1037399525,26cyclictest0-21swapper/017:05:200
1037399524,27cyclictest0-21swapper/018:05:090
1037399524,27cyclictest0-21swapper/018:05:090
1037399524,27cyclictest0-21swapper/017:04:550
1037899513,41cyclictest0-21swapper/320:50:023
1037899513,41cyclictest0-21swapper/320:50:023
10378995128,11cyclictest0-21swapper/321:44:483
1037799516,28cyclictest0-21swapper/221:35:162
1037799514,40cyclictest0-21swapper/220:44:542
1037799512,43cyclictest0-21swapper/219:40:022
10377995118,11cyclictest0-21swapper/220:59:472
10377995114,32cyclictest0-21swapper/219:02:032
10377995112,24cyclictest0-21swapper/220:05:102
10377995110,21cyclictest26974-21runrttasks19:28:282
1037399514,26cyclictest0-21swapper/018:20:070
242342502,10sleep30-21swapper/320:10:283
242342502,10sleep30-21swapper/320:10:283
124702503,40sleep30-21swapper/319:06:083
113632502,10sleep20-21swapper/218:03:072
108532503,9sleep30-21swapper/319:50:503
10378995035,9cyclictest19775-21head18:20:123
10378995033,12cyclictest0-21swapper/317:25:203
10378995015,17cyclictest0-21swapper/321:27:413
10378995014,28cyclictest0-21swapper/317:20:093
10378995014,28cyclictest0-21swapper/317:20:093
1037799505,39cyclictest0-21swapper/221:00:022
1037799504,41cyclictest0-21swapper/218:58:282
10377995034,10cyclictest30538-21ssh21:09:522
10377995033,11cyclictest20655-21grep18:20:262
1037799503,41cyclictest28530-21ssh19:30:092
1037799503,41cyclictest28530-21ssh19:30:092
1037799503,40cyclictest0-21swapper/221:30:042
1037799503,40cyclictest0-21swapper/221:30:042
30472492,10sleep30-21swapper/318:54:103
30472492,10sleep30-21swapper/318:54:103
146802492,10sleep30-21swapper/319:57:313
10378994935,8cyclictest20782-21ssh20:05:223
1037899493,40cyclictest11902-21yum-updatesd-he20:40:303
1037899493,38cyclictest0-21swapper/319:15:033
1037799495,28cyclictest0-21swapper/218:15:102
1037799494,28cyclictest0-21swapper/218:05:162
1037799494,28cyclictest0-21swapper/218:05:162
10377994933,10cyclictest21936-21sort18:25:102
10377994919,11cyclictest0-21swapper/217:46:322
10377994918,11cyclictest0-21swapper/219:05:102
90422482,10sleep30-21swapper/317:59:013
3062483,10sleep20-21swapper/218:46:522
1037899483,39cyclictest2496-21rm19:40:043
1037899483,39cyclictest0-21swapper/321:18:373
1037899483,24cyclictest16689-21ssh21:35:163
1037899482,39cyclictest0-21swapper/321:54:563
10378994819,12cyclictest0-21swapper/321:00:543
10378994812,30cyclictest25314-21aten_r1power_cu21:49:563
1037799485,38cyclictest0-21swapper/218:40:242
1037799485,29cyclictest0-21swapper/219:55:212
1037799484,12cyclictest0-21swapper/222:01:302
10377994832,11cyclictest11230-21tune2fs16:55:142
1037799483,39cyclictest0-21swapper/220:18:582
10377994818,13cyclictest0-21swapper/217:35:312
305802473,10sleep30-21swapper/318:44:393
16692472,10sleep20-21swapper/217:43:082
151162472,10sleep20-21swapper/217:04:512
1037899473,38cyclictest3108-21diskmemload22:09:093
1037899473,38cyclictest0-21swapper/322:00:053
1037899473,38cyclictest0-21swapper/320:45:413
1037799476,34cyclictest0-21swapper/218:35:032
10377994731,11cyclictest7121-21aten2.4-expect17:55:062
10377994731,10cyclictest14915-21cut18:10:112
10377994730,9cyclictest22586-21tail17:20:062
10377994730,9cyclictest22586-21tail17:20:062
10377994730,12cyclictest19416-21unixbench-2d17:10:272
10377994729,11cyclictest944-21aten_r1power_vo18:50:052
10377994729,11cyclictest944-21aten_r1power_vo18:50:052
248599460,4rtkit-daemon2484-21rtkit-daemon16:53:353
198752463,36sleep30-21swapper/317:14:403
172122462,10sleep20-21swapper/217:06:002
1037899468,33cyclictest361ktimersoftd/321:05:013
10378994632,9cyclictest13533-21cpuspeed_turbos22:19:583
10378994631,10cyclictest3039-21head17:45:133
1037899463,37cyclictest0-21swapper/319:30:173
1037899463,37cyclictest0-21swapper/319:30:173
1037899463,12cyclictest0-21swapper/320:15:183
10378994625,17cyclictest0-21swapper/317:54:213
10378994618,13cyclictest0-21swapper/319:21:383
10378994614,27cyclictest4456-21which20:30:083
10378994612,29cyclictest361ktimersoftd/317:00:133
1037799463,27cyclictest0-21swapper/217:31:292
3122452,10sleep30-21swapper/318:46:573
256662453,10sleep30-21swapper/318:32:553
227092452,37sleep30-21swapper/320:56:483
202282452,36sleep30-21swapper/317:15:083
127352453,11sleep30-21swapper/316:59:533
1037899453,36cyclictest1835-21basename17:44:533
1037799455,32cyclictest0-21swapper/217:15:062
113342442,10sleep30-21swapper/318:02:443
10378994429,10cyclictest12681-21ls18:05:143
10378994429,10cyclictest12681-21ls18:05:143
10378994414,9cyclictest7764-21expr20:35:073
1037799443,35cyclictest1419-21runrttasks18:30:032
1037899433,34cyclictest0-21swapper/317:35:213
10378994328,9cyclictest4584-21needreboot18:55:153
1037899432,15cyclictest0-21swapper/318:12:493
102922434,32sleep00-21swapper/016:54:180
1037899412,32cyclictest0-21swapper/317:05:253
1037799403,24cyclictest0-21swapper/216:54:562
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional