You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-16 - 06:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 16, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
299019910042,11cyclictest18065-21gltestperf21:45:041
2990099964,73cyclictest0-21swapper/023:14:580
2990199955,14cyclictest0-21swapper/120:34:101
29901999543,44cyclictest0-21swapper/120:15:001
29901999543,44cyclictest0-21swapper/120:15:001
29901999441,10cyclictest23802-21gltestperf20:25:081
2829429412,18sleep00-21swapper/018:20:100
2990199925,14cyclictest0-21swapper/120:36:001
2990199915,26cyclictest1227-21runrttasks22:31:061
29901999125,9cyclictest15033-21cat23:09:421
2990199905,14cyclictest0-21swapper/123:18:431
2990199905,11cyclictest16328-21irqstats23:10:021
2990199894,30cyclictest0-21swapper/118:49:511
2990099894,63cyclictest0-21swapper/023:20:060
2990199885,14cyclictest0-21swapper/123:40:391
304192870,3sleep041ktimersoftd/023:29:540
2990199875,28cyclictest0-21swapper/122:46:401
2990199875,14cyclictest1227-21runrttasks22:09:361
2990099874,66cyclictest0-21swapper/020:37:290
2990099874,61cyclictest16076-21ssh23:09:580
2990099873,65cyclictest12561-21munin-node20:55:240
2990099873,65cyclictest12561-21munin-node20:55:240
2990099873,65cyclictest1227-21runrttasks21:05:020
2990099873,65cyclictest0-21swapper/022:09:550
2990199865,28cyclictest0-21swapper/121:32:411
2990099863,75cyclictest14206-21timerwakeupswit23:50:140
2990099863,75cyclictest0-21swapper/021:15:050
2990099863,63cyclictest17109-21ssh22:27:380
2990199853,28cyclictest17415-21taskset21:00:111
2990099854,72cyclictest22646-21diskmemload21:27:210
2990099854,72cyclictest0-21swapper/022:19:580
2990099854,63cyclictest0-21swapper/022:44:580
2990099854,62cyclictest0-21swapper/023:35:000
2990099854,62cyclictest0-21swapper/023:35:000
2990099853,75cyclictest25042-21processes21:10:160
2990099853,75cyclictest0-21swapper/022:01:590
2990099853,74cyclictest0-21swapper/021:45:550
29900998518,58cyclictest17855-21basename20:14:480
2990099845,61cyclictest0-21swapper/022:15:500
2990099845,61cyclictest0-21swapper/022:15:500
2990099844,73cyclictest0-21swapper/020:50:220
2990099844,72cyclictest0-21swapper/022:42:050
2990099844,72cyclictest0-21swapper/021:24:000
2990099844,71cyclictest0-21swapper/021:30:160
2990099844,62cyclictest0-21swapper/020:25:210
2990099844,61cyclictest1547-21nscd21:35:090
2990099844,61cyclictest1547-21nscd21:35:090
2990099843,75cyclictest0-21swapper/022:39:150
2990099843,75cyclictest0-21swapper/020:48:330
2990099843,73cyclictest0-21swapper/022:33:370
2990099843,67cyclictest0-21swapper/023:03:290
2990099843,65cyclictest13465-21munin-node21:40:040
2990099843,64cyclictest22646-21diskmemload20:40:060
2990099843,62cyclictest1124-21snmpd23:28:450
29900998420,45cyclictest0-21swapper/021:00:050
2990099834,61cyclictest0-21swapper/020:30:050
2990099833,73cyclictest0-21swapper/023:39:430
2990099833,72cyclictest31897-21yum-updatesd-he22:04:540
29900998320,44cyclictest0-21swapper/022:55:100
29900998320,44cyclictest0-21swapper/022:55:100
2990199824,14cyclictest0-21swapper/120:41:331
2990099823,61cyclictest12658-21ssh23:05:050
2990099823,61cyclictest0-21swapper/021:54:550
2990099814,59cyclictest0-21swapper/021:49:550
29900998135,39cyclictest3040-21df18:35:070
2990099813,61cyclictest0-21swapper/022:54:190
2990099813,59cyclictest1124-21snmpd19:03:340
219499810,4rtkit-daemon2193-21rtkit-daemon22:29:593
189152810,3sleep3361ktimersoftd/321:02:393
2990099793,69cyclictest0-21swapper/020:15:110
2990099793,69cyclictest0-21swapper/020:15:110
2990099793,67cyclictest8300-21crond19:54:510
2990099793,62cyclictest0-21swapper/023:47:090
2990099793,58cyclictest12800-21fschecks_count18:55:080
2990099793,58cyclictest12800-21fschecks_count18:55:080
29900997916,45cyclictest16930-21yum-updatesd-he19:05:030
116652790,4sleep121-21ksoftirqd/123:48:011
2990099783,68cyclictest0-21swapper/020:21:140
2990099782,59cyclictest0-21swapper/018:51:000
2990099773,68cyclictest0-21swapper/019:35:100
2990099773,68cyclictest0-21swapper/019:35:100
2990099763,67cyclictest7117-21if_err_eth019:50:110
2990099762,66cyclictest1124-21snmpd19:41:070
2990099753,66cyclictest0-21swapper/020:01:110
2990099753,64cyclictest0-21swapper/018:25:150
2990099753,56cyclictest0-21swapper/018:47:130
2990099752,65cyclictest4343-21forks19:45:060
2990099734,54cyclictest0-21swapper/018:40:100
2990099733,55cyclictest28877-21munin-node19:30:240
2990099733,55cyclictest0-21swapper/018:30:030
2990099733,54cyclictest0-21swapper/019:15:020
2990099733,48cyclictest19688-21taskset19:10:050
2990099724,61cyclictest0-21swapper/019:20:190
2990099723,46cyclictest0-21swapper/020:05:220
2990099702,62cyclictest1227-21runrttasks19:25:300
29903996823,26cyclictest9028-21aten_r1power_vo20:50:013
219499640,5rtkit-daemon2193-21rtkit-daemon21:59:453
219499640,4rtkit-daemon2193-21rtkit-daemon23:14:203
219499630,4rtkit-daemon2193-21rtkit-daemon22:34:593
29902995927,25cyclictest0-21swapper/221:34:032
2990199595,27cyclictest3917-21idleruntime-cro22:54:421
219499590,4rtkit-daemon2193-21rtkit-daemon20:37:113
175192594,46sleep30-21swapper/319:05:103
2990399583,48cyclictest0-21swapper/321:49:593
2990299584,46cyclictest0-21swapper/222:14:322
2990299583,47cyclictest0-21swapper/221:34:572
2990299583,47cyclictest0-21swapper/221:34:572
2990299583,37cyclictest0-21swapper/220:30:232
29901995837,14cyclictest0-21swapper/121:15:061
219499580,5rtkit-daemon2193-21rtkit-daemon22:50:062
219499580,4rtkit-daemon2193-21rtkit-daemon21:32:463
67262573,45sleep20-21swapper/219:50:072
2990399579,25cyclictest0-21swapper/321:58:233
2990399574,24cyclictest0-21swapper/321:10:093
2990299574,45cyclictest0-21swapper/220:40:022
2990299573,17cyclictest13800-21grep21:39:582
29901995728,12cyclictest4410-21kernelversion22:10:081
29901995718,11cyclictest31683-21fschecks_count21:20:021
219499570,5rtkit-daemon2193-21rtkit-daemon22:45:133
219499570,4rtkit-daemon2193-21rtkit-daemon22:39:583
2990399567,30cyclictest0-21swapper/320:05:173
2990299564,44cyclictest0-21swapper/223:04:582
2990199565,31cyclictest0-21swapper/121:44:451
29901995622,11cyclictest5072-21gltestperf22:55:011
29901995622,11cyclictest5072-21gltestperf22:55:011
219499560,6rtkit-daemon2193-21rtkit-daemon23:29:423
219499560,6rtkit-daemon2193-21rtkit-daemon19:15:072
219499560,5rtkit-daemon2193-21rtkit-daemon23:05:133
219499560,5rtkit-daemon2193-21rtkit-daemon19:55:122
74232553,13sleep20-21swapper/222:59:092
74232553,13sleep20-21swapper/222:59:092
2990399559,40cyclictest0-21swapper/323:21:373
2990399554,35cyclictest0-21swapper/321:16:433
2990399554,30cyclictest0-21swapper/319:20:023
2990299554,42cyclictest0-21swapper/220:25:232
29902995535,13cyclictest0-21swapper/222:04:562
2990299553,45cyclictest0-21swapper/223:16:592
2990199553,45cyclictest0-21swapper/123:49:551
219499550,6rtkit-daemon2193-21rtkit-daemon20:19:492
219499550,6rtkit-daemon2193-21rtkit-daemon20:19:492
219499550,5rtkit-daemon2193-21rtkit-daemon22:05:073
219499550,5rtkit-daemon2193-21rtkit-daemon21:50:002
219499550,5rtkit-daemon2193-21rtkit-daemon20:05:122
219499550,5rtkit-daemon2193-21rtkit-daemon19:45:052
219499550,5rtkit-daemon2193-21rtkit-daemon18:50:222
219499550,5rtkit-daemon2193-21rtkit-daemon18:49:532
2990399546,28cyclictest0-21swapper/320:27:023
2990399545,29cyclictest0-21swapper/323:50:143
2990399544,32cyclictest0-21swapper/323:41:393
2990399544,29cyclictest0-21swapper/318:35:103
2990399544,28cyclictest0-21swapper/322:50:123
29903995437,10cyclictest4252-21http_loadtime22:10:043
2990399542,25cyclictest0-21swapper/321:38:203
2990399542,25cyclictest0-21swapper/321:38:203
29903995411,38cyclictest0-21swapper/320:33:003
29903995410,29cyclictest107550irq/46-eth023:17:153
2990299544,42cyclictest5148-21aten_r1power_cu23:39:512
2990299544,42cyclictest0-21swapper/221:05:202
29902995434,14cyclictest0-21swapper/223:29:532
2990299543,12cyclictest0-21swapper/222:59:582
29902995422,26cyclictest28744-21df_abs21:59:592
2990199548,26cyclictest0-21swapper/121:10:041
29901995425,22cyclictest9783-21munin-node21:35:011
29901995425,22cyclictest9783-21munin-node21:35:011
29901995419,22cyclictest0-21swapper/120:46:391
268182547,39sleep10-21swapper/121:56:271
219499540,7rtkit-daemon2193-21rtkit-daemon22:48:512
219499540,5rtkit-daemon2193-21rtkit-daemon21:15:172
219499540,5rtkit-daemon2193-21rtkit-daemon20:45:103
219499540,5rtkit-daemon2193-21rtkit-daemon19:39:512
219499540,5rtkit-daemon2193-21rtkit-daemon19:39:512
219499540,5rtkit-daemon2193-21rtkit-daemon19:32:512
219499540,4rtkit-daemon2193-21rtkit-daemon23:31:493
91472532,9sleep20-21swapper/222:15:592
91472532,9sleep20-21swapper/222:15:592
2990399535,28cyclictest0-21swapper/319:25:173
2990399535,27cyclictest0-21swapper/321:26:493
29903995320,13cyclictest0-21swapper/323:45:383
29903995320,13cyclictest0-21swapper/320:10:243
29903995316,29cyclictest0-21swapper/322:54:533
29903995316,29cyclictest0-21swapper/322:54:533
29903995313,21cyclictest107550irq/46-eth022:17:313
29903995313,21cyclictest107550irq/46-eth022:17:313
2990299535,40cyclictest0-21swapper/222:35:172
2990299533,43cyclictest0-21swapper/223:49:582
2990299533,42cyclictest0-21swapper/222:39:502
2990299533,31cyclictest0-21swapper/219:09:562
2990199534,30cyclictest0-21swapper/123:00:171
29901995323,14cyclictest0-21swapper/122:25:031
242152533,42sleep20-21swapper/221:10:042
219499530,6rtkit-daemon2193-21rtkit-daemon21:47:083
219499530,5rtkit-daemon2193-21rtkit-daemon22:27:213
219499530,5rtkit-daemon2193-21rtkit-daemon20:40:033
219499530,5rtkit-daemon2193-21rtkit-daemon19:20:142
219499530,5rtkit-daemon2193-21rtkit-daemon19:04:442
219499530,5rtkit-daemon2193-21rtkit-daemon18:35:162
158582533,42sleep20-21swapper/223:09:572
110612534,42sleep30-21swapper/323:04:023
2990399525,28cyclictest0-21swapper/319:35:013
2990399525,28cyclictest0-21swapper/319:35:013
2990399524,32cyclictest0-21swapper/321:42:503
2990399524,29cyclictest0-21swapper/318:45:113
2990399524,29cyclictest0-21swapper/318:30:113
2990399524,28cyclictest12228-21python22:20:143
2990399524,28cyclictest0-21swapper/319:50:023
29903995221,24cyclictest0-21swapper/323:38:243
29903995221,24cyclictest0-21swapper/323:38:243
29903995220,13cyclictest0-21swapper/318:55:113
29903995220,13cyclictest0-21swapper/318:55:113
2990299525,39cyclictest0-21swapper/221:25:062
2990299525,38cyclictest0-21swapper/220:45:092
2990299524,13cyclictest0-21swapper/222:25:152
2990299523,43cyclictest0-21swapper/222:30:122
2990299523,42cyclictest0-21swapper/223:25:082
2990299523,42cyclictest0-21swapper/220:50:072
2990199524,30cyclictest0-21swapper/121:50:141
2990199524,29cyclictest0-21swapper/122:35:171
2990199524,27cyclictest0-21swapper/121:07:301
29901995223,10cyclictest30784-21perl23:29:581
29901995222,13cyclictest0-21swapper/120:05:221
29901995219,15cyclictest0-21swapper/122:24:441
219499520,5rtkit-daemon2193-21rtkit-daemon19:29:512
219499520,5rtkit-daemon2193-21rtkit-daemon19:09:522
115812522,9sleep30-21swapper/318:50:313
2990399514,29cyclictest0-21swapper/320:56:253
2990399514,29cyclictest0-21swapper/320:56:253
2990399514,28cyclictest0-21swapper/319:15:073
2990399514,23cyclictest19913-21yum-updatesd-he21:05:053
29903995120,12cyclictest32362-21ntp_states21:20:133
2990299513,41cyclictest0-21swapper/222:19:562
2990299513,40cyclictest0-21swapper/221:55:152
29902995110,25cyclictest1369-21aten_r1power_en23:34:522
29902995110,25cyclictest1369-21aten_r1power_en23:34:522
2990199515,28cyclictest0-21swapper/123:25:031
2990199515,28cyclictest0-21swapper/122:02:091
2990199515,28cyclictest0-21swapper/119:50:141
29901995119,13cyclictest0-21swapper/119:40:051
219499510,5rtkit-daemon2193-21rtkit-daemon21:24:462
114842512,9sleep20-21swapper/223:47:302
2990399505,27cyclictest0-21swapper/318:25:043
2990399505,25cyclictest0-21swapper/320:00:103
29903995020,7cyclictest0-21swapper/320:20:023
2990399502,32cyclictest0-21swapper/319:48:213
29903995013,19cyclictest0-21swapper/318:40:043
2990299504,38cyclictest0-21swapper/220:56:532
2990299504,38cyclictest0-21swapper/220:56:532
2990299503,12cyclictest0-21swapper/223:19:562
2990299503,12cyclictest0-21swapper/221:00:002
2990199506,27cyclictest0-21swapper/123:20:371
2990199505,37cyclictest0-21swapper/121:24:551
2990199504,27cyclictest0-21swapper/122:14:531
2990199504,27cyclictest0-21swapper/122:14:531
2990199504,27cyclictest0-21swapper/119:05:121
2990199504,27cyclictest0-21swapper/118:40:211
2990199503,34cyclictest0-21swapper/120:50:171
29901995022,12cyclictest0-21swapper/120:56:051
29901995022,12cyclictest0-21swapper/120:56:051
219499500,5rtkit-daemon2193-21rtkit-daemon21:49:002
219499500,5rtkit-daemon2193-21rtkit-daemon18:55:072
219499500,5rtkit-daemon2193-21rtkit-daemon18:55:072
21362502,9sleep20-21swapper/218:32:322
2990399494,26cyclictest0-21swapper/320:16:133
2990399494,26cyclictest0-21swapper/320:16:133
2990399494,26cyclictest0-21swapper/319:40:073
2990199495,28cyclictest0-21swapper/122:40:271
2990199495,25cyclictest2150-21perl23:34:591
2990199495,25cyclictest2150-21perl23:34:591
2990199494,28cyclictest0-21swapper/120:00:041
2990199494,28cyclictest0-21swapper/119:20:181
29901994920,12cyclictest0-21swapper/119:14:521
29901994915,29cyclictest0-21swapper/118:30:211
285442494,9sleep10-21swapper/119:28:381
237072492,39sleep10-21swapper/119:17:451
219499490,5rtkit-daemon2193-21rtkit-daemon18:44:532
2990299484,12cyclictest0-21swapper/220:35:182
2990299483,28cyclictest0-21swapper/218:29:532
2990199484,27cyclictest0-21swapper/119:45:131
2990199484,27cyclictest0-21swapper/118:25:231
2990199483,27cyclictest0-21swapper/118:55:201
2990199483,27cyclictest0-21swapper/118:55:201
29901994819,12cyclictest0-21swapper/119:59:491
219499480,5rtkit-daemon2193-21rtkit-daemon19:44:502
309922472,9sleep10-21swapper/119:34:221
29903994712,12cyclictest0-21swapper/319:56:103
2990199474,27cyclictest0-21swapper/119:35:241
2990199474,27cyclictest0-21swapper/119:35:241
2990199474,26cyclictest0-21swapper/118:50:201
2990399464,25cyclictest0-21swapper/319:10:033
2990399463,24cyclictest0-21swapper/319:34:513
29901994628,11cyclictest15758-21cut19:00:171
176332462,37sleep20-21swapper/220:12:082
2990399454,22cyclictest0-21swapper/319:00:043
2990199455,33cyclictest0-21swapper/118:35:111
225482452,36sleep10-21swapper/120:23:431
124112453,35sleep20-21swapper/220:00:232
29902994431,8cyclictest21904-21find20:20:212
175602442,35sleep10-21swapper/120:11:101
2990399422,22cyclictest0-21swapper/318:24:543
29901994223,13cyclictest0-21swapper/118:24:531
29902994021,6cyclictest29877-21latency_hist18:24:532
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional