You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-30 - 01:43

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Jul 30, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
275679910418,56cyclictest0-21swapper/022:14:540
27567991034,70cyclictest0-21swapper/021:06:500
2194991030,6rtkit-daemon0-21swapper/022:46:490
27577991014,88cyclictest5905-21gltestperf20:36:553
275679910118,56cyclictest0-21swapper/021:21:480
27567991004,72cyclictest0-21swapper/023:21:550
2756799994,71cyclictest0-21swapper/022:41:510
2756799984,69cyclictest0-21swapper/020:21:520
2756799975,75cyclictest0-21swapper/021:17:120
2756799975,70cyclictest0-21swapper/021:56:240
2756799975,70cyclictest0-21swapper/021:56:240
2756799974,69cyclictest0-21swapper/021:01:510
2756799974,69cyclictest0-21swapper/020:11:560
2756799964,66cyclictest0-21swapper/022:39:410
2756799964,66cyclictest0-21swapper/022:39:410
2756799954,69cyclictest0-21swapper/018:46:530
2756799943,73cyclictest7814-21ssh22:17:020
27567999418,54cyclictest0-21swapper/020:58:550
2757799934,81cyclictest0-21swapper/323:41:193
2757799933,81cyclictest1413-21latency_hist20:31:383
2756799936,72cyclictest0-21swapper/021:27:020
2756799936,70cyclictest31228-21yum-updatesd-he22:52:270
2756799934,70cyclictest0-21swapper/022:35:430
27567999317,12cyclictest0-21swapper/020:16:580
27567999313,8cyclictest0-21swapper/020:42:100
2756799924,67cyclictest0-21swapper/023:13:440
2756799924,23cyclictest0-21swapper/021:46:510
27567999223,49cyclictest0-21swapper/019:11:530
27567999219,57cyclictest0-21swapper/019:27:090
2757799914,65cyclictest1227-21runrttasks23:19:203
2757799914,65cyclictest1227-21runrttasks23:19:203
2757799914,59cyclictest0-21swapper/320:44:333
2757799913,63cyclictest17411-21cut22:31:573
2756799915,68cyclictest0-21swapper/022:57:040
2756799915,66cyclictest12973-21sort21:36:540
2756799914,71cyclictest0-21swapper/023:31:530
2756799914,65cyclictest0-21swapper/022:06:360
2756799914,65cyclictest0-21swapper/022:03:580
2756799908,12cyclictest0-21swapper/023:02:080
2756799905,70cyclictest0-21swapper/019:41:580
2756799904,72cyclictest0-21swapper/020:56:360
2756799904,69cyclictest0-21swapper/021:56:520
27567999011,9cyclictest107550irq/46-eth020:27:110
2757799893,78cyclictest0-21swapper/319:32:063
2757799893,77cyclictest24594-21ssh23:31:573
2756799895,68cyclictest0-21swapper/020:37:330
2756799893,21cyclictest0-21swapper/023:07:500
2757799884,76cyclictest0-21swapper/321:57:063
2757799883,62cyclictest0-21swapper/321:41:343
2756799887,57cyclictest0-21swapper/022:23:480
2756799885,67cyclictest0-21swapper/018:36:550
2756799884,69cyclictest0-21swapper/021:36:250
2756799884,68cyclictest0-21swapper/018:31:540
2756799884,63cyclictest0-21swapper/020:36:200
2756799884,63cyclictest0-21swapper/020:36:200
2756799884,61cyclictest0-21swapper/020:47:120
27567998814,9cyclictest26690-21telnet23:36:430
27567998813,10cyclictest0-21swapper/023:18:060
27567998813,10cyclictest0-21swapper/023:18:060
27567998810,14cyclictest0-21swapper/018:12:150
2757799874,76cyclictest0-21swapper/322:21:053
2757799874,75cyclictest0-21swapper/321:52:053
2757799874,75cyclictest0-21swapper/321:52:053
2757799874,65cyclictest0-21swapper/322:05:443
2757799874,64cyclictest0-21swapper/322:13:293
2756799874,69cyclictest0-21swapper/018:57:120
2756799874,68cyclictest0-21swapper/022:28:580
2756799874,68cyclictest0-21swapper/021:42:340
2756799874,65cyclictest0-21swapper/019:32:090
2756799874,63cyclictest0-21swapper/023:28:000
27567998723,57cyclictest0-21swapper/021:13:410
2757799864,74cyclictest22366-21grep21:01:553
2757799864,74cyclictest0-21swapper/322:37:313
2757799864,74cyclictest0-21swapper/322:37:313
2757799864,74cyclictest0-21swapper/320:22:073
2757799864,59cyclictest0-21swapper/323:27:583
2757799863,74cyclictest31025-21gltestperf18:17:043
2756799864,74cyclictest0-21swapper/018:26:560
27567998616,8cyclictest32565-21munin-node18:22:150
27567998616,8cyclictest32565-21munin-node18:22:150
2757799855,73cyclictest0-21swapper/321:23:523
2757799854,74cyclictest0-21swapper/321:32:053
2757799854,73cyclictest0-21swapper/322:56:563
2757799854,58cyclictest0-21swapper/323:02:213
2757799853,57cyclictest25903-21latency21:06:583
2756799854,66cyclictest0-21swapper/018:21:430
27567998532,45cyclictest27420-21sed19:17:010
2757799845,72cyclictest0-21swapper/320:52:233
2757799844,73cyclictest0-21swapper/318:12:163
2757799844,72cyclictest0-21swapper/322:44:163
2757799844,72cyclictest0-21swapper/322:07:543
2757799843,73cyclictest21431-21grep21:01:373
2757799843,61cyclictest15524-21crond20:01:393
27567998421,55cyclictest0-21swapper/018:42:000
27567998419,58cyclictest0-21swapper/019:57:080
2757799835,70cyclictest0-21swapper/321:16:593
2757799834,71cyclictest0-21swapper/320:49:213
2757799833,72cyclictest10488-21head22:21:533
2757799833,64cyclictest10970-21fschecks_time23:11:503
2756799834,23cyclictest0-21swapper/019:51:510
2756799834,23cyclictest0-21swapper/019:51:510
2756799833,22cyclictest14611-21munin-node18:51:540
27567998314,11cyclictest0-21swapper/019:06:540
27567998314,11cyclictest0-21swapper/019:06:540
2757799825,70cyclictest23906-21aten_r1power_vo20:16:493
2757799824,71cyclictest0-21swapper/319:21:413
2757799824,70cyclictest0-21swapper/322:50:363
2757799824,70cyclictest0-21swapper/321:11:553
2757799824,70cyclictest0-21swapper/320:36:383
2757799824,70cyclictest0-21swapper/320:36:383
2757799824,60cyclictest0-21swapper/318:56:413
2757799824,57cyclictest0-21swapper/320:15:203
2757799823,73cyclictest19719-21sed21:46:543
2757799815,60cyclictest0-21swapper/321:27:263
2757799814,69cyclictest0-21swapper/320:01:583
2757799813,72cyclictest0-21swapper/322:26:513
2756799814,70cyclictest0-21swapper/020:06:550
2757799804,60cyclictest0-21swapper/323:21:533
2757799803,69cyclictest29591-21fschecks_count19:21:583
2756799803,20cyclictest15761-21munin-node20:02:140
2757799793,69cyclictest979-21gltestperf18:22:023
2757799793,69cyclictest979-21gltestperf18:22:023
2756799793,20cyclictest8628-21runrttasks19:46:510
2757799784,67cyclictest0-21swapper/322:53:253
2757799783,67cyclictest3829-21aten_r1power_cu19:36:523
2757799783,48cyclictest0-21swapper/323:08:193
2756799784,12cyclictest1227-21runrttasks19:38:140
219499780,4rtkit-daemon2193-21rtkit-daemon19:12:353
2757799774,66cyclictest0-21swapper/319:43:193
2757799774,65cyclictest27625-21grep18:11:433
2757799773,66cyclictest16168-21fschecks_count21:41:533
2757799773,65cyclictest9604-21munin-plugin-st18:41:423
2756799775,11cyclictest1227-21runrttasks19:25:290
2757799764,61cyclictest0-21swapper/320:07:143
2757799763,66cyclictest0-21swapper/318:57:133
2757799763,65cyclictest32388-21latency19:27:033
2757799763,45cyclictest0-21swapper/319:02:123
2756799763,20cyclictest0-21swapper/019:03:240
2757799754,64cyclictest0-21swapper/318:32:063
2757799743,45cyclictest13628-21sendmail_mailqu18:47:103
2756799745,13cyclictest27561-21cyclictest18:11:430
2757799733,9cyclictest22737-21idleruntime19:07:033
2757799733,9cyclictest22737-21idleruntime19:07:033
2757799724,44cyclictest0-21swapper/319:56:403
2757799713,9cyclictest10427-21runrttasks19:47:313
2757799704,43cyclictest0-21swapper/318:43:213
2757799703,59cyclictest0-21swapper/318:27:553
2757799698,41cyclictest7150irq/45-ahci19:52:303
219499650,4rtkit-daemon2193-21rtkit-daemon21:52:142
219499650,4rtkit-daemon2193-21rtkit-daemon21:52:142
2757699624,47cyclictest0-21swapper/221:27:052
52912613,12sleep20-21swapper/222:13:362
27576996041,12cyclictest0-21swapper/221:47:012
2757699594,47cyclictest0-21swapper/222:16:562
219499590,6rtkit-daemon2193-21rtkit-daemon20:51:162
219499590,6rtkit-daemon0-21swapper/223:32:402
2757699585,44cyclictest0-21swapper/222:41:522
2757699584,46cyclictest0-21swapper/222:01:512
2757599584,46cyclictest0-21swapper/123:16:491
2757599584,46cyclictest0-21swapper/123:16:491
315932573,45sleep10-21swapper/119:26:541
27576995712,36cyclictest0-21swapper/223:26:322
27576995712,27cyclictest0-21swapper/222:37:052
27576995712,27cyclictest0-21swapper/222:37:052
219499570,6rtkit-daemon2193-21rtkit-daemon20:25:322
219499570,4rtkit-daemon2193-21rtkit-daemon22:47:572
2757699564,44cyclictest0-21swapper/218:22:182
2757699564,44cyclictest0-21swapper/218:22:182
27576995638,10cyclictest31041-21grep18:17:042
27575995639,10cyclictest7804-21cut23:06:551
27575995617,23cyclictest26962-21cpuspeed_turbos23:36:461
2757599560,9cyclictest107550irq/46-eth020:32:331
2757599560,9cyclictest107550irq/46-eth020:32:331
219499560,6rtkit-daemon2193-21rtkit-daemon21:16:382
219499560,5rtkit-daemon2193-21rtkit-daemon20:54:242
158512563,11sleep10-21swapper/121:41:511
34142553,44sleep10-21swapper/119:34:281
2757699555,20cyclictest1227-21runrttasks21:07:262
2757699555,13cyclictest0-21swapper/222:52:022
2757699554,43cyclictest0-21swapper/222:36:332
2757699554,32cyclictest0-21swapper/219:21:562
27576995538,10cyclictest17320-21grep18:56:552
2757699553,25cyclictest8884-21ssh23:07:272
2757599555,31cyclictest0-21swapper/121:31:401
2757599554,35cyclictest0-21swapper/122:13:081
2757599554,32cyclictest0-21swapper/122:59:161
260062553,45sleep10-21swapper/120:18:341
219499550,4rtkit-daemon2193-21rtkit-daemon20:29:252
183222553,46sleep10-21swapper/122:33:151
11362553,45sleep11217-21cat22:07:061
48762543,11sleep24878-21ssh21:24:302
297532544,43sleep10-21swapper/122:01:581
2757699545,30cyclictest0-21swapper/222:56:592
2757699544,43cyclictest0-21swapper/223:36:582
27576995436,12cyclictest0-21swapper/219:31:512
2757699543,26cyclictest12597-21chrt23:14:062
2757599545,40cyclictest0-21swapper/118:41:531
2757599544,34cyclictest0-21swapper/121:30:411
219499540,4rtkit-daemon2193-21rtkit-daemon23:04:112
157352543,13sleep10-21swapper/118:52:081
88892534,40sleep20-21swapper/218:37:132
2757699535,41cyclictest0-21swapper/222:25:362
2757699535,14cyclictest0-21swapper/220:37:252
2757699534,42cyclictest0-21swapper/220:41:522
27576995332,14cyclictest0-21swapper/221:11:532
2757699533,43cyclictest0-21swapper/222:27:062
2757699533,42cyclictest25889-21df_abs21:56:532
27576995326,20cyclictest0-21swapper/220:02:382
2757599535,40cyclictest0-21swapper/121:21:541
2757599534,34cyclictest0-21swapper/123:15:401
27575995336,10cyclictest17824-21tail18:57:011
27575995332,14cyclictest0-21swapper/122:22:051
2757599533,35cyclictest32150-21taskset22:55:471
269092536,39sleep10-21swapper/118:07:111
219499530,4rtkit-daemon2193-21rtkit-daemon19:05:212
102562533,12sleep10-21swapper/119:47:141
2757699525,39cyclictest0-21swapper/220:59:062
2757699524,41cyclictest0-21swapper/223:17:042
2757699524,41cyclictest0-21swapper/223:17:042
27576995235,10cyclictest11331-21grep19:51:532
27576995235,10cyclictest11331-21grep19:51:532
27576995234,11cyclictest15492-21sed18:52:032
2757599524,30cyclictest0-21swapper/121:52:091
2757599524,30cyclictest0-21swapper/121:52:091
2757599524,24cyclictest1227-21runrttasks23:29:221
263762522,10sleep20-21swapper/220:19:562
219499520,4rtkit-daemon2193-21rtkit-daemon19:12:202
298482513,42sleep10-21swapper/118:15:321
2757699515,38cyclictest0-21swapper/220:31:542
2757699515,38cyclictest0-21swapper/220:31:542
2757699514,41cyclictest0-21swapper/223:26:452
2757699514,40cyclictest0-21swapper/222:07:052
2757699514,28cyclictest0-21swapper/221:02:502
2757699514,13cyclictest0-21swapper/221:36:562
27576995132,12cyclictest0-21swapper/221:31:562
2757599515,28cyclictest0-21swapper/121:16:491
2757599514,29cyclictest0-21swapper/123:21:491
2757599514,29cyclictest0-21swapper/121:36:491
2757599513,43cyclictest0-21swapper/120:29:511
27575995123,12cyclictest0-21swapper/122:28:481
27575995120,13cyclictest0-21swapper/121:59:051
27575995110,23cyclictest0-21swapper/121:06:461
207242513,42sleep10-21swapper/120:59:381
177212513,11sleep10-21swapper/120:03:591
60352503,12sleep10-21swapper/123:04:111
46172503,11sleep10-21swapper/118:29:021
310752503,41sleep10-21swapper/119:26:261
2757699505,27cyclictest0-21swapper/219:47:032
2757699504,13cyclictest0-21swapper/220:15:092
2757599505,28cyclictest0-21swapper/119:01:531
27575995020,13cyclictest0-21swapper/120:21:501
27575995019,13cyclictest0-21swapper/120:46:491
27575995019,13cyclictest0-21swapper/119:46:401
237242503,40sleep10-21swapper/119:09:011
237242503,40sleep10-21swapper/119:09:011
20812503,11sleep10-21swapper/118:22:451
20812503,11sleep10-21swapper/118:22:451
199852502,11sleep10-21swapper/120:07:251
130522503,41sleep10-21swapper/119:55:361
130522503,41sleep10-21swapper/119:55:361
95312493,11sleep10-21swapper/118:40:551
94082493,39sleep19420-21iostat_ios20:42:001
57152492,9sleep20-21swapper/219:38:162
2757699494,27cyclictest0-21swapper/218:42:042
27576994919,12cyclictest0-21swapper/221:42:042
2757599496,38cyclictest201ktimersoftd/121:48:591
2757599495,28cyclictest0-21swapper/118:17:071
2757599495,27cyclictest0-21swapper/119:17:031
2757599494,28cyclictest0-21swapper/123:31:571
2757599494,28cyclictest0-21swapper/121:12:021
2757599494,28cyclictest0-21swapper/120:52:261
2757599494,28cyclictest0-21swapper/119:36:551
2757599494,27cyclictest0-21swapper/121:01:481
2757599494,27cyclictest0-21swapper/120:38:401
2757599494,27cyclictest0-21swapper/119:57:021
2757599494,22cyclictest0-21swapper/120:16:281
27575994923,12cyclictest0-21swapper/122:50:021
27575994919,13cyclictest0-21swapper/118:47:091
27575994918,13cyclictest0-21swapper/122:41:531
251862493,11sleep10-21swapper/119:12:031
216522494,12sleep10-21swapper/122:38:271
216522494,12sleep10-21swapper/122:38:271
2757699484,26cyclictest0-21swapper/219:58:332
2757699484,26cyclictest0-21swapper/218:47:022
2757699483,28cyclictest0-21swapper/219:20:582
2757599484,27cyclictest0-21swapper/122:16:461
2757699474,27cyclictest0-21swapper/218:27:122
2757699473,27cyclictest0-21swapper/219:41:532
27576994717,13cyclictest0-21swapper/220:11:382
2757599474,26cyclictest0-21swapper/118:33:191
27576994619,12cyclictest0-21swapper/219:08:252
27576994619,12cyclictest0-21swapper/219:08:252
2757699454,35cyclictest0-21swapper/218:12:062
2757699454,33cyclictest0-21swapper/218:31:552
27576994517,11cyclictest0-21swapper/219:26:512
27576994026,8cyclictest0-21swapper/218:11:432
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional