You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-26 - 13:12

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jul 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991100,4rtkit-daemon2193-21rtkit-daemon21:20:380
2194991060,6rtkit-daemon2193-21rtkit-daemon20:21:033
219499960,4rtkit-daemon2193-21rtkit-daemon20:40:403
19238999319,56cyclictest1227-21runrttasks22:15:503
219499920,5rtkit-daemon2193-21rtkit-daemon22:49:340
1923899903,9cyclictest17005-21runrttasks23:37:573
1923899894,66cyclictest0-21swapper/323:26:383
1923899893,62cyclictest0-21swapper/323:21:093
1923899883,11cyclictest0-21swapper/322:33:263
19238998812,53cyclictest0-21swapper/322:51:343
1923899874,9cyclictest20836-21ntp_states21:15:493
1923899874,64cyclictest0-21swapper/323:00:163
1923899874,60cyclictest0-21swapper/321:07:383
1923899873,60cyclictest0-21swapper/320:18:163
19238998717,46cyclictest0-21swapper/320:25:403
19238998716,56cyclictest0-21swapper/323:06:023
19238998711,63cyclictest0-21swapper/321:10:513
19238998711,53cyclictest0-21swapper/321:45:163
19238998710,53cyclictest0-21swapper/321:50:483
219499860,6rtkit-daemon2193-21rtkit-daemon23:40:250
1923899864,9cyclictest7468-21needreboot18:55:523
1923899864,75cyclictest0-21swapper/323:12:073
1923899864,69cyclictest0-21swapper/320:00:523
1923899864,63cyclictest0-21swapper/321:46:373
1923899864,60cyclictest0-21swapper/321:55:343
1923899863,61cyclictest0-21swapper/320:54:243
1923899863,61cyclictest0-21swapper/320:54:243
1923899863,10cyclictest1227-21runrttasks21:25:593
19238998616,47cyclictest0-21swapper/321:03:523
1923899858,59cyclictest30274-21cpuspeed_turbos22:20:353
1923899856,59cyclictest32239-21aten_r1power_vo20:45:363
1923899854,58cyclictest23236-21df21:20:383
1923899853,9cyclictest30871-21grep21:30:533
1923899853,9cyclictest30871-21grep21:30:533
19238998516,46cyclictest10485-21munin-run22:40:183
1923899845,54cyclictest0-21swapper/318:50:513
1923899844,63cyclictest20637-21df_abs22:05:353
1923899844,60cyclictest0-21swapper/322:50:193
1923899844,12cyclictest0-21swapper/320:55:503
1923899844,12cyclictest0-21swapper/319:00:513
1923899843,9cyclictest13792-21cpuspeed_turbos19:10:423
1923899843,57cyclictest0-21swapper/320:31:173
19238998420,47cyclictest0-21swapper/323:15:333
1923899839,53cyclictest107550irq/46-eth021:35:473
1923899838,7cyclictest18168-21ps22:00:483
1923899834,56cyclictest0-21swapper/322:11:133
1923899834,56cyclictest0-21swapper/322:11:133
1923899833,62cyclictest1602-21ssh22:25:393
1923899833,56cyclictest11038-21munin-node19:05:453
1923899833,56cyclictest0-21swapper/323:44:223
1923899833,10cyclictest11022-21sort22:40:333
1923899826,59cyclictest11670-21cpuspeed_turbos23:30:313
1923899824,12cyclictest0-21swapper/319:40:493
1923899823,9cyclictest27232-21ssh20:35:583
1923899823,64cyclictest0-21swapper/318:21:053
19238998213,47cyclictest0-21swapper/323:03:413
219499810,5rtkit-daemon2193-21rtkit-daemon18:32:073
219499810,5rtkit-daemon2193-21rtkit-daemon18:27:373
1923899814,59cyclictest0-21swapper/318:35:473
19238998110,8cyclictest7150irq/45-ahci19:40:253
166832810,7sleep20-21swapper/222:48:532
219499800,4rtkit-daemon2193-21rtkit-daemon20:25:332
1923899804,12cyclictest0-21swapper/320:10:383
1923899804,12cyclictest0-21swapper/319:15:413
1923899794,60cyclictest0-21swapper/319:30:483
1923899794,52cyclictest0-21swapper/318:46:143
219499780,4rtkit-daemon2193-21rtkit-daemon19:57:563
1923899784,58cyclictest0-21swapper/319:45:573
1923899783,53cyclictest0-21swapper/319:50:383
219499770,4rtkit-daemon11976-21diskmemload21:47:520
1923899774,12cyclictest0-21swapper/319:21:513
1923899774,12cyclictest0-21swapper/319:21:513
1923899773,52cyclictest0-21swapper/318:40:403
1923899773,52cyclictest0-21swapper/318:40:403
19238997713,55cyclictest0-21swapper/320:05:433
19238997713,55cyclictest0-21swapper/320:05:433
219499760,4rtkit-daemon2193-21rtkit-daemon23:09:492
1923899762,68cyclictest0-21swapper/318:16:433
19238997310,48cyclictest0-21swapper/319:25:383
219499720,5rtkit-daemon2193-21rtkit-daemon22:23:362
219499710,7rtkit-daemon0-21swapper/223:39:102
219499700,4rtkit-daemon2193-21rtkit-daemon20:14:182
19237997021,28cyclictest1227-21runrttasks20:37:342
219499690,5rtkit-daemon2193-21rtkit-daemon18:15:452
219499670,5rtkit-daemon2193-21rtkit-daemon23:31:332
219499670,5rtkit-daemon2193-21rtkit-daemon22:01:292
1923899674,55cyclictest0-21swapper/318:15:303
219499660,4rtkit-daemon2193-21rtkit-daemon22:06:062
219499660,4rtkit-daemon2193-21rtkit-daemon21:14:312
219499660,4rtkit-daemon2193-21rtkit-daemon20:34:322
219499660,4rtkit-daemon2193-21rtkit-daemon18:40:592
219499660,4rtkit-daemon2193-21rtkit-daemon18:40:592
59252653,54sleep00-21swapper/021:42:370
219499650,5rtkit-daemon2193-21rtkit-daemon22:51:572
219499650,4rtkit-daemon2193-21rtkit-daemon21:09:162
219499630,6rtkit-daemon2193-21rtkit-daemon21:42:302
219499620,13rtkit-daemon2193-21rtkit-daemon19:56:112
19235996213,39cyclictest0-21swapper/120:25:571
232022613,22sleep10-21swapper/122:58:411
219499610,13rtkit-daemon2193-21rtkit-daemon22:35:502
46902604,48sleep04790-21sh22:30:340
219499600,12rtkit-daemon2193-21rtkit-daemon22:40:422
1923599604,14cyclictest0-21swapper/121:56:541
19231996017,30cyclictest0-21swapper/020:55:450
219499590,7rtkit-daemon2193-21rtkit-daemon23:15:482
219499590,7rtkit-daemon0-21swapper/321:02:392
19235995841,12cyclictest0-21swapper/121:39:401
19235995825,14cyclictest0-21swapper/122:35:181
116162583,12sleep00-21swapper/019:05:460
219499570,4rtkit-daemon2193-21rtkit-daemon18:27:072
307402563,44sleep030890-21tune2fs19:45:440
235692562,10sleep00-21swapper/018:21:040
219499560,7rtkit-daemon0-21swapper/321:22:152
219499560,6rtkit-daemon2193-21rtkit-daemon18:31:452
219499560,4rtkit-daemon2193-21rtkit-daemon21:47:372
19237995636,12cyclictest0-21swapper/220:50:572
19237995636,12cyclictest0-21swapper/220:50:572
1923599567,42cyclictest13662-21tune2fs21:05:401
1923199564,44cyclictest0-21swapper/022:15:480
1923199564,12cyclictest0-21swapper/020:40:400
219499550,5rtkit-daemon2193-21rtkit-daemon23:40:552
219499550,5rtkit-daemon2193-21rtkit-daemon21:25:532
219499550,4rtkit-daemon2193-21rtkit-daemon22:13:132
219499550,4rtkit-daemon2193-21rtkit-daemon22:13:132
1923799555,34cyclictest0-21swapper/220:22:012
1923799555,14cyclictest0-21swapper/222:34:392
1923799555,13cyclictest0-21swapper/219:20:422
1923799555,13cyclictest0-21swapper/219:20:422
1923799554,31cyclictest0-21swapper/218:51:022
1923799554,26cyclictest0-21swapper/223:20:312
19237995514,21cyclictest0-21swapper/219:05:402
1923599558,29cyclictest0-21swapper/121:30:411
1923599558,29cyclictest0-21swapper/121:30:411
1923599557,41cyclictest0-21swapper/121:11:211
19235995540,9cyclictest21462-21cut19:25:461
1923599554,13cyclictest0-21swapper/121:40:451
1923599553,46cyclictest0-21swapper/121:45:481
19231995538,10cyclictest16836-21aten2.4-expect22:00:310
1923199553,38cyclictest0-21swapper/023:20:260
219499540,5rtkit-daemon2193-21rtkit-daemon20:46:092
219499540,4rtkit-daemon2193-21rtkit-daemon22:28:502
219499540,4rtkit-daemon2193-21rtkit-daemon21:59:062
219499540,4rtkit-daemon2193-21rtkit-daemon21:35:452
1923799546,29cyclictest0-21swapper/220:15:572
19237995434,12cyclictest1227-21runrttasks20:05:252
1923799543,36cyclictest0-21swapper/222:56:572
1923599545,25cyclictest28135-21sort23:05:401
19235995411,28cyclictest0-21swapper/123:25:321
1923199544,44cyclictest0-21swapper/023:07:050
1923199543,46cyclictest0-21swapper/021:55:370
1923199543,44cyclictest3576-21sh20:50:390
1923199543,44cyclictest3576-21sh20:50:390
1923199543,44cyclictest0-21swapper/022:55:580
176142543,43sleep017752-21sh22:50:330
254862532,43sleep00-21swapper/020:35:340
219499530,5rtkit-daemon2193-21rtkit-daemon23:26:482
219499530,5rtkit-daemon2193-21rtkit-daemon20:59:312
219499530,4rtkit-daemon2193-21rtkit-daemon23:02:342
19237995337,10cyclictest21433-21head19:25:462
19237995321,14cyclictest0-21swapper/220:40:552
19237995321,13cyclictest0-21swapper/218:56:022
19237995320,27cyclictest22357-21kworker/2:021:50:392
1923599537,40cyclictest12495-21unixbench-2d22:40:531
1923599537,37cyclictest10837-21munin-node21:00:471
1923599534,42cyclictest0-21swapper/120:41:201
19235995336,10cyclictest0-21swapper/123:35:471
19235995311,36cyclictest11976-21diskmemload20:35:381
1923199537,41cyclictest15-21rcuc/020:30:330
1923199537,40cyclictest0-21swapper/023:04:320
1923199534,42cyclictest0-21swapper/022:10:440
1923199534,42cyclictest0-21swapper/022:10:440
19231995335,12cyclictest0-21swapper/021:50:430
1923199533,43cyclictest0-21swapper/023:25:300
117212532,10sleep00-21swapper/020:12:160
66382522,43sleep00-21swapper/018:55:420
219499520,4rtkit-daemon2193-21rtkit-daemon23:10:192
1923799525,14cyclictest0-21swapper/222:16:012
1923799525,13cyclictest0-21swapper/221:19:522
1923799524,28cyclictest0-21swapper/219:50:462
1923599525,29cyclictest0-21swapper/120:30:491
19235995222,13cyclictest0-21swapper/122:53:401
1923199527,40cyclictest15-21rcuc/023:15:370
1923199527,39cyclictest0-21swapper/021:01:190
1923199524,41cyclictest0-21swapper/023:35:370
1923199524,22cyclictest0-21swapper/021:25:330
1923199523,43cyclictest2538-21cat19:55:250
1923199523,42cyclictest20420-21timerandwakeup20:25:570
1923199523,42cyclictest0-21swapper/021:16:310
19231995211,36cyclictest15-21rcuc/020:21:560
94072513,10sleep10-21swapper/120:08:101
94072513,10sleep10-21swapper/120:08:101
33742513,10sleep10-21swapper/118:47:081
1923799514,28cyclictest0-21swapper/219:15:542
19237995121,12cyclictest0-21swapper/219:35:492
1923599515,38cyclictest0-21swapper/123:20:421
1923599515,27cyclictest0-21swapper/122:08:221
1923599514,41cyclictest0-21swapper/120:46:211
19235995130,14cyclictest0-21swapper/122:23:181
1923599513,41cyclictest0-21swapper/119:55:471
19235995119,13cyclictest0-21swapper/123:00:421
19231995135,10cyclictest24751-21unixbench_singl19:31:000
1923199513,43cyclictest0-21swapper/022:05:380
208222503,10sleep10-21swapper/121:15:501
1923799507,22cyclictest0-21swapper/221:30:532
1923799507,22cyclictest0-21swapper/221:30:532
1923799504,29cyclictest0-21swapper/219:45:382
1923799504,28cyclictest0-21swapper/220:05:522
1923799504,28cyclictest0-21swapper/220:05:522
1923799504,28cyclictest0-21swapper/219:41:012
1923799504,28cyclictest0-21swapper/219:00:552
1923799504,28cyclictest0-21swapper/218:46:052
1923799504,27cyclictest0-21swapper/219:15:272
19237995019,13cyclictest0-21swapper/218:20:462
1923599509,33cyclictest0-21swapper/122:15:311
1923599508,35cyclictest201ktimersoftd/120:21:321
1923599505,27cyclictest0-21swapper/118:20:401
1923599505,26cyclictest0-21swapper/122:03:361
19235995033,11cyclictest0-21swapper/123:32:161
19231995032,12cyclictest0-21swapper/022:35:530
1923199503,42cyclictest0-21swapper/021:08:240
19231995021,8cyclictest3348-21latency_hist21:40:210
153532502,9sleep00-21swapper/019:12:270
35372492,41sleep00-21swapper/022:28:490
273372493,39sleep00-21swapper/019:37:580
1923799495,27cyclictest0-21swapper/219:30:412
1923799494,27cyclictest0-21swapper/218:35:542
1923599497,35cyclictest1122-21munin-run18:45:271
1923599497,35cyclictest1122-21munin-run18:45:271
1923599496,35cyclictest0-21swapper/120:17:521
1923599494,40cyclictest0-21swapper/120:50:511
1923599494,40cyclictest0-21swapper/120:50:511
1923599494,27cyclictest0-21swapper/119:45:561
1923599494,27cyclictest0-21swapper/118:35:511
19235994928,14cyclictest0-21swapper/122:25:311
19235994928,11cyclictest23020-21telnet19:30:371
19235994918,13cyclictest0-21swapper/119:00:271
19235994916,13cyclictest26859-21perl21:25:411
19235994915,14cyclictest24887-21switchtime22:10:521
19235994915,14cyclictest24887-21switchtime22:10:521
19235994913,30cyclictest0-21swapper/123:42:361
19235994911,32cyclictest16073-21runrttasks22:46:311
1923199494,39cyclictest0-21swapper/021:30:450
1923199494,39cyclictest0-21swapper/021:30:450
1923199494,39cyclictest0-21swapper/020:05:420
1923199494,39cyclictest0-21swapper/020:05:420
19231994933,11cyclictest6757-21unixbench_multi20:00:590
19231994931,13cyclictest0-21swapper/023:11:220
1923199493,13cyclictest0-21swapper/020:46:230
33732483,38sleep00-21swapper/018:47:070
324562483,11sleep10-21swapper/123:11:181
214992482,41sleep00-21swapper/018:19:100
1923599484,27cyclictest0-21swapper/123:15:451
1923599484,27cyclictest0-21swapper/120:56:341
19235994833,9cyclictest18213-21munin-node19:20:521
19235994833,9cyclictest18213-21munin-node19:20:521
19235994831,11cyclictest24041-21needreboot21:20:481
1923199484,39cyclictest0-21swapper/019:26:010
1923199483,39cyclictest0-21swapper/023:30:400
177122482,40sleep00-21swapper/019:17:020
143982482,10sleep00-21swapper/020:17:440
1923599477,34cyclictest1158-21kernelversion19:50:491
1923599473,27cyclictest0-21swapper/121:50:331
19235994729,12cyclictest28535-21fschecks_time19:40:451
1923199475,37cyclictest0-21swapper/018:30:580
1923199473,38cyclictest15-21rcuc/018:35:390
1923199473,38cyclictest0-21swapper/021:12:140
19231994729,12cyclictest8978-21cpuspeed_turbos19:00:430
189752474,6sleep00-21swapper/018:12:340
182062472,38sleep00-21swapper/019:20:330
182062472,38sleep00-21swapper/019:20:330
117222474,9sleep10-21swapper/120:12:171
97152463,37sleep10-21swapper/122:37:201
313752462,10sleep00-21swapper/018:40:340
313752462,10sleep00-21swapper/018:40:340
19235994627,13cyclictest0-21swapper/119:35:451
1923199464,38cyclictest0-21swapper/022:22:190
1923199464,36cyclictest0-21swapper/022:40:300
252482452,37sleep00-21swapper/018:25:510
1923599459,30cyclictest1227-21runrttasks18:34:501
19235994528,12cyclictest11794-21sort19:05:471
19235994528,11cyclictest16173-21cpuspeed_turbos19:15:421
19235994526,10cyclictest4218-21cpuspeed_turbos18:50:431
19231994531,9cyclictest28968-21needreboot19:40:520
1923599444,34cyclictest0-21swapper/119:10:541
1923599443,34cyclictest0-21swapper/118:15:411
19235994423,15cyclictest0-21swapper/118:25:551
1923599442,36cyclictest10908-21latency_hist19:05:271
19235994411,13cyclictest0-21swapper/120:00:541
1923199443,35cyclictest0-21swapper/018:51:010
1923599435,16cyclictest0-21swapper/118:15:291
1923199423,33cyclictest0-21swapper/019:55:370
1923799413,32cyclictest0-21swapper/218:15:292
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional