You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-12 - 11:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sat Jul 12, 2025 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
223099970,5rtkit-daemon2229-21rtkit-daemon21:22:353
2801799964,84cyclictest0-21swapper/022:17:590
2801799944,54cyclictest0-21swapper/021:32:310
2801799934,81cyclictest0-21swapper/022:43:580
2802199924,81cyclictest0-21swapper/223:37:132
2801799923,9cyclictest0-21swapper/018:46:020
2801799914,80cyclictest0-21swapper/020:57:200
2801799905,75cyclictest0-21swapper/018:27:080
2801799904,78cyclictest0-21swapper/022:02:160
2802199894,78cyclictest0-21swapper/221:57:012
2801799894,77cyclictest0-21swapper/019:37:350
223099890,4rtkit-daemon2229-21rtkit-daemon23:27:232
2802199884,76cyclictest0-21swapper/219:27:282
2802199884,60cyclictest0-21swapper/218:47:192
2801799884,66cyclictest0-21swapper/019:52:280
2801799884,55cyclictest0-21swapper/020:22:360
223099880,6rtkit-daemon0-21swapper/021:28:200
2802199874,76cyclictest0-21swapper/220:27:032
2802199874,74cyclictest0-21swapper/219:02:072
2802199874,74cyclictest0-21swapper/219:02:072
2801799873,9cyclictest0-21swapper/023:46:560
2801799873,77cyclictest0-21swapper/023:47:110
2801799873,60cyclictest28237-21munin-node18:27:330
2801799873,10cyclictest0-21swapper/020:27:310
2801799864,75cyclictest0-21swapper/023:32:240
2801799864,75cyclictest0-21swapper/021:37:180
2801799864,75cyclictest0-21swapper/019:47:220
2801799864,75cyclictest0-21swapper/019:37:060
2801799864,74cyclictest0-21swapper/020:12:040
2801799863,76cyclictest0-21swapper/021:02:260
2801799863,76cyclictest0-21swapper/021:02:260
223099860,4rtkit-daemon2229-21rtkit-daemon23:47:303
2802199853,66cyclictest0-21swapper/218:37:252
2802199853,63cyclictest31248-21fschecks_time23:02:152
2801799854,74cyclictest0-21swapper/021:47:000
2801799854,74cyclictest0-21swapper/021:47:000
2801799853,75cyclictest0-21swapper/018:47:350
2802199844,72cyclictest7531-21latency_hist23:21:572
2801799844,73cyclictest0-21swapper/021:52:010
2801799844,72cyclictest0-21swapper/019:27:270
2801799844,72cyclictest0-21swapper/019:17:230
2801799844,65cyclictest0-21swapper/020:32:320
2801799843,75cyclictest0-21swapper/021:52:170
2802199834,71cyclictest1584-21nscd22:31:582
2802199834,71cyclictest1584-21nscd22:31:582
2802199834,65cyclictest0-21swapper/221:22:282
2802199834,64cyclictest0-21swapper/223:50:032
2802199833,73cyclictest0-21swapper/218:32:252
2801799837,54cyclictest0-21swapper/022:27:250
2801799837,54cyclictest0-21swapper/022:27:250
2801799834,58cyclictest0-21swapper/018:52:350
2801799832,10cyclictest0-21swapper/019:57:300
223099830,5rtkit-daemon2229-21rtkit-daemon19:01:113
223099830,5rtkit-daemon2229-21rtkit-daemon19:01:113
2802199824,71cyclictest0-21swapper/221:27:252
2802199824,70cyclictest0-21swapper/223:07:252
2802199824,70cyclictest0-21swapper/223:07:252
2802199824,63cyclictest0-21swapper/218:43:372
2802199823,72cyclictest0-21swapper/222:43:282
2801799824,71cyclictest0-21swapper/020:42:030
2801799824,69cyclictest0-21swapper/019:02:310
2801799824,57cyclictest0-21swapper/021:12:230
28017998225,50cyclictest0-21swapper/020:22:000
28017998225,50cyclictest0-21swapper/020:22:000
223099820,4rtkit-daemon2229-21rtkit-daemon22:36:330
223099820,4rtkit-daemon2229-21rtkit-daemon20:43:443
2802199814,70cyclictest0-21swapper/222:16:592
2802199814,70cyclictest0-21swapper/220:58:272
2802199814,62cyclictest0-21swapper/223:12:262
2802199814,62cyclictest0-21swapper/222:39:172
2802199814,48cyclictest0-21swapper/219:22:062
2801799813,71cyclictest0-21swapper/019:42:220
2801799813,71cyclictest0-21swapper/019:42:220
2801799813,7cyclictest15978-21awk20:17:030
2801799813,58cyclictest0-21swapper/022:54:210
2801799813,10cyclictest6544-21cat23:17:230
223099810,5rtkit-daemon2229-21rtkit-daemon23:27:163
223099810,4rtkit-daemon2229-21rtkit-daemon22:53:323
2802199804,69cyclictest0-21swapper/223:32:282
2802199804,68cyclictest0-21swapper/221:02:282
2802199804,68cyclictest0-21swapper/221:02:282
2802199804,65cyclictest0-21swapper/221:37:172
2802199804,61cyclictest0-21swapper/221:07:242
2802199803,69cyclictest0-21swapper/219:47:252
2802199803,55cyclictest0-21swapper/223:42:112
2801799804,69cyclictest0-21swapper/018:57:370
2801799804,69cyclictest0-21swapper/018:57:370
2801799804,61cyclictest0-21swapper/023:02:210
2801799803,9cyclictest0-21swapper/021:17:160
2801799803,70cyclictest0-21swapper/023:37:270
223099800,6rtkit-daemon2229-21rtkit-daemon18:39:493
223099800,5rtkit-daemon2229-21rtkit-daemon23:07:393
223099800,5rtkit-daemon2229-21rtkit-daemon23:07:393
223099800,5rtkit-daemon2229-21rtkit-daemon22:39:103
223099800,5rtkit-daemon2229-21rtkit-daemon21:44:573
223099800,5rtkit-daemon2229-21rtkit-daemon21:44:573
223099800,4rtkit-daemon2229-21rtkit-daemon21:12:133
223099800,4rtkit-daemon2229-21rtkit-daemon19:52:313
2802199794,57cyclictest0-21swapper/219:07:232
2802199793,52cyclictest6654-21munin-node19:57:182
2801799799,63cyclictest0-21swapper/023:12:130
2801799799,49cyclictest106250irq/46-eth022:22:100
2801799794,68cyclictest0-21swapper/019:12:230
2801799794,67cyclictest0-21swapper/022:57:170
2801799794,62cyclictest0-21swapper/023:22:240
2801799794,61cyclictest0-21swapper/021:57:310
2801799794,48cyclictest0-21swapper/020:51:560
2801799793,8cyclictest23367-21tail22:47:090
2801799793,8cyclictest20221-21unixbench_multi22:37:310
2801799793,70cyclictest0-21swapper/023:30:370
223099790,6rtkit-daemon2229-21rtkit-daemon23:00:243
223099790,5rtkit-daemon2229-21rtkit-daemon21:52:193
223099790,5rtkit-daemon2229-21rtkit-daemon19:32:323
223099790,4rtkit-daemon2229-21rtkit-daemon23:23:313
223099790,4rtkit-daemon2229-21rtkit-daemon21:47:492
223099790,4rtkit-daemon2229-21rtkit-daemon21:39:123
223099790,4rtkit-daemon2229-21rtkit-daemon21:02:213
223099790,4rtkit-daemon2229-21rtkit-daemon21:02:213
2802199784,67cyclictest0-21swapper/221:12:192
2802199784,49cyclictest0-21swapper/220:37:242
2802199783,69cyclictest0-21swapper/221:57:362
2802199783,68cyclictest0-21swapper/220:32:222
2802199783,66cyclictest0-21swapper/223:52:142
2802199783,66cyclictest0-21swapper/223:52:142
2801799784,66cyclictest0-21swapper/020:07:030
2801799783,69cyclictest0-21swapper/019:22:220
2801799783,13cyclictest0-21swapper/020:42:250
2801799783,10cyclictest0-21swapper/018:32:290
28017997818,43cyclictest2741-21awk23:11:570
28017997818,43cyclictest2741-21awk23:11:570
223099780,5rtkit-daemon2229-21rtkit-daemon22:18:113
223099780,4rtkit-daemon2229-21rtkit-daemon22:03:043
2802199774,60cyclictest0-21swapper/220:12:042
2802199773,66cyclictest0-21swapper/220:32:032
28021997712,49cyclictest0-21swapper/220:47:142
2801799773,9cyclictest8571-21tune2fs21:07:230
2801799773,68cyclictest0-21swapper/021:25:290
2801799773,10cyclictest0-21swapper/019:08:410
223099770,5rtkit-daemon2229-21rtkit-daemon22:44:103
223099770,4rtkit-daemon2229-21rtkit-daemon20:12:313
223099770,4rtkit-daemon2229-21rtkit-daemon19:16:333
223099770,4rtkit-daemon2229-21rtkit-daemon19:06:563
2802199764,59cyclictest0-21swapper/222:47:192
2802199763,67cyclictest0-21swapper/218:52:252
28021997616,37cyclictest0-21swapper/221:21:462
2801799763,7cyclictest4197-21munin-node22:07:330
2801799763,66cyclictest0-21swapper/022:12:120
223099760,7rtkit-daemon0-21swapper/218:31:422
223099760,4rtkit-daemon2229-21rtkit-daemon23:17:533
223099760,4rtkit-daemon2229-21rtkit-daemon23:15:463
223099760,4rtkit-daemon2229-21rtkit-daemon22:35:253
2802199754,63cyclictest0-21swapper/221:32:222
2802199754,49cyclictest0-21swapper/219:52:322
2802199754,44cyclictest0-21swapper/220:42:372
2802199753,64cyclictest0-21swapper/220:02:162
223099750,4rtkit-daemon2229-21rtkit-daemon23:32:233
2802199749,47cyclictest0-21swapper/222:22:162
2802199745,62cyclictest10442-21cat22:17:302
2802199744,63cyclictest0-21swapper/219:37:002
2802199744,63cyclictest0-21swapper/219:12:232
2802199744,58cyclictest0-21swapper/220:52:362
2802199744,56cyclictest0-21swapper/219:37:202
2802199744,50cyclictest0-21swapper/219:42:172
2802199744,50cyclictest0-21swapper/219:42:172
2802199743,64cyclictest0-21swapper/223:23:182
2802199734,62cyclictest0-21swapper/220:20:352
2802199734,62cyclictest0-21swapper/220:20:352
2802199734,49cyclictest0-21swapper/222:56:292
2802199734,47cyclictest0-21swapper/221:42:102
2802199734,47cyclictest0-21swapper/221:42:102
2802199733,8cyclictest5612-21rt-features22:07:312
28021997311,43cyclictest106250irq/46-eth022:32:262
2801799733,50cyclictest0-21swapper/023:52:260
2801799733,50cyclictest0-21swapper/023:52:260
2802199724,60cyclictest0-21swapper/222:57:132
2802199714,59cyclictest0-21swapper/222:02:142
2802199713,60cyclictest12691-21head19:02:212
28017997112,42cyclictest0-21swapper/020:52:170
2801799704,58cyclictest0-21swapper/018:37:250
2802199698,44cyclictest106250irq/46-eth019:22:292
2802199684,57cyclictest0-21swapper/218:27:082
28021996825,36cyclictest14664-21gltestperf20:12:232
223099650,8rtkit-daemon0-21swapper/219:07:333
28022995939,12cyclictest14321-21grep21:17:383
272952594,12sleep327482-21timerwakeupswit18:22:353
28022995841,10cyclictest7789-21tail22:12:253
2802299584,12cyclictest0-21swapper/323:51:573
2802299584,12cyclictest0-21swapper/323:51:573
2802099587,39cyclictest0-21swapper/123:31:571
28020995732,16cyclictest0-21swapper/122:21:451
28020995535,12cyclictest15959-21crond20:17:031
223099550,4rtkit-daemon31832-21strings18:32:353
46092543,44sleep34731-21timerwakeupswit18:42:413
28022995421,14cyclictest0-21swapper/320:22:193
28020995435,12cyclictest1113-21unixbench_singl19:42:391
28020995435,12cyclictest1113-21unixbench_singl19:42:391
28020995434,11cyclictest4288-21aten2.4-expect22:07:141
311652533,41sleep10-21swapper/121:53:071
2802299535,29cyclictest0-21swapper/322:07:183
2802299534,30cyclictest0-21swapper/321:57:213
2802299534,30cyclictest0-21swapper/320:57:133
224542532,10sleep122472-21munin-node20:27:341
38572522,43sleep30-21swapper/319:49:563
28022995233,11cyclictest25456-21crond22:51:573
2802299523,29cyclictest0-21swapper/323:46:563
28022995220,13cyclictest0-21swapper/320:52:373
2802099524,40cyclictest0-21swapper/121:27:271
2802099524,30cyclictest0-21swapper/119:22:051
2802099524,29cyclictest0-21swapper/121:32:341
28020995230,15cyclictest0-21swapper/118:42:341
28020995226,7cyclictest17071-21latency_hist23:41:561
28020995222,13cyclictest0-21swapper/118:52:371
28020995220,13cyclictest0-21swapper/119:22:321
276262522,10sleep30-21swapper/320:38:133
26972522,13sleep10-21swapper/120:55:401
223099520,4rtkit-daemon2229-21rtkit-daemon22:29:483
223099520,4rtkit-daemon2229-21rtkit-daemon22:29:483
325642514,40sleep30-21swapper/320:50:143
2802299514,29cyclictest0-21swapper/319:37:433
2802299513,29cyclictest0-21swapper/319:27:353
28022995122,12cyclictest0-21swapper/321:32:223
28022995120,13cyclictest0-21swapper/319:22:413
2802099515,29cyclictest0-21swapper/118:57:371
2802099515,29cyclictest0-21swapper/118:57:371
2802099515,28cyclictest0-21swapper/119:57:291
2802099514,29cyclictest0-21swapper/122:27:371
2802099514,29cyclictest0-21swapper/122:27:371
2802099514,23cyclictest25632-21iostat19:27:281
28020995131,13cyclictest0-21swapper/122:41:591
28020995122,10cyclictest0-21swapper/122:52:271
28020995118,27cyclictest4259-21open_files23:12:251
174202513,40sleep10-21swapper/119:12:091
171282512,11sleep10-21swapper/121:26:511
2802099504,28cyclictest0-21swapper/123:42:171
2802099504,28cyclictest0-21swapper/119:12:071
2802099504,27cyclictest0-21swapper/121:02:201
2802099504,27cyclictest0-21swapper/121:02:201
2802099504,27cyclictest0-21swapper/119:42:051
28020995020,12cyclictest0-21swapper/118:38:501
254192502,11sleep30-21swapper/320:35:313
239432502,41sleep10-21swapper/121:37:361
96562493,40sleep10-21swapper/123:23:361
8522492,11sleep30-21swapper/319:42:383
8522492,11sleep30-21swapper/319:42:383
74442493,41sleep10-21swapper/118:49:281
2802299494,27cyclictest0-21swapper/323:37:193
2802299493,23cyclictest0-21swapper/320:07:163
28022994918,12cyclictest0-21swapper/322:25:263
28020994932,10cyclictest23484-21aten_r1power_fr20:32:161
28020994932,10cyclictest17403-21tail20:17:301
28020994932,10cyclictest17403-21tail20:17:301
28020994931,11cyclictest7794-21needreboot22:12:251
28020994931,11cyclictest28885-21cut20:42:231
28020994931,11cyclictest27362-21tr19:32:191
115592492,41sleep10-21swapper/123:27:271
98462482,13sleep10-21swapper/121:10:271
306102483,39sleep10-21swapper/118:32:111
2802299484,27cyclictest0-21swapper/320:02:363
2802299484,12cyclictest0-21swapper/320:18:523
2802299484,12cyclictest0-21swapper/320:18:523
2802099488,20cyclictest0-21swapper/123:11:571
2802099488,20cyclictest0-21swapper/123:11:571
2802099485,23cyclictest24564-21aten2.4-expect21:42:111
2802099485,23cyclictest24564-21aten2.4-expect21:42:111
2802099484,27cyclictest0-21swapper/122:32:261
28020994832,11cyclictest0-21swapper/122:23:161
209182482,12sleep10-21swapper/122:42:091
138792484,37sleep10-21swapper/121:17:321
135722482,10sleep10-21swapper/120:12:031
123112482,11sleep10-21swapper/121:16:321
2802299474,35cyclictest0-21swapper/318:47:363
2802299474,26cyclictest0-21swapper/321:09:013
28022994727,13cyclictest0-21swapper/319:17:263
28022994714,13cyclictest0-21swapper/321:52:003
2802099477,29cyclictest0-21swapper/120:52:031
2802099474,26cyclictest0-21swapper/123:03:191
2802099474,26cyclictest0-21swapper/120:22:151
28020994730,10cyclictest23002-21sed23:52:161
28020994730,10cyclictest23002-21sed23:52:161
28020994729,11cyclictest27799-21cut21:47:201
28020994727,13cyclictest0-21swapper/122:47:311
28020994726,14cyclictest0-21swapper/118:27:091
28020994726,13cyclictest0-21swapper/122:02:121
144732473,36sleep10-21swapper/119:02:461
109342473,38sleep10-21swapper/120:03:481
37462462,39sleep10-21swapper/119:48:291
2802299464,34cyclictest0-21swapper/318:32:093
28022994616,12cyclictest0-21swapper/321:27:253
2802099464,35cyclictest0-21swapper/119:52:181
2802099464,26cyclictest0-21swapper/121:57:251
2802099463,27cyclictest0-21swapper/123:01:131
2802099463,26cyclictest0-21swapper/120:57:261
72512453,36sleep10-21swapper/123:18:281
2802299454,33cyclictest0-21swapper/320:27:243
2802299454,14cyclictest0-21swapper/323:02:133
28022994527,11cyclictest7086-21df_abs19:57:213
28022994515,12cyclictest7895-21aten_r1power_cu18:52:183
279042454,35sleep10-21swapper/120:41:491
28020994429,10cyclictest0-21swapper/123:47:071
28020994427,13cyclictest0-21swapper/118:27:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional