You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-11 - 02:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jan 11, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991210,6rtkit-daemon2484-21rtkit-daemon23:05:280
6067999711,61cyclictest0-21swapper/122:50:371
606799944,25cyclictest0-21swapper/123:40:581
606799924,26cyclictest0-21swapper/121:19:301
6067999221,9cyclictest1419-21runrttasks21:01:131
606799904,28cyclictest0-21swapper/121:53:081
606799903,31cyclictest0-21swapper/119:29:091
606799897,21cyclictest0-21swapper/121:32:171
6067998930,51cyclictest20927-21fgrep21:13:191
606799893,78cyclictest12267-21strings18:53:181
606799885,65cyclictest0-21swapper/123:34:361
606799884,26cyclictest0-21swapper/121:10:531
606799884,11cyclictest0-21swapper/123:57:571
606799883,25cyclictest0-21swapper/121:03:101
6067998819,9cyclictest47852tail21:38:071
606799877,21cyclictest0-21swapper/122:25:191
606799874,24cyclictest0-21swapper/122:03:481
606799864,26cyclictest0-21swapper/120:46:261
606799864,25cyclictest0-21swapper/123:18:521
6067998625,55cyclictest10598-21gltestperf23:23:031
248599860,5rtkit-daemon2484-21rtkit-daemon21:51:230
606799854,27cyclictest0-21swapper/123:12:451
606799854,26cyclictest0-21swapper/121:33:041
606799854,25cyclictest0-21swapper/121:44:241
606799853,25cyclictest7205-21latency_hist19:52:541
606799844,25cyclictest0-21swapper/121:49:291
606799844,23cyclictest0-21swapper/122:32:571
606799844,23cyclictest0-21swapper/122:32:571
606799843,29cyclictest0-21swapper/122:38:071
606799843,27cyclictest0-21swapper/123:53:131
606799843,27cyclictest0-21swapper/123:53:131
298402840,5sleep041ktimersoftd/022:15:330
606799837,20cyclictest0-21swapper/123:31:291
606799834,71cyclictest0-21swapper/122:43:071
606799834,24cyclictest0-21swapper/120:33:041
606799834,21cyclictest0-21swapper/123:03:411
606799834,12cyclictest0-21swapper/120:14:191
606799833,26cyclictest0-21swapper/122:54:141
606799833,26cyclictest0-21swapper/122:17:241
606799825,21cyclictest0-21swapper/123:00:341
606799824,70cyclictest0-21swapper/120:08:221
6067998219,13cyclictest0-21swapper/121:57:581
6067998219,12cyclictest0-21swapper/122:31:011
6067998219,12cyclictest0-21swapper/122:31:011
606799814,25cyclictest0-21swapper/120:54:431
606799814,24cyclictest0-21swapper/120:50:131
606799814,12cyclictest0-21swapper/122:08:051
606799813,26cyclictest0-21swapper/100:12:431
606799813,13cyclictest7279-21crond00:07:421
6067998110,14cyclictest0-21swapper/122:18:121
606799809,24cyclictest22769-21awk19:17:541
606799803,20cyclictest0-21swapper/123:15:021
606799803,20cyclictest0-21swapper/123:15:021
6067998012,16cyclictest0-21swapper/118:58:271
606799794,29cyclictest0-21swapper/123:50:031
606799794,27cyclictest0-21swapper/119:23:261
606799793,8cyclictest26727-21ssh21:23:051
6067997926,46cyclictest23180-21fgrep20:23:201
6067997922,9cyclictest29996-21latency20:38:141
6067997921,8cyclictest1419-21runrttasks19:39:081
6067997920,9cyclictest4430-21unixbench_singl19:43:291
6067997920,9cyclictest4430-21unixbench_singl19:43:291
6067997917,10cyclictest7987-21unixbench_multi18:43:281
6067997912,12cyclictest0-21swapper/123:43:101
6067997823,9cyclictest12261-21aten_r1power_en20:03:031
6067997810,14cyclictest0-21swapper/119:53:121
606799774,12cyclictest0-21swapper/119:21:131
6067997721,9cyclictest18299-21aten_r1power_fr19:08:041
606799764,13cyclictest0-21swapper/119:58:041
6067997624,45cyclictest0-21swapper/120:28:221
6067997624,45cyclictest0-21swapper/120:28:221
6067997621,9cyclictest9402-21fschecks_time18:48:111
6067997619,9cyclictest31854-21unixbench_multi19:33:271
6067997522,7cyclictest19933-21df_abs20:18:071
606799743,24cyclictest0-21swapper/119:03:231
606799743,24cyclictest0-21swapper/119:03:231
6069997314,51cyclictest0-21swapper/222:32:562
6069997314,51cyclictest0-21swapper/222:32:562
248599710,5rtkit-daemon0-21swapper/300:03:410
6064996937,12cyclictest0-21swapper/022:03:190
6064996841,10cyclictest26495-21grep21:23:030
6064996837,13cyclictest0-21swapper/022:38:120
606999673,57cyclictest0-21swapper/200:08:052
6064996637,13cyclictest0-21swapper/023:14:510
6064996637,13cyclictest0-21swapper/023:14:510
606999655,52cyclictest0-21swapper/221:08:152
6064996519,15cyclictest0-21swapper/023:33:240
248599650,4rtkit-daemon2484-21rtkit-daemon23:12:050
606999644,52cyclictest0-21swapper/223:33:062
606999643,12cyclictest0-21swapper/222:13:082
606999643,12cyclictest0-21swapper/220:58:142
6064996437,12cyclictest0-21swapper/022:28:160
6064996437,12cyclictest0-21swapper/022:28:160
6064996435,13cyclictest0-21swapper/020:58:080
6064996433,11cyclictest0-21swapper/023:42:550
6064996432,9cyclictest3723-21yum-updatesd-he22:23:340
6064996344,12cyclictest11624-21yum-updatesd-he23:23:430
6064996322,21cyclictest2379-21sort23:58:150
607099624,51cyclictest0-21swapper/319:23:223
607099624,51cyclictest0-21swapper/319:02:543
607099623,12cyclictest29817-21gltestperf20:38:103
606999624,50cyclictest0-21swapper/223:03:042
6064996230,10cyclictest0-21swapper/020:53:400
607099615,49cyclictest0-21swapper/323:07:443
607099614,50cyclictest0-21swapper/320:18:033
6069996139,8cyclictest26204-21kworker/2:022:18:122
6064996145,11cyclictest0-21swapper/023:29:590
6064996136,8cyclictest32572-21munin-run21:32:480
6064996130,10cyclictest0-21swapper/021:53:440
41372615,13sleep34311-21df18:38:093
301982613,50sleep20-21swapper/223:52:582
301982613,50sleep20-21swapper/223:52:582
286412614,11sleep00-21swapper/023:49:290
248599610,5rtkit-daemon2484-21rtkit-daemon19:01:370
248599610,19rtkit-daemon2484-21rtkit-daemon19:30:510
227462613,8sleep220369-21crond19:17:492
607099605,48cyclictest0-21swapper/322:43:423
607099605,47cyclictest0-21swapper/322:32:593
607099605,47cyclictest0-21swapper/322:32:593
607099605,47cyclictest0-21swapper/322:23:083
607099604,49cyclictest0-21swapper/323:43:133
607099604,49cyclictest0-21swapper/322:03:183
607099604,49cyclictest0-21swapper/321:48:093
607099604,49cyclictest0-21swapper/321:22:443
607099604,49cyclictest0-21swapper/319:57:533
607099604,49cyclictest0-21swapper/319:08:093
606999606,47cyclictest13318-21sh22:38:172
606999606,46cyclictest0-21swapper/222:48:202
6069996030,13cyclictest0-21swapper/221:03:062
606999603,11cyclictest0-21swapper/222:23:452
6064996042,13cyclictest0-21swapper/022:47:460
6064996039,15cyclictest0-21swapper/023:39:380
6064996027,9cyclictest0-21swapper/022:53:530
6064996027,10cyclictest0-21swapper/022:10:590
6064996018,24cyclictest8340-21http_loadtime19:53:130
248599600,20rtkit-daemon2484-21rtkit-daemon19:05:520
248599600,20rtkit-daemon2484-21rtkit-daemon19:05:520
607099595,47cyclictest0-21swapper/323:58:023
607099595,47cyclictest0-21swapper/320:14:203
607099594,48cyclictest23260-21chrt20:23:223
607099594,48cyclictest0-21swapper/323:38:013
607099594,48cyclictest0-21swapper/323:02:343
607099594,48cyclictest0-21swapper/321:43:083
607099594,48cyclictest0-21swapper/321:25:483
607099594,48cyclictest0-21swapper/320:48:213
607099594,48cyclictest0-21swapper/320:37:523
607099594,48cyclictest0-21swapper/300:03:103
607099594,47cyclictest0-21swapper/323:17:563
607099594,47cyclictest0-21swapper/321:03:043
607099594,13cyclictest0-21swapper/323:37:433
6070995920,32cyclictest29495-21cut21:27:593
606999594,10cyclictest0-21swapper/221:27:412
6069995930,13cyclictest0-21swapper/223:12:582
6069995930,13cyclictest0-21swapper/223:12:582
606999593,50cyclictest0-21swapper/223:39:332
606999593,49cyclictest0-21swapper/221:52:592
606999593,49cyclictest0-21swapper/219:18:042
606999593,49cyclictest0-21swapper/200:02:562
606999593,48cyclictest0-21swapper/221:48:112
606999593,48cyclictest0-21swapper/219:56:022
6069995925,12cyclictest0-21swapper/221:35:092
6064995942,12cyclictest0-21swapper/021:04:270
6064995941,13cyclictest0-21swapper/023:55:530
6064995941,13cyclictest0-21swapper/023:55:530
6064995940,14cyclictest0-21swapper/023:19:440
6064995940,14cyclictest0-21swapper/020:08:150
606499594,38cyclictest0-21swapper/018:48:210
6064995928,10cyclictest0-21swapper/000:08:580
256792590,4chrt29-21ksoftirqd/222:57:592
212532593,12sleep00-21swapper/020:19:250
607099585,47cyclictest0-21swapper/323:28:203
607099585,46cyclictest0-21swapper/323:49:393
607099585,46cyclictest0-21swapper/321:11:293
607099585,45cyclictest8718-21memory00:08:083
607099585,45cyclictest24645-21diskstats22:08:103
607099584,47cyclictest0-21swapper/323:52:543
607099584,47cyclictest0-21swapper/323:52:543
607099584,47cyclictest0-21swapper/323:24:133
607099584,47cyclictest0-21swapper/322:53:293
607099584,47cyclictest0-21swapper/319:18:213
607099584,47cyclictest0-21swapper/319:03:213
607099584,47cyclictest0-21swapper/319:03:213
607099584,10cyclictest5216-21aten_r1power_fr22:27:573
607099584,10cyclictest5216-21aten_r1power_fr22:27:573
606999584,47cyclictest0-21swapper/220:43:242
6069995834,8cyclictest26204-21kworker/2:022:53:292
6069995830,12cyclictest0-21swapper/221:58:192
6064995840,10cyclictest8964-21grep21:43:210
6064995831,11cyclictest0-21swapper/022:18:420
6064995826,13cyclictest0-21swapper/022:49:460
6064995821,13cyclictest0-21swapper/022:33:180
6064995821,13cyclictest0-21swapper/022:33:180
248599580,4rtkit-daemon2484-21rtkit-daemon19:34:140
607099576,43cyclictest19885-21df21:13:033
607099575,46cyclictest0-21swapper/321:56:203
607099575,45cyclictest0-21swapper/322:18:053
607099575,44cyclictest937-21seq20:44:233
607099574,47cyclictest0-21swapper/322:13:033
607099574,47cyclictest0-21swapper/321:37:103
607099574,46cyclictest0-21swapper/320:59:313
606999577,44cyclictest6057-21cyclictest20:48:202
6069995731,12cyclictest0-21swapper/221:38:502
6069995729,13cyclictest0-21swapper/222:42:592
6069995726,13cyclictest0-21swapper/223:48:092
6064995735,8cyclictest19197-21awk21:12:490
6064995720,13cyclictest0-21swapper/021:19:570
33082573,47sleep00-21swapper/020:48:110
8452563,10sleep2934-21grep19:38:122
607099565,43cyclictest7214-21munin-run19:52:533
607099564,45cyclictest0-21swapper/320:53:193
606999563,46cyclictest6659-21grep23:17:582
606999563,46cyclictest0-21swapper/223:07:592
606999562,48cyclictest0-21swapper/221:18:222
606999562,11cyclictest0-21swapper/221:15:292
606499566,26cyclictest0-21swapper/021:58:040
606499565,28cyclictest0-21swapper/023:01:530
606499565,28cyclictest0-21swapper/020:07:520
606499564,32cyclictest0-21swapper/020:32:520
606499564,32cyclictest0-21swapper/020:32:520
606499564,28cyclictest0-21swapper/021:41:350
606499564,27cyclictest0-21swapper/021:15:270
606499563,35cyclictest0-21swapper/018:43:150
6064995621,11cyclictest2958-21ssh21:35:150
6064995619,15cyclictest0-21swapper/020:43:240
607099555,45cyclictest0-21swapper/323:15:363
607099555,45cyclictest0-21swapper/323:15:363
607099554,44cyclictest0-21swapper/322:51:403
606999554,44cyclictest0-21swapper/221:28:192
606999554,11cyclictest0-21swapper/223:25:552
606999553,8cyclictest13756-21fschecks_time23:28:012
606999553,6cyclictest22492-21unixbench_singl22:03:202
606999553,46cyclictest0-21swapper/222:07:572
6069995528,12cyclictest0-21swapper/218:53:162
606499554,29cyclictest0-21swapper/019:23:210
606499554,29cyclictest0-21swapper/019:08:220
6064995527,12cyclictest0-21swapper/018:53:210
6064995522,12cyclictest0-21swapper/019:38:120
607099545,44cyclictest0-21swapper/322:41:423
607099544,44cyclictest0-21swapper/321:40:563
607099544,43cyclictest2686-21aten2.4-expect19:43:063
607099544,43cyclictest2686-21aten2.4-expect19:43:063
606999544,11cyclictest0-21swapper/223:58:182
606499545,28cyclictest0-21swapper/020:24:210
606499545,27cyclictest0-21swapper/020:38:100
606499545,27cyclictest0-21swapper/019:18:230
606499544,29cyclictest0-21swapper/019:58:160
6064995424,13cyclictest0-21swapper/020:13:080
607099533,43cyclictest0-21swapper/320:03:033
6070995322,12cyclictest0-21swapper/319:28:063
606999533,46cyclictest0-21swapper/223:45:522
606999533,14cyclictest0-21swapper/220:04:182
606499534,28cyclictest0-21swapper/019:43:110
606499534,28cyclictest0-21swapper/019:43:110
248599530,5rtkit-daemon2484-21rtkit-daemon19:50:200
248599530,5rtkit-daemon2484-21rtkit-daemon18:38:162
607099524,32cyclictest0-21swapper/319:37:533
6070995237,9cyclictest11393-21cpuspeed_turbos18:53:073
6070995221,12cyclictest0-21swapper/320:28:243
6070995221,12cyclictest0-21swapper/320:28:243
6070995218,28cyclictest15183-21forks20:08:083
6070995218,15cyclictest0-21swapper/323:10:353
6064995225,10cyclictest0-21swapper/020:33:080
606999514,15cyclictest0-21swapper/220:53:012
6069995136,9cyclictest19925-21unixbench_multi19:08:262
606999513,43cyclictest0-21swapper/220:31:012
606999513,43cyclictest0-21swapper/220:31:012
6069995129,8cyclictest28976-21strings19:28:192
606999512,44cyclictest0-21swapper/222:31:232
606999512,44cyclictest0-21swapper/222:31:232
606999512,43cyclictest0-21swapper/218:48:532
6064995128,10cyclictest0-21swapper/019:14:100
226652512,9sleep30-21swapper/319:16:453
607099505,27cyclictest0-21swapper/318:44:053
607099504,31cyclictest0-21swapper/322:00:573
606999503,10cyclictest0-21swapper/221:43:102
272112504,39sleep20-21swapper/219:23:452
6069994924,10cyclictest0-21swapper/220:39:232
6069994924,10cyclictest0-21swapper/219:33:392
606499495,36cyclictest0-21swapper/018:42:560
607099487,27cyclictest0-21swapper/319:57:583
607099485,28cyclictest0-21swapper/319:39:143
606999482,12cyclictest0-21swapper/220:23:222
607099478,12cyclictest0-21swapper/318:49:313
606999473,38cyclictest0-21swapper/220:22:522
606999473,36cyclictest0-21swapper/219:43:052
606999473,36cyclictest0-21swapper/219:43:052
6069994630,9cyclictest11587-21grep19:58:262
606999463,36cyclictest0-21swapper/218:43:072
69912452,9sleep20-21swapper/219:50:132
606999452,10cyclictest0-21swapper/220:08:032
6069994517,12cyclictest0-21swapper/219:03:072
6069994517,12cyclictest0-21swapper/219:03:072
606999443,12cyclictest0-21swapper/220:17:382
6069994429,10cyclictest0-21swapper/218:58:062
606999423,34cyclictest0-21swapper/220:33:292
606799353,27cyclictest6215-21cut18:42:561
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional