You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-02 - 05:06

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Wed Sep 02, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991360,5rtkit-daemon12-21rcu_preempt21:33:101
1497421140,7sleep114975-21grep21:14:531
2194991130,5rtkit-daemon12-21rcu_preempt22:05:021
2194991120,6rtkit-daemon0-21swapper/022:04:171
2194991000,6rtkit-daemon0-21swapper/019:14:080
219499990,9rtkit-daemon0-21swapper/022:08:460
25350999818,58cyclictest10824-21ssh21:56:210
2535099974,73cyclictest0-21swapper/019:41:280
219499970,8rtkit-daemon28517-21aten_r1power_po22:24:460
219499970,8rtkit-daemon28517-21aten_r1power_po22:24:460
2535099954,12cyclictest0-21swapper/020:43:450
2535099954,12cyclictest0-21swapper/020:15:010
2535099944,12cyclictest0-21swapper/020:35:100
2535399934,70cyclictest0-21swapper/221:19:502
2535399933,83cyclictest0-21swapper/222:54:482
2535099934,13cyclictest0-21swapper/022:44:480
2535099934,12cyclictest0-21swapper/018:44:560
2535099934,10cyclictest1227-21runrttasks17:58:170
2535099933,66cyclictest23697-21ntpdc23:05:000
2535399924,81cyclictest0-21swapper/221:29:082
2535399923,81cyclictest4845-21telnet20:09:522
2535399923,81cyclictest31950-21cpuspeed22:29:482
2535099929,69cyclictest0-21swapper/019:55:110
25350999217,58cyclictest0-21swapper/020:29:520
219499920,8rtkit-daemon0-21swapper/020:12:580
2535399914,69cyclictest0-21swapper/220:49:512
25353999129,54cyclictest2225-21grep19:04:592
25353999129,54cyclictest2225-21grep19:04:592
2535099914,9cyclictest1227-21runrttasks21:52:280
2535099914,65cyclictest0-21swapper/019:46:130
2535099914,13cyclictest0-21swapper/022:22:010
2535099914,13cyclictest0-21swapper/021:40:030
2535099914,13cyclictest0-21swapper/021:09:540
2535099913,67cyclictest0-21swapper/021:34:570
25350999117,53cyclictest107550irq/46-eth022:09:550
2535399907,75cyclictest0-21swapper/220:59:532
2535099906,66cyclictest17578-21diskmemload20:25:050
2535099906,66cyclictest17578-21diskmemload20:25:050
2535099904,9cyclictest1227-21runrttasks18:36:540
2535099904,66cyclictest5362-21diskstats20:59:550
2535099904,13cyclictest0-21swapper/022:00:200
2535099904,12cyclictest0-21swapper/020:07:060
2535099904,11cyclictest0-21swapper/023:03:170
2535099904,11cyclictest0-21swapper/022:31:000
2535099903,64cyclictest0-21swapper/018:29:560
2535099903,12cyclictest0-21swapper/021:05:340
2535099903,12cyclictest0-21swapper/021:05:340
2535399894,65cyclictest0-21swapper/223:05:102
2535099894,64cyclictest0-21swapper/020:24:140
2535099894,14cyclictest0-21swapper/020:54:540
2535099894,13cyclictest0-21swapper/021:30:080
2535099894,12cyclictest0-21swapper/019:35:000
2535099893,12cyclictest0-21swapper/022:35:040
2535399884,78cyclictest0-21swapper/222:39:532
2535399883,50cyclictest0-21swapper/222:28:022
2535399883,50cyclictest0-21swapper/222:28:022
2535099884,65cyclictest0-21swapper/018:19:570
2535099884,65cyclictest0-21swapper/018:19:570
2535099884,64cyclictest0-21swapper/021:26:590
2535099884,14cyclictest0-21swapper/022:18:540
2535099884,12cyclictest0-21swapper/021:20:000
2535099884,12cyclictest0-21swapper/020:52:270
2535099884,11cyclictest1227-21runrttasks19:52:450
2535099883,12cyclictest31876-21df_abs19:59:560
25350998816,56cyclictest0-21swapper/022:55:020
219499880,8rtkit-daemon0-21swapper/122:33:533
219499880,7rtkit-daemon15-21rcuc/018:25:180
219499880,7rtkit-daemon14303-21grep22:50:070
219499880,5rtkit-daemon2193-21rtkit-daemon22:22:532
2535399874,77cyclictest0-21swapper/220:15:252
2535399874,75cyclictest0-21swapper/223:00:102
2535399874,75cyclictest0-21swapper/221:50:002
2535399874,75cyclictest0-21swapper/221:43:052
2535399874,75cyclictest0-21swapper/221:15:012
2535399874,67cyclictest0-21swapper/217:50:192
2535099874,13cyclictest0-21swapper/021:15:070
2535099874,12cyclictest0-21swapper/021:44:520
2535099874,12cyclictest0-21swapper/021:44:520
2535099874,12cyclictest0-21swapper/019:06:100
2535099874,12cyclictest0-21swapper/019:06:100
2535099874,12cyclictest0-21swapper/018:59:570
2535099874,12cyclictest0-21swapper/017:50:120
2535099873,13cyclictest0-21swapper/017:39:580
2535099873,13cyclictest0-21swapper/017:39:580
219499870,8rtkit-daemon0-21swapper/018:44:020
2535399865,73cyclictest0-21swapper/221:54:522
2535399864,75cyclictest0-21swapper/222:54:132
2535399864,75cyclictest0-21swapper/222:04:552
2535399864,75cyclictest0-21swapper/222:00:082
2535399863,76cyclictest0-21swapper/220:19:462
2535099864,9cyclictest6322-21grep22:39:490
2535099864,13cyclictest0-21swapper/020:45:040
2535099864,12cyclictest0-21swapper/018:15:150
2535099864,12cyclictest0-21swapper/018:00:030
219499860,6rtkit-daemon0-21swapper/018:09:560
2535399854,74cyclictest0-21swapper/218:09:562
2535399853,65cyclictest10183-21ssh21:06:122
2535399853,65cyclictest10183-21ssh21:06:122
2535099854,70cyclictest0-21swapper/017:39:450
2535099854,13cyclictest0-21swapper/018:49:560
2535099853,13cyclictest0-21swapper/019:25:120
2535399844,72cyclictest0-21swapper/221:44:522
2535399844,72cyclictest0-21swapper/221:44:522
2535399844,65cyclictest0-21swapper/220:33:142
2535399844,64cyclictest0-21swapper/221:34:492
2535399844,59cyclictest0-21swapper/218:00:082
2535399844,53cyclictest0-21swapper/222:10:042
2535399843,62cyclictest23451-21chrt20:39:022
2535099843,65cyclictest0-21swapper/019:30:090
2535399834,72cyclictest0-21swapper/220:40:132
2535399834,72cyclictest0-21swapper/220:25:112
2535399834,72cyclictest0-21swapper/220:25:112
2535399834,71cyclictest0-21swapper/222:44:452
2535399834,55cyclictest0-21swapper/219:41:222
2535399833,72cyclictest0-21swapper/221:13:262
2535399833,71cyclictest7199-21runrttasks18:07:342
2535399833,64cyclictest25389-21kernelversion18:45:072
2535399833,43cyclictest0-21swapper/219:55:042
2535099834,12cyclictest0-21swapper/019:15:080
2535399825,47cyclictest0-21swapper/222:14:582
2535399824,71cyclictest0-21swapper/222:34:582
2535399824,71cyclictest0-21swapper/219:50:052
2535399824,71cyclictest0-21swapper/218:54:592
2535399824,64cyclictest0-21swapper/220:03:102
2535399823,72cyclictest0-21swapper/220:07:482
2535399823,62cyclictest13682-21open_files18:20:122
2535399823,62cyclictest13682-21open_files18:20:122
2535099824,12cyclictest0-21swapper/018:55:240
25353998143,31cyclictest27181-21munin-node20:44:522
2535399814,70cyclictest0-21swapper/220:54:522
2535399814,70cyclictest0-21swapper/219:45:152
2535399814,70cyclictest0-21swapper/218:59:582
2535399814,69cyclictest0-21swapper/218:25:082
2535399814,61cyclictest0-21swapper/219:19:572
2535099813,10cyclictest10698-21chrt19:21:550
2535399809,54cyclictest17930-21fschecks_time18:30:032
2535399803,49cyclictest14364-21kworker/2:021:29:592
2535399794,68cyclictest0-21swapper/219:14:572
2535399794,60cyclictest0-21swapper/217:44:582
2535399784,67cyclictest0-21swapper/218:35:132
2535399783,67cyclictest13314-21basename19:29:412
2535399775,65cyclictest0-21swapper/219:09:542
2535399773,67cyclictest15704-21latency_hist19:34:422
2535099764,13cyclictest0-21swapper/018:05:070
2535099763,58cyclictest0-21swapper/017:45:140
2535399754,55cyclictest0-21swapper/218:49:592
2535399753,65cyclictest0-21swapper/217:40:192
2535399753,65cyclictest0-21swapper/217:40:192
219499750,9rtkit-daemon0-21swapper/019:10:161
2535499744,60cyclictest0-21swapper/321:35:103
2535399734,63cyclictest0-21swapper/219:34:562
2535399734,41cyclictest11046-21latency18:15:072
2535399733,63cyclictest22634-21sort18:40:022
219499720,9rtkit-daemon0-21swapper/022:24:531
219499720,9rtkit-daemon0-21swapper/022:24:531
219499720,9rtkit-daemon0-21swapper/021:10:111
2535499714,60cyclictest0-21swapper/319:50:123
2535399712,62cyclictest0-21swapper/217:54:572
2535499704,57cyclictest0-21swapper/320:26:223
2535499704,57cyclictest0-21swapper/320:26:223
25354997024,36cyclictest23670-21netstat23:05:003
219499700,10rtkit-daemon0-21swapper/018:22:101
219499700,10rtkit-daemon0-21swapper/018:22:101
77822697,14sleep10-21swapper/121:04:381
2535399694,59cyclictest0-21swapper/217:39:462
219499690,9rtkit-daemon0-21swapper/020:04:591
219499690,8rtkit-daemon0-21swapper/022:59:521
219499690,8rtkit-daemon0-21swapper/022:39:531
219499690,7rtkit-daemon0-21swapper/017:55:191
2535499685,56cyclictest0-21swapper/318:04:573
2535499683,57cyclictest0-21swapper/322:15:003
2535499674,55cyclictest0-21swapper/318:29:553
219499660,9rtkit-daemon0-21swapper/020:11:511
219499660,8rtkit-daemon0-21swapper/019:58:361
219499660,6rtkit-daemon7580-21strings19:15:081
219499660,6rtkit-daemon2719-21needreboot20:55:041
2535499655,52cyclictest0-21swapper/322:35:063
2535499654,53cyclictest22817-21timerandwakeup21:25:093
2535499654,53cyclictest0-21swapper/321:59:523
2535499654,53cyclictest0-21swapper/320:34:523
2535499654,52cyclictest0-21swapper/321:33:033
2535499654,52cyclictest0-21swapper/320:59:503
219499650,9rtkit-daemon0-21swapper/019:29:531
219499650,7rtkit-daemon0-21swapper/021:48:021
219499650,7rtkit-daemon0-21swapper/021:48:021
2535499644,52cyclictest0-21swapper/320:40:103
2535499644,51cyclictest0-21swapper/321:10:003
2535499635,51cyclictest27957-21fschecks_time20:44:583
2535499634,51cyclictest0-21swapper/322:20:113
2535499634,51cyclictest0-21swapper/320:05:023
2535499634,51cyclictest0-21swapper/319:05:143
2535499634,51cyclictest0-21swapper/319:05:143
219499630,6rtkit-daemon0-21swapper/021:40:031
219499630,6rtkit-daemon0-21swapper/019:48:591
111162633,52sleep111181-21df_abs20:19:551
2535499624,8cyclictest21787-21diskstats19:45:013
2535499624,50cyclictest0-21swapper/318:54:433
2535499624,50cyclictest0-21swapper/317:39:463
25352996242,13cyclictest0-21swapper/120:00:071
219499620,7rtkit-daemon0-21swapper/019:25:001
219499620,7rtkit-daemon0-21swapper/019:00:011
219499620,7rtkit-daemon0-21swapper/018:45:021
219499620,6rtkit-daemon1227-21runrttasks21:58:241
2535499614,51cyclictest0-21swapper/321:09:373
2535499614,51cyclictest0-21swapper/321:09:373
2535499614,40cyclictest0-21swapper/319:44:263
2535499613,50cyclictest17588-21cpuspeed_turbos20:29:533
25352996138,15cyclictest0-21swapper/120:42:371
219499610,6rtkit-daemon0-21swapper/022:12:461
2535499604,49cyclictest0-21swapper/321:45:123
2535499604,49cyclictest0-21swapper/321:45:123
2535499604,48cyclictest0-21swapper/321:49:593
2535499604,48cyclictest0-21swapper/320:14:573
25352996039,14cyclictest0-21swapper/120:37:551
219499600,7rtkit-daemon0-21swapper/022:59:141
219499600,7rtkit-daemon0-21swapper/020:32:201
219499600,7rtkit-daemon0-21swapper/020:27:581
219499600,7rtkit-daemon0-21swapper/020:27:581
219499600,7rtkit-daemon0-21swapper/019:51:591
219499600,7rtkit-daemon0-21swapper/019:41:151
219499600,7rtkit-daemon0-21swapper/018:29:101
219499600,6rtkit-daemon0-21swapper/022:49:521
219499600,6rtkit-daemon0-21swapper/018:40:021
2535499594,48cyclictest0-21swapper/321:20:173
2535499594,46cyclictest8917-21aten2.4-expect19:19:543
2535499594,46cyclictest7047-21irqstats22:39:583
25352995940,11cyclictest27373-21yum-updatesd-he22:21:521
219499590,7rtkit-daemon0-21swapper/021:20:261
219499590,7rtkit-daemon0-21swapper/021:08:491
219499590,7rtkit-daemon0-21swapper/021:08:491
219499590,7rtkit-daemon0-21swapper/020:54:191
219499590,6rtkit-daemon7605-21munin-node18:10:111
219499590,5rtkit-daemon7267-21ssh21:50:171
219499590,5rtkit-daemon469-21strings22:30:011
219499590,5rtkit-daemon0-21swapper/023:06:221
219499590,5rtkit-daemon0-21swapper/020:15:361
2535499584,48cyclictest0-21swapper/322:07:553
2535499584,48cyclictest0-21swapper/320:12:353
2535499584,47cyclictest0-21swapper/319:56:033
2535499584,46cyclictest12772-21munin-node22:49:463
2535499583,48cyclictest0-21swapper/321:19:303
25352995843,8cyclictest22490-21awk21:25:021
219499580,5rtkit-daemon2193-21rtkit-daemon20:52:343
170532583,12sleep30-21swapper/319:35:063
2535499574,46cyclictest16767-21munin-node22:54:533
2535499574,46cyclictest0-21swapper/320:54:573
2535299574,36cyclictest0-21swapper/122:46:311
2535499564,47cyclictest0-21swapper/321:58:023
25354995637,12cyclictest12459-21unixbench-2d20:20:133
25352995640,11cyclictest0-21swapper/122:36:271
2535499554,45cyclictest0-21swapper/322:59:453
2535299554,31cyclictest29164-21needreboot17:45:111
219499550,5rtkit-daemon2193-21rtkit-daemon17:43:193
219499550,5rtkit-daemon2193-21rtkit-daemon17:43:193
2535499546,9cyclictest361ktimersoftd/318:25:083
2535499544,44cyclictest0-21swapper/322:49:303
2535499544,44cyclictest0-21swapper/322:26:153
2535499544,44cyclictest0-21swapper/322:26:153
2535499542,46cyclictest0-21swapper/321:39:483
2535299545,14cyclictest0-21swapper/120:48:321
2535299544,43cyclictest0-21swapper/122:15:001
13052543,10sleep30-21swapper/320:04:043
25354995336,11cyclictest15301-21head19:30:153
2535299536,29cyclictest0-21swapper/119:35:031
2535299534,29cyclictest30236-21ssh21:37:241
2535299533,27cyclictest0-21swapper/118:50:011
2535499524,30cyclictest0-21swapper/322:10:093
2535499523,29cyclictest0-21swapper/318:19:583
2535499523,29cyclictest0-21swapper/318:19:583
2535299525,29cyclictest0-21swapper/118:55:041
2535499514,29cyclictest0-21swapper/317:55:063
25354995134,10cyclictest20383-21tail18:35:023
2535499513,28cyclictest0-21swapper/319:14:563
219499510,4rtkit-daemon2193-21rtkit-daemon17:45:043
104762512,11sleep30-21swapper/318:15:003
35472502,12sleep10-21swapper/119:07:101
35472502,12sleep10-21swapper/119:07:101
312432503,11sleep10-21swapper/117:50:071
2535499503,28cyclictest0-21swapper/317:50:203
2535299504,37cyclictest0-21swapper/119:19:521
25352995019,12cyclictest0-21swapper/117:40:061
25352995019,12cyclictest0-21swapper/117:40:061
71902493,10sleep10-21swapper/118:07:281
2535499494,29cyclictest0-21swapper/319:25:013
2535499494,26cyclictest0-21swapper/318:41:023
2535299495,35cyclictest0-21swapper/118:15:131
25352994917,13cyclictest0-21swapper/118:35:091
2535499484,29cyclictest0-21swapper/319:10:153
2535499483,25cyclictest29475-21cpuspeed_turbos18:54:583
2535299484,37cyclictest18417-21awk18:30:111
2535499475,15cyclictest0-21swapper/318:10:123
2535499474,26cyclictest0-21swapper/318:01:053
48932463,37sleep10-21swapper/118:03:371
2535499454,34cyclictest0-21swapper/318:49:423
2535499424,33cyclictest0-21swapper/319:02:093
249982424,31sleep10-21swapper/117:35:371
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional