You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-18 - 06:15

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 18, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991020,5rtkit-daemon0-21swapper/319:49:382
82862930,4sleep08289-21kernelversion20:21:120
1897299907,67cyclictest19315-21ps23:01:143
1897299907,67cyclictest19315-21ps23:01:143
1897299904,79cyclictest0-21swapper/321:13:333
1897299904,79cyclictest0-21swapper/321:06:513
1897299904,69cyclictest0-21swapper/322:35:563
1897299894,72cyclictest9964-21ssh20:24:393
1897299893,54cyclictest0-21swapper/319:39:273
1897299884,76cyclictest0-21swapper/317:50:553
1897299884,66cyclictest0-21swapper/323:05:573
1897299874,76cyclictest0-21swapper/321:19:573
1897299874,75cyclictest0-21swapper/322:21:133
1897299874,75cyclictest0-21swapper/320:06:163
1897299874,66cyclictest0-21swapper/320:57:123
1897299873,67cyclictest22444-21df_abs21:31:023
1897299873,65cyclictest18344-21irqstats20:36:133
1897299873,52cyclictest30876-21crond18:05:543
1897299864,64cyclictest15371-21seq22:07:313
1897299864,62cyclictest0-21swapper/319:56:193
1897299863,75cyclictest207971ssh22:16:053
1897299863,75cyclictest207971ssh22:16:053
1897299854,74cyclictest0-21swapper/320:55:153
1897299854,73cyclictest20211-21ntp_kernel_pll_19:51:163
1897299854,73cyclictest0-21swapper/320:42:523
1897299854,73cyclictest0-21swapper/319:16:013
1897299854,71cyclictest0-21swapper/318:36:203
1897299854,62cyclictest0-21swapper/320:31:333
1897299854,61cyclictest0-21swapper/321:58:353
1897299853,74cyclictest23563-21gltestperf18:56:133
1897299853,57cyclictest679-21latency21:46:103
170592850,3sleep03-21ksoftirqd/022:58:390
170592850,3sleep03-21ksoftirqd/022:58:390
1897299844,73cyclictest0-21swapper/320:16:093
1897299844,72cyclictest17189-21ssh19:46:223
1897299844,72cyclictest0-21swapper/321:37:113
1897299844,72cyclictest0-21swapper/321:37:113
1897299844,69cyclictest19663-21cut21:26:093
1897299844,63cyclictest0-21swapper/320:47:553
1897299844,59cyclictest0-21swapper/319:44:493
1897299843,75cyclictest10603-21aten_r1power_en20:25:593
1897299843,73cyclictest9680-21yum22:46:193
1897299843,62cyclictest31678-21taskset19:11:253
1897299843,62cyclictest30117-21aten_r1power_po22:30:563
1897299843,50cyclictest25934-21aten_r1power_en20:01:013
1897299843,50cyclictest15456-21cpuspeed21:20:583
1897299834,73cyclictest0-21swapper/320:11:073
1897299834,73cyclictest0-21swapper/320:11:073
248599820,4rtkit-daemon2484-21rtkit-daemon22:16:240
248599820,4rtkit-daemon2484-21rtkit-daemon22:16:240
1897299824,70cyclictest0-21swapper/318:41:083
1897299824,61cyclictest11757-21diskstats22:51:013
1897299823,65cyclictest1419-21runrttasks21:01:063
1897299823,60cyclictest0-21swapper/322:03:323
1897299823,55cyclictest5009-21ssh21:51:253
1897299814,70cyclictest0-21swapper/319:31:163
1897299814,70cyclictest0-21swapper/317:55:553
1897299814,68cyclictest0-21swapper/318:11:123
1897299814,68cyclictest0-21swapper/318:11:123
1897299814,59cyclictest0-21swapper/322:12:443
1897299813,70cyclictest31773-21ls21:45:463
1897299813,59cyclictest4501-21ssh22:40:533
1897299813,58cyclictest0-21swapper/322:29:293
1897299813,58cyclictest0-21swapper/318:20:543
1897299804,68cyclictest0-21swapper/317:41:063
1897299803,67cyclictest1419-21runrttasks19:23:583
1897299803,56cyclictest0-21swapper/323:00:003
1897299803,56cyclictest0-21swapper/323:00:003
248599790,5rtkit-daemon2484-21rtkit-daemon18:05:490
248599790,4rtkit-daemon2484-21rtkit-daemon23:10:300
1897299784,62cyclictest0-21swapper/319:30:343
1897299783,67cyclictest29277-21users19:06:273
1897299783,45cyclictest0-21swapper/318:21:043
18972997818,43cyclictest1247-21lldpd19:01:043
1897299765,47cyclictest10757-21munin-node18:31:163
1897299764,65cyclictest0-21swapper/318:26:273
1897299753,49cyclictest0-21swapper/318:06:123
1897299743,56cyclictest27359-21iostat17:56:163
1897299734,61cyclictest20487-21tail18:51:043
1897299734,61cyclictest20487-21tail18:51:043
1897299734,53cyclictest0-21swapper/318:46:053
1897199694,15cyclictest0-21swapper/219:56:102
1896899694,28cyclictest0-21swapper/020:31:150
1897299685,56cyclictest0-21swapper/317:40:563
1897199634,14cyclictest0-21swapper/219:36:112
251492627,48sleep10-21swapper/122:21:231
1897199625,13cyclictest0-21swapper/221:51:112
1897199625,12cyclictest0-21swapper/220:11:072
1897199625,12cyclictest0-21swapper/220:11:072
1897199624,39cyclictest0-21swapper/220:21:052
18971996221,26cyclictest0-21swapper/221:46:162
125292624,49sleep20-21swapper/219:41:072
248599610,8rtkit-daemon0-21swapper/123:04:000
248599610,8rtkit-daemon0-21swapper/123:04:000
248599610,8rtkit-daemon0-21swapper/118:08:272
248599610,7rtkit-daemon0-21swapper/122:31:390
1897199604,13cyclictest0-21swapper/223:01:212
1897199604,13cyclictest0-21swapper/223:01:212
1897199604,13cyclictest0-21swapper/221:41:142
189162603,12sleep00-21swapper/022:13:160
248599590,7rtkit-daemon0-21swapper/122:30:010
248599590,4rtkit-daemon2484-21rtkit-daemon22:51:311
18971995940,12cyclictest19735-21tail19:51:092
1897199594,14cyclictest0-21swapper/222:17:302
1897199594,14cyclictest0-21swapper/222:17:302
1896899594,45cyclictest0-21swapper/020:05:500
248599580,6rtkit-daemon0-21swapper/117:56:500
248599580,4rtkit-daemon22779-21strings17:46:200
1897199584,44cyclictest1419-21runrttasks20:46:102
18971995812,27cyclictest0-21swapper/221:16:072
180482584,47sleep20-21swapper/221:24:482
94222573,9sleep00-21swapper/022:00:220
248599570,4rtkit-daemon2484-21rtkit-daemon22:42:311
248599570,4rtkit-daemon2484-21rtkit-daemon17:49:201
1897199574,47cyclictest9131-21chrt21:59:182
1897199574,36cyclictest0-21swapper/222:14:292
18971995713,25cyclictest2507-21gdm-simple-gree22:30:432
1896899575,44cyclictest0-21swapper/019:52:310
59482563,46sleep26060-21sh21:06:062
294732563,10sleep00-21swapper/020:52:130
248599560,4rtkit-daemon2484-21rtkit-daemon23:02:531
248599560,4rtkit-daemon2484-21rtkit-daemon23:02:531
248599560,4rtkit-daemon2484-21rtkit-daemon22:13:471
1897199564,35cyclictest0-21swapper/222:54:002
1897199564,12cyclictest0-21swapper/221:15:162
18968995627,13cyclictest0-21swapper/022:51:050
147072562,46sleep10-21swapper/120:31:101
251152552,7sleep125120-21ssh19:59:171
248599550,5rtkit-daemon2484-21rtkit-daemon18:01:121
248599550,4rtkit-daemon2484-21rtkit-daemon22:35:461
248599550,4rtkit-daemon2484-21rtkit-daemon18:07:271
248599550,4rtkit-daemon2484-21rtkit-daemon17:43:051
20342552,10sleep20-21swapper/219:20:522
1897199558,32cyclictest0-21swapper/222:58:042
1897199558,32cyclictest0-21swapper/222:58:042
1897199554,25cyclictest0-21swapper/222:33:132
1897199554,24cyclictest0-21swapper/220:56:102
18970995535,13cyclictest0-21swapper/120:46:141
1896899554,43cyclictest0-21swapper/022:46:120
18968995511,26cyclictest0-21swapper/020:46:050
119792553,9sleep00-21swapper/022:02:240
73202543,10sleep00-21swapper/021:07:250
248599540,4rtkit-daemon2484-21rtkit-daemon23:09:151
248599540,4rtkit-daemon2484-21rtkit-daemon23:00:081
248599540,4rtkit-daemon2484-21rtkit-daemon23:00:081
248599540,4rtkit-daemon2484-21rtkit-daemon22:17:021
248599540,4rtkit-daemon2484-21rtkit-daemon22:17:021
248599540,4rtkit-daemon2484-21rtkit-daemon17:56:051
248599540,4rtkit-daemon2484-21rtkit-daemon17:54:501
1897199545,30cyclictest0-21swapper/221:01:052
1897199544,34cyclictest0-21swapper/222:21:272
1897199544,30cyclictest0-21swapper/221:36:142
1897199544,30cyclictest0-21swapper/221:36:142
1897199544,27cyclictest0-21swapper/220:31:022
18971995437,10cyclictest27694-21grep20:01:232
18971995410,26cyclictest0-21swapper/222:36:072
18970995418,29cyclictest16255-21crond22:10:441
1896899540,7cyclictest22620-21ssh20:41:440
36762533,10sleep00-21swapper/021:01:240
248599530,7rtkit-daemon0-21swapper/122:44:530
248599530,5rtkit-daemon2484-21rtkit-daemon22:47:081
248599530,4rtkit-daemon2484-21rtkit-daemon22:33:011
248599530,4rtkit-daemon2484-21rtkit-daemon22:27:391
206832533,10sleep00-21swapper/021:27:080
1897199535,38cyclictest0-21swapper/222:06:112
1897199535,32cyclictest29-21ksoftirqd/223:09:092
1897199535,28cyclictest0-21swapper/220:51:002
1897199534,43cyclictest0-21swapper/221:33:022
18971995339,9cyclictest30746-21grep19:11:092
18971995322,13cyclictest0-21swapper/218:46:192
18971995321,13cyclictest0-21swapper/220:41:142
1897099534,25cyclictest0-21swapper/120:24:231
18970995316,10cyclictest4362-21needreboot21:51:121
1896899535,30cyclictest0-21swapper/019:06:100
1896899534,39cyclictest1419-21runrttasks18:16:240
16022533,9sleep00-21swapper/021:46:430
103952532,9sleep20-21swapper/222:48:582
103722533,10sleep00-21swapper/018:29:020
68612523,43sleep00-21swapper/019:30:250
39862523,9sleep00-21swapper/022:40:050
326342523,7sleep132716-21fschecks_count21:46:041
32152523,10sleep00-21swapper/018:14:030
32152523,10sleep00-21swapper/018:14:030
1897199524,34cyclictest0-21swapper/221:29:242
1897199524,34cyclictest0-21swapper/218:21:062
1897199524,30cyclictest0-21swapper/220:16:252
1897199524,29cyclictest0-21swapper/219:26:032
1897199524,29cyclictest0-21swapper/217:56:242
18971995220,11cyclictest0-21swapper/218:12:272
18971995220,11cyclictest0-21swapper/218:12:272
1897099525,14cyclictest0-21swapper/121:32:081
18970995233,13cyclictest0-21swapper/121:36:061
18970995233,13cyclictest0-21swapper/121:36:061
18970995232,13cyclictest0-21swapper/120:16:011
18970995221,13cyclictest0-21swapper/121:16:161
18968995232,13cyclictest0-21swapper/020:26:200
91182513,43sleep00-21swapper/019:33:280
38252513,8sleep13947-21sed19:21:231
305872513,41sleep00-21swapper/021:41:270
248599510,5rtkit-daemon2484-21rtkit-daemon17:36:201
199422513,41sleep00-21swapper/018:48:570
1897199515,33cyclictest0-21swapper/220:26:332
1897199515,28cyclictest0-21swapper/220:05:552
1897199514,41cyclictest0-21swapper/217:41:162
1897199514,33cyclictest0-21swapper/222:41:212
1897199514,28cyclictest0-21swapper/219:31:202
1897199514,28cyclictest0-21swapper/218:26:172
18971995131,13cyclictest0-21swapper/219:01:092
18971995121,13cyclictest0-21swapper/222:04:342
1897099515,38cyclictest0-21swapper/118:31:261
1897099514,28cyclictest0-21swapper/121:06:071
18970995132,13cyclictest0-21swapper/122:01:181
1897099513,19cyclictest0-21swapper/121:57:301
18970995127,18cyclictest0-21swapper/120:26:001
18970995121,13cyclictest0-21swapper/121:40:591
1896899514,26cyclictest0-21swapper/021:11:010
18968995130,15cyclictest0-21swapper/022:06:030
18968995129,15cyclictest0-21swapper/020:11:060
18968995129,15cyclictest0-21swapper/020:11:060
18968995124,11cyclictest0-21swapper/022:20:560
18968995115,13cyclictest0-21swapper/017:40:550
132222513,10sleep00-21swapper/019:41:180
53612503,41sleep00-21swapper/021:52:440
317722503,40sleep00-21swapper/019:12:360
316772503,41sleep131752-21iostat20:56:091
258572502,41sleep00-21swapper/017:52:380
1897199505,27cyclictest0-21swapper/220:37:472
1897199504,29cyclictest0-21swapper/219:24:342
1897199504,28cyclictest0-21swapper/218:41:052
1897199504,28cyclictest0-21swapper/218:31:272
1897199504,28cyclictest0-21swapper/218:16:242
18971995020,12cyclictest0-21swapper/219:06:102
1897099505,38cyclictest0-21swapper/119:55:491
1897099505,28cyclictest0-21swapper/119:16:231
1897099505,26cyclictest0-21swapper/120:06:021
1897099504,28cyclictest0-21swapper/120:45:481
1896899506,35cyclictest1419-21runrttasks21:36:330
1896899506,35cyclictest1419-21runrttasks21:36:330
1896899504,39cyclictest0-21swapper/020:16:130
1896899504,28cyclictest0-21swapper/018:41:090
1896899504,25cyclictest0-21swapper/018:51:020
1896899504,25cyclictest0-21swapper/018:51:020
1896899504,12cyclictest0-21swapper/020:06:010
18968995033,11cyclictest0-21swapper/021:21:070
1896899503,11cyclictest15321-21munin-node19:46:200
151462503,10sleep00-21swapper/018:38:500
80642493,39sleep00-21swapper/018:25:030
234532492,10sleep20-21swapper/217:47:282
202872493,10sleep00-21swapper/020:40:320
1897199494,27cyclictest0-21swapper/218:51:042
1897199494,27cyclictest0-21swapper/218:51:042
1897199493,28cyclictest0-21swapper/217:51:242
18971994917,13cyclictest0-21swapper/218:56:062
1897099497,9cyclictest6170-21sendmail_mailqu19:26:201
1897099495,26cyclictest0-21swapper/119:44:591
1897099494,39cyclictest0-21swapper/120:51:141
1897099494,28cyclictest0-21swapper/120:15:141
1897099494,28cyclictest0-21swapper/120:15:141
18970994934,11cyclictest0-21swapper/121:25:311
18970994923,12cyclictest0-21swapper/121:05:051
1896899497,7cyclictest41ktimersoftd/019:20:510
1896899495,27cyclictest0-21swapper/019:21:270
1896899494,9cyclictest0-21swapper/021:33:590
1896899494,27cyclictest0-21swapper/020:56:040
1896899494,27cyclictest0-21swapper/019:01:090
1896899494,27cyclictest0-21swapper/017:41:230
18968994931,12cyclictest0-21swapper/021:19:100
30182482,9sleep10-21swapper/118:11:301
30182482,9sleep10-21swapper/118:11:301
1897199484,27cyclictest0-21swapper/218:36:182
1897099485,22cyclictest0-21swapper/119:46:521
1897099484,36cyclictest0-21swapper/118:46:241
1897099484,27cyclictest0-21swapper/120:38:451
1897099484,27cyclictest0-21swapper/118:26:221
1897099484,24cyclictest0-21swapper/118:36:041
18970994830,11cyclictest28912-21sendmail_mailqu19:06:221
1896899484,37cyclictest0-21swapper/019:56:060
1896899484,37cyclictest0-21swapper/018:56:110
7032473,39sleep00-21swapper/018:09:430
18971994733,8cyclictest30424-21grep18:01:262
1897099475,26cyclictest0-21swapper/120:00:581
18970994730,12cyclictest0-21swapper/121:26:011
18970994713,16cyclictest8563-21aten2.4-expect21:10:581
125842473,38sleep00-21swapper/018:31:440
114962473,37sleep00-21swapper/019:38:230
1897099465,34cyclictest0-21swapper/118:21:101
1897099465,25cyclictest0-21swapper/118:51:541
1897099465,25cyclictest0-21swapper/118:51:541
1897099454,25cyclictest0-21swapper/118:41:111
1897099453,12cyclictest0-21swapper/119:01:051
1897099445,33cyclictest0-21swapper/118:56:191
18970994431,8cyclictest8704-21ls19:31:241
1897099443,34cyclictest0-21swapper/118:16:241
317782432,9sleep10-21swapper/119:12:411
1897099433,34cyclictest0-21swapper/119:40:521
179222424,6sleep20-21swapper/217:36:172
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional