You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-06 - 10:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jul 06, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
809021160,11sleep3407899cyclictest19:49:283
2194991120,3rtkit-daemon2193-21rtkit-daemon20:07:492
4069999321,13cyclictest0-21swapper/023:49:050
164382920,4sleep316538-21timerandwakeup20:04:443
406999743,64cyclictest0-21swapper/020:50:440
219499660,20rtkit-daemon2193-21rtkit-daemon20:42:552
255892654,12sleep20-21swapper/222:03:552
219499640,19rtkit-daemon2193-21rtkit-daemon21:32:453
275932622,9sleep30-21swapper/323:40:063
275932622,9sleep30-21swapper/323:40:063
219499610,5rtkit-daemon2193-21rtkit-daemon23:06:272
219499610,5rtkit-daemon2193-21rtkit-daemon23:06:272
162432603,50sleep00-21swapper/022:36:180
407799593,28cyclictest0-21swapper/221:14:292
406999594,47cyclictest0-21swapper/020:42:430
407799585,30cyclictest0-21swapper/222:59:222
407799584,36cyclictest0-21swapper/220:31:092
407799584,36cyclictest0-21swapper/220:31:092
4077995820,23cyclictest0-21swapper/220:36:032
276292584,46sleep20-21swapper/219:20:302
219499580,5rtkit-daemon2193-21rtkit-daemon19:14:133
407799573,38cyclictest1227-21runrttasks23:39:392
407799573,38cyclictest1227-21runrttasks23:39:392
407799573,38cyclictest0-21swapper/200:01:012
407799573,35cyclictest0-21swapper/220:52:342
322632573,46sleep10-21swapper/121:24:351
219499570,6rtkit-daemon2193-21rtkit-daemon23:54:172
219499570,6rtkit-daemon2193-21rtkit-daemon23:14:262
219499570,6rtkit-daemon2193-21rtkit-daemon22:34:432
4078995621,9cyclictest1227-21runrttasks23:54:133
407799565,43cyclictest11143-21diskstats22:29:232
407799565,31cyclictest0-21swapper/223:35:062
407799565,31cyclictest0-21swapper/222:04:342
407799564,36cyclictest0-21swapper/218:44:462
407799564,34cyclictest0-21swapper/223:24:192
4077995615,25cyclictest4334-21sshd22:19:232
4077995615,25cyclictest4334-21sshd22:19:232
4077995613,27cyclictest0-21swapper/220:44:242
4077995610,27cyclictest0-21swapper/221:32:092
406999563,46cyclictest0-21swapper/021:39:240
301292563,11sleep30-21swapper/322:57:333
72772552,9sleep00-21swapper/023:10:000
407799557,26cyclictest0-21swapper/223:14:072
407799556,34cyclictest0-21swapper/221:38:042
407799556,28cyclictest0-21swapper/223:44:242
407799555,30cyclictest0-21swapper/220:56:332
407799554,32cyclictest0-21swapper/222:54:292
407799554,25cyclictest0-21swapper/219:49:142
407799554,14cyclictest796-21tr19:34:292
407799553,37cyclictest0-21swapper/222:25:132
407799553,35cyclictest0-21swapper/221:06:562
407799553,35cyclictest0-21swapper/221:06:562
407799553,22cyclictest21598-21gltestperf22:44:282
4077995522,13cyclictest0-21swapper/220:24:402
4077995521,13cyclictest0-21swapper/221:54:372
4077995520,15cyclictest0-21swapper/219:09:152
407699554,42cyclictest0-21swapper/120:54:121
4076995523,12cyclictest0-21swapper/119:54:141
4069995532,11cyclictest0-21swapper/022:43:030
308052554,11sleep20-21swapper/222:09:392
308052554,11sleep20-21swapper/222:09:392
219499550,5rtkit-daemon2193-21rtkit-daemon23:29:182
219499550,5rtkit-daemon2193-21rtkit-daemon21:14:013
180372553,7sleep318042-21ssh23:27:123
4078995424,12cyclictest0-21swapper/323:20:453
407799545,29cyclictest0-21swapper/221:09:422
407799544,29cyclictest0-21swapper/222:14:362
4077995421,14cyclictest0-21swapper/223:22:502
4077995421,14cyclictest0-21swapper/218:39:502
4077995421,13cyclictest0-21swapper/220:59:352
4077995420,14cyclictest0-21swapper/219:59:482
407699543,46cyclictest0-21swapper/119:29:151
407699543,44cyclictest14868-21rm22:34:291
4076995421,14cyclictest0-21swapper/121:59:041
406999543,43cyclictest0-21swapper/021:04:440
406999543,43cyclictest0-21swapper/021:04:440
219499540,6rtkit-daemon2193-21rtkit-daemon21:39:222
219499540,5rtkit-daemon2193-21rtkit-daemon23:49:402
219499540,5rtkit-daemon2193-21rtkit-daemon21:45:222
219499540,5rtkit-daemon2193-21rtkit-daemon21:45:222
219499540,5rtkit-daemon2193-21rtkit-daemon20:19:262
219499540,5rtkit-daemon2193-21rtkit-daemon20:14:332
61332533,42sleep36139-21ssh20:46:003
407899535,23cyclictest0-21swapper/320:56:223
407899533,42cyclictest14003-21ssh22:34:203
407799536,28cyclictest1227-21runrttasks21:19:412
407799536,27cyclictest16656-21df18:59:322
407799535,29cyclictest0-21swapper/219:09:332
407799535,25cyclictest16231-21cstates21:49:252
407799534,29cyclictest0-21swapper/219:29:372
4077995323,11cyclictest29101-21diskmemload21:26:082
4077995321,12cyclictest1227-21runrttasks19:57:232
407699534,42cyclictest0-21swapper/121:39:371
407699534,42cyclictest0-21swapper/118:34:271
407699534,15cyclictest0-21swapper/122:19:331
407699534,15cyclictest0-21swapper/122:19:331
4076995337,10cyclictest1155-21gltestperf22:14:291
406999533,45cyclictest0-21swapper/022:02:110
406999533,44cyclictest0-21swapper/021:26:440
4069995314,29cyclictest0-21swapper/023:43:200
4069995314,29cyclictest0-21swapper/023:43:200
219499530,5rtkit-daemon2193-21rtkit-daemon22:39:282
206192533,43sleep10-21swapper/121:08:311
206192533,43sleep10-21swapper/121:08:311
130182533,42sleep113112-21fschecks_count21:44:271
130182533,42sleep113112-21fschecks_count21:44:271
407899525,12cyclictest0-21swapper/320:54:113
407899523,43cyclictest0-21swapper/321:00:033
4078995211,34cyclictest0-21swapper/322:12:473
4078995211,34cyclictest0-21swapper/322:12:473
407799526,27cyclictest0-21swapper/218:34:452
407799525,28cyclictest0-21swapper/218:49:322
407799525,27cyclictest0-21swapper/219:49:252
407799525,27cyclictest0-21swapper/218:56:322
407799524,29cyclictest0-21swapper/220:09:432
407799524,28cyclictest0-21swapper/222:49:372
407699524,42cyclictest0-21swapper/123:19:261
407699524,41cyclictest0-21swapper/123:49:171
407699523,43cyclictest29101-21diskmemload23:47:521
407699523,43cyclictest29101-21diskmemload21:14:551
4076995219,28cyclictest11103-21df_abs22:29:231
4076995218,29cyclictest2896-21sh21:29:291
406999525,16cyclictest0-21swapper/023:23:190
406999524,41cyclictest0-21swapper/023:14:190
406999523,42cyclictest0-21swapper/022:09:400
406999523,42cyclictest0-21swapper/022:09:400
406999523,21cyclictest0-21swapper/021:49:090
406999523,21cyclictest0-21swapper/021:49:090
406999523,17cyclictest0-21swapper/023:54:470
275842523,8sleep327716-21perl20:29:313
275842523,8sleep327716-21perl20:29:313
138502523,42sleep10-21swapper/120:58:271
72172513,41sleep30-21swapper/323:09:473
58912513,41sleep35895-21ssh22:20:333
58912513,41sleep35895-21ssh22:20:333
4078995134,10cyclictest8054-21tail22:24:273
407799515,28cyclictest0-21swapper/219:14:382
407799514,28cyclictest0-21swapper/219:39:362
4077995122,8cyclictest30329-21latency_hist19:29:152
407699514,41cyclictest0-21swapper/122:00:441
407699513,42cyclictest28410-21sshd21:19:261
407699513,42cyclictest23067-21gltestperf23:34:251
407699513,42cyclictest0-21swapper/120:14:131
407699513,41cyclictest29101-21diskmemload00:01:311
407699513,41cyclictest0-21swapper/120:44:261
407699513,41cyclictest0-21swapper/119:54:251
407699513,11cyclictest25964-21munin-node22:49:421
406999514,40cyclictest0-21swapper/023:24:310
406999514,11cyclictest0-21swapper/023:59:380
406999514,11cyclictest0-21swapper/021:16:350
406999513,42cyclictest0-21swapper/021:59:090
406999513,41cyclictest0-21swapper/021:29:260
406999513,41cyclictest0-21swapper/020:34:210
222082513,42sleep00-21swapper/019:09:400
4078995026,8cyclictest31701-21ssh22:59:253
4078995011,22cyclictest0-21swapper/323:15:013
407699504,41cyclictest0-21swapper/122:46:031
407699504,40cyclictest0-21swapper/122:39:351
407699504,40cyclictest0-21swapper/121:51:271
407699504,39cyclictest0-21swapper/122:09:421
407699504,39cyclictest0-21swapper/122:09:421
407699504,38cyclictest27515-21aten2.4-expect22:54:171
407699503,43cyclictest0-21swapper/121:36:301
406999503,42cyclictest0-21swapper/021:01:040
406999503,41cyclictest0-21swapper/023:04:490
406999503,41cyclictest0-21swapper/023:04:490
406999503,40cyclictest17972-21ssh21:50:470
406999502,42cyclictest0-21swapper/022:19:250
406999502,42cyclictest0-21swapper/022:19:250
219499500,5rtkit-daemon2193-21rtkit-daemon19:24:353
219499500,5rtkit-daemon2193-21rtkit-daemon18:29:373
219499500,4rtkit-daemon2193-21rtkit-daemon21:28:083
213332502,40sleep30-21swapper/323:31:563
129202502,42sleep00-21swapper/022:31:300
6962492,41sleep00-21swapper/023:01:170
41872493,39sleep30-21swapper/323:06:043
41872493,39sleep30-21swapper/323:06:043
407899493,37cyclictest18885-21ssh21:54:073
407899493,23cyclictest5220-21sa119:44:143
4078994919,12cyclictest0-21swapper/319:14:533
407699494,40cyclictest14408-21df_abs18:54:321
407699494,39cyclictest0-21swapper/123:13:321
407699494,39cyclictest0-21swapper/121:11:041
407699494,38cyclictest0-21swapper/123:39:181
407699494,38cyclictest0-21swapper/123:39:181
407699494,28cyclictest0-21swapper/123:56:521
4076994930,14cyclictest0-21swapper/123:32:271
407699493,39cyclictest9668-21cat23:14:261
406999499,23cyclictest1227-21runrttasks20:45:370
4069994931,13cyclictest0-21swapper/023:34:230
406999493,42cyclictest0-21swapper/023:50:410
406999493,42cyclictest0-21swapper/023:29:350
406999493,40cyclictest0-21swapper/022:47:090
406999493,40cyclictest0-21swapper/022:15:190
4069994929,15cyclictest0-21swapper/022:27:000
4069994919,24cyclictest0-21swapper/022:04:100
326612492,39sleep30-21swapper/322:14:163
265032493,9sleep30-21swapper/321:15:223
255092492,9sleep00-21swapper/019:18:550
215972492,41sleep30-21swapper/320:15:083
110172493,10sleep10-21swapper/118:46:401
407899484,38cyclictest0-21swapper/321:22:163
4078994835,8cyclictest25657-21crond22:04:083
4078994833,9cyclictest13317-21gltestperf21:44:283
4078994833,9cyclictest13317-21gltestperf21:44:283
4078994831,11cyclictest21613-21cut22:44:283
407899483,38cyclictest0-21swapper/323:53:473
407699485,26cyclictest0-21swapper/123:25:551
407699484,38cyclictest0-21swapper/122:05:021
407699483,39cyclictest2318-21sed19:34:481
407699483,38cyclictest0-21swapper/122:59:161
4076994822,11cyclictest0-21swapper/121:01:021
406999484,39cyclictest0-21swapper/022:57:260
406999482,11cyclictest0-21swapper/022:49:350
257722483,36sleep30-21swapper/319:19:263
24022482,40sleep10-21swapper/120:40:171
239892483,38sleep10-21swapper/120:20:141
219499480,5rtkit-daemon2193-21rtkit-daemon18:54:513
146802483,40sleep10-21swapper/120:03:211
131092482,40sleep00-21swapper/020:56:000
128702482,9sleep30-21swapper/319:59:283
73792473,37sleep10-21swapper/119:46:291
4078994732,9cyclictest20352-21chrt19:04:503
4078994732,10cyclictest19458-21unixbench-2d21:04:453
4078994732,10cyclictest19458-21unixbench-2d21:04:453
4078994730,10cyclictest22985-21fschecks_time23:34:253
4078994725,16cyclictest0-21swapper/322:04:393
4078994723,8cyclictest29101-21diskmemload20:34:483
407699474,38cyclictest0-21swapper/123:04:401
407699474,38cyclictest0-21swapper/123:04:401
407699473,39cyclictest0-21swapper/122:28:041
407699473,38cyclictest0-21swapper/120:35:051
407699473,38cyclictest0-21swapper/120:24:251
4076994717,9cyclictest5271-21cat19:44:141
406999473,38cyclictest0-21swapper/021:19:230
406999473,37cyclictest22629-21switchtime21:09:440
406999473,37cyclictest0-21swapper/019:04:510
406999473,26cyclictest0-21swapper/018:45:540
406999473,11cyclictest0-21swapper/021:38:310
4069994719,9cyclictest29097-21latency_hist20:34:130
4069994719,9cyclictest29097-21latency_hist20:34:130
4069994718,8cyclictest13608-21latency_hist18:54:160
302392472,39sleep00-21swapper/019:28:100
145972472,39sleep00-21swapper/020:02:160
126402473,37sleep312643-21ssh22:30:283
78962462,38sleep30-21swapper/321:35:583
407899464,13cyclictest0-21swapper/300:04:033
407899463,38cyclictest0-21swapper/322:49:303
407899463,37cyclictest0-21swapper/321:56:053
4078994629,10cyclictest5157-21gltestperf18:34:353
4078994618,12cyclictest0-21swapper/320:39:303
407699465,33cyclictest0-21swapper/119:14:161
407699463,37cyclictest0-21swapper/118:49:391
407699463,12cyclictest0-21swapper/119:19:441
4069994629,10cyclictest1268-21tune2fs19:34:340
4069994618,8cyclictest27925-21latency_hist19:24:150
25522462,37sleep30-21swapper/319:35:553
168812463,37sleep10-21swapper/120:05:551
133502463,10sleep30-21swapper/318:51:013
112202462,38sleep329101-21diskmemload21:40:503
407899455,33cyclictest0-21swapper/322:42:153
407699454,34cyclictest0-21swapper/118:59:291
4069994530,9cyclictest32708-21crond19:34:140
406999453,37cyclictest0-21swapper/019:44:320
4069994517,8cyclictest17142-21latency_hist20:09:130
37402453,6sleep00-21swapper/018:30:230
49142442,9sleep00-21swapper/019:40:270
407899444,32cyclictest0-21swapper/323:44:193
407899444,12cyclictest0-21swapper/320:09:303
4078994423,14cyclictest0-21swapper/320:19:453
4078994416,12cyclictest0-21swapper/320:24:273
407699443,35cyclictest25051-21sed19:14:481
4069994427,12cyclictest0-21swapper/019:04:150
406999442,37cyclictest0-21swapper/018:40:490
407899434,33cyclictest0-21swapper/319:44:433
407899433,35cyclictest0-21swapper/318:46:193
4078994313,16cyclictest4389-21kworker/3:218:59:303
407699434,33cyclictest0-21swapper/118:39:331
407699434,32cyclictest0-21swapper/120:34:131
407699434,32cyclictest0-21swapper/120:34:131
4076994326,12cyclictest0-21swapper/119:31:401
406999435,32cyclictest0-21swapper/019:54:320
406999433,11cyclictest19503-21yum-updatesd-he20:14:130
406999433,11cyclictest0-21swapper/019:49:460
4069994329,9cyclictest20430-21grep20:14:320
149522432,35sleep00-21swapper/018:54:410
407899425,30cyclictest0-21swapper/319:54:383
4078994228,9cyclictest7217-21sed18:39:323
4069994227,10cyclictest0-21swapper/018:34:430
324292422,33sleep30-21swapper/319:30:393
407699414,31cyclictest0-21swapper/119:04:281
406999413,31cyclictest0-21swapper/020:24:130
406999413,10cyclictest0-21swapper/020:25:560
4076994011,12cyclictest0-21swapper/120:14:261
407799394,28cyclictest0-21swapper/218:34:182
28882359,16sleep10-21swapper/118:29:361
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional