You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-20 - 01:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jul 20, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991080,4rtkit-daemon2193-21rtkit-daemon22:31:132
219499960,25rtkit-daemon0-21swapper/320:11:483
219499910,6rtkit-daemon2193-21rtkit-daemon20:46:170
219499890,6rtkit-daemon0-21swapper/320:31:333
219499880,4rtkit-daemon2193-21rtkit-daemon19:26:282
219499870,5rtkit-daemon2193-21rtkit-daemon18:28:300
219499850,5rtkit-daemon2193-21rtkit-daemon18:36:000
219499850,5rtkit-daemon2193-21rtkit-daemon18:36:000
219499850,4rtkit-daemon2193-21rtkit-daemon23:31:410
79392840,2sleep3361ktimersoftd/321:26:243
219499840,5rtkit-daemon2193-21rtkit-daemon20:51:242
219499830,5rtkit-daemon2193-21rtkit-daemon19:20:050
219499830,5rtkit-daemon2193-21rtkit-daemon19:20:050
219499830,4rtkit-daemon2193-21rtkit-daemon20:41:100
219499820,4rtkit-daemon2193-21rtkit-daemon19:01:290
219499810,5rtkit-daemon2193-21rtkit-daemon21:37:072
219499810,5rtkit-daemon2193-21rtkit-daemon19:11:062
219499810,4rtkit-daemon2193-21rtkit-daemon22:14:362
219499780,4rtkit-daemon2193-21rtkit-daemon21:55:292
219499770,7rtkit-daemon0-21swapper/320:59:313
219499770,5rtkit-daemon2193-21rtkit-daemon22:44:420
219499770,25rtkit-daemon0-21swapper/323:04:123
219499760,6rtkit-daemon0-21swapper/322:24:513
219499760,6rtkit-daemon0-21swapper/322:10:213
219499760,4rtkit-daemon2193-21rtkit-daemon20:38:550
219499760,4rtkit-daemon2193-21rtkit-daemon20:38:550
281432750,5sleep00-21swapper/021:55:240
219499750,6rtkit-daemon0-21swapper/018:50:440
219499750,5rtkit-daemon0-21swapper/321:04:313
219499750,4rtkit-daemon2193-21rtkit-daemon23:25:560
219499740,8rtkit-daemon0-21swapper/321:11:312
31373997333,32cyclictest87341ssh20:42:523
219499710,13rtkit-daemon2193-21rtkit-daemon20:48:391
219499690,5rtkit-daemon2193-21rtkit-daemon23:30:560
219499690,4rtkit-daemon2193-21rtkit-daemon21:33:450
219499690,10rtkit-daemon0-21swapper/021:48:070
219499670,4rtkit-daemon2193-21rtkit-daemon21:36:300
219499660,6rtkit-daemon0-21swapper/221:43:453
219499660,5rtkit-daemon2193-21rtkit-daemon18:41:221
31373996529,14cyclictest0-21swapper/320:40:323
31373996529,14cyclictest0-21swapper/320:40:323
219499650,7rtkit-daemon0-21swapper/223:13:493
219499650,6rtkit-daemon2193-21rtkit-daemon21:21:011
219499650,6rtkit-daemon2193-21rtkit-daemon21:21:011
219499650,5rtkit-daemon723-21yum-updatesd-he22:01:373
219499650,5rtkit-daemon2193-21rtkit-daemon20:43:171
219499650,5rtkit-daemon19321-21latency_hist20:11:033
219499640,7rtkit-daemon0-21swapper/321:43:152
219499640,6rtkit-daemon26-21rcuc/219:41:053
219499640,6rtkit-daemon0-21swapper/222:41:123
219499640,5rtkit-daemon5059-21iostat_ios22:51:203
219499640,5rtkit-daemon24212-21ssh22:33:133
219499640,5rtkit-daemon0-21swapper/219:41:203
219499640,4rtkit-daemon2193-21rtkit-daemon18:36:221
219499640,4rtkit-daemon0-21swapper/222:20:583
3137399634,51cyclictest0-21swapper/323:42:173
3137299638,42cyclictest0-21swapper/222:01:292
275502633,53sleep00-21swapper/020:26:030
219499630,5rtkit-daemon26718-21ssh20:23:252
3137299623,49cyclictest0-21swapper/222:06:262
219499620,6rtkit-daemon0-21swapper/221:58:523
219499620,6rtkit-daemon0-21swapper/221:58:523
219499620,5rtkit-daemon0-21swapper/221:40:073
219499620,5rtkit-daemon0-21swapper/220:21:253
72662614,13sleep00-21swapper/018:36:270
3136999614,48cyclictest0-21swapper/021:41:300
31369996134,15cyclictest1159-21ssh22:01:260
219499610,4rtkit-daemon2193-21rtkit-daemon19:01:591
3137399604,22cyclictest0-21swapper/323:36:103
3137199604,49cyclictest0-21swapper/121:33:001
219499600,6rtkit-daemon0-21swapper/323:16:412
219499600,6rtkit-daemon0-21swapper/323:16:412
219499600,5rtkit-daemon2193-21rtkit-daemon18:51:071
322212593,12sleep20-21swapper/222:45:342
3137399594,36cyclictest0-21swapper/323:21:253
31373995939,12cyclictest24698-21crond21:50:583
31373995935,18cyclictest8828-21latency_hist18:41:073
31373995934,19cyclictest0-21swapper/323:19:123
31373995934,19cyclictest0-21swapper/323:19:123
31373995920,23cyclictest0-21swapper/322:13:293
3136999595,32cyclictest0-21swapper/022:11:190
3136999594,47cyclictest0-21swapper/023:36:070
31369995920,21cyclictest0-21swapper/021:28:300
219499590,6rtkit-daemon0-21swapper/320:11:412
219499590,6rtkit-daemon0-21swapper/319:18:282
219499590,6rtkit-daemon0-21swapper/319:18:282
3137399585,33cyclictest0-21swapper/319:21:283
3137399584,45cyclictest0-21swapper/323:26:083
31373995839,12cyclictest1401-21missed_timers22:46:223
31373995811,30cyclictest0-21swapper/321:06:243
3137299585,36cyclictest0-21swapper/223:28:412
219499580,6rtkit-daemon0-21swapper/321:56:072
219499580,6rtkit-daemon0-21swapper/321:56:072
219499580,6rtkit-daemon0-21swapper/320:58:242
219499580,6rtkit-daemon0-21swapper/320:31:402
219499580,5rtkit-daemon2193-21rtkit-daemon23:38:181
219499580,4rtkit-daemon14874-21ssh23:06:042
208702583,49sleep00-21swapper/022:29:080
158122583,8sleep015850-21ssh23:06:170
3137399575,44cyclictest0-21swapper/323:06:283
3137399574,45cyclictest0-21swapper/321:31:333
3137399574,35cyclictest0-21swapper/321:21:133
3137399573,47cyclictest0-21swapper/323:32:433
3137399573,46cyclictest0-21swapper/321:53:113
3137299574,34cyclictest15097-21ssh22:21:142
31372995716,21cyclictest1080-21lldpd21:30:152
31371995723,27cyclictest1400-21fschecks_time23:31:131
219499570,6rtkit-daemon0-21swapper/323:22:112
219499570,5rtkit-daemon2193-21rtkit-daemon23:41:181
9492564,44sleep20-21swapper/219:31:232
67002564,45sleep06804-21timerandwakeup19:41:370
3137399564,46cyclictest0-21swapper/320:50:013
31373995638,12cyclictest22038-21netstat19:06:333
31373995631,18cyclictest0-21swapper/322:56:293
3137399563,45cyclictest17068-21munin-run20:56:003
3137399563,29cyclictest0-21swapper/318:41:403
3137299565,34cyclictest0-21swapper/221:46:102
3137299564,46cyclictest0-21swapper/222:53:272
31371995634,15cyclictest0-21swapper/120:28:061
3136999565,43cyclictest0-21swapper/023:00:560
31369995630,18cyclictest8443-21cstates23:41:090
31369995622,27cyclictest0-21swapper/019:11:360
219499560,5rtkit-daemon2193-21rtkit-daemon21:51:141
120282563,8sleep012115-21df23:46:080
33732552,46sleep10-21swapper/122:49:571
3137399554,44cyclictest0-21swapper/321:13:233
3137399554,43cyclictest0-21swapper/322:36:093
3137399554,43cyclictest0-21swapper/322:36:093
3137399554,43cyclictest0-21swapper/322:26:403
3137399554,32cyclictest0-21swapper/323:48:393
3137299555,42cyclictest0-21swapper/223:01:242
31372995537,11cyclictest7693-21grep20:41:302
3137199554,32cyclictest0-21swapper/120:23:331
31371995521,26cyclictest13893-21cpu20:51:131
3136999554,44cyclictest0-21swapper/021:01:380
31369995510,24cyclictest0-21swapper/023:20:560
31369995510,24cyclictest0-21swapper/023:20:560
219499550,4rtkit-daemon2848-21ssh21:20:460
219499550,4rtkit-daemon2848-21ssh21:20:460
135212553,9sleep00-21swapper/022:18:510
3137399544,44cyclictest0-21swapper/321:17:273
3137399544,44cyclictest0-21swapper/321:17:273
3137399544,43cyclictest0-21swapper/319:56:123
3137399544,43cyclictest0-21swapper/319:56:123
3137399544,43cyclictest0-21swapper/318:31:073
3137399544,42cyclictest0-21swapper/320:26:273
31373995432,16cyclictest0-21swapper/318:31:413
31373995432,16cyclictest0-21swapper/318:31:413
3137299544,31cyclictest0-21swapper/221:01:372
3137299544,29cyclictest15823-21kernelversion20:01:272
31372995416,19cyclictest26004-21open_inodes21:06:302
31372995410,26cyclictest0-21swapper/223:36:092
3137199545,28cyclictest0-21swapper/122:01:381
31371995426,13cyclictest0-21swapper/122:14:141
3136999545,30cyclictest0-21swapper/022:31:320
31369995411,25cyclictest0-21swapper/023:11:550
219499540,7rtkit-daemon2193-21rtkit-daemon21:29:451
219499540,4rtkit-daemon2193-21rtkit-daemon20:39:171
219499540,4rtkit-daemon2193-21rtkit-daemon20:39:171
145422543,7sleep014630-21latency_hist20:01:040
145422543,7sleep014630-21latency_hist20:01:040
131582543,44sleep20-21swapper/222:17:452
81192534,12sleep00-21swapper/019:46:200
3137399535,32cyclictest0-21swapper/318:46:253
3137399533,42cyclictest0-21swapper/320:17:113
3137399533,36cyclictest0-21swapper/319:16:053
3137299534,26cyclictest0-21swapper/218:46:262
3137299534,13cyclictest0-21swapper/220:38:292
3137299534,13cyclictest0-21swapper/220:38:292
31372995323,13cyclictest0-21swapper/220:26:162
31372995312,25cyclictest0-21swapper/221:16:092
31372995312,25cyclictest0-21swapper/221:16:092
3137199534,36cyclictest0-21swapper/122:56:291
3137199534,31cyclictest0-21swapper/122:06:251
31371995335,11cyclictest30034-21unixbench_multi21:11:341
31371995322,14cyclictest0-21swapper/120:11:251
3136999535,13cyclictest0-21swapper/021:56:190
3136999535,13cyclictest0-21swapper/021:56:190
3136999534,44cyclictest0-21swapper/022:46:250
31369995334,13cyclictest0-21swapper/021:21:120
31369995331,15cyclictest0-21swapper/021:13:010
3136999533,24cyclictest0-21swapper/022:38:020
3136999533,24cyclictest0-21swapper/022:38:020
298752533,42sleep00-21swapper/019:23:030
268232532,7sleep11124-21snmpd21:07:321
219499530,6rtkit-daemon0-21swapper/218:21:383
219499530,5rtkit-daemon2193-21rtkit-daemon19:06:361
205162533,10sleep00-21swapper/020:11:280
170102532,43sleep10-21swapper/120:06:051
35432522,44sleep10-21swapper/118:27:211
31373995234,11cyclictest13697-21aten_r1power_en18:51:183
31373995227,18cyclictest26218-21fschecks_count19:16:283
31373995227,18cyclictest26218-21fschecks_count19:16:283
3137299528,27cyclictest0-21swapper/223:14:182
3137299525,13cyclictest0-21swapper/223:42:302
3137299524,41cyclictest0-21swapper/222:47:152
3137299524,19cyclictest0-21swapper/220:46:362
3137299523,41cyclictest0-21swapper/223:31:282
31372995223,9cyclictest3470-21ssh21:21:132
31372995221,13cyclictest0-21swapper/222:36:322
31372995221,13cyclictest0-21swapper/222:36:322
31372995211,34cyclictest0-21swapper/223:46:162
3137199524,40cyclictest0-21swapper/122:19:291
31371995237,8cyclictest0-21swapper/120:31:291
31371995233,13cyclictest0-21swapper/121:01:251
31371995232,13cyclictest0-21swapper/123:06:101
3136999529,25cyclictest0-21swapper/023:04:400
3136999525,29cyclictest0-21swapper/019:36:370
3136999525,28cyclictest0-21swapper/018:56:190
31369995237,9cyclictest25512-21sed21:06:220
3136999523,43cyclictest0-21swapper/020:31:320
225282522,43sleep10-21swapper/120:16:201
3137399514,40cyclictest0-21swapper/319:34:453
3137399514,40cyclictest0-21swapper/319:01:363
31373995132,12cyclictest16498-21grep20:01:383
3137399513,42cyclictest0-21swapper/318:59:053
3137299514,28cyclictest0-21swapper/219:01:222
3137299514,12cyclictest0-21swapper/222:57:042
3137199514,40cyclictest0-21swapper/123:48:231
3137199513,35cyclictest0-21swapper/123:11:281
3136999516,24cyclictest0-21swapper/020:56:140
3136999515,27cyclictest0-21swapper/022:24:040
3136999514,40cyclictest0-21swapper/022:51:170
3136999514,28cyclictest0-21swapper/022:06:170
31369995124,12cyclictest0-21swapper/020:53:570
312632514,6sleep00-21swapper/018:20:110
300302512,43sleep10-21swapper/119:25:051
31373995033,10cyclictest10810-21grep19:51:223
3137299504,37cyclictest0-21swapper/222:26:052
3137299504,28cyclictest0-21swapper/219:56:232
3137299504,28cyclictest0-21swapper/219:56:232
3137299504,28cyclictest0-21swapper/218:51:222
3137299504,27cyclictest0-21swapper/220:16:332
3137299504,27cyclictest0-21swapper/219:41:412
3137299504,27cyclictest0-21swapper/219:16:052
3137299504,13cyclictest0-21swapper/221:35:302
3137299504,13cyclictest0-21swapper/220:06:292
31372995020,13cyclictest0-21swapper/218:31:292
31372995020,13cyclictest0-21swapper/218:31:292
3137199504,33cyclictest0-21swapper/121:48:231
3137199504,28cyclictest0-21swapper/123:01:291
3137199504,28cyclictest0-21swapper/120:56:291
31371995034,10cyclictest26533-21latency22:36:221
31371995034,10cyclictest26533-21latency22:36:221
31371995029,14cyclictest0-21swapper/122:45:501
3136999505,27cyclictest0-21swapper/018:41:240
3136999504,27cyclictest0-21swapper/020:26:050
31369995032,11cyclictest15470-21grep20:01:210
3137299494,28cyclictest0-21swapper/218:56:212
3137299494,28cyclictest0-21swapper/218:41:282
31372994920,12cyclictest0-21swapper/219:51:212
3137299492,41cyclictest0-21swapper/219:47:452
31372994910,22cyclictest0-21swapper/218:21:252
3137199495,37cyclictest0-21swapper/121:26:001
3137199495,24cyclictest0-21swapper/121:36:451
3137199495,10cyclictest7150irq/45-ahci23:16:331
3137199495,10cyclictest7150irq/45-ahci23:16:331
3137199494,28cyclictest0-21swapper/121:56:171
3137199494,28cyclictest0-21swapper/121:56:171
3137199494,27cyclictest0-21swapper/119:46:151
3137199493,24cyclictest21757-21munin-node22:31:271
31371994925,9cyclictest14551-21cut22:21:091
3136999494,27cyclictest0-21swapper/019:51:200
3136999494,27cyclictest0-21swapper/019:06:340
219499490,5rtkit-daemon2193-21rtkit-daemon22:26:581
9972482,9sleep10-21swapper/118:22:091
324722483,39sleep00-21swapper/019:30:450
3137399484,27cyclictest0-21swapper/318:21:073
31373994829,14cyclictest0-21swapper/319:46:173
3137299484,27cyclictest0-21swapper/218:26:262
31372994818,12cyclictest0-21swapper/218:21:072
3137199485,25cyclictest30032-21diskstats23:26:121
3137199484,26cyclictest0-21swapper/119:11:321
3137199484,26cyclictest0-21swapper/118:36:081
3137199484,26cyclictest0-21swapper/118:36:081
31371994826,8cyclictest107550irq/46-eth022:51:241
31371994823,12cyclictest0-21swapper/121:42:091
31369994820,11cyclictest0-21swapper/018:51:370
267712482,9sleep10-21swapper/123:21:181
238802483,39sleep00-21swapper/020:18:090
147502482,9sleep10-21swapper/118:51:321
48962472,39sleep10-21swapper/119:39:491
3137399472,38cyclictest30783-21df_abs19:26:203
3137299474,24cyclictest0-21swapper/219:21:172
3137199474,26cyclictest15669-21yum-updatesd-he20:01:371
3137199474,26cyclictest0-21swapper/119:51:251
3136999473,37cyclictest0-21swapper/018:21:190
3137299464,33cyclictest0-21swapper/218:36:192
3137299464,26cyclictest0-21swapper/219:36:152
313062463,6sleep10-21swapper/118:20:441
276972462,9sleep10-21swapper/119:20:461
276972462,9sleep10-21swapper/119:20:461
144582462,38sleep10-21swapper/120:00:001
144582462,38sleep10-21swapper/120:00:001
31371994522,7cyclictest7482-21cat19:46:041
191482453,9sleep00-21swapper/020:08:540
3137199444,13cyclictest0-21swapper/119:31:051
3136999444,32cyclictest0-21swapper/019:34:340
3137199434,25cyclictest0-21swapper/119:31:341
3137199433,33cyclictest0-21swapper/118:56:271
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional