You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-05 - 01:54

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sun Jul 05, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
8263999937,7cyclictest818-21diskmemload22:35:162
173062870,7sleep041ktimersoftd/021:45:230
219499680,5rtkit-daemon2193-21rtkit-daemon22:12:582
261822676,53sleep00-21swapper/021:10:280
826399664,55cyclictest0-21swapper/223:12:472
826299665,53cyclictest0-21swapper/122:15:051
826299655,53cyclictest0-21swapper/122:07:151
219499650,4rtkit-daemon2193-21rtkit-daemon22:17:053
826299644,53cyclictest0-21swapper/120:46:381
826299643,54cyclictest0-21swapper/118:50:451
219499640,5rtkit-daemon2193-21rtkit-daemon23:41:173
826299634,52cyclictest0-21swapper/123:09:531
826299634,52cyclictest0-21swapper/121:14:531
826299634,52cyclictest0-21swapper/121:01:481
826299633,52cyclictest0-21swapper/121:55:261
71532638,10sleep20-21swapper/220:43:172
826399624,51cyclictest0-21swapper/221:10:062
826299625,51cyclictest0-21swapper/121:39:181
826299625,51cyclictest0-21swapper/121:39:181
826299625,50cyclictest0-21swapper/120:39:161
826299625,29cyclictest0-21swapper/119:15:121
826299624,51cyclictest0-21swapper/123:52:471
826299624,51cyclictest0-21swapper/122:54:371
826299624,51cyclictest0-21swapper/122:54:371
826299624,51cyclictest0-21swapper/122:17:061
826299624,50cyclictest13308-21unixbench-2d20:50:411
826299624,50cyclictest0-21swapper/121:40:371
826399615,48cyclictest0-21swapper/223:30:192
8263996138,8cyclictest818-21diskmemload21:20:202
8263996135,12cyclictest0-21swapper/222:59:042
826399613,50cyclictest8278-21grep21:30:402
826299616,49cyclictest0-21swapper/122:33:581
826299615,50cyclictest0-21swapper/120:58:521
826299615,50cyclictest0-21swapper/120:58:521
826299615,49cyclictest0-21swapper/123:47:561
826299615,49cyclictest0-21swapper/120:44:031
826299615,49cyclictest0-21swapper/100:04:151
826299615,49cyclictest0-21swapper/100:04:151
826299614,50cyclictest0-21swapper/121:49:111
43362610,3sleep041ktimersoftd/023:50:250
1840426110,43sleep118505-21df_abs18:55:291
1840426110,43sleep118505-21df_abs18:55:291
8263996029,19cyclictest0-21swapper/222:31:062
826299606,48cyclictest0-21swapper/121:33:581
8262996010,43cyclictest201ktimersoftd/123:00:221
826099604,48cyclictest0-21swapper/022:35:220
8260996028,19cyclictest0-21swapper/020:59:060
8260996028,19cyclictest0-21swapper/020:59:060
225582603,50sleep20-21swapper/222:41:012
206162607,11sleep20-21swapper/223:25:522
206162607,11sleep20-21swapper/223:25:522
8263995935,11cyclictest0-21swapper/222:15:262
826399593,49cyclictest0-21swapper/220:48:292
826299595,48cyclictest0-21swapper/122:41:341
826299595,48cyclictest0-21swapper/121:15:271
826299594,48cyclictest0-21swapper/123:40:371
826299594,48cyclictest0-21swapper/122:37:381
826099594,49cyclictest0-21swapper/022:59:470
8260995932,13cyclictest0-21swapper/021:00:270
302072593,48sleep00-21swapper/020:25:410
281392593,12sleep00-21swapper/023:38:400
826399584,47cyclictest0-21swapper/223:47:132
8263995836,10cyclictest0-21swapper/223:43:332
8263995822,23cyclictest107550irq/46-eth021:41:332
826299584,48cyclictest0-21swapper/121:53:571
826099584,48cyclictest0-21swapper/021:37:200
826099584,48cyclictest0-21swapper/021:37:200
8260995833,12cyclictest0-21swapper/023:46:270
8260995833,12cyclictest0-21swapper/020:47:420
233612583,13sleep00-21swapper/023:30:300
8263995735,9cyclictest18816-21cpuspeed_turbos21:00:212
826299576,44cyclictest26496-21chrt22:48:051
826299576,29cyclictest0-21swapper/121:25:291
826299574,47cyclictest0-21swapper/123:15:421
826099574,47cyclictest0-21swapper/022:10:410
826099574,46cyclictest0-21swapper/022:40:370
8260995732,12cyclictest0-21swapper/022:08:270
8260995731,13cyclictest0-21swapper/021:52:090
8260995731,12cyclictest0-21swapper/022:47:140
826099572,49cyclictest0-21swapper/022:33:250
286672573,48sleep30-21swapper/322:00:513
219499570,5rtkit-daemon2193-21rtkit-daemon23:15:033
826499564,40cyclictest0-21swapper/321:30:063
8263995635,9cyclictest0-21swapper/220:35:452
8263995635,8cyclictest20570-21diskstats21:50:212
8263995633,10cyclictest0-21swapper/223:18:142
826299566,27cyclictest0-21swapper/121:23:381
826299565,29cyclictest0-21swapper/123:11:331
826299565,27cyclictest0-21swapper/123:30:171
826299563,48cyclictest0-21swapper/122:55:271
826099565,45cyclictest0-21swapper/023:27:100
826099565,45cyclictest0-21swapper/023:27:100
8260995633,8cyclictest28887-21ssh21:15:190
8260995631,12cyclictest0-21swapper/020:43:150
8260995630,13cyclictest0-21swapper/023:21:170
58572562,48sleep00-21swapper/022:16:320
826499554,22cyclictest0-21swapper/322:32:483
8264995519,27cyclictest0-21swapper/323:32:043
826399554,36cyclictest0-21swapper/222:07:172
8263995535,7cyclictest26669-21ssh22:48:422
8263995535,7cyclictest1124-21snmpd21:27:192
8263995535,7cyclictest10475-21munin-node22:25:182
8263995534,8cyclictest6600-21munin-node23:55:382
8263995534,11cyclictest0-21swapper/220:52:122
8263995533,11cyclictest0-21swapper/221:12:122
826399553,44cyclictest0-21swapper/218:35:422
8263995511,38cyclictest0-21swapper/223:35:152
826299555,28cyclictest0-21swapper/123:38:381
826299555,28cyclictest0-21swapper/122:28:461
826299554,29cyclictest0-21swapper/123:27:241
826299554,29cyclictest0-21swapper/123:27:241
8262995521,11cyclictest0-21swapper/118:45:491
826099554,46cyclictest0-21swapper/021:21:520
8260995528,13cyclictest0-21swapper/022:24:020
826099552,45cyclictest19954-21tune2fs20:05:270
48022553,46sleep20-21swapper/223:04:402
219499550,5rtkit-daemon2193-21rtkit-daemon23:19:563
219499550,5rtkit-daemon2193-21rtkit-daemon22:20:203
219499550,5rtkit-daemon2193-21rtkit-daemon22:07:063
8264995420,25cyclictest6203-21if_eth023:05:243
8263995435,7cyclictest30001-21ssh22:53:332
8263995435,7cyclictest30001-21ssh22:53:332
8263995433,10cyclictest0-21swapper/223:53:042
8263995432,11cyclictest0-21swapper/222:02:432
8263995425,12cyclictest0-21swapper/218:40:382
8263995414,23cyclictest1761-21Xorg21:49:092
826299546,27cyclictest0-21swapper/119:16:211
826299545,27cyclictest0-21swapper/119:01:191
826299545,26cyclictest0-21swapper/123:59:471
826299544,43cyclictest8633-21aten2.4-expect18:35:241
826299544,43cyclictest16900-21head20:00:211
826299544,29cyclictest0-21swapper/122:24:111
826299544,27cyclictest0-21swapper/123:22:561
8262995421,11cyclictest0-21swapper/119:41:261
826099544,45cyclictest0-21swapper/022:28:490
826099543,45cyclictest0-21swapper/021:06:500
8260995429,12cyclictest0-21swapper/023:17:200
8260995429,12cyclictest0-21swapper/023:00:220
154132542,9sleep00-21swapper/019:55:340
826499535,38cyclictest0-21swapper/320:54:043
826499534,15cyclictest0-21swapper/322:58:113
826399534,42cyclictest0-21swapper/221:19:242
826399534,36cyclictest0-21swapper/222:20:222
826099534,43cyclictest0-21swapper/021:40:380
8260995332,10cyclictest0-21swapper/023:07:030
826099533,45cyclictest0-21swapper/022:51:350
826099533,45cyclictest0-21swapper/022:51:350
8260995326,11cyclictest0-21swapper/000:00:340
8260995326,11cyclictest0-21swapper/000:00:340
8260995325,12cyclictest0-21swapper/021:30:530
826099532,45cyclictest0-21swapper/020:39:190
48492532,10sleep00-21swapper/019:35:230
48492532,10sleep00-21swapper/019:35:230
221172533,7sleep122240-21cpuspeed_turbos21:05:211
200542532,45sleep00-21swapper/018:58:460
200542532,45sleep00-21swapper/018:58:460
90512522,43sleep00-21swapper/019:40:510
88162523,12sleep30-21swapper/321:32:203
8264995235,10cyclictest8113-21gltestperf19:40:303
826499523,41cyclictest0-21swapper/321:22:023
826399525,7cyclictest0-21swapper/220:56:552
826399525,7cyclictest0-21swapper/220:56:552
8263995230,10cyclictest0-21swapper/221:37:422
8263995230,10cyclictest0-21swapper/221:37:422
826399523,42cyclictest0-21swapper/223:10:042
8263995221,22cyclictest8602-21kworker/2:123:20:132
826299525,29cyclictest0-21swapper/119:36:251
826299525,29cyclictest0-21swapper/119:36:251
826299525,25cyclictest0-21swapper/122:04:491
826299523,12cyclictest0-21swapper/120:08:501
826099523,42cyclictest0-21swapper/021:55:080
76652522,43sleep00-21swapper/023:55:260
5222523,42sleep10-21swapper/120:31:351
826499516,36cyclictest10418-21df00:00:163
826499516,36cyclictest10418-21df00:00:163
826499514,39cyclictest0-21swapper/318:50:443
826499514,36cyclictest0-21swapper/320:39:233
826499514,28cyclictest0-21swapper/320:42:333
826499514,21cyclictest0-21swapper/321:40:593
8264995132,11cyclictest20882-21cpuspeed_turbos22:40:183
826499513,42cyclictest0-21swapper/320:47:393
826499513,29cyclictest12241-21unixbench_multi22:25:393
8264995125,15cyclictest23199-21netstat21:05:373
8264995123,9cyclictest1668-21df_inode22:10:203
8264995123,10cyclictest30007-21chrt21:15:343
826499512,42cyclictest0-21swapper/323:20:043
826399514,28cyclictest0-21swapper/219:20:112
8263995130,10cyclictest0-21swapper/220:26:332
8263995118,15cyclictest0-21swapper/221:55:312
826299519,23cyclictest23698-21runrttasks20:15:051
826299519,23cyclictest23698-21runrttasks20:15:051
826299516,39cyclictest0-21swapper/118:40:371
826099514,42cyclictest0-21swapper/023:44:460
826099514,39cyclictest0-21swapper/023:10:250
8260995129,10cyclictest0-21swapper/019:50:410
8260995125,13cyclictest0-21swapper/018:40:250
8260995114,31cyclictest26785-21aten_r1power_en22:00:160
308862513,41sleep130883-21latency_hist20:30:101
294882513,42sleep329599-21hddtemp_smartct20:25:283
223162512,9sleep00-21swapper/019:02:090
219499510,5rtkit-daemon2193-21rtkit-daemon23:45:173
219499510,5rtkit-daemon2193-21rtkit-daemon21:37:003
219499510,5rtkit-daemon2193-21rtkit-daemon21:37:003
219499510,4rtkit-daemon2193-21rtkit-daemon23:00:343
189602513,10sleep30-21swapper/321:47:243
826499506,28cyclictest0-21swapper/321:59:113
826499505,37cyclictest0-21swapper/320:55:313
826499505,37cyclictest0-21swapper/320:55:313
826499505,33cyclictest0-21swapper/319:10:403
826499504,40cyclictest0-21swapper/322:50:443
826499504,40cyclictest0-21swapper/322:50:443
826499504,40cyclictest0-21swapper/321:02:473
8264995030,12cyclictest24771-21gltestperf22:45:223
8264995030,12cyclictest19255-21aten_r1power_fr20:05:203
826399507,13cyclictest0-21swapper/218:45:292
826399503,29cyclictest0-21swapper/219:05:442
826299503,13cyclictest0-21swapper/119:58:531
826099505,40cyclictest0-21swapper/020:51:470
826099504,40cyclictest3095-21munin-node21:25:180
318662502,9sleep30-21swapper/319:22:113
219499500,5rtkit-daemon2193-21rtkit-daemon23:56:173
219499500,5rtkit-daemon2193-21rtkit-daemon22:35:273
152832502,9sleep20-21swapper/219:55:322
114322502,9sleep00-21swapper/019:45:470
92412492,9sleep20-21swapper/219:43:192
826499495,26cyclictest0-21swapper/323:53:453
826499495,12cyclictest27120-21users21:10:423
8264994933,9cyclictest3338-21gltestperf19:30:313
8264994930,12cyclictest19564-21sed23:25:233
8264994930,12cyclictest19564-21sed23:25:233
826499492,41cyclictest0-21swapper/321:50:123
826399493,41cyclictest0-21swapper/220:10:422
826399493,41cyclictest0-21swapper/220:10:422
826399493,24cyclictest0-21swapper/219:45:232
826299494,29cyclictest0-21swapper/119:30:421
826299494,12cyclictest0-21swapper/120:23:481
826299493,12cyclictest0-21swapper/119:09:171
826099493,41cyclictest0-21swapper/018:50:240
8260994928,10cyclictest0-21swapper/020:20:350
8260994923,14cyclictest0-21swapper/018:37:290
199142493,40sleep20-21swapper/220:05:282
18712492,40sleep30-21swapper/319:27:113
114722493,9sleep10-21swapper/119:46:161
8264994830,11cyclictest18257-21cat18:55:273
8264994830,11cyclictest18257-21cat18:55:273
8264994827,14cyclictest9940-21cpuspeed_turbos19:45:243
8264994827,14cyclictest26290-21gltestperf23:35:203
826399484,37cyclictest0-21swapper/219:35:302
826399484,37cyclictest0-21swapper/219:35:302
826399484,36cyclictest0-21swapper/200:00:202
826399484,36cyclictest0-21swapper/200:00:202
826399484,27cyclictest0-21swapper/219:00:352
8263994828,9cyclictest0-21swapper/219:14:562
8263994815,12cyclictest0-21swapper/218:50:302
8263994810,22cyclictest0-21swapper/218:55:352
8263994810,22cyclictest0-21swapper/218:55:352
826299484,23cyclictest0-21swapper/119:26:231
826299483,40cyclictest0-21swapper/119:50:411
826099484,36cyclictest0-21swapper/019:15:230
8260994821,22cyclictest0-21swapper/020:19:090
8260994821,22cyclictest0-21swapper/020:19:090
5702482,9sleep20-21swapper/220:32:122
222672482,9sleep30-21swapper/319:01:313
145412483,11sleep30-21swapper/319:55:253
132462483,9sleep00-21swapper/018:45:200
826499475,29cyclictest0-21swapper/320:35:093
8264994727,12cyclictest24292-21cpuspeed_turbos20:15:243
8264994727,12cyclictest24292-21cpuspeed_turbos20:15:243
8264994722,15cyclictest0-21swapper/319:05:293
8264994716,13cyclictest0-21swapper/319:50:223
826399474,38cyclictest0-21swapper/220:25:082
8263994732,9cyclictest12609-21cut19:50:272
826299472,40cyclictest0-21swapper/119:25:111
826099474,37cyclictest0-21swapper/020:10:330
826099474,37cyclictest0-21swapper/020:10:330
8260994722,20cyclictest0-21swapper/019:23:260
260092473,38sleep10-21swapper/120:19:051
260092473,38sleep10-21swapper/120:19:051
19212472,9sleep00-21swapper/019:27:490
826499464,27cyclictest0-21swapper/320:20:353
826499464,25cyclictest0-21swapper/318:48:003
826499464,21cyclictest0-21swapper/320:10:213
826499464,21cyclictest0-21swapper/320:10:213
826499464,21cyclictest0-21swapper/319:35:243
826499464,21cyclictest0-21swapper/319:35:243
8264994618,12cyclictest0-21swapper/318:41:163
8264994616,22cyclictest27748-21cpu19:15:253
826399463,25cyclictest0-21swapper/219:25:232
8263994621,8cyclictest2455-21munin-node19:30:242
8263994613,13cyclictest0-21swapper/220:05:092
826099465,9cyclictest8254-21cyclictest18:35:130
826099464,37cyclictest0-21swapper/020:05:100
8260994618,11cyclictest0-21swapper/019:10:410
188452462,9sleep30-21swapper/320:04:083
44462452,9sleep00-21swapper/019:33:090
826499444,29cyclictest0-21swapper/318:35:363
826499444,26cyclictest0-21swapper/318:35:133
826399443,36cyclictest0-21swapper/220:15:252
826399443,36cyclictest0-21swapper/220:15:252
8263994425,12cyclictest0-21swapper/219:20:242
826099444,35cyclictest0-21swapper/019:05:360
8260994429,10cyclictest31825-21tune2fs20:30:260
826299394,13cyclictest0-21swapper/118:35:131
826399373,21cyclictest0-21swapper/218:35:132
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional