You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-22 - 12:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Sun Mar 22, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
24680991058,27cyclictest0-21swapper/122:52:101
24680991058,27cyclictest0-21swapper/122:52:101
24680991034,35cyclictest23162-21chrt19:43:141
2485991010,7rtkit-daemon0-21swapper/219:55:382
2485991000,5rtkit-daemon0-21swapper/219:57:382
248599990,6rtkit-daemon0-21swapper/218:07:122
248599990,6rtkit-daemon0-21swapper/218:00:422
248599990,5rtkit-daemon0-21swapper/217:44:432
248599980,6rtkit-daemon0-21swapper/219:19:392
248599980,6rtkit-daemon0-21swapper/219:12:472
248599980,6rtkit-daemon0-21swapper/218:49:032
248599980,6rtkit-daemon0-21swapper/218:49:032
248599980,6rtkit-daemon0-21swapper/218:04:422
248599980,6rtkit-daemon0-21swapper/218:04:422
248599980,5rtkit-daemon0-21swapper/220:35:512
248599980,5rtkit-daemon0-21swapper/219:50:152
248599980,5rtkit-daemon0-21swapper/217:39:362
248599970,6rtkit-daemon0-21swapper/218:18:122
248599970,6rtkit-daemon0-21swapper/218:13:122
248599970,6rtkit-daemon0-21swapper/217:52:502
248599970,6rtkit-daemon0-21swapper/217:48:132
248599970,5rtkit-daemon0-21swapper/220:59:352
248599970,5rtkit-daemon0-21swapper/220:27:512
248599970,5rtkit-daemon0-21swapper/220:02:522
248599960,6rtkit-daemon0-21swapper/221:02:052
248599960,5rtkit-daemon0-21swapper/220:55:352
248599960,5rtkit-daemon0-21swapper/220:55:352
248599960,5rtkit-daemon0-21swapper/220:38:212
248599950,5rtkit-daemon0-21swapper/219:47:012
2468299904,79cyclictest27114-21ssh19:50:043
2468299904,23cyclictest0-21swapper/321:20:253
46582890,5sleep041ktimersoftd/022:27:250
248599890,4rtkit-daemon2484-21rtkit-daemon17:57:351
2468299894,28cyclictest0-21swapper/322:52:303
2468299894,28cyclictest0-21swapper/322:52:303
248599880,6rtkit-daemon0-21swapper/219:59:151
248599880,6rtkit-daemon0-21swapper/218:50:551
248599880,6rtkit-daemon0-21swapper/218:50:551
248599880,5rtkit-daemon0-21swapper/220:03:521
248599880,5rtkit-daemon0-21swapper/219:54:001
248599880,5rtkit-daemon0-21swapper/217:55:571
2468299884,28cyclictest0-21swapper/321:12:023
2468299884,14cyclictest0-21swapper/319:57:313
248599870,6rtkit-daemon0-21swapper/218:06:571
248599870,6rtkit-daemon0-21swapper/218:06:571
248599870,6rtkit-daemon0-21swapper/217:40:131
248599870,5rtkit-daemon0-21swapper/220:36:141
248599870,5rtkit-daemon0-21swapper/220:31:291
24682998732,47cyclictest8681-21sort19:17:223
24682998722,12cyclictest0-21swapper/320:02:153
24679998731,47cyclictest0-21swapper/022:26:590
248599860,6rtkit-daemon0-21swapper/218:14:041
248599860,5rtkit-daemon0-21swapper/220:58:581
248599860,5rtkit-daemon0-21swapper/219:19:091
248599860,5rtkit-daemon0-21swapper/219:13:471
248599860,5rtkit-daemon0-21swapper/217:47:581
2468299864,34cyclictest0-21swapper/320:57:263
2468299864,33cyclictest0-21swapper/322:46:573
24682998626,53cyclictest0-21swapper/319:42:063
248599850,6rtkit-daemon0-21swapper/220:53:431
248599850,6rtkit-daemon0-21swapper/220:53:431
248599850,5rtkit-daemon0-21swapper/219:50:231
248599850,5rtkit-daemon0-21swapper/218:18:573
2468299854,74cyclictest0-21swapper/323:00:523
2468299854,25cyclictest0-21swapper/321:12:133
2468299854,23cyclictest0-21swapper/320:42:323
2468299853,22cyclictest0-21swapper/320:21:193
24682998529,49cyclictest31259-21cpuspeed_turbos21:32:133
24682998529,49cyclictest31259-21cpuspeed_turbos21:32:133
248599840,5rtkit-daemon0-21swapper/218:07:491
2468299845,32cyclictest0-21swapper/320:14:303
2468299844,30cyclictest0-21swapper/320:22:353
2468299844,14cyclictest0-21swapper/322:34:163
2468299844,12cyclictest0-21swapper/322:21:013
2468299844,12cyclictest0-21swapper/322:21:013
2468299843,32cyclictest0-21swapper/321:50:403
2468299843,10cyclictest14674-21sshd21:55:103
2468299837,11cyclictest32640-21cpuspeed_turbos22:22:123
2468299835,34cyclictest0-21swapper/321:45:303
2468299834,32cyclictest0-21swapper/318:22:263
2468299833,72cyclictest0-21swapper/320:37:163
2468299833,28cyclictest0-21swapper/320:27:163
2468299833,11cyclictest0-21swapper/320:07:163
24682998322,10cyclictest1419-21runrttasks20:52:273
24682998322,10cyclictest1419-21runrttasks20:52:273
24679998330,46cyclictest0-21swapper/022:32:090
2468299824,21cyclictest0-21swapper/320:36:193
2468299824,14cyclictest0-21swapper/322:37:203
2468299824,12cyclictest0-21swapper/319:45:113
24679998237,38cyclictest27299-21idleruntime-cro21:27:000
24679998232,43cyclictest0-21swapper/021:47:120
126272820,19sleep1201ktimersoftd/119:27:051
2468299814,70cyclictest0-21swapper/321:58:163
2468299814,27cyclictest0-21swapper/319:52:183
2468299814,24cyclictest0-21swapper/321:25:203
2468299814,13cyclictest0-21swapper/323:02:143
2468299814,13cyclictest0-21swapper/322:12:283
2468299814,12cyclictest0-21swapper/317:57:373
2468299813,21cyclictest0-21swapper/322:11:453
24682998124,10cyclictest2293-21cpuspeed_turbos21:37:133
24682998115,11cyclictest0-21swapper/322:06:313
24679998129,46cyclictest0-21swapper/022:01:430
24679998120,54cyclictest0-21swapper/019:57:140
2468299804,27cyclictest0-21swapper/321:28:063
2468299804,13cyclictest0-21swapper/319:27:253
2468299803,9cyclictest4351-21ls22:27:203
2468299803,35cyclictest1387-21cut19:02:243
24682998025,10cyclictest1305-21fschecks_time20:47:213
24679998036,27cyclictest32390-21grep17:52:230
24679998033,25cyclictest27531-21ssh23:02:130
24679998031,42cyclictest0-21swapper/022:47:220
24679998031,42cyclictest0-21swapper/019:52:270
24679998031,31cyclictest25322-21df17:37:240
24679998029,30cyclictest0-21swapper/018:42:300
24679998029,30cyclictest0-21swapper/018:42:300
24679998025,48cyclictest0-21swapper/021:18:160
24679998023,49cyclictest0-21swapper/021:12:220
266302790,4sleep229-21ksoftirqd/223:01:462
2468299794,31cyclictest0-21swapper/318:32:283
24682997922,8cyclictest17417-21diskmemload21:02:163
24679997933,40cyclictest12949-21tail21:52:180
24679997933,39cyclictest23958-21cpuspeed_turbos22:57:110
24679997932,40cyclictest1419-21runrttasks22:02:030
24679997928,31cyclictest0-21swapper/021:02:030
24679997925,47cyclictest0-21swapper/020:38:450
2468299784,25cyclictest0-21swapper/319:32:193
2468299784,22cyclictest0-21swapper/322:47:123
2468299784,14cyclictest0-21swapper/318:12:253
24682997825,10cyclictest25080-21sendmail_mailst18:42:363
24682997825,10cyclictest25080-21sendmail_mailst18:42:363
24682997813,12cyclictest0-21swapper/318:57:383
24679997837,34cyclictest2513-21udisks-daemon18:17:320
24679997833,37cyclictest1287-21snmpd18:47:370
24679997833,37cyclictest1287-21snmpd18:47:370
24679997830,40cyclictest0-21swapper/022:07:150
24679997829,33cyclictest0-21swapper/022:42:420
24679997828,33cyclictest0-21swapper/019:52:050
24679997826,45cyclictest0-21swapper/020:30:210
24679997825,34cyclictest0-21swapper/020:47:560
24679997822,49cyclictest0-21swapper/020:45:040
2468299773,31cyclictest0-21swapper/319:07:253
24679997733,37cyclictest11630-21tr21:02:230
24679997733,27cyclictest11372-21tail22:37:240
24679997733,11cyclictest17417-21diskmemload19:37:260
24679997731,40cyclictest0-21swapper/020:32:150
24679997731,39cyclictest5978-21diskstats21:42:160
24679997728,43cyclictest0-21swapper/021:27:210
24679997726,44cyclictest0-21swapper/022:17:120
24679997726,44cyclictest0-21swapper/022:17:120
24679997725,45cyclictest0-21swapper/020:23:340
2468299764,12cyclictest0-21swapper/318:07:293
2468299763,24cyclictest10470-21munin-node19:22:213
24679997634,27cyclictest4848-21grep20:52:220
24679997634,27cyclictest4848-21grep20:52:220
24679997627,42cyclictest0-21swapper/020:12:180
24679997626,43cyclictest0-21swapper/018:32:250
24679997625,44cyclictest0-21swapper/021:33:560
24679997625,44cyclictest0-21swapper/021:33:560
24679997619,21cyclictest0-21swapper/021:37:140
2468299753,12cyclictest0-21swapper/318:52:283
24682997526,9cyclictest26231-21proc_pri17:37:383
24682997520,10cyclictest30487-21head17:47:283
24682997515,15cyclictest0-21swapper/318:37:213
2468199753,64cyclictest26959-21munin-node23:02:242
24679997533,36cyclictest3058-21ssh20:02:170
24679997530,39cyclictest0-21swapper/021:08:090
24679997529,20cyclictest0-21swapper/017:42:250
2468299744,15cyclictest0-21swapper/318:02:463
2468299744,15cyclictest0-21swapper/318:02:463
24682997424,7cyclictest26290-21cpuspeed18:47:193
24682997424,7cyclictest26290-21cpuspeed18:47:193
24679997433,35cyclictest1419-21runrttasks18:27:210
24679997431,37cyclictest21963-21sed22:52:310
24679997431,37cyclictest21963-21sed22:52:310
24679997428,39cyclictest0-21swapper/019:42:150
24679997427,33cyclictest0-21swapper/020:17:490
24679997426,41cyclictest0-21swapper/022:12:230
129642740,3chrt12963-21ssh21:03:481
24679997324,42cyclictest0-21swapper/020:07:210
24679997323,35cyclictest0-21swapper/018:12:300
24682997224,8cyclictest18644-21crond18:32:073
24682997223,8cyclictest6162-21df_abs19:12:203
24679997228,37cyclictest0-21swapper/018:37:320
24679997224,41cyclictest0-21swapper/019:37:050
24682997124,11cyclictest0-21swapper/317:42:203
24679997031,32cyclictest4750-21python19:07:340
24679997025,18cyclictest10136-21chrt19:20:510
24679997018,35cyclictest0-21swapper/017:57:250
248599690,24rtkit-daemon0-21swapper/318:17:191
24682996925,8cyclictest32201-21aten_r1power_vo17:52:223
24679996932,30cyclictest30582-21crond18:57:070
24679996921,42cyclictest0-21swapper/018:07:210
24679996822,39cyclictest0-21swapper/019:27:310
24679996749,12cyclictest1494-21grep19:02:240
24679996726,25cyclictest502-21crond19:02:070
24679996718,42cyclictest0-21swapper/018:22:300
2468199664,11cyclictest14839-21fschecks_time21:07:192
24679996620,40cyclictest0-21swapper/018:02:270
24679996620,40cyclictest0-21swapper/018:02:270
24679996535,22cyclictest24663-21munin-run17:37:100
24679996525,34cyclictest0-21swapper/019:22:180
2468199645,40cyclictest0-21swapper/221:32:222
2468199645,40cyclictest0-21swapper/221:32:222
24679996420,28cyclictest0-21swapper/019:12:200
2468199635,14cyclictest0-21swapper/221:27:232
2468199634,13cyclictest0-21swapper/221:37:212
24679996333,24cyclictest1287-21snmpd17:47:500
2468199624,51cyclictest0-21swapper/222:27:262
24681996211,25cyclictest0-21swapper/219:37:272
24680996244,9cyclictest17323-21uptime21:57:341
198122623,52sleep20-21swapper/222:51:312
2468199615,33cyclictest0-21swapper/221:47:382
2468199615,13cyclictest0-21swapper/221:20:512
2468199614,49cyclictest0-21swapper/220:07:352
2468199614,29cyclictest0-21swapper/221:52:232
24680996141,13cyclictest0-21swapper/120:17:141
2468199608,27cyclictest0-21swapper/220:20:532
2468199605,28cyclictest0-21swapper/219:22:182
2468199605,28cyclictest0-21swapper/218:42:222
2468199605,28cyclictest0-21swapper/218:42:222
2468199604,29cyclictest0-21swapper/222:42:172
24681996023,15cyclictest0-21swapper/222:32:182
24681996020,15cyclictest0-21swapper/222:14:422
24681996020,15cyclictest0-21swapper/221:26:462
24681996020,14cyclictest0-21swapper/222:56:172
24681996020,14cyclictest0-21swapper/222:56:172
24681996020,14cyclictest0-21swapper/222:26:012
24680996041,12cyclictest0-21swapper/121:52:201
116332603,7sleep211636-21ssh20:14:082
2468199595,31cyclictest0-21swapper/222:02:232
2468199595,29cyclictest0-21swapper/222:17:152
2468199595,29cyclictest0-21swapper/222:17:152
2468199593,48cyclictest17654-21missed_timers18:27:332
24681995921,15cyclictest0-21swapper/220:24:312
24681995920,14cyclictest0-21swapper/221:46:302
248599580,6rtkit-daemon0-21swapper/021:28:421
2468199585,29cyclictest0-21swapper/220:48:402
2468199585,29cyclictest0-21swapper/220:42:292
2468199585,29cyclictest0-21swapper/218:52:192
2468199584,27cyclictest15802-21grep21:57:142
24681995821,13cyclictest0-21swapper/222:07:212
148022583,47sleep10-21swapper/122:42:271
2468199574,29cyclictest0-21swapper/219:27:182
2468199574,28cyclictest0-21swapper/218:32:352
2468099576,9cyclictest121850irq/46-eth022:27:291
24680995743,9cyclictest20415-21taskset21:16:271
24680995721,19cyclictest30027-21crond23:06:571
281582566,44sleep10-21swapper/122:15:131
2468199565,36cyclictest18796-21ntp_states21:12:262
2468199563,10cyclictest10574-21df_abs22:37:142
2468099555,15cyclictest0-21swapper/120:23:581
24680995540,10cyclictest0-21swapper/121:11:201
24680995540,10cyclictest0-21swapper/120:50:311
24681995410,25cyclictest0-21swapper/218:57:182
2468099545,29cyclictest0-21swapper/120:37:211
24680995440,8cyclictest10665-21df_abs22:37:141
2468099544,42cyclictest0-21swapper/117:42:321
24680995439,10cyclictest0-21swapper/122:23:061
24680995437,12cyclictest0-21swapper/121:51:031
24680995421,19cyclictest3448-21processes21:37:281
256142532,44sleep10-21swapper/118:44:421
256142532,44sleep10-21swapper/118:44:421
24680995338,10cyclictest0-21swapper/121:35:371
24680995338,10cyclictest0-21swapper/121:35:371
24680995338,10cyclictest0-21swapper/121:17:331
24680995337,12cyclictest0-21swapper/120:44:481
24680995337,11cyclictest0-21swapper/120:14:001
24680995337,10cyclictest0-21swapper/121:44:291
24680995322,12cyclictest0-21swapper/121:23:311
2468099525,14cyclictest0-21swapper/120:09:051
2468099524,31cyclictest0-21swapper/118:42:071
24680995238,9cyclictest0-21swapper/122:10:051
24680995238,10cyclictest0-21swapper/122:32:311
24680995232,12cyclictest0-21swapper/119:02:191
2468199514,26cyclictest0-21swapper/219:06:502
24681995133,11cyclictest3647-21grep19:07:172
24681995119,14cyclictest0-21swapper/219:32:372
2468099514,40cyclictest0-21swapper/122:17:111
2468099514,40cyclictest0-21swapper/122:17:111
2468099514,28cyclictest0-21swapper/119:37:451
216492512,42sleep10-21swapper/122:06:021
326542503,10sleep10-21swapper/118:58:041
2468199504,28cyclictest0-21swapper/218:37:252
2468199504,28cyclictest0-21swapper/217:37:102
2468099505,37cyclictest16974-21aten_r1power_po22:47:101
2468099504,26cyclictest0-21swapper/122:57:371
24680995029,13cyclictest0-21swapper/118:32:081
2468199495,13cyclictest0-21swapper/218:22:332
209652492,10sleep10-21swapper/118:36:191
2468099474,26cyclictest0-21swapper/119:07:261
24680994725,10cyclictest0-21swapper/118:52:191
154952472,9sleep10-21swapper/118:22:371
2468099464,13cyclictest0-21swapper/119:27:361
171802442,10sleep10-21swapper/119:34:081
248599360,4rtkit-daemon2484-21rtkit-daemon17:32:131
2468299324,7cyclictest24712-21cut17:37:103
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional