You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-17 - 08:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Jun 17, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991340,5rtkit-daemon2193-21rtkit-daemon23:17:342
17012991093,55cyclictest0-21swapper/021:52:180
17012991044,50cyclictest0-21swapper/021:42:170
17012991034,55cyclictest0-21swapper/021:47:210
17012991033,56cyclictest0-21swapper/021:17:380
170129910324,10cyclictest21070-21cut21:07:230
2194991020,5rtkit-daemon0-21swapper/123:28:562
17012991024,56cyclictest0-21swapper/000:17:220
17012991023,56cyclictest0-21swapper/023:57:150
17012991014,56cyclictest0-21swapper/023:40:490
17012991014,56cyclictest0-21swapper/023:40:490
17012991004,55cyclictest0-21swapper/023:42:210
17012991004,55cyclictest0-21swapper/023:42:210
17017999831,12cyclictest0-21swapper/221:29:162
17017999731,13cyclictest0-21swapper/222:50:372
1701899954,16cyclictest10090-21fschecks_count00:02:153
219499940,5rtkit-daemon2193-21rtkit-daemon23:27:261
1701899933,68cyclictest0-21swapper/322:33:573
17017999331,14cyclictest0-21swapper/222:08:002
17018999220,49cyclictest31681ssh23:52:123
17017999123,25cyclictest0-21swapper/222:34:022
17017999118,16cyclictest0-21swapper/223:52:102
1701799904,38cyclictest0-21swapper/219:28:562
1701799904,38cyclictest0-21swapper/219:28:562
17017998934,9cyclictest9753-21diskmemload21:57:322
1701899883,7cyclictest107550irq/46-eth022:52:283
1701899883,67cyclictest0-21swapper/323:35:543
17018998814,55cyclictest20963-21fschecks_count21:07:223
1701899873,15cyclictest0-21swapper/300:17:273
1701899865,61cyclictest0-21swapper/321:15:513
1701899864,63cyclictest0-21swapper/322:01:343
1701899863,19cyclictest0-21swapper/323:42:223
1701899863,19cyclictest0-21swapper/323:42:223
17018998616,9cyclictest1002-21sshd22:30:343
1701899859,12cyclictest0-21swapper/300:07:253
1701899853,68cyclictest0-21swapper/322:15:533
17018998517,45cyclictest107550irq/46-eth022:23:073
1701899844,72cyclictest1124-21snmpd20:31:353
17017998418,14cyclictest0-21swapper/222:52:222
17017998415,15cyclictest0-21swapper/223:02:292
1701899834,60cyclictest0-21swapper/322:02:233
1701899834,15cyclictest0-21swapper/323:41:083
1701899834,15cyclictest0-21swapper/323:41:083
1701899833,63cyclictest0-21swapper/321:36:223
1701899833,63cyclictest0-21swapper/321:36:223
17018998310,9cyclictest107550irq/46-eth023:27:253
17018998310,8cyclictest107550irq/46-eth023:57:183
89812820,4sleep01701299cyclictest23:12:190
1701899823,63cyclictest0-21swapper/321:20:093
1701899823,62cyclictest0-21swapper/323:07:313
1701899823,21cyclictest0-21swapper/322:37:133
1701899823,21cyclictest0-21swapper/300:16:213
1701899823,20cyclictest0-21swapper/321:23:093
17018998217,10cyclictest175681ssh21:02:223
17018998215,8cyclictest0-21swapper/321:31:103
1701899816,58cyclictest835-21awk23:01:593
1701899816,58cyclictest835-21awk23:01:593
1701899814,68cyclictest11994-21aten_r1power_po21:42:143
1701899814,58cyclictest0-21swapper/323:26:503
17017998132,12cyclictest0-21swapper/221:06:432
1701899804,21cyclictest21192-21sed22:42:253
1701899804,12cyclictest0-21swapper/322:19:003
1701899804,12cyclictest0-21swapper/322:19:003
1701899803,69cyclictest0-21swapper/321:47:243
1701899803,61cyclictest0-21swapper/322:47:123
17018998021,52cyclictest19502-21gltestperf21:52:193
17018998018,56cyclictest21326-21unixbench_multi18:57:413
17018998015,48cyclictest0-21swapper/320:52:043
17018998012,8cyclictest29879-21kworker/3:023:02:123
219499790,28rtkit-daemon2193-21rtkit-daemon20:54:322
219499790,28rtkit-daemon2193-21rtkit-daemon20:54:322
1701899794,68cyclictest0-21swapper/320:53:243
1701899794,68cyclictest0-21swapper/320:53:243
1701899793,69cyclictest22005-21munin-node19:02:263
1701899793,15cyclictest0-21swapper/321:37:293
1701899786,12cyclictest0-21swapper/320:58:123
1701899785,57cyclictest0-21swapper/319:17:193
1701899784,13cyclictest0-21swapper/319:42:263
17018997820,41cyclictest107550irq/46-eth022:07:293
17018997815,7cyclictest9814-21ssh23:12:323
17018997810,9cyclictest31714-21telnet23:47:113
17018997711,8cyclictest107550irq/46-eth023:17:173
1701899763,65cyclictest0-21swapper/320:32:383
17018997622,47cyclictest12060-21gltestperf19:47:283
17018997618,9cyclictest4723-21runrttasks20:39:033
17018997618,51cyclictest0-21swapper/319:32:253
17018997618,51cyclictest0-21swapper/319:32:253
1701899754,64cyclictest333-21ntp_kernel_err19:22:333
1701899754,13cyclictest0-21swapper/318:57:093
17018997523,45cyclictest18882-21df_abs20:02:213
1701899747,12cyclictest0-21swapper/320:47:043
17018997422,45cyclictest25841-21cpuspeed_turbos20:17:193
17018997319,47cyclictest1227-21runrttasks20:07:233
17018997313,8cyclictest7909-21switchtime19:37:383
1701899724,59cyclictest0-21swapper/320:22:343
17018997221,45cyclictest24690-21cpuspeed_turbos19:07:233
17018997219,46cyclictest13759-21aten_r1power_vo19:52:203
17018997215,50cyclictest0-21swapper/319:12:223
17018997118,47cyclictest16758-21fschecks_time19:57:243
17018997113,8cyclictest0-21swapper/319:27:213
17018997113,8cyclictest0-21swapper/319:27:213
219499700,5rtkit-daemon2193-21rtkit-daemon20:57:252
17017996943,11cyclictest0-21swapper/200:17:282
17017996935,19cyclictest0-21swapper/222:59:402
17017996935,19cyclictest0-21swapper/222:59:402
219499680,5rtkit-daemon2193-21rtkit-daemon20:19:042
219499680,20rtkit-daemon2193-21rtkit-daemon00:02:322
1701899686,12cyclictest0-21swapper/320:17:063
1701899686,12cyclictest0-21swapper/320:17:063
17017996842,11cyclictest0-21swapper/222:31:072
219499670,5rtkit-daemon2193-21rtkit-daemon22:46:432
17017996740,12cyclictest0-21swapper/223:42:342
17017996740,12cyclictest0-21swapper/223:42:342
17017996740,12cyclictest0-21swapper/223:39:392
17017996740,12cyclictest0-21swapper/223:39:392
1701299674,55cyclictest0-21swapper/022:40:350
1701599669,28cyclictest0-21swapper/120:55:191
1701599669,28cyclictest0-21swapper/120:55:191
1701299664,55cyclictest0-21swapper/000:07:130
1701299654,54cyclictest0-21swapper/022:17:170
1701299654,54cyclictest0-21swapper/022:17:170
1701299653,53cyclictest0-21swapper/022:02:330
17017996433,11cyclictest0-21swapper/223:34:292
1701599644,53cyclictest0-21swapper/119:47:241
1701299643,55cyclictest0-21swapper/022:27:240
1701299643,55cyclictest0-21swapper/022:07:170
1701299643,53cyclictest0-21swapper/021:57:130
1701299643,53cyclictest0-21swapper/021:02:160
79162633,12sleep10-21swapper/122:22:301
243702633,52sleep10-21swapper/121:59:201
1701899634,13cyclictest0-21swapper/318:52:093
1701899634,13cyclictest0-21swapper/318:52:093
17017996339,9cyclictest23922-21aten_r1power_fr21:12:152
17017996336,11cyclictest16778-21taskset21:47:352
1701599636,50cyclictest29325-21irqstats23:42:221
1701599636,50cyclictest29325-21irqstats23:42:221
1701599635,51cyclictest0-21swapper/121:07:221
1701299633,53cyclictest0-21swapper/023:31:060
1701299633,52cyclictest0-21swapper/023:35:300
1701299633,52cyclictest0-21swapper/023:01:070
1701299633,52cyclictest0-21swapper/023:01:070
33112628,7sleep20-21swapper/220:37:222
17017996233,14cyclictest0-21swapper/221:22:272
1701599625,38cyclictest0-21swapper/122:48:361
1701599624,52cyclictest0-21swapper/122:06:091
1701599624,51cyclictest0-21swapper/122:55:101
1701599624,51cyclictest0-21swapper/100:06:511
1701299623,52cyclictest0-21swapper/023:02:310
1701299623,51cyclictest0-21swapper/022:32:200
17017996133,13cyclictest0-21swapper/221:38:062
17017996132,14cyclictest0-21swapper/222:22:462
17017996132,12cyclictest0-21swapper/200:12:302
1701599615,49cyclictest14141-21munin-node00:07:231
1701599614,50cyclictest0-21swapper/119:07:071
17012996131,13cyclictest0-21swapper/023:52:270
17012996131,11cyclictest28610-21grep22:52:330
1701299613,52cyclictest0-21swapper/019:32:270
1701299613,52cyclictest0-21swapper/019:32:270
1701299613,52cyclictest0-21swapper/000:14:180
1701299613,51cyclictest0-21swapper/021:27:140
1701299612,52cyclictest16537-21crond21:02:040
219499600,4rtkit-daemon2193-21rtkit-daemon19:53:352
1701799605,28cyclictest0-21swapper/222:03:132
17017996034,13cyclictest0-21swapper/223:57:212
17017996018,25cyclictest0-21swapper/222:16:392
1701599606,48cyclictest1227-21runrttasks21:33:141
1701599606,48cyclictest1227-21runrttasks21:33:141
1701599606,31cyclictest0-21swapper/121:39:181
1701599605,47cyclictest14139-21perl20:57:241
1701599604,50cyclictest0-21swapper/122:43:531
1701599604,13cyclictest0-21swapper/122:37:341
1701299604,49cyclictest24678-21head21:12:230
1701299604,48cyclictest0-21swapper/021:37:200
17017995933,9cyclictest17900-21ssh23:26:582
17017995933,11cyclictest0-21swapper/222:37:132
17017995931,13cyclictest0-21swapper/222:19:162
17017995931,13cyclictest0-21swapper/222:19:162
17017995930,14cyclictest0-21swapper/223:12:122
1701599596,46cyclictest0-21swapper/122:20:431
1701599596,46cyclictest0-21swapper/122:20:431
1701599595,31cyclictest0-21swapper/123:39:311
1701599595,31cyclictest0-21swapper/123:39:311
1701599595,30cyclictest0-21swapper/120:12:291
1701599595,30cyclictest0-21swapper/120:12:291
1701599594,48cyclictest9753-21diskmemload22:07:371
1701599594,47cyclictest0-21swapper/119:22:081
219499580,4rtkit-daemon2193-21rtkit-daemon19:17:512
17017995831,11cyclictest0-21swapper/200:07:032
17017995830,12cyclictest0-21swapper/221:07:212
1701599587,27cyclictest0-21swapper/120:47:151
1701599586,28cyclictest0-21swapper/122:15:471
1701599585,47cyclictest0-21swapper/123:13:241
1701599585,29cyclictest0-21swapper/118:57:241
1701599585,14cyclictest0-21swapper/123:47:151
1701599585,11cyclictest7741-21crond23:11:591
17015995823,12cyclictest0-21swapper/121:47:161
1701299584,25cyclictest0-21swapper/022:27:010
1701299583,48cyclictest1227-21runrttasks21:32:260
1701299583,48cyclictest1227-21runrttasks21:32:260
1701299583,48cyclictest0-21swapper/020:22:390
1701299582,49cyclictest0-21swapper/021:22:280
60922573,9sleep20-21swapper/219:35:512
60922573,9sleep20-21swapper/219:35:512
27042572,49sleep00-21swapper/022:16:120
219499570,6rtkit-daemon2193-21rtkit-daemon19:22:282
17017995732,9cyclictest17989-21uniq18:52:282
17017995732,11cyclictest0-21swapper/223:07:062
17017995731,12cyclictest0-21swapper/219:47:322
17017995730,12cyclictest0-21swapper/223:47:012
1701599576,9cyclictest18-21rcuc/121:17:381
1701599576,28cyclictest0-21swapper/100:00:551
1701599575,46cyclictest1227-21runrttasks00:16:381
1701599575,45cyclictest0-21swapper/100:18:341
1701599574,13cyclictest0-21swapper/121:54:271
1701599573,11cyclictest0-21swapper/123:52:291
1701599573,10cyclictest0-21swapper/121:27:341
17012995734,10cyclictest0-21swapper/023:11:160
17012995731,8cyclictest11611-21ssh00:03:290
1701299573,48cyclictest0-21swapper/019:22:080
1701299572,49cyclictest0-21swapper/022:47:200
1701799565,28cyclictest0-21swapper/221:19:572
17017995631,12cyclictest0-21swapper/221:45:162
1701799563,37cyclictest0-21swapper/220:02:272
1701599564,46cyclictest2424-21load23:02:231
1701599564,46cyclictest0-21swapper/120:12:061
1701599564,46cyclictest0-21swapper/119:27:211
1701599564,46cyclictest0-21swapper/119:27:211
1701599564,13cyclictest0-21swapper/121:02:181
1701299563,46cyclictest0-21swapper/023:22:170
219499550,5rtkit-daemon2193-21rtkit-daemon20:42:252
219499550,5rtkit-daemon2193-21rtkit-daemon18:47:222
219499550,5rtkit-daemon2193-21rtkit-daemon18:47:222
1701799555,41cyclictest0-21swapper/220:47:362
17017995522,14cyclictest0-21swapper/221:32:332
17017995522,14cyclictest0-21swapper/221:32:332
17017995522,13cyclictest0-21swapper/219:57:342
1701599554,44cyclictest0-21swapper/122:57:111
1701599554,44cyclictest0-21swapper/122:57:111
1701599554,30cyclictest0-21swapper/121:42:251
1701299554,45cyclictest0-21swapper/020:52:320
1701299554,45cyclictest0-21swapper/020:52:320
17012995539,10cyclictest1857-21cpuspeed_turbos19:27:220
17012995539,10cyclictest1857-21cpuspeed_turbos19:27:220
1701299553,46cyclictest0-21swapper/023:47:210
1701299553,46cyclictest0-21swapper/020:42:130
1701299553,46cyclictest0-21swapper/019:03:510
1701799545,29cyclictest0-21swapper/219:12:362
1701799545,26cyclictest0-21swapper/220:09:042
1701799544,29cyclictest0-21swapper/220:32:202
17017995421,14cyclictest0-21swapper/219:42:382
17017995420,15cyclictest0-21swapper/221:53:012
1701599546,25cyclictest0-21swapper/121:27:021
1701599545,29cyclictest0-21swapper/121:17:031
1701599544,13cyclictest0-21swapper/122:32:211
1701599543,12cyclictest0-21swapper/123:32:091
1701299545,45cyclictest0-21swapper/019:23:390
1701299545,44cyclictest0-21swapper/022:45:010
1701299545,44cyclictest0-21swapper/020:47:290
17012995435,7cyclictest21776-21latency_hist19:02:090
1701299543,46cyclictest0-21swapper/023:18:220
1701299543,45cyclictest0-21swapper/019:52:330
1701799534,29cyclictest0-21swapper/220:12:272
1701799534,29cyclictest0-21swapper/220:12:272
1701799534,27cyclictest0-21swapper/219:07:212
17017995336,10cyclictest30630-21grep20:27:182
17017995324,10cyclictest8580-21turbostat.cron19:42:072
17017995323,12cyclictest0-21swapper/219:07:082
17017995318,15cyclictest0-21swapper/218:57:292
1701599535,29cyclictest0-21swapper/123:17:191
1701599534,29cyclictest0-21swapper/123:24:271
1701599533,9cyclictest32383-21yum-updatesd-he20:31:121
1701599533,11cyclictest0-21swapper/122:29:271
1701299533,44cyclictest0-21swapper/020:17:230
1701299533,44cyclictest0-21swapper/020:02:180
17012995327,8cyclictest4962-21latency_hist20:42:040
1701799524,29cyclictest0-21swapper/220:22:192
17015995221,12cyclictest0-21swapper/120:02:391
1701299522,44cyclictest0-21swapper/019:47:320
1701599513,10cyclictest0-21swapper/119:52:171
17015995120,13cyclictest0-21swapper/120:17:361
17015995119,13cyclictest0-21swapper/118:53:501
1701299513,43cyclictest0-21swapper/020:07:160
1701599506,25cyclictest0-21swapper/119:13:531
1701299503,41cyclictest8084-21unixbench-2d19:37:400
168482504,6sleep00-21swapper/018:50:270
168482504,6sleep00-21swapper/018:50:270
1701599495,25cyclictest29250-21proc_pri20:22:351
1701599494,27cyclictest0-21swapper/119:22:271
1701599494,27cyclictest0-21swapper/119:07:221
1701599493,11cyclictest0-21swapper/119:57:381
17015994919,9cyclictest7539-21cat20:47:051
1701299493,42cyclictest0-21swapper/019:10:380
17012994925,11cyclictest0-21swapper/019:57:170
1701599485,37cyclictest0-21swapper/120:32:191
17015994817,11cyclictest0-21swapper/119:42:291
1701299483,40cyclictest0-21swapper/020:29:120
1701299483,39cyclictest0-21swapper/019:17:070
1701299482,42cyclictest0-21swapper/020:37:050
1701299482,42cyclictest0-21swapper/019:42:400
46372463,36sleep10-21swapper/120:37:571
1701599463,25cyclictest0-21swapper/119:37:081
1701599463,25cyclictest0-21swapper/119:37:081
1701299463,27cyclictest0-21swapper/018:52:100
17012994618,13cyclictest0-21swapper/020:12:220
17012994618,13cyclictest0-21swapper/020:12:220
1701599455,23cyclictest6453-21aten2.4-expect19:37:181
17015994110,14cyclictest0-21swapper/118:52:091
17015994110,14cyclictest0-21swapper/118:52:091
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional