You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-22 - 19:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Jun 22, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2204521090,18sleep02459999cyclictest07:47:170
24599991005,47cyclictest21296-21ssh12:02:040
2460399993,89cyclictest19601-21runrttasks11:58:471
2460399993,89cyclictest19601-21runrttasks11:58:471
2460399974,85cyclictest0-21swapper/110:47:031
2460399963,86cyclictest0-21swapper/109:57:031
2460399963,86cyclictest0-21swapper/109:57:031
2460399944,83cyclictest0-21swapper/110:32:391
2460399943,70cyclictest12409-21ssh09:26:161
2460399943,70cyclictest12409-21ssh09:26:161
2460399933,82cyclictest13040-21runrttasks10:13:111
2459999937,31cyclictest0-21swapper/010:13:270
2460399923,82cyclictest0-21swapper/111:15:401
2459999924,36cyclictest0-21swapper/010:57:170
24599999235,13cyclictest0-21swapper/011:22:180
2460399914,80cyclictest0-21swapper/111:37:101
2460399914,80cyclictest0-21swapper/110:37:011
2460399914,80cyclictest0-21swapper/110:37:011
2460399913,82cyclictest0-21swapper/109:31:361
2460399913,78cyclictest19599-21munin-node09:37:131
24599999135,14cyclictest0-21swapper/010:17:000
2460399904,79cyclictest0-21swapper/109:07:531
2460399904,55cyclictest0-21swapper/110:11:471
2460399903,79cyclictest28410-21sort12:12:041
2459999905,36cyclictest0-21swapper/009:13:120
2460399895,77cyclictest0-21swapper/112:07:151
2460399894,78cyclictest0-21swapper/108:07:081
2460399894,52cyclictest27058-21latency11:22:111
2460399883,78cyclictest2637-21taskset11:33:371
2460399883,78cyclictest0-21swapper/111:09:501
2460399883,77cyclictest24136-21ssh11:17:201
2460399883,77cyclictest24136-21ssh11:17:201
2459999885,14cyclictest1227-21runrttasks11:07:450
2460399874,76cyclictest21754-21iostat_ios12:02:091
2460399874,76cyclictest0-21swapper/109:32:061
2460399874,76cyclictest0-21swapper/109:14:331
2460399874,76cyclictest0-21swapper/108:57:371
2460399873,78cyclictest0-21swapper/111:46:011
2460399873,77cyclictest2144-21proc_pri08:12:251
2460399873,76cyclictest14436-21aten_r1power_po10:17:011
2460399873,40cyclictest0-21swapper/111:51:581
2460399863,75cyclictest32281-21ssh10:42:111
2460399863,75cyclictest30416-21cat11:27:111
2460399863,43cyclictest0-21swapper/109:02:051
2460399862,77cyclictest28295-21ssh09:47:351
2460399853,76cyclictest0-21swapper/110:54:581
2460399853,75cyclictest0-21swapper/109:55:011
2460399844,73cyclictest21874-21perl10:27:081
2460399844,73cyclictest0-21swapper/108:55:381
2460399844,64cyclictest0-21swapper/111:48:501
2460399843,73cyclictest9819-21perl10:57:051
2460399843,73cyclictest0-21swapper/106:47:161
2460399834,72cyclictest29360-21turbostat.cron06:56:581
2460399834,70cyclictest0-21swapper/111:05:091
2460399833,74cyclictest0-21swapper/108:48:361
2460399824,71cyclictest0-21swapper/110:22:301
2460399824,61cyclictest0-21swapper/109:42:181
2460399814,69cyclictest0-21swapper/110:06:511
2460399814,69cyclictest0-21swapper/107:17:071
2460399814,64cyclictest0-21swapper/107:42:161
2460399813,60cyclictest0-21swapper/109:20:061
219499810,6rtkit-daemon0-21swapper/310:56:383
2460399803,70cyclictest9746-21df_abs07:22:141
2460399802,72cyclictest648-21memory07:02:231
2460399794,68cyclictest0-21swapper/107:41:561
2460399793,70cyclictest31304-21unixbench_multi06:57:311
2460399793,70cyclictest0-21swapper/107:54:191
2460399793,69cyclictest12883-21munin-node08:37:071
2460399793,68cyclictest5384-21crond08:21:541
2460399793,47cyclictest30507-21crond08:06:551
2460399793,47cyclictest12209-21munin-node07:27:131
2460399783,67cyclictest21194-21munin-node07:47:241
2460399773,68cyclictest0-21swapper/108:28:581
2460399773,67cyclictest28125-21latency_hist08:01:571
2460399773,67cyclictest28125-21latency_hist08:01:571
2460399764,65cyclictest0-21swapper/108:22:231
2460399763,67cyclictest0-21swapper/107:34:371
2460399763,67cyclictest0-21swapper/107:09:191
2460399763,65cyclictest1227-21runrttasks07:14:251
2460399763,65cyclictest1227-21runrttasks07:14:251
2460399753,66cyclictest0-21swapper/108:44:041
24604997413,52cyclictest0-21swapper/211:27:162
2460399743,57cyclictest0-21swapper/108:32:071
24605997329,27cyclictest21012-21unixbench_singl11:12:233
24604997319,48cyclictest0-21swapper/208:16:542
24604997217,34cyclictest0-21swapper/210:46:502
24604997123,39cyclictest14324-21aten_r1power_cu10:17:002
24604997123,31cyclictest24745-21unixbench-2d09:42:252
24604997022,39cyclictest5416-21nscd08:36:542
300652690,6sleep030067-21grep09:52:040
2460499697,55cyclictest0-21swapper/209:07:032
24604996919,43cyclictest7356-21ls10:52:212
24604996919,34cyclictest0-21swapper/211:58:062
24604996919,34cyclictest0-21swapper/211:58:062
24604996918,34cyclictest0-21swapper/209:17:032
24604996823,29cyclictest26380-21aten_r1power_cu09:47:022
24604996823,23cyclictest4992-21ssh11:37:122
24604996820,39cyclictest29432-21ssh10:37:222
24604996820,39cyclictest29432-21ssh10:37:222
24604996815,45cyclictest23812-21munin-run12:06:462
24604996810,50cyclictest0-21swapper/209:01:392
24604996810,37cyclictest0-21swapper/212:07:162
24604996724,35cyclictest26772-21grep11:22:062
24604996722,30cyclictest6072-21munin-node10:02:262
24604996717,43cyclictest29829-21chrt12:14:092
24604996621,38cyclictest973-21ssh09:57:042
24604996621,38cyclictest973-21ssh09:57:042
24604996619,14cyclictest0-21swapper/210:22:192
24604996618,31cyclictest1124-21snmpd10:09:342
24604996617,42cyclictest0-21swapper/211:21:492
24604996617,42cyclictest0-21swapper/211:21:492
24604996617,42cyclictest0-21swapper/210:59:312
24604996616,43cyclictest0-21swapper/206:52:162
24604996616,33cyclictest0-21swapper/210:27:132
24604996612,46cyclictest0-21swapper/211:44:312
2460399664,54cyclictest0-21swapper/106:46:591
24604996518,39cyclictest5912-21python07:12:272
24604996518,39cyclictest5912-21python07:12:272
24604996516,41cyclictest20339-21grep09:37:102
24604996516,41cyclictest0-21swapper/211:32:422
24604996515,43cyclictest0-21swapper/211:02:002
24604996515,33cyclictest0-21swapper/209:02:042
24604996511,47cyclictest0-21swapper/208:51:312
24604996511,46cyclictest0-21swapper/209:22:062
24604996511,46cyclictest0-21swapper/209:22:062
219499650,4rtkit-daemon2193-21rtkit-daemon11:47:140
24604996415,43cyclictest0-21swapper/210:47:182
24604996415,42cyclictest0-21swapper/210:32:002
24604996415,41cyclictest0-21swapper/211:52:102
24604996415,41cyclictest0-21swapper/209:27:072
24604996412,31cyclictest0-21swapper/207:10:452
24604996321,35cyclictest4198-21python09:12:232
24604996316,32cyclictest0-21swapper/209:52:212
24604996315,29cyclictest0-21swapper/211:47:172
24604996314,41cyclictest0-21swapper/211:07:042
24604996313,33cyclictest0-21swapper/211:14:072
24604996313,32cyclictest0-21swapper/208:52:212
24604996311,45cyclictest0-21swapper/208:26:092
263472623,12sleep30-21swapper/309:47:003
24604996118,36cyclictest17385-21ssh09:32:142
24604996117,35cyclictest1124-21snmpd07:49:252
24604996115,37cyclictest14063-21aten_r1power_en07:32:092
24604996112,41cyclictest0-21swapper/210:11:542
39112600,5sleep334-21rcuc/310:01:473
39112600,5sleep334-21rcuc/310:01:473
24604996017,36cyclictest1124-21snmpd08:40:232
24604996010,43cyclictest0-21swapper/207:27:212
219499600,7rtkit-daemon0-21swapper/011:43:510
81552596,10sleep00-21swapper/010:54:340
24604995914,37cyclictest0-21swapper/208:02:192
24604995912,40cyclictest0-21swapper/207:46:562
2460499586,44cyclictest0-21swapper/207:26:152
24604995840,10cyclictest1254-21grep07:02:322
24604995815,36cyclictest29597-21munin-node06:57:172
24604995814,35cyclictest0-21swapper/208:46:542
24604995813,38cyclictest0-21swapper/207:52:112
24604995812,38cyclictest0-21swapper/207:57:082
24604995812,38cyclictest0-21swapper/207:57:082
2459999584,22cyclictest23335-21cpuspeed_turbos09:42:050
219499580,7rtkit-daemon0-21swapper/307:39:382
219499580,7rtkit-daemon0-21swapper/307:21:092
2459999575,37cyclictest0-21swapper/011:19:360
2459999575,37cyclictest0-21swapper/011:19:360
219499570,7rtkit-daemon0-21swapper/306:49:032
219499570,6rtkit-daemon0-21swapper/308:11:072
219499570,5rtkit-daemon2193-21rtkit-daemon10:01:553
219499570,5rtkit-daemon2193-21rtkit-daemon09:54:333
219499570,5rtkit-daemon2193-21rtkit-daemon09:39:343
219499570,5rtkit-daemon2193-21rtkit-daemon08:43:063
219499570,5rtkit-daemon2193-21rtkit-daemon07:51:533
219499570,5rtkit-daemon2193-21rtkit-daemon07:17:323
219499570,5rtkit-daemon2193-21rtkit-daemon07:05:403
219499570,5rtkit-daemon2193-21rtkit-daemon06:55:473
219499570,5rtkit-daemon2193-21rtkit-daemon06:51:033
24604995614,35cyclictest8036-21aten_r1power_cu08:27:062
2459999565,44cyclictest0-21swapper/010:48:210
2459999564,44cyclictest0-21swapper/011:36:580
24599995635,14cyclictest0-21swapper/011:28:570
24599995635,14cyclictest0-21swapper/010:37:060
24599995635,14cyclictest0-21swapper/010:37:060
24599995629,13cyclictest0-21swapper/010:01:510
24599995629,13cyclictest0-21swapper/010:01:510
24599995617,33cyclictest0-21swapper/010:35:190
24599995617,20cyclictest28096-21grep09:47:240
219499560,5rtkit-daemon2193-21rtkit-daemon11:06:153
219499560,5rtkit-daemon2193-21rtkit-daemon10:58:303
219499560,5rtkit-daemon2193-21rtkit-daemon09:43:263
219499560,5rtkit-daemon2193-21rtkit-daemon09:13:273
219499560,5rtkit-daemon2193-21rtkit-daemon09:02:573
219499560,5rtkit-daemon2193-21rtkit-daemon08:58:203
219499560,5rtkit-daemon2193-21rtkit-daemon08:23:223
219499560,5rtkit-daemon2193-21rtkit-daemon08:14:373
219499560,5rtkit-daemon2193-21rtkit-daemon08:10:523
219499560,5rtkit-daemon2193-21rtkit-daemon07:43:083
219499560,5rtkit-daemon2193-21rtkit-daemon07:39:233
219499560,5rtkit-daemon2193-21rtkit-daemon07:25:243
219499560,5rtkit-daemon2193-21rtkit-daemon06:57:403
319772552,45sleep00-21swapper/007:02:070
2460599553,36cyclictest0-21swapper/310:18:523
24605995511,26cyclictest0-21swapper/312:06:583
2460499558,39cyclictest0-21swapper/206:47:002
2459999554,34cyclictest0-21swapper/011:12:050
24599995536,13cyclictest0-21swapper/011:52:120
2459999553,22cyclictest18472-21fschecks_time10:22:070
24599995517,12cyclictest0-21swapper/009:17:110
219499550,5rtkit-daemon2193-21rtkit-daemon11:11:153
219499550,5rtkit-daemon2193-21rtkit-daemon10:47:463
219499550,5rtkit-daemon2193-21rtkit-daemon09:34:043
219499550,5rtkit-daemon2193-21rtkit-daemon07:35:013
219499550,5rtkit-daemon2193-21rtkit-daemon07:29:163
219499550,4rtkit-daemon2193-21rtkit-daemon09:16:573
219499550,4rtkit-daemon2193-21rtkit-daemon07:12:393
219499550,4rtkit-daemon2193-21rtkit-daemon07:12:393
134942552,11sleep00-21swapper/007:28:150
265692542,10sleep00-21swapper/008:58:120
2459999543,34cyclictest0-21swapper/010:07:310
24599995425,13cyclictest0-21swapper/012:01:180
24599995425,13cyclictest0-21swapper/012:01:180
219499540,4rtkit-daemon2193-21rtkit-daemon08:41:213
267792533,43sleep00-21swapper/006:49:340
2460599534,27cyclictest22031-21ntp_states12:02:143
24605995333,12cyclictest0-21swapper/311:47:203
2459999535,40cyclictest0-21swapper/009:35:390
2459999534,42cyclictest0-21swapper/010:06:510
2459999534,12cyclictest0-21swapper/009:22:110
2459999534,12cyclictest0-21swapper/009:22:110
24599995339,8cyclictest1227-21runrttasks08:02:380
2459999533,45cyclictest0-21swapper/012:12:030
24599995325,12cyclictest0-21swapper/009:10:360
219499530,5rtkit-daemon2193-21rtkit-daemon10:32:543
219499530,5rtkit-daemon2193-21rtkit-daemon08:17:222
2460599524,29cyclictest0-21swapper/311:17:243
2460599524,29cyclictest0-21swapper/311:17:243
2460599524,29cyclictest0-21swapper/308:17:183
2460599524,14cyclictest0-21swapper/311:31:313
2459999525,41cyclictest0-21swapper/009:06:010
2459999525,39cyclictest0-21swapper/008:47:120
24599995231,14cyclictest0-21swapper/010:31:500
24599995222,12cyclictest0-21swapper/007:32:130
240202523,43sleep024022-21ssh08:56:260
100102523,42sleep30-21swapper/310:09:263
61932512,43sleep00-21swapper/008:22:120
2460599514,28cyclictest0-21swapper/310:37:053
2460599514,28cyclictest0-21swapper/310:37:053
2460599514,13cyclictest0-21swapper/310:23:283
24605995134,9cyclictest23633-21aten_r1power_en07:52:073
2460599513,26cyclictest0-21swapper/310:16:143
2459999515,9cyclictest9445-21kworker/u8:006:52:240
2459999515,29cyclictest0-21swapper/010:42:070
2459999515,29cyclictest0-21swapper/007:17:210
2459999515,27cyclictest0-21swapper/008:36:550
2459999514,40cyclictest0-21swapper/011:02:000
2459999514,33cyclictest0-21swapper/009:27:260
2459999514,28cyclictest0-21swapper/008:42:170
24599995137,9cyclictest0-21swapper/009:37:100
24599995121,13cyclictest0-21swapper/008:27:110
24599995121,10cyclictest558-21grep11:32:010
2460599504,28cyclictest0-21swapper/311:41:583
2460599504,27cyclictest0-21swapper/311:32:213
2460599504,24cyclictest22244-21ntp_states08:52:213
2460599504,13cyclictest0-21swapper/309:27:203
2460599504,12cyclictest0-21swapper/312:00:053
2460599504,12cyclictest0-21swapper/312:00:053
2459999505,28cyclictest0-21swapper/007:52:250
2459999504,29cyclictest0-21swapper/007:42:150
24599995031,13cyclictest0-21swapper/012:06:570
2460599497,36cyclictest0-21swapper/311:22:083
2460599494,28cyclictest0-21swapper/308:32:283
2460599494,27cyclictest0-21swapper/311:37:143
2460599494,27cyclictest0-21swapper/310:30:583
2460599494,27cyclictest0-21swapper/309:07:233
24605994932,10cyclictest28706-21cpuspeed_turbos08:02:103
24605994920,13cyclictest0-21swapper/309:22:113
24605994920,13cyclictest0-21swapper/309:22:113
24605994919,13cyclictest0-21swapper/308:50:143
24605994918,13cyclictest0-21swapper/311:51:563
2459999495,27cyclictest0-21swapper/007:37:240
2459999494,28cyclictest0-21swapper/007:12:190
2459999494,28cyclictest0-21swapper/007:12:190
2459999494,27cyclictest0-21swapper/007:57:120
2459999494,27cyclictest0-21swapper/007:57:120
2459999493,42cyclictest0-21swapper/008:07:340
2460599484,26cyclictest0-21swapper/308:27:073
2460599483,28cyclictest0-21swapper/310:42:023
2460599482,41cyclictest0-21swapper/312:14:083
2459999484,27cyclictest0-21swapper/008:37:150
2459999484,27cyclictest0-21swapper/008:17:080
2459999484,26cyclictest0-21swapper/008:12:190
24599994830,12cyclictest0-21swapper/007:22:190
244432484,39sleep00-21swapper/006:45:230
41572472,10sleep00-21swapper/007:11:060
24605994628,11cyclictest2923-21gltestperf07:07:173
2459999464,13cyclictest0-21swapper/007:01:580
2460599424,22cyclictest0-21swapper/307:57:053
2460599424,22cyclictest0-21swapper/307:57:053
2460599387,22cyclictest0-21swapper/306:46:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional