You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-23 - 18:16

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Tue Jun 23, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27454991074,56cyclictest0-21swapper/210:16:222
27453991024,89cyclictest12727-21hwlatdetect10:56:111
27453991014,89cyclictest1227-21runrttasks08:26:091
2745399974,85cyclictest0-21swapper/111:31:011
2745399974,85cyclictest0-21swapper/111:31:011
2745399953,84cyclictest1227-21runrttasks11:51:411
2745399944,81cyclictest0-21swapper/109:35:561
2745399943,84cyclictest0-21swapper/110:31:451
2745399933,83cyclictest0-21swapper/112:05:071
2745399923,82cyclictest27590-21gltestperf12:06:091
2745399923,82cyclictest0-21swapper/111:26:451
2745399923,80cyclictest0-21swapper/109:49:481
2745399913,81cyclictest30101-21ssh12:11:001
2745399913,81cyclictest0-21swapper/109:09:301
2745399913,80cyclictest26302-21kernelversion11:16:141
2745399913,79cyclictest0-21swapper/110:53:441
2745399904,79cyclictest0-21swapper/110:26:051
2745399903,80cyclictest0-21swapper/110:37:471
2745399903,80cyclictest0-21swapper/109:15:031
2745399894,76cyclictest0-21swapper/111:41:191
2745399893,77cyclictest8282-21head11:36:241
2745399893,77cyclictest8282-21head11:36:241
2745399893,45cyclictest10456-21sort09:16:281
2745399884,65cyclictest0-21swapper/108:46:221
2745399883,79cyclictest0-21swapper/110:43:481
2745399874,75cyclictest0-21swapper/108:43:121
2745399873,77cyclictest0-21swapper/108:56:551
2745399873,76cyclictest209281ssh11:08:231
2745399864,74cyclictest0-21swapper/110:24:151
2745399863,77cyclictest0-21swapper/110:19:101
2745399863,64cyclictest0-21swapper/109:36:001
2745399863,62cyclictest10205-21latency_hist10:05:551
2745399854,74cyclictest0-21swapper/111:22:261
2745399854,73cyclictest0-21swapper/109:56:161
2745399853,73cyclictest1227-21runrttasks09:22:201
2745399845,71cyclictest0-21swapper/109:03:341
2745399844,73cyclictest0-21swapper/110:11:211
2745399844,73cyclictest0-21swapper/110:11:211
2745399843,75cyclictest0-21swapper/106:56:251
2745399843,74cyclictest0-21swapper/110:47:501
2745399843,74cyclictest0-21swapper/109:52:121
2745399843,73cyclictest0-21swapper/110:06:241
219499830,5rtkit-daemon2193-21rtkit-daemon07:38:233
219499830,5rtkit-daemon2193-21rtkit-daemon07:17:243
2745399823,72cyclictest31090-21munin-node06:51:251
2745399823,72cyclictest0-21swapper/108:55:101
2745399823,72cyclictest0-21swapper/108:55:101
2745399823,71cyclictest16882-21netstat09:26:221
2745399823,62cyclictest14320-21sed11:46:151
2745399823,60cyclictest0-21swapper/111:01:541
2745399822,72cyclictest15632-21munin-node08:36:161
219499820,5rtkit-daemon2193-21rtkit-daemon07:43:153
219499820,5rtkit-daemon2193-21rtkit-daemon07:28:463
219499820,5rtkit-daemon2193-21rtkit-daemon07:28:463
2745399813,70cyclictest32267-21munin-node08:01:251
2745399813,48cyclictest0-21swapper/109:43:031
219499810,5rtkit-daemon2193-21rtkit-daemon07:33:233
219499810,5rtkit-daemon2193-21rtkit-daemon07:24:463
2745399803,70cyclictest0-21swapper/108:06:201
2745399803,69cyclictest19954-21munin-node11:56:031
2745399793,69cyclictest4354-21sshd07:01:371
2745399793,69cyclictest1002-21sshd11:15:431
2745399793,68cyclictest9385-21rm08:21:201
2745399793,43cyclictest8025-21grep07:11:181
2745399783,68cyclictest0-21swapper/108:31:221
219499780,5rtkit-daemon2193-21rtkit-daemon10:21:170
2745399774,60cyclictest0-21swapper/107:16:321
2745399763,66cyclictest7236-21missed_timers08:16:231
2745399763,66cyclictest0-21swapper/106:46:141
2745399763,66cyclictest0-21swapper/106:46:141
2745399763,56cyclictest0-21swapper/107:29:591
2745399763,56cyclictest0-21swapper/107:29:591
2745399763,43cyclictest24106-21telnet07:46:111
219499760,8rtkit-daemon0-21swapper/111:21:290
2745399754,43cyclictest0-21swapper/107:57:301
2745399753,65cyclictest0-21swapper/107:41:231
2745399753,64cyclictest26775-21tr07:51:141
2745399753,64cyclictest0-21swapper/107:21:131
2745399743,65cyclictest0-21swapper/108:11:151
2745399743,65cyclictest0-21swapper/108:11:151
2745399743,64cyclictest19084-21wc07:36:011
2745399743,60cyclictest0-21swapper/107:40:001
2745399743,55cyclictest503-1kworker/1:0H07:06:131
219499710,4rtkit-daemon2193-21rtkit-daemon08:53:580
219499710,4rtkit-daemon2193-21rtkit-daemon08:53:580
27455996923,39cyclictest12674-21gltestperf10:56:103
27455996921,31cyclictest19659-21crond11:55:493
27455996914,48cyclictest0-21swapper/306:46:183
27455996914,48cyclictest0-21swapper/306:46:183
2745499694,57cyclictest0-21swapper/212:11:012
2745499694,56cyclictest0-21swapper/209:36:212
27455996819,42cyclictest26400-21idleruntime-cro12:05:493
27455996816,44cyclictest25553-21cpuspeed_turbos11:16:043
27455996816,21cyclictest0-21swapper/312:07:443
219499680,4rtkit-daemon2193-21rtkit-daemon09:49:030
27455996712,46cyclictest0-21swapper/310:51:223
2745499674,57cyclictest0-21swapper/209:31:132
27455996633,11cyclictest0-21swapper/309:58:533
27455996611,47cyclictest0-21swapper/311:58:233
2745499664,55cyclictest0-21swapper/210:30:542
2745499664,54cyclictest0-21swapper/212:01:082
2745499664,54cyclictest0-21swapper/210:41:152
2745499664,53cyclictest0-21swapper/211:31:052
2745499664,53cyclictest0-21swapper/211:31:052
2745199664,53cyclictest0-21swapper/012:01:210
27451996626,12cyclictest8395-21munin-node10:51:200
219499660,8rtkit-daemon0-21swapper/208:16:143
219499660,4rtkit-daemon2193-21rtkit-daemon09:51:100
219499660,4rtkit-daemon2193-21rtkit-daemon09:09:270
219499660,4rtkit-daemon2193-21rtkit-daemon08:56:430
27455996521,37cyclictest29882-21latency07:56:223
27455996514,43cyclictest0-21swapper/310:26:123
27455996514,32cyclictest0-21swapper/310:31:123
27455996512,33cyclictest12338-21ls08:26:283
2745499654,53cyclictest0-21swapper/211:26:102
2745499653,54cyclictest0-21swapper/209:11:272
2745399652,58cyclictest0-21swapper/106:46:031
2745599648,48cyclictest0-21swapper/310:06:123
27455996420,36cyclictest6804-21ntp_states09:11:243
27455996417,27cyclictest1124-21snmpd09:40:193
27455996416,40cyclictest0-21swapper/310:46:123
27455996414,43cyclictest4599-21switchtime11:31:203
27455996414,43cyclictest4599-21switchtime11:31:203
27455996412,44cyclictest21345-21ssh08:46:173
2745499645,40cyclictest0-21swapper/208:06:192
2745499644,51cyclictest0-21swapper/210:46:082
2745499643,53cyclictest0-21swapper/209:16:192
2745599634,30cyclictest0-21swapper/309:51:303
27455996315,31cyclictest20904-21ssh09:31:453
27455996313,43cyclictest27685-21rm09:41:443
27455996312,31cyclictest0-21swapper/309:06:103
27455996311,45cyclictest0-21swapper/310:36:063
27455996311,44cyclictest0-21swapper/308:31:183
27455996310,46cyclictest0-21swapper/311:12:133
27455996310,45cyclictest0-21swapper/310:41:193
2745499634,51cyclictest0-21swapper/210:21:272
2745499634,51cyclictest0-21swapper/208:54:482
2745499634,51cyclictest0-21swapper/208:54:482
27454996332,14cyclictest30558-21munin-node10:36:102
219499630,5rtkit-daemon27547-21ls06:46:033
199212637,8sleep00-21swapper/010:20:050
27455996222,12cyclictest9167-21cpuspeed_turbos09:16:103
27455996211,44cyclictest31980-21munin-node11:26:103
2745499624,50cyclictest0-21swapper/211:51:152
219499620,5rtkit-daemon0-21swapper/206:51:323
219499620,4rtkit-daemon2193-21rtkit-daemon08:30:590
27455996117,37cyclictest9488-21awk07:16:003
27455996114,29cyclictest32239-21swap09:01:293
27455996113,32cyclictest0-21swapper/311:48:513
27455996112,34cyclictest0-21swapper/310:24:333
27455996111,32cyclictest18382-21taskset09:29:523
2745499614,50cyclictest0-21swapper/209:41:122
2745499614,49cyclictest0-21swapper/210:01:262
2745499613,50cyclictest0-21swapper/211:15:302
27451996113,27cyclictest0-21swapper/011:11:210
219499610,6rtkit-daemon0-21swapper/207:08:393
27455996041,13cyclictest5588-21sshd08:12:373
27455996041,13cyclictest5588-21sshd08:12:373
27455996016,37cyclictest20193-21diskmemload11:01:103
27455996016,37cyclictest1124-21snmpd10:17:413
27455996015,36cyclictest30545-21ssh11:21:383
27455996013,40cyclictest0-21swapper/310:01:043
27455996010,43cyclictest0-21swapper/311:06:133
2745499604,48cyclictest0-21swapper/211:56:042
2745499602,51cyclictest0-21swapper/211:01:582
27454996018,25cyclictest1227-21runrttasks10:34:072
2745199606,45cyclictest30722-21aten2.4-expect10:36:060
2745199604,33cyclictest0-21swapper/010:09:450
2745199604,12cyclictest0-21swapper/009:36:110
2745199603,51cyclictest0-21swapper/008:06:150
219499600,7rtkit-daemon0-21swapper/112:15:270
219499600,6rtkit-daemon0-21swapper/208:07:523
2745599598,30cyclictest0-21swapper/312:11:363
2745599595,33cyclictest0-21swapper/307:55:593
27455995914,39cyclictest7989-21switchtime11:36:223
27455995914,39cyclictest7989-21switchtime11:36:223
27455995914,38cyclictest24045-21munin-node07:46:123
27455995913,36cyclictest12800-21diskstats09:21:123
27455995912,40cyclictest10432-21forks11:41:093
27455995912,29cyclictest0-21swapper/310:11:123
27455995912,29cyclictest0-21swapper/310:11:123
27455995911,40cyclictest23713-21awk08:51:083
27455995911,40cyclictest23713-21awk08:51:083
27455995910,30cyclictest0-21swapper/308:56:223
2745499595,45cyclictest0-21swapper/211:36:092
2745499595,45cyclictest0-21swapper/211:36:092
2745499594,48cyclictest0-21swapper/209:26:122
2745499594,47cyclictest29127-21aten2.4-expect09:46:072
2745199594,47cyclictest0-21swapper/010:56:080
2745199593,50cyclictest0-21swapper/012:10:240
219499590,7rtkit-daemon0-21swapper/111:46:510
219499590,4rtkit-daemon2193-21rtkit-daemon10:46:230
75942583,47sleep20-21swapper/208:16:312
27455995810,40cyclictest20193-21diskmemload09:46:413
2745499584,47cyclictest0-21swapper/210:56:122
2745499584,47cyclictest0-21swapper/208:36:192
2745499583,49cyclictest0-21swapper/210:11:062
2745499583,49cyclictest0-21swapper/210:11:062
2745199583,50cyclictest0-21swapper/009:01:200
2745199583,49cyclictest0-21swapper/011:16:390
2745199583,49cyclictest0-21swapper/009:31:170
219499580,5rtkit-daemon2193-21rtkit-daemon08:15:522
219499580,5rtkit-daemon2193-21rtkit-daemon08:15:522
219499580,5rtkit-daemon2193-21rtkit-daemon07:47:452
27455995714,35cyclictest4716-21idleruntime-cro07:06:013
27455995712,40cyclictest10314-21seq08:22:003
2745499574,28cyclictest0-21swapper/207:26:132
2745499574,28cyclictest0-21swapper/207:26:132
2745199574,47cyclictest0-21swapper/011:56:430
2745199574,36cyclictest0-21swapper/011:02:290
2745199574,36cyclictest0-21swapper/010:35:520
2745199573,49cyclictest0-21swapper/011:07:210
27451995712,23cyclictest0-21swapper/010:45:520
219499570,5rtkit-daemon2193-21rtkit-daemon07:56:372
219499570,5rtkit-daemon2193-21rtkit-daemon07:45:302
219499570,5rtkit-daemon2193-21rtkit-daemon07:37:532
219499570,5rtkit-daemon2193-21rtkit-daemon07:15:312
219499570,5rtkit-daemon2193-21rtkit-daemon07:08:242
165242572,10sleep00-21swapper/010:15:010
165242572,10sleep00-21swapper/010:15:010
27455995615,26cyclictest1828-21users06:56:353
27455995613,35cyclictest16654-21iostat_ios08:36:183
2745499564,46cyclictest0-21swapper/208:50:252
2745499564,46cyclictest0-21swapper/207:21:122
2745499564,45cyclictest0-21swapper/208:56:132
2745499564,30cyclictest0-21swapper/209:51:282
2745499564,16cyclictest0-21swapper/211:25:422
2745499564,12cyclictest0-21swapper/209:04:582
2745499562,48cyclictest0-21swapper/211:45:002
2745199565,25cyclictest0-21swapper/009:43:300
2745199564,44cyclictest10730-21grep11:41:120
2745199564,28cyclictest0-21swapper/007:56:370
27451995622,8cyclictest107550irq/46-eth011:51:280
219499560,5rtkit-daemon2193-21rtkit-daemon08:03:452
219499560,4rtkit-daemon2193-21rtkit-daemon07:51:532
2745499556,28cyclictest0-21swapper/211:46:092
2745499552,9cyclictest0-21swapper/211:16:192
2745499552,48cyclictest0-21swapper/212:07:302
2745199555,40cyclictest0-21swapper/007:25:170
2745199554,45cyclictest10206-21open_inodes09:16:240
2745199554,44cyclictest4881-21grep11:31:230
2745199554,44cyclictest4881-21grep11:31:230
2745199554,44cyclictest0-21swapper/011:26:110
27451995535,11cyclictest27296-21sed07:51:190
2745199553,47cyclictest0-21swapper/010:26:440
2745199553,47cyclictest0-21swapper/009:15:450
219499550,4rtkit-daemon2193-21rtkit-daemon07:31:462
219499550,4rtkit-daemon2193-21rtkit-daemon07:17:092
213462552,10sleep00-21swapper/007:40:050
327012542,44sleep00-21swapper/006:56:150
27454995435,11cyclictest20186-21crond08:45:572
27454995426,12cyclictest0-21swapper/209:06:122
27454995412,24cyclictest0-21swapper/209:21:062
2745199544,43cyclictest0-21swapper/010:01:180
2745199544,30cyclictest0-21swapper/008:41:270
2745199544,27cyclictest0-21swapper/009:28:510
27451995437,10cyclictest11475-21unixbench_singl07:16:340
2745199543,45cyclictest0-21swapper/008:16:400
2745199543,44cyclictest0-21swapper/007:11:320
2745199543,37cyclictest0-21swapper/006:52:410
27451995420,14cyclictest1124-21snmpd11:37:290
27451995420,14cyclictest1124-21snmpd11:37:290
2745599538,30cyclictest0-21swapper/308:03:273
2745499534,41cyclictest0-21swapper/211:06:192
2745499532,45cyclictest0-21swapper/208:26:162
2745199535,29cyclictest0-21swapper/008:11:250
2745199535,29cyclictest0-21swapper/008:11:250
2745199535,27cyclictest0-21swapper/009:56:290
2745199534,44cyclictest0-21swapper/008:48:390
2745199534,30cyclictest0-21swapper/007:26:220
2745199534,30cyclictest0-21swapper/007:26:220
2745199533,44cyclictest0-21swapper/007:33:370
27451995319,13cyclictest0-21swapper/009:21:070
218752533,11sleep00-21swapper/007:41:140
27455995211,34cyclictest18606-21taskset08:41:113
2745499523,43cyclictest0-21swapper/210:52:352
27454995221,12cyclictest0-21swapper/210:06:262
2745499522,9cyclictest0-21swapper/209:56:122
2745199524,29cyclictest0-21swapper/008:21:190
2745199523,43cyclictest0-21swapper/008:31:180
2745499514,38cyclictest0-21swapper/207:01:302
2745499513,29cyclictest0-21swapper/206:56:312
2745199515,38cyclictest0-21swapper/007:01:120
2745199514,28cyclictest0-21swapper/008:36:130
272562514,40sleep00-21swapper/006:43:580
6542502,42sleep00-21swapper/008:02:500
2745499504,40cyclictest0-21swapper/206:46:262
2745499504,40cyclictest0-21swapper/206:46:262
2745199504,28cyclictest0-21swapper/006:46:260
2745199504,28cyclictest0-21swapper/006:46:260
2745199504,27cyclictest0-21swapper/007:46:120
2745199503,43cyclictest0-21swapper/007:06:280
2745499493,26cyclictest0-21swapper/206:51:222
2745499472,40cyclictest0-21swapper/208:31:152
2745499472,40cyclictest0-21swapper/208:21:282
2745499444,13cyclictest0-21swapper/206:46:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional