You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-25 - 23:37

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Wed Mar 25, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
11814991014,13cyclictest0-21swapper/010:58:440
118149910126,57cyclictest0-21swapper/007:38:480
118149910126,57cyclictest0-21swapper/007:38:480
248599990,7rtkit-daemon2484-21rtkit-daemon10:41:272
11814999821,10cyclictest25229-21cpuspeed09:38:560
1182199963,75cyclictest0-21swapper/309:16:123
1181499964,30cyclictest0-21swapper/009:36:380
1181499964,29cyclictest0-21swapper/005:34:030
11814999615,22cyclictest3427-21fschecks_count09:53:590
11814999510,24cyclictest0-21swapper/007:54:200
1182199944,66cyclictest0-21swapper/310:23:523
1182199944,66cyclictest0-21swapper/310:23:523
1181499946,76cyclictest0-21swapper/007:17:460
11814999436,51cyclictest17669-21gltestperf05:44:120
11814999314,9cyclictest14941-21rm08:34:150
11814999313,12cyclictest0-21swapper/006:23:510
1182199925,80cyclictest0-21swapper/310:00:303
11814999214,12cyclictest0-21swapper/010:33:590
1182199913,82cyclictest13223-21sed09:19:153
1182199913,81cyclictest4819-21aten_r1power_fr09:08:543
1181499915,28cyclictest0-21swapper/007:24:240
11814999140,44cyclictest1596-21gltestperf10:38:590
1181499914,80cyclictest0-21swapper/009:06:450
1181499914,80cyclictest0-21swapper/009:06:450
1181499914,80cyclictest0-21swapper/009:03:440
1181499914,80cyclictest0-21swapper/009:03:440
1181499914,28cyclictest0-21swapper/009:27:040
1181499914,28cyclictest0-21swapper/008:04:100
1181499913,9cyclictest10154-21munin-node10:03:570
11814999117,9cyclictest17378-21ssh10:14:040
1182199904,80cyclictest0-21swapper/309:50:493
1182199903,80cyclictest10440-21cpuspeed_turbos08:29:003
1181499904,26cyclictest0-21swapper/009:22:250
1181499904,26cyclictest0-21swapper/008:23:000
1181499904,26cyclictest0-21swapper/008:23:000
11814999017,10cyclictest10783-21ssh08:29:040
248599890,5rtkit-daemon2484-21rtkit-daemon06:15:372
248599890,5rtkit-daemon2484-21rtkit-daemon06:15:372
1182199895,65cyclictest25496-21munin-node08:04:173
1182199894,78cyclictest30751-21hwlatdetect10:34:013
1182199894,70cyclictest0-21swapper/308:52:413
1182199894,56cyclictest0-21swapper/310:44:423
1181499898,22cyclictest0-21swapper/010:44:100
1181499896,7cyclictest0-21swapper/008:24:190
1181499894,32cyclictest0-21swapper/005:59:130
1181499894,29cyclictest0-21swapper/006:49:220
1181499894,24cyclictest0-21swapper/010:48:560
1181499894,24cyclictest0-21swapper/009:31:070
1182199883,63cyclictest0-21swapper/307:34:183
1182199883,63cyclictest0-21swapper/307:34:183
1182199883,52cyclictest0-21swapper/310:30:583
1181499884,76cyclictest0-21swapper/008:56:270
1181499884,26cyclictest0-21swapper/010:18:530
1181499884,13cyclictest0-21swapper/010:25:150
1181499884,13cyclictest0-21swapper/010:25:150
1181499884,12cyclictest0-21swapper/010:09:140
1181499883,77cyclictest28737-21ssh09:43:560
1181499883,77cyclictest28737-21ssh09:43:560
11814998810,17cyclictest0-21swapper/010:58:160
1182199878,60cyclictest18173-21ntpq08:39:133
1182199875,60cyclictest0-21swapper/310:20:093
1182199874,65cyclictest30535-21ssh09:45:223
1182199874,65cyclictest30535-21ssh09:45:223
1182199874,64cyclictest0-21swapper/308:18:423
1182199874,64cyclictest0-21swapper/307:54:163
1182199874,50cyclictest20792-21diskstats08:44:033
1181499875,26cyclictest0-21swapper/008:48:170
1181499874,35cyclictest4830-21munin-node09:08:550
1181499874,23cyclictest0-21swapper/007:41:230
1181499874,12cyclictest0-21swapper/008:00:180
1182199864,76cyclictest0-21swapper/308:13:463
1182199864,65cyclictest0-21swapper/309:54:583
1182199864,64cyclictest0-21swapper/308:21:123
1182199864,64cyclictest0-21swapper/308:21:123
1182199863,77cyclictest0-21swapper/308:24:133
1182199863,63cyclictest2656-21ssh09:04:093
1182199863,63cyclictest2656-21ssh09:04:093
1182199863,51cyclictest0-21swapper/310:56:533
11821998613,68cyclictest23340-21sed09:34:153
1181499864,33cyclictest0-21swapper/007:31:080
1181499864,12cyclictest0-21swapper/006:34:060
1181499864,12cyclictest0-21swapper/005:49:260
1181499863,22cyclictest0-21swapper/010:02:240
1181499863,21cyclictest1174-21ssh09:49:170
1182199856,62cyclictest0-21swapper/310:11:293
1182199855,74cyclictest0-21swapper/307:44:213
1182199854,64cyclictest0-21swapper/309:42:293
1182199853,75cyclictest0-21swapper/310:51:463
1182199853,50cyclictest0-21swapper/307:53:013
1181499854,13cyclictest0-21swapper/008:38:560
1181499854,11cyclictest10626-21chrt09:16:360
11814998523,10cyclictest31838-21ssh08:13:200
11814998516,11cyclictest0-21swapper/010:29:140
11814998514,10cyclictest0-21swapper/007:48:350
11814998511,9cyclictest121850irq/46-eth007:49:000
1182199844,74cyclictest0-21swapper/309:29:123
1182199844,74cyclictest0-21swapper/309:23:523
1182199844,58cyclictest0-21swapper/307:41:013
1182199843,63cyclictest31759-21ssh08:59:133
1182199843,63cyclictest31759-21ssh08:59:133
1181499845,29cyclictest0-21swapper/006:39:070
1181499844,33cyclictest0-21swapper/007:09:140
1181499844,29cyclictest0-21swapper/006:44:070
1181499844,28cyclictest0-21swapper/006:54:170
1181499844,28cyclictest0-21swapper/006:54:170
1181499843,22cyclictest1419-21runrttasks08:15:510
11814998428,10cyclictest21212-21tail06:59:080
1182199834,73cyclictest0-21swapper/310:18:413
1182199834,73cyclictest0-21swapper/306:43:493
1182199834,72cyclictest15977-21runrttasks08:36:373
1182199834,52cyclictest0-21swapper/310:41:303
11814998325,8cyclictest4426-21gltestperf06:24:090
11814998317,12cyclictest0-21swapper/008:48:470
1182199814,72cyclictest0-21swapper/308:55:273
1182199814,70cyclictest0-21swapper/306:19:183
1182199814,69cyclictest0-21swapper/307:23:493
1182199814,52cyclictest0-21swapper/306:29:233
1181499813,33cyclictest0-21swapper/005:54:130
1182199804,67cyclictest23176-21iostat07:59:083
1182199804,57cyclictest0-21swapper/307:04:173
1182199803,48cyclictest10630-21grep10:04:043
11821998013,49cyclictest31132-21munin-node06:14:153
11821998013,49cyclictest31132-21munin-node06:14:153
1181499804,28cyclictest0-21swapper/007:19:140
1182199794,68cyclictest0-21swapper/306:26:213
1182199794,59cyclictest0-21swapper/310:59:013
1181499794,15cyclictest0-21swapper/006:29:150
1181499784,23cyclictest0-21swapper/005:39:050
1182199774,67cyclictest0-21swapper/305:54:183
1182199774,66cyclictest0-21swapper/305:43:533
1182199774,53cyclictest0-21swapper/306:49:533
1182199773,63cyclictest0-21swapper/306:10:543
1182199764,64cyclictest0-21swapper/307:09:043
1182199763,57cyclictest0-21swapper/305:49:023
1181499764,31cyclictest0-21swapper/006:04:230
1181499763,23cyclictest0-21swapper/006:09:030
11814997612,11cyclictest0-21swapper/007:04:220
1182199754,65cyclictest0-21swapper/305:34:543
1182199754,65cyclictest0-21swapper/305:33:533
1182199754,65cyclictest0-21swapper/305:33:533
1182199754,62cyclictest13556-21cpuspeed_turbos06:44:053
1182199753,56cyclictest0-21swapper/306:34:233
1182199745,61cyclictest0-21swapper/306:08:443
1182199744,62cyclictest17842-21taskset05:44:153
1182199736,59cyclictest4551-21crond07:33:473
1182199734,60cyclictest0-21swapper/307:15:313
1182199733,65cyclictest0-21swapper/306:59:013
11814997311,8cyclictest0-21swapper/006:14:050
11814997311,8cyclictest0-21swapper/006:14:050
1182199724,62cyclictest0-21swapper/307:25:413
1182199723,60cyclictest25952-21taskset06:01:433
1182199714,59cyclictest18404-21df_abs06:54:043
1182199714,59cyclictest18404-21df_abs06:54:043
248599630,6rtkit-daemon0-21swapper/007:34:121
248599630,6rtkit-daemon0-21swapper/007:34:121
1181899624,29cyclictest0-21swapper/109:14:381
1181999603,50cyclictest0-21swapper/208:04:182
11819995942,12cyclictest0-21swapper/208:32:262
11819995931,12cyclictest0-21swapper/210:03:222
1181899594,27cyclictest0-21swapper/107:24:021
59082584,47sleep10-21swapper/109:58:431
32262583,12sleep10-21swapper/110:40:591
1181999584,46cyclictest0-21swapper/208:43:442
11819995837,14cyclictest0-21swapper/209:34:052
11819995741,10cyclictest0-21swapper/207:50:512
11819995739,11cyclictest0-21swapper/209:01:442
11819995739,11cyclictest0-21swapper/209:01:442
1181899574,40cyclictest0-21swapper/109:27:081
1181899574,32cyclictest0-21swapper/110:13:341
1181899573,12cyclictest0-21swapper/107:48:591
103652574,45sleep10-21swapper/107:40:031
1181999568,43cyclictest281ktimersoftd/209:05:442
1181999568,43cyclictest281ktimersoftd/209:05:442
1181999564,45cyclictest0-21swapper/210:33:572
1181899564,25cyclictest0-21swapper/109:34:121
248599550,5rtkit-daemon2484-21rtkit-daemon09:39:142
199572554,13sleep20-21swapper/209:29:172
1181999556,42cyclictest9319-21sshd06:34:102
1181999555,29cyclictest0-21swapper/210:13:572
11819995540,10cyclictest0-21swapper/207:56:342
1181999554,44cyclictest0-21swapper/210:28:592
1181999554,43cyclictest0-21swapper/208:54:132
1181999554,42cyclictest0-21swapper/210:18:562
1181999553,44cyclictest0-21swapper/209:17:342
11819995512,25cyclictest0-21swapper/208:14:092
1181899555,29cyclictest1419-21runrttasks06:19:081
1181899553,38cyclictest0-21swapper/110:23:251
248599540,5rtkit-daemon2484-21rtkit-daemon10:44:122
187112543,9sleep118801-21gltestperf06:54:081
187112543,9sleep118801-21gltestperf06:54:081
1181999549,26cyclictest0-21swapper/209:26:042
11819995436,11cyclictest13300-21unixbench_singl09:19:162
1181999543,44cyclictest0-21swapper/210:24:022
1181999543,44cyclictest0-21swapper/210:24:022
1181999543,42cyclictest0-21swapper/210:06:342
1181899545,30cyclictest0-21swapper/107:48:471
1181899544,34cyclictest0-21swapper/108:34:001
1181899543,35cyclictest0-21swapper/109:45:521
1181899543,35cyclictest0-21swapper/109:45:521
100382545,12sleep210201-21df_inode05:29:062
100382545,12sleep210201-21df_inode05:29:062
261062533,11sleep20-21swapper/208:51:442
248599530,5rtkit-daemon2484-21rtkit-daemon07:27:422
1181999534,26cyclictest0-21swapper/207:44:012
11819995335,11cyclictest5097-21unixbench_multi08:19:172
11819995335,11cyclictest5097-21unixbench_multi08:19:172
1181999533,44cyclictest0-21swapper/209:49:102
1181999533,42cyclictest0-21swapper/209:09:012
1181899534,32cyclictest0-21swapper/108:17:181
1181899534,31cyclictest0-21swapper/109:58:581
1181899533,24cyclictest0-21swapper/108:08:461
93982522,11sleep20-21swapper/210:49:152
44192523,41sleep10-21swapper/107:32:091
317962523,11sleep10-21swapper/107:20:321
20682523,12sleep10-21swapper/109:52:261
189142523,10sleep20-21swapper/205:48:152
139982524,12sleep10-21swapper/105:36:291
1181999528,35cyclictest0-21swapper/208:08:562
1181999524,40cyclictest0-21swapper/209:44:022
1181999524,40cyclictest0-21swapper/209:44:022
1181999524,40cyclictest0-21swapper/208:33:582
1181999524,29cyclictest0-21swapper/209:53:562
1181999523,41cyclictest0-21swapper/210:09:022
1181999523,28cyclictest0-21swapper/210:58:582
1181899526,29cyclictest0-21swapper/108:42:161
1181899525,29cyclictest0-21swapper/108:09:221
1181899524,27cyclictest0-21swapper/109:11:421
11818995233,11cyclictest29037-21cpuspeed_turbos06:09:051
11818995225,13cyclictest0-21swapper/108:57:561
11818995225,12cyclictest0-21swapper/108:59:081
11818995225,12cyclictest0-21swapper/108:59:081
11818995223,8cyclictest11153-21uname08:29:091
11818995221,13cyclictest0-21swapper/110:14:141
280372513,11sleep10-21swapper/109:43:351
248599510,5rtkit-daemon2484-21rtkit-daemon08:24:102
163912512,12sleep20-21swapper/205:41:302
1181999514,21cyclictest0-21swapper/210:56:092
11819995110,34cyclictest281ktimersoftd/207:59:042
1181899514,29cyclictest0-21swapper/110:38:421
1181899514,29cyclictest0-21swapper/109:03:591
1181899514,29cyclictest0-21swapper/109:03:591
1181899514,28cyclictest0-21swapper/105:49:141
248599500,5rtkit-daemon2484-21rtkit-daemon06:56:062
248599500,5rtkit-daemon2484-21rtkit-daemon06:56:062
193622503,9sleep219488-21cpuspeed_turbos05:49:042
139222502,11sleep20-21swapper/205:35:302
1181999508,35cyclictest4501-21grep06:24:092
1181999507,36cyclictest281ktimersoftd/207:34:002
1181999507,36cyclictest281ktimersoftd/207:34:002
1181999504,28cyclictest0-21swapper/206:29:022
1181999504,28cyclictest0-21swapper/206:09:202
11819995020,12cyclictest0-21swapper/206:49:162
11819995019,12cyclictest0-21swapper/207:39:072
1181899505,28cyclictest0-21swapper/108:44:091
1181899505,27cyclictest0-21swapper/110:28:421
1181899505,27cyclictest0-21swapper/110:28:421
1181899505,27cyclictest0-21swapper/110:05:511
1181899504,39cyclictest0-21swapper/107:04:211
1181899504,29cyclictest0-21swapper/106:39:061
1181899504,28cyclictest0-21swapper/106:44:181
1181899504,27cyclictest0-21swapper/110:49:421
1181899504,27cyclictest0-21swapper/105:59:021
11818995024,12cyclictest0-21swapper/108:26:511
11818995020,13cyclictest0-21swapper/106:29:191
11818995020,12cyclictest0-21swapper/110:43:521
11818995019,13cyclictest0-21swapper/107:54:551
6232493,11sleep10-21swapper/106:16:201
6232493,11sleep10-21swapper/106:16:201
294392492,13sleep20-21swapper/207:15:582
293452493,40sleep10-21swapper/107:14:441
1181999494,28cyclictest0-21swapper/207:04:242
1181999494,24cyclictest0-21swapper/208:44:002
11819994933,8cyclictest20446-21telnet06:59:002
11819994919,13cyclictest0-21swapper/206:04:082
1181899494,28cyclictest0-21swapper/109:29:051
1181899494,28cyclictest0-21swapper/108:49:061
1181899494,26cyclictest0-21swapper/110:58:471
1181899494,26cyclictest0-21swapper/107:09:151
1181899494,26cyclictest0-21swapper/106:38:501
1181899493,27cyclictest0-21swapper/108:21:171
1181899493,27cyclictest0-21swapper/108:21:171
1181899493,23cyclictest11888-21expr09:18:571
11818994918,13cyclictest0-21swapper/110:54:031
11818994918,13cyclictest0-21swapper/106:49:051
153112482,11sleep20-21swapper/206:48:332
1181999486,27cyclictest0-21swapper/207:29:082
1181999484,35cyclictest0-21swapper/205:54:072
1181899484,27cyclictest0-21swapper/107:59:021
1181899484,26cyclictest0-21swapper/110:29:091
1181999474,26cyclictest0-21swapper/207:19:102
1181899474,27cyclictest0-21swapper/105:43:521
1181899474,26cyclictest0-21swapper/106:04:101
11818994712,10cyclictest121850irq/46-eth005:44:051
114582474,6sleep00-21swapper/005:29:400
114582474,6sleep00-21swapper/005:29:400
31352462,12sleep20-21swapper/206:20:402
11818994618,12cyclictest0-21swapper/106:59:011
126922452,12sleep20-21swapper/206:40:312
1181999453,33cyclictest0-21swapper/206:03:522
1181899454,26cyclictest0-21swapper/105:54:021
11819994430,9cyclictest26051-21hwlatdetect07:09:092
1181899444,34cyclictest0-21swapper/105:33:531
1181899444,34cyclictest0-21swapper/105:33:531
11818994423,15cyclictest0-21swapper/106:24:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional