You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-28 - 15:14

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Tue Apr 28, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29414991033,47cyclictest2002-21timerandwakeup07:17:250
2941499994,41cyclictest0-21swapper/009:47:140
29414999436,10cyclictest30102-21unixbench_multi06:07:290
2941499924,27cyclictest0-21swapper/010:17:100
2941499924,12cyclictest0-21swapper/010:22:260
29414999235,12cyclictest0-21swapper/006:12:080
29414999139,45cyclictest0-21swapper/008:42:050
2941499904,45cyclictest0-21swapper/009:36:010
2941499904,27cyclictest0-21swapper/005:51:580
2941499904,24cyclictest0-21swapper/008:22:070
2941499904,24cyclictest0-21swapper/008:22:070
29414999034,11cyclictest0-21swapper/009:19:180
2941499903,29cyclictest0-21swapper/009:12:140
2941499893,47cyclictest0-21swapper/007:13:110
248599890,25rtkit-daemon0-21swapper/307:22:323
29414998816,32cyclictest22069-21sed07:47:150
2941499834,28cyclictest0-21swapper/008:52:070
248599830,5rtkit-daemon2484-21rtkit-daemon05:11:152
248599830,4rtkit-daemon2484-21rtkit-daemon09:39:052
40602790,3sleep118-21rcuc/109:44:251
40602790,3sleep118-21rcuc/109:44:251
248599790,6rtkit-daemon0-21swapper/307:32:100
248599780,11rtkit-daemon0-21swapper/209:57:043
248599750,5rtkit-daemon2484-21rtkit-daemon07:32:251
248599700,9rtkit-daemon0-21swapper/309:57:262
248599690,5rtkit-daemon2484-21rtkit-daemon07:37:241
248599690,5rtkit-daemon2484-21rtkit-daemon07:37:090
2941799685,42cyclictest0-21swapper/307:47:113
248599680,4rtkit-daemon2484-21rtkit-daemon08:00:241
248599680,4rtkit-daemon2484-21rtkit-daemon05:57:281
2941699673,12cyclictest18810-21cpuspeed_turbos10:06:582
248599670,6rtkit-daemon0-21swapper/308:13:083
248599670,4rtkit-daemon2484-21rtkit-daemon08:18:531
248599670,4rtkit-daemon2484-21rtkit-daemon06:17:131
2941699665,42cyclictest1419-21runrttasks09:13:122
248599660,7rtkit-daemon0-21swapper/309:17:133
248599660,6rtkit-daemon0-21swapper/207:17:253
248599660,4rtkit-daemon2484-21rtkit-daemon10:28:481
248599660,4rtkit-daemon2484-21rtkit-daemon10:28:481
248599660,4rtkit-daemon2484-21rtkit-daemon09:32:271
248599660,4rtkit-daemon2484-21rtkit-daemon09:30:201
248599650,4rtkit-daemon2484-21rtkit-daemon05:37:071
248599650,4rtkit-daemon2484-21rtkit-daemon05:37:071
248599650,4rtkit-daemon2484-21rtkit-daemon05:02:531
29417996414,41cyclictest13071-21fschecks_time08:22:103
29417996414,41cyclictest13071-21fschecks_time08:22:103
2941699645,12cyclictest0-21swapper/208:37:162
2941699644,42cyclictest0-21swapper/209:52:162
29416996412,35cyclictest0-21swapper/209:08:092
248599640,5rtkit-daemon26791-21ssh10:17:183
248599640,4rtkit-daemon2484-21rtkit-daemon08:13:231
248599640,4rtkit-daemon2484-21rtkit-daemon05:11:000
193342640,3sleep019331-21tr08:32:030
29417996313,42cyclictest31395-21gltestperf09:37:063
29414996230,25cyclictest0-21swapper/008:39:060
29414996220,26cyclictest32305-21unixbench_multi09:37:200
276352626,12sleep20-21swapper/208:42:272
248599620,7rtkit-daemon0-21swapper/210:10:333
248599620,6rtkit-daemon0-21swapper/307:19:252
248599620,5rtkit-daemon21082-21ssh09:22:053
248599620,5rtkit-daemon10935-21df_inode09:07:061
2941799614,37cyclictest5974-21ssh09:47:093
2941499614,25cyclictest0-21swapper/010:00:530
254462613,50sleep10-21swapper/108:41:451
16962613,50sleep20-21swapper/206:17:172
2941699604,49cyclictest11286-21ssh08:19:172
2941699604,39cyclictest0-21swapper/207:52:402
2941699604,13cyclictest0-21swapper/208:23:372
2941699604,13cyclictest0-21swapper/208:23:372
2941699604,12cyclictest0-21swapper/210:17:072
2941699604,12cyclictest0-21swapper/207:02:082
2941699604,12cyclictest0-21swapper/207:02:082
248599600,5rtkit-daemon30212-21ssh08:47:142
248599600,5rtkit-daemon0-21swapper/309:51:122
248599600,5rtkit-daemon0-21swapper/107:44:021
248599600,5rtkit-daemon0-21swapper/107:44:021
248599600,11rtkit-daemon2484-21rtkit-daemon05:36:520
29417995923,11cyclictest29956-21fschecks_time07:12:113
29417995915,37cyclictest0-21swapper/308:33:513
2941699594,12cyclictest0-21swapper/207:22:332
29416995914,27cyclictest0-21swapper/209:44:222
29416995914,27cyclictest0-21swapper/209:44:222
2941499593,46cyclictest0-21swapper/005:52:280
2941499593,39cyclictest0-21swapper/007:07:250
248599590,6rtkit-daemon0-21swapper/308:09:382
248599590,5rtkit-daemon0-21swapper/307:28:402
2941799589,42cyclictest28996-21unixbench_singl09:32:233
2941799589,41cyclictest0-21swapper/310:22:033
2941799587,45cyclictest0-21swapper/309:05:543
2941799587,45cyclictest0-21swapper/309:05:543
2941699584,13cyclictest0-21swapper/209:01:342
2941699584,13cyclictest0-21swapper/207:44:312
2941699584,13cyclictest0-21swapper/207:44:312
29414995837,14cyclictest0-21swapper/008:27:070
29414995836,15cyclictest0-21swapper/009:30:070
248599580,6rtkit-daemon0-21swapper/309:24:202
2941799578,32cyclictest0-21swapper/308:52:063
2941799578,31cyclictest30821-21ssh08:01:523
29417995711,27cyclictest0-21swapper/310:13:363
29415995721,27cyclictest445-21unixbench_singl08:02:261
29414995735,14cyclictest0-21swapper/007:22:110
248599570,5rtkit-daemon27660-21munin-node06:02:281
248599570,4rtkit-daemon17893-21python05:42:291
230902573,9sleep00-21swapper/009:25:100
16502573,9sleep11780-21timerwakeupswit08:52:211
11762573,48sleep20-21swapper/208:04:492
2941799567,42cyclictest25326-21sh08:41:183
2941799567,28cyclictest0-21swapper/307:42:163
2941799567,28cyclictest0-21swapper/307:42:163
2941799566,42cyclictest0-21swapper/306:51:553
2941799565,42cyclictest0-21swapper/309:42:043
2941799565,42cyclictest0-21swapper/309:42:043
2941799564,43cyclictest0-21swapper/308:47:093
2941699564,13cyclictest0-21swapper/210:11:542
2941699564,12cyclictest0-21swapper/209:27:212
2941699564,12cyclictest0-21swapper/208:13:492
2941599565,31cyclictest22125-21memory07:47:151
2941599564,37cyclictest0-21swapper/108:33:191
2941599564,37cyclictest0-21swapper/108:26:241
2941599564,37cyclictest0-21swapper/108:26:241
2941799558,31cyclictest9441-21df_abs08:17:053
2941799557,41cyclictest24973-21seq07:04:593
2941799557,41cyclictest24973-21seq07:04:593
29417995512,25cyclictest0-21swapper/310:27:033
29417995512,25cyclictest0-21swapper/310:27:033
29417995511,37cyclictest11505-21cut07:32:113
2941699554,34cyclictest0-21swapper/210:24:362
29416995538,10cyclictest136442sleep206:42:152
29415995538,10cyclictest19280-21df_abs05:47:111
2941499554,26cyclictest0-21swapper/010:06:360
29414995535,13cyclictest0-21swapper/006:47:090
29414995534,13cyclictest0-21swapper/007:42:050
29414995534,13cyclictest0-21swapper/007:42:050
223852553,9sleep10-21swapper/109:22:331
2941799549,39cyclictest0-21swapper/309:10:543
2941799549,38cyclictest0-21swapper/309:12:143
2941799547,40cyclictest0-21swapper/308:09:113
2941799547,27cyclictest0-21swapper/307:41:053
2941799545,42cyclictest0-21swapper/307:27:153
29417995412,13cyclictest0-21swapper/309:27:383
2941699544,30cyclictest0-21swapper/205:22:282
29416995435,11cyclictest7327-21grep09:02:032
29416995435,11cyclictest7327-21grep09:02:032
29416995414,23cyclictest0-21swapper/210:31:222
29416995414,23cyclictest0-21swapper/210:31:222
2941599546,40cyclictest0-21swapper/108:31:511
2941599544,28cyclictest1243-21lldpd05:27:191
2941599543,20cyclictest0-21swapper/109:12:411
2941499543,44cyclictest0-21swapper/008:57:150
2941499543,21cyclictest1419-21runrttasks08:20:000
29414995415,22cyclictest0-21swapper/007:02:100
29414995415,22cyclictest0-21swapper/007:02:100
248599540,5rtkit-daemon2484-21rtkit-daemon04:57:161
46482533,9sleep00-21swapper/008:09:430
2941799539,27cyclictest0-21swapper/309:54:383
2941799537,39cyclictest0-21swapper/307:52:073
2941799536,12cyclictest0-21swapper/308:27:203
2941799534,29cyclictest0-21swapper/306:57:063
29417995325,9cyclictest32239-21cat08:02:163
29417995316,22cyclictest16155-21munin-node10:02:073
29417995310,35cyclictest1419-21runrttasks06:22:063
29417995310,35cyclictest1419-21runrttasks06:22:063
29417995310,26cyclictest26003-21cat08:42:033
2941699534,41cyclictest0-21swapper/208:32:142
2941699534,30cyclictest0-21swapper/205:57:162
2941699534,21cyclictest0-21swapper/209:31:532
29416995321,13cyclictest0-21swapper/206:52:172
29416995313,24cyclictest0-21swapper/207:16:162
29416995312,22cyclictest0-21swapper/210:02:102
2941599535,14cyclictest0-21swapper/107:22:551
2941599534,28cyclictest0-21swapper/109:04:551
2941599534,28cyclictest0-21swapper/109:04:551
29415995322,13cyclictest0-21swapper/105:52:341
29415995314,20cyclictest0-21swapper/106:42:081
2941499534,31cyclictest0-21swapper/008:48:320
29414995321,14cyclictest0-21swapper/005:46:570
248599530,5rtkit-daemon2484-21rtkit-daemon09:37:051
248599530,5rtkit-daemon2484-21rtkit-daemon06:27:201
2941799524,12cyclictest0-21swapper/309:01:413
29417995234,11cyclictest30495-21cut05:02:203
2941799523,41cyclictest0-21swapper/306:42:103
29417995220,24cyclictest10583-21tail06:37:083
29417995211,34cyclictest20994-21idleruntime-cro05:51:563
29417995210,36cyclictest19765-21crond06:56:533
2941699525,25cyclictest15741-21python07:37:232
2941699524,39cyclictest0-21swapper/208:52:122
2941699524,31cyclictest0-21swapper/207:32:122
2941699524,30cyclictest0-21swapper/208:27:062
2941699524,30cyclictest0-21swapper/207:57:232
2941699524,29cyclictest0-21swapper/207:07:182
2941699524,29cyclictest0-21swapper/205:02:202
2941699524,13cyclictest0-21swapper/209:20:412
2941599525,29cyclictest0-21swapper/107:17:151
2941599525,28cyclictest0-21swapper/107:27:111
2941599524,28cyclictest4981-21munin-node09:47:081
2941599524,13cyclictest15551-21df10:02:001
29415995233,12cyclictest31085-21unixbench_singl07:12:271
29415995215,32cyclictest0-21swapper/110:22:101
2941499524,29cyclictest0-21swapper/005:06:580
29414995238,10cyclictest0-21swapper/009:51:570
186152523,41sleep20-21swapper/205:46:582
17102523,9sleep00-21swapper/008:06:400
122482526,38sleep20-21swapper/205:32:142
102822523,9sleep10-21swapper/109:52:371
84572514,9sleep00-21swapper/008:16:160
35752513,8sleep129406-21cyclictest05:12:301
2941799516,37cyclictest0-21swapper/306:31:553
2941799514,30cyclictest0-21swapper/307:07:053
29417995117,16cyclictest0-21swapper/306:17:133
29417995110,25cyclictest0-21swapper/306:12:243
2941699514,29cyclictest0-21swapper/206:11:552
29416995128,8cyclictest21354-21yum-updatesd-he07:47:132
2941599517,27cyclictest0-21swapper/108:47:071
2941599515,27cyclictest0-21swapper/105:32:291
2941599515,14cyclictest0-21swapper/107:52:251
2941599514,41cyclictest0-21swapper/108:57:011
2941599514,28cyclictest0-21swapper/110:11:591
29415995135,10cyclictest28693-21cpuspeed_turbos06:07:091
29415995124,12cyclictest0-21swapper/108:08:221
2941499514,26cyclictest0-21swapper/009:41:590
2941499514,26cyclictest0-21swapper/009:41:590
2941499514,26cyclictest0-21swapper/007:30:300
29414995133,11cyclictest3609-21cpuspeed_turbos06:22:090
29414995133,11cyclictest3609-21cpuspeed_turbos06:22:090
2941499513,27cyclictest0-21swapper/007:56:250
257932513,9sleep10-21swapper/107:07:031
248599510,5rtkit-daemon2484-21rtkit-daemon10:28:100
248599510,5rtkit-daemon2484-21rtkit-daemon10:28:100
2941799508,25cyclictest0-21swapper/306:07:183
2941799505,38cyclictest0-21swapper/305:53:063
29417995032,10cyclictest14105-21aten_r1power_en05:37:083
29417995032,10cyclictest14105-21aten_r1power_en05:37:083
2941799503,27cyclictest1282-21unixbench_multi05:07:293
29417995013,11cyclictest11430-21munin-plugin-st05:31:573
2941699504,27cyclictest0-21swapper/207:01:192
2941699504,27cyclictest0-21swapper/205:37:082
2941699504,27cyclictest0-21swapper/205:37:082
2941699504,26cyclictest15301-21yum-updatesd-he06:47:192
29416995019,13cyclictest0-21swapper/205:12:302
2941599504,28cyclictest0-21swapper/109:59:421
2941599504,28cyclictest0-21swapper/105:22:301
2941599504,27cyclictest0-21swapper/107:02:231
2941599504,27cyclictest0-21swapper/107:02:231
2941499504,29cyclictest0-21swapper/010:12:100
29414995036,10cyclictest0-21swapper/009:06:190
29414995036,10cyclictest0-21swapper/009:06:190
248599500,5rtkit-daemon2484-21rtkit-daemon05:17:150
248599500,5rtkit-daemon2484-21rtkit-daemon05:07:531
191302503,41sleep10-21swapper/109:17:571
2941799499,25cyclictest23619-21munin-node05:57:163
2941799496,36cyclictest16608-21runrttasks05:42:113
2941799496,24cyclictest8659-21fschecks_count06:32:113
29417994919,12cyclictest0-21swapper/305:16:583
2941699494,28cyclictest0-21swapper/206:12:162
2941699494,27cyclictest0-21swapper/206:02:102
2941699494,27cyclictest0-21swapper/205:52:182
2941699494,27cyclictest0-21swapper/205:17:262
2941699493,28cyclictest0-21swapper/206:27:082
29416994918,12cyclictest0-21swapper/206:32:142
2941599495,22cyclictest27084-21ntp_states08:42:181
2941599494,27cyclictest0-21swapper/106:22:261
2941599494,27cyclictest0-21swapper/106:22:261
2941599494,27cyclictest0-21swapper/106:12:251
29415994933,10cyclictest6165-21unixbench-2d05:17:311
29415994929,13cyclictest16903-21unixbench_multi06:47:291
29415994920,12cyclictest0-21swapper/110:16:521
2941499494,28cyclictest0-21swapper/005:22:170
2941499494,27cyclictest0-21swapper/005:57:190
2941499494,26cyclictest0-21swapper/007:58:130
2941499493,29cyclictest0-21swapper/006:52:150
2941499493,27cyclictest0-21swapper/005:41:030
2941499493,27cyclictest0-21swapper/005:41:030
29414994929,14cyclictest0-21swapper/009:07:080
278822492,9sleep00-21swapper/006:03:290
114072492,40sleep00-21swapper/005:31:480
2941799485,24cyclictest0-21swapper/305:32:083
2941699484,24cyclictest0-21swapper/206:22:062
2941699484,24cyclictest0-21swapper/206:22:062
29416994819,12cyclictest19066-21yum-updatesd-he05:47:132
2941599484,27cyclictest0-21swapper/106:37:211
2941499484,27cyclictest0-21swapper/006:17:140
212272483,39sleep10-21swapper/110:10:351
210132482,40sleep00-21swapper/010:09:490
2941799476,34cyclictest1419-21runrttasks05:20:253
2941799475,13cyclictest0-21swapper/305:01:583
2941699475,11cyclictest0-21swapper/206:37:192
29415994730,10cyclictest8840-21grep06:32:131
2941499474,35cyclictest0-21swapper/006:27:060
292502473,37sleep00-21swapper/005:00:200
2941799464,25cyclictest0-21swapper/306:04:433
2941699464,32cyclictest0-21swapper/205:27:272
2941599465,33cyclictest0-21swapper/106:57:061
2941599465,12cyclictest0-21swapper/106:52:051
2941499464,36cyclictest0-21swapper/006:42:080
2941499464,26cyclictest0-21swapper/007:01:190
29414994627,14cyclictest0-21swapper/006:32:130
124542462,38sleep00-21swapper/006:40:250
29416994518,7cyclictest29389-21latency_hist05:01:592
2941499453,36cyclictest24492sleep005:12:120
29417994427,10cyclictest7701-21gltestperf05:22:183
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional