You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-22 - 21:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Mon Dec 22, 2025 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3267721040,4chrt32680-21latency_hist08:51:100
248599800,4rtkit-daemon2484-21rtkit-daemon11:06:530
248599770,4rtkit-daemon2484-21rtkit-daemon07:12:022
248599750,5rtkit-daemon2484-21rtkit-daemon12:01:432
248599750,5rtkit-daemon2484-21rtkit-daemon12:01:432
1104527511,54sleep00-21swapper/006:56:330
1104527511,54sleep00-21swapper/006:56:330
248599740,4rtkit-daemon2484-21rtkit-daemon08:35:442
248599710,8rtkit-daemon0-21swapper/208:35:290
248599710,7rtkit-daemon0-21swapper/210:56:313
248599680,8rtkit-daemon0-21swapper/208:36:593
248599670,7rtkit-daemon0-21swapper/207:11:400
248599670,6rtkit-daemon5274-21strings07:51:383
248599670,6rtkit-daemon0-21swapper/208:02:003
248599670,5rtkit-daemon4109-21ntp_kernel_pll_08:56:353
248599660,6rtkit-daemon0-21swapper/212:28:053
248599660,6rtkit-daemon0-21swapper/209:11:053
248599660,6rtkit-daemon0-21swapper/209:11:053
248599660,6rtkit-daemon0-21swapper/207:18:393
248599660,5rtkit-daemon0-21swapper/212:15:353
248599660,5rtkit-daemon0-21swapper/211:17:073
248599650,5rtkit-daemon26-21rcuc/212:01:360
248599650,5rtkit-daemon26-21rcuc/212:01:360
248599650,5rtkit-daemon0-21swapper/212:09:433
248599650,5rtkit-daemon0-21swapper/211:52:443
248599650,5rtkit-daemon0-21swapper/211:21:453
248599650,5rtkit-daemon0-21swapper/210:39:013
248599650,5rtkit-daemon0-21swapper/209:14:353
248599650,4rtkit-daemon0-21swapper/207:47:013
12269996515,11cyclictest22745-21tune2fs07:21:320
248599640,7rtkit-daemon0-21swapper/207:08:253
248599640,6rtkit-daemon23118-21munin-node10:46:393
248599640,6rtkit-daemon0-21swapper/210:26:323
248599640,6rtkit-daemon0-21swapper/208:46:363
248599640,6rtkit-daemon0-21swapper/208:27:593
248599640,6rtkit-daemon0-21swapper/208:15:523
248599640,5rtkit-daemon0-21swapper/212:03:283
248599640,5rtkit-daemon0-21swapper/212:03:283
248599640,5rtkit-daemon0-21swapper/209:52:113
248599640,5rtkit-daemon0-21swapper/209:04:053
248599630,6rtkit-daemon0-21swapper/212:25:353
248599630,6rtkit-daemon0-21swapper/208:44:513
248599630,6rtkit-daemon0-21swapper/107:57:080
248599630,5rtkit-daemon0-21swapper/209:56:483
248599630,5rtkit-daemon0-21swapper/209:42:563
248599630,4rtkit-daemon0-21swapper/209:35:193
248599620,6rtkit-daemon0-21swapper/209:22:423
248599620,6rtkit-daemon0-21swapper/208:17:223
248599620,6rtkit-daemon0-21swapper/207:29:313
248599620,5rtkit-daemon0-21swapper/211:28:003
248599620,5rtkit-daemon0-21swapper/210:16:473
248599620,5rtkit-daemon0-21swapper/207:12:403
248599620,5rtkit-daemon0-21swapper/207:02:553
248599620,4rtkit-daemon0-21swapper/211:34:073
248599620,4rtkit-daemon0-21swapper/210:01:553
248599620,4rtkit-daemon0-21swapper/208:54:063
248599620,3rtkit-daemon0-21swapper/208:00:003
248599610,7rtkit-daemon0-21swapper/209:46:413
248599610,7rtkit-daemon0-21swapper/209:46:413
248599610,6rtkit-daemon0-21swapper/210:51:313
248599610,6rtkit-daemon0-21swapper/210:34:023
248599610,6rtkit-daemon0-21swapper/210:34:023
248599610,5rtkit-daemon0-21swapper/210:11:483
248599610,4rtkit-daemon0-21swapper/209:28:573
248599610,4rtkit-daemon0-21swapper/207:33:463
12275996127,14cyclictest0-21swapper/311:41:163
12269996110,32cyclictest0-21swapper/009:51:190
248599600,7rtkit-daemon0-21swapper/107:46:532
248599600,6rtkit-daemon0-21swapper/211:07:153
248599600,5rtkit-daemon0-21swapper/211:36:523
248599600,4rtkit-daemon0-21swapper/212:16:353
1226999608,44cyclictest0-21swapper/012:26:350
12269996010,43cyclictest0-21swapper/007:06:340
248599590,7rtkit-daemon0-21swapper/107:57:382
248599590,6rtkit-daemon0-21swapper/109:36:410
248599580,7rtkit-daemon0-21swapper/109:12:570
248599580,5rtkit-daemon2484-21rtkit-daemon10:10:401
248599580,5rtkit-daemon2484-21rtkit-daemon09:12:421
1226999589,33cyclictest0-21swapper/009:26:310
12269995815,35cyclictest2353-21tune2fs07:46:300
12269995811,29cyclictest24465-21basename07:26:220
12269995810,26cyclictest28584-21open_inodes12:06:310
248599570,6rtkit-daemon0-21swapper/110:11:032
248599570,5rtkit-daemon2484-21rtkit-daemon09:02:051
248599570,5rtkit-daemon2484-21rtkit-daemon07:56:531
1226999578,41cyclictest0-21swapper/010:51:340
12269995738,11cyclictest14399-21grep10:26:250
12269995712,27cyclictest0-21swapper/010:36:070
12269995712,27cyclictest0-21swapper/010:36:070
248599560,8rtkit-daemon0-21swapper/111:12:232
248599560,4rtkit-daemon2484-21rtkit-daemon07:46:381
1227499563,11cyclictest0-21swapper/208:41:232
1226999565,30cyclictest0-21swapper/010:26:060
292172552,45sleep10-21swapper/112:08:201
248599550,6rtkit-daemon2484-21rtkit-daemon08:25:071
248599550,6rtkit-daemon2484-21rtkit-daemon08:25:071
248599550,6rtkit-daemon0-21swapper/110:32:242
248599550,6rtkit-daemon0-21swapper/110:32:242
248599550,6rtkit-daemon0-21swapper/109:13:502
12274995538,10cyclictest9107-21tr10:16:232
1227499553,12cyclictest0-21swapper/208:11:452
1226999558,29cyclictest0-21swapper/010:36:270
1226999557,41cyclictest0-21swapper/011:16:300
1226999557,40cyclictest0-21swapper/008:26:420
1226999554,42cyclictest0-21swapper/010:01:260
12269995527,21cyclictest0-21swapper/008:18:060
12269995516,31cyclictest0-21swapper/008:41:250
12269995513,35cyclictest1419-21runrttasks11:38:220
248599540,7rtkit-daemon0-21swapper/111:07:082
248599540,6rtkit-daemon0-21swapper/109:41:492
248599540,6rtkit-daemon0-21swapper/108:25:222
248599540,6rtkit-daemon0-21swapper/108:25:222
248599540,5rtkit-daemon2484-21rtkit-daemon11:12:001
248599540,4rtkit-daemon2484-21rtkit-daemon10:32:091
248599540,4rtkit-daemon2484-21rtkit-daemon10:32:091
248599540,4rtkit-daemon2484-21rtkit-daemon09:41:341
163352544,43sleep10-21swapper/109:21:431
12275995422,13cyclictest0-21swapper/307:36:373
12275995422,13cyclictest0-21swapper/307:36:373
12275995421,13cyclictest0-21swapper/307:41:453
12275995421,13cyclictest0-21swapper/307:41:453
12274995435,12cyclictest21206-21unixbench_multi11:46:362
12273995423,8cyclictest24115-21latency_hist09:41:081
1226999549,38cyclictest0-21swapper/010:46:230
1226999549,17cyclictest0-21swapper/011:41:160
1226999548,28cyclictest0-21swapper/009:16:280
1226999545,32cyclictest0-21swapper/010:41:180
1226999543,43cyclictest1676-21nscd11:31:030
88942533,43sleep20-21swapper/209:06:372
88942533,43sleep20-21swapper/209:06:372
248599530,7rtkit-daemon0-21swapper/109:02:202
1227599535,28cyclictest0-21swapper/307:21:383
1227599535,27cyclictest0-21swapper/311:46:313
12274995323,23cyclictest0-21swapper/209:40:562
1227399534,18cyclictest0-21swapper/111:41:331
12273995333,13cyclictest0-21swapper/111:21:331
1226999539,28cyclictest0-21swapper/011:01:230
1226999538,38cyclictest0-21swapper/009:46:240
1226999538,38cyclictest0-21swapper/009:46:240
1226999538,28cyclictest0-21swapper/011:46:230
1226999536,40cyclictest0-21swapper/007:16:300
12269995321,10cyclictest315791munin-node07:41:240
12269995321,10cyclictest315791munin-node07:41:240
12269995313,33cyclictest599-21timerandwakeup09:56:410
12269995311,35cyclictest31335-21yum-updatesd-he07:41:120
12269995311,35cyclictest31335-21yum-updatesd-he07:41:120
103922534,40sleep310577-21df_abs06:56:283
103922534,40sleep310577-21df_abs06:56:283
248599520,5rtkit-daemon2484-21rtkit-daemon09:41:190
248599520,5rtkit-daemon2484-21rtkit-daemon09:01:350
248599520,5rtkit-daemon0-21swapper/212:00:583
1227599524,24cyclictest24118-21crond09:41:073
12275995219,13cyclictest0-21swapper/309:16:383
1227499524,11cyclictest0-21swapper/208:16:312
1227499523,10cyclictest0-21swapper/207:36:292
1227499523,10cyclictest0-21swapper/207:36:292
1227399524,30cyclictest0-21swapper/107:31:351
1227399524,29cyclictest0-21swapper/109:31:201
1226999527,39cyclictest0-21swapper/011:23:420
1226999527,29cyclictest0-21swapper/007:51:240
1226999524,32cyclictest0-21swapper/012:21:020
12269995221,13cyclictest0-21swapper/009:06:340
12269995221,13cyclictest0-21swapper/009:06:340
1226999522,43cyclictest0-21swapper/012:11:200
12269995211,22cyclictest16894-21runrttasks09:25:270
239572512,43sleep10-21swapper/107:23:171
191122512,41sleep10-21swapper/107:12:171
1227599515,27cyclictest0-21swapper/311:01:413
1227599515,27cyclictest0-21swapper/310:21:273
1227599514,28cyclictest0-21swapper/310:06:183
12274995134,10cyclictest30023-21tr12:11:152
12274995132,11cyclictest7879-21cpuspeed_turbos11:21:172
12274995132,11cyclictest15234-21cpuspeed_turbos07:06:302
1227499513,9cyclictest20732-21munin-node10:41:192
12274995120,9cyclictest25592-21telnet08:36:222
1227399514,29cyclictest0-21swapper/110:11:231
1227399514,29cyclictest0-21swapper/108:51:441
12273995130,14cyclictest0-21swapper/110:41:281
12273995122,12cyclictest0-21swapper/110:29:121
1226999519,36cyclictest0-21swapper/011:00:480
1226999517,19cyclictest0-21swapper/010:16:260
1226999515,39cyclictest0-21swapper/008:36:310
1226999515,37cyclictest0-21swapper/010:11:210
1226999514,40cyclictest0-21swapper/009:31:300
40702502,42sleep10-21swapper/112:23:041
248599500,5rtkit-daemon2484-21rtkit-daemon11:11:380
248599500,5rtkit-daemon2484-21rtkit-daemon08:21:440
248599500,5rtkit-daemon2484-21rtkit-daemon08:21:440
213782502,9sleep10-21swapper/111:47:371
1227599505,27cyclictest0-21swapper/311:13:133
12275995020,13cyclictest0-21swapper/308:21:243
12275995020,13cyclictest0-21swapper/308:21:243
1227499505,39cyclictest0-21swapper/212:26:202
1227499505,27cyclictest0-21swapper/211:41:192
1227499504,28cyclictest0-21swapper/210:11:252
12274995034,10cyclictest12927-21grep10:21:402
1227399504,25cyclictest0-21swapper/108:26:251
12273995020,13cyclictest0-21swapper/107:41:301
12273995020,13cyclictest0-21swapper/107:41:301
1226999505,38cyclictest0-21swapper/008:06:300
1226999505,29cyclictest0-21swapper/010:07:050
1226999504,27cyclictest0-21swapper/007:31:490
12269995032,11cyclictest12665-21grep11:31:180
1226999503,29cyclictest0-21swapper/008:56:100
12269995019,13cyclictest0-21swapper/008:56:300
95432493,40sleep29638-21fschecks_time08:01:312
322772492,9sleep10-21swapper/108:48:261
320982492,41sleep10-21swapper/109:56:251
315692492,40sleep10-21swapper/112:12:521
286422492,39sleep10-21swapper/109:48:031
286422492,39sleep10-21swapper/109:48:031
227072492,9sleep20-21swapper/208:28:082
202232492,9sleep10-21swapper/110:37:401
189982492,9sleep10-21swapper/109:26:471
1227599494,26cyclictest0-21swapper/310:41:183
1227599494,25cyclictest0-21swapper/308:06:243
1227499493,28cyclictest0-21swapper/210:01:242
1227499493,19cyclictest0-21swapper/211:00:522
1227399494,28cyclictest0-21swapper/111:31:211
1227399494,28cyclictest0-21swapper/111:16:191
1227399494,28cyclictest0-21swapper/110:46:381
1227399494,28cyclictest0-21swapper/107:36:341
1227399494,28cyclictest0-21swapper/107:36:341
1227399494,27cyclictest0-21swapper/111:51:401
1227399494,27cyclictest0-21swapper/109:51:311
1227399494,27cyclictest0-21swapper/109:16:411
1227399494,26cyclictest0-21swapper/111:01:051
1227399494,12cyclictest0-21swapper/110:55:471
12273994933,10cyclictest4780-21fschecks_time07:51:311
1226999496,36cyclictest2040-21munin-node12:21:270
12269994911,12cyclictest23094-21needreboot11:51:290
238862482,9sleep20-21swapper/207:22:222
159752482,9sleep20-21swapper/209:21:362
1227599484,25cyclictest0-21swapper/308:35:073
1227499485,26cyclictest0-21swapper/210:26:392
1227499484,27cyclictest0-21swapper/211:03:232
1227499484,27cyclictest0-21swapper/210:46:292
1227499484,27cyclictest0-21swapper/207:51:282
12274994832,10cyclictest29032-21unixbench_singl12:06:362
1227499483,9cyclictest12272-21iostat_ios08:06:352
1227499483,27cyclictest0-21swapper/210:51:242
1227499483,27cyclictest0-21swapper/208:56:252
12274994820,12cyclictest0-21swapper/211:36:222
12274994819,14cyclictest0-21swapper/208:51:282
1227399484,29cyclictest0-21swapper/112:21:031
1227399484,27cyclictest0-21swapper/112:01:341
1227399484,27cyclictest0-21swapper/112:01:341
1227399484,27cyclictest0-21swapper/111:36:281
1227399484,27cyclictest0-21swapper/110:01:341
1227399484,27cyclictest0-21swapper/107:06:291
1227399484,26cyclictest0-21swapper/107:26:461
1227399483,27cyclictest0-21swapper/111:31:031
12273994828,13cyclictest0-21swapper/109:06:411
12273994828,13cyclictest0-21swapper/109:06:411
12273994826,14cyclictest0-21swapper/108:16:231
1226999486,36cyclictest0-21swapper/007:01:280
91952472,39sleep10-21swapper/110:16:241
310582472,9sleep20-21swapper/209:53:122
133612472,39sleep10-21swapper/108:10:451
12274994731,9cyclictest26192-21grep07:26:442
12274994730,11cyclictest10261-21cpuspeed_turbos11:26:202
1227499473,27cyclictest0-21swapper/211:16:172
1227499473,26cyclictest0-21swapper/207:41:282
1227499473,26cyclictest0-21swapper/207:41:282
1227399475,25cyclictest0-21swapper/108:31:231
1227399474,26cyclictest0-21swapper/111:10:501
1227399474,26cyclictest0-21swapper/108:36:291
1227399474,25cyclictest0-21swapper/111:05:481
1226999474,26cyclictest0-21swapper/008:01:260
64382462,38sleep10-21swapper/112:27:511
299362462,38sleep10-21swapper/108:43:591
244132462,37sleep20-21swapper/211:57:532
1227499463,25cyclictest0-21swapper/209:18:272
12274994617,13cyclictest0-21swapper/210:36:282
1227399464,26cyclictest0-21swapper/112:00:591
1226999469,31cyclictest14323-21fschecks_time08:11:300
1226999468,32cyclictest0-21swapper/012:00:590
141492452,9sleep20-21swapper/211:31:502
1227499453,35cyclictest0-21swapper/209:35:582
1227499453,30cyclictest0-21swapper/209:26:232
1227499453,27cyclictest0-21swapper/209:48:252
1227499453,27cyclictest0-21swapper/209:48:252
12274994528,11cyclictest3022-21grep12:21:242
12274994519,12cyclictest0-21swapper/207:31:262
1227399454,13cyclictest0-21swapper/107:16:371
1227399453,24cyclictest14482-21gltestperf08:11:321
12273994517,12cyclictest0-21swapper/108:56:201
1227499443,25cyclictest0-21swapper/211:51:282
1227499442,36cyclictest0-21swapper/208:46:202
1227399445,25cyclictest0-21swapper/108:01:331
216542433,9sleep20-21swapper/207:19:232
1227499433,11cyclictest0-21swapper/209:56:292
12274994315,13cyclictest0-21swapper/212:16:132
12273994324,12cyclictest0-21swapper/107:01:321
1227399424,21cyclictest0-21swapper/110:21:191
1227499403,12cyclictest0-21swapper/207:01:282
1227399383,30cyclictest0-21swapper/107:01:141
1227399383,30cyclictest0-21swapper/107:01:141
1148923811,15sleep20-21swapper/206:56:392
1148923811,15sleep20-21swapper/206:56:392
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional