You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-16 - 19:10

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Thu Apr 16, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2408521100,10sleep22995699cyclictest08:48:342
29953991004,78cyclictest0-21swapper/008:27:360
2995399984,29cyclictest0-21swapper/010:38:030
29953999718,13cyclictest0-21swapper/008:03:290
29953999718,13cyclictest0-21swapper/008:03:290
2995399965,27cyclictest0-21swapper/010:18:270
2995399964,32cyclictest0-21swapper/009:31:010
2995399964,32cyclictest0-21swapper/009:31:010
2995399964,27cyclictest0-21swapper/005:28:400
29953999621,12cyclictest0-21swapper/009:19:200
29953999511,23cyclictest22332-21kworker/0:110:28:120
2995399944,27cyclictest0-21swapper/007:03:380
2995399944,26cyclictest0-21swapper/010:17:580
29953999415,23cyclictest0-21swapper/010:06:300
29953999415,23cyclictest0-21swapper/010:06:300
2995399936,26cyclictest0-21swapper/010:08:340
2995399936,26cyclictest0-21swapper/010:08:340
2995399934,26cyclictest0-21swapper/009:52:340
2995399927,23cyclictest0-21swapper/009:37:440
2995399914,78cyclictest0-21swapper/005:23:140
2995399914,28cyclictest0-21swapper/005:58:300
29953999120,12cyclictest0-21swapper/007:53:310
2995399906,24cyclictest0-21swapper/008:15:490
2995399904,27cyclictest0-21swapper/010:02:530
2995399903,69cyclictest0-21swapper/008:36:470
2995399894,76cyclictest0-21swapper/006:53:360
2995399894,31cyclictest0-21swapper/007:13:100
2995399893,27cyclictest0-21swapper/009:08:230
29953998913,23cyclictest0-21swapper/005:23:310
2995399889,11cyclictest0-21swapper/008:43:320
2995399889,11cyclictest0-21swapper/008:43:320
2995399887,25cyclictest0-21swapper/009:42:190
2995399887,24cyclictest0-21swapper/009:55:480
2995399885,25cyclictest0-21swapper/007:27:240
2995399885,25cyclictest0-21swapper/007:27:240
2995399884,28cyclictest0-21swapper/007:58:250
2995399884,27cyclictest0-21swapper/006:08:340
2995399884,27cyclictest0-21swapper/006:08:340
2995399884,12cyclictest0-21swapper/010:24:180
2995399883,27cyclictest0-21swapper/008:48:330
2995399883,27cyclictest0-21swapper/008:08:240
2995399883,27cyclictest0-21swapper/007:43:340
29953998826,55cyclictest0-21swapper/010:38:140
29953998822,9cyclictest950-21munin-node07:28:410
248599880,11rtkit-daemon0-21swapper/005:13:310
2995399879,9cyclictest121850irq/46-eth009:44:410
2995399878,22cyclictest0-21swapper/007:35:410
2995399874,26cyclictest0-21swapper/006:06:000
2995399869,9cyclictest31092-21turbostat06:23:120
2995399864,74cyclictest0-21swapper/007:51:520
2995399864,26cyclictest0-21swapper/009:27:460
2995399864,26cyclictest0-21swapper/009:27:460
2995399864,12cyclictest0-21swapper/008:30:130
29953998619,12cyclictest0-21swapper/007:38:420
2995399859,9cyclictest27452-21ssh07:18:330
2995399857,24cyclictest0-21swapper/008:41:130
2995399854,73cyclictest0-21swapper/006:58:400
2995399854,72cyclictest0-21swapper/009:03:320
29953998518,13cyclictest0-21swapper/009:14:150
2995399844,28cyclictest0-21swapper/005:33:360
2995399844,28cyclictest0-21swapper/005:33:360
2995399844,27cyclictest0-21swapper/006:51:070
2995399844,27cyclictest0-21swapper/006:51:070
2995399834,12cyclictest0-21swapper/006:13:380
29953998320,11cyclictest0-21swapper/006:23:300
29953998315,9cyclictest0-21swapper/008:53:380
2995399829,9cyclictest3030-21ssh08:18:230
2995399825,11cyclictest0-21swapper/008:58:220
2995399824,16cyclictest0-21swapper/005:57:120
2995399824,12cyclictest0-21swapper/007:14:060
2995399823,9cyclictest6934-21fschecks_time06:38:300
2995399823,24cyclictest0-21swapper/006:28:220
29953998111,13cyclictest0-21swapper/005:45:570
2995399805,25cyclictest0-21swapper/006:46:060
29953998021,7cyclictest16743-21latency_hist05:53:140
2995399784,12cyclictest0-21swapper/006:36:050
2995399782,23cyclictest0-21swapper/005:13:140
2995399764,30cyclictest0-21swapper/005:38:270
248599720,5rtkit-daemon2484-21rtkit-daemon09:28:213
248599720,5rtkit-daemon2484-21rtkit-daemon09:28:213
2995499684,54cyclictest13202-21df_abs08:33:231
2995499674,55cyclictest0-21swapper/109:58:031
29954996724,35cyclictest850-21unixbench_multi08:13:411
29957996546,11cyclictest21108-21ssh07:58:013
29957996545,11cyclictest1565-21timerwakeupswit10:38:363
2995499643,24cyclictest24892-1kworker/1:1H07:23:091
2995799632,56cyclictest0-21swapper/307:33:363
2995499633,52cyclictest0-21swapper/107:38:291
2995499633,11cyclictest30261-21grep08:58:251
29957996241,12cyclictest29686-21python08:08:403
29957996221,24cyclictest0-21swapper/308:17:003
29954996244,11cyclictest6824-21gltestperf08:23:251
248599620,5rtkit-daemon2484-21rtkit-daemon08:13:312
2995799614,13cyclictest0-21swapper/308:23:393
2995499614,50cyclictest13014-21timerwakeupswit07:43:421
67152604,49sleep10-21swapper/109:58:331
324862604,13sleep30-21swapper/307:26:033
324862604,13sleep30-21swapper/307:26:033
29957996041,12cyclictest0-21swapper/307:48:363
2995799603,50cyclictest0-21swapper/307:45:453
2995799602,53cyclictest0-21swapper/308:48:243
2995499604,49cyclictest0-21swapper/109:29:021
2995499604,49cyclictest0-21swapper/109:29:021
2995499604,48cyclictest0-21swapper/109:48:001
2995499603,50cyclictest0-21swapper/109:23:351
2995499603,50cyclictest0-21swapper/109:23:351
2995499594,48cyclictest0-21swapper/108:58:011
2995499594,47cyclictest0-21swapper/108:28:241
2995499594,37cyclictest0-21swapper/107:35:321
29954995939,12cyclictest24463-21cpuspeed_turbos06:08:271
29954995939,12cyclictest24463-21cpuspeed_turbos06:08:271
2995499593,50cyclictest0-21swapper/107:48:311
2995499593,48cyclictest0-21swapper/105:43:401
29954995918,24cyclictest12-21rcu_preempt10:33:161
2995799582,51cyclictest0-21swapper/309:33:293
2995799582,50cyclictest0-21swapper/309:58:593
2995699583,48cyclictest0-21swapper/208:58:382
2995499584,48cyclictest0-21swapper/107:28:401
2995499583,50cyclictest0-21swapper/110:10:581
2995499583,50cyclictest0-21swapper/110:10:581
2995499583,48cyclictest0-21swapper/109:08:221
2995499583,46cyclictest0-21swapper/110:16:011
42322572,17sleep30-21swapper/309:55:003
29957995742,8cyclictest0-21swapper/310:03:153
29957995742,8cyclictest0-21swapper/310:03:153
29957995738,14cyclictest0-21swapper/307:59:043
29957995738,13cyclictest0-21swapper/310:34:373
2995799573,47cyclictest3095-21grep05:23:283
29957995728,9cyclictest25331-21load09:38:303
29957995727,14cyclictest0-21swapper/310:22:163
2995799572,50cyclictest0-21swapper/309:15:103
2995799572,50cyclictest0-21swapper/307:41:123
2995799572,50cyclictest0-21swapper/307:29:283
29957995713,26cyclictest0-21swapper/307:21:263
2995699573,16cyclictest0-21swapper/209:56:102
2995499575,29cyclictest1419-21runrttasks08:40:591
2995499574,46cyclictest0-21swapper/109:38:201
2995499574,46cyclictest0-21swapper/108:19:181
2995499574,46cyclictest0-21swapper/108:03:231
2995499574,46cyclictest0-21swapper/108:03:231
2995499573,48cyclictest0-21swapper/108:00:081
29954995718,32cyclictest11234-21sendmail_mailqu05:38:441
29954995714,20cyclictest0-21swapper/108:48:201
267002572,48sleep20-21swapper/209:41:042
2995799564,46cyclictest0-21swapper/308:58:293
2995799564,36cyclictest0-21swapper/307:16:553
29957995622,14cyclictest0-21swapper/309:48:283
2995699563,38cyclictest0-21swapper/210:24:152
2995499564,47cyclictest0-21swapper/110:38:381
2995499564,46cyclictest0-21swapper/108:43:311
2995499564,46cyclictest0-21swapper/108:43:311
2995499564,45cyclictest0-21swapper/110:22:431
2995499564,44cyclictest0-21swapper/107:23:301
2995499564,44cyclictest0-21swapper/107:23:301
29954995638,11cyclictest13705-21tr06:53:251
2995499563,47cyclictest0-21swapper/106:33:271
2995499563,46cyclictest0-21swapper/107:13:101
29954995617,8cyclictest0-21swapper/109:13:251
2995799555,30cyclictest17730-21runrttasks07:01:083
2995799554,34cyclictest0-21swapper/309:45:263
2995799553,13cyclictest427-21tr05:18:293
29957995522,14cyclictest0-21swapper/310:17:073
29957995521,14cyclictest0-21swapper/309:27:003
29957995521,14cyclictest0-21swapper/309:27:003
2995799552,48cyclictest0-21swapper/310:24:043
2995799552,48cyclictest0-21swapper/308:53:593
29957995515,23cyclictest0-21swapper/309:10:443
2995699553,45cyclictest0-21swapper/209:04:192
2995699553,10cyclictest0-21swapper/210:29:422
2995499554,44cyclictest23836-21hddtemp_smartct07:13:291
2995499554,44cyclictest0-21swapper/110:24:561
2995499554,44cyclictest0-21swapper/109:50:001
2995499554,44cyclictest0-21swapper/108:08:431
2995499553,45cyclictest0-21swapper/106:58:391
29954995529,9cyclictest10599-21yum10:03:391
29954995529,9cyclictest10599-21yum10:03:391
248599550,5rtkit-daemon2484-21rtkit-daemon08:13:092
2995799546,29cyclictest30740-21runrttasks06:18:483
2995799544,30cyclictest0-21swapper/306:38:353
29957995421,14cyclictest0-21swapper/308:41:593
2995799542,48cyclictest0-21swapper/310:08:483
2995799542,48cyclictest0-21swapper/310:08:483
2995799542,48cyclictest0-21swapper/309:07:163
2995799542,48cyclictest0-21swapper/308:31:453
2995799542,47cyclictest0-21swapper/308:35:083
29957995418,12cyclictest0-21swapper/308:43:313
29957995418,12cyclictest0-21swapper/308:43:313
29957995417,14cyclictest0-21swapper/308:04:153
29957995417,14cyclictest0-21swapper/308:04:153
2995499545,43cyclictest0-21swapper/110:32:431
2995499544,44cyclictest0-21swapper/109:34:331
29954995415,33cyclictest9999-21sendmail_mailqu06:43:401
248599540,5rtkit-daemon2484-21rtkit-daemon08:33:232
248599540,5rtkit-daemon2484-21rtkit-daemon08:18:233
209652549,7sleep20-21swapper/209:33:182
35092532,44sleep20-21swapper/207:30:342
2995799535,38cyclictest0-21swapper/306:23:273
2995799535,28cyclictest0-21swapper/305:53:143
2995799534,40cyclictest0-21swapper/306:33:123
2995799534,30cyclictest0-21swapper/309:18:243
2995799534,29cyclictest0-21swapper/305:55:593
29957995335,10cyclictest26811-21grep10:28:263
2995799533,27cyclictest0-21swapper/305:33:143
2995699537,39cyclictest0-21swapper/207:38:282
2995699533,43cyclictest0-21swapper/208:38:202
2995699533,43cyclictest0-21swapper/207:58:262
2995699532,45cyclictest0-21swapper/209:13:362
2995499534,43cyclictest0-21swapper/109:19:541
29954995334,12cyclictest22590-21head06:03:311
29954995322,12cyclictest0-21swapper/106:23:341
248599530,5rtkit-daemon2484-21rtkit-daemon07:03:412
13532532,10sleep20-21swapper/209:52:172
58652522,10sleep20-21swapper/206:37:052
2995799525,23cyclictest0-21swapper/306:33:273
2995799523,27cyclictest0-21swapper/305:58:363
29957995210,21cyclictest0-21swapper/305:13:263
2995699524,40cyclictest0-21swapper/207:55:522
2995699523,45cyclictest0-21swapper/209:21:142
2995699523,41cyclictest0-21swapper/210:06:192
2995699523,41cyclictest0-21swapper/210:06:192
2995699523,40cyclictest0-21swapper/209:08:342
2995499524,29cyclictest0-21swapper/105:18:151
29954995232,12cyclictest20228-21gltestperf05:58:331
248599520,5rtkit-daemon2484-21rtkit-daemon07:07:263
248599520,4rtkit-daemon2484-21rtkit-daemon08:23:232
213602524,41sleep20-21swapper/210:20:592
202332523,43sleep10-21swapper/107:07:271
134822524,41sleep30-21swapper/305:43:403
128102523,10sleep20-21swapper/206:49:182
128102523,10sleep20-21swapper/206:49:182
46712512,9sleep20-21swapper/205:26:302
45252513,42sleep10-21swapper/105:24:361
2995799515,39cyclictest0-21swapper/306:43:473
2995799515,27cyclictest0-21swapper/305:38:363
2995799514,38cyclictest0-21swapper/307:08:343
29956995131,14cyclictest0-21swapper/207:52:462
29956995131,13cyclictest0-21swapper/207:18:342
2995699513,41cyclictest0-21swapper/210:17:002
2995699513,39cyclictest0-21swapper/209:28:242
2995699513,39cyclictest0-21swapper/209:28:242
29956995128,18cyclictest23702-21cut07:13:282
29956995112,32cyclictest0-21swapper/207:43:242
2995499515,39cyclictest19217-21memory07:53:301
2995499514,41cyclictest0-21swapper/109:06:491
29954995134,11cyclictest29803-21sed06:18:311
2995799505,26cyclictest0-21swapper/306:53:223
2995799504,26cyclictest0-21swapper/306:51:063
2995799504,26cyclictest0-21swapper/306:51:063
2995799502,44cyclictest0-21swapper/306:13:233
29957995017,13cyclictest0-21swapper/306:08:233
29957995017,13cyclictest0-21swapper/306:08:233
2995699504,37cyclictest0-21swapper/207:33:252
2995699503,39cyclictest0-21swapper/208:53:372
2995499505,28cyclictest0-21swapper/106:28:361
2995499504,40cyclictest0-21swapper/106:18:131
29954995033,10cyclictest17319-21cpuspeed_turbos05:53:271
29954995033,10cyclictest14919-21tr05:48:261
2995499503,41cyclictest1419-21runrttasks05:33:331
2995499503,41cyclictest1419-21runrttasks05:33:331
71752493,11sleep10-21swapper/105:33:061
2995799494,26cyclictest22953-21needreboot06:03:373
2995699494,39cyclictest20231-21tail08:43:262
2995699494,39cyclictest20231-21tail08:43:262
2995699493,39cyclictest5654-21cpuspeed_turbos09:58:182
2995699493,38cyclictest0-21swapper/208:03:192
2995699493,38cyclictest0-21swapper/208:03:192
2995699493,21cyclictest0-21swapper/209:44:352
2995499493,26cyclictest0-21swapper/106:38:231
284552492,10sleep20-21swapper/206:15:122
248599490,5rtkit-daemon2484-21rtkit-daemon08:31:532
80502482,9sleep20-21swapper/206:39:262
2995799483,24cyclictest0-21swapper/305:33:323
2995799483,24cyclictest0-21swapper/305:33:323
2995699484,38cyclictest0-21swapper/205:58:322
2995699484,36cyclictest0-21swapper/210:38:332
2995699484,22cyclictest22673-21crond07:13:092
2995699483,40cyclictest0-21swapper/205:28:252
2995699483,39cyclictest0-21swapper/208:18:222
2995699483,39cyclictest0-21swapper/205:53:132
2995699483,38cyclictest0-21swapper/209:24:362
2995699483,38cyclictest0-21swapper/209:24:362
2995699483,27cyclictest0-21swapper/210:33:182
29954994818,12cyclictest0-21swapper/106:51:061
29954994818,12cyclictest0-21swapper/106:51:061
2995699474,36cyclictest0-21swapper/207:23:202
2995699474,36cyclictest0-21swapper/207:23:202
2995699473,26cyclictest0-21swapper/206:18:392
2995699473,23cyclictest0-21swapper/210:09:502
2995699473,23cyclictest0-21swapper/210:09:502
29956994712,29cyclictest14354-21crond05:48:132
2995499473,32cyclictest0-21swapper/105:20:121
178462472,10sleep20-21swapper/207:02:402
85672462,9sleep20-21swapper/206:43:132
34102462,37sleep20-21swapper/206:31:122
29957994623,15cyclictest0-21swapper/305:13:153
119882464,35sleep20-21swapper/205:43:152
2995699454,34cyclictest0-21swapper/206:53:432
2995699453,13cyclictest0-21swapper/205:33:312
2995699453,13cyclictest0-21swapper/205:33:312
29956994520,10cyclictest32715-21telnet05:18:272
2995699443,37cyclictest0-21swapper/206:23:232
2995699443,35cyclictest0-21swapper/205:53:302
237012442,10sleep20-21swapper/206:05:242
301652432,11sleep20-21swapper/205:13:202
29956994320,9cyclictest24158-21munin-node06:08:242
29956994320,9cyclictest24158-21munin-node06:08:242
2995699413,12cyclictest0-21swapper/205:13:142
2995499403,24cyclictest0-21swapper/105:13:151
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional