You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-02 - 14:04

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jan 02, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2103521370,39chrt0-21swapper/011:15:560
2333899983,49cyclictest8113-21munin-node10:46:151
2333899926,78cyclictest0-21swapper/110:40:571
2333699914,78cyclictest0-21swapper/012:10:410
23336999031,52cyclictest0-21swapper/006:56:160
23336998934,48cyclictest25497-21gltestperf10:16:060
23336998934,48cyclictest25497-21gltestperf10:16:060
2333699893,32cyclictest0-21swapper/010:11:520
23336998829,52cyclictest0-21swapper/008:31:220
2333999872,39cyclictest0-21swapper/209:20:592
2333699873,33cyclictest14452-21grep09:51:210
23336998729,9cyclictest19476-21cut11:11:040
23336998726,8cyclictest30404-21munin-plugin-st09:20:480
119312870,4sleep211933-21sed12:01:162
23336998531,48cyclictest13262-21unixbench_singl08:41:240
2333699853,30cyclictest32718-21sleep11:40:430
23336998526,52cyclictest0-21swapper/010:35:590
2333699844,30cyclictest0-21swapper/010:41:170
23336998428,49cyclictest0-21swapper/011:45:520
23336998428,49cyclictest0-21swapper/011:45:520
23336998331,8cyclictest30322-21latency_hist11:35:430
2333699833,33cyclictest10989-21tune2fs12:01:010
2333699833,29cyclictest27929-21crond11:30:430
2333699833,26cyclictest0-21swapper/007:41:250
2333699833,12cyclictest0-21swapper/011:21:010
23336998323,10cyclictest6496-21crond08:30:490
23336998320,13cyclictest0-21swapper/010:05:460
2333699824,32cyclictest0-21swapper/007:11:160
2333699824,30cyclictest0-21swapper/012:11:160
2333699824,11cyclictest0-21swapper/010:25:220
2333699823,34cyclictest0-21swapper/011:40:590
23336998225,12cyclictest0-21swapper/007:59:460
23336998224,9cyclictest26082-21cpu09:11:020
23336998213,12cyclictest0-21swapper/010:51:060
2333699813,8cyclictest11435-21sort07:31:200
2333699813,32cyclictest0-21swapper/008:40:130
2333699813,30cyclictest0-21swapper/009:57:530
2333699813,29cyclictest0-21swapper/006:51:060
2333699813,13cyclictest0-21swapper/009:36:110
2333699813,13cyclictest0-21swapper/009:36:110
23336998126,10cyclictest0-21swapper/010:06:050
2333699803,70cyclictest0-21swapper/007:40:060
23336997929,43cyclictest0-21swapper/009:20:590
23336997929,10cyclictest30050-21unixbench_multi07:01:280
2333699783,32cyclictest0-21swapper/009:26:190
2333699783,31cyclictest0-21swapper/010:56:020
23336997828,44cyclictest0-21swapper/009:06:070
23336997828,43cyclictest0-21swapper/008:51:190
23336997828,43cyclictest0-21swapper/008:51:190
23336997825,12cyclictest0-21swapper/009:31:140
23336997820,12cyclictest0-21swapper/007:16:170
23336997819,10cyclictest0-21swapper/008:23:140
23336997815,7cyclictest1597-21latency_hist08:20:520
23336997735,37cyclictest0-21swapper/012:20:310
2333699773,32cyclictest0-21swapper/011:55:560
2333699773,31cyclictest0-21swapper/007:26:130
2333699773,31cyclictest0-21swapper/007:26:130
23336997725,8cyclictest19009-21tr08:56:030
2333699763,11cyclictest0-21swapper/008:46:000
23336997626,10cyclictest0-21swapper/009:40:570
2333699753,29cyclictest7428-21perl10:46:030
2333699744,33cyclictest0-21swapper/007:21:040
2333699743,35cyclictest0-21swapper/009:45:580
23336997429,8cyclictest31083-21cpuspeed_turbos07:06:070
23336997421,12cyclictest0-21swapper/008:06:020
23336997421,12cyclictest0-21swapper/008:06:020
2333699733,31cyclictest0-21swapper/008:11:220
23336997325,10cyclictest0-21swapper/010:26:100
23336997325,10cyclictest0-21swapper/009:05:200
23336997323,9cyclictest0-21swapper/008:03:520
23336997321,13cyclictest0-21swapper/007:51:060
23336997026,11cyclictest0-21swapper/011:50:550
23336997024,11cyclictest0-21swapper/011:00:560
23336997024,11cyclictest0-21swapper/011:00:560
248599680,4rtkit-daemon2484-21rtkit-daemon10:27:093
248599670,4rtkit-daemon2484-21rtkit-daemon09:31:343
248599660,5rtkit-daemon2484-21rtkit-daemon09:40:563
248599660,4rtkit-daemon2484-21rtkit-daemon09:08:573
2333699663,30cyclictest0-21swapper/010:35:370
23336996625,9cyclictest0-21swapper/007:49:330
248599650,7rtkit-daemon0-21swapper/311:59:053
248599650,4rtkit-daemon2484-21rtkit-daemon09:14:343
248599650,4rtkit-daemon2484-21rtkit-daemon08:56:433
248599650,4rtkit-daemon2484-21rtkit-daemon07:01:023
248599640,9rtkit-daemon0-21swapper/310:41:013
248599640,8rtkit-daemon0-21swapper/308:36:133
248599640,5rtkit-daemon27661-21diskstats08:06:073
248599640,5rtkit-daemon27661-21diskstats08:06:073
248599640,4rtkit-daemon2484-21rtkit-daemon11:34:143
248599640,3rtkit-daemon0-21swapper/311:52:063
248599640,3rtkit-daemon0-21swapper/310:33:393
248599630,8rtkit-daemon0-21swapper/311:26:143
248599630,7rtkit-daemon0-21swapper/308:11:223
248599630,5rtkit-daemon1287-21snmpd12:15:503
248599630,4rtkit-daemon21662-21diskstats09:01:053
2333899634,51cyclictest0-21swapper/112:05:581
248599620,8rtkit-daemon0-21swapper/309:51:183
248599620,7rtkit-daemon0-21swapper/310:17:393
248599620,7rtkit-daemon0-21swapper/310:17:393
248599620,5rtkit-daemon27582-21df_inode10:21:023
248599620,5rtkit-daemon14615-21sshd07:37:163
248599620,4rtkit-daemon32366-21yum11:36:213
248599620,4rtkit-daemon20559-21sshd11:13:073
248599620,4rtkit-daemon14865-21irqstats11:01:083
248599620,4rtkit-daemon14865-21irqstats11:01:083
248599620,4rtkit-daemon12533-21irqstats08:41:133
2333999624,39cyclictest0-21swapper/210:45:212
248599610,8rtkit-daemon0-21swapper/312:01:133
248599610,7rtkit-daemon0-21swapper/310:11:023
248599610,7rtkit-daemon0-21swapper/307:46:083
248599610,6rtkit-daemon0-21swapper/308:16:073
248599610,6rtkit-daemon0-21swapper/307:41:083
248599610,5rtkit-daemon6163-21diskstats07:21:093
248599610,5rtkit-daemon3635-21diskstats11:45:583
248599610,5rtkit-daemon3635-21diskstats11:45:583
248599610,5rtkit-daemon18915-21smartctl10:01:183
248599610,4rtkit-daemon23989-21df_abs06:51:103
248599610,4rtkit-daemon21427-21df11:16:003
23340996144,10cyclictest12656-21needreboot10:56:123
2333899617,10cyclictest0-21swapper/111:16:141
248599600,7rtkit-daemon25990-21ntp_states08:01:223
248599600,6rtkit-daemon475-21munin-node11:40:593
248599600,5rtkit-daemon2484-21rtkit-daemon07:00:553
248599600,4rtkit-daemon31207-21df_inode09:21:043
248599600,4rtkit-daemon28824-21diskstats09:16:043
248599600,4rtkit-daemon2627-21yum07:11:323
248599600,4rtkit-daemon16443-21python12:11:123
248599600,4rtkit-daemon16240-21latency_hist08:50:503
248599600,4rtkit-daemon10869-21df_inode09:46:033
248599600,4rtkit-daemon10082-21iostat10:51:083
248599600,3rtkit-daemon0-21swapper/307:56:073
2333999605,44cyclictest0-21swapper/208:31:252
2333999604,50cyclictest0-21swapper/209:31:142
18382607,44sleep10-21swapper/108:21:011
2333899593,50cyclictest0-21swapper/111:41:141
248599580,5rtkit-daemon3383-21switchtime10:36:163
2333899585,45cyclictest0-21swapper/107:26:071
2333899585,45cyclictest0-21swapper/107:26:071
2333899583,49cyclictest0-21swapper/111:56:181
248599560,6rtkit-daemon0-21swapper/308:56:282
248599560,5rtkit-daemon0-21swapper/311:33:592
2333999563,35cyclictest0-21swapper/212:10:422
2333899565,44cyclictest0-21swapper/110:20:571
2333899563,47cyclictest0-21swapper/108:56:131
2333899563,46cyclictest6074-21df_abs09:36:031
2333899563,46cyclictest6074-21df_abs09:36:031
2333899563,46cyclictest0-21swapper/108:26:171
2333899563,46cyclictest0-21swapper/107:01:131
248599550,6rtkit-daemon0-21swapper/310:24:022
248599550,6rtkit-daemon0-21swapper/309:10:422
23340995535,11cyclictest8834-21sh10:50:443
2333999553,45cyclictest0-21swapper/207:31:202
23339995522,12cyclictest0-21swapper/210:31:132
2333899555,42cyclictest0-21swapper/108:06:021
2333899555,42cyclictest0-21swapper/108:06:021
2333899553,46cyclictest0-21swapper/111:11:111
23336995532,7cyclictest23314-21latency_hist06:50:550
233202558,40sleep20-21swapper/207:56:192
123182556,11sleep10-21swapper/112:05:071
106732553,44sleep20-21swapper/209:46:022
248599540,6rtkit-daemon2484-21rtkit-daemon07:31:313
248599540,6rtkit-daemon0-21swapper/311:38:142
23340995423,13cyclictest0-21swapper/309:56:223
2333999543,43cyclictest25455-21grep10:16:062
2333999543,43cyclictest25455-21grep10:16:062
23339995420,15cyclictest0-21swapper/207:20:532
23339995418,21cyclictest3044-21latency08:21:142
2333899544,44cyclictest0-21swapper/107:06:051
2333899543,44cyclictest10308-21hostname09:45:581
2333899542,46cyclictest0-21swapper/109:11:091
88432533,44sleep10-21swapper/108:35:201
248599530,5rtkit-daemon2484-21rtkit-daemon09:40:483
248599530,5rtkit-daemon2484-21rtkit-daemon09:40:483
2333999534,30cyclictest0-21swapper/208:50:512
23339995321,14cyclictest0-21swapper/210:46:012
2333899536,41cyclictest0-21swapper/108:46:181
2333899535,42cyclictest0-21swapper/111:21:051
2333899534,43cyclictest0-21swapper/107:21:241
2333899533,44cyclictest0-21swapper/111:48:491
2333899533,44cyclictest0-21swapper/111:48:491
2333899533,44cyclictest0-21swapper/111:31:031
2333899533,44cyclictest0-21swapper/110:01:021
2333899533,44cyclictest0-21swapper/109:01:441
2333899533,44cyclictest0-21swapper/108:51:211
2333899533,44cyclictest0-21swapper/108:51:211
2333899533,44cyclictest0-21swapper/107:51:051
2333899533,43cyclictest29040-21perl09:16:061
2333899533,43cyclictest0-21swapper/107:36:311
45012523,42sleep10-21swapper/109:31:181
2333999525,27cyclictest0-21swapper/211:15:572
2333999524,31cyclictest0-21swapper/212:20:412
2333999524,30cyclictest0-21swapper/211:21:002
2333999524,30cyclictest0-21swapper/211:01:082
2333999524,30cyclictest0-21swapper/211:01:082
2333999524,29cyclictest0-21swapper/210:51:102
2333999524,29cyclictest0-21swapper/210:36:042
2333999524,29cyclictest0-21swapper/210:26:022
2333999524,29cyclictest0-21swapper/208:06:112
2333999524,29cyclictest0-21swapper/208:06:112
23339995235,10cyclictest8656-21grep07:26:132
23339995235,10cyclictest8656-21grep07:26:132
2333999523,34cyclictest24867-21telnet08:01:072
2333999523,31cyclictest0-21swapper/208:55:172
2333999523,31cyclictest0-21swapper/208:55:172
23339995221,14cyclictest0-21swapper/208:16:152
2333899525,41cyclictest16495-21munin-node09:56:181
2333899523,43cyclictest0-21swapper/112:11:101
2333899523,43cyclictest0-21swapper/111:38:071
2333899523,43cyclictest0-21swapper/110:51:211
2333899523,43cyclictest0-21swapper/110:37:291
2333899523,43cyclictest0-21swapper/109:41:111
2333899523,43cyclictest0-21swapper/108:36:351
2333899523,43cyclictest0-21swapper/107:59:141
2333899523,42cyclictest2627-21runrttasks09:27:281
2333899523,42cyclictest23373-21memory10:11:111
2333899523,41cyclictest0-21swapper/109:10:241
2333899523,41cyclictest0-21swapper/107:47:301
2333899523,34cyclictest5777-21cpuspeed_turbos11:50:571
23338995221,13cyclictest0-21swapper/107:14:591
171222523,42sleep10-21swapper/107:43:321
134372527,37sleep20-21swapper/209:51:062
264732514,11sleep10-21swapper/110:16:531
264732514,11sleep10-21swapper/110:16:531
248599510,5rtkit-daemon2484-21rtkit-daemon07:52:153
2334099515,28cyclictest0-21swapper/308:26:093
2334099515,28cyclictest0-21swapper/307:06:103
23340995130,15cyclictest7250irq/45-ahci07:30:523
23340995130,15cyclictest7250irq/45-ahci07:30:523
2333999514,30cyclictest0-21swapper/206:51:202
2333999514,29cyclictest0-21swapper/211:56:002
2333999514,29cyclictest0-21swapper/211:46:122
2333999514,29cyclictest0-21swapper/211:46:122
2333999514,29cyclictest0-21swapper/209:56:192
2333999514,29cyclictest0-21swapper/209:45:472
2333999514,29cyclictest0-21swapper/209:26:182
2333999514,29cyclictest0-21swapper/208:36:152
2333999514,28cyclictest0-21swapper/211:26:032
2333999514,28cyclictest0-21swapper/210:11:052
2333999514,28cyclictest0-21swapper/209:11:112
2333999514,28cyclictest0-21swapper/208:45:492
23339995133,11cyclictest11888-21df10:56:022
2333999513,29cyclictest0-21swapper/209:01:052
23339995119,16cyclictest0-21swapper/208:30:132
23339995119,14cyclictest0-21swapper/210:01:092
2333899515,40cyclictest0-21swapper/107:31:251
2333899513,43cyclictest0-21swapper/109:21:171
2333899513,43cyclictest0-21swapper/107:17:321
2333899513,42cyclictest17031-21grep11:06:041
2333899513,42cyclictest0-21swapper/111:01:051
2333899513,42cyclictest0-21swapper/111:01:051
2333899513,42cyclictest0-21swapper/110:56:001
2333899513,42cyclictest0-21swapper/110:29:091
2333899513,41cyclictest0-21swapper/111:25:581
2333899513,41cyclictest0-21swapper/109:55:481
2333899513,41cyclictest0-21swapper/108:01:271
254492504,11sleep10-21swapper/106:52:371
2334099504,28cyclictest0-21swapper/311:06:133
2334099504,27cyclictest3524-21cpuspeed_turbos07:16:103
2334099504,27cyclictest0-21swapper/308:21:013
23340995019,13cyclictest0-21swapper/306:50:553
2333999504,29cyclictest0-21swapper/211:51:012
2333999504,29cyclictest0-21swapper/207:36:062
2333999504,28cyclictest0-21swapper/207:01:122
2333999504,27cyclictest0-21swapper/208:11:062
2333999504,27cyclictest0-21swapper/207:21:112
23339995034,10cyclictest18973-21tr11:10:582
2333999503,34cyclictest0-21swapper/207:42:262
2333999503,30cyclictest0-21swapper/212:10:522
2333999503,29cyclictest0-21swapper/207:46:212
2333999503,29cyclictest0-21swapper/207:11:302
2333899504,29cyclictest0-21swapper/110:06:081
2333899504,28cyclictest0-21swapper/110:35:331
194322503,11sleep10-21swapper/112:19:301
12462503,41sleep10-21swapper/108:16:291
287322493,39sleep20-21swapper/209:16:042
2334099494,27cyclictest0-21swapper/311:21:113
23340994930,12cyclictest7480-21fschecks_time08:31:093
2333999494,29cyclictest0-21swapper/209:40:242
2333999494,29cyclictest0-21swapper/209:40:242
23339994933,9cyclictest31460-21chrt07:06:122
23339994919,13cyclictest0-21swapper/211:06:122
212542493,7sleep321291-21sensors_temp10:06:153
144242492,9sleep30-21swapper/312:06:303
2333999484,26cyclictest0-21swapper/210:10:292
2333899483,40cyclictest0-21swapper/108:41:021
2334099474,26cyclictest0-21swapper/308:51:023
2334099474,26cyclictest0-21swapper/308:51:023
2333999474,37cyclictest0-21swapper/207:51:102
2333999474,26cyclictest0-21swapper/211:40:442
2333999474,26cyclictest0-21swapper/206:56:072
2333899472,39cyclictest0-21swapper/106:56:061
2333899462,10cyclictest0-21swapper/108:11:111
230912464,6sleep10-21swapper/106:48:111
2333999454,12cyclictest0-21swapper/206:50:552
2333699453,37cyclictest0-21swapper/011:06:080
2334099444,14cyclictest0-21swapper/309:26:033
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional