You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 15:25

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Jan 01, 2026 12:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
9410991064,51cyclictest0-21swapper/010:41:410
941099944,47cyclictest0-21swapper/012:16:380
941399933,46cyclictest0-21swapper/110:42:161
941599914,27cyclictest0-21swapper/208:12:082
941399903,45cyclictest13461-21awk06:57:201
941599893,38cyclictest0-21swapper/210:32:042
941599893,38cyclictest0-21swapper/206:56:502
941599884,40cyclictest0-21swapper/207:07:182
941599884,40cyclictest0-21swapper/207:07:182
941399884,44cyclictest0-21swapper/110:11:571
941599863,27cyclictest0-21swapper/211:16:592
941599853,28cyclictest0-21swapper/209:29:082
941599843,28cyclictest0-21swapper/211:41:572
9415998332,10cyclictest12558-21unixbench_singl08:02:212
9415998320,10cyclictest5767-21crond07:51:482
9415998320,10cyclictest5767-21crond07:51:482
9415998232,11cyclictest31456-21tr07:37:002
941599763,39cyclictest0-21swapper/207:32:202
9415997629,10cyclictest0-21swapper/210:23:472
941599753,26cyclictest0-21swapper/210:50:232
941599703,47cyclictest0-21swapper/209:02:052
9415996925,7cyclictest9371-21kworker/2:210:36:532
9415996637,13cyclictest0-21swapper/212:01:562
941099645,52cyclictest0-21swapper/008:32:160
941099645,52cyclictest0-21swapper/008:32:160
941099625,50cyclictest0-21swapper/010:47:160
941099615,49cyclictest0-21swapper/008:02:110
941099594,48cyclictest19983-21grep09:27:030
298812593,48sleep00-21swapper/008:41:580
289682593,48sleep10-21swapper/112:01:541
248599590,4rtkit-daemon2484-21rtkit-daemon10:46:163
248599590,4rtkit-daemon2484-21rtkit-daemon09:47:563
172042594,47sleep00-21swapper/007:07:060
172042594,47sleep00-21swapper/007:07:060
9416995841,10cyclictest13648-21grep09:12:213
9410995821,30cyclictest16795-21tail11:36:520
74992586,43sleep07659-21df06:47:040
6952587,44sleep00-21swapper/007:40:270
248599580,5rtkit-daemon2484-21rtkit-daemon11:32:143
248599570,7rtkit-daemon2484-21rtkit-daemon08:31:592
248599570,7rtkit-daemon2484-21rtkit-daemon08:31:592
9416995638,12cyclictest28304-21grep08:37:063
9416995638,11cyclictest28634-21needreboot10:52:063
9416995636,11cyclictest13776-21unixbench_singl06:57:243
941099566,29cyclictest0-21swapper/011:51:570
941099564,44cyclictest5951-21head10:06:540
80012563,46sleep31287-21snmpd07:54:533
32872566,9sleep00-21swapper/007:45:350
248599560,5rtkit-daemon2484-21rtkit-daemon09:32:113
248599560,5rtkit-daemon2484-21rtkit-daemon08:36:592
9415995536,6cyclictest29587-21latency_hist10:56:422
941399553,45cyclictest17873-21munin-node10:32:131
9410995525,8cyclictest30824-21latency_hist09:51:440
5692555,9sleep30-21swapper/307:38:493
248599550,5rtkit-daemon2484-21rtkit-daemon09:17:052
248599550,4rtkit-daemon2484-21rtkit-daemon10:17:103
169672553,45sleep00-21swapper/008:12:200
9416995437,11cyclictest30668-21gltestperf10:57:013
941399543,44cyclictest0-21swapper/110:02:151
941399542,46cyclictest21495-21munin-node09:31:561
941099545,26cyclictest0-21swapper/009:11:570
941099544,42cyclictest0-21swapper/010:57:010
941099543,44cyclictest0-21swapper/008:27:040
9410995427,21cyclictest0-21swapper/009:22:060
248599540,5rtkit-daemon2484-21rtkit-daemon12:07:053
248599540,5rtkit-daemon2484-21rtkit-daemon12:07:053
248599540,5rtkit-daemon2484-21rtkit-daemon10:32:173
190162544,9sleep00-21swapper/011:41:460
9416995335,12cyclictest3357-21kernelversion11:07:053
941599534,43cyclictest23244-21grep07:17:232
941599534,25cyclictest0-21swapper/208:27:102
941399534,44cyclictest29595-21awk10:56:411
941399533,44cyclictest0-21swapper/107:02:251
91192533,9sleep00-21swapper/011:20:220
248599530,5rtkit-daemon2484-21rtkit-daemon09:52:033
248599530,5rtkit-daemon2484-21rtkit-daemon08:57:132
248599530,5rtkit-daemon2484-21rtkit-daemon08:17:072
248599530,5rtkit-daemon2484-21rtkit-daemon07:52:002
248599530,5rtkit-daemon2484-21rtkit-daemon07:42:082
248599530,5rtkit-daemon2484-21rtkit-daemon07:27:162
10462533,9sleep30-21swapper/307:41:513
9416995234,10cyclictest21215-21tail08:22:063
9416995232,11cyclictest7017-21wc10:07:073
9416995232,11cyclictest28928-21tr12:01:533
9415995221,13cyclictest0-21swapper/210:27:162
9415995215,23cyclictest13168-21munin-node08:07:242
941399529,36cyclictest31167-21aten_r1power_en07:36:571
941399523,44cyclictest4406-21idleruntime12:17:001
941399523,44cyclictest0-21swapper/111:34:291
941399523,41cyclictest0-21swapper/109:46:531
941399522,43cyclictest74492chrt11:16:551
9413995213,30cyclictest0-21swapper/111:36:551
941099525,29cyclictest0-21swapper/007:24:490
941099524,42cyclictest11709-21sadc09:11:450
941099524,41cyclictest0-21swapper/011:06:540
941099524,13cyclictest0-21swapper/007:57:000
248599520,5rtkit-daemon2484-21rtkit-daemon09:12:052
248599520,5rtkit-daemon2484-21rtkit-daemon08:42:212
248599520,5rtkit-daemon2484-21rtkit-daemon07:12:172
246102523,9sleep30-21swapper/308:28:313
236132523,43sleep00-21swapper/009:36:230
125902523,43sleep312592-21yum08:02:233
9416995133,12cyclictest20316-21cut09:27:093
9416995133,11cyclictest24263-21cut07:22:023
9416995132,13cyclictest17504-21fschecks_time07:07:093
9416995132,13cyclictest17504-21fschecks_time07:07:093
9413995135,10cyclictest12610-21uniq11:26:591
941399513,43cyclictest0-21swapper/109:12:501
941399513,42cyclictest0-21swapper/111:13:441
941399513,42cyclictest0-21swapper/110:20:201
941099514,41cyclictest0-21swapper/007:12:040
307082513,9sleep30-21swapper/307:34:383
248599510,5rtkit-daemon2484-21rtkit-daemon12:12:053
248599510,4rtkit-daemon2484-21rtkit-daemon11:38:363
248599510,4rtkit-daemon2484-21rtkit-daemon09:40:113
248599510,3rtkit-daemon2484-21rtkit-daemon11:19:003
236392516,38sleep00-21swapper/007:20:520
192162513,8sleep319287-21aten_r1power_po07:12:053
17052516,9sleep00-21swapper/011:03:330
150272513,9sleep30-21swapper/310:23:583
9416995031,10cyclictest632-21gltestperf08:47:053
941599505,27cyclictest0-21swapper/210:11:552
9413995033,10cyclictest8730-21tr07:57:021
941399503,42cyclictest0-21swapper/109:29:181
941399503,41cyclictest0-21swapper/109:43:301
941399502,43cyclictest1287-21snmpd09:40:111
9410995025,10cyclictest0-21swapper/011:22:170
9410995025,10cyclictest0-21swapper/011:22:170
85262504,7sleep30-21swapper/306:47:153
66422504,9sleep00-21swapper/011:14:090
286902503,40sleep00-21swapper/010:52:090
248599500,4rtkit-daemon2484-21rtkit-daemon11:02:003
9416994933,10cyclictest1318-21cpuspeed_turbos09:56:573
9416994933,10cyclictest1318-21cpuspeed_turbos09:56:573
9416994931,12cyclictest26519-21wc10:47:133
9416994930,12cyclictest9212-21gltestperf07:57:083
941599497,35cyclictest0-21swapper/211:56:512
941599493,35cyclictest0-21swapper/206:57:282
941599493,28cyclictest0-21swapper/208:22:022
9415994921,23cyclictest0-21swapper/212:10:042
9415994921,23cyclictest0-21swapper/212:10:042
941399493,39cyclictest0-21swapper/109:06:461
941399493,24cyclictest26137-21irqstats08:32:111
941399493,24cyclictest26137-21irqstats08:32:111
941099495,24cyclictest22701-21aten2.4-expect10:41:550
941099494,38cyclictest0-21swapper/008:21:580
941099494,28cyclictest0-21swapper/010:12:110
9410994930,13cyclictest0-21swapper/011:47:060
941099492,41cyclictest0-21swapper/010:27:140
40802494,39sleep34191-21diskstats07:47:033
40802494,39sleep34191-21diskstats07:47:033
283672492,9sleep30-21swapper/309:45:543
281642494,9sleep00-21swapper/007:27:370
248599490,4rtkit-daemon2484-21rtkit-daemon10:37:013
138162493,40sleep00-21swapper/011:29:160
116922493,9sleep30-21swapper/306:55:443
115202492,40sleep00-21swapper/006:53:270
113442493,9sleep30-21swapper/311:23:073
113442493,9sleep30-21swapper/311:23:073
941699485,36cyclictest0-21swapper/311:16:403
941699485,13cyclictest0-21swapper/312:17:113
9416994825,14cyclictest26794-21df_abs07:27:033
941699482,39cyclictest0-21swapper/308:17:113
941599486,35cyclictest0-21swapper/210:16:542
941599484,27cyclictest0-21swapper/209:57:072
941599484,27cyclictest0-21swapper/209:57:072
941599484,27cyclictest0-21swapper/207:22:042
941599483,28cyclictest0-21swapper/211:47:162
941599482,41cyclictest0-21swapper/207:59:482
941399484,37cyclictest24109-21aten2.4-expect07:22:011
941399483,36cyclictest0-21swapper/109:26:461
9410994830,12cyclictest0-21swapper/010:32:150
9410994829,14cyclictest0-21swapper/007:01:500
941099482,11cyclictest0-21swapper/009:37:360
5442483,38sleep10-21swapper/112:10:161
5442483,38sleep10-21swapper/112:10:161
32642483,39sleep00-21swapper/010:01:140
32642483,39sleep00-21swapper/010:01:140
295542485,10sleep00-21swapper/012:02:010
294692483,9sleep10-21swapper/108:39:331
248599480,5rtkit-daemon2484-21rtkit-daemon09:24:193
248599480,4rtkit-daemon2484-21rtkit-daemon09:07:202
248599480,4rtkit-daemon2484-21rtkit-daemon07:02:172
200582483,9sleep00-21swapper/008:21:230
19792482,38sleep20-21swapper/212:12:032
18132484,9sleep10-21swapper/108:49:051
941699474,31cyclictest0-21swapper/308:32:153
941699474,31cyclictest0-21swapper/308:32:153
9416994729,10cyclictest4398-21gltestperf10:02:063
9416994727,12cyclictest20132-21latency11:42:053
9416994720,12cyclictest0-21swapper/308:13:113
941699472,40cyclictest0-21swapper/307:04:013
9415994724,9cyclictest21495-21munin-node09:32:212
9415994717,14cyclictest0-21swapper/211:06:402
9415994717,14cyclictest0-21swapper/209:42:442
941399473,40cyclictest0-21swapper/108:53:301
941399473,38cyclictest0-21swapper/111:26:221
941399473,38cyclictest0-21swapper/111:26:221
941399473,38cyclictest0-21swapper/111:06:531
941399473,38cyclictest0-21swapper/107:17:111
941399473,37cyclictest0-21swapper/108:07:091
941399472,40cyclictest21-21ksoftirqd/109:06:551
941099477,34cyclictest0-21swapper/011:56:520
941099475,36cyclictest0-21swapper/010:17:110
941099475,12cyclictest0-21swapper/008:37:030
941099474,37cyclictest0-21swapper/011:32:060
941099473,39cyclictest0-21swapper/009:16:560
941099473,39cyclictest0-21swapper/009:03:190
941099473,38cyclictest0-21swapper/009:52:030
941099473,37cyclictest0-21swapper/007:47:050
941099473,37cyclictest0-21swapper/007:47:050
941099472,39cyclictest0-21swapper/007:52:020
9410994712,28cyclictest1-21systemd08:51:460
259192472,38sleep20-21swapper/209:40:202
238062472,38sleep30-21swapper/311:51:483
941699465,14cyclictest0-21swapper/308:09:563
941699465,13cyclictest0-21swapper/310:12:093
941699465,13cyclictest0-21swapper/308:42:063
941699464,25cyclictest0-21swapper/311:47:453
941599469,22cyclictest31057-21munin-node09:51:562
941599464,26cyclictest0-21swapper/209:50:132
9415994631,9cyclictest4266-21grep12:16:592
941599463,26cyclictest0-21swapper/211:26:572
941599463,26cyclictest0-21swapper/210:02:202
941399463,37cyclictest0-21swapper/107:32:201
9413994619,14cyclictest0-21swapper/112:16:071
941099465,34cyclictest0-21swapper/008:07:000
941099464,37cyclictest0-21swapper/007:32:150
941099464,26cyclictest0-21swapper/010:22:070
941099463,38cyclictest0-21swapper/007:02:020
941099463,36cyclictest0-21swapper/009:41:570
9410994626,15cyclictest0-21swapper/010:05:070
941099462,39cyclictest0-21swapper/008:57:140
941099462,38cyclictest0-21swapper/012:11:390
226442463,38sleep122691-21ntp_kernel_pll_11:47:071
941699455,13cyclictest0-21swapper/309:07:203
941699454,27cyclictest0-21swapper/309:17:043
941699454,12cyclictest0-21swapper/310:27:163
941699453,25cyclictest0-21swapper/311:57:083
941699453,25cyclictest0-21swapper/308:52:073
9416994515,13cyclictest0-21swapper/311:26:513
941599454,34cyclictest0-21swapper/211:31:532
941599454,34cyclictest0-21swapper/210:06:592
9415994523,8cyclictest1287-21snmpd09:25:102
941399453,38cyclictest0-21swapper/108:17:381
941399453,36cyclictest0-21swapper/111:01:411
941399453,36cyclictest0-21swapper/108:22:181
941399453,10cyclictest0-21swapper/110:00:481
941399453,10cyclictest0-21swapper/110:00:481
9413994524,8cyclictest16931-21python10:27:151
9413994523,18cyclictest0-21swapper/110:25:141
9413994523,16cyclictest0-21swapper/110:06:551
9413994517,14cyclictest0-21swapper/108:42:031
9413994510,27cyclictest16802-21aten_r1power_cu07:07:011
9413994510,27cyclictest16802-21aten_r1power_cu07:07:011
941099457,22cyclictest0-21swapper/012:16:510
941099454,35cyclictest0-21swapper/012:06:510
81292454,6sleep10-21swapper/106:47:091
44862452,38sleep00-21swapper/008:56:050
225662450,3sleep3361ktimersoftd/307:17:123
210322452,37sleep10-21swapper/107:12:551
941699445,29cyclictest0-21swapper/308:57:053
941699443,26cyclictest0-21swapper/309:02:023
941599444,33cyclictest0-21swapper/211:07:042
941599444,33cyclictest0-21swapper/210:42:182
941599443,12cyclictest0-21swapper/211:38:372
941399444,34cyclictest0-21swapper/109:17:021
9413994430,9cyclictest608-21gltestperf11:02:011
941399443,37cyclictest0-21swapper/110:37:241
941399443,36cyclictest1065-21munin-node07:42:211
941399443,35cyclictest0-21swapper/109:00:211
9413994429,10cyclictest0-21swapper/107:27:121
79472442,36sleep10-21swapper/107:54:111
248599440,4rtkit-daemon2484-21rtkit-daemon08:51:582
9415994327,10cyclictest24648-21gltestperf11:52:012
9415994322,15cyclictest0-21swapper/211:12:032
9415994314,13cyclictest0-21swapper/210:56:532
941399433,34cyclictest0-21swapper/108:06:031
9413994322,17cyclictest0-21swapper/110:50:331
93672433,34sleep20-21swapper/206:51:442
941399423,35cyclictest0-21swapper/106:52:531
941399423,33cyclictest0-21swapper/111:56:501
941399423,11cyclictest0-21swapper/111:52:381
941399423,11cyclictest0-21swapper/108:27:081
941399423,11cyclictest0-21swapper/108:11:561
941399423,11cyclictest0-21swapper/107:50:591
941399423,11cyclictest0-21swapper/107:50:591
9413994229,8cyclictest19823-21gltestperf11:42:001
941599413,31cyclictest0-21swapper/208:46:582
941399413,33cyclictest0-21swapper/109:51:461
113092412,33sleep20-21swapper/211:22:422
113092412,33sleep20-21swapper/211:22:422
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional