You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-06-07 - 00:33

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Sat Jun 06, 2026 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2194991080,6rtkit-daemon0-21swapper/007:15:390
26720991064,15cyclictest0-21swapper/108:17:321
26720991064,15cyclictest0-21swapper/108:17:321
26721991044,52cyclictest0-21swapper/211:02:152
26721991034,58cyclictest0-21swapper/211:42:062
26721991034,58cyclictest0-21swapper/211:42:062
2671899974,74cyclictest0-21swapper/009:52:150
26718999723,66cyclictest0-21swapper/011:42:180
26718999723,66cyclictest0-21swapper/011:42:180
2672199963,53cyclictest0-21swapper/210:37:192
26718999313,12cyclictest0-21swapper/009:32:190
2671899923,22cyclictest0-21swapper/010:26:540
26718998911,13cyclictest0-21swapper/009:39:130
26718998911,13cyclictest0-21swapper/009:39:130
2671899874,75cyclictest0-21swapper/010:52:210
5012860,3sleep2281ktimersoftd/207:12:262
2671899864,75cyclictest10267-21cut11:57:070
2671899864,74cyclictest0-21swapper/010:19:430
2671899864,74cyclictest0-21swapper/010:19:430
2671899863,75cyclictest0-21swapper/010:32:430
2671899863,23cyclictest0-21swapper/010:02:100
26718998627,52cyclictest23773-21fschecks_time12:17:080
26718998626,53cyclictest19676-21kernelversion09:47:190
26718998624,55cyclictest0-21swapper/008:30:490
2671899858,63cyclictest0-21swapper/009:20:540
2671899855,18cyclictest0-21swapper/008:22:300
2671899854,74cyclictest0-21swapper/012:27:030
2671899853,76cyclictest0-21swapper/009:42:070
2671899853,24cyclictest21459-21grep09:02:280
26718998516,10cyclictest0-21swapper/011:13:190
26718998513,12cyclictest0-21swapper/011:32:140
2671899845,71cyclictest0-21swapper/010:47:170
2671899844,73cyclictest0-21swapper/010:11:530
2671899844,73cyclictest0-21swapper/009:12:410
2671899844,73cyclictest0-21swapper/008:47:090
2671899844,72cyclictest0-21swapper/012:22:060
2671899844,72cyclictest0-21swapper/011:02:180
2671899844,24cyclictest0-21swapper/009:59:030
2671899843,73cyclictest16906-21fschecks_time07:47:190
2671899843,13cyclictest0-21swapper/012:02:010
26718998428,50cyclictest0-21swapper/010:45:240
26718998423,54cyclictest20215-21aten_r1power_po10:37:040
2671899834,72cyclictest0-21swapper/007:42:250
2671899834,23cyclictest0-21swapper/011:25:490
2671899834,12cyclictest0-21swapper/011:52:260
2671899833,73cyclictest0-21swapper/010:58:520
2671899833,73cyclictest0-21swapper/010:58:520
2671899833,72cyclictest0-21swapper/007:52:240
2671899833,24cyclictest0-21swapper/011:10:380
26718998323,52cyclictest0-21swapper/009:07:140
26718998319,7cyclictest25465-21munin-run08:06:580
2671899824,70cyclictest0-21swapper/011:47:120
2671899823,26cyclictest0-21swapper/010:22:150
2671899823,26cyclictest0-21swapper/010:22:150
2671899813,71cyclictest0-21swapper/008:57:300
2671899813,71cyclictest0-21swapper/008:57:300
2671899813,70cyclictest21592-21ssh11:27:010
26718998127,47cyclictest26971-21basename07:02:100
26718998119,54cyclictest0-21swapper/007:37:000
2671899805,15cyclictest0-21swapper/007:02:010
2671899805,15cyclictest0-21swapper/007:02:010
2671899804,69cyclictest0-21swapper/009:27:160
2671899804,68cyclictest0-21swapper/012:11:590
2671899804,67cyclictest0-21swapper/008:17:290
2671899804,67cyclictest0-21swapper/008:17:290
2671899804,27cyclictest19452-21diskmemload11:37:240
26718998034,38cyclictest28917-21grep08:12:180
2671899803,71cyclictest0-21swapper/011:19:210
2671899803,71cyclictest0-21swapper/007:57:140
2671899803,69cyclictest0-21swapper/009:22:130
2671899794,13cyclictest0-21swapper/008:42:300
26718997918,8cyclictest1227-21runrttasks07:18:550
2671899784,67cyclictest0-21swapper/007:32:000
2671899783,8cyclictest107550irq/46-eth012:07:240
2671899783,66cyclictest0-21swapper/010:13:580
26718997728,43cyclictest4532-21cpuspeed_turbos07:22:130
26718997521,47cyclictest0-21swapper/008:37:090
2671899743,21cyclictest0-21swapper/007:07:310
2671899735,12cyclictest0-21swapper/008:52:080
2671899734,18cyclictest0-21swapper/007:37:230
26718997312,12cyclictest0-21swapper/008:08:490
2672199723,61cyclictest0-21swapper/209:25:042
2672199715,59cyclictest0-21swapper/211:27:242
26720997031,13cyclictest29797-21aten2.4-expect12:26:581
26718997019,8cyclictest6129-21fschecks_time08:32:170
280692673,10sleep30-21swapper/310:00:303
2672199663,55cyclictest0-21swapper/211:32:142
2672199663,55cyclictest0-21swapper/210:33:472
2672199643,53cyclictest0-21swapper/211:57:232
2672199643,53cyclictest0-21swapper/210:27:142
2672199633,51cyclictest0-21swapper/210:08:112
2672199623,51cyclictest0-21swapper/210:52:232
219499620,20rtkit-daemon2193-21rtkit-daemon10:38:161
295722615,8sleep20-21swapper/209:15:292
2672299615,37cyclictest0-21swapper/309:32:073
2672299613,42cyclictest0-21swapper/312:11:493
26722996119,23cyclictest0-21swapper/311:17:233
2672199614,49cyclictest0-21swapper/212:01:582
2672199613,50cyclictest0-21swapper/211:17:222
26720996126,14cyclictest0-21swapper/111:23:481
26722996018,22cyclictest0-21swapper/311:04:583
26722996012,29cyclictest0-21swapper/310:32:173
2672199604,49cyclictest0-21swapper/212:27:052
2672199604,49cyclictest0-21swapper/211:12:032
2672199603,48cyclictest0-21swapper/209:37:212
2672199603,48cyclictest0-21swapper/209:37:212
26720996030,14cyclictest0-21swapper/112:17:221
264822606,47sleep20-21swapper/210:46:332
123302603,11sleep10-21swapper/112:00:381
61122592,11sleep10-21swapper/110:16:081
287342593,48sleep20-21swapper/210:02:062
2672299595,37cyclictest0-21swapper/311:15:043
2672299594,48cyclictest0-21swapper/311:27:303
26722995918,23cyclictest32464-21cpuspeed_turbos10:07:083
2672199593,48cyclictest2120-21gltestperf10:57:112
2672199593,48cyclictest2120-21gltestperf10:57:112
2672199593,41cyclictest0-21swapper/212:18:392
2672099595,15cyclictest0-21swapper/112:16:261
26720995942,10cyclictest24599-21latency10:42:161
26720995940,11cyclictest32598-21cut11:42:091
26720995940,11cyclictest32598-21cut11:42:091
2672099594,39cyclictest0-21swapper/110:56:311
2672099593,49cyclictest0-21swapper/111:38:421
26720995927,13cyclictest0-21swapper/110:47:051
2672299585,37cyclictest0-21swapper/312:28:003
2672299585,29cyclictest31033-21yum-updatesd-he11:40:423
2672299584,38cyclictest0-21swapper/312:12:463
2672299584,37cyclictest0-21swapper/309:25:013
2672299584,36cyclictest0-21swapper/310:26:053
2672299584,36cyclictest0-21swapper/310:26:053
26722995826,13cyclictest14668-21unixbench-2d12:02:213
26722995822,12cyclictest0-21swapper/310:56:483
2672099585,26cyclictest0-21swapper/111:07:201
2672099583,47cyclictest0-21swapper/110:33:561
219499580,4rtkit-daemon2193-21rtkit-daemon10:08:331
2672299574,35cyclictest0-21swapper/309:38:003
2672299574,35cyclictest0-21swapper/309:38:003
26722995724,11cyclictest19452-21diskmemload11:46:483
26722995724,11cyclictest19452-21diskmemload11:46:483
26722995721,14cyclictest0-21swapper/308:41:563
26722995719,22cyclictest0-21swapper/311:25:463
2672199573,46cyclictest7336-21grep07:27:192
2672099576,35cyclictest0-21swapper/109:16:431
2672099575,46cyclictest0-21swapper/109:55:091
2672099574,29cyclictest0-21swapper/107:27:311
2672299565,30cyclictest0-21swapper/311:57:203
2672299565,28cyclictest0-21swapper/307:06:093
2672299564,36cyclictest0-21swapper/310:27:283
2672299564,35cyclictest0-21swapper/312:20:543
2672299564,28cyclictest0-21swapper/310:40:353
2672299564,27cyclictest0-21swapper/311:52:503
2672299564,26cyclictest6955-21tr10:17:073
2672299564,26cyclictest6955-21tr10:17:073
26722995620,14cyclictest0-21swapper/311:47:273
26722995620,11cyclictest31764-21ssh10:06:393
26722995612,28cyclictest0-21swapper/309:53:473
2672199564,46cyclictest0-21swapper/209:47:242
2672199563,45cyclictest6978-21cpuspeed_turbos10:17:072
2672199563,45cyclictest6978-21cpuspeed_turbos10:17:072
2672199562,47cyclictest0-21swapper/212:13:542
2672099566,26cyclictest28234-21aten_r1power_vo08:12:111
2672099565,25cyclictest0-21swapper/109:27:101
2672099563,25cyclictest0-21swapper/109:47:071
2672099563,24cyclictest0-21swapper/111:47:021
26720995624,11cyclictest12429-21ssh09:37:111
26720995624,11cyclictest12429-21ssh09:37:111
26720995621,12cyclictest0-21swapper/110:17:231
26720995621,12cyclictest0-21swapper/110:17:231
26720995620,10cyclictest0-21swapper/109:17:111
26720995618,10cyclictest0-21swapper/110:22:221
26720995618,10cyclictest0-21swapper/110:22:221
26720995615,12cyclictest0-21swapper/111:27:051
26720995611,12cyclictest7427-21needreboot11:52:151
219499560,4rtkit-daemon2193-21rtkit-daemon10:31:471
192572563,45sleep10-21swapper/108:59:321
192572563,45sleep10-21swapper/108:59:321
2672299554,34cyclictest0-21swapper/311:32:333
2672299554,13cyclictest0-21swapper/310:58:233
2672299554,13cyclictest0-21swapper/310:58:233
26722995530,10cyclictest0-21swapper/312:21:533
26722995527,21cyclictest0-21swapper/309:42:113
26722995522,11cyclictest24057-21munin-node09:07:153
26722995521,14cyclictest0-21swapper/308:07:313
26722995520,12cyclictest0-21swapper/308:56:283
26722995518,13cyclictest0-21swapper/310:16:223
26722995518,13cyclictest0-21swapper/308:02:293
26722995518,12cyclictest0-21swapper/307:16:103
26722995517,14cyclictest0-21swapper/307:17:183
26721995537,11cyclictest27219-21tr10:47:072
2672199553,46cyclictest23286-21taskset09:52:212
2672199553,46cyclictest0-21swapper/212:07:232
26721995520,29cyclictest1227-21runrttasks10:24:402
26721995520,29cyclictest1227-21runrttasks10:24:402
2672199552,10cyclictest0-21swapper/209:10:412
2672099555,36cyclictest107550irq/46-eth011:32:131
2672099555,31cyclictest0-21swapper/107:37:241
2672099555,28cyclictest20303-21munin-node07:52:321
2672099554,25cyclictest0-21swapper/109:07:141
26720995535,13cyclictest3566-21unixbench_singl07:17:351
2672099553,46cyclictest0-21swapper/107:07:261
2672099553,45cyclictest1809-21df_inode10:57:071
2672099553,45cyclictest1809-21df_inode10:57:071
26720995517,12cyclictest0-21swapper/112:02:211
26720995515,11cyclictest0-21swapper/109:32:081
91402545,8sleep29144-21ssh11:56:192
278942543,8sleep127919-21python12:22:191
2672299545,30cyclictest0-21swapper/307:51:593
2672299545,28cyclictest0-21swapper/308:12:103
2672299545,25cyclictest0-21swapper/310:42:413
2672299544,31cyclictest0-21swapper/309:12:203
2672299544,30cyclictest0-21swapper/308:42:173
2672299544,28cyclictest0-21swapper/310:47:193
2672299544,27cyclictest0-21swapper/309:47:313
2672299544,27cyclictest0-21swapper/308:17:273
2672299544,27cyclictest0-21swapper/308:17:273
2672299544,26cyclictest0-21swapper/309:02:243
2672299543,28cyclictest0-21swapper/309:27:193
26722995421,14cyclictest0-21swapper/308:47:313
26722995420,10cyclictest9695-21timerandwakeup11:07:243
26722995418,13cyclictest0-21swapper/309:16:583
26722995418,13cyclictest0-21swapper/307:22:263
2672199544,44cyclictest0-21swapper/209:05:582
2672099544,30cyclictest0-21swapper/108:37:151
2672099544,29cyclictest0-21swapper/108:07:161
2672099543,44cyclictest0-21swapper/108:47:091
2672099543,25cyclictest0-21swapper/111:02:141
26720995422,15cyclictest0-21swapper/111:12:201
26720995411,38cyclictest0-21swapper/109:57:311
2672299535,26cyclictest31476-21sadc07:12:003
2672299534,29cyclictest0-21swapper/308:22:283
2672299534,29cyclictest0-21swapper/307:37:343
2672299534,28cyclictest0-21swapper/307:57:343
26722995336,9cyclictest4668-21unixbench_multi08:27:293
2672299533,26cyclictest0-21swapper/308:32:193
2672199535,43cyclictest0-21swapper/207:02:232
2672199534,43cyclictest0-21swapper/209:42:032
2672199533,27cyclictest0-21swapper/212:23:302
2672199533,27cyclictest0-21swapper/207:26:592
2672199532,44cyclictest0-21swapper/210:12:082
2672099535,29cyclictest0-21swapper/108:52:251
2672099535,28cyclictest0-21swapper/108:02:341
2672099534,39cyclictest0-21swapper/109:06:571
2672099534,29cyclictest0-21swapper/107:42:201
2672099533,45cyclictest0-21swapper/111:18:351
2672099533,43cyclictest0-21swapper/109:26:281
2672099533,43cyclictest0-21swapper/108:42:151
26720995326,10cyclictest17093-21sshd07:47:221
26720995321,13cyclictest0-21swapper/109:45:481
26720995320,12cyclictest0-21swapper/112:07:221
26720995318,14cyclictest0-21swapper/107:12:251
100202533,43sleep20-21swapper/211:07:372
72882523,10sleep10-21swapper/108:34:131
2672299524,27cyclictest0-21swapper/307:36:143
26722995217,13cyclictest0-21swapper/308:57:093
26722995217,13cyclictest0-21swapper/308:57:093
2672199524,43cyclictest0-21swapper/209:59:422
2672199524,41cyclictest85032sleep209:32:052
2672199522,44cyclictest0-21swapper/207:08:422
26721995215,21cyclictest0-21swapper/211:23:452
26721995214,24cyclictest0-21swapper/207:53:542
2672099525,27cyclictest0-21swapper/108:31:581
2672099525,27cyclictest0-21swapper/107:06:091
26720995210,22cyclictest0-21swapper/110:02:221
2672299515,26cyclictest0-21swapper/307:56:173
2672299514,27cyclictest0-21swapper/307:27:273
2672199514,43cyclictest0-21swapper/209:27:292
26721995125,12cyclictest0-21swapper/211:37:012
2672099516,27cyclictest0-21swapper/108:26:231
2672199504,39cyclictest0-21swapper/211:47:242
26721995034,10cyclictest29295-21strings08:12:242
26721995032,10cyclictest5691-21grep08:32:122
2672199503,28cyclictest0-21swapper/208:57:312
2672199503,28cyclictest0-21swapper/208:57:312
26721995021,11cyclictest10286-21telnet08:42:092
2672199502,23cyclictest27816-21taskset08:11:332
2672099505,13cyclictest0-21swapper/107:32:181
40182493,10sleep20-21swapper/208:27:212
38402492,9sleep20-21swapper/207:20:332
2672199494,39cyclictest0-21swapper/209:17:132
2672199493,24cyclictest0-21swapper/207:32:112
2672199492,42cyclictest0-21swapper/208:52:292
26720994917,14cyclictest0-21swapper/107:57:331
2672199484,37cyclictest0-21swapper/208:02:142
2672199483,40cyclictest0-21swapper/207:42:252
26721994820,22cyclictest0-21swapper/208:47:312
26721994818,13cyclictest0-21swapper/208:22:132
2672099484,25cyclictest0-21swapper/107:26:131
2672299474,35cyclictest0-21swapper/307:42:123
2672199472,39cyclictest0-21swapper/208:41:572
133452473,37sleep20-21swapper/207:39:562
2672199462,38cyclictest0-21swapper/208:17:312
2672199462,38cyclictest0-21swapper/208:17:312
2672199454,12cyclictest0-21swapper/207:52:002
2672199444,34cyclictest0-21swapper/207:57:122
26722994215,10cyclictest0-21swapper/307:02:013
26722994215,10cyclictest0-21swapper/307:02:013
26721994124,11cyclictest26731-21ls07:02:012
26721994124,11cyclictest26731-21ls07:02:012
219499380,4rtkit-daemon2193-21rtkit-daemon06:57:251
219499380,4rtkit-daemon2193-21rtkit-daemon06:57:251
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional