You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-23 - 06:00

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Dec 23, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2485991100,11rtkit-daemon0-21swapper/119:34:501
2485991100,11rtkit-daemon0-21swapper/119:34:501
2485991060,8rtkit-daemon0-21swapper/121:09:241
2485991010,6rtkit-daemon0-21swapper/120:41:551
2485991000,8rtkit-daemon10923-21awk00:01:021
2485991000,6rtkit-daemon0-21swapper/122:56:571
248599990,6rtkit-daemon5035-21proc_pri20:26:101
248599980,6rtkit-daemon23592-21head23:20:561
248599960,6rtkit-daemon7003-21munin-node20:31:031
248599950,6rtkit-daemon0-21swapper/122:54:271
2747499944,34cyclictest0-21swapper/023:30:560
248599940,6rtkit-daemon0-21swapper/119:37:571
27476999210,76cyclictest1419-21runrttasks21:40:402
248599920,7rtkit-daemon0-21swapper/122:22:581
248599920,7rtkit-daemon0-21swapper/122:22:581
248599920,6rtkit-daemon0-21swapper/123:30:261
248599920,6rtkit-daemon0-21swapper/123:20:261
248599920,6rtkit-daemon0-21swapper/122:43:271
2747499914,30cyclictest0-21swapper/019:30:440
27474999118,20cyclictest0-21swapper/000:06:030
27476999018,47cyclictest0-21swapper/223:48:452
27476999018,47cyclictest0-21swapper/223:48:452
27474999035,48cyclictest24832-21grep22:15:590
2747699884,13cyclictest0-21swapper/220:26:062
2747499884,9cyclictest14253-21yum-updatesd-he19:40:450
2747499874,27cyclictest0-21swapper/022:51:000
2747499874,26cyclictest0-21swapper/022:48:460
2747699864,59cyclictest0-21swapper/222:02:572
2747699864,13cyclictest0-21swapper/223:55:532
2747699864,13cyclictest0-21swapper/223:40:482
2747499864,34cyclictest0-21swapper/020:09:280
2747499864,33cyclictest0-21swapper/000:20:460
2747499864,25cyclictest0-21swapper/020:30:550
2747499864,12cyclictest0-21swapper/021:00:590
2747499863,21cyclictest4120-21timerwakeupswit21:31:100
2747499854,28cyclictest0-21swapper/022:40:510
2747499854,26cyclictest0-21swapper/000:20:330
2747499854,12cyclictest0-21swapper/020:40:580
27474998517,12cyclictest0-21swapper/023:04:070
27474998517,12cyclictest0-21swapper/023:04:070
27474998517,12cyclictest0-21swapper/020:25:540
248599850,30rtkit-daemon16843-21aten_r1power_fr00:15:461
2747699845,12cyclictest0-21swapper/220:15:562
2747699845,12cyclictest0-21swapper/220:15:562
2747699844,57cyclictest0-21swapper/223:33:272
2747699844,12cyclictest0-21swapper/221:21:062
2747699844,11cyclictest0-21swapper/221:55:512
2747699843,9cyclictest31599-21unixbench-2d23:36:072
2747699843,9cyclictest31599-21unixbench-2d23:36:072
2747499844,33cyclictest0-21swapper/023:44:170
2747499844,28cyclictest0-21swapper/023:20:590
2747499844,28cyclictest0-21swapper/020:51:000
2747499844,28cyclictest0-21swapper/019:50:530
2747499844,24cyclictest0-21swapper/021:10:180
2747499844,23cyclictest0-21swapper/020:55:530
2747499844,23cyclictest0-21swapper/020:55:530
2747499844,12cyclictest0-21swapper/021:40:530
2747499843,23cyclictest14410-21taskset00:10:460
27474998427,11cyclictest22737-21cat19:56:080
2747699835,12cyclictest0-21swapper/223:24:112
2747699834,58cyclictest0-21swapper/220:40:562
2747699834,13cyclictest0-21swapper/223:51:032
2747699834,13cyclictest0-21swapper/221:09:252
2747699834,12cyclictest0-21swapper/221:00:542
2747699834,12cyclictest0-21swapper/219:56:062
2747699834,12cyclictest0-21swapper/219:01:102
27476998316,43cyclictest0-21swapper/220:12:392
27476998311,46cyclictest0-21swapper/220:06:152
2747499834,32cyclictest0-21swapper/021:46:070
2747499834,12cyclictest0-21swapper/000:26:080
27474998323,10cyclictest10427-21grep00:00:530
248599830,27rtkit-daemon5788-21gltestperf19:21:051
248599830,26rtkit-daemon0-21swapper/023:50:551
2747699824,12cyclictest0-21swapper/221:25:532
2747699824,12cyclictest0-21swapper/221:15:402
2747699824,12cyclictest0-21swapper/219:21:152
27476998239,36cyclictest32013-21grep22:30:572
2747699823,10cyclictest11646-21gltestperf22:55:582
27476998218,41cyclictest3650-21munin-node22:40:522
27476998215,45cyclictest1287-21snmpd22:23:432
27476998215,45cyclictest1287-21snmpd22:23:432
2747499824,24cyclictest0-21swapper/022:10:530
27474998227,9cyclictest464-21grep20:16:140
27474998227,9cyclictest464-21grep20:16:140
248599820,31rtkit-daemon8085-21fschecks_time19:26:051
248599820,30rtkit-daemon0-21swapper/000:26:081
248599820,28rtkit-daemon19249-21nfs_client23:11:041
248599820,27rtkit-daemon0-21swapper/023:46:021
248599820,27rtkit-daemon0-21swapper/023:46:021
248599820,26rtkit-daemon0-21swapper/019:41:051
2747699815,65cyclictest1419-21runrttasks19:06:362
2747699814,62cyclictest0-21swapper/221:45:512
2747699814,12cyclictest0-21swapper/220:55:542
2747699814,12cyclictest0-21swapper/220:55:542
2747699814,12cyclictest0-21swapper/220:51:002
2747699814,12cyclictest0-21swapper/219:26:042
2747499814,31cyclictest0-21swapper/023:35:580
2747499814,31cyclictest0-21swapper/023:35:580
2747499814,27cyclictest0-21swapper/021:27:520
2747499814,25cyclictest0-21swapper/023:50:480
2747499814,14cyclictest0-21swapper/022:03:580
2747499814,12cyclictest0-21swapper/019:01:080
2747499813,27cyclictest0-21swapper/023:20:360
2747499813,27cyclictest0-21swapper/022:36:020
2747499813,27cyclictest0-21swapper/021:35:580
27474998129,9cyclictest32508-21proc_pri22:31:060
248599810,26rtkit-daemon24067-21munin-node20:01:111
27476998041,31cyclictest1995-21grep22:36:012
2747699804,13cyclictest0-21swapper/200:00:532
2747699804,12cyclictest0-21swapper/221:16:092
2747699803,12cyclictest0-21swapper/222:09:042
2747699803,12cyclictest0-21swapper/219:16:062
2747699803,11cyclictest0-21swapper/200:25:332
2747499804,23cyclictest0-21swapper/020:10:550
2747499804,22cyclictest0-21swapper/022:05:490
2747499804,11cyclictest0-21swapper/019:12:260
2747499803,23cyclictest10827-21munin-node22:56:070
2747499803,22cyclictest0-21swapper/023:45:490
2747499803,22cyclictest0-21swapper/023:45:490
27474998021,14cyclictest0-21swapper/022:26:030
27474998016,12cyclictest0-21swapper/021:55:570
27474998016,12cyclictest0-21swapper/021:20:560
27474998016,12cyclictest0-21swapper/021:10:530
248599800,26rtkit-daemon0-21swapper/020:46:101
248599800,25rtkit-daemon16820-21needreboot23:06:041
2747699797,48cyclictest0-21swapper/219:30:542
2747699797,48cyclictest0-21swapper/219:30:542
2747699795,52cyclictest0-21swapper/220:38:352
2747699794,54cyclictest0-21swapper/219:51:152
2747699794,13cyclictest0-21swapper/200:15:472
2747499795,16cyclictest0-21swapper/019:46:150
2747499794,31cyclictest0-21swapper/019:22:280
2747499794,23cyclictest0-21swapper/020:45:560
2747499793,23cyclictest0-21swapper/019:30:550
2747499793,23cyclictest0-21swapper/019:30:550
248599790,28rtkit-daemon0-21swapper/021:01:161
248599790,25rtkit-daemon0-21swapper/020:21:101
2747699786,11cyclictest0-21swapper/200:05:562
2747699784,12cyclictest0-21swapper/222:16:122
2747699783,52cyclictest0-21swapper/200:14:112
2747699783,12cyclictest12102-21munin-node19:36:062
2747499783,24cyclictest0-21swapper/020:36:020
248599780,26rtkit-daemon0-21swapper/022:31:051
248599780,25rtkit-daemon0-21swapper/023:03:491
248599780,25rtkit-daemon0-21swapper/023:03:491
248599780,20rtkit-daemon0-21swapper/021:11:011
2747699776,61cyclictest0-21swapper/220:01:172
2747699774,14cyclictest0-21swapper/222:50:502
2747699774,13cyclictest0-21swapper/222:10:542
2747699774,13cyclictest0-21swapper/220:21:092
2747499774,23cyclictest0-21swapper/023:10:490
2747499774,22cyclictest0-21swapper/019:06:110
2747499774,12cyclictest0-21swapper/021:15:580
2747499773,23cyclictest0-21swapper/019:41:180
2747499773,22cyclictest0-21swapper/022:20:510
2747499773,22cyclictest0-21swapper/022:20:510
248599770,23rtkit-daemon0-21swapper/000:08:171
2747699764,48cyclictest0-21swapper/219:46:222
2747699764,12cyclictest0-21swapper/223:15:482
2747699763,9cyclictest6382-21cut22:45:532
2747499764,12cyclictest0-21swapper/023:05:580
2747499763,22cyclictest0-21swapper/023:55:470
2747499763,22cyclictest0-21swapper/020:20:550
248599760,26rtkit-daemon0-21swapper/019:55:561
248599760,25rtkit-daemon0-21swapper/019:48:041
2747699755,60cyclictest1419-21runrttasks22:28:512
2747699754,48cyclictest0-21swapper/220:32:422
2747699754,13cyclictest0-21swapper/223:06:002
2747699754,12cyclictest0-21swapper/223:29:002
2747699754,12cyclictest0-21swapper/221:31:012
27476997529,38cyclictest0-21swapper/223:01:122
27476997529,38cyclictest0-21swapper/223:01:122
2747499754,20cyclictest0-21swapper/019:15:560
2747499754,12cyclictest0-21swapper/020:01:160
248599750,25rtkit-daemon0-21swapper/000:10:461
2747699745,58cyclictest1419-21runrttasks21:44:352
2747699744,61cyclictest0-21swapper/223:11:042
27476997421,44cyclictest14815-21cpuspeed_turbos19:40:592
27476997420,45cyclictest12041-21munin-node21:50:522
248599740,23rtkit-daemon0-21swapper/020:10:031
2747699735,58cyclictest1419-21runrttasks19:10:522
2747699735,12cyclictest0-21swapper/219:00:472
2747699716,56cyclictest1419-21runrttasks20:45:512
2747699714,12cyclictest0-21swapper/200:25:472
248599700,8rtkit-daemon20103-21grep19:51:041
248599680,6rtkit-daemon12-21rcu_preempt23:40:481
248599620,7rtkit-daemon0-21swapper/123:29:480
248599610,8rtkit-daemon0-21swapper/000:21:011
248599600,6rtkit-daemon0-21swapper/020:56:091
248599600,6rtkit-daemon0-21swapper/020:56:091
248599590,6rtkit-daemon0-21swapper/221:51:073
83462574,14sleep10-21swapper/123:55:591
38812574,10sleep34012-21cpuspeed_turbos20:25:563
27477995723,27cyclictest15103-21fschecks_count21:55:573
88042563,9sleep18930-21unixbench-2d21:41:151
27477995640,10cyclictest21333-21gltestperf21:01:013
2747599565,44cyclictest0-21swapper/121:56:101
27477995540,9cyclictest18181-21proc_pri22:01:073
27477995537,11cyclictest17715-21head19:46:063
2747599553,26cyclictest0-21swapper/123:37:541
2747599553,26cyclictest0-21swapper/123:37:541
2631225411,34sleep10-21swapper/118:56:081
248599540,6rtkit-daemon2484-21rtkit-daemon20:36:023
199102542,12sleep30-21swapper/323:12:413
43282533,11sleep30-21swapper/323:47:273
43282533,11sleep30-21swapper/323:47:273
27477995336,10cyclictest19817-21sed20:56:143
27477995336,10cyclictest19817-21sed20:56:143
2747599535,31cyclictest11669-21sshd21:48:581
72492523,7sleep37294-21munin-node22:46:053
32382524,12sleep10-21swapper/122:38:291
278992522,8sleep30-21swapper/320:06:143
2747599526,29cyclictest0-21swapper/120:16:051
2747599526,29cyclictest0-21swapper/120:16:051
2747599524,23cyclictest28797-21aten2.4-expect22:25:471
27475995233,12cyclictest1237-21tail19:11:121
27475995221,13cyclictest0-21swapper/122:00:591
13062522,10sleep31345-21sensors23:41:063
104312523,12sleep30-21swapper/322:53:393
5142513,12sleep30-21swapper/322:31:223
46742513,13sleep10-21swapper/119:20:211
27477995135,9cyclictest23380-21head22:11:153
27477995135,10cyclictest26145-21crond22:20:383
2747599514,30cyclictest0-21swapper/122:16:061
2747599513,24cyclictest27780-21tail21:15:541
27475995119,13cyclictest0-21swapper/123:31:091
249532513,12sleep30-21swapper/320:01:063
46382503,12sleep10-21swapper/121:35:381
288362503,13sleep10-21swapper/120:10:471
2747799509,34cyclictest4642-21crond21:35:393
27477995032,11cyclictest7152-21kernelversion20:31:063
27477995013,31cyclictest1287-21snmpd00:18:363
164382502,10sleep30-21swapper/300:14:233
2747799499,34cyclictest361ktimersoftd/323:00:513
2747799499,34cyclictest361ktimersoftd/323:00:513
2747799497,35cyclictest11593-21sshd21:47:583
2747799494,37cyclictest0-21swapper/322:05:503
2747599495,26cyclictest0-21swapper/120:52:451
2747599494,27cyclictest0-21swapper/122:11:071
2747599494,27cyclictest0-21swapper/121:51:041
2747599494,13cyclictest0-21swapper/122:46:001
223412493,13sleep30-21swapper/323:18:173
210362493,12sleep30-21swapper/300:22:093
70772483,39sleep30-21swapper/319:25:353
32152482,10sleep30-21swapper/322:38:113
318772483,11sleep10-21swapper/121:22:041
297452484,12sleep30-21swapper/319:04:353
2747799485,36cyclictest0-21swapper/320:20:433
2747799485,36cyclictest0-21swapper/320:20:433
2747799484,27cyclictest0-21swapper/321:17:593
2747799484,26cyclictest0-21swapper/319:41:073
2747799484,12cyclictest0-21swapper/322:40:493
27477994832,10cyclictest30824-21gltestperf21:20:593
27477994832,10cyclictest25969-21gltestperf23:25:553
248292483,38sleep30-21swapper/321:08:403
235232482,12sleep30-21swapper/319:56:503
213442483,40sleep10-21swapper/122:10:201
175602482,9sleep30-21swapper/320:52:203
282332472,38sleep30-21swapper/322:21:433
282332472,38sleep30-21swapper/322:21:433
2747799476,34cyclictest21540-21munin-node00:26:063
2747799475,35cyclictest7498-21cat23:55:483
2747799474,27cyclictest0-21swapper/300:01:043
2747799474,26cyclictest0-21swapper/320:11:053
27477994733,8cyclictest857-21grep21:26:003
2747599475,26cyclictest0-21swapper/119:06:041
246382472,38sleep30-21swapper/323:22:043
128552473,37sleep30-21swapper/322:59:073
68292461,12sleep30-21swapper/323:53:403
27477994629,10cyclictest5727-21tail21:36:003
27477994628,11cyclictest12950-21gltestperf19:36:033
27477994628,10cyclictest1286-21aten_r1power_fr20:20:543
2747599465,34cyclictest0-21swapper/119:01:151
2747499464,23cyclictest0-21swapper/021:50:530
273692464,36sleep00-21swapper/018:59:530
212462463,11sleep30-21swapper/319:53:163
2747799455,35cyclictest0-21swapper/319:33:433
2747799455,35cyclictest0-21swapper/319:33:433
2747799454,33cyclictest0-21swapper/322:25:493
27477994532,8cyclictest25500-21cpuspeed_turbos21:10:543
27477994528,10cyclictest11807-21sed20:41:053
2747599454,25cyclictest0-21swapper/121:27:511
175442451,12sleep30-21swapper/323:07:573
93942442,11sleep30-21swapper/319:29:423
92122442,10sleep30-21swapper/321:43:023
295352442,12sleep30-21swapper/323:33:373
2747799444,33cyclictest0-21swapper/323:35:553
2747799444,33cyclictest0-21swapper/323:35:553
27477994428,10cyclictest30197-21aten_r1power_po19:05:583
2747599443,9cyclictest6288-21rt-features21:36:101
27475994428,10cyclictest8812-21tr20:35:561
2747799437,31cyclictest4565-21runrttasks19:18:553
2747799434,33cyclictest0-21swapper/319:11:163
27477994313,13cyclictest0-21swapper/300:05:493
151282432,11sleep30-21swapper/320:47:043
2747799405,29cyclictest361ktimersoftd/319:00:473
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional