You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-27 - 04:51

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Sat Dec 27, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
25935991004,47cyclictest0-21swapper/121:52:301
25938999012,54cyclictest0-21swapper/319:47:203
2593899894,11cyclictest0-21swapper/320:32:203
2593899884,8cyclictest16217-21latency_hist23:06:513
2593899882,63cyclictest0-21swapper/322:22:263
2593899874,9cyclictest25560-21perl22:17:123
2593899874,60cyclictest0-21swapper/321:14:043
2593899874,12cyclictest0-21swapper/321:36:553
2593899874,12cyclictest0-21swapper/321:36:553
2593899874,11cyclictest0-21swapper/323:37:193
2593899874,11cyclictest0-21swapper/323:37:193
2593899864,12cyclictest0-21swapper/323:42:073
25938998617,49cyclictest0-21swapper/300:07:003
2593899854,11cyclictest0-21swapper/321:22:223
2593899845,59cyclictest0-21swapper/320:21:573
2593899844,13cyclictest0-21swapper/322:37:033
2593899844,13cyclictest0-21swapper/320:02:163
2593899843,8cyclictest30537-21crond23:36:493
25938998418,50cyclictest0-21swapper/319:57:093
25938998411,49cyclictest121850irq/46-eth022:47:063
2593899837,11cyclictest8114-21munin-node21:42:143
2593899836,67cyclictest0-21swapper/320:37:153
2593899834,63cyclictest0-21swapper/321:52:103
2593899834,13cyclictest0-21swapper/320:57:103
2593899834,12cyclictest0-21swapper/323:27:053
2593899833,60cyclictest26458-21cpuspeed_turbos18:57:143
2593899833,57cyclictest0-21swapper/321:37:143
2593899833,56cyclictest30636-21iostat22:27:143
2593899833,13cyclictest0-21swapper/321:21:553
2593899833,10cyclictest31194-21wc20:12:293
2593899824,63cyclictest0-21swapper/322:54:203
2593899824,63cyclictest0-21swapper/322:54:203
2593899823,59cyclictest17393-21awk00:16:483
25938998215,48cyclictest12956-21yum-updatesd-he19:37:153
2593899815,58cyclictest0-21swapper/319:22:283
2593899815,58cyclictest0-21swapper/319:22:283
2593899814,12cyclictest0-21swapper/319:12:193
2593899813,10cyclictest1287-21snmpd20:22:083
25938998115,48cyclictest0-21swapper/322:07:133
25938998115,45cyclictest0-21swapper/320:54:013
25938998114,51cyclictest0-21swapper/323:22:213
2593899804,60cyclictest0-21swapper/321:47:173
2593899804,56cyclictest0-21swapper/300:17:003
2593899804,54cyclictest0-21swapper/323:14:243
2593899804,12cyclictest0-21swapper/319:32:333
2593899803,55cyclictest0-21swapper/322:57:193
2593899803,12cyclictest0-21swapper/320:11:573
2593899803,12cyclictest0-21swapper/320:11:573
2593899797,9cyclictest121850irq/46-eth020:47:093
2593899794,60cyclictest0-21swapper/322:12:213
2593899794,60cyclictest0-21swapper/322:12:213
2593899794,13cyclictest0-21swapper/319:52:083
25938997912,50cyclictest0-21swapper/321:27:133
2593899785,15cyclictest0-21swapper/319:42:233
2593899784,12cyclictest0-21swapper/320:43:113
25938997830,41cyclictest30693-21idleruntime-cro19:06:593
2593899783,15cyclictest21567-21expr23:17:053
2593899774,56cyclictest0-21swapper/319:08:443
2593899774,14cyclictest0-21swapper/322:44:193
2593899773,61cyclictest1287-21snmpd21:07:263
25938997719,41cyclictest5844-21sshd20:27:243
2593899764,9cyclictest459-21hwlatdetect22:32:153
2593899764,57cyclictest0-21swapper/323:52:073
2593899764,57cyclictest0-21swapper/318:57:013
2593899764,13cyclictest0-21swapper/323:09:233
2593899764,11cyclictest0-21swapper/323:51:193
2593899754,53cyclictest0-21swapper/322:02:083
2593899744,17cyclictest0-21swapper/319:27:113
2593899744,12cyclictest0-21swapper/300:02:033
2593899743,53cyclictest20427-21df00:22:013
2593899743,53cyclictest20427-21df00:22:013
25938997411,43cyclictest0-21swapper/321:57:173
25938997410,56cyclictest0-21swapper/323:57:083
2593899734,12cyclictest0-21swapper/321:02:183
2593899734,10cyclictest1247-21lldpd19:17:113
317212693,13sleep20-21swapper/222:31:202
2593799604,36cyclictest0-21swapper/222:26:532
2593599606,46cyclictest0-21swapper/122:46:511
2593599604,48cyclictest0-21swapper/119:57:081
25932996030,15cyclictest0-21swapper/019:32:200
2593799598,42cyclictest0-21swapper/222:37:102
2593599594,48cyclictest0-21swapper/120:37:151
2593599594,47cyclictest0-21swapper/121:37:241
25935995934,10cyclictest18763-21iostat_ios19:47:211
2593599584,47cyclictest0-21swapper/121:02:281
196112585,14sleep10-21swapper/122:04:031
307712575,44sleep00-21swapper/023:36:590
307712575,44sleep00-21swapper/023:36:590
2593799563,24cyclictest0-21swapper/219:22:302
2593799563,24cyclictest0-21swapper/219:22:302
30332555,11sleep10-21swapper/121:31:021
2593599554,44cyclictest4129-21fschecks_time19:17:161
25932995529,12cyclictest0-21swapper/021:36:550
25932995529,12cyclictest0-21swapper/021:36:550
2593799544,30cyclictest0-21swapper/223:11:512
25937995437,10cyclictest26939-21tail21:12:152
25937995433,12cyclictest1785-21gltestperf19:12:192
2593599543,46cyclictest0-21swapper/123:16:331
2593299543,44cyclictest0-21swapper/023:02:200
118532545,42sleep20-21swapper/221:47:232
314852532,43sleep00-21swapper/022:28:160
2593799535,12cyclictest0-21swapper/221:44:092
2593799534,28cyclictest12958-21munin-node19:37:202
2593799534,13cyclictest0-21swapper/223:52:022
25937995321,13cyclictest0-21swapper/219:07:132
25937995320,11cyclictest9338-21yum-updatesd-he20:37:092
249882533,43sleep225037-21processes21:07:212
173762532,11sleep20-21swapper/219:45:242
99442522,11sleep20-21swapper/223:58:212
291372525,40sleep00-21swapper/021:17:150
281492524,13sleep10-21swapper/119:00:011
2593799525,39cyclictest0-21swapper/222:57:192
2593799525,29cyclictest0-21swapper/220:47:252
2593799525,28cyclictest0-21swapper/221:27:112
2593799525,28cyclictest0-21swapper/221:17:102
2593799525,28cyclictest0-21swapper/220:32:302
2593799525,28cyclictest0-21swapper/220:17:282
2593799525,28cyclictest0-21swapper/200:07:202
2593799524,29cyclictest0-21swapper/223:47:042
25937995235,10cyclictest29214-21tail23:32:102
25937995234,11cyclictest6037-21tr21:37:062
25937995234,11cyclictest27921-21unixbench_singl18:57:342
25937995233,11cyclictest25276-21cpuspeed_turbos20:02:122
25937995221,13cyclictest0-21swapper/221:32:202
25937995221,13cyclictest0-21swapper/221:32:202
25937995221,13cyclictest0-21swapper/220:07:132
25937995221,13cyclictest0-21swapper/220:07:132
25937995221,13cyclictest0-21swapper/219:27:332
25937995219,14cyclictest0-21swapper/222:47:192
196552522,11sleep20-21swapper/219:48:432
138502523,11sleep10-21swapper/120:46:411
117912523,43sleep10-21swapper/121:47:221
66242517,10sleep10-21swapper/120:30:491
2593799515,28cyclictest0-21swapper/222:12:092
2593799515,28cyclictest0-21swapper/222:12:092
2593799515,28cyclictest0-21swapper/219:57:232
2593799515,28cyclictest0-21swapper/219:02:292
2593799515,26cyclictest0-21swapper/223:15:182
2593799514,29cyclictest0-21swapper/220:42:112
2593799514,28cyclictest0-21swapper/222:32:162
2593799514,28cyclictest0-21swapper/222:02:242
2593799514,28cyclictest0-21swapper/200:12:152
2593799514,28cyclictest0-21swapper/200:02:042
2593799514,26cyclictest17618-21munin-node00:17:002
25937995119,13cyclictest0-21swapper/220:57:332
2593599514,42cyclictest0-21swapper/119:39:491
25932995125,11cyclictest0-21swapper/020:07:080
25932995125,11cyclictest0-21swapper/020:07:080
25932995120,13cyclictest0-21swapper/023:27:180
220682514,13sleep10-21swapper/100:25:491
220682514,13sleep10-21swapper/100:25:491
219442513,11sleep20-21swapper/221:02:142
14022515,12sleep10-21swapper/122:32:361
78912504,40sleep00-21swapper/019:26:200
78912504,40sleep00-21swapper/019:26:200
290722504,39sleep00-21swapper/022:22:560
285282504,12sleep10-21swapper/119:02:031
27642502,11sleep20-21swapper/223:43:222
2593799505,27cyclictest0-21swapper/220:52:092
2593799504,40cyclictest0-21swapper/223:27:032
2593799504,27cyclictest0-21swapper/220:12:092
2593799504,27cyclictest0-21swapper/219:52:092
25937995020,13cyclictest0-21swapper/200:26:472
25937995020,13cyclictest0-21swapper/200:26:472
2593799502,42cyclictest0-21swapper/220:23:572
2593799502,35cyclictest0-21swapper/220:30:532
25937995018,12cyclictest30772-21yum-updatesd-he23:37:022
25937995018,12cyclictest30772-21yum-updatesd-he23:37:022
2593599504,28cyclictest0-21swapper/100:02:091
2593599504,27cyclictest0-21swapper/122:21:521
25935995023,9cyclictest642-21cat21:26:551
2593299504,40cyclictest0-21swapper/020:47:150
2593299503,42cyclictest0-21swapper/021:37:210
173092503,13sleep10-21swapper/100:15:571
16212502,41sleep00-21swapper/022:35:250
150192502,42sleep00-21swapper/019:40:510
101762504,39sleep10-21swapper/100:01:221
88832493,14sleep10-21swapper/120:34:111
42352493,39sleep00-21swapper/022:41:380
4182492,41sleep00-21swapper/019:09:310
317152493,11sleep10-21swapper/122:31:151
302362493,10sleep10-21swapper/123:33:011
2593799496,26cyclictest0-21swapper/222:42:032
2593799494,28cyclictest0-21swapper/222:52:172
2593799494,28cyclictest0-21swapper/222:52:172
2593799494,27cyclictest0-21swapper/223:17:152
2593799494,27cyclictest0-21swapper/218:57:012
2593799493,27cyclictest0-21swapper/222:17:122
2593799493,25cyclictest0-21swapper/219:32:122
25937994917,13cyclictest0-21swapper/223:02:112
2593599496,13cyclictest4044-21perl23:47:081
25935994929,13cyclictest0-21swapper/119:46:581
25935994922,9cyclictest4307-21cat22:41:521
2593299493,41cyclictest0-21swapper/020:42:260
243592492,41sleep00-21swapper/019:57:510
18162493,9sleep10-21swapper/120:21:541
161102495,10sleep10-21swapper/123:05:331
101302493,40sleep10-21swapper/119:29:231
80562482,39sleep00-21swapper/023:56:540
53502482,13sleep10-21swapper/121:35:091
53502482,13sleep10-21swapper/121:35:091
53462482,39sleep00-21swapper/023:50:370
304062482,40sleep00-21swapper/023:35:140
281312483,12sleep10-21swapper/121:15:391
2593799485,26cyclictest0-21swapper/221:59:122
2593799484,27cyclictest0-21swapper/223:22:072
2593799484,25cyclictest0-21swapper/221:22:102
2593599484,26cyclictest0-21swapper/121:44:091
2593599484,24cyclictest16956-21taskset21:57:261
25935994828,15cyclictest0-21swapper/120:11:571
25935994828,15cyclictest0-21swapper/120:11:571
25935994818,9cyclictest24600-21crond22:16:521
25935994818,9cyclictest24600-21crond22:16:521
25932994833,9cyclictest5426-21sed20:27:160
25932994825,10cyclictest0-21swapper/020:39:130
25932994819,11cyclictest0-21swapper/021:15:460
25932994816,27cyclictest0-21swapper/000:07:000
173122482,40sleep00-21swapper/022:00:110
101412482,39sleep00-21swapper/019:29:300
89542472,40sleep00-21swapper/020:35:070
2593799474,24cyclictest0-21swapper/221:52:072
2593599474,36cyclictest0-21swapper/120:56:561
2593599474,26cyclictest0-21swapper/122:07:081
2593599474,25cyclictest0-21swapper/122:49:201
25935994731,10cyclictest2397-21rt-features19:12:281
2593299474,39cyclictest0-21swapper/022:12:150
2593299474,39cyclictest0-21swapper/022:12:150
2593299474,38cyclictest0-21swapper/023:52:200
2593299474,36cyclictest0-21swapper/023:17:030
2593299473,38cyclictest0-21swapper/020:12:290
25932994726,10cyclictest0-21swapper/023:12:210
25932994715,26cyclictest0-21swapper/019:47:160
256812475,35sleep10-21swapper/123:25:561
210862472,9sleep20-21swapper/222:07:182
197232474,35sleep10-21swapper/100:21:171
137022472,39sleep00-21swapper/023:00:200
111692474,10sleep10-21swapper/122:53:281
111692474,10sleep10-21swapper/122:53:281
268352463,10sleep10-21swapper/120:03:571
25937994616,13cyclictest0-21swapper/219:17:112
2593599464,36cyclictest0-21swapper/100:11:481
25935994627,13cyclictest0-21swapper/119:26:591
25935994627,13cyclictest0-21swapper/119:26:591
25932994625,9cyclictest0-21swapper/021:43:010
256672464,35sleep10-21swapper/121:09:421
233362463,11sleep10-21swapper/123:21:251
198162462,38sleep00-21swapper/022:06:440
135992463,10sleep10-21swapper/122:59:001
89382452,38sleep00-21swapper/022:50:280
292392454,10sleep10-21swapper/122:25:061
2593599455,33cyclictest0-21swapper/123:52:101
2593599455,33cyclictest0-21swapper/123:37:051
2593599455,33cyclictest0-21swapper/123:37:051
2593599454,13cyclictest0-21swapper/121:18:191
2593599453,36cyclictest0-21swapper/119:07:271
25935994522,8cyclictest2315-21grep23:42:211
2593299455,33cyclictest0-21swapper/022:52:010
2593299455,33cyclictest0-21swapper/022:52:010
2593299454,34cyclictest0-21swapper/021:47:050
25932994531,9cyclictest20956-21grep19:52:160
2593299453,36cyclictest0-21swapper/023:07:010
2593299453,28cyclictest0-21swapper/021:07:200
2593299453,26cyclictest0-21swapper/022:07:070
2593299453,26cyclictest0-21swapper/020:56:570
2593299453,25cyclictest0-21swapper/000:21:570
2593299453,25cyclictest0-21swapper/000:21:570
25932994526,14cyclictest0-21swapper/019:42:100
25932994525,9cyclictest0-21swapper/020:06:090
255802454,6sleep00-21swapper/018:52:520
231382455,5sleep00-21swapper/021:02:520
126632453,35sleep10-21swapper/119:36:201
123582452,38sleep00-21swapper/000:03:430
317522443,9sleep10-21swapper/120:15:501
2593599443,23cyclictest16452-21munin-node23:07:021
2593599442,10cyclictest0-21swapper/119:53:361
25935994419,11cyclictest0-21swapper/120:22:231
2593299444,36cyclictest0-21swapper/020:57:270
2593299444,10cyclictest0-21swapper/022:17:220
2593299443,37cyclictest0-21swapper/023:44:320
2593299443,36cyclictest0-21swapper/021:52:060
25932994427,12cyclictest0-21swapper/019:02:160
25932994419,20cyclictest0-21swapper/020:17:030
159392444,10sleep10-21swapper/120:47:421
2593599434,31cyclictest0-21swapper/120:57:091
25932994330,9cyclictest1657-21gltestperf21:27:120
2593299433,36cyclictest0-21swapper/020:22:190
2593299433,35cyclictest0-21swapper/019:17:310
25932994328,11cyclictest0-21swapper/018:57:350
2593299432,10cyclictest0-21swapper/019:13:440
2593299424,33cyclictest0-21swapper/000:17:010
2593299424,25cyclictest0-21swapper/021:23:140
25932994216,8cyclictest25768-21awk23:26:490
2593599404,21cyclictest0-21swapper/123:27:021
2593299403,33cyclictest0-21swapper/000:12:040
2593299403,24cyclictest0-21swapper/022:42:030
2593599353,8cyclictest26051-21cat18:57:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional