You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-21 - 06:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Sat Mar 21, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2486121500,2sleep1201ktimersoftd/121:18:311
26849999433,12cyclictest0-21swapper/121:35:501
26849999433,12cyclictest0-21swapper/121:35:501
315382820,3sleep3361ktimersoftd/318:53:233
2685299654,44cyclictest0-21swapper/321:41:093
17562634,50sleep30-21swapper/322:22:553
17562634,50sleep30-21swapper/322:22:553
248599620,5rtkit-daemon2484-21rtkit-daemon20:33:591
26849996033,13cyclictest0-21swapper/122:12:551
248599600,12rtkit-daemon2484-21rtkit-daemon21:27:271
26851995917,13cyclictest0-21swapper/222:36:562
2685199591,44cyclictest0-21swapper/220:40:152
26846995913,11cyclictest0-21swapper/022:42:540
247882583,10sleep20-21swapper/218:38:322
184132583,10sleep00-21swapper/022:46:550
26846995724,11cyclictest0-21swapper/022:58:140
26846995720,21cyclictest0-21swapper/020:08:220
220622573,46sleep30-21swapper/319:40:033
72602563,12sleep20-21swapper/220:05:342
2685299565,45cyclictest20818-21users22:48:273
2685299565,44cyclictest30818-21diskstats19:53:163
2685299565,44cyclictest22868-21users22:03:303
2685299564,45cyclictest0-21swapper/322:53:043
26852995636,6cyclictest13962-21ssh20:15:233
26852995636,6cyclictest13962-21ssh20:15:233
2685199564,36cyclictest0-21swapper/222:21:472
2685199564,36cyclictest0-21swapper/222:21:472
2684699562,50cyclictest0-21swapper/020:36:520
26846995612,9cyclictest11967-21crond22:37:550
262662563,13sleep00-21swapper/019:47:260
8262553,9sleep10-21swapper/122:19:431
8262553,9sleep10-21swapper/122:19:431
327332553,45sleep00-21swapper/017:48:250
325542553,45sleep00-21swapper/019:55:040
2685299557,13cyclictest2001-21fschecks_time19:58:173
2685299554,44cyclictest27704-21ssh19:48:213
2685299554,43cyclictest15604-21df_inode19:28:183
2685299553,44cyclictest25419-21munin-node22:08:173
2685299553,43cyclictest5509-21munin-node22:28:083
2685299553,43cyclictest1813-21munin-node17:53:313
26851995541,9cyclictest29982-21wc23:03:132
26851995520,12cyclictest8973-21fschecks_time20:08:182
2685199552,40cyclictest0-21swapper/222:59:592
26851995518,20cyclictest15353-21nscd22:28:052
2684699552,47cyclictest0-21swapper/021:53:490
248599550,6rtkit-daemon2484-21rtkit-daemon21:17:571
248599550,5rtkit-daemon2484-21rtkit-daemon20:48:281
248599550,5rtkit-daemon2484-21rtkit-daemon19:43:161
248599550,5rtkit-daemon2484-21rtkit-daemon18:03:351
248599550,5rtkit-daemon2484-21rtkit-daemon18:03:351
2685299545,43cyclictest0-21swapper/321:53:273
2685299544,44cyclictest1151-21df21:33:103
2685299544,44cyclictest1151-21df21:33:103
2684999543,43cyclictest0-21swapper/119:38:141
2684699544,43cyclictest0-21swapper/020:53:130
2684699544,43cyclictest0-21swapper/020:53:130
2684699542,47cyclictest0-21swapper/021:19:510
248599540,5rtkit-daemon2484-21rtkit-daemon21:53:111
248599540,5rtkit-daemon2484-21rtkit-daemon17:43:051
308972532,9sleep30-21swapper/320:40:453
277492533,44sleep00-21swapper/019:48:230
27332533,43sleep00-21swapper/017:53:250
2685299535,42cyclictest0-21swapper/321:49:163
2685299534,42cyclictest25767-21yum-updatesd-he21:21:403
2685299534,41cyclictest30661-21sed21:28:163
2685299534,41cyclictest19590-21diskmemload22:12:583
2685299534,41cyclictest0-21swapper/322:33:213
2685299534,27cyclictest0-21swapper/323:03:043
26852995338,10cyclictest32681-21gltestperf20:43:183
2685299533,42cyclictest30017-21df_inode17:43:213
2685299532,44cyclictest9098-21munin-node18:08:273
26849995330,11cyclictest0-21swapper/120:29:161
2684699534,42cyclictest0-21swapper/022:07:560
2684699534,42cyclictest0-21swapper/021:38:080
2684699534,33cyclictest0-21swapper/018:38:250
2684699533,40cyclictest0-21swapper/022:13:180
248599530,5rtkit-daemon2484-21rtkit-daemon21:48:331
248599530,5rtkit-daemon2484-21rtkit-daemon21:28:121
248599530,5rtkit-daemon2484-21rtkit-daemon20:21:441
248599530,5rtkit-daemon2484-21rtkit-daemon19:18:021
248599530,5rtkit-daemon2484-21rtkit-daemon17:58:201
204582533,44sleep00-21swapper/020:24:300
202682532,9sleep30-21swapper/322:01:153
103942533,44sleep00-21swapper/021:47:010
96742522,44sleep20-21swapper/218:08:222
2685299525,41cyclictest20279-21diskstats21:13:143
2685299524,43cyclictest2847-21munin-node20:48:123
2685299524,42cyclictest23796-21ssh19:43:163
2685299524,41cyclictest8513-21rm21:43:173
2685299524,41cyclictest27641-21diskstats17:38:213
2685299524,41cyclictest19590-21diskmemload22:25:183
2685299524,41cyclictest0-21swapper/318:28:043
26852995236,10cyclictest1127-21tail17:48:373
2685299523,42cyclictest9570-21munin-node20:58:133
2685299523,42cyclictest18650-21munin-node18:28:363
2685299523,42cyclictest1287-21snmpd18:04:143
2685299523,42cyclictest1287-21snmpd18:04:143
2685299523,41cyclictest5478-21munin-node19:08:143
2685299523,41cyclictest18755-21rm21:10:353
2685299523,40cyclictest4805-21ssh20:03:023
2685199524,41cyclictest19590-21diskmemload20:52:582
26851995220,8cyclictest2430-21ssh19:58:222
26851995219,8cyclictest21423-21ssh22:50:372
26851995216,13cyclictest0-21swapper/220:37:592
26851995214,24cyclictest0-21swapper/221:21:172
2684999523,24cyclictest8581-21if_eth021:43:171
26849995228,11cyclictest0-21swapper/121:09:381
26849995227,10cyclictest23878-21switchtime22:53:241
2684699524,41cyclictest0-21swapper/019:58:290
2684699524,29cyclictest0-21swapper/020:28:110
2684699523,43cyclictest0-21swapper/022:18:470
2684699523,43cyclictest0-21swapper/022:18:470
2684699522,43cyclictest0-21swapper/019:42:590
248599520,5rtkit-daemon2484-21rtkit-daemon22:16:021
248599520,5rtkit-daemon2484-21rtkit-daemon22:06:031
248599520,5rtkit-daemon2484-21rtkit-daemon20:08:151
248599520,5rtkit-daemon2484-21rtkit-daemon20:03:451
248599520,5rtkit-daemon2484-21rtkit-daemon19:53:301
248599520,5rtkit-daemon2484-21rtkit-daemon19:21:461
248599520,4rtkit-daemon2484-21rtkit-daemon22:28:541
230672522,43sleep10-21swapper/118:36:221
189712523,42sleep20-21swapper/221:58:242
89632513,10sleep20-21swapper/220:56:452
89632513,10sleep20-21swapper/220:56:452
325482512,41sleep10-21swapper/120:43:171
290482513,41sleep00-21swapper/021:26:170
2685299519,36cyclictest0-21swapper/320:24:483
2685299514,42cyclictest19590-21diskmemload23:02:183
2685299514,41cyclictest6810-21diskstats20:53:153
2685299514,41cyclictest6810-21diskstats20:53:153
2685299514,41cyclictest19590-21diskmemload20:33:443
2685299514,39cyclictest1287-21snmpd17:59:143
2685299513,43cyclictest22268-21df_inode20:28:163
2685299513,41cyclictest19590-21diskmemload20:08:573
2685299513,40cyclictest26388-21ssh21:23:033
2685199514,40cyclictest1287-21snmpd18:24:182
2685199514,12cyclictest0-21swapper/221:33:182
2685199514,12cyclictest0-21swapper/221:33:182
2685199513,41cyclictest6228-21ssh21:39:012
2685199513,41cyclictest4547-21kworker/2:120:25:422
2685199513,41cyclictest0-21swapper/222:03:132
2685199513,41cyclictest0-21swapper/221:07:582
2684699516,39cyclictest0-21swapper/020:45:590
2684699515,41cyclictest0-21swapper/022:26:270
2684699514,43cyclictest0-21swapper/021:58:020
2684699514,41cyclictest0-21swapper/021:15:260
2684699513,43cyclictest0-21swapper/020:58:310
2684699513,42cyclictest0-21swapper/020:48:100
26846995124,8cyclictest10011-21latency_hist19:18:030
248599510,5rtkit-daemon2484-21rtkit-daemon22:37:161
145902512,43sleep00-21swapper/020:17:410
145902512,43sleep00-21swapper/020:17:410
50412503,41sleep00-21swapper/019:05:300
314102502,42sleep00-21swapper/017:45:430
309592503,41sleep00-21swapper/020:40:590
305282503,39sleep00-21swapper/018:53:050
2685299506,39cyclictest19590-21diskmemload22:43:063
2685299504,39cyclictest1681-21nscd19:22:483
2685299504,39cyclictest15089-21ssh22:42:033
2685299503,41cyclictest23440-21munin-node18:38:243
2685299503,40cyclictest7959-21kworker/3:020:18:043
2685299503,40cyclictest1287-21snmpd21:04:443
2685299503,40cyclictest1287-21snmpd18:44:213
2685199505,28cyclictest0-21swapper/221:43:152
2685199504,30cyclictest0-21swapper/219:53:162
2685199504,24cyclictest22312-21munin-node22:53:132
2685199503,40cyclictest19590-21diskmemload21:56:442
2685199503,32cyclictest0-21swapper/219:39:552
2685199503,20cyclictest8870-21munin-run18:08:052
2685199503,20cyclictest8870-21munin-run18:08:052
26851995019,9cyclictest24813-21ssh20:32:592
26851995018,12cyclictest0-21swapper/220:58:192
26851995012,34cyclictest281ktimersoftd/220:16:242
26851995012,34cyclictest281ktimersoftd/220:16:242
2684699509,10cyclictest121850irq/46-eth021:48:120
2684699508,25cyclictest0-21swapper/022:30:260
2684699505,39cyclictest0-21swapper/019:08:140
2684699504,40cyclictest0-21swapper/020:19:220
26846995022,7cyclictest19591-21latency_hist19:38:030
267562502,41sleep20-21swapper/219:48:122
248599500,5rtkit-daemon2484-21rtkit-daemon21:40:411
248599500,5rtkit-daemon2484-21rtkit-daemon19:02:471
248599500,5rtkit-daemon2484-21rtkit-daemon17:48:501
173862503,40sleep20-21swapper/220:20:332
159052502,9sleep30-21swapper/318:21:333
157252503,41sleep00-21swapper/021:06:500
51912492,41sleep10-21swapper/119:07:291
302202492,9sleep30-21swapper/318:51:113
302202492,9sleep30-21swapper/318:51:113
291242493,40sleep21287-21snmpd17:41:582
277912493,40sleep00-21swapper/018:45:400
2685299493,40cyclictest1287-21snmpd18:34:193
2685199495,27cyclictest0-21swapper/221:28:152
2685199493,40cyclictest1287-21snmpd21:14:462
2685199493,39cyclictest19590-21diskmemload20:43:252
2685199493,39cyclictest10627-21kworker/2:122:13:332
26851994912,32cyclictest17002-21processes22:43:222
2684999493,41cyclictest0-21swapper/119:58:271
2684699495,27cyclictest0-21swapper/018:12:490
2684699495,26cyclictest0-21swapper/021:10:210
2684699494,38cyclictest0-21swapper/021:28:090
26846994930,13cyclictest0-21swapper/022:48:030
2684699493,39cyclictest0-21swapper/019:23:120
26846994920,11cyclictest0-21swapper/018:23:160
248599490,5rtkit-daemon2484-21rtkit-daemon19:08:171
248599490,4rtkit-daemon2484-21rtkit-daemon19:28:311
182302492,41sleep10-21swapper/118:25:461
143312492,41sleep10-21swapper/122:39:181
133992492,9sleep10-21swapper/118:15:061
124982493,7sleep312505-21irqstats18:13:273
123102493,39sleep00-21swapper/019:21:550
85512482,40sleep10-21swapper/120:55:151
85512482,40sleep10-21swapper/120:55:151
50792482,40sleep10-21swapper/122:27:211
2685299484,39cyclictest8016-21telnet19:13:143
2685299483,39cyclictest0-21swapper/319:23:133
2685199488,24cyclictest0-21swapper/221:08:192
26851994833,9cyclictest8170-21cpuspeed_turbos19:13:152
26851994833,10cyclictest12166-21grep21:48:212
26851994832,9cyclictest17795-21grep19:33:152
26851994832,9cyclictest17795-21grep19:33:152
2685199483,39cyclictest26371-21ssh21:23:002
2685199483,37cyclictest24392-21aten_r1power_en22:08:062
2685199482,24cyclictest2743-21ssh22:23:122
26851994819,12cyclictest0-21swapper/218:48:222
26851994819,12cyclictest0-21swapper/218:48:222
2684699486,26cyclictest0-21swapper/022:08:240
2684699484,26cyclictest0-21swapper/022:57:480
2684699483,39cyclictest0-21swapper/023:04:170
26846994820,8cyclictest16161-21cat18:23:050
248599480,5rtkit-daemon2484-21rtkit-daemon21:03:131
248599480,5rtkit-daemon2484-21rtkit-daemon17:48:051
230512484,9sleep00-21swapper/018:36:090
211212482,9sleep10-21swapper/122:49:301
141442483,40sleep114147-21ssh20:16:051
141442483,40sleep114147-21ssh20:16:051
111162482,39sleep10-21swapper/118:11:271
305052472,39sleep10-21swapper/120:39:181
302072473,38sleep00-21swapper/018:50:590
302072473,38sleep00-21swapper/018:50:590
2685299474,38cyclictest0-21swapper/318:58:313
2685199474,26cyclictest0-21swapper/219:18:322
26851994733,9cyclictest12096-21tune2fs18:13:222
26851994732,10cyclictest6280-21grep19:08:222
2685199473,38cyclictest26421-21ssh19:47:542
26851994721,10cyclictest12628-21cstates22:38:082
2684699475,36cyclictest0-21swapper/021:33:250
2684699475,36cyclictest0-21swapper/021:33:250
2684699474,27cyclictest0-21swapper/017:59:270
26846994721,7cyclictest17205-21latency_hist19:33:030
268052473,6sleep00-21swapper/017:38:010
195392472,39sleep10-21swapper/121:58:351
122672472,9sleep10-21swapper/121:01:311
52122462,9sleep20-21swapper/219:07:462
324212462,9sleep20-21swapper/218:53:482
2685299464,35cyclictest0-21swapper/319:38:033
2685199464,27cyclictest0-21swapper/218:58:332
26851994632,8cyclictest6475-21crond18:03:052
2685199463,37cyclictest13871-21munin-node18:18:242
26851994618,8cyclictest31834-21munin-node17:48:322
2684999466,34cyclictest0-21swapper/120:23:451
2684999463,38cyclictest0-21swapper/119:48:311
2684699465,26cyclictest0-21swapper/017:43:060
2684699465,12cyclictest0-21swapper/018:03:260
2684699465,12cyclictest0-21swapper/018:03:260
2684699464,26cyclictest0-21swapper/019:33:150
2684699463,37cyclictest0-21swapper/020:03:150
26422463,38sleep00-21swapper/019:00:180
188782462,38sleep10-21swapper/119:33:321
188782462,38sleep10-21swapper/119:33:321
315312452,9sleep10-21swapper/123:05:461
2685299453,36cyclictest26970-21cat17:38:073
2685199455,12cyclictest0-21swapper/218:43:192
2685199454,23cyclictest26822-21latency_hist17:38:072
2685199453,25cyclictest19689-21taskset18:28:272
2685199452,36cyclictest12634-21munin-node19:23:132
26851994510,21cyclictest20817-1kworker/2:0H18:33:222
2684999453,36cyclictest28194-21ssh23:00:461
26849994525,14cyclictest0-21swapper/122:44:181
2684699455,34cyclictest0-21swapper/018:28:240
37752442,9sleep10-21swapper/117:54:061
301862442,9sleep10-21swapper/118:50:441
301862442,9sleep10-21swapper/118:50:441
2685199443,26cyclictest0-21swapper/217:43:392
26851994418,12cyclictest0-21swapper/217:53:402
26851994416,12cyclictest0-21swapper/219:28:262
253252442,36sleep10-21swapper/118:39:401
26852994317,8cyclictest18008-21diskstats19:33:173
26852994317,11cyclictest0-21swapper/319:03:223
2684699434,33cyclictest0-21swapper/018:13:340
248599420,4rtkit-daemon2484-21rtkit-daemon18:53:181
248599420,4rtkit-daemon2484-21rtkit-daemon18:21:561
26849994127,10cyclictest0-21swapper/118:28:101
248599410,4rtkit-daemon2484-21rtkit-daemon19:23:311
248599410,4rtkit-daemon2484-21rtkit-daemon18:43:331
2684999373,28cyclictest0-21swapper/117:38:071
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional