You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-26 - 12:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Thu Mar 26, 2026 00:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
225022990,3sleep1201ktimersoftd/122:33:421
248599760,31rtkit-daemon0-21swapper/117:59:571
342699682,60cyclictest0-21swapper/222:08:382
342699673,57cyclictest0-21swapper/222:38:272
342699664,53cyclictest0-21swapper/220:38:512
3425996626,24cyclictest3628-21processes22:53:411
3426996523,25cyclictest0-21swapper/220:12:032
342699643,52cyclictest0-21swapper/220:43:492
342799634,52cyclictest0-21swapper/321:13:403
3426996336,8cyclictest1138-21crond20:28:182
342699633,53cyclictest0-21swapper/221:13:462
342699633,12cyclictest0-21swapper/222:33:452
342699633,12cyclictest0-21swapper/219:48:312
3425996342,13cyclictest0-21swapper/122:48:231
342699623,51cyclictest0-21swapper/221:38:322
342699623,51cyclictest0-21swapper/221:38:322
248599620,5rtkit-daemon2484-21rtkit-daemon21:30:342
342699613,14cyclictest0-21swapper/222:17:202
342699613,12cyclictest0-21swapper/220:28:342
342699612,53cyclictest0-21swapper/219:45:302
3425996134,12cyclictest0-21swapper/120:53:261
342699604,8cyclictest1684-21nscd22:03:132
342699603,50cyclictest0-21swapper/217:59:132
342699603,13cyclictest0-21swapper/219:08:512
3425996029,13cyclictest0-21swapper/119:38:421
342399605,46cyclictest0-21swapper/022:38:410
3423996011,42cyclictest0-21swapper/021:46:200
248599600,4rtkit-daemon2484-21rtkit-daemon20:57:052
342799594,48cyclictest0-21swapper/321:50:223
3426995923,12cyclictest0-21swapper/221:27:302
3426995921,23cyclictest0-21swapper/222:32:322
342599594,15cyclictest0-21swapper/121:12:331
3425995937,15cyclictest0-21swapper/122:43:271
3425995928,13cyclictest3735-21gltestperf21:18:341
342399597,11cyclictest0-21swapper/022:18:240
342399597,11cyclictest0-21swapper/022:18:240
3423995915,36cyclictest28411-21munin-node21:08:370
248599590,6rtkit-daemon17846-21gltestperf20:03:371
342799584,47cyclictest0-21swapper/320:12:283
342799584,14cyclictest5056-21gltestperf22:08:333
342699583,13cyclictest0-21swapper/218:28:392
3426995823,12cyclictest0-21swapper/221:20:572
3425995842,11cyclictest0-21swapper/122:18:271
3425995842,11cyclictest0-21swapper/122:18:271
342599583,34cyclictest0-21swapper/122:30:241
342399589,32cyclictest18782-21df_abs20:53:290
342399586,22cyclictest0-21swapper/021:38:300
342399586,22cyclictest0-21swapper/021:38:300
3423995811,16cyclictest30839-21crond22:48:110
292972584,45sleep20-21swapper/219:33:372
292972584,45sleep20-21swapper/219:33:372
342799574,45cyclictest0-21swapper/318:56:363
342799574,14cyclictest0-21swapper/321:33:153
342699578,43cyclictest0-21swapper/220:18:472
342699574,46cyclictest0-21swapper/221:53:412
342699573,8cyclictest24369-21fschecks_count20:13:342
342699573,47cyclictest0-21swapper/222:43:442
342699573,13cyclictest0-21swapper/222:48:462
342699573,13cyclictest0-21swapper/220:03:352
342399579,40cyclictest12082-21df20:43:300
342399574,45cyclictest0-21swapper/022:53:360
342399574,45cyclictest0-21swapper/022:07:200
342399574,45cyclictest0-21swapper/019:58:410
3423995711,39cyclictest8623-21systemd-cgroups23:03:110
3423995711,39cyclictest8623-21systemd-cgroups23:03:110
280952573,12sleep30-21swapper/319:28:543
92092562,9sleep10-21swapper/120:38:381
342699563,38cyclictest0-21swapper/218:45:422
3426995611,38cyclictest0-21swapper/221:08:342
3425995624,12cyclictest0-21swapper/119:48:421
342399565,45cyclictest41ktimersoftd/019:51:560
342399565,43cyclictest0-21swapper/021:58:370
3423995637,12cyclictest0-21swapper/020:18:340
160592563,12sleep20-21swapper/220:00:502
136212562,10sleep20-21swapper/222:21:512
136212562,10sleep20-21swapper/222:21:512
342799554,46cyclictest0-21swapper/322:02:303
342799554,45cyclictest0-21swapper/320:54:323
342799554,45cyclictest0-21swapper/320:24:253
342799554,23cyclictest0-21swapper/320:18:183
342799553,45cyclictest0-21swapper/321:23:353
342699553,45cyclictest0-21swapper/219:42:202
342599554,42cyclictest0-21swapper/122:23:311
3425995539,11cyclictest0-21swapper/122:38:421
3425995538,10cyclictest10882-21fschecks_count19:53:361
3425995537,11cyclictest28449-21diskmemload21:49:471
3425995536,13cyclictest0-21swapper/120:46:351
3425995534,14cyclictest0-21swapper/120:51:321
342599553,47cyclictest0-21swapper/120:25:101
342599552,41cyclictest0-21swapper/120:21:461
342399559,28cyclictest13359-21ssh19:58:150
342399557,40cyclictest7630-21timerwakeupswit17:38:560
342399556,42cyclictest0-21swapper/022:23:250
342399556,27cyclictest0-21swapper/019:28:310
342399553,32cyclictest0-21swapper/022:33:470
3423995520,27cyclictest19210-21tail19:13:320
3423995516,22cyclictest1466-21ssh20:28:280
3423995514,33cyclictest0-21swapper/022:12:400
3423995514,23cyclictest0-21swapper/021:24:550
3423995512,36cyclictest0-21swapper/021:55:160
3423995511,37cyclictest32068-21crond18:33:210
3423995511,25cyclictest0-21swapper/020:59:140
3423995511,25cyclictest0-21swapper/020:59:140
34332543,44sleep10-21swapper/118:38:461
342799545,27cyclictest14864-21diskstats22:23:283
342799544,45cyclictest0-21swapper/319:50:043
342799544,13cyclictest0-21swapper/319:38:303
3427995411,26cyclictest0-21swapper/320:22:383
342699547,32cyclictest0-21swapper/221:44:102
3426995423,19cyclictest0-21swapper/222:25:172
342699542,10cyclictest0-21swapper/222:53:262
342699542,10cyclictest0-21swapper/221:03:492
3425995435,13cyclictest0-21swapper/123:02:041
3425995435,13cyclictest0-21swapper/123:02:041
3425995435,12cyclictest22762-21irqstats20:58:391
3425995435,12cyclictest22762-21irqstats20:58:391
342599543,11cyclictest0-21swapper/121:26:261
342399549,38cyclictest0-21swapper/020:09:020
342399547,40cyclictest8767-21missed_timers22:13:370
342399547,29cyclictest10227-21ssh20:39:050
342399543,44cyclictest0-21swapper/019:41:140
248599540,5rtkit-daemon2484-21rtkit-daemon22:03:322
248599540,5rtkit-daemon2484-21rtkit-daemon20:58:352
248599540,5rtkit-daemon2484-21rtkit-daemon20:58:352
13622543,44sleep10-21swapper/121:14:181
342799534,27cyclictest0-21swapper/320:49:063
3427995310,37cyclictest0-21swapper/322:48:113
342699537,40cyclictest0-21swapper/221:33:322
3426995332,8cyclictest28449-21diskmemload19:55:212
3426995325,13cyclictest0-21swapper/223:01:582
3426995325,13cyclictest0-21swapper/223:01:582
342599535,26cyclictest0-21swapper/120:32:151
342599534,15cyclictest0-21swapper/118:15:271
3425995332,10cyclictest0-21swapper/119:08:491
3425995326,13cyclictest0-21swapper/122:13:411
3425995310,8cyclictest121850irq/46-eth022:06:331
342399539,26cyclictest0-21swapper/021:13:380
342399539,26cyclictest0-21swapper/020:17:170
342399537,25cyclictest0-21swapper/020:48:380
342399533,44cyclictest0-21swapper/019:35:400
342399533,44cyclictest0-21swapper/019:35:400
342399533,42cyclictest0-21swapper/020:26:560
3423995319,27cyclictest28449-21diskmemload22:48:320
3423995313,12cyclictest0-21swapper/021:48:270
3423995312,35cyclictest0-21swapper/021:36:360
3423995310,25cyclictest0-21swapper/021:19:250
342799526,25cyclictest10340-21yum-updatesd-he22:17:183
342799524,27cyclictest0-21swapper/317:43:243
342799524,22cyclictest0-21swapper/322:58:253
342799524,22cyclictest0-21swapper/322:58:253
3427995236,10cyclictest3759-21gltestperf21:18:343
3427995221,13cyclictest0-21swapper/321:33:363
3427995221,13cyclictest0-21swapper/319:43:433
3426995223,12cyclictest0-21swapper/220:36:392
342599525,15cyclictest0-21swapper/121:57:081
342599524,29cyclictest0-21swapper/121:59:531
3425995237,10cyclictest0-21swapper/117:53:501
3425995234,12cyclictest0-21swapper/120:34:581
3425995213,11cyclictest4877-21timerandwakeup19:43:501
342399528,38cyclictest5385-21df_abs20:33:320
342399528,26cyclictest0-21swapper/020:03:320
342399527,27cyclictest0-21swapper/019:46:150
3423995213,24cyclictest0-21swapper/022:28:250
3423995210,35cyclictest0-21swapper/019:23:310
283032522,9sleep20-21swapper/219:31:352
248599520,5rtkit-daemon2484-21rtkit-daemon21:48:252
342799516,39cyclictest0-21swapper/321:44:313
342799515,26cyclictest0-21swapper/322:35:253
342799514,41cyclictest12205-21df_abs20:43:303
342799514,14cyclictest0-21swapper/322:28:313
342799514,13cyclictest0-21swapper/322:58:123
3427995137,8cyclictest31653-21grep18:28:553
342799513,32cyclictest0-21swapper/321:54:143
3427995123,11cyclictest0-21swapper/320:59:483
3427995123,11cyclictest0-21swapper/320:59:483
3426995124,12cyclictest0-21swapper/220:48:262
3425995138,8cyclictest5613-21ssh22:08:421
3425995135,11cyclictest0-21swapper/118:03:341
3425995135,11cyclictest0-21swapper/118:03:341
3425995132,7cyclictest25713-21rm21:03:381
3425995122,24cyclictest20975-21netstat21:43:391
342399516,38cyclictest0-21swapper/021:28:310
342399514,28cyclictest0-21swapper/019:08:360
3423995129,13cyclictest0-21swapper/018:43:540
3423995111,25cyclictest0-21swapper/017:58:360
196532512,9sleep30-21swapper/320:06:393
17182512,42sleep10-21swapper/118:34:111
164702512,9sleep30-21swapper/320:02:203
97232502,9sleep10-21swapper/117:43:531
342799509,36cyclictest0-21swapper/319:13:463
342799508,37cyclictest34-21rcuc/322:48:253
342799505,39cyclictest0-21swapper/320:28:543
3427995036,9cyclictest21777-21cpuspeed_turbos19:18:343
3426995029,8cyclictest3703-21telnet17:33:362
342599505,28cyclictest0-21swapper/119:16:411
342599505,28cyclictest0-21swapper/118:08:411
342599505,27cyclictest0-21swapper/121:28:351
342599505,27cyclictest0-21swapper/119:58:331
342599505,27cyclictest0-21swapper/119:18:371
342599504,29cyclictest0-21swapper/120:08:441
342599504,29cyclictest0-21swapper/118:58:361
342599504,28cyclictest0-21swapper/119:33:481
342599504,28cyclictest0-21swapper/119:33:481
342599504,28cyclictest0-21swapper/118:28:391
3425995022,14cyclictest0-21swapper/120:15:251
3425995021,12cyclictest0-21swapper/118:23:451
3425995013,23cyclictest0-21swapper/119:03:241
342399506,26cyclictest27281-21sadc18:23:230
342399505,27cyclictest16559-21latency_hist19:08:210
342399504,29cyclictest0-21swapper/018:23:350
342399504,27cyclictest0-21swapper/021:03:430
342399504,27cyclictest0-21swapper/018:58:360
3423995035,9cyclictest12539-21head17:48:560
28882503,7sleep32893-21ssh22:04:263
186902502,9sleep30-21swapper/319:10:573
146332502,10sleep30-21swapper/317:53:543
71712492,9sleep30-21swapper/318:48:273
71712492,9sleep30-21swapper/318:48:273
342799498,26cyclictest0-21swapper/320:35:193
342799495,27cyclictest0-21swapper/319:55:033
342799495,26cyclictest0-21swapper/319:35:083
342799495,26cyclictest0-21swapper/319:35:083
342799495,14cyclictest0-21swapper/321:08:363
342799494,39cyclictest0-21swapper/321:06:343
342799494,10cyclictest0-21swapper/320:38:343
3427994920,13cyclictest0-21swapper/321:38:333
3427994920,13cyclictest0-21swapper/321:38:333
3427994918,13cyclictest0-21swapper/317:58:533
3426994933,10cyclictest25495-21cpuspeed_turbos18:18:372
3426994926,7cyclictest19116-21munin-node19:13:412
342699492,13cyclictest0-21swapper/219:03:312
342599494,39cyclictest0-21swapper/118:48:501
342599494,39cyclictest0-21swapper/118:48:501
342599494,29cyclictest0-21swapper/118:53:481
342599494,28cyclictest0-21swapper/121:33:541
342599494,28cyclictest0-21swapper/119:23:531
3425994928,10cyclictest0-21swapper/118:48:221
3425994920,12cyclictest0-21swapper/121:38:251
3425994920,12cyclictest0-21swapper/121:38:251
342399495,27cyclictest0-21swapper/018:08:490
342399494,28cyclictest0-21swapper/018:33:550
342399494,28cyclictest0-21swapper/017:43:470
342399494,27cyclictest0-21swapper/018:13:380
3423994933,10cyclictest5361-21unixbench_multi17:33:570
3423994932,10cyclictest13550-21grep17:53:370
258962492,9sleep30-21swapper/319:26:163
127352492,9sleep30-21swapper/317:50:403
3427994820,12cyclictest0-21swapper/322:18:233
3427994820,12cyclictest0-21swapper/322:18:233
3426994831,10cyclictest26057-21crond19:28:192
3426994827,9cyclictest0-21swapper/218:58:472
342599484,27cyclictest0-21swapper/117:48:391
342399487,34cyclictest4560-21latency_hist18:43:210
342399487,34cyclictest0-21swapper/018:48:360
342399487,34cyclictest0-21swapper/018:48:360
342399485,37cyclictest0-21swapper/018:53:500
342399485,27cyclictest0-21swapper/019:20:370
342399484,37cyclictest0-21swapper/018:08:230
342399484,37cyclictest0-21swapper/018:08:230
342799475,25cyclictest0-21swapper/322:38:463
342799474,26cyclictest0-21swapper/319:00:343
342799474,26cyclictest0-21swapper/318:33:483
3427994734,7cyclictest0-21swapper/317:33:363
3427994717,10cyclictest4793-21munin-node18:43:473
342699474,26cyclictest0-21swapper/218:38:412
342699473,8cyclictest22078-21taskset18:08:552
342699473,38cyclictest0-21swapper/217:38:472
342699472,12cyclictest0-21swapper/219:19:522
342699472,12cyclictest0-21swapper/218:25:282
342699472,11cyclictest0-21swapper/218:53:382
342699472,11cyclictest0-21swapper/218:16:212
342699472,11cyclictest0-21swapper/218:05:502
342699472,11cyclictest0-21swapper/218:05:502
342699472,11cyclictest0-21swapper/217:52:582
342599474,27cyclictest0-21swapper/119:28:471
342599474,26cyclictest0-21swapper/117:40:211
200012472,9sleep30-21swapper/318:06:563
200012472,9sleep30-21swapper/318:06:563
342799465,34cyclictest0-21swapper/319:03:303
342799464,25cyclictest0-21swapper/317:44:003
3427994631,10cyclictest23591-21sed18:13:413
342699463,7cyclictest15341-21latency_hist17:58:242
342699462,11cyclictest0-21swapper/218:51:232
342699462,11cyclictest0-21swapper/218:51:232
342699462,11cyclictest0-21swapper/218:34:012
342699462,11cyclictest0-21swapper/217:43:262
342599464,25cyclictest0-21swapper/117:35:201
221882462,9sleep30-21swapper/318:09:223
342799455,35cyclictest0-21swapper/318:38:393
342799455,35cyclictest0-21swapper/318:23:393
342799455,35cyclictest0-21swapper/318:18:463
342699453,25cyclictest0-21swapper/217:33:252
342599424,15cyclictest0-21swapper/118:18:461
31222424,31sleep10-21swapper/117:29:551
3423994115,19cyclictest3393-21crond17:33:240
342799374,27cyclictest0-21swapper/317:33:253
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional