You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-09 - 04:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Fri Jan 09, 2026 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
181202960,6sleep0132199cyclictest20:25:050
181202960,6sleep0132199cyclictest20:25:050
132499723,62cyclictest281ktimersoftd/220:44:532
132599664,55cyclictest19155-21gltestperf21:35:003
132399654,54cyclictest0-21swapper/123:54:531
132399654,44cyclictest32483-21latency_hist19:49:471
132399653,43cyclictest18284-21cat21:34:421
132399653,43cyclictest10953-21cat23:34:381
132499644,40cyclictest0-21swapper/223:40:122
132399643,42cyclictest16996-21cat20:24:441
132599633,51cyclictest9669-21sadc22:24:393
132399634,52cyclictest0-21swapper/121:25:001
132399634,52cyclictest0-21swapper/121:14:551
132399633,53cyclictest0-21swapper/119:24:461
132399633,41cyclictest28829-21cat23:04:381
132199634,53cyclictest0-21swapper/020:34:530
232322624,50sleep20-21swapper/219:29:582
132499611,54cyclictest0-21swapper/223:10:112
132399615,49cyclictest1419-21runrttasks00:05:081
132399615,49cyclictest1419-21runrttasks00:05:081
132399614,51cyclictest0-21swapper/119:34:461
132199613,50cyclictest0-21swapper/020:49:550
292152603,49sleep10-21swapper/100:10:051
132599603,49cyclictest0-21swapper/320:25:143
132599603,49cyclictest0-21swapper/320:25:143
132499605,49cyclictest0-21swapper/220:00:002
132499602,45cyclictest0-21swapper/222:21:252
132399605,48cyclictest0-21swapper/121:00:051
132399604,49cyclictest0-21swapper/120:49:441
132399604,49cyclictest0-21swapper/119:50:031
132399604,48cyclictest0-21swapper/118:50:001
132399603,51cyclictest0-21swapper/122:34:531
132399603,51cyclictest0-21swapper/122:34:531
132399603,50cyclictest0-21swapper/120:30:051
1321996032,12cyclictest0-21swapper/022:40:020
233002590,6sleep323301-21processes20:35:123
132599593,50cyclictest0-21swapper/300:04:533
132599593,50cyclictest0-21swapper/300:04:533
132399595,47cyclictest0-21swapper/121:39:521
132399593,51cyclictest0-21swapper/121:35:141
132399593,49cyclictest13468-21munin-node23:39:571
1323995915,14cyclictest0-21swapper/122:54:511
145202583,9sleep314594-21missed_timers23:40:003
132499583,48cyclictest0-21swapper/219:50:092
132499582,50cyclictest0-21swapper/219:10:352
132499582,48cyclictest0-21swapper/223:15:052
132399588,45cyclictest0-21swapper/120:39:571
132399585,47cyclictest0-21swapper/119:35:071
132399584,47cyclictest0-21swapper/100:03:141
132399583,49cyclictest0-21swapper/122:14:501
132399583,49cyclictest0-21swapper/118:55:151
132399583,48cyclictest30244-21munin-node22:00:011
132399583,48cyclictest0-21swapper/119:15:161
132599574,9cyclictest27718-21munin-run19:39:463
132599573,12cyclictest0-21swapper/323:29:543
132599572,48cyclictest0-21swapper/322:55:093
132499574,17cyclictest0-21swapper/221:35:002
132499574,13cyclictest10825-21crond23:34:372
132499572,49cyclictest0-21swapper/219:40:092
132499572,49cyclictest0-21swapper/219:40:092
132399574,47cyclictest0-21swapper/123:25:071
132399574,11cyclictest25501-21aten_r1power_cu21:49:521
132399574,11cyclictest25501-21aten_r1power_cu21:49:521
132399573,48cyclictest0-21swapper/119:00:131
132399573,47cyclictest5204-21munin-node20:00:101
132399573,47cyclictest0-21swapper/121:55:011
1321995731,12cyclictest0-21swapper/023:19:490
1321995731,12cyclictest0-21swapper/023:19:490
132199573,48cyclictest0-21swapper/020:29:590
132199573,47cyclictest14454-21systemd-cgroups22:34:390
132199573,47cyclictest0-21swapper/019:24:410
1321995729,13cyclictest0-21swapper/021:05:090
1321995729,13cyclictest0-21swapper/021:05:090
248599560,5rtkit-daemon2484-21rtkit-daemon23:44:482
204282562,9sleep00-21swapper/021:39:100
132599564,10cyclictest23729-21diskstats19:30:023
132599563,47cyclictest0-21swapper/321:50:013
132599563,47cyclictest0-21swapper/321:50:013
132599563,47cyclictest0-21swapper/320:20:113
1325995621,12cyclictest0-21swapper/320:50:193
132599562,48cyclictest0-21swapper/323:50:063
132599562,48cyclictest0-21swapper/323:24:473
132599562,48cyclictest0-21swapper/319:15:193
132599562,47cyclictest0-21swapper/322:41:043
132499563,29cyclictest0-21swapper/220:39:542
132499562,47cyclictest0-21swapper/221:00:072
132399565,45cyclictest7516-21munin-node22:20:021
132399564,45cyclictest24908-21sshd21:45:231
132399563,47cyclictest32635-21munin-node22:04:551
132399563,47cyclictest0-21swapper/120:09:551
132399563,47cyclictest0-21swapper/119:13:421
132399563,46cyclictest20307-21runrttasks23:53:321
132399563,46cyclictest19055-21sshd22:42:211
132399563,10cyclictest0-21swapper/122:24:561
132199563,48cyclictest0-21swapper/020:55:000
132199563,48cyclictest0-21swapper/019:45:170
132199563,48cyclictest0-21swapper/018:59:590
132199563,47cyclictest0-21swapper/021:25:180
132199563,47cyclictest0-21swapper/018:54:570
132599555,27cyclictest0-21swapper/319:45:073
132599553,16cyclictest0-21swapper/322:49:503
132599553,11cyclictest0-21swapper/320:44:593
1325995521,9cyclictest15920-21munin-node21:30:113
1325995520,13cyclictest0-21swapper/321:56:493
132599552,46cyclictest0-21swapper/321:08:273
132599552,46cyclictest0-21swapper/321:08:273
1325995514,24cyclictest10544-21fschecks_count22:24:573
132499553,46cyclictest0-21swapper/222:54:512
132499553,46cyclictest0-21swapper/221:09:312
132499553,46cyclictest0-21swapper/221:09:312
132499553,30cyclictest0-21swapper/219:55:042
132499553,29cyclictest0-21swapper/200:08:442
132499553,29cyclictest0-21swapper/200:08:442
132499552,45cyclictest0-21swapper/218:49:592
132399555,45cyclictest0-21swapper/120:19:451
1323995539,10cyclictest2498-21gltestperf18:45:061
132399553,8cyclictest32116-21fschecks_count20:55:001
132399553,47cyclictest0-21swapper/123:19:091
132399553,46cyclictest29012-21munin-node23:05:061
132399553,46cyclictest20771-21munin-node19:25:191
132199554,46cyclictest0-21swapper/022:04:510
132199553,46cyclictest0-21swapper/021:39:560
132199553,46cyclictest0-21swapper/019:34:470
1321995529,12cyclictest0-21swapper/023:54:480
1321995529,12cyclictest0-21swapper/023:04:590
1321995528,12cyclictest0-21swapper/020:19:440
1321995528,12cyclictest0-21swapper/019:14:470
1321995525,13cyclictest0-21swapper/021:31:390
132199552,48cyclictest0-21swapper/023:45:040
248599540,6rtkit-daemon2484-21rtkit-daemon23:23:492
248599540,6rtkit-daemon2484-21rtkit-daemon23:23:492
248599540,5rtkit-daemon2484-21rtkit-daemon23:24:492
248599540,5rtkit-daemon2484-21rtkit-daemon22:25:292
142682543,43sleep20-21swapper/220:16:332
132599544,14cyclictest0-21swapper/320:30:003
1325995421,10cyclictest9981-21munin-node20:10:033
1325995419,13cyclictest0-21swapper/321:44:413
132499544,46cyclictest0-21swapper/223:56:142
132499542,46cyclictest0-21swapper/223:02:102
132499542,46cyclictest0-21swapper/220:52:142
132399544,44cyclictest11532-21expr21:19:561
132399543,46cyclictest0-21swapper/120:07:551
132399543,45cyclictest0-21swapper/122:29:501
1323995423,12cyclictest0-21swapper/121:05:141
1323995423,12cyclictest0-21swapper/121:05:141
132199544,44cyclictest0-21swapper/021:55:130
1321995434,9cyclictest0-21swapper/019:35:030
1321995433,10cyclictest0-21swapper/020:20:160
132199543,46cyclictest0-21swapper/022:04:410
132199543,45cyclictest0-21swapper/022:59:570
1321995428,12cyclictest0-21swapper/021:50:020
1321995428,12cyclictest0-21swapper/021:50:020
1321995428,12cyclictest0-21swapper/021:20:120
1321995428,12cyclictest0-21swapper/019:50:040
132199542,46cyclictest0-21swapper/022:39:390
132199542,46cyclictest0-21swapper/022:39:390
8432532,44sleep00-21swapper/023:11:320
248599530,5rtkit-daemon2484-21rtkit-daemon22:09:522
132599533,45cyclictest0-21swapper/320:44:433
132599533,10cyclictest32512-21iostat_ios20:55:053
132499533,28cyclictest0-21swapper/219:14:562
132499533,26cyclictest32635-21munin-node22:04:582
132499532,45cyclictest0-21swapper/221:18:242
132499531,46cyclictest0-21swapper/219:25:112
132399533,9cyclictest0-21swapper/122:49:391
132399533,45cyclictest0-21swapper/123:22:371
132399533,45cyclictest0-21swapper/123:22:371
132399533,45cyclictest0-21swapper/120:38:511
132399533,13cyclictest0-21swapper/122:50:101
132399533,11cyclictest3466-21fschecks_count19:55:021
132399533,11cyclictest0-21swapper/120:50:001
132199534,44cyclictest0-21swapper/022:24:520
132199534,43cyclictest0-21swapper/022:10:020
1321995333,9cyclictest0-21swapper/018:45:050
132199533,45cyclictest0-21swapper/021:44:520
132199533,45cyclictest0-21swapper/021:19:430
132199533,43cyclictest0-21swapper/023:49:570
1321995328,11cyclictest0-21swapper/018:54:480
1321995327,12cyclictest0-21swapper/022:54:510
1321995325,11cyclictest0-21swapper/019:05:020
248599520,5rtkit-daemon2484-21rtkit-daemon22:30:062
248599520,5rtkit-daemon2484-21rtkit-daemon19:04:593
248599520,5rtkit-daemon2484-21rtkit-daemon18:55:073
248599520,5rtkit-daemon2484-21rtkit-daemon00:10:102
1325995237,9cyclictest19827-21tr22:44:513
132599522,44cyclictest0-21swapper/320:07:393
132499525,24cyclictest1287-21snmpd18:56:202
1324995236,10cyclictest30881-21grep21:59:572
132499523,26cyclictest25537-21munin-node19:35:082
132399525,30cyclictest0-21swapper/119:39:571
132399525,30cyclictest0-21swapper/119:39:571
132399523,44cyclictest0-21swapper/121:12:211
132399523,43cyclictest31453-21aten2.4-expect23:09:491
132399523,11cyclictest0-21swapper/120:25:331
132399523,11cyclictest0-21swapper/120:25:331
132199524,43cyclictest0-21swapper/020:10:040
1321995232,10cyclictest0-21swapper/023:14:500
1321995231,10cyclictest0-21swapper/000:09:510
132199523,45cyclictest0-21swapper/019:40:150
132199523,45cyclictest0-21swapper/019:40:150
132199523,44cyclictest0-21swapper/020:44:540
132199523,43cyclictest0-21swapper/023:30:040
1321995227,11cyclictest0-21swapper/020:59:550
112832523,42sleep10-21swapper/119:04:581
248599510,5rtkit-daemon2484-21rtkit-daemon22:48:202
132599515,13cyclictest0-21swapper/323:14:523
132599514,13cyclictest0-21swapper/319:39:563
132599514,13cyclictest0-21swapper/319:39:563
132599513,9cyclictest13224-21head20:15:033
132599513,41cyclictest0-21swapper/318:59:593
132599513,24cyclictest30244-21munin-node22:00:003
132599513,12cyclictest0-21swapper/319:54:463
1325995119,16cyclictest0-21swapper/318:45:183
132499514,30cyclictest0-21swapper/220:30:022
132499514,23cyclictest9730-21smartctl19:00:072
132499514,11cyclictest0-21swapper/218:45:202
1324995136,9cyclictest16632-21grep21:29:592
132499512,26cyclictest1287-21snmpd19:21:242
1324995114,14cyclictest0-21swapper/220:20:122
132399514,28cyclictest0-21swapper/122:14:401
132399514,27cyclictest0-21swapper/123:34:471
132199514,42cyclictest0-21swapper/021:10:020
132199513,44cyclictest0-21swapper/022:22:250
132199513,43cyclictest0-21swapper/023:24:490
1321995126,13cyclictest0-21swapper/000:09:360
1321995126,13cyclictest0-21swapper/000:09:360
110612513,41sleep211062-21munin-node23:34:472
95282502,9sleep20-21swapper/220:06:582
248599500,5rtkit-daemon2484-21rtkit-daemon22:50:132
155202502,9sleep30-21swapper/321:27:363
1325995035,10cyclictest12270-21needreboot23:35:013
132599503,24cyclictest4058-21munin-node18:50:183
1325995018,15cyclictest0-21swapper/323:49:183
132499504,30cyclictest0-21swapper/220:56:402
1324995036,9cyclictest22451-21unixbench_singl21:40:142
132499503,29cyclictest0-21swapper/220:25:132
132499503,29cyclictest0-21swapper/220:25:132
132499503,15cyclictest0-21swapper/221:50:122
132499503,15cyclictest0-21swapper/221:50:122
132199503,7cyclictest0-21swapper/020:05:010
1321995025,11cyclictest0-21swapper/023:39:360
239922492,9sleep20-21swapper/220:38:342
132599499,10cyclictest14052-21df_abs19:10:013
1325994933,11cyclictest9112-21cpuspeed_turbos21:14:543
1325994918,13cyclictest0-21swapper/319:21:243
132499494,29cyclictest0-21swapper/223:49:552
132499494,13cyclictest0-21swapper/222:39:572
132499493,15cyclictest0-21swapper/223:04:492
132399495,37cyclictest0-21swapper/118:44:491
132399493,41cyclictest0-21swapper/123:44:541
132199493,41cyclictest0-21swapper/023:59:470
132199493,41cyclictest0-21swapper/023:42:290
132199493,40cyclictest3457-21tune2fs19:55:020
132199493,39cyclictest0-21swapper/022:49:380
1321994922,12cyclictest0-21swapper/019:25:160
287352482,9sleep30-21swapper/323:04:133
132599485,28cyclictest21348-21diskstats19:25:033
132599484,8cyclictest24433-21sendmail_mailqu00:00:053
132599484,37cyclictest0-21swapper/319:54:563
132599484,30cyclictest0-21swapper/320:59:593
132599484,28cyclictest0-21swapper/322:09:413
132599483,13cyclictest0-21swapper/300:13:413
132499483,30cyclictest0-21swapper/221:20:082
132499483,29cyclictest0-21swapper/221:56:502
1324994816,17cyclictest0-21swapper/221:25:072
132199483,38cyclictest0-21swapper/022:14:500
1321994828,10cyclictest0-21swapper/020:00:210
8192474,6sleep00-21swapper/018:40:150
237292472,39sleep00-21swapper/022:51:080
142462472,39sleep30-21swapper/322:32:133
132599474,26cyclictest0-21swapper/323:09:383
132599472,11cyclictest0-21swapper/322:17:493
1324994730,11cyclictest25161-21crond00:04:352
1321994720,11cyclictest0-21swapper/020:40:160
132599465,30cyclictest0-21swapper/323:59:363
132599464,30cyclictest0-21swapper/323:10:103
132599464,30cyclictest0-21swapper/321:49:413
1325994631,10cyclictest4771-21head23:19:563
1325994631,10cyclictest4771-21head23:19:563
132599462,11cyclictest0-21swapper/322:34:533
132599462,11cyclictest0-21swapper/322:34:533
132599462,11cyclictest0-21swapper/320:00:343
1324994633,8cyclictest24290-21needreboot21:45:052
1324994630,10cyclictest5472-21cpuspeed_turbos22:14:532
132499463,39cyclictest0-21swapper/219:45:022
132499463,10cyclictest0-21swapper/219:04:572
132599454,26cyclictest0-21swapper/321:20:253
1325994529,10cyclictest3425-21cut22:09:573
1324994523,10cyclictest0-21swapper/221:10:142
132199453,26cyclictest0-21swapper/019:15:000
120662452,9sleep20-21swapper/220:13:592
132599442,11cyclictest0-21swapper/321:12:573
132499444,35cyclictest0-21swapper/222:34:532
132499444,35cyclictest0-21swapper/222:34:532
132499423,33cyclictest0-21swapper/218:44:492
248599360,4rtkit-daemon2484-21rtkit-daemon18:43:153
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional