You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-08 - 10:30

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rack1slot6s.osadl.org (updated Mon Dec 08, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
6229998233,8cyclictest0-21swapper/218:44:152
622999804,27cyclictest0-21swapper/219:12:282
622999773,38cyclictest0-21swapper/223:49:282
622999773,21cyclictest29940-21latency_hist00:04:022
6227997620,49cyclictest9110-21cpuspeed_turbos21:04:261
622599736,60cyclictest0-21swapper/019:09:280
622599684,56cyclictest0-21swapper/021:29:080
622599674,55cyclictest0-21swapper/022:39:070
622599653,56cyclictest0-21swapper/019:34:420
623099645,53cyclictest0-21swapper/322:44:373
623099644,54cyclictest0-21swapper/323:04:313
623099642,26cyclictest0-21swapper/321:44:193
622999644,48cyclictest0-21swapper/220:04:412
229272643,12sleep30-21swapper/319:19:143
6227996311,33cyclictest0-21swapper/123:44:041
6227996311,33cyclictest0-21swapper/123:44:041
622599635,51cyclictest0-21swapper/020:55:490
622599634,52cyclictest0-21swapper/023:39:040
622599634,52cyclictest0-21swapper/023:39:040
622599634,52cyclictest0-21swapper/021:59:210
622599626,49cyclictest0-21swapper/019:30:280
622599624,49cyclictest0-21swapper/018:49:280
622599624,27cyclictest0-21swapper/022:14:200
68542610,4sleep1201ktimersoftd/123:14:221
623099614,51cyclictest0-21swapper/322:19:083
622799613,52cyclictest1727-21sendmail_mailqu19:39:441
622599614,51cyclictest23937-21gltestperf21:34:300
622599613,52cyclictest0-21swapper/021:19:280
245892613,9sleep124716-21unixbench_multi23:49:381
622799604,8cyclictest32455-21yum-updatesd-he19:39:131
6227996036,10cyclictest1369-21runrttasks22:54:061
622599604,27cyclictest0-21swapper/023:24:410
622599603,50cyclictest0-21swapper/022:29:280
6227995936,10cyclictest23126-21telnet21:34:211
622599593,50cyclictest0-21swapper/022:19:280
622599593,49cyclictest0-21swapper/021:54:330
622599593,49cyclictest0-21swapper/020:39:150
622599593,49cyclictest0-21swapper/019:14:290
263312593,49sleep00-21swapper/019:24:360
623099585,44cyclictest1369-21runrttasks22:54:183
623099584,29cyclictest0-21swapper/322:29:383
622599585,26cyclictest0-21swapper/022:09:190
622599584,47cyclictest0-21swapper/023:39:210
622599584,47cyclictest0-21swapper/023:39:210
622599583,49cyclictest0-21swapper/019:44:270
622599583,49cyclictest0-21swapper/018:54:270
622599583,49cyclictest0-21swapper/018:54:270
622599583,49cyclictest0-21swapper/018:44:420
622599583,48cyclictest0-21swapper/023:23:010
125832583,9sleep112647-21switchtime21:09:411
623099574,30cyclictest0-21swapper/320:04:123
6230995739,12cyclictest11885-21head23:24:253
6230995720,14cyclictest0-21swapper/320:59:383
6230995720,14cyclictest0-21swapper/320:59:383
623099572,9cyclictest0-21swapper/322:29:073
623099572,9cyclictest0-21swapper/322:29:073
622599574,47cyclictest0-21swapper/021:19:110
622599573,48cyclictest0-21swapper/023:14:300
622599573,48cyclictest0-21swapper/023:07:370
622599573,48cyclictest0-21swapper/020:19:240
622599573,48cyclictest0-21swapper/020:19:240
622599572,48cyclictest0-21swapper/022:44:370
281652573,46sleep00-21swapper/020:34:450
623099565,42cyclictest0-21swapper/320:24:353
622799563,47cyclictest0-21swapper/123:34:391
622799563,47cyclictest0-21swapper/123:34:391
622599563,47cyclictest0-21swapper/022:24:310
622599563,47cyclictest0-21swapper/022:24:310
622599563,47cyclictest0-21swapper/021:04:400
622599563,46cyclictest0-21swapper/019:49:320
623099555,28cyclictest0-21swapper/319:25:343
623099554,27cyclictest0-21swapper/321:39:033
623099553,45cyclictest7729-21munin-node18:44:513
623099553,44cyclictest0-21swapper/320:44:253
622999553,46cyclictest0-21swapper/221:04:472
6227995540,8cyclictest19215-21awk22:34:061
6227995535,8cyclictest19292-21munin-run20:19:111
6227995535,13cyclictest0-21swapper/119:24:141
622599554,44cyclictest0-21swapper/023:54:160
622599553,46cyclictest0-21swapper/023:59:220
622599553,46cyclictest0-21swapper/023:49:390
622599553,46cyclictest0-21swapper/023:44:260
622599553,46cyclictest0-21swapper/022:59:180
622599553,46cyclictest0-21swapper/022:59:180
622599553,46cyclictest0-21swapper/021:49:490
622599553,46cyclictest0-21swapper/021:09:210
622599553,46cyclictest0-21swapper/020:14:440
622599553,45cyclictest0-21swapper/020:24:310
622599552,47cyclictest0-21swapper/021:29:330
622599552,47cyclictest0-21swapper/000:09:220
263652553,45sleep00-21swapper/020:33:160
216982556,42sleep20-21swapper/223:44:272
623099544,44cyclictest0-21swapper/319:08:173
6230995437,10cyclictest482-21tr21:54:233
623099543,8cyclictest19967-21unixbench_singl23:39:373
623099543,8cyclictest19967-21unixbench_singl23:39:373
6230995421,15cyclictest0-21swapper/322:11:023
6227995441,7cyclictest0-21swapper/120:39:121
6227995436,12cyclictest0-21swapper/120:04:321
622599544,28cyclictest0-21swapper/020:00:400
622599543,46cyclictest15017-21rt-features18:59:480
622599543,46cyclictest0-21swapper/022:49:370
622599543,45cyclictest0-21swapper/000:04:350
622599543,10cyclictest0-21swapper/019:56:300
623099536,22cyclictest13591-21open_inodes22:19:353
623099535,29cyclictest0-21swapper/319:54:353
623099535,28cyclictest0-21swapper/321:50:593
623099534,35cyclictest0-21swapper/323:38:543
623099534,35cyclictest0-21swapper/323:38:543
623099534,30cyclictest0-21swapper/323:19:323
623099534,29cyclictest0-21swapper/318:54:413
623099534,29cyclictest0-21swapper/318:54:413
6230995338,10cyclictest12338-21head21:09:343
6230995324,9cyclictest14812-21aten2.4-expect20:09:263
6230995322,14cyclictest0-21swapper/319:44:423
6230995321,12cyclictest0-21swapper/323:30:213
6230995320,14cyclictest0-21swapper/321:14:313
6230995320,14cyclictest0-21swapper/319:10:323
6227995341,7cyclictest7865-21rt-features18:44:541
6227995336,11cyclictest0-21swapper/119:09:151
6227995335,13cyclictest0-21swapper/120:09:351
6227995335,12cyclictest0-21swapper/119:14:351
6227995313,34cyclictest29324-21rt-features19:29:441
622599536,29cyclictest0-21swapper/020:10:420
622599536,28cyclictest0-21swapper/020:05:410
622599533,45cyclictest0-21swapper/021:39:210
622599533,45cyclictest0-21swapper/021:39:210
622599533,44cyclictest0-21swapper/021:44:320
622599533,44cyclictest0-21swapper/020:59:220
622599533,44cyclictest0-21swapper/020:59:220
622599533,11cyclictest0-21swapper/020:44:360
49022539,37sleep20-21swapper/223:09:282
6762522,10sleep10-21swapper/100:09:211
623099526,29cyclictest0-21swapper/320:14:523
623099525,29cyclictest0-21swapper/322:59:283
623099525,29cyclictest0-21swapper/322:59:283
623099525,28cyclictest0-21swapper/319:39:393
623099525,27cyclictest0-21swapper/323:16:133
623099525,27cyclictest0-21swapper/323:13:383
623099525,27cyclictest0-21swapper/320:50:483
623099524,41cyclictest0-21swapper/320:54:413
623099524,31cyclictest0-21swapper/300:04:143
623099524,29cyclictest0-21swapper/322:49:213
623099524,29cyclictest0-21swapper/322:04:393
623099524,29cyclictest0-21swapper/319:04:153
623099524,28cyclictest0-21swapper/323:44:263
623099524,27cyclictest0-21swapper/321:04:233
623099524,27cyclictest0-21swapper/320:04:483
6230995234,10cyclictest24009-21munin-plugin-st22:44:053
6230995233,13cyclictest31969-21unixbench-2d19:34:463
623099523,9cyclictest6740-21munin-node19:49:473
623099523,26cyclictest0-21swapper/323:50:263
6230995220,13cyclictest0-21swapper/320:19:453
6230995220,13cyclictest0-21swapper/320:19:453
6230995218,14cyclictest0-21swapper/321:24:413
6230995216,15cyclictest0-21swapper/321:29:303
6229995239,8cyclictest281ktimersoftd/223:39:352
6229995239,8cyclictest281ktimersoftd/223:39:352
622999523,43cyclictest0-21swapper/219:44:312
6227995240,7cyclictest13062-21fschecks_time22:19:271
6227995237,10cyclictest0-21swapper/121:39:421
6227995237,10cyclictest0-21swapper/121:39:421
6227995235,11cyclictest20145-21unixbench_singl19:09:491
6227995225,11cyclictest0-21swapper/100:04:271
622599525,28cyclictest0-21swapper/019:05:310
622599524,28cyclictest0-21swapper/022:59:060
622599523,44cyclictest0-21swapper/023:29:290
622599523,44cyclictest0-21swapper/022:40:300
622599523,43cyclictest0-21swapper/019:42:330
6225995220,14cyclictest0-21swapper/022:06:010
293642523,41sleep30-21swapper/319:29:473
22162523,9sleep30-21swapper/300:12:013
623099515,16cyclictest0-21swapper/319:19:303
623099514,28cyclictest0-21swapper/323:59:383
623099514,28cyclictest0-21swapper/321:39:413
623099514,28cyclictest0-21swapper/321:39:413
623099514,28cyclictest0-21swapper/318:44:153
623099514,27cyclictest0-21swapper/320:35:493
623099513,29cyclictest0-21swapper/321:22:193
6230995118,15cyclictest0-21swapper/321:59:223
6227995137,9cyclictest6563-21cpu20:59:231
6227995137,9cyclictest6563-21cpu20:59:231
6227995136,9cyclictest11383-21chrt18:54:291
6227995136,9cyclictest11383-21chrt18:54:291
6227995135,11cyclictest0-21swapper/122:34:281
6227995135,11cyclictest0-21swapper/121:54:261
6227995135,10cyclictest19717-21cpu20:19:261
6227995135,10cyclictest19717-21cpu20:19:261
6227995133,13cyclictest0-21swapper/121:44:301
622799513,29cyclictest0-21swapper/123:22:371
622599515,40cyclictest0-21swapper/023:09:270
622599514,27cyclictest0-21swapper/019:19:430
309752512,9sleep10-21swapper/120:40:511
308972512,9sleep10-21swapper/122:55:411
264162512,9sleep10-21swapper/123:54:251
11112512,42sleep10-21swapper/120:48:041
623099504,38cyclictest0-21swapper/320:39:403
623099504,27cyclictest0-21swapper/320:29:253
6230995033,10cyclictest9145-21taskset18:49:313
6230995022,11cyclictest21622-21awk22:39:063
6227995034,11cyclictest0-21swapper/120:29:301
6227995034,11cyclictest0-21swapper/118:49:411
6227995033,10cyclictest1451-21munin-node20:49:401
6227995033,10cyclictest11869-21gltestperf23:24:251
622599504,39cyclictest0-21swapper/020:49:420
58362502,9sleep10-21swapper/123:11:331
297542503,9sleep10-21swapper/100:01:471
622999496,26cyclictest0-21swapper/222:09:302
6227994935,9cyclictest17679-21unixbench_singl21:19:441
6227994935,10cyclictest0-21swapper/122:39:461
6227994930,8cyclictest1179-21lldpd22:47:181
6227994929,9cyclictest1243-21snmpd23:30:221
323292492,9sleep10-21swapper/121:53:181
154312492,41sleep10-21swapper/119:00:061
10602492,41sleep10-21swapper/123:03:271
10602492,41sleep10-21swapper/123:03:271
622999483,38cyclictest0-21swapper/219:43:092
6227994835,9cyclictest0-21swapper/123:44:051
6227994832,11cyclictest0-21swapper/121:59:371
6227994832,11cyclictest0-21swapper/119:24:291
40952483,39sleep14135-21open_inodes19:44:441
70092472,39sleep10-21swapper/122:05:391
622999478,26cyclictest114550irq/46-eth021:14:302
622999476,35cyclictest0-21swapper/220:34:112
622999473,27cyclictest0-21swapper/220:34:492
6229994710,32cyclictest0-21swapper/222:00:132
6227994735,7cyclictest201ktimersoftd/119:59:381
6227994733,9cyclictest15879-21needreboot22:24:321
6227994733,9cyclictest15879-21needreboot22:24:321
6227994724,11cyclictest0-21swapper/120:54:351
28052473,38sleep10-21swapper/123:04:361
16722474,37sleep21677-21smartctl21:54:402
622999464,36cyclictest1243-21snmpd21:34:402
622999464,36cyclictest0-21swapper/219:53:442
622999463,37cyclictest0-21swapper/222:34:292
622999463,36cyclictest0-21swapper/219:59:212
622999463,27cyclictest0-21swapper/221:29:212
622999463,26cyclictest0-21swapper/222:04:222
622799464,27cyclictest0-21swapper/119:54:131
6227994631,10cyclictest0-21swapper/121:18:141
622799463,37cyclictest0-21swapper/122:13:511
622799463,37cyclictest0-21swapper/118:44:151
622799463,36cyclictest0-21swapper/119:59:131
6227994620,12cyclictest0-21swapper/122:19:071
34882462,38sleep20-21swapper/220:51:042
622999455,24cyclictest0-21swapper/222:14:192
622999454,34cyclictest0-21swapper/219:36:272
622999453,25cyclictest0-21swapper/219:29:382
6229994527,12cyclictest0-21swapper/220:59:232
6229994527,12cyclictest0-21swapper/220:59:232
6229994525,14cyclictest0-21swapper/221:09:232
6229994523,9cyclictest15863-21telnet23:34:182
6229994523,9cyclictest15863-21telnet23:34:182
308862452,37sleep20-21swapper/222:55:342
253952452,36sleep30-21swapper/323:54:113
202432452,38sleep10-21swapper/121:26:381
9582442,37sleep20-21swapper/220:46:202
6229994432,8cyclictest4765-21grep20:54:312
622999443,35cyclictest0-21swapper/219:19:272
6229994424,13cyclictest0-21swapper/220:24:242
6229994423,8cyclictest7600-21munin-node19:54:472
6229994423,8cyclictest13686-21kworker/2:121:44:202
622799443,37cyclictest0-21swapper/120:25:111
152902442,35sleep20-21swapper/223:30:122
106722442,36sleep20-21swapper/223:22:182
622999435,12cyclictest0-21swapper/222:49:172
622999434,33cyclictest0-21swapper/221:39:292
622999434,33cyclictest0-21swapper/221:39:292
622999434,13cyclictest0-21swapper/218:44:292
6229994330,8cyclictest18296-21munin-node21:24:242
622999433,34cyclictest0-21swapper/220:19:452
622999433,34cyclictest0-21swapper/220:19:452
622999433,34cyclictest0-21swapper/220:14:472
622999433,25cyclictest0-21swapper/219:17:562
6229994322,8cyclictest29088-21munin-node20:39:312
6229994321,9cyclictest1243-21snmpd22:31:052
6229994321,8cyclictest30233-21telnet00:04:132
6229994321,18cyclictest0-21swapper/218:59:182
6229994311,20cyclictest114550irq/46-eth020:09:262
6227994321,11cyclictest0-21swapper/121:29:411
622999424,32cyclictest0-21swapper/219:04:532
622999423,35cyclictest0-21swapper/219:28:282
622999423,32cyclictest0-21swapper/223:14:292
6229994229,8cyclictest1369-21runrttasks23:01:192
6229994229,8cyclictest1369-21runrttasks23:01:192
6229994225,12cyclictest0-21swapper/221:19:242
6229994223,7cyclictest1179-21lldpd22:27:192
6229994223,7cyclictest1179-21lldpd22:27:192
6229994223,13cyclictest0-21swapper/221:51:182
6229994216,12cyclictest0-21swapper/200:09:142
109462422,34sleep20-21swapper/218:53:502
622999414,31cyclictest0-21swapper/223:24:332
622999413,32cyclictest0-21swapper/223:54:252
622999413,32cyclictest0-21swapper/222:39:292
622999413,32cyclictest0-21swapper/222:19:292
6229994123,7cyclictest31430-21kworker/2:223:04:182
6229994117,18cyclictest0-21swapper/218:54:282
6229994117,18cyclictest0-21swapper/218:54:282
6229994115,11cyclictest0-21swapper/222:44:272
243799360,4rtkit-daemon2436-21rtkit-daemon18:40:340
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional