You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-19 - 11:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Fri Dec 19, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3033321110,4sleep230332-21head20:39:472
1615899974,68cyclictest0-21swapper/300:09:313
1615899944,24cyclictest0-21swapper/322:04:373
16158999420,53cyclictest0-21swapper/323:16:403
1615899933,24cyclictest14658-21tail23:29:413
16158999216,13cyclictest0-21swapper/321:24:573
1615899915,62cyclictest0-21swapper/322:44:523
248599900,6rtkit-daemon0-21swapper/019:32:280
1615899904,66cyclictest0-21swapper/323:19:483
1615899904,66cyclictest0-21swapper/323:19:483
1615899904,29cyclictest0-21swapper/323:04:453
1615899896,64cyclictest0-21swapper/321:05:053
1615899884,27cyclictest0-21swapper/320:25:073
248599870,7rtkit-daemon0-21swapper/019:19:430
1615899874,63cyclictest0-21swapper/321:34:563
1615899874,26cyclictest0-21swapper/320:36:203
1615899874,24cyclictest0-21swapper/319:49:423
1615899874,24cyclictest0-21swapper/319:49:423
1615599874,76cyclictest0-21swapper/020:04:410
1615599874,76cyclictest0-21swapper/019:14:560
1615599874,64cyclictest0-21swapper/023:26:480
1615899864,24cyclictest0-21swapper/322:13:333
1615899864,24cyclictest0-21swapper/319:44:443
1615899864,24cyclictest0-21swapper/319:36:103
16158998627,52cyclictest26621-21fschecks_time19:24:473
16158998619,12cyclictest0-21swapper/321:41:313
16158998614,12cyclictest0-21swapper/320:19:393
1615899855,20cyclictest0-21swapper/322:29:363
1615899853,26cyclictest31224-21unixbench_singl20:40:013
1615899853,25cyclictest0-21swapper/320:59:593
16158998516,8cyclictest30233-21cut22:54:423
1615599854,74cyclictest0-21swapper/020:44:500
1615599854,73cyclictest16917-21fschecks_time23:34:390
1615599853,74cyclictest0-21swapper/022:14:560
1615899844,73cyclictest0-21swapper/322:19:243
1615899844,60cyclictest0-21swapper/322:49:483
16158998422,54cyclictest1419-21runrttasks23:54:523
16158998419,47cyclictest0-21swapper/319:20:043
16158998417,10cyclictest29114-21gltestperf19:29:503
1615599844,73cyclictest0-21swapper/022:24:360
16158998331,45cyclictest17761-21timerandwakeup23:34:553
1615899833,72cyclictest12528-21grep23:24:463
1615599834,71cyclictest0-21swapper/021:24:480
1615599833,73cyclictest0-21swapper/023:39:380
248599820,5rtkit-daemon2484-21rtkit-daemon21:34:382
1615899826,67cyclictest0-21swapper/319:44:293
1615899824,27cyclictest0-21swapper/321:24:273
1615899824,27cyclictest0-21swapper/300:29:303
1615899824,26cyclictest0-21swapper/300:14:453
1615899824,21cyclictest0-21swapper/319:54:573
16158998231,44cyclictest4324-21needreboot21:59:503
16158998217,13cyclictest0-21swapper/322:39:363
16158998214,12cyclictest0-21swapper/320:54:383
248599810,5rtkit-daemon2484-21rtkit-daemon22:11:062
248599810,4rtkit-daemon2484-21rtkit-daemon21:01:242
1615899814,70cyclictest0-21swapper/322:39:233
1615899814,70cyclictest0-21swapper/322:39:233
1615899814,23cyclictest18098-21df_inode20:14:473
16158998128,45cyclictest21407-21cpuspeed_turbos21:29:413
16158998110,15cyclictest0-21swapper/322:19:383
1615599814,70cyclictest26558-21fschecks_time21:39:440
1615599814,70cyclictest0-21swapper/020:15:030
1615599814,70cyclictest0-21swapper/000:00:360
1615599814,70cyclictest0-21swapper/000:00:360
1615599813,71cyclictest17298-21idleruntime-cro20:14:280
1615599813,71cyclictest0-21swapper/023:54:350
1615899804,59cyclictest0-21swapper/320:44:533
1615899804,58cyclictest0-21swapper/321:44:383
16158998031,41cyclictest12367-21tail21:09:463
16158998029,44cyclictest16530-21aten_r1power_vo19:04:443
16158998029,43cyclictest13957-21aten_r1power_en21:14:393
16158998017,12cyclictest0-21swapper/319:59:533
1615599804,68cyclictest0-21swapper/021:34:570
1615599804,68cyclictest0-21swapper/019:34:400
1615599803,71cyclictest4517-21cpuspeed23:09:350
1615599803,71cyclictest0-21swapper/023:19:420
1615599803,71cyclictest0-21swapper/023:19:420
1615599803,70cyclictest31948-21telnet22:59:350
1615599803,70cyclictest23749-21python20:25:010
1615599803,69cyclictest29068-21chrt20:37:310
248599790,5rtkit-daemon2484-21rtkit-daemon21:32:532
1615899795,66cyclictest0-21swapper/323:09:423
1615899794,59cyclictest0-21swapper/300:29:183
1615899794,26cyclictest0-21swapper/319:11:063
1615899794,26cyclictest0-21swapper/319:11:063
1615899794,21cyclictest0-21swapper/323:49:543
16158997925,47cyclictest22665-21unixbench-2d23:44:543
16158997923,49cyclictest15407-21cpuspeed_turbos22:24:393
1615599794,67cyclictest0-21swapper/023:49:550
1615599794,67cyclictest0-21swapper/022:34:440
1615599794,67cyclictest0-21swapper/022:34:440
1615599794,67cyclictest0-21swapper/021:19:420
1615599794,43cyclictest30312-21wc22:54:430
1615599793,70cyclictest14253-21df_abs23:29:370
1615599793,61cyclictest5440-21munin-node00:19:310
1615899786,18cyclictest0-21swapper/321:54:253
1615899786,18cyclictest0-21swapper/321:54:253
1615899784,21cyclictest0-21swapper/319:14:413
1615899783,22cyclictest31845-21aten_r1power_en22:59:343
1615899783,22cyclictest0-21swapper/320:49:393
16158997826,45cyclictest19203-21fschecks_count23:39:383
1615599784,66cyclictest0-21swapper/021:59:390
16155997831,39cyclictest8046-21aten2.4-expect22:09:360
1615599783,69cyclictest1287-21snmpd20:01:140
1615599783,69cyclictest0-21swapper/019:09:560
1615599783,69cyclictest0-21swapper/019:09:560
1615599783,68cyclictest9018-21chrt23:19:220
1615599783,68cyclictest5342-21munin-run19:49:290
1615599783,68cyclictest29546-21aten2.4-expect20:39:400
1615599783,67cyclictest18049-21grep19:05:050
1615599783,67cyclictest0-21swapper/023:04:520
1615599783,46cyclictest0-21swapper/022:49:350
1615599783,44cyclictest0-21swapper/021:29:400
1615599782,69cyclictest12666-21munin-node22:19:460
1615899774,66cyclictest0-21swapper/319:04:323
1615899774,23cyclictest0-21swapper/300:09:173
1615599774,67cyclictest0-21swapper/000:29:430
1615599774,66cyclictest0-21swapper/022:46:580
1615599774,66cyclictest0-21swapper/021:05:030
1615599774,65cyclictest0-21swapper/019:24:430
16155997733,37cyclictest21590-21sed20:20:020
1615599773,68cyclictest0-21swapper/000:05:350
1615599773,67cyclictest0-21swapper/020:49:400
1615599773,67cyclictest0-21swapper/000:14:550
1615599773,58cyclictest8044-21telnet19:54:410
248599760,24rtkit-daemon0-21swapper/019:20:211
1615899765,57cyclictest0-21swapper/320:29:593
1615899765,57cyclictest0-21swapper/320:29:593
1615899764,33cyclictest0-21swapper/323:59:363
1615899764,33cyclictest0-21swapper/323:59:363
1615599764,66cyclictest0-21swapper/020:29:480
1615599764,66cyclictest0-21swapper/020:29:480
1615599764,65cyclictest0-21swapper/021:11:020
1615599763,66cyclictest21841-21grep23:44:400
248599750,5rtkit-daemon2484-21rtkit-daemon19:44:352
248599750,4rtkit-daemon2484-21rtkit-daemon21:14:392
16158997516,10cyclictest16855-21unixbench_multi20:10:033
16158997514,8cyclictest2387-21tail21:54:573
1615599754,64cyclictest0-21swapper/022:32:230
1615599754,64cyclictest0-21swapper/022:04:430
1615599754,64cyclictest0-21swapper/020:57:160
1615599754,64cyclictest0-21swapper/000:09:320
1615599753,65cyclictest0-21swapper/021:49:400
1615599753,65cyclictest0-21swapper/021:49:400
1615599753,65cyclictest0-21swapper/019:49:460
1615599753,65cyclictest0-21swapper/019:49:460
248599740,4rtkit-daemon2484-21rtkit-daemon21:44:152
1615899743,22cyclictest0-21swapper/300:19:473
1615599743,64cyclictest30383-21latency_hist21:49:260
1615899739,18cyclictest0-21swapper/320:05:023
1615599733,64cyclictest0-21swapper/021:14:520
1615599733,64cyclictest0-21swapper/019:04:320
248599720,5rtkit-daemon2484-21rtkit-daemon21:49:372
248599720,5rtkit-daemon2484-21rtkit-daemon21:49:372
1615599724,61cyclictest0-21swapper/022:44:130
1615599723,63cyclictest0-21swapper/021:02:490
1615599723,63cyclictest0-21swapper/019:39:420
1615599723,59cyclictest0-21swapper/000:24:310
248599710,5rtkit-daemon2484-21rtkit-daemon23:31:482
248599710,5rtkit-daemon2484-21rtkit-daemon00:24:312
16155997128,37cyclictest2392-21grep21:54:580
248599690,5rtkit-daemon2484-21rtkit-daemon19:39:572
248599690,4rtkit-daemon2484-21rtkit-daemon21:54:372
248599670,4rtkit-daemon2484-21rtkit-daemon23:09:342
248599650,4rtkit-daemon2484-21rtkit-daemon20:18:412
248599650,3rtkit-daemon2484-21rtkit-daemon00:32:462
248599620,5rtkit-daemon22225-21munin-node22:39:502
248599620,14rtkit-daemon2484-21rtkit-daemon22:29:512
1615699624,51cyclictest0-21swapper/120:54:561
16156996041,11cyclictest29156-21gltestperf19:29:501
14082603,10sleep11528-21gltestperf19:39:491
87012586,8sleep18774-21gltestperf19:54:491
1615799584,36cyclictest0-21swapper/221:24:432
248599570,13rtkit-daemon2484-21rtkit-daemon23:44:402
220622574,45sleep10-21swapper/119:14:501
1615799574,23cyclictest0-21swapper/219:29:532
100722573,46sleep110096-21kernelversion23:19:451
100722573,46sleep110096-21kernelversion23:19:451
12512563,45sleep20-21swapper/200:09:392
1615799554,26cyclictest0-21swapper/200:19:302
16157995510,21cyclictest0-21swapper/223:19:342
16157995510,21cyclictest0-21swapper/223:19:342
3069625410,8sleep130798-21cpuspeed00:04:351
248599540,5rtkit-daemon2484-21rtkit-daemon19:54:572
248599540,4rtkit-daemon2484-21rtkit-daemon22:49:572
246412542,45sleep20-21swapper/222:44:352
16157995434,13cyclictest13072-21cpuspeed_turbos20:04:442
1615799534,28cyclictest0-21swapper/221:19:502
1615799534,28cyclictest0-21swapper/200:04:452
1615799533,43cyclictest0-21swapper/220:54:272
1615799533,26cyclictest0-21swapper/219:12:472
1615799533,26cyclictest0-21swapper/219:12:472
16157995314,21cyclictest0-21swapper/221:09:382
1615699534,28cyclictest0-21swapper/100:24:501
73362522,11sleep10-21swapper/122:05:161
170372522,45sleep20-21swapper/222:27:062
1615799525,29cyclictest0-21swapper/223:49:372
1615799525,28cyclictest0-21swapper/223:59:432
1615799525,28cyclictest0-21swapper/223:59:432
1615799525,28cyclictest0-21swapper/220:19:592
1615799524,28cyclictest0-21swapper/220:44:452
1615799524,27cyclictest0-21swapper/223:04:472
1615799524,27cyclictest0-21swapper/219:09:322
1615799524,13cyclictest0-21swapper/220:01:142
1615699525,27cyclictest0-21swapper/122:44:241
1615699524,24cyclictest0-21swapper/121:39:381
98972512,11sleep10-21swapper/122:12:341
251882512,41sleep10-21swapper/121:35:011
217102512,9sleep10-21swapper/122:35:471
217102512,9sleep10-21swapper/122:35:471
1615799515,28cyclictest0-21swapper/223:54:372
1615799515,28cyclictest0-21swapper/222:34:442
1615799515,28cyclictest0-21swapper/222:34:442
1615799515,26cyclictest0-21swapper/219:49:432
1615799515,26cyclictest0-21swapper/219:49:432
1615799514,28cyclictest0-21swapper/223:24:382
1615799514,27cyclictest0-21swapper/220:24:532
1615799514,27cyclictest0-21swapper/219:24:492
1615799514,26cyclictest0-21swapper/200:19:202
16157995137,7cyclictest6516-21systemd-cgroups20:59:262
1615799513,28cyclictest28274-21tail20:34:542
16156995132,13cyclictest0-21swapper/123:29:431
16156995130,12cyclictest0-21swapper/121:19:561
76292502,42sleep10-21swapper/119:53:281
76292502,42sleep10-21swapper/119:53:281
301072502,10sleep10-21swapper/100:01:281
301072502,10sleep10-21swapper/100:01:281
207352503,41sleep10-21swapper/123:44:071
199092503,9sleep119971-21sh20:19:401
1615799505,26cyclictest0-21swapper/223:01:432
1615799504,28cyclictest0-21swapper/222:16:362
1615799504,28cyclictest0-21swapper/219:14:562
1615799504,27cyclictest0-21swapper/220:29:522
1615799504,27cyclictest0-21swapper/220:29:522
1615799504,27cyclictest0-21swapper/220:09:582
16157995033,10cyclictest9942-21gltestperf21:04:482
16157995016,24cyclictest0-21swapper/222:54:342
1615699505,29cyclictest0-21swapper/120:44:431
1615699504,28cyclictest0-21swapper/100:14:521
16156995015,8cyclictest2892-21awk21:59:241
186782493,40sleep10-21swapper/121:24:331
1615799494,27cyclictest0-21swapper/223:39:422
1615799494,27cyclictest0-21swapper/221:44:562
1615799494,26cyclictest0-21swapper/222:23:282
1615799494,26cyclictest0-21swapper/219:38:552
1615699494,35cyclictest0-21swapper/121:14:381
1615699494,27cyclictest0-21swapper/123:54:441
1615699494,27cyclictest0-21swapper/121:04:491
1615699494,27cyclictest0-21swapper/120:04:521
1615699494,27cyclictest0-21swapper/100:19:541
61612482,40sleep10-21swapper/123:10:581
55002482,39sleep20-21swapper/222:04:282
315072483,39sleep10-21swapper/122:58:491
265612482,12sleep10-21swapper/120:31:001
265612482,12sleep10-21swapper/120:31:001
254852482,10sleep20-21swapper/219:22:012
207232482,41sleep10-21swapper/119:12:081
207232482,41sleep10-21swapper/119:12:081
196592483,38sleep10-21swapper/120:19:191
171102482,12sleep10-21swapper/120:12:141
1615799484,38cyclictest0-21swapper/222:01:342
1615699484,27cyclictest0-21swapper/121:31:291
1615699484,27cyclictest0-21swapper/120:49:421
16156994830,11cyclictest13471-21gltestperf22:19:431
1615699483,27cyclictest0-21swapper/121:59:371
16156994818,12cyclictest0-21swapper/100:29:311
325262472,39sleep10-21swapper/119:35:301
290122472,38sleep10-21swapper/122:52:401
1615799472,33cyclictest0-21swapper/223:16:462
133562472,11sleep10-21swapper/123:26:261
122352472,39sleep10-21swapper/120:01:061
302102462,11sleep10-21swapper/121:47:141
183292463,37sleep10-21swapper/123:38:511
1615799464,13cyclictest0-21swapper/223:34:502
1615699467,25cyclictest0-21swapper/121:14:271
1615699465,33cyclictest0-21swapper/123:14:451
1615699464,34cyclictest0-21swapper/122:29:351
16156994630,10cyclictest21308-21tr23:44:341
16156994626,14cyclictest0-21swapper/122:47:461
16156994626,14cyclictest0-21swapper/100:14:201
16156994623,11cyclictest0-21swapper/120:59:471
121032462,39sleep10-21swapper/122:15:121
1615699455,34cyclictest0-21swapper/123:49:531
1615699455,33cyclictest0-21swapper/119:49:291
16156994525,12cyclictest29715-21cpuspeed20:39:411
326362442,35sleep10-21swapper/121:52:471
326362442,35sleep10-21swapper/121:52:471
1615699444,10cyclictest16976-21fschecks_count19:04:491
16156994426,11cyclictest0-21swapper/122:24:361
16156994420,7cyclictest29303-21cat20:39:281
1615699436,12cyclictest0-21swapper/123:08:121
14382433,32sleep10-21swapper/123:03:201
16156994223,14cyclictest0-21swapper/120:25:031
16156994119,10cyclictest0-21swapper/119:24:551
159642414,30sleep20-21swapper/219:02:302
1615699399,19cyclictest0-21swapper/119:04:321
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional