You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-18 - 21:19

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rack1slot6s.osadl.org (updated Thu Dec 18, 2025 12:43:33)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1264621160,4sleep212647-21aten2.4-expect09:45:052
1264621160,4sleep212647-21aten2.4-expect09:45:052
3272699934,27cyclictest0-21swapper/010:50:130
32726999328,58cyclictest20496-21gltestperf12:15:090
32726999314,27cyclictest0-21swapper/009:05:160
32726999138,11cyclictest16666-21grep09:50:260
3272699913,37cyclictest0-21swapper/007:40:230
3272699913,37cyclictest0-21swapper/007:40:230
32726999118,12cyclictest0-21swapper/009:23:080
3272699904,37cyclictest0-21swapper/010:00:180
3272699894,28cyclictest0-21swapper/012:30:130
3272699894,28cyclictest0-21swapper/012:30:130
3272699894,27cyclictest0-21swapper/011:15:130
3272699874,24cyclictest0-21swapper/008:45:070
32726998711,15cyclictest0-21swapper/008:54:550
3272699864,40cyclictest0-21swapper/008:55:190
32726998628,9cyclictest3510-21df_abs09:25:100
3272699854,25cyclictest0-21swapper/008:15:110
3272699834,26cyclictest0-21swapper/011:30:170
3272699824,26cyclictest0-21swapper/007:50:290
3272699793,26cyclictest0-21swapper/008:24:570
248599790,26rtkit-daemon0-21swapper/007:30:321
3272699784,26cyclictest0-21swapper/010:29:520
3272699774,27cyclictest0-21swapper/010:14:510
248599770,26rtkit-daemon0-21swapper/007:53:011
248599770,19rtkit-daemon1419-21runrttasks10:54:541
248599750,21rtkit-daemon0-21swapper/008:25:441
248599750,21rtkit-daemon0-21swapper/008:25:441
248599740,20rtkit-daemon0-21swapper/007:56:381
248599740,19rtkit-daemon0-21swapper/007:45:311
248599740,19rtkit-daemon0-21swapper/007:45:311
32729997221,43cyclictest7527-21systemd-cgroups09:34:532
32729997111,35cyclictest0-21swapper/208:45:182
248599710,7rtkit-daemon0-21swapper/309:40:422
248599710,7rtkit-daemon0-21swapper/309:40:422
248599710,6rtkit-daemon0-21swapper/108:34:590
248599670,6rtkit-daemon20010-21timerandwakeup11:05:231
248599650,5rtkit-daemon25326-21perl07:55:160
32729996419,38cyclictest19950-21grep12:15:032
32729996414,41cyclictest27111-21grep12:29:592
32729996414,41cyclictest27111-21grep12:29:592
32728996419,25cyclictest7969-21grep11:50:021
32728996419,25cyclictest7969-21grep11:50:021
217792640,5sleep226-21rcuc/208:55:152
32729996313,42cyclictest0-21swapper/209:04:552
32729996313,16cyclictest0-21swapper/208:04:562
248599630,8rtkit-daemon0-21swapper/311:59:062
3272999629,45cyclictest0-21swapper/210:44:512
32729996220,34cyclictest3344-21grep07:10:112
32729996213,40cyclictest1419-21runrttasks08:30:092
32729996210,45cyclictest0-21swapper/210:29:512
248599620,7rtkit-daemon0-21swapper/310:18:482
248599620,7rtkit-daemon0-21swapper/108:11:230
248599620,7rtkit-daemon0-21swapper/108:00:080
248599620,6rtkit-daemon0-21swapper/107:15:470
3272999619,33cyclictest0-21swapper/210:55:082
3272999617,45cyclictest0-21swapper/207:34:582
32729996112,42cyclictest0-21swapper/210:05:182
248599610,6rtkit-daemon0-21swapper/110:59:010
248599610,6rtkit-daemon0-21swapper/107:29:170
248599610,6rtkit-daemon0-21swapper/107:22:470
32730996041,11cyclictest4576-21tr08:20:143
3272999609,21cyclictest0-21swapper/212:19:582
32729996012,41cyclictest0-21swapper/210:50:352
3272899604,29cyclictest0-21swapper/110:45:041
248599600,7rtkit-daemon0-21swapper/311:43:442
248599600,7rtkit-daemon0-21swapper/310:49:242
248599600,6rtkit-daemon0-21swapper/111:07:310
248599600,6rtkit-daemon0-21swapper/108:33:520
3272999598,44cyclictest0-21swapper/207:45:192
3272999598,44cyclictest0-21swapper/207:45:192
3272999597,45cyclictest0-21swapper/207:25:102
248599590,7rtkit-daemon0-21swapper/312:13:132
248599590,7rtkit-daemon0-21swapper/312:06:432
248599590,7rtkit-daemon0-21swapper/311:13:152
248599590,7rtkit-daemon0-21swapper/311:13:152
248599590,7rtkit-daemon0-21swapper/310:54:161
248599590,7rtkit-daemon0-21swapper/310:39:242
248599590,7rtkit-daemon0-21swapper/310:32:022
248599590,7rtkit-daemon0-21swapper/310:32:022
248599590,7rtkit-daemon0-21swapper/309:55:412
248599590,7rtkit-daemon0-21swapper/309:21:272
248599590,6rtkit-daemon0-21swapper/311:51:062
248599590,6rtkit-daemon0-21swapper/311:51:062
248599590,6rtkit-daemon0-21swapper/309:39:192
248599590,6rtkit-daemon0-21swapper/111:11:380
248599590,6rtkit-daemon0-21swapper/111:11:380
248599590,6rtkit-daemon0-21swapper/111:03:080
248599590,6rtkit-daemon0-21swapper/108:07:000
3272999589,41cyclictest0-21swapper/207:55:222
3272999589,31cyclictest0-21swapper/208:40:062
32729995813,25cyclictest26284-21df_inode09:05:122
32729995810,41cyclictest0-21swapper/211:16:112
248599580,7rtkit-daemon0-21swapper/312:28:122
248599580,7rtkit-daemon0-21swapper/311:26:302
248599580,7rtkit-daemon0-21swapper/310:21:322
248599580,7rtkit-daemon0-21swapper/309:59:562
248599580,7rtkit-daemon0-21swapper/309:14:582
248599580,6rtkit-daemon0-21swapper/311:37:142
248599580,6rtkit-daemon0-21swapper/311:32:002
248599580,6rtkit-daemon0-21swapper/309:27:422
248599580,6rtkit-daemon0-21swapper/107:47:530
248599580,6rtkit-daemon0-21swapper/107:47:530
248599580,5rtkit-daemon2484-21rtkit-daemon11:36:143
248599580,5rtkit-daemon2484-21rtkit-daemon09:57:333
248599580,5rtkit-daemon2484-21rtkit-daemon09:39:043
248599580,5rtkit-daemon2484-21rtkit-daemon09:27:273
248599580,4rtkit-daemon2484-21rtkit-daemon09:02:213
126812587,43sleep00-21swapper/012:00:020
32729995712,38cyclictest0-21swapper/208:36:542
32729995712,37cyclictest7840-21chrt07:20:102
32729995711,30cyclictest0-21swapper/208:20:142
3272899574,36cyclictest0-21swapper/109:38:201
3272699574,36cyclictest0-21swapper/007:10:000
3272699574,36cyclictest0-21swapper/007:10:000
248599570,7rtkit-daemon0-21swapper/312:03:132
248599570,6rtkit-daemon0-21swapper/308:52:362
248599570,5rtkit-daemon2484-21rtkit-daemon12:07:063
248599570,5rtkit-daemon2484-21rtkit-daemon11:51:293
248599570,5rtkit-daemon2484-21rtkit-daemon11:51:293
248599570,5rtkit-daemon2484-21rtkit-daemon10:39:023
248599570,5rtkit-daemon2484-21rtkit-daemon10:29:553
248599570,5rtkit-daemon2484-21rtkit-daemon10:29:553
248599570,5rtkit-daemon2484-21rtkit-daemon10:02:263
248599570,5rtkit-daemon2484-21rtkit-daemon08:49:593
248599570,4rtkit-daemon2484-21rtkit-daemon11:13:003
248599570,4rtkit-daemon2484-21rtkit-daemon11:13:003
248599570,4rtkit-daemon2484-21rtkit-daemon10:49:093
3273099564,32cyclictest0-21swapper/310:05:213
3272999567,42cyclictest0-21swapper/207:50:302
32729995637,11cyclictest30199-21grep08:05:172
32729995616,33cyclictest26829-21head11:20:162
3272899565,27cyclictest0-21swapper/112:22:001
3272899564,30cyclictest0-21swapper/109:04:541
248599560,5rtkit-daemon2484-21rtkit-daemon12:19:353
248599560,5rtkit-daemon2484-21rtkit-daemon12:12:583
248599560,5rtkit-daemon2484-21rtkit-daemon11:54:593
248599560,5rtkit-daemon2484-21rtkit-daemon11:15:303
248599560,5rtkit-daemon2484-21rtkit-daemon10:16:403
248599560,5rtkit-daemon2484-21rtkit-daemon09:14:433
248599560,5rtkit-daemon2484-21rtkit-daemon08:57:283
248599560,4rtkit-daemon2484-21rtkit-daemon11:42:593
248599560,4rtkit-daemon2484-21rtkit-daemon09:30:493
32730995537,11cyclictest8334-21grep08:25:293
32730995537,11cyclictest8334-21grep08:25:293
3272999556,34cyclictest0-21swapper/208:15:122
3272899555,31cyclictest0-21swapper/112:04:481
32728995538,10cyclictest31367-21gltestperf09:15:141
248599550,5rtkit-daemon2484-21rtkit-daemon12:32:123
248599550,5rtkit-daemon2484-21rtkit-daemon12:32:123
248599550,5rtkit-daemon2484-21rtkit-daemon11:26:073
248599550,5rtkit-daemon2484-21rtkit-daemon10:20:403
248599550,4rtkit-daemon2484-21rtkit-daemon11:31:453
248599550,4rtkit-daemon2484-21rtkit-daemon10:28:103
248599550,4rtkit-daemon2484-21rtkit-daemon09:23:053
248599550,4rtkit-daemon2484-21rtkit-daemon09:07:583
248599550,4rtkit-daemon2484-21rtkit-daemon08:44:143
32730995435,12cyclictest17344-21needreboot08:45:213
3272999544,25cyclictest0-21swapper/207:05:072
3272999544,25cyclictest0-21swapper/207:05:072
3272899544,27cyclictest0-21swapper/109:48:071
3272899544,27cyclictest0-21swapper/109:48:071
3272699544,32cyclictest0-21swapper/009:15:130
32726995436,11cyclictest23665-21tr09:00:080
248599540,5rtkit-daemon2484-21rtkit-daemon10:51:393
248599540,5rtkit-daemon2484-21rtkit-daemon09:45:493
248599540,5rtkit-daemon2484-21rtkit-daemon09:45:493
248599540,5rtkit-daemon2484-21rtkit-daemon09:10:282
248599540,4rtkit-daemon2484-21rtkit-daemon10:12:103
32729995310,36cyclictest0-21swapper/208:10:192
3272899534,24cyclictest13767-21aten2.4-expect08:40:061
32726995322,9cyclictest12415-21cat09:44:540
32726995322,9cyclictest12415-21cat09:44:540
248599530,6rtkit-daemon0-21swapper/310:12:032
248599530,5rtkit-daemon2484-21rtkit-daemon11:44:522
248599530,4rtkit-daemon2484-21rtkit-daemon12:01:513
3273099524,27cyclictest0-21swapper/307:45:193
3273099524,27cyclictest0-21swapper/307:45:193
3273099523,41cyclictest0-21swapper/308:30:303
3272999527,38cyclictest0-21swapper/209:50:272
32729995235,11cyclictest15133-21hostname07:35:122
32729995232,11cyclictest19302-21grep11:05:112
32729995218,25cyclictest6615-21tail08:25:072
32729995218,25cyclictest6615-21tail08:25:072
3272899525,28cyclictest0-21swapper/111:15:101
3272899524,28cyclictest0-21swapper/111:10:121
3272899524,28cyclictest0-21swapper/111:10:121
3272899524,27cyclictest0-21swapper/111:24:501
3272899524,26cyclictest0-21swapper/107:39:591
3272899524,25cyclictest1709-21aten2.4-expect10:30:031
3272899524,25cyclictest1709-21aten2.4-expect10:30:031
3272899524,13cyclictest0-21swapper/109:28:181
3272899523,31cyclictest0-21swapper/110:10:131
32728995221,13cyclictest0-21swapper/112:09:481
32728995220,13cyclictest0-21swapper/108:45:231
285882523,42sleep10-21swapper/112:30:221
285882523,42sleep10-21swapper/112:30:221
32730995135,10cyclictest12749-21aten_r1power_vo07:30:123
32730995124,10cyclictest3885-21gltestperf07:10:173
32730995121,12cyclictest0-21swapper/307:50:233
3272999512,42cyclictest0-21swapper/211:00:082
32729995119,25cyclictest18119-21fschecks_time07:40:182
32729995119,25cyclictest18119-21fschecks_time07:40:182
3272899514,28cyclictest0-21swapper/111:30:191
3272899514,28cyclictest0-21swapper/109:24:551
3272899514,28cyclictest0-21swapper/108:15:111
3272899514,28cyclictest0-21swapper/108:05:261
3272899514,28cyclictest0-21swapper/107:10:001
3272899514,28cyclictest0-21swapper/107:10:001
3272899514,27cyclictest0-21swapper/110:09:531
32728995132,11cyclictest6452-21wc09:30:181
3272699514,40cyclictest0-21swapper/007:30:120
98082502,9sleep30-21swapper/307:22:543
67742505,9sleep00-21swapper/009:30:250
3273099509,25cyclictest24867-21cpuspeed_turbos07:55:113
3273099504,40cyclictest0-21swapper/307:06:133
3273099504,40cyclictest0-21swapper/307:06:133
3273099504,38cyclictest0-21swapper/311:48:593
3273099504,28cyclictest0-21swapper/308:10:153
3273099504,27cyclictest0-21swapper/309:15:233
32730995019,13cyclictest0-21swapper/309:40:293
32730995019,13cyclictest0-21swapper/309:40:293
3272899505,27cyclictest0-21swapper/108:10:161
3272899504,38cyclictest0-21swapper/109:09:551
3272899504,38cyclictest0-21swapper/108:54:021
3272899504,28cyclictest0-21swapper/111:39:481
3272899504,28cyclictest0-21swapper/110:35:281
3272899504,28cyclictest0-21swapper/110:15:231
3272899504,27cyclictest0-21swapper/109:59:531
3272899504,27cyclictest0-21swapper/108:24:571
3272899503,12cyclictest0-21swapper/111:45:151
32728995018,12cyclictest0-21swapper/110:20:031
32726995020,13cyclictest0-21swapper/011:55:150
48832492,41sleep00-21swapper/011:42:490
3273099494,27cyclictest0-21swapper/311:00:283
3273099494,27cyclictest0-21swapper/308:05:193
3273099493,28cyclictest0-21swapper/308:15:133
3272899495,26cyclictest0-21swapper/112:13:431
3272899495,26cyclictest0-21swapper/107:12:041
3272899494,28cyclictest0-21swapper/111:43:531
3272899494,28cyclictest0-21swapper/110:00:061
3272899494,27cyclictest0-21swapper/108:35:111
3272899494,27cyclictest0-21swapper/108:30:261
3272899494,26cyclictest0-21swapper/112:29:021
3272899494,25cyclictest0-21swapper/110:43:291
32728994931,11cyclictest6317-21gltestperf07:15:181
32728994931,11cyclictest32491-21cut10:25:121
3272699495,38cyclictest0-21swapper/011:20:140
3272699495,27cyclictest0-21swapper/012:10:050
3272699494,28cyclictest0-21swapper/009:10:080
3272699494,25cyclictest0-21swapper/011:44:590
32726994920,13cyclictest0-21swapper/011:35:010
32726994920,12cyclictest0-21swapper/007:35:320
32726994919,13cyclictest0-21swapper/010:20:150
301352493,9sleep10-21swapper/111:29:321
3273099484,27cyclictest0-21swapper/308:38:003
32730994831,10cyclictest15689-21grep09:50:113
3272899486,25cyclictest0-21swapper/109:10:081
3272899484,27cyclictest0-21swapper/109:40:131
3272899484,27cyclictest0-21swapper/109:40:131
3272899484,27cyclictest0-21swapper/108:58:131
3272699484,27cyclictest0-21swapper/012:24:480
3272699484,27cyclictest0-21swapper/011:50:060
3272699484,27cyclictest0-21swapper/011:50:060
3272699484,27cyclictest0-21swapper/009:35:200
3272699483,27cyclictest0-21swapper/009:59:540
3272699483,23cyclictest4287-21telnet10:35:040
207582483,38sleep10-21swapper/112:15:151
3273099474,36cyclictest0-21swapper/307:40:123
3273099474,36cyclictest0-21swapper/307:40:123
3273099474,24cyclictest0-21swapper/310:59:333
32730994717,12cyclictest0-21swapper/308:00:093
32730994716,13cyclictest0-21swapper/310:40:243
3272899474,26cyclictest0-21swapper/108:03:061
3272899473,31cyclictest0-21swapper/109:52:271
32728994727,12cyclictest10559-21cpuspeed_turbos07:25:131
3272699473,32cyclictest0-21swapper/011:28:280
32726994717,14cyclictest0-21swapper/012:24:590
263882472,38sleep30-21swapper/312:27:463
3273099466,32cyclictest0-21swapper/307:35:193
3272899464,25cyclictest0-21swapper/111:03:321
3272899464,24cyclictest11259-21needreboot11:55:141
3272899463,27cyclictest0-21swapper/107:20:251
3272699464,26cyclictest0-21swapper/010:45:040
3272699464,26cyclictest0-21swapper/010:30:140
3272699464,26cyclictest0-21swapper/010:30:140
3272699464,25cyclictest0-21swapper/010:15:060
3272699464,23cyclictest0-21swapper/007:10:090
3272699463,39cyclictest0-21swapper/010:44:400
3272699463,31cyclictest0-21swapper/009:45:040
3272699463,31cyclictest0-21swapper/009:45:040
3272699463,26cyclictest0-21swapper/012:05:070
3272699463,25cyclictest14175-21sshd08:40:100
32726994619,12cyclictest0-21swapper/008:27:100
32726994619,12cyclictest0-21swapper/008:27:100
324262464,6sleep00-21swapper/007:01:320
239852462,38sleep00-21swapper/010:06:360
32729994517,22cyclictest5519-21aten_r1power_fr07:15:102
3272899454,24cyclictest0-21swapper/107:43:011
3272899454,24cyclictest0-21swapper/107:43:011
221692452,35sleep30-21swapper/312:20:003
3273099444,35cyclictest0-21swapper/307:15:183
3273099444,24cyclictest0-21swapper/311:20:033
3273099444,10cyclictest11554-21proc_pri07:25:283
32730994314,12cyclictest0-21swapper/311:05:243
3272999434,32cyclictest0-21swapper/207:05:002
3272899407,21cyclictest0-21swapper/107:05:001
3273099374,15cyclictest0-21swapper/307:04:593
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional