You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-03 - 06:27

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rack1slot6s.osadl.org (updated Mon Nov 03, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2794799964,34cyclictest0-21swapper/021:20:130
27951999538,11cyclictest24905-21cpuspeed_turbos17:40:092
2794799904,25cyclictest0-21swapper/018:26:190
27947999022,14cyclictest0-21swapper/021:09:570
27947998931,10cyclictest0-21swapper/021:05:200
2794799883,30cyclictest1265-21runrttasks17:50:280
2794799874,35cyclictest0-21swapper/020:15:110
2794799874,35cyclictest0-21swapper/020:15:110
2794799874,34cyclictest0-21swapper/021:34:570
2794799874,34cyclictest0-21swapper/021:34:570
2794799874,32cyclictest0-21swapper/018:30:210
2794799874,32cyclictest0-21swapper/017:35:290
2794799873,10cyclictest8292-21unixbench_multi18:10:270
27947998719,16cyclictest0-21swapper/020:05:080
2794799864,34cyclictest0-21swapper/021:55:150
2794799864,34cyclictest0-21swapper/017:00:080
2794799864,33cyclictest0-21swapper/016:45:150
2794799864,11cyclictest0-21swapper/020:59:470
2794799864,11cyclictest0-21swapper/020:59:470
2794799863,25cyclictest0-21swapper/019:45:180
27947998625,10cyclictest4816-21grep16:55:320
2794799854,32cyclictest0-21swapper/018:35:200
2794799854,25cyclictest0-21swapper/021:45:060
2794799854,11cyclictest0-21swapper/022:00:210
27947998522,12cyclictest0-21swapper/019:25:180
2794799845,28cyclictest0-21swapper/020:50:240
2794799844,39cyclictest0-21swapper/021:40:100
2794799844,34cyclictest0-21swapper/019:00:040
2794799844,33cyclictest0-21swapper/019:05:190
2794799844,18cyclictest0-21swapper/017:20:230
27947998325,10cyclictest6827-21timerandwakeup21:30:180
2794799824,33cyclictest0-21swapper/020:35:180
2794799824,33cyclictest0-21swapper/018:55:130
2794799824,27cyclictest0-21swapper/018:15:110
2794799824,12cyclictest0-21swapper/020:26:410
27947998231,10cyclictest0-21swapper/017:10:080
27947998226,11cyclictest1265-21runrttasks19:15:160
27947998224,13cyclictest0-21swapper/021:25:180
2794799814,33cyclictest0-21swapper/019:35:250
2794799814,32cyclictest0-21swapper/021:50:070
2794799813,23cyclictest0-21swapper/022:05:090
2794799804,35cyclictest0-21swapper/016:50:210
2794799804,26cyclictest0-21swapper/019:10:040
2794799804,22cyclictest0-21swapper/021:15:030
2794799804,12cyclictest0-21swapper/018:50:270
2794799804,12cyclictest0-21swapper/018:50:270
27947998030,15cyclictest0-21swapper/018:45:050
27947998026,13cyclictest0-21swapper/019:30:210
27947998026,13cyclictest0-21swapper/019:30:210
2794799794,26cyclictest0-21swapper/020:46:160
2794799794,13cyclictest0-21swapper/019:50:260
27947997930,11cyclictest0-21swapper/017:15:100
2794799793,11cyclictest24323-21wc21:00:120
2794799787,20cyclictest0-21swapper/020:29:490
2794799786,15cyclictest0-21swapper/019:43:180
223099780,4rtkit-daemon2229-21rtkit-daemon21:28:072
2794799774,35cyclictest0-21swapper/019:20:180
2794799774,12cyclictest0-21swapper/020:40:060
2794799764,35cyclictest0-21swapper/017:09:550
2794799734,33cyclictest0-21swapper/017:55:110
2794799723,33cyclictest0-21swapper/019:55:490
27947997028,10cyclictest0-21swapper/020:11:370
86602633,52sleep10-21swapper/120:29:481
75272636,49sleep20-21swapper/220:25:142
27950996244,11cyclictest8551-21gltestperf21:35:051
27950996244,11cyclictest8551-21gltestperf21:35:051
2794799614,15cyclictest0-21swapper/020:20:210
207712613,49sleep30-21swapper/317:30:193
163232613,51sleep10-21swapper/121:50:171
49112603,10sleep10-21swapper/119:12:101
34732593,8sleep13569-21fschecks_count21:25:061
157552595,46sleep20-21swapper/221:50:062
27952995721,13cyclictest0-21swapper/319:05:283
223099570,5rtkit-daemon2229-21rtkit-daemon18:39:212
8472563,46sleep10-21swapper/119:05:081
2795299565,29cyclictest0-21swapper/317:55:153
2795299564,27cyclictest0-21swapper/319:19:513
27952995623,14cyclictest0-21swapper/318:20:073
27952995622,15cyclictest0-21swapper/318:50:283
27952995622,15cyclictest0-21swapper/318:50:283
27952995621,12cyclictest0-21swapper/317:14:553
27952995620,13cyclictest0-21swapper/320:40:143
27952995620,13cyclictest0-21swapper/320:00:233
27952995619,13cyclictest0-21swapper/322:00:113
27952995618,13cyclictest0-21swapper/317:35:113
2795099564,34cyclictest0-21swapper/119:39:131
27950995624,25cyclictest12564-21tail21:44:571
2795299554,28cyclictest0-21swapper/321:04:583
2795299554,28cyclictest0-21swapper/316:40:573
2795299554,28cyclictest0-21swapper/316:40:573
2795299554,27cyclictest0-21swapper/320:39:473
27952995537,11cyclictest8216-21unixbench_multi20:25:243
27952995536,12cyclictest787-21cut16:50:123
27952995522,14cyclictest0-21swapper/316:45:243
27952995520,12cyclictest0-21swapper/321:39:463
27952995520,12cyclictest0-21swapper/321:39:463
27951995539,10cyclictest6029-21cut17:00:142
2795199553,12cyclictest0-21swapper/217:55:102
2795199553,11cyclictest0-21swapper/220:57:152
2795199553,11cyclictest0-21swapper/220:57:152
2795199553,11cyclictest0-21swapper/220:45:022
2795199553,11cyclictest0-21swapper/218:20:272
27950995512,25cyclictest20705-21seq18:39:511
223099550,5rtkit-daemon2229-21rtkit-daemon19:45:262
223099550,5rtkit-daemon2229-21rtkit-daemon19:39:272
223099550,5rtkit-daemon2229-21rtkit-daemon18:45:142
179422553,45sleep10-21swapper/117:25:171
107062553,11sleep10-21swapper/120:30:251
2795299545,28cyclictest0-21swapper/318:45:093
2795299545,27cyclictest0-21swapper/318:30:123
2795299545,27cyclictest0-21swapper/317:25:313
2795299545,25cyclictest0-21swapper/318:15:073
2795299544,30cyclictest0-21swapper/320:55:013
2795299544,30cyclictest0-21swapper/320:55:013
2795299544,28cyclictest0-21swapper/319:50:093
2795299544,28cyclictest0-21swapper/319:20:083
2795299544,28cyclictest0-21swapper/318:35:223
2795299544,28cyclictest0-21swapper/317:50:333
2795299544,28cyclictest0-21swapper/317:40:213
2795299544,27cyclictest0-21swapper/321:50:083
2795299544,27cyclictest0-21swapper/319:14:513
2795299544,27cyclictest0-21swapper/317:49:543
2795299544,26cyclictest0-21swapper/322:06:113
2795299544,26cyclictest0-21swapper/321:26:043
2795299544,26cyclictest0-21swapper/321:20:233
2795299544,26cyclictest0-21swapper/318:29:523
2795299544,26cyclictest0-21swapper/318:04:543
2795299544,26cyclictest0-21swapper/316:55:093
2795299544,25cyclictest10666-21diskstats21:40:063
27952995421,14cyclictest0-21swapper/320:10:173
27952995416,19cyclictest4335-21munin-node18:05:073
27952995416,19cyclictest4335-21munin-node18:05:073
223099540,6rtkit-daemon2229-21rtkit-daemon19:30:052
223099540,6rtkit-daemon2229-21rtkit-daemon19:30:052
223099540,5rtkit-daemon2229-21rtkit-daemon22:05:062
223099540,5rtkit-daemon2229-21rtkit-daemon20:00:112
223099540,5rtkit-daemon2229-21rtkit-daemon19:05:282
223099540,5rtkit-daemon2229-21rtkit-daemon18:50:142
223099540,5rtkit-daemon2229-21rtkit-daemon18:50:142
223099540,5rtkit-daemon2229-21rtkit-daemon18:42:212
223099540,5rtkit-daemon2229-21rtkit-daemon18:25:152
223099540,5rtkit-daemon2229-21rtkit-daemon17:47:092
223099540,5rtkit-daemon2229-21rtkit-daemon16:45:112
223099540,4rtkit-daemon2229-21rtkit-daemon19:00:212
2795299535,28cyclictest0-21swapper/320:05:253
2795299535,27cyclictest0-21swapper/318:40:153
2795299534,29cyclictest0-21swapper/320:50:253
2795299534,27cyclictest0-21swapper/321:45:023
2795299534,26cyclictest0-21swapper/319:40:023
2795299534,26cyclictest0-21swapper/317:21:303
2795299534,25cyclictest0-21swapper/321:15:003
27952995321,13cyclictest0-21swapper/317:00:073
2795199533,12cyclictest0-21swapper/218:05:132
2795199533,12cyclictest0-21swapper/218:05:132
223099530,5rtkit-daemon2229-21rtkit-daemon20:45:093
223099530,5rtkit-daemon2229-21rtkit-daemon19:20:052
223099530,5rtkit-daemon2229-21rtkit-daemon19:10:132
223099530,5rtkit-daemon2229-21rtkit-daemon16:40:192
223099530,5rtkit-daemon2229-21rtkit-daemon16:40:192
298962523,11sleep10-21swapper/121:11:231
2795299525,28cyclictest0-21swapper/319:35:143
2795299524,27cyclictest11258-21memory19:25:163
2795299524,25cyclictest1667-21aten2.4-expect20:15:003
2795299524,25cyclictest1667-21aten2.4-expect20:15:003
2795299523,27cyclictest0-21swapper/320:30:203
2795199524,10cyclictest0-21swapper/220:50:052
2795099523,41cyclictest0-21swapper/119:45:081
274862523,42sleep10-21swapper/121:06:121
223099520,5rtkit-daemon2229-21rtkit-daemon22:04:282
223099520,5rtkit-daemon2229-21rtkit-daemon19:50:042
223099520,5rtkit-daemon2229-21rtkit-daemon18:30:072
223099520,5rtkit-daemon2229-21rtkit-daemon17:25:172
223099520,5rtkit-daemon2229-21rtkit-daemon17:15:252
2795299514,28cyclictest0-21swapper/317:15:223
2795299514,27cyclictest0-21swapper/321:00:103
2795099514,28cyclictest0-21swapper/117:15:151
27950995133,11cyclictest31690-21needreboot19:00:181
27950995132,12cyclictest11119-21crond18:19:531
27950995121,12cyclictest0-21swapper/117:44:541
223099510,5rtkit-daemon2229-21rtkit-daemon20:05:112
223099510,5rtkit-daemon2229-21rtkit-daemon19:59:482
223099510,5rtkit-daemon2229-21rtkit-daemon17:50:162
223099510,5rtkit-daemon2229-21rtkit-daemon17:20:252
223099510,4rtkit-daemon2229-21rtkit-daemon19:40:122
126262514,41sleep00-21swapper/018:20:220
97022503,41sleep10-21swapper/117:06:301
323972503,10sleep10-21swapper/121:17:561
2795299504,27cyclictest0-21swapper/321:55:033
2795199504,39cyclictest0-21swapper/216:50:202
2795199503,26cyclictest0-21swapper/218:00:072
2795099504,40cyclictest0-21swapper/116:45:231
2795099504,28cyclictest0-21swapper/119:15:161
2795099504,28cyclictest0-21swapper/117:34:551
2795099504,27cyclictest0-21swapper/121:40:011
264432502,10sleep30-21swapper/319:57:383
103062503,8sleep110407-21cpu17:10:091
63462490,6sleep00-21swapper/018:09:540
63462490,6sleep00-21swapper/018:09:540
39472494,39sleep00-21swapper/018:04:500
27951994933,9cyclictest3675-21tune2fs16:55:162
2795199493,28cyclictest0-21swapper/221:34:582
2795199493,28cyclictest0-21swapper/221:34:582
2795099494,28cyclictest0-21swapper/117:55:221
2795099494,27cyclictest0-21swapper/121:20:051
2795099494,27cyclictest0-21swapper/120:45:111
2795099494,27cyclictest0-21swapper/119:55:241
2795099494,27cyclictest0-21swapper/118:05:301
2795099494,27cyclictest0-21swapper/118:05:301
2795099494,27cyclictest0-21swapper/116:55:201
2794799494,39cyclictest0-21swapper/020:00:100
2794799494,28cyclictest0-21swapper/016:40:250
2794799494,28cyclictest0-21swapper/016:40:250
131952493,12sleep10-21swapper/120:36:291
122742493,41sleep10-21swapper/119:29:471
86312482,10sleep30-21swapper/318:13:363
75742483,12sleep10-21swapper/117:04:531
27951994833,9cyclictest0-21swapper/216:39:562
27951994832,10cyclictest12184-21gltestperf20:35:112
2795199483,28cyclictest0-21swapper/219:15:252
2795199483,28cyclictest0-21swapper/217:35:222
2795199483,27cyclictest0-21swapper/221:10:132
2795199483,27cyclictest0-21swapper/220:40:202
2795199483,26cyclictest0-21swapper/217:30:072
2795199483,11cyclictest0-21swapper/219:25:202
27951994817,13cyclictest0-21swapper/221:20:192
2795099485,28cyclictest0-21swapper/118:49:511
2795099485,26cyclictest0-21swapper/117:45:101
2795099484,27cyclictest0-21swapper/118:10:251
2795099484,26cyclictest0-21swapper/122:05:191
27950994819,13cyclictest0-21swapper/120:21:401
2794799485,26cyclictest0-21swapper/018:40:120
2794799484,28cyclictest0-21swapper/017:30:150
2794799484,27cyclictest0-21swapper/017:45:100
25362483,11sleep10-21swapper/116:51:311
217102483,11sleep10-21swapper/122:03:551
192962483,9sleep10-21swapper/121:58:351
158082483,40sleep10-21swapper/118:28:531
11502483,9sleep10-21swapper/120:12:111
313532474,37sleep10-21swapper/120:09:211
287512474,37sleep128884-21perl16:40:151
287512474,37sleep128884-21perl16:40:151
27952994727,12cyclictest4766-21fschecks_count20:20:063
2795199474,26cyclictest0-21swapper/220:20:182
2795199474,26cyclictest0-21swapper/217:11:012
27951994732,9cyclictest2566-21grep20:15:072
27951994732,9cyclictest2566-21grep20:15:072
2795199473,27cyclictest0-21swapper/221:41:062
2795199473,27cyclictest0-21swapper/220:30:052
27950994729,11cyclictest21085-21aten_r1power_vo18:40:041
27950994729,10cyclictest22922-21gltestperf19:50:101
276002473,38sleep10-21swapper/118:51:381
276002473,38sleep10-21swapper/118:51:381
252412473,39sleep10-21swapper/121:03:011
167972473,9sleep10-21swapper/117:20:411
158542473,11sleep10-21swapper/120:44:471
2795299464,26cyclictest0-21swapper/318:55:293
2795299464,26cyclictest0-21swapper/317:06:003
2795299464,25cyclictest0-21swapper/321:31:053
2795299464,25cyclictest0-21swapper/319:34:503
2795299464,25cyclictest0-21swapper/319:34:503
2795299463,27cyclictest0-21swapper/319:00:253
2795199463,26cyclictest0-21swapper/221:00:102
2795199463,25cyclictest0-21swapper/221:29:582
2795199463,12cyclictest0-21swapper/221:55:172
27951994616,14cyclictest0-21swapper/221:05:032
2795099464,34cyclictest0-21swapper/119:30:241
2795099464,34cyclictest0-21swapper/119:30:241
27950994632,8cyclictest60602sleep121:30:061
227542463,10sleep10-21swapper/120:56:441
227542463,10sleep10-21swapper/120:56:441
223099460,4rtkit-daemon2229-21rtkit-daemon18:19:152
217392462,9sleep30-21swapper/319:48:313
191362463,10sleep10-21swapper/119:40:391
180742463,38sleep10-21swapper/118:32:041
16802463,35sleep10-21swapper/118:00:031
134212463,37sleep10-21swapper/118:23:491
27952994525,13cyclictest0-21swapper/321:14:453
2795199453,38cyclictest0-21swapper/218:59:132
2795199453,23cyclictest0-21swapper/218:10:062
2794799454,35cyclictest0-21swapper/017:25:230
27947994526,12cyclictest0-21swapper/017:40:200
277912454,35sleep00-21swapper/016:38:250
288192443,36sleep10-21swapper/120:02:241
27951994430,8cyclictest30769-21cpuspeed_turbos21:15:032
2795199443,26cyclictest0-21swapper/221:47:512
2795199443,23cyclictest0-21swapper/217:05:082
2795099444,33cyclictest0-21swapper/120:50:071
2795099443,36cyclictest0-21swapper/120:16:111
2795099443,36cyclictest0-21swapper/120:16:111
2795099443,36cyclictest0-21swapper/118:55:491
27950994412,25cyclictest0-21swapper/117:39:241
11182442,9sleep20-21swapper/220:11:482
2795099434,13cyclictest0-21swapper/116:39:571
27952994226,9cyclictest0-21swapper/316:39:573
2795099424,32cyclictest0-21swapper/117:50:141
2795099414,31cyclictest0-21swapper/119:24:481
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional