You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-25 - 05:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #1, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Intel
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rack1slot6s.osadl.org (updated Tue Nov 25, 2025 00:43:32)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2925021250,3sleep226-21rcuc/223:01:192
891899735,46cyclictest0-21swapper/120:16:251
8919996435,13cyclictest0-21swapper/222:36:462
28832633,12sleep30-21swapper/319:51:253
244352633,52sleep00-21swapper/021:41:460
244352633,52sleep00-21swapper/021:41:460
8918996244,12cyclictest0-21swapper/122:16:511
891899624,51cyclictest0-21swapper/119:26:011
8917996234,13cyclictest0-21swapper/020:25:450
891999613,52cyclictest0-21swapper/222:50:402
891899614,50cyclictest0-21swapper/120:21:251
891899614,50cyclictest0-21swapper/120:21:251
891899614,49cyclictest0-21swapper/122:56:451
891999604,50cyclictest0-21swapper/221:36:522
8919996033,12cyclictest0-21swapper/221:46:452
8919996033,12cyclictest0-21swapper/200:11:382
8919996032,13cyclictest0-21swapper/222:33:402
891999603,50cyclictest0-21swapper/220:51:442
891999602,52cyclictest0-21swapper/220:12:172
891899604,49cyclictest0-21swapper/123:11:301
891899604,49cyclictest0-21swapper/123:11:301
8918996038,11cyclictest0-21swapper/121:16:231
891899603,51cyclictest0-21swapper/121:08:491
216382602,23sleep20-21swapper/220:27:032
891999594,49cyclictest0-21swapper/221:16:232
891999594,47cyclictest3063-21head00:21:262
8919995930,14cyclictest0-21swapper/223:36:482
891999593,50cyclictest0-21swapper/218:56:502
8919995929,15cyclictest0-21swapper/223:50:372
8919995929,13cyclictest0-21swapper/219:36:392
891899594,50cyclictest0-21swapper/119:43:541
891899594,48cyclictest0-21swapper/121:42:421
891899594,48cyclictest0-21swapper/121:42:421
891899594,48cyclictest0-21swapper/121:23:421
8918995936,11cyclictest0-21swapper/119:16:591
891899593,51cyclictest12028-21fschecks_count23:31:351
891899593,51cyclictest0-21swapper/122:26:471
891899593,51cyclictest0-21swapper/122:26:471
76892595,47sleep30-21swapper/321:06:473
892099584,13cyclictest0-21swapper/300:11:493
891899585,46cyclictest457-21cut00:16:291
891899584,48cyclictest1429-21grep19:46:471
891899584,48cyclictest0-21swapper/122:56:181
8918995831,13cyclictest0-21swapper/119:12:031
891899583,49cyclictest18-21rcuc/119:51:571
8917995837,15cyclictest0-21swapper/022:31:470
8917995833,7cyclictest2811-21latency_hist22:06:210
892099576,13cyclictest32637-21taskset19:44:523
892099573,12cyclictest0-21swapper/322:26:203
8919995730,13cyclictest0-21swapper/219:46:502
891999573,49cyclictest0-21swapper/222:16:432
891999573,48cyclictest0-21swapper/200:06:292
8918995738,9cyclictest26311-21fschecks_count00:01:341
8918995732,13cyclictest0-21swapper/120:56:251
891899573,49cyclictest0-21swapper/123:36:281
891899573,48cyclictest0-21swapper/119:36:401
891899573,48cyclictest0-21swapper/119:07:011
891999564,46cyclictest0-21swapper/222:06:422
891999564,46cyclictest0-21swapper/220:16:552
891999564,46cyclictest0-21swapper/220:16:552
891999564,46cyclictest0-21swapper/200:16:382
891999563,46cyclictest26502-21tune2fs00:01:362
891999563,46cyclictest0-21swapper/219:11:472
8918995629,12cyclictest0-21swapper/120:51:411
891799563,48cyclictest0-21swapper/019:46:270
117342563,45sleep00-21swapper/020:06:580
892099554,14cyclictest0-21swapper/323:06:483
891999554,45cyclictest0-21swapper/221:31:422
8919995531,9cyclictest1844-21telnet23:11:312
8919995531,9cyclictest1844-21telnet23:11:312
8919995525,12cyclictest0-21swapper/220:31:472
891999552,47cyclictest0-21swapper/223:17:512
891899554,45cyclictest0-21swapper/120:26:251
891899553,47cyclictest0-21swapper/123:46:361
891899553,47cyclictest0-21swapper/121:36:421
891899553,46cyclictest12350-21munin-node21:16:441
891899552,48cyclictest0-21swapper/120:46:511
8917995541,9cyclictest0-21swapper/023:11:340
8917995541,9cyclictest0-21swapper/023:11:340
8917995540,10cyclictest0-21swapper/023:01:180
8917995536,13cyclictest0-21swapper/023:06:390
8917995536,13cyclictest0-21swapper/020:41:400
8917995530,8cyclictest12619-21head22:26:310
8917995530,8cyclictest12619-21head22:26:310
891799553,46cyclictest0-21swapper/022:56:190
243799550,5rtkit-daemon2436-21rtkit-daemon18:51:493
243799550,5rtkit-daemon2436-21rtkit-daemon18:51:493
17272552,10sleep20-21swapper/222:01:472
151002553,44sleep00-21swapper/021:21:510
892099544,34cyclictest0-21swapper/322:56:183
892099544,15cyclictest0-21swapper/319:11:273
892099543,10cyclictest0-21swapper/320:36:483
891999549,37cyclictest0-21swapper/221:56:522
891999543,44cyclictest0-21swapper/219:51:582
891899544,30cyclictest0-21swapper/122:06:491
8918995430,10cyclictest1306-21sshd23:09:381
891899543,46cyclictest0-21swapper/123:25:381
891899543,46cyclictest0-21swapper/122:33:581
891899543,45cyclictest0-21swapper/100:11:481
8918995427,11cyclictest0-21swapper/122:40:361
8918995426,12cyclictest0-21swapper/122:42:211
891899542,46cyclictest25478-21idleruntime-cro00:01:161
891899542,46cyclictest0-21swapper/123:01:311
8917995435,7cyclictest2751-21awk00:21:150
891799543,45cyclictest0-21swapper/018:56:460
49302542,9sleep00-21swapper/019:52:030
892099535,32cyclictest0-21swapper/319:36:553
891999534,43cyclictest0-21swapper/221:21:552
891999533,45cyclictest0-21swapper/220:47:442
891999533,43cyclictest16057-21latency_hist19:11:282
891999532,45cyclictest0-21swapper/223:56:402
891899534,42cyclictest3984-21iostat00:21:361
8918995337,12cyclictest0-21swapper/120:41:041
891899533,44cyclictest0-21swapper/120:42:451
891899533,43cyclictest8053-21telnet20:01:401
8918995327,13cyclictest0-21swapper/120:06:461
8918995326,12cyclictest0-21swapper/122:13:541
8918995326,11cyclictest0-21swapper/123:55:061
8918995326,11cyclictest0-21swapper/123:55:061
891799534,44cyclictest0-21swapper/023:31:340
8917995333,8cyclictest16065-21awk19:11:270
891799532,46cyclictest0-21swapper/023:51:170
61422532,44sleep00-21swapper/021:02:450
61422532,44sleep00-21swapper/021:02:450
48902532,9sleep00-21swapper/000:23:200
286792533,43sleep10-21swapper/100:06:361
144262533,8sleep314580-21perl21:21:423
109042533,9sleep00-21swapper/021:12:320
891899524,43cyclictest11126-21munin-run23:31:171
8918995232,11cyclictest0-21swapper/121:06:231
8918995232,11cyclictest0-21swapper/121:06:231
891899523,42cyclictest0-21swapper/119:31:371
891899523,42cyclictest0-21swapper/119:31:371
8918995227,10cyclictest0-21swapper/121:31:571
8918995226,12cyclictest0-21swapper/121:52:301
8918995226,11cyclictest0-21swapper/122:21:311
8918995225,11cyclictest0-21swapper/122:02:181
8917995231,10cyclictest0-21swapper/020:26:590
891799523,44cyclictest0-21swapper/020:38:050
220842522,42sleep00-21swapper/019:21:520
212142522,43sleep00-21swapper/022:41:510
211962522,10sleep30-21swapper/322:41:503
892099515,30cyclictest0-21swapper/321:29:113
8920995135,11cyclictest8319-21unixbench_singl23:21:533
8920995135,11cyclictest11780-21cut21:16:373
891999514,41cyclictest0-21swapper/219:27:432
8919995126,10cyclictest0-21swapper/220:06:572
891999512,7cyclictest7991-21rt-features23:21:492
891999512,44cyclictest0-21swapper/219:34:162
891999512,44cyclictest0-21swapper/219:34:162
891899516,28cyclictest0-21swapper/123:44:101
891899515,39cyclictest0-21swapper/118:56:291
891899514,30cyclictest0-21swapper/120:26:481
891899513,42cyclictest0-21swapper/121:26:361
8918995125,11cyclictest0-21swapper/123:18:281
8918995123,12cyclictest0-21swapper/119:01:291
891799514,23cyclictest0-21swapper/023:36:360
8917995130,10cyclictest0-21swapper/022:46:410
8917995130,10cyclictest0-21swapper/022:16:210
8917995128,11cyclictest0-21swapper/021:51:410
8917995127,13cyclictest0-21swapper/020:51:360
325172512,9sleep00-21swapper/000:14:490
318432513,41sleep00-21swapper/021:56:490
155952512,43sleep30-21swapper/323:37:283
145892512,9sleep30-21swapper/322:29:253
145892512,9sleep30-21swapper/322:29:253
134152512,9sleep30-21swapper/319:03:133
122322513,41sleep00-21swapper/021:16:430
892099505,40cyclictest0-21swapper/320:46:353
892099505,40cyclictest0-21swapper/300:01:163
8920995035,9cyclictest18289-21crond23:46:163
8920995033,11cyclictest18310-21sort22:36:393
891999504,27cyclictest0-21swapper/220:56:432
8919995033,10cyclictest31092-21grep23:01:532
891999503,9cyclictest30730-21aten2.4-expect19:41:382
891999503,41cyclictest0-21swapper/221:01:362
891999503,41cyclictest0-21swapper/221:01:362
8919995026,11cyclictest0-21swapper/223:51:302
8919995026,11cyclictest0-21swapper/223:51:302
8919995026,11cyclictest0-21swapper/220:36:562
8919995026,10cyclictest0-21swapper/223:06:422
8919995025,9cyclictest0-21swapper/221:53:202
8919995025,10cyclictest0-21swapper/222:21:332
8919995025,10cyclictest0-21swapper/219:16:412
8919995024,11cyclictest0-21swapper/223:46:172
891999502,43cyclictest0-21swapper/219:22:022
8918995030,11cyclictest0-21swapper/122:01:221
891899503,42cyclictest0-21swapper/119:03:151
891899503,41cyclictest0-21swapper/119:56:441
8918995028,8cyclictest23453-21munin-node19:26:551
8918995021,13cyclictest0-21swapper/120:31:471
8917995036,9cyclictest0-21swapper/020:16:530
8917995036,9cyclictest0-21swapper/020:16:530
8917995035,10cyclictest0-21swapper/000:02:320
8917995031,9cyclictest0-21swapper/020:01:520
8917995030,9cyclictest0-21swapper/023:28:030
8917995029,10cyclictest0-21swapper/021:50:430
8917995024,12cyclictest0-21swapper/020:33:300
8917995024,11cyclictest0-21swapper/019:16:460
8917995021,13cyclictest0-21swapper/019:27:470
289272502,9sleep30-21swapper/322:59:203
131212502,9sleep00-21swapper/019:02:010
110072502,9sleep30-21swapper/321:13:523
892099495,28cyclictest0-21swapper/320:03:303
8920994935,9cyclictest22951-21grep22:46:403
891999494,24cyclictest0-21swapper/221:06:462
8919994925,9cyclictest0-21swapper/223:29:012
8919994925,10cyclictest0-21swapper/222:29:402
8919994925,10cyclictest0-21swapper/222:29:402
8919994923,12cyclictest0-21swapper/219:04:172
891999492,9cyclictest281ktimersoftd/220:41:542
891999492,11cyclictest0-21swapper/220:01:402
8918994925,11cyclictest0-21swapper/121:46:421
891799494,39cyclictest0-21swapper/023:26:180
8917994935,10cyclictest0-21swapper/023:01:460
8917994935,10cyclictest0-21swapper/021:09:170
8917994935,10cyclictest0-21swapper/020:46:380
8917994934,11cyclictest0-21swapper/019:49:380
8917994934,10cyclictest0-21swapper/022:39:220
8917994928,10cyclictest0-21swapper/023:16:310
8917994927,11cyclictest0-21swapper/000:06:290
8917994923,12cyclictest0-21swapper/022:06:440
892099485,27cyclictest0-21swapper/320:28:343
892099484,40cyclictest0-21swapper/321:01:233
892099484,29cyclictest0-21swapper/323:46:503
892099484,28cyclictest0-21swapper/322:01:493
892099484,28cyclictest0-21swapper/321:51:223
892099484,28cyclictest0-21swapper/300:11:173
891999484,40cyclictest0-21swapper/221:41:412
891999484,40cyclictest0-21swapper/221:41:412
8919994826,10cyclictest0-21swapper/221:26:352
8919994825,11cyclictest0-21swapper/222:51:312
8919994825,11cyclictest0-21swapper/222:11:332
8919994825,10cyclictest0-21swapper/220:00:542
8919994823,10cyclictest0-21swapper/222:41:312
8919994819,13cyclictest0-21swapper/220:21:412
891899483,37cyclictest0-21swapper/122:46:321
891799484,38cyclictest0-21swapper/019:31:500
891799484,38cyclictest0-21swapper/019:31:500
8917994826,11cyclictest0-21swapper/021:26:360
8917994824,11cyclictest0-21swapper/019:41:270
8917994822,12cyclictest0-21swapper/022:21:500
8917994822,12cyclictest0-21swapper/020:56:520
8917994821,12cyclictest0-21swapper/021:36:440
73212482,41sleep00-21swapper/019:57:070
36942482,9sleep30-21swapper/323:12:583
36942482,9sleep30-21swapper/323:12:583
26612482,9sleep30-21swapper/300:20:203
230632482,40sleep30-21swapper/319:24:333
186032482,9sleep30-21swapper/321:31:333
168722482,40sleep30-21swapper/320:17:093
168722482,40sleep30-21swapper/320:17:093
145452482,41sleep00-21swapper/020:12:550
892099474,39cyclictest0-21swapper/322:31:523
892099474,38cyclictest0-21swapper/323:21:193
892099474,37cyclictest3991-21taskset00:21:363
8920994733,9cyclictest6429-21sadc21:06:233
8920994733,9cyclictest6429-21sadc21:06:233
8920994722,19cyclictest26532-21gltestperf00:01:363
891999474,27cyclictest0-21swapper/221:16:462
8917994733,10cyclictest0-21swapper/019:11:390
8917994732,10cyclictest0-21swapper/023:51:300
8917994732,10cyclictest0-21swapper/023:51:300
891799473,37cyclictest0-21swapper/023:56:380
76532474,36sleep30-21swapper/320:01:253
289152472,9sleep30-21swapper/320:43:373
126682472,39sleep30-21swapper/320:11:373
101582472,9sleep30-21swapper/318:56:523
98152462,37sleep30-21swapper/322:19:253
892099464,38cyclictest0-21swapper/320:06:493
892099464,38cyclictest0-21swapper/319:17:003
8920994631,11cyclictest3340-21cpuspeed_turbos22:06:333
8920994631,10cyclictest21338-21tr21:36:343
8920994631,10cyclictest21304-21cpuspeed_turbos23:51:323
8920994631,10cyclictest21304-21cpuspeed_turbos23:51:323
892099463,14cyclictest0-21swapper/323:01:313
8919994630,10cyclictest12107-21grep23:31:352
8917994633,9cyclictest0-21swapper/023:41:300
8917994625,10cyclictest0-21swapper/022:16:360
8917994621,12cyclictest0-21swapper/021:36:220
81782464,6sleep20-21swapper/218:51:562
81782464,6sleep20-21swapper/218:51:562
57412463,36sleep35855-21df22:11:363
308492462,9sleep30-21swapper/321:56:363
252842462,9sleep30-21swapper/319:27:193
132502462,38sleep30-21swapper/323:33:013
892099454,37cyclictest0-21swapper/321:41:343
892099454,37cyclictest0-21swapper/321:41:343
892099454,36cyclictest0-21swapper/319:31:583
892099454,36cyclictest0-21swapper/319:31:583
892099454,35cyclictest0-21swapper/319:56:263
302312452,37sleep30-21swapper/321:55:153
182522452,9sleep30-21swapper/319:14:053
892099447,33cyclictest32351-21df_inode20:51:393
8920994429,9cyclictest23089-21head20:31:453
8920994326,11cyclictest18786-21ps20:21:533
891799434,34cyclictest0-21swapper/018:56:280
891799434,34cyclictest0-21swapper/018:56:280
892099424,34cyclictest0-21swapper/323:26:383
891899384,15cyclictest0-21swapper/118:56:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional