You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-18 - 05:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Tue Nov 18, 2025 00:43:59)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3075300212755,67sleep30-21swapper/319:06:343
307547029154,10sleep10-21swapper/119:08:401
307540628959,6sleep00-21swapper/019:07:510
307527928151,9sleep20-21swapper/219:06:172
3075698993935,2cyclictest0-21swapper/323:25:223
3075698993935,2cyclictest0-21swapper/323:25:213
33357772350,1sleep20-21swapper/222:29:552
34916132271,2sleep20-21swapper/200:04:482
3075698992623,2cyclictest0-21swapper/300:00:003
3075698992522,1cyclictest0-21swapper/321:35:173
307569899252,14cyclictest3484412-21taskset00:00:153
34969372240,3sleep10-21swapper/100:05:251
3075698992421,1cyclictest0-21swapper/323:35:013
3075698992421,1cyclictest0-21swapper/321:30:133
307569899232,14cyclictest3410094-21taskset23:15:173
307569899232,13cyclictest3451371-21taskset23:40:193
3075698992320,1cyclictest0-21swapper/321:40:123
3075698992320,1cyclictest0-21swapper/300:20:003
3075698992313,5cyclictest34642502sleep323:46:013
35131902221,13sleep13204573-21diskmemload00:16:051
34349752220,10sleep244-21ksoftirqd/223:30:162
307569899222,15cyclictest3278159-21sleep21:55:003
3075698992219,2cyclictest0-21swapper/319:15:033
3075698992218,2cyclictest0-21swapper/321:57:323
3075698992217,2cyclictest0-21swapper/322:40:163
3075698992216,3cyclictest0-21swapper/322:15:003
307569899221,17cyclictest3302995-21turbostat22:10:013
307569899221,16cyclictest3401016-21turbostat23:10:003
32285792211,13sleep03204573-21diskmemload21:24:340
307569899216,11cyclictest0-21swapper/300:05:233
307569899212,13cyclictest3390058-21taskset23:00:413
3075698992118,1cyclictest0-21swapper/322:17:523
3075698992118,1cyclictest0-21swapper/321:00:283
3075698992117,2cyclictest0-21swapper/323:20:273
3075698992116,3cyclictest0-21swapper/322:50:233
35136172201,12sleep03204573-21diskmemload00:16:530
307569899202,12cyclictest3544332-21taskset00:35:433
3075698992016,2cyclictest0-21swapper/322:24:073
3075698992016,1cyclictest0-21swapper/320:45:163
307569899201,15cyclictest3343975-21turbostat22:35:003
307569899201,15cyclictest3210895-21chrt21:12:143
307569899201,14cyclictest3292341-21chrt22:01:133
307569899201,14cyclictest3267138-21chrt21:45:463
307569899195,7cyclictest3212840-21taskset21:15:063
307569899192,12cyclictest3344340-21taskset22:35:123
307569899192,11cyclictest3193283-21taskset20:55:303
3075698991917,1cyclictest0-21swapper/322:46:543
3075698991916,1cyclictest0-21swapper/320:40:243
3075698991916,1cyclictest0-21swapper/320:40:233
3075698991914,3cyclictest0-21swapper/322:25:193
307569899191,2cyclictest0-21swapper/323:50:393
307569899191,14cyclictest3521154-21chrt00:21:123
307569899191,14cyclictest3500150-21chrt00:10:093
307569899191,14cyclictest0-21swapper/320:30:113
307569899191,14cyclictest0-21swapper/320:00:133
307569899190,16cyclictest66550irq/131-enp1s0-TxRx-321:28:003
35374602181,4sleep23204573-21diskmemload00:32:222
34399942181,2sleep10-21swapper/123:32:041
34090672181,3sleep20-21swapper/223:14:562
34067762181,4sleep13204573-21diskmemload23:11:231
33265432181,4sleep23204573-21diskmemload22:23:212
32767832181,2sleep00-21swapper/021:53:000
31930322181,11sleep23193279-21grep20:55:302
307569899182,12cyclictest3406835-21taskset23:11:283
3075698991815,1cyclictest0-21swapper/321:20:243
3075698991815,1cyclictest0-21swapper/300:30:183
3075698991813,2cyclictest0-21swapper/322:56:143
307569899181,14cyclictest0-21swapper/320:35:253
307569899181,10cyclictest3119278-21chrt19:45:293
307569899180,16cyclictest0-21swapper/323:39:483
35457302170,3sleep20-21swapper/200:38:112
34973302171,3sleep20-21swapper/200:05:352
34151662171,2sleep00-21swapper/023:16:480
33827212171,4sleep03204573-21diskmemload22:56:590
32934052171,2sleep00-21swapper/022:02:500
32697492171,3sleep00-21swapper/021:49:480
32107502170,8sleep13204573-21diskmemload21:12:011
32049822171,4sleep03205003-21apt-get21:10:160
30937562171,11sleep23093775-21apt-get19:25:132
307569899177,6cyclictest3161997-21taskset20:29:013
307569899175,9cyclictest3140665-21chrt20:05:293
307569899171,13cyclictest0-21swapper/319:35:213
307569899171,13cyclictest0-21swapper/300:25:083
307569899171,12cyclictest3113729-21chrt19:40:243
307569899171,12cyclictest3113729-21chrt19:40:243
307569899171,11cyclictest3141320-21taskset20:10:143
307569899171,10cyclictest3075858-21taskset19:10:013
307569899170,14cyclictest0-21swapper/319:50:163
307569899170,13cyclictest0-21swapper/320:50:213
35287482161,12sleep00-21swapper/000:25:430
33830482161,10sleep23383059-21ssh22:57:292
32862942161,8sleep23286334-21munin-run22:00:012
32538712161,3sleep13204573-21diskmemload21:40:101
32148472161,10sleep13216548-21kthreadcore21:15:181
32134682161,10sleep03214846-21grep21:15:170
31666792161,10sleep23166694-21grep20:30:252
307569899161,9cyclictest3093742-21taskset19:25:013
3075698991613,1cyclictest0-21swapper/320:20:143
3075698991612,3cyclictest0-21swapper/321:05:013
35373612150,2sleep03204573-21diskmemload00:32:120
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional