You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-12-01 - 19:05

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #3, slot #3

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TQ-Systems
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack3slot3s.osadl.org (updated Mon Dec 01, 2025 12:43:58)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2174599212759,63sleep30-21swapper/307:08:423
217463728453,10sleep10-21swapper/107:09:111
217444527960,13sleep00-21swapper/007:06:410
217455527762,9sleep20-21swapper/207:08:092
2174834993127,2cyclictest0-21swapper/309:30:183
2174834992924,2cyclictest0-21swapper/312:25:243
25281522270,3sleep20-21swapper/211:37:232
2174834992723,2cyclictest0-21swapper/311:32:023
2174834992522,1cyclictest0-21swapper/312:05:153
2174834992522,1cyclictest0-21swapper/307:39:243
2174834992520,3cyclictest0-21swapper/309:55:003
2174834992519,3cyclictest0-21swapper/310:35:203
217483499251,19cyclictest2415234-21taskset10:23:563
2174834992421,1cyclictest0-21swapper/309:00:003
2174834992420,2cyclictest0-21swapper/310:15:163
2174834992414,5cyclictest24754882sleep311:03:393
217483499241,19cyclictest2324338-21taskset09:22:033
217483499232,15cyclictest2446595-21taskset10:45:133
2174834992319,2cyclictest0-21swapper/312:16:313
2174834992319,2cyclictest0-21swapper/311:50:193
2174834992319,2cyclictest0-21swapper/311:15:233
2174834992319,2cyclictest0-21swapper/309:10:003
2174834992318,3cyclictest0-21swapper/312:35:163
2174834992318,2cyclictest0-21swapper/310:00:163
2174834992318,2cyclictest0-21swapper/309:39:433
25140102221,16sleep12304306-21diskmemload11:29:251
2174834992220,1cyclictest0-21swapper/307:50:013
2174834992219,1cyclictest0-21swapper/310:00:003
2174834992218,2cyclictest0-21swapper/312:10:223
2174834992218,2cyclictest0-21swapper/311:48:583
2174834992218,2cyclictest0-21swapper/311:25:013
2174834992218,2cyclictest0-21swapper/310:55:013
2174834992218,2cyclictest0-21swapper/310:05:003
2174834992218,2cyclictest0-21swapper/309:40:183
2174834992217,2cyclictest0-21swapper/309:10:153
2174834992216,3cyclictest0-21swapper/312:20:133
217483499221,13cyclictest2476398-21taskset11:05:013
2174834992118,2cyclictest0-21swapper/310:45:013
2174834992117,2cyclictest0-21swapper/311:35:443
2174834992117,2cyclictest0-21swapper/310:55:193
2174834992117,2cyclictest0-21swapper/310:30:243
2174834992117,2cyclictest0-21swapper/308:20:013
2174834992117,2cyclictest0-21swapper/307:30:013
2174834992116,2cyclictest0-21swapper/309:50:003
2174834992112,6cyclictest2229899-21sleep08:00:013
217483499211,17cyclictest0-21swapper/311:27:513
217483499211,15cyclictest2613545-21chrt12:31:013
2174834992110,8cyclictest2399175-21taskset10:12:223
24842092201,13sleep12484451-21expr11:10:131
22050892200,4sleep1321rcuc/107:35:151
2174834992017,1cyclictest0-21swapper/309:25:223
2174834992017,1cyclictest0-21swapper/308:40:113
2174834992017,1cyclictest0-21swapper/308:03:483
2174834992016,2cyclictest0-21swapper/308:30:013
217483499200,17cyclictest0-21swapper/310:25:133
2174834991917,1cyclictest0-21swapper/308:35:163
2174834991915,2cyclictest0-21swapper/312:05:013
2174834991915,2cyclictest0-21swapper/311:10:203
2174834991914,2cyclictest0-21swapper/311:56:163
217483499191,14cyclictest2535227-21chrt11:41:023
217483499191,14cyclictest2261779-21chrt08:30:123
26155082181,3sleep00-21swapper/012:34:230
25765102181,12sleep22576787-21cut12:10:162
24313062181,4sleep02431328-21apt-get10:35:130
24230792181,5sleep22304306-21diskmemload10:29:212
24230642181,10sleep02304306-21diskmemload10:29:200
23754022181,4sleep12304306-21diskmemload09:55:301
23109512181,2sleep10-21swapper/109:14:121
217483499182,10cyclictest2223627-21taskset07:50:203
2174834991815,1cyclictest0-21swapper/307:30:163
2174834991814,2cyclictest0-21swapper/309:15:263
217483499181,11cyclictest2287232-21taskset08:50:203
25984212171,4sleep12304306-21diskmemload12:22:491
25604232171,4sleep02561556-21kthreadcore12:00:150
25441862171,4sleep22304306-21diskmemload11:49:032
25048492171,3sleep00-21swapper/011:21:390
24975482171,4sleep12304306-21diskmemload11:17:231
24293532175,2sleep2171rcu_preempt10:32:022
23841662171,4sleep12304306-21diskmemload10:01:581
23535552171,4sleep22304306-21diskmemload09:41:552
23405422171,4sleep02340573-21ssh09:35:120
23248712171,3sleep20-21swapper/209:23:022
23099882171,4sleep22304306-21diskmemload09:11:442
2174834991714,1cyclictest0-21swapper/309:00:183
2174834991713,2cyclictest0-21swapper/308:10:243
2174834991713,2cyclictest0-21swapper/308:07:173
217483499171,11cyclictest2256255-21turbostat08:25:003
25995572161,10sleep02304306-21diskmemload12:24:320
25841832162,7sleep02584314-21diskstats12:15:140
25742792161,2sleep20-21swapper/212:07:512
25136882161,8sleep00-21swapper/011:28:520
24766302161,8sleep22476754-21diskstats11:05:132
24379192161,3sleep10-21swapper/110:38:501
24233182161,4sleep12304306-21diskmemload10:29:521
23555802161,7sleep22304306-21diskmemload09:45:112
23401332161,2sleep10-21swapper/109:34:521
23108752161,10sleep02310887-21ssh09:14:030
22937232161,4sleep02293742-21latency_hist09:00:000
217483499165,8cyclictest2282950-21turbostat08:50:003
2174834991613,1cyclictest0-21swapper/307:20:143
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional