You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 16:31

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #8

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  Congatec
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rackeslot8s.osadl.org (updated Thu Nov 27, 2025 12:43:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
7213069911980,1194cyclictest7616622sleep307:40:003
7213069911650,1161cyclictest9155042sleep309:34:573
721306993220,319cyclictest825083-21turbostat08:34:563
721306992319,1cyclictest0-21swapper/310:04:593
721306992118,1cyclictest0-21swapper/310:50:003
721306992118,1cyclictest0-21swapper/308:25:153
721306991815,1cyclictest0-21swapper/309:50:013
190898180,4rtkit-daemon0-21swapper/211:27:392
721306991714,1cyclictest0-21swapper/310:15:003
721306991714,1cyclictest0-21swapper/308:55:143
72130699171,12cyclictest1102018-21turbostat11:30:013
190898170,4rtkit-daemon1172747-21ssh12:13:430
9331212160,4sleep0934264-21tr09:45:170
72130699169,3cyclictest1165226-21turbostat12:10:003
72130699167,6cyclictest7394852sleep307:20:193
72130699167,6cyclictest10521722sleep310:57:043
721306991613,1cyclictest0-21swapper/312:39:123
721306991613,1cyclictest0-21swapper/311:55:013
72130699161,12cyclictest1083531-21chrt11:15:223
72130699161,12cyclictest1021193-21taskset10:40:013
72130699161,11cyclictest964564-21taskset10:05:143
72130699155,7cyclictest1171473-21taskset12:10:483
721306991513,1cyclictest0-21swapper/311:30:393
721306991513,0cyclictest0-21swapper/308:51:503
721306991512,1cyclictest0-21swapper/312:30:073
721306991512,1cyclictest0-21swapper/311:36:433
721306991512,1cyclictest0-21swapper/311:13:463
721306991512,1cyclictest0-21swapper/311:04:053
721306991512,1cyclictest0-21swapper/311:04:043
721306991512,1cyclictest0-21swapper/308:05:013
721306991512,1cyclictest0-21swapper/307:36:183
721306991512,1cyclictest0-21swapper/307:15:143
72130699151,11cyclictest980887-21taskset10:15:153
72130699151,11cyclictest868127-21taskset09:00:193
72130699151,11cyclictest804577-21taskset08:10:173
72130699151,11cyclictest1178924-21taskset12:15:223
8626602141,10sleep0862710-21sendmail09:00:010
72130699145,7cyclictest1131762-21taskset11:47:203
72130699145,6cyclictest7820022sleep307:55:163
72130699144,7cyclictest921567-21taskset09:35:203
72130699144,7cyclictest9072702sleep309:29:363
72130699144,7cyclictest1043454-21taskset10:50:513
72130699144,7cyclictest10041052sleep310:28:273
721306991413,0cyclictest0-21swapper/312:00:363
721306991413,0cyclictest0-21swapper/307:31:023
721306991412,1cyclictest0-21swapper/311:41:283
721306991412,1cyclictest0-21swapper/309:15:443
721306991412,0cyclictest0-21swapper/311:09:313
721306991411,1cyclictest0-21swapper/310:31:563
721306991411,1cyclictest0-21swapper/308:45:583
72130699141,10cyclictest948206-21taskset09:55:093
72130699141,10cyclictest931710-21turbostat09:45:013
72130699141,10cyclictest873719-21taskset09:05:163
72130699141,10cyclictest811887-21taskset08:16:243
72130699140,11cyclictest843487-21taskset08:40:243
72130699140,11cyclictest843487-21taskset08:40:233
72130699140,11cyclictest767940-21chrt07:45:013
72130699140,11cyclictest747839-21chrt07:25:193
72130699140,11cyclictest1141172-21taskset11:55:023
190898140,9rtkit-daemon1085450-21ssh11:19:170
10866552141,10sleep01087648-21irqstats11:20:170
7807342130,4sleep0780849-21perl07:55:140
72130699134,6cyclictest11959962sleep312:25:523
72130699133,7cyclictest837293-21taskset08:36:183
72130699131,9cyclictest891538-21chrt09:20:013
72130699131,9cyclictest881299-21taskset09:10:323
72130699131,9cyclictest818588-21taskset08:22:483
721306991312,0cyclictest0-21swapper/312:21:143
721306991312,0cyclictest0-21swapper/307:14:513
721306991311,1cyclictest0-21swapper/310:20:153
721306991311,1cyclictest0-21swapper/309:52:083
72130699131,10cyclictest1028026-21taskset10:42:323
721306991310,2cyclictest0-21swapper/308:05:233
72130699130,10cyclictest1091195-21taskset11:20:203
190898130,1rtkit-daemon0-21swapper/010:48:420
11172632131,2sleep20-21swapper/211:37:152
7487122120,1sleep0748884-21latency_hist07:30:020
72130699121,8cyclictest7742552sleep307:50:163
190898120,8rtkit-daemon1076281-21ssh11:11:381
9622462111,4sleep0962254-21ssh10:00:360
7207282110,3sleep30-21swapper/307:05:443
7155662111,3sleep2716349-21irqrtprio07:05:192
190898110,4rtkit-daemon1109173-21ssh11:32:510
9897982103,4sleep2818535-21kworker/u16:1+nfsiod10:20:172
9466352100,7sleep1946643-21ssh09:52:061
8253492101,7sleep10-21swapper/108:30:131
190898100,7rtkit-daemon727881-21munin-node09:10:472
190898100,6rtkit-daemon956338-21/usr/sbin/munin10:00:201
190898100,6rtkit-daemon1063382-21ssh11:05:161
190898100,5rtkit-daemon891652-21apt-get09:20:141
190898100,5rtkit-daemon859716-21grep08:55:172
190898100,4rtkit-daemon1149289-21ssh12:00:020
12143132100,6sleep01214494-21sed12:40:010
941679293,3sleep0943631-21kthreadcore09:50:170
913712290,6sleep0913720-21ssh09:30:500
898286290,1sleep00-21swapper/009:22:330
825313291,4sleep0825346-21apt-get08:30:120
819190291,5sleep2819218-21cut08:25:122
763782290,6sleep1765837-21grep07:40:201
735146290,6sleep2735221-21ntp_states07:15:202
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional