You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-11-27 - 11:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Thu Nov 27, 2025 00:43:56)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1120221320,0sleep10-21swapper/121:28:231
2735429668,9sleep00-21swapper/019:08:510
2723329581,9sleep10-21swapper/119:07:151
2715329582,9sleep30-21swapper/319:06:123
2738828665,6sleep20-21swapper/219:09:172
199812540,1sleep10-21swapper/123:48:001
2753499282,25cyclictest16597-21diskmemload21:39:101
2753499280,27cyclictest10871-21turbostat00:05:001
2753499280,27cyclictest0-21swapper/123:38:591
27534992717,9cyclictest12495-21nfs4_client00:05:201
2753499270,25cyclictest0-21swapper/121:40:111
2753499260,24cyclictest0-21swapper/100:36:441
2753499260,1cyclictest0-21swapper/122:54:351
2753499250,24cyclictest0-21swapper/122:14:481
2753499250,23cyclictest0-21swapper/123:41:041
2753499250,1cyclictest0-21swapper/122:35:141
2753499243,14cyclictest26796-21ssh23:30:171
2753499242,21cyclictest16597-21diskmemload23:53:381
2753499241,17cyclictest31315-21aten2_r7power_c21:20:131
2753499240,23cyclictest0-21swapper/122:05:191
2753499240,1cyclictest0-21swapper/100:10:131
2753999230,23cyclictest0-21swapper/323:01:023
2753499233,19cyclictest330-21ssh00:20:231
2753499230,22cyclictest0-21swapper/121:54:371
2753499230,22cyclictest0-21swapper/121:30:101
2753499230,20cyclictest24158-21cpuspeed_turbos21:15:131
2753499230,20cyclictest0-21swapper/123:15:531
2753499230,20cyclictest0-21swapper/122:40:031
2753499230,1cyclictest0-21swapper/123:23:111
2753499230,1cyclictest0-21swapper/122:49:481
2753699220,21cyclictest0-21swapper/222:01:012
2753499221,1cyclictest0-21swapper/121:10:131
2753499220,21cyclictest0-21swapper/122:02:081
2753499220,21cyclictest0-21swapper/100:31:081
2752999222,19cyclictest8059-21ssh23:40:110
27536992118,2cyclictest0-21swapper/221:58:002
2753499213,17cyclictest17972-21sh23:01:351
2753499212,17cyclictest16597-21diskmemload22:57:131
2753499211,19cyclictest31053-21pmu-power23:55:211
2753499211,16cyclictest0-21swapper/119:55:191
2753999200,19cyclictest0-21swapper/321:15:563
27536992020,0cyclictest0-21swapper/221:52:032
2753699200,2cyclictest0-21swapper/223:41:562
2753699200,19cyclictest0-21swapper/222:28:562
2753499204,15cyclictest16597-21diskmemload23:06:321
2753499202,17cyclictest20612-21unixbench_multi23:25:291
2753499200,19cyclictest0-21swapper/121:56:111
2753499200,17cyclictest1842-21grep19:20:281
2753699191,17cyclictest0-21swapper/220:34:552
2753499191,1cyclictest0-21swapper/100:18:361
2753499191,15cyclictest16597-21diskmemload22:15:571
2753499190,1cyclictest0-21swapper/119:25:131
2753499190,18cyclictest0-21swapper/100:28:151
2753999180,13cyclictest27651-21ssh21:40:003
27536991815,1cyclictest0-21swapper/200:15:032
2753499181,15cyclictest31529-21grep20:30:011
2753499180,1cyclictest16597-21diskmemload22:30:231
2753499180,1cyclictest0-21swapper/120:40:101
2753499180,1cyclictest0-21swapper/119:45:131
2753499180,18cyclictest0-21swapper/121:45:361
2753499180,14cyclictest16597-21diskmemload22:25:261
2753699170,2cyclictest0-21swapper/221:35:252
2753699170,1cyclictest141rcu_preempt22:23:432
2753699170,1cyclictest0-21swapper/223:37:182
2753699170,14cyclictest0-21swapper/222:54:152
2753499179,6cyclictest29030-21tr20:20:131
2753499173,11cyclictest31763-21apt-get20:30:081
2753499172,1cyclictest16597-21diskmemload23:10:291
2752999176,6cyclictest491-21latency_hist23:35:000
27536991615,1cyclictest0-21swapper/223:29:082
2753699160,1cyclictest0-21swapper/221:10:162
2753699160,15cyclictest0-21swapper/223:23:282
2753699160,13cyclictest0-21swapper/221:46:292
2753699160,13cyclictest0-21swapper/200:08:512
2753499161,12cyclictest27829-21runrttasks22:24:161
2752999160,14cyclictest0-21swapper/021:26:000
2753999150,7cyclictest20056-21ntp_states23:25:243
27536991512,2cyclictest22780-21tr20:05:222
2753699150,15cyclictest0-21swapper/223:56:262
2753699150,15cyclictest0-21swapper/222:11:582
2753699150,12cyclictest0-21swapper/223:33:462
2753499159,5cyclictest13084-21wc21:00:191
2753499158,6cyclictest9564-21date20:55:001
2753499152,11cyclictest9721-21cut20:55:131
2753499152,11cyclictest0-21swapper/120:05:121
2753499152,10cyclictest21272-21cron20:05:001
2753499150,1cyclictest0-21swapper/121:05:191
2753499150,1cyclictest0-21swapper/119:40:131
2753499150,14cyclictest0-21swapper/119:10:131
2752999151,3cyclictest0-21swapper/021:05:130
27529991513,2cyclictest0-21swapper/023:38:320
2753699141,3cyclictest5871-21latency_hist21:25:002
27536991410,3cyclictest28937-21sed21:40:162
27536991410,2cyclictest14355-21cat21:05:002
2753699140,3cyclictest0-21swapper/200:21:132
2753699140,14cyclictest37850irq/131-snd_hda22:56:072
2753699140,14cyclictest0-21swapper/222:35:512
2753699140,13cyclictest0-21swapper/221:34:002
2753499148,5cyclictest8816-21wc19:35:261
2753499148,5cyclictest6255-21grep20:45:221
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional