You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-07-14 - 10:59

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #7, slot #7

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of the 100 highest latencies:
System rack7slot7s.osadl.org (updated Tue Jul 14, 2026 00:43:51)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2890929164,9sleep30-21swapper/319:08:373
2889828976,9sleep20-21swapper/219:08:282
2883928977,8sleep00-21swapper/019:07:420
2878228469,11sleep10-21swapper/119:06:581
162342520,0sleep00-21swapper/022:42:140
171572450,0sleep00-21swapper/000:19:400
2909699270,0cyclictest0-21swapper/023:40:260
2910599260,24cyclictest0-21swapper/222:54:102
2910799230,3cyclictest0-21swapper/320:45:153
29105992222,0cyclictest0-21swapper/221:53:322
2910099223,3cyclictest24122-21/usr/sbin/munin23:45:181
2910099220,2cyclictest0-21swapper/123:35:141
2910099220,15cyclictest0-21swapper/121:30:121
2909699221,18cyclictest0-21swapper/020:05:150
2910599210,21cyclictest0-21swapper/222:34:332
29100992117,3cyclictest16144-21fschecks_count21:25:171
2910099210,19cyclictest0-21swapper/120:40:131
2909699210,4cyclictest0-21swapper/000:20:120
2909699210,20cyclictest0-21swapper/021:46:330
2909699210,16cyclictest0-21swapper/020:25:130
2910599200,20cyclictest0-21swapper/223:56:442
2910599200,20cyclictest0-21swapper/200:07:542
2910599200,19cyclictest0-21swapper/222:17:002
2910099204,1cyclictest141rcu_preempt00:23:121
2910099200,2cyclictest0-21swapper/123:14:251
2909699200,20cyclictest0-21swapper/021:13:210
2909699200,19cyclictest31553-21ssh23:30:120
2910599191,3cyclictest9386-21ssh21:40:202
29105991910,8cyclictest32-21ksoftirqd/221:45:462
2910599190,19cyclictest0-21swapper/222:49:032
29100991919,0cyclictest0-21swapper/100:19:351
2910099190,1cyclictest0-21swapper/122:37:501
2909699195,10cyclictest8867-21munin-node23:51:100
29105991815,2cyclictest0-21swapper/222:24:442
2910599180,18cyclictest0-21swapper/221:12:012
2910099183,14cyclictest22060-21diskmemload23:09:451
2910099180,16cyclictest0-21swapper/122:45:131
2910599171,16cyclictest22060-21diskmemload23:32:492
2910599171,15cyclictest0-21swapper/223:25:142
2910599170,1cyclictest0-21swapper/221:22:592
2910599170,16cyclictest0-21swapper/222:05:112
2910599170,13cyclictest0-21swapper/200:00:432
29100991715,1cyclictest0-21swapper/121:47:101
29100991713,1cyclictest25-21ksoftirqd/122:15:221
2910099170,17cyclictest0-21swapper/121:14:041
2909699171,14cyclictest0-21swapper/021:50:240
29107991615,1cyclictest11975-21kworker/3:023:25:033
2910599160,16cyclictest0-21swapper/222:02:022
2910599160,16cyclictest0-21swapper/221:16:062
2910099161,1cyclictest28729-21apt-get22:50:131
2910099160,16cyclictest0-21swapper/123:04:391
29096991613,2cyclictest904-21munin-run00:10:000
321772150,1sleep125-21ksoftirqd/100:28:191
29107991513,2cyclictest39-21ksoftirqd/322:05:333
2910599154,10cyclictest0-21swapper/200:34:152
2910599150,0cyclictest0-21swapper/223:40:012
2910099150,1cyclictest0-21swapper/122:22:301
2909699159,6cyclictest27579-21apache222:04:130
2909699159,5cyclictest27571-21apache221:33:000
29096991510,3cyclictest7538-21sendmail21:40:000
2909699150,12cyclictest0-21swapper/023:26:560
2910799144,7cyclictest417-21latency_hist21:55:003
2910799143,10cyclictest28075-21apt-get20:15:033
29107991412,1cyclictest0-21swapper/321:19:143
29107991410,3cyclictest18992-21tr19:55:173
29107991410,3cyclictest13874-21grep22:40:263
2910799140,8cyclictest0-21swapper/322:53:253
2910799140,13cyclictest0-21swapper/320:00:143
2910799140,12cyclictest4039-21grep20:30:183
2910799140,12cyclictest4039-21grep20:30:173
29105991413,1cyclictest0-21swapper/222:59:362
29105991411,2cyclictest3001-21cron20:30:012
29105991411,2cyclictest24795-21cat21:30:182
2910599140,6cyclictest0-21swapper/220:10:112
2910599140,14cyclictest0-21swapper/221:59:412
2910099147,4cyclictest25-21ksoftirqd/123:15:111
29100991414,0cyclictest0-21swapper/100:01:551
2910099140,0cyclictest141rcu_preempt00:30:091
2909699147,6cyclictest8797-21munin-run22:00:000
2909699143,4cyclictest225-21systemd-journal19:19:590
29096991413,1cyclictest0-21swapper/023:23:100
29096991410,3cyclictest12538-21basename22:59:590
29096991410,2cyclictest13543-21grep20:50:170
2910799139,3cyclictest8583-21wc23:35:193
2910799139,3cyclictest8233-21grep21:40:143
2910799139,3cyclictest20108-21ssh00:20:253
2910799139,3cyclictest17504-21ssh00:00:163
2910799132,10cyclictest0-21swapper/321:30:133
2910799131,7cyclictest225-21systemd-journal22:33:133
29107991310,2cyclictest9248-21uniq23:55:183
29107991310,2cyclictest880-21cron00:10:013
29107991310,2cyclictest3851-21cut22:35:133
29107991310,2cyclictest23825-21ssh21:10:193
29107991310,2cyclictest16758-21grep23:20:273
29107991310,2cyclictest16169-21grep21:25:173
29107991310,2cyclictest10548-21tr00:15:173
2910599139,3cyclictest19885-21grep22:25:162
2910599133,9cyclictest27579-21apache223:05:542
29105991310,2cyclictest7577-21tr19:30:202
29105991310,2cyclictest25990-21ls00:25:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional