You are here: Home / Projects / OSADL QA Farm Real-time / Latency plots / 
2025-07-01 - 12:48

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 376 highest latencies:
System rackeslot6s.osadl.org (updated Tue Jul 01, 2025 00:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
94684099849,31cyclictest0-21swapper/223:05:012
94684099747,28cyclictest0-21swapper/221:30:002
946840997414,24cyclictest997882-21/usr/sbin/munin00:10:162
946834997436,32cyclictest968327-21ptp4l-jitter21:10:280
946836997366,5cyclictest0-21swapper/100:10:011
946840997213,30cyclictest0-21swapper/223:20:022
94683499721,61cyclictest0-21swapper/000:15:110
946840997021,43cyclictest0-21swapper/222:55:022
94683699664,27cyclictest951379-21sort19:35:001
946834996641,20cyclictest990614-21munin-plugin-st23:24:590
946834996527,8cyclictest987926-21unixbench_singl23:05:320
94684099640,42cyclictest995030-21/usr/sbin/munin23:50:212
946836996411,26cyclictest0-21swapper/119:15:021
946840996311,20cyclictest0-21swapper/222:00:012
946840996237,12cyclictest0-21swapper/219:25:162
946836996210,42cyclictest22-21rcuc/120:25:221
946834996228,9cyclictest0-21swapper/020:15:360
946834996131,8cyclictest0-21swapper/023:25:300
946834996131,5cyclictest0-21swapper/019:15:020
946840996037,13cyclictest992568-21/usr/sbin/munin23:35:192
946840996036,17cyclictest0-21swapper/220:25:162
946834995935,4cyclictest0-21swapper/000:00:010
946840995845,9cyclictest1001911-21munin-plugin-st00:34:592
946840995837,15cyclictest0-21swapper/223:55:132
946840995836,15cyclictest0-21swapper/200:35:132
946840995833,13cyclictest0-21swapper/221:15:132
94683699582,40cyclictest24-21ksoftirqd/100:05:021
946840995742,8cyclictest967382-21/usr/sbin/munin21:05:292
946840995740,12cyclictest0-21swapper/222:05:152
946840995739,11cyclictest0-21swapper/220:45:152
946840995719,31cyclictest0-21swapper/219:35:222
94683699575,26cyclictest24-21ksoftirqd/121:10:021
946840995621,7cyclictest0-21swapper/222:30:292
946840995538,12cyclictest0-21swapper/221:50:142
946840995538,12cyclictest0-21swapper/221:50:142
946840995537,11cyclictest0-21swapper/220:15:182
946840995536,14cyclictest0-21swapper/220:10:172
94683499551,27cyclictest20950irq/209-8000000.ethernet20:10:000
946840995439,9cyclictest948369-21/usr/sbin/munin19:15:212
946840995433,11cyclictest0-21swapper/219:20:182
946840995410,30cyclictest0-21swapper/220:55:202
94683499541,3cyclictest0-21swapper/019:30:140
94684099539,18cyclictest0-21swapper/221:35:012
946840995343,7cyclictest954008-21sshd19:48:462
946840995343,7cyclictest954008-21sshd19:48:462
946840995340,9cyclictest0-21swapper/223:30:132
946840995338,8cyclictest0-21swapper/200:30:002
946840995338,8cyclictest0-21swapper/200:30:002
946840995336,13cyclictest0-21swapper/220:20:172
946840995335,11cyclictest962931-21/usr/sbin/munin20:40:242
946840995334,14cyclictest0-21swapper/221:55:182
946840995334,14cyclictest0-21swapper/200:15:252
946840995334,13cyclictest0-21swapper/223:20:172
946840995246,3cyclictest972981-21munin-node21:40:132
946840995238,9cyclictest0-21swapper/221:35:192
946840995238,9cyclictest0-21swapper/221:35:182
946840995234,12cyclictest0-21swapper/200:20:152
946840995234,11cyclictest983420-21/usr/sbin/munin22:40:262
946840995215,31cyclictest0-21swapper/220:00:182
946840995215,31cyclictest0-21swapper/220:00:182
946840995139,6cyclictest984861-21/usr/sbin/munin22:50:182
946840995137,8cyclictest982881-21sshd22:35:482
946840995135,12cyclictest0-21swapper/219:40:182
946840995134,13cyclictest0-21swapper/222:25:192
946840995133,13cyclictest991060-21/usr/sbin/munin23:25:242
946840995129,12cyclictest0-21swapper/220:50:112
946840995128,13cyclictest946997-21/usr/sbin/munin19:10:122
946840995117,29cyclictest0-21swapper/223:00:242
946840995117,29cyclictest0-21swapper/223:00:242
946840995039,8cyclictest961918-21/usr/sbin/munin20:35:202
946840995037,7cyclictest954444-21/usr/sbin/munin19:50:232
946840995036,7cyclictest978956-21diskstats22:15:222
946840995035,10cyclictest0-21swapper/220:05:142
946840995034,8cyclictest974118-21/usr/sbin/munin21:45:302
946840995027,13cyclictest0-21swapper/223:10:142
94683699505,16cyclictest22-21rcuc/119:25:011
946840994943,3cyclictest969605-21apt-get21:20:152
946840994935,8cyclictest993959-21users23:40:292
946840994933,9cyclictest966429-21/usr/sbin/munin21:00:272
946840994932,11cyclictest950711-21/usr/sbin/munin19:30:192
946840994930,11cyclictest996877-21/usr/sbin/munin00:00:162
946840994836,8cyclictest978043-21/usr/sbin/munin22:10:162
946840994830,8cyclictest0-21swapper/221:10:132
946840994815,27cyclictest0-21swapper/219:55:132
946836994827,12cyclictest0-21swapper/119:15:011
946834994842,4cyclictest0-21swapper/019:10:000
946840994741,3cyclictest960975-21apt-get20:30:172
946840994734,9cyclictest979806-21/usr/sbin/munin22:20:212
946840994733,11cyclictest994429-21/usr/sbin/munin23:45:242
946834994733,10cyclictest0-21swapper/020:45:010
946836994628,9cyclictest0-21swapper/120:50:211
946836994627,14cyclictest231ktimers/120:40:121
946836994625,10cyclictest0-21swapper/119:45:191
946836994625,10cyclictest0-21swapper/119:45:191
94683699462,4cyclictest0-21swapper/121:45:001
946836994616,20cyclictest0-21swapper/121:50:011
946840994533,7cyclictest984222-21/usr/sbin/munin22:45:262
946836994537,4cyclictest978687-21munin-plugin-st22:14:591
94683499442,6cyclictest0-21swapper/000:15:010
946840994327,10cyclictest997829-21latency_hist00:10:022
94683699437,4cyclictest0-21swapper/122:20:011
946836994229,9cyclictest0-21swapper/100:00:201
946836994225,11cyclictest231ktimers/121:00:161
946834994234,6cyclictest948768-21run-parts19:20:000
946834994233,5cyclictest20950irq/209-8000000.ethernet23:30:290
946836994129,6cyclictest991398-21grep23:25:311
946836994128,9cyclictest0-21swapper/121:30:331
94683699411,4cyclictest0-21swapper/120:00:011
94683499413,5cyclictest949566-21grep19:20:350
946834994134,4cyclictest20750irq/251-8000000.ethernet20:30:200
946834994133,5cyclictest964142-21cron20:50:000
946834994128,9cyclictest0-21swapper/019:50:300
946836994031,5cyclictest964150-21munin-plugin-st20:50:001
946836994027,6cyclictest0-21swapper/122:10:011
94683699402,6cyclictest0-21swapper/119:10:011
946836994026,10cyclictest989760-21sendmail23:20:001
946836994024,12cyclictest231ktimers/120:05:151
94683699401,2cyclictest0-21swapper/100:30:021
94683699401,2cyclictest0-21swapper/100:30:021
946834994029,8cyclictest0-21swapper/021:20:000
946834994028,9cyclictest0-21swapper/022:25:320
946834994027,9cyclictest0-21swapper/021:25:300
946840993926,6cyclictest946929-21latency_hist19:10:012
946836993929,7cyclictest993878-21grep23:40:291
946836993929,6cyclictest0-21swapper/123:30:301
946836993925,10cyclictest0-21swapper/122:45:241
946836993923,9cyclictest0-21swapper/120:10:221
94683499393,7cyclictest989237-21cut23:15:200
946834993931,5cyclictest964992-21grep20:50:280
946834993929,6cyclictest978460-21ptp4l22:10:320
94683499391,36cyclictest0-21swapper/023:40:280
94683499391,36cyclictest0-21swapper/021:20:320
946836993830,4cyclictest168350irq/127-8000000.ethernet-tx120:20:001
946836993822,10cyclictest0-21swapper/119:45:021
946836993821,9cyclictest0-21swapper/121:55:321
946834993832,3cyclictest0-21swapper/021:55:330
946834993831,4cyclictest20950irq/209-8000000.ethernet23:00:280
946834993831,4cyclictest20950irq/209-8000000.ethernet23:00:270
946834993831,4cyclictest20950irq/209-8000000.ethernet22:20:270
946834993831,3cyclictest20750irq/251-8000000.ethernet00:20:140
946834993822,10cyclictest0-21swapper/020:35:290
946834993818,5cyclictest27250irq/343-wl18xx22:40:250
946834993818,11cyclictest974662-21/usr/sbin/munin21:50:200
946834993818,11cyclictest974662-21/usr/sbin/munin21:50:200
94683499381,35cyclictest0-21swapper/022:45:260
94683699378,16cyclictest24-21ksoftirqd/121:30:001
946836993724,8cyclictest231ktimers/122:00:201
94683699371,2cyclictest0-21swapper/123:40:011
946834993731,4cyclictest0-21swapper/022:55:150
94683499372,5cyclictest293-21systemd-journal21:10:000
946834993725,9cyclictest0-21swapper/020:20:330
946834993720,12cyclictest0-21swapper/023:35:300
94683499371,2cyclictest951595-21apt-get19:35:200
946836993624,7cyclictest962380-21grep20:35:291
946836993624,7cyclictest0-21swapper/121:50:311
946836993624,7cyclictest0-21swapper/121:50:311
94683699361,2cyclictest0-21swapper/119:40:011
946834993629,4cyclictest20950irq/209-8000000.ethernet19:45:020
946834993628,5cyclictest0-21swapper/019:25:300
946834993626,7cyclictest0-21swapper/022:50:310
94683499361,4cyclictest1666-21snmpd22:05:250
946836993526,6cyclictest1002776-21sendmail00:40:001
946836993526,5cyclictest0-21swapper/120:25:001
946836993524,8cyclictest0-21swapper/119:55:001
94683699351,4cyclictest0-21swapper/120:05:011
94683699351,4cyclictest0-21swapper/120:05:011
946834993529,4cyclictest20950irq/209-8000000.ethernet00:35:300
946834993529,4cyclictest20950irq/209-8000000.ethernet00:25:200
946834993529,4cyclictest20950irq/209-8000000.ethernet00:25:190
946834993527,5cyclictest0-21swapper/020:55:270
946834993526,4cyclictest0-21swapper/021:00:310
946836993424,6cyclictest0-21swapper/123:00:291
946836993424,6cyclictest0-21swapper/123:00:291
946836993420,7cyclictest0-21swapper/100:15:281
946834993428,4cyclictest20950irq/209-8000000.ethernet22:15:250
94683499341,3cyclictest0-21swapper/000:05:010
94683499341,26cyclictest972870-21wc21:40:010
94683499341,26cyclictest972870-21wc21:40:010
94683699332,4cyclictest0-21swapper/121:40:011
94683699332,4cyclictest0-21swapper/121:40:011
946836993324,4cyclictest0-21swapper/122:30:001
946836993315,13cyclictest231ktimers/122:30:141
94683699331,27cyclictest0-21swapper/121:20:301
946836993312,15cyclictest231ktimers/100:30:131
94683499333,4cyclictest960203-21/usr/sbin/munin20:25:200
94683499331,4cyclictest982826-21sed22:35:320
94683499331,2cyclictest0-21swapper/020:00:010
946836993223,6cyclictest0-21swapper/123:55:011
94683699322,16cyclictest22-21rcuc/123:50:011
946836993220,8cyclictest22-21rcuc/122:40:311
94683699321,4cyclictest999952-21ps00:20:301
94683699321,3cyclictest950186-21ps19:25:281
94683699321,29cyclictest988271-21/usr/sbin/munin23:10:211
946834993226,4cyclictest20950irq/209-8000000.ethernet19:45:050
946834993226,4cyclictest20950irq/209-8000000.ethernet19:45:050
946834993226,4cyclictest0-21swapper/022:30:150
946834993223,7cyclictest0-21swapper/000:35:000
946834993222,7cyclictest974455-21sshd21:49:480
946834993222,7cyclictest0-21swapper/021:40:290
946834993221,7cyclictest0-21swapper/023:50:320
94683499321,28cyclictest994190-21/usr/sbin/munin23:45:220
946836993117,9cyclictest0-21swapper/123:55:211
94683699311,15cyclictest0-21swapper/122:40:011
946834993126,3cyclictest20950irq/209-8000000.ethernet21:30:180
946834993125,4cyclictest20950irq/209-8000000.ethernet20:10:140
946834993123,4cyclictest0-21swapper/020:00:110
946834993123,4cyclictest0-21swapper/020:00:110
94683499311,6cyclictest0-21swapper/000:10:000
946836993023,4cyclictest960972-21/usr/sbin/munin20:30:251
946836993021,5cyclictest0-21swapper/120:55:291
946836993019,8cyclictest0-21swapper/122:20:311
946836993018,7cyclictest0-21swapper/121:05:321
946834993024,4cyclictest20950irq/209-8000000.ethernet23:10:190
946836992920,5cyclictest0-21swapper/122:50:191
94683699291,3cyclictest0-21swapper/123:10:001
94683499291,4cyclictest976660-21meminfo22:00:270
94683699281,4cyclictest0-21swapper/123:20:311
946836992718,5cyclictest0-21swapper/121:15:281
946836992620,4cyclictest0-21swapper/122:56:201
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional