You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-09-22 - 14:40

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Tue Sep 22, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
47871699812,34cyclictest513208-21/usr/sbin/munin22:30:231
47871699812,34cyclictest513208-21/usr/sbin/munin22:30:221
47871899668,21cyclictest0-21swapper/219:15:012
478718996611,15cyclictest30-21rcuc/219:50:172
478718996611,15cyclictest30-21rcuc/219:50:172
478713996134,24cyclictest521629-21sendmail23:20:000
478718995622,9cyclictest30-21rcuc/222:30:022
478718995622,9cyclictest30-21rcuc/222:30:022
47871899558,22cyclictest32-21ksoftirqd/222:15:002
478718995545,5cyclictest493411-21munin-plugin-st20:35:012
478713995448,4cyclictest131ktimers/019:20:190
478718995234,11cyclictest502648-21grep21:25:272
478718995234,11cyclictest502648-21grep21:25:272
478716995242,5cyclictest481507-21munin-plugin-st19:25:001
478713995244,5cyclictest507856-21sendmail21:59:590
478713995218,24cyclictest527911-21/usr/sbin/munin23:55:190
47871899514,26cyclictest32-21ksoftirqd/219:35:012
478718995129,19cyclictest528769-21/usr/sbin/munin00:00:202
47871399518,5cyclictest0-21swapper/020:05:010
478718995043,5cyclictest0-21swapper/200:15:022
478718995025,13cyclictest32-21ksoftirqd/223:10:182
47871899501,11cyclictest0-21swapper/221:25:002
478718994936,5cyclictest0-21swapper/222:25:002
47871699493,37cyclictest517851-21tail22:55:261
47871699493,37cyclictest517851-21tail22:55:261
478718994833,10cyclictest0-21swapper/223:55:012
478716994839,4cyclictest487405-21grep19:55:271
478716994812,29cyclictest502641-21unixbench_singl21:25:281
478716994812,29cyclictest502641-21unixbench_singl21:25:281
47871399480,44cyclictest508805-21latency_hist22:05:000
478718994734,7cyclictest518992-21grep23:00:272
478718994729,12cyclictest0-21swapper/223:30:212
478718994729,12cyclictest0-21swapper/223:30:202
478718994710,14cyclictest32-21ksoftirqd/222:25:012
478718994635,7cyclictest531076-21grep00:10:302
478718994632,8cyclictest535368-21grep00:35:292
478718994535,6cyclictest525082-21sh23:39:592
478718994534,8cyclictest0-21swapper/219:25:002
478718994533,8cyclictest528555-21sendmail00:00:002
478716994537,5cyclictest0-21swapper/123:54:591
478716994532,8cyclictest0-21swapper/100:20:301
478713994539,3cyclictest0-21swapper/021:15:260
478713994536,4cyclictest20850irq/208-8000000.ethernet23:10:190
478713994533,9cyclictest0-21swapper/022:55:010
478713994531,9cyclictest0-21swapper/023:20:260
478713994523,16cyclictest0-21swapper/020:20:280
47871399451,3cyclictest0-21swapper/022:30:290
47871399451,3cyclictest0-21swapper/022:30:280
47871399451,37cyclictest0-21swapper/000:20:020
478718994435,6cyclictest507008-21munin-plugin-st21:55:002
478718994435,5cyclictest480544-21grep19:15:282
478713994433,6cyclictest131ktimers/020:35:290
478713994429,10cyclictest0-21swapper/021:25:200
478713994429,10cyclictest0-21swapper/021:25:200
478718994331,7cyclictest534503-21grep00:30:302
478718994329,10cyclictest0-21swapper/222:40:292
478718994312,11cyclictest30-21rcuc/221:45:012
478718994310,26cyclictest0-21swapper/219:40:262
478713994335,6cyclictest0-21swapper/022:55:130
478713994335,6cyclictest0-21swapper/022:55:130
478713994332,8cyclictest0-21swapper/021:05:270
47871399431,39cyclictest534348-21grep00:30:290
47871399431,35cyclictest0-21swapper/019:25:030
478718994234,5cyclictest532873-21cron00:25:002
478718994225,9cyclictest0-21swapper/220:20:202
478716994229,7cyclictest484908-21grep19:40:291
478716994224,8cyclictest0-21swapper/121:40:281
47871399422,5cyclictest506978-21users21:50:280
47871399421,39cyclictest0-21swapper/000:25:310
478718994129,6cyclictest0-21swapper/200:05:282
47871899412,7cyclictest0-21swapper/222:40:012
478718994127,9cyclictest0-21swapper/221:10:302
478718994119,11cyclictest490019-21cron20:15:002
478716994132,5cyclictest485748-21unixbench_singl19:45:291
478716994129,8cyclictest533200-21sh00:25:211
478716994126,10cyclictest0-21swapper/120:20:261
47871699411,33cyclictest0-21swapper/120:25:191
478713994128,8cyclictest0-21swapper/022:45:300
478713994128,8cyclictest0-21swapper/022:45:300
47871399412,4cyclictest495567-21irqstats20:45:240
478713994122,4cyclictest139430-1kworker/0:2H+mmc_complete23:55:010
47871399411,37cyclictest0-21swapper/022:40:180
47871899409,25cyclictest0-21swapper/221:05:192
478718994030,7cyclictest502991-21/usr/sbin/munin21:30:232
478718994023,10cyclictest0-21swapper/223:40:262
478713994027,8cyclictest0-21swapper/021:45:290
478713994027,8cyclictest0-21swapper/021:45:290
47871399401,4cyclictest0-21swapper/000:00:280
47871399401,37cyclictest0-21swapper/020:55:250
478718993927,9cyclictest311ktimers/219:45:272
478718993927,7cyclictest311ktimers/222:55:122
478718993927,7cyclictest311ktimers/222:55:122
47871899391,5cyclictest0-21swapper/222:00:012
478716993931,4cyclictest167450irq/126-8000000.ethernet-tx121:00:201
478716993931,4cyclictest167450irq/126-8000000.ethernet-tx121:00:201
478716993929,6cyclictest528462-21grep23:55:271
478713993923,14cyclictest0-21swapper/020:43:030
47871399391,8cyclictest485744-21sshd19:45:280
47871399391,3cyclictest512374-21apt-get22:25:160
47871399391,35cyclictest526285-21ssh23:45:200
47871399391,35cyclictest510879-21if_err_eth022:15:230
47871399391,35cyclictest510879-21if_err_eth022:15:230
478718993824,8cyclictest0-21swapper/220:55:192
47871699383,3cyclictest497427-21gzip20:55:271
478716993830,5cyclictest0-21swapper/121:05:271
478716993829,4cyclictest167450irq/126-8000000.ethernet-tx123:40:211
478716993827,5cyclictest0-21swapper/119:15:021
47871699382,34cyclictest0-21swapper/100:35:291
478713993826,7cyclictest0-21swapper/020:05:300
478713993826,7cyclictest0-21swapper/020:05:300
478713993826,7cyclictest0-21swapper/000:05:270
478713993822,14cyclictest0-21swapper/023:25:200
47871399381,34cyclictest0-21swapper/019:30:180
478718993728,5cyclictest504478-21grep21:40:002
478718993721,10cyclictest0-21swapper/220:05:272
478718993721,10cyclictest0-21swapper/220:05:272
478718993720,10cyclictest0-21swapper/222:50:192
478718993718,10cyclictest508706-21cut22:05:012
478718993713,13cyclictest0-21swapper/221:45:122
478718993713,13cyclictest0-21swapper/221:45:122
47871699374,26cyclictest0-21swapper/121:35:271
478716993728,5cyclictest511197-21grep22:15:291
478716993728,5cyclictest511197-21grep22:15:291
478716993728,5cyclictest0-21swapper/123:20:021
478716993727,6cyclictest0-21swapper/122:40:291
47871399375,14cyclictest0-21swapper/020:20:000
478713993730,4cyclictest20650irq/252-8000000.ethernet21:10:300
478713993729,4cyclictest23850irq/422-mmc119:15:020
478713993725,8cyclictest0-21swapper/023:40:000
478713993724,8cyclictest0-21swapper/021:30:340
478713993723,9cyclictest0-21swapper/022:10:300
47871399372,33cyclictest0-21swapper/000:20:210
478713993722,13cyclictest0-21swapper/019:35:200
478713993722,13cyclictest0-21swapper/019:35:200
47871399371,34cyclictest0-21swapper/022:37:350
47871399371,34cyclictest0-21swapper/021:35:120
47871399371,34cyclictest0-21swapper/019:55:260
478718993625,6cyclictest0-21swapper/223:20:302
47871899361,28cyclictest32-21ksoftirqd/223:25:282
47871899361,10cyclictest32-21ksoftirqd/223:15:212
478716993628,4cyclictest0-21swapper/122:10:271
478716993628,4cyclictest0-21swapper/100:13:291
478716993627,5cyclictest0-21swapper/122:35:281
478716993627,5cyclictest0-21swapper/122:05:011
478716993626,6cyclictest529416-21http00:05:011
478716993620,10cyclictest0-21swapper/100:15:211
47871699361,9cyclictest0-21swapper/120:50:011
478713993631,3cyclictest20850irq/208-8000000.ethernet19:15:260
478713993629,4cyclictest20850irq/208-8000000.ethernet22:20:230
478713993628,5cyclictest0-21swapper/020:30:290
47871399362,4cyclictest525674-21grep23:40:250
478713993624,8cyclictest0-21swapper/023:05:320
478713993621,7cyclictest0-21swapper/023:35:020
478713993621,7cyclictest0-21swapper/023:35:020
47871399361,4cyclictest0-21swapper/000:35:130
47871399361,32cyclictest0-21swapper/000:10:250
478718993526,6cyclictest311ktimers/222:10:022
478718993524,6cyclictest0-21swapper/220:15:272
47871899352,27cyclictest30-21rcuc/200:25:302
478716993527,5cyclictest496721-21grep20:50:271
478716993522,5cyclictest0-21swapper/121:55:011
47871699351,2cyclictest0-21swapper/122:10:021
47871699351,2cyclictest0-21swapper/120:15:001
47871399352,5cyclictest496405-21irqstats20:50:230
478713993522,9cyclictest0-21swapper/021:40:290
478713993519,12cyclictest0-21swapper/023:00:270
47871399351,3cyclictest0-21swapper/019:50:200
47871399351,3cyclictest0-21swapper/019:50:190
47871399351,32cyclictest0-21swapper/020:29:460
47871399351,32cyclictest0-21swapper/020:10:130
47871399351,32cyclictest0-21swapper/019:43:580
478718993426,6cyclictest311ktimers/221:15:152
478718993426,5cyclictest311ktimers/222:20:012
478718993426,5cyclictest311ktimers/222:20:012
478718993422,7cyclictest487477-21sshd19:58:282
47871899342,27cyclictest0-21swapper/220:29:232
478718993421,6cyclictest0-21swapper/221:00:302
478718993421,6cyclictest0-21swapper/221:00:302
47871899341,27cyclictest1660-21snmpd20:45:212
478716993425,5cyclictest167450irq/126-8000000.ethernet-tx123:45:221
478716993424,7cyclictest516292-21grep22:45:301
478716993424,7cyclictest516292-21grep22:45:301
478716993424,6cyclictest486644-21cron19:55:011
478716993424,6cyclictest486644-21cron19:55:011
478716993422,6cyclictest533931-21/usr/sbin/munin00:30:201
478716993419,11cyclictest231ktimers/121:30:161
47871699340,5cyclictest530110-21ptp4l00:05:261
47871399341,3cyclictest0-21swapper/022:05:150
47871399341,31cyclictest0-21swapper/021:21:430
478718993327,4cyclictest311ktimers/223:05:212
47871899331,26cyclictest0-21swapper/223:45:172
478716993326,4cyclictest167450irq/126-8000000.ethernet-tx123:20:271
478716993326,4cyclictest167450irq/126-8000000.ethernet-tx121:15:231
478716993325,6cyclictest516586-21/usr/sbin/munin22:50:251
478716993325,5cyclictest0-21swapper/121:55:171
478716993325,4cyclictest0-21swapper/119:25:281
47871699331,27cyclictest0-21swapper/119:30:061
478716993310,4cyclictest8321systemd-network20:05:221
478716993310,4cyclictest8321systemd-network20:05:221
47871399332,4cyclictest498422-21unixbench_singl21:00:290
47871399332,4cyclictest498422-21unixbench_singl21:00:290
478718993225,4cyclictest311ktimers/219:35:212
478718993225,4cyclictest311ktimers/219:35:212
478718993223,5cyclictest0-21swapper/220:50:272
478718993221,8cyclictest311ktimers/220:00:142
478716993224,5cyclictest518461-21/usr/sbin/munin23:00:231
478718993124,5cyclictest311ktimers/222:50:012
478718993124,5cyclictest311ktimers/222:50:002
478718993122,5cyclictest0-21swapper/219:25:272
478716993124,4cyclictest167450irq/126-8000000.ethernet-tx121:45:261
478716993124,4cyclictest167450irq/126-8000000.ethernet-tx121:45:261
478716993122,6cyclictest0-21swapper/123:30:301
478716993122,6cyclictest0-21swapper/123:30:301
478716993122,5cyclictest490795-21grep20:15:281
478716993120,7cyclictest0-21swapper/119:35:291
478716993120,7cyclictest0-21swapper/119:35:291
47871699311,26cyclictest519744-21gzip23:05:301
478716993022,4cyclictest0-21swapper/123:35:291
478716993022,4cyclictest0-21swapper/122:25:281
478716993021,6cyclictest511589-21dropbear22:20:151
478716993021,5cyclictest0-21swapper/120:35:011
478713993021,5cyclictest0-21swapper/019:10:020
478718992921,4cyclictest0-21swapper/220:40:012
478718992918,7cyclictest0-21swapper/220:40:272
478716992918,8cyclictest0-21swapper/123:25:211
478716992823,3cyclictest501836-21uptime21:20:291
478716992820,4cyclictest0-21swapper/119:15:271
478716992819,6cyclictest0-21swapper/120:00:231
47871699281,24cyclictest0-21swapper/121:13:281
47871699275,18cyclictest22-21rcuc/120:40:021
478716992710,10cyclictest493611-21apt-get20:35:131
47871699247,10cyclictest0-21swapper/119:10:011
478716992419,3cyclictest520813-21latency_hist23:15:001
478718992112,4cyclictest0-21swapper/219:10:002
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional