You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-29 - 10:21

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #5

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.
Unexpectedly long latencies may be caused by SMIs
Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes, lowest P state: performance
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot5s.osadl.org (updated Mon Dec 29, 2025 00:44:23)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
22047992523,1cyclictest8444-21apt20:55:002
22049992322,0cyclictest0-21swapper/300:35:393
22049992321,1cyclictest4645-21munin-run23:00:013
22049992321,1cyclictest0-21swapper/322:50:013
22047992320,2cyclictest13949-21cron00:25:012
2204799230,22cyclictest23981-21apt-get20:20:362
2204799230,22cyclictest14298-21munin-run23:20:002
2204399232,20cyclictest22-21ksoftirqd/122:55:371
2204399230,22cyclictest21232-21idleruntime-cro20:15:011
22039992321,1cyclictest0-21swapper/023:00:010
22039992321,1cyclictest0-21swapper/000:10:000
2203999230,22cyclictest24282-21idleruntime-cro23:40:010
22049992220,1cyclictest4373-21perf00:05:003
22049992220,1cyclictest1267-21awk20:40:003
2204999220,22cyclictest0-21swapper/323:35:383
2204999220,21cyclictest31231-21apt-get21:40:353
2204999220,21cyclictest28467-21apt-get20:30:023
2204999220,21cyclictest26990-21apt-get23:45:353
2204999220,21cyclictest22312-21apt-get19:10:343
2204999220,21cyclictest0-21swapper/320:55:373
2204999220,21cyclictest0-21swapper/320:45:373
2204999220,21cyclictest0-21swapper/320:25:343
2204999220,21cyclictest0-21swapper/319:30:353
2204999220,21cyclictest0-21swapper/319:25:373
22047992220,1cyclictest9720-21apt-get23:10:362
22047992220,1cyclictest0-21swapper/220:10:002
2204799220,21cyclictest605-21avahi-daemon22:00:012
2204799220,21cyclictest24596-21apt-get23:40:362
2204799220,21cyclictest0-21swapper/222:20:352
2204799220,21cyclictest0-21swapper/221:20:362
2204799220,21cyclictest0-21swapper/200:15:372
2204399220,21cyclictest3963-21apt-get20:45:371
2204399220,21cyclictest25319-21apt-get22:35:331
2204399220,21cyclictest0-21swapper/121:35:361
2204399220,21cyclictest0-21swapper/121:25:351
2204399220,1cyclictest19067-21apt-get00:35:391
2204399220,0cyclictest0-21swapper/123:10:361
22039992222,0cyclictest0-21swapper/019:55:360
22039992220,1cyclictest606-21dbus-daemon21:10:010
22039992220,1cyclictest606-21dbus-daemon21:10:010
2203999220,21cyclictest4929-21apt-get23:00:360
2203999220,21cyclictest32229-21grep22:50:010
2203999220,21cyclictest14271-21turbostat.cron23:20:000
2203999220,21cyclictest0-21swapper/020:55:000
2203999220,1cyclictest21875-21sh23:35:010
2203999220,1cyclictest15421-21munin-run22:15:000
2203999220,0cyclictest0-21swapper/020:45:370
22049992121,0cyclictest6360-21apt-get20:50:393
22049992119,1cyclictest21866-21turbostat.cron23:35:013
22049992119,1cyclictest0-21swapper/322:20:003
2204999210,20cyclictest7106-21apt-get19:45:353
2204999210,20cyclictest0-21swapper/321:30:383
2204999210,20cyclictest0-21swapper/320:00:003
2204999210,20cyclictest0-21swapper/300:20:393
2204999210,1cyclictest21266-21turbostat20:15:013
2204999210,0cyclictest4671-21apt-get00:05:373
2204999210,0cyclictest24706-21apt-get19:15:353
2204999210,0cyclictest0-21swapper/323:50:033
22047992120,0cyclictest23624-21apt-get21:25:342
22047992119,1cyclictest14070-21sendmail-msp20:00:002
22047992119,1cyclictest0-21swapper/222:00:362
22047992119,1cyclictest0-21swapper/221:45:362
22047992118,2cyclictest29225-21latency_hist19:25:012
2204799210,20cyclictest16016-21apt-get21:10:372
2204799210,20cyclictest0-21swapper/220:40:362
2204799210,20cyclictest0-21swapper/220:35:332
2204799210,20cyclictest0-21swapper/220:25:342
2204799210,20cyclictest0-21swapper/219:25:372
2204799210,0cyclictest27742-21apt-get22:40:402
2204799210,0cyclictest11223-21apt-get21:00:362
2204799210,0cyclictest0-21swapper/223:30:382
22043992121,0cyclictest11885-21apt-get00:20:391
22043992121,0cyclictest0-21swapper/123:20:021
22043992120,1cyclictest22181-21apt-get23:35:381
22043992119,1cyclictest19467-21sh23:30:011
22043992119,1cyclictest17821-21perf22:20:001
22043992118,2cyclictest891-21sh21:45:001
2204399210,20cyclictest0-21swapper/120:05:381
2204399210,1cyclictest11662-21munin-run19:55:001
2204399210,1cyclictest0-21swapper/120:55:001
2204399210,0cyclictest21223-21apt-get21:20:361
2204399210,0cyclictest0-21swapper/123:50:351
2204399210,0cyclictest0-21swapper/123:40:361
2204399210,0cyclictest0-21swapper/121:30:381
2204399210,0cyclictest0-21swapper/119:25:371
2204399210,0cyclictest0-21swapper/100:00:351
22039992121,0cyclictest11223-21apt-get21:00:360
22039992121,0cyclictest0-21swapper/019:35:350
22039992121,0cyclictest0-21swapper/000:10:360
22039992119,1cyclictest0-21swapper/020:25:010
22039992118,2cyclictest607-21in:imuxsock00:00:010
2203999210,21cyclictest0-21swapper/023:10:000
2203999210,21cyclictest0-21swapper/020:55:370
2203999210,21cyclictest0-21swapper/020:35:340
2203999210,20cyclictest16766-21apt-get20:05:380
2203999210,0cyclictest0-21swapper/022:15:340
2203999210,0cyclictest0-21swapper/021:15:020
2203999210,0cyclictest0-21swapper/000:35:390
22049992020,0cyclictest7068-21apt-get00:10:363
22049992020,0cyclictest3609-21apt-get21:50:363
22049992020,0cyclictest10920-21apt-get22:05:353
22049992020,0cyclictest0-21swapper/323:00:353
22049992020,0cyclictest0-21swapper/321:05:353
22049992020,0cyclictest0-21swapper/321:05:353
22049992019,0cyclictest14982-21apt-get23:20:353
22049992019,0cyclictest0-21swapper/321:55:373
22049992018,1cyclictest8474-21apt-get22:00:363
2204999200,20cyclictest0-21swapper/323:25:363
2204999200,0cyclictest0-21swapper/323:55:373
2204999200,0cyclictest0-21swapper/321:00:363
22047992020,0cyclictest0-21swapper/222:35:332
22047992020,0cyclictest0-21swapper/221:35:362
22047992020,0cyclictest0-21swapper/221:15:352
22047992020,0cyclictest0-21swapper/219:45:352
22047992020,0cyclictest0-21swapper/200:35:392
22047992020,0cyclictest0-21swapper/200:25:352
22047992020,0cyclictest0-21swapper/200:10:362
22047992020,0cyclictest0-21swapper/200:05:372
22047992019,0cyclictest30522-21apt-get21:40:022
2204799200,20cyclictest0-21swapper/222:55:372
2204799200,20cyclictest0-21swapper/222:45:392
2204799200,0cyclictest0-21swapper/219:40:022
2204799200,0cyclictest0-21swapper/219:10:342
22043992020,0cyclictest7327-21apt-get23:05:361
22043992020,0cyclictest0-21swapper/122:45:401
22043992020,0cyclictest0-21swapper/121:10:371
22043992020,0cyclictest0-21swapper/120:40:361
22043992020,0cyclictest0-21swapper/100:25:351
22043992020,0cyclictest0-21swapper/100:05:381
22043992019,1cyclictest0-21swapper/100:10:361
22043992018,1cyclictest8474-21apt-get22:00:361
22043992018,1cyclictest20927-21sendmail-msp21:20:011
22043992017,2cyclictest26824-21munin-plugin-st19:20:001
2204399200,20cyclictest0-21swapper/122:20:351
2204399200,0cyclictest0-21swapper/120:35:341
2204399200,0cyclictest0-21swapper/119:40:361
22039992020,0cyclictest29521-21apt-get19:25:370
22039992020,0cyclictest23624-21apt-get21:25:340
22039992020,0cyclictest2274-21apt-get00:00:350
22039992020,0cyclictest0-21swapper/022:35:330
22039992020,0cyclictest0-21swapper/020:15:340
22039992020,0cyclictest0-21swapper/019:40:020
22039992019,1cyclictest31915-21apt-get19:30:350
22049991919,0cyclictest0-21swapper/321:20:363
22049991919,0cyclictest0-21swapper/321:15:353
22049991919,0cyclictest0-21swapper/300:30:373
22049991918,0cyclictest0-21swapper/319:40:363
22047991919,0cyclictest0-21swapper/223:50:352
22047991919,0cyclictest0-21swapper/222:10:362
22047991919,0cyclictest0-21swapper/221:05:362
22047991919,0cyclictest0-21swapper/221:05:362
22047991918,0cyclictest0-21swapper/220:55:372
22047991918,0cyclictest0-21swapper/219:15:342
22047991917,1cyclictest0-21swapper/223:50:012
22043991919,0cyclictest0-21swapper/122:25:351
22043991919,0cyclictest0-21swapper/122:10:351
22043991919,0cyclictest0-21swapper/119:55:361
22043991919,0cyclictest0-21swapper/119:20:341
22043991918,1cyclictest8753-21apt-get20:55:371
22043991918,1cyclictest0-21swapper/121:45:361
22043991917,1cyclictest622-21gdbus00:00:001
22039991919,0cyclictest0-21swapper/022:30:360
22039991919,0cyclictest0-21swapper/021:35:360
22039991919,0cyclictest0-21swapper/021:10:370
22049991818,0cyclictest21550-21apt-get20:15:343
22049991818,0cyclictest1203-21apt-get21:45:363
22049991817,0cyclictest0-21swapper/300:15:373
22047991818,0cyclictest0-21swapper/223:05:372
22047991818,0cyclictest0-21swapper/222:05:352
22047991817,1cyclictest22928-21apt-get22:30:362
22047991817,1cyclictest1899-21apt-get19:35:342
22047991817,1cyclictest14278-21apt-get23:20:022
22047991816,1cyclictest24270-21cron23:40:012
22047991815,2cyclictest19492-21awk23:30:012
2204799181,16cyclictest0-21swapper/200:00:352
22043991818,0cyclictest0-21swapper/122:50:361
22043991818,0cyclictest0-21swapper/122:30:361
22043991818,0cyclictest0-21swapper/120:30:361
22043991818,0cyclictest0-21swapper/120:20:361
22043991818,0cyclictest0-21swapper/119:35:341
22039991818,0cyclictest0-21swapper/023:50:020
22039991818,0cyclictest0-21swapper/023:50:010
22039991818,0cyclictest0-21swapper/022:40:400
22039991818,0cyclictest0-21swapper/021:20:360
22039991818,0cyclictest0-21swapper/000:20:390
22039991816,1cyclictest17067-21cron23:25:010
22049991717,0cyclictest0-21swapper/323:20:003
22049991717,0cyclictest0-21swapper/322:10:353
22049991717,0cyclictest0-21swapper/320:20:363
22049991717,0cyclictest0-21swapper/320:10:013
22049991716,1cyclictest0-21swapper/323:05:363
22049991716,1cyclictest0-21swapper/319:50:353
2204999170,17cyclictest0-21swapper/323:40:363
22047991717,0cyclictest0-21swapper/221:50:362
22047991717,0cyclictest0-21swapper/220:45:372
22047991717,0cyclictest0-21swapper/220:30:362
22047991717,0cyclictest0-21swapper/220:15:342
22047991716,1cyclictest0-21swapper/223:55:362
22047991715,2cyclictest22638-21grep22:30:002
22043991717,0cyclictest0-21swapper/121:00:361
22043991717,0cyclictest0-21swapper/119:30:351
2204399170,16cyclictest22-21ksoftirqd/121:52:491
22039991717,0cyclictest0-21swapper/023:10:360
22039991717,0cyclictest0-21swapper/022:05:350
22039991717,0cyclictest0-21swapper/021:45:360
22039991717,0cyclictest0-21swapper/021:40:020
22039991717,0cyclictest0-21swapper/020:25:340
22039991717,0cyclictest0-21swapper/019:10:340
22039991717,0cyclictest0-21swapper/000:25:350
22049991616,0cyclictest0-21swapper/322:40:403
22049991616,0cyclictest0-21swapper/322:20:353
22049991614,1cyclictest16447-21awk20:05:003
22047991616,0cyclictest26024-21apt-get21:30:382
22047991616,0cyclictest0-21swapper/223:00:362
2204799160,15cyclictest21265-21perf20:15:012
2204799160,15cyclictest16758-21ntp_states22:15:402
22043991616,0cyclictest9462-21apt-get00:15:371
22043991616,0cyclictest20139-21kworker/1:220:01:131
2204399160,15cyclictest0-21swapper/100:30:401
22039991616,0cyclictest0-21swapper/021:30:380
22039991616,0cyclictest0-21swapper/020:40:370
22039991616,0cyclictest0-21swapper/020:30:020
22039991616,0cyclictest0-21swapper/019:45:350
22039991616,0cyclictest0-21swapper/019:20:330
22039991616,0cyclictest0-21swapper/000:30:360
22039991616,0cyclictest0-21swapper/000:15:370
2203999160,15cyclictest0-21swapper/020:00:420
2203999160,15cyclictest0-21swapper/019:50:380
22049991515,0cyclictest0-21swapper/321:10:373
22049991515,0cyclictest0-21swapper/320:40:363
22049991515,0cyclictest0-21swapper/319:20:333
22049991514,0cyclictest28419-21apt-get21:35:363
2204799150,14cyclictest0-21swapper/200:30:392
2204799150,0cyclictest0-21swapper/219:30:352
22043991515,0cyclictest0-21swapper/120:15:341
22039991515,0cyclictest5517-21apt-get21:52:490
22039991515,0cyclictest0-21swapper/022:25:350
2203999150,1cyclictest26472-21chrt19:16:090
22049991414,0cyclictest0-21swapper/323:10:363
22049991414,0cyclictest0-21swapper/319:35:343
2204999140,14cyclictest0-21swapper/322:30:133
2204999140,14cyclictest0-21swapper/322:25:133
2204999140,0cyclictest0-21swapper/322:51:063
2204999140,0cyclictest0-21swapper/322:35:303
2204999140,0cyclictest0-21swapper/300:25:063
22047991414,0cyclictest0-21swapper/219:50:352
2204799140,14cyclictest0-21swapper/222:51:082
2204799140,0cyclictest0-21swapper/220:00:492
22043991414,0cyclictest0-21swapper/123:30:031
22043991414,0cyclictest0-21swapper/121:05:371
22043991414,0cyclictest0-21swapper/121:05:371
22043991414,0cyclictest0-21swapper/120:25:131
2204399140,14cyclictest0-21swapper/121:55:111
2204399140,0cyclictest0-21swapper/123:15:161
2204399140,0cyclictest0-21swapper/122:05:521
22039991414,0cyclictest0-21swapper/023:40:030
22039991414,0cyclictest0-21swapper/022:50:260
2203999140,14cyclictest0-21swapper/021:56:180
2203999140,0cyclictest0-21swapper/023:25:110
2203999140,0cyclictest0-21swapper/022:20:160
2203999140,0cyclictest0-21swapper/022:00:360
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional