You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-10 - 08:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Tue Mar 10, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
361301499903,41cyclictest3660263-21/usr/sbin/munin23:45:191
3613016998012,29cyclictest30-21rcuc/220:05:002
3613014996943,21cyclictest3615802-21munin-plugin-st19:25:001
361301499691,54cyclictest0-21swapper/120:35:131
361301499691,52cyclictest0-21swapper/120:50:151
361301499691,41cyclictest3642220-21kworker/u8:1+events_power_efficient22:15:121
361301499671,53cyclictest0-21swapper/121:55:141
361301499671,53cyclictest0-21swapper/100:10:121
361301499671,51cyclictest0-21swapper/121:05:151
361301699662,45cyclictest32-21ksoftirqd/223:45:192
3613014996517,40cyclictest0-21swapper/100:05:261
361301499651,50cyclictest0-21swapper/122:50:131
361301499651,50cyclictest0-21swapper/121:40:131
361301499651,50cyclictest0-21swapper/120:40:121
361301499651,50cyclictest0-21swapper/120:40:121
3613016996448,12cyclictest311ktimers/200:10:112
3613014996434,24cyclictest3669294-21grep00:35:281
361301499641,51cyclictest0-21swapper/119:45:151
361301499641,49cyclictest0-21swapper/121:10:161
361301499631,49cyclictest0-21swapper/122:10:131
3613014996216,39cyclictest3643026-21grep22:00:281
3613014996119,35cyclictest0-21swapper/100:25:281
361301499611,48cyclictest0-21swapper/120:05:111
361301499611,47cyclictest0-21swapper/121:45:141
361301499611,47cyclictest0-21swapper/121:45:141
361301499611,36cyclictest0-21swapper/120:05:011
3613016996011,19cyclictest3617477-21apt-get19:35:012
361301499605,35cyclictest2181224-1kworker/1:2H+kblockd19:35:041
361301499605,35cyclictest2181224-1kworker/1:2H+kblockd19:35:041
3613014996023,32cyclictest0-21swapper/122:20:201
361301499601,46cyclictest0-21swapper/120:30:141
3613014995928,26cyclictest0-21swapper/100:30:281
3613014995928,26cyclictest0-21swapper/100:30:281
361301499591,50cyclictest3613490-21/usr/sbin/munin19:10:281
361301499591,45cyclictest0-21swapper/120:15:161
361301499591,45cyclictest0-21swapper/120:15:161
361301699581,48cyclictest0-21swapper/222:10:012
361301499582,47cyclictest3657724-21apt-get23:30:151
361301499581,47cyclictest0-21swapper/100:15:141
361301499581,46cyclictest0-21swapper/100:00:121
361301499581,44cyclictest0-21swapper/119:15:111
361301499581,42cyclictest0-21swapper/121:20:131
361301499581,42cyclictest0-21swapper/121:20:131
361301499571,49cyclictest3631980-21/usr/sbin/munin20:55:281
361301499571,47cyclictest3618695-21/usr/sbin/munin19:40:171
361301499562,47cyclictest3666544-21/usr/sbin/munin00:20:251
361301499562,46cyclictest3620606-21memory19:50:261
361301499561,48cyclictest3648687-21/usr/sbin/munin22:35:271
361301499561,48cyclictest3637720-21/usr/sbin/munin21:30:261
361301499561,48cyclictest0-21swapper/120:20:121
361301499561,47cyclictest3662558-21/usr/sbin/munin23:55:291
361301499561,47cyclictest3654346-21apt-get23:10:171
361301499561,47cyclictest3652971-21/usr/sbin/munin23:00:261
361301499561,47cyclictest0-21swapper/120:10:151
361301499552,46cyclictest3635151-21/usr/sbin/munin21:15:281
361301499552,45cyclictest3648027-21/usr/sbin/munin22:30:281
361301499551,47cyclictest3653823-21/usr/sbin/munin23:05:261
361301499551,47cyclictest3617296-21/usr/sbin/munin19:30:261
361301499542,45cyclictest3650134-21/usr/sbin/munin22:45:131
361301499542,45cyclictest3650134-21/usr/sbin/munin22:45:131
361301499542,44cyclictest3640749-21apt-get21:50:131
361301499542,43cyclictest3638327-21/usr/sbin/munin21:35:221
361301499541,45cyclictest3636554-21/usr/sbin/munin21:25:201
361301499541,45cyclictest0-21swapper/123:25:121
361301499532,44cyclictest3659718-21/usr/sbin/munin23:40:251
361301499532,41cyclictest3616002-21apt-get19:25:121
361301499531,44cyclictest3659073-21/usr/sbin/munin23:35:261
361301499531,44cyclictest3655185-21apt-get23:15:141
361301499531,44cyclictest3626674-21/usr/sbin/munin20:25:291
361301499531,39cyclictest0-21swapper/123:50:131
361301499531,39cyclictest0-21swapper/123:50:121
361301399532,4cyclictest3625069-21grep20:15:320
361301399532,4cyclictest3625069-21grep20:15:320
361301499521,44cyclictest3651863-21/usr/sbin/munin22:55:161
361301499521,44cyclictest3647103-21/usr/sbin/munin22:25:271
361301499521,44cyclictest3647103-21/usr/sbin/munin22:25:261
361301499521,44cyclictest3630050-21/usr/sbin/munin20:45:271
361301499521,42cyclictest3643288-21apt-get22:05:111
361301499512,39cyclictest3649205-21apt-get22:40:131
361301499511,44cyclictest0-21swapper/121:00:221
361301499501,42cyclictest3621392-21/usr/sbin/munin19:55:231
3613013995045,4cyclictest0-21swapper/022:30:150
361301499491,42cyclictest3656669-21sshd23:23:181
361301399492,4cyclictest3656130-21fschecks_count23:20:200
361301399474,6cyclictest3667749-21sort00:30:010
3613013994738,6cyclictest0-21swapper/021:45:280
3613013994738,6cyclictest0-21swapper/021:45:270
3613013994736,6cyclictest0-21swapper/023:00:000
361301399471,42cyclictest3625712-21phc2sys20:20:260
361301399471,16cyclictest0-21swapper/019:55:010
3613013994710,15cyclictest3613950-21ptp4l19:15:020
3613013994620,4cyclictest3640803-21ssh21:50:160
3613016994511,10cyclictest32-21ksoftirqd/223:10:012
361301499452,40cyclictest3613023-21grep19:10:011
3613013994531,9cyclictest3614951-21sendmail19:20:000
3613016994430,8cyclictest0-21swapper/221:55:282
3613016994421,12cyclictest311ktimers/222:55:112
3613016994415,15cyclictest311ktimers/220:50:002
3613013994436,4cyclictest167350irq/118-8000000.ethernet-tx022:35:130
3613013994429,11cyclictest0-21swapper/022:45:280
3613013994429,11cyclictest0-21swapper/022:45:280
3613016994329,9cyclictest0-21swapper/220:10:282
3613013994337,4cyclictest0-21swapper/020:10:110
3613013994336,4cyclictest167350irq/118-8000000.ethernet-tx023:45:210
3613013994327,14cyclictest167350irq/118-8000000.ethernet-tx000:30:190
3613013994327,14cyclictest167350irq/118-8000000.ethernet-tx000:30:190
361301399431,5cyclictest0-21swapper/019:25:120
361301399431,39cyclictest3645127-21lsblk22:15:200
3613016994227,8cyclictest0-21swapper/222:10:282
3613016994227,10cyclictest0-21swapper/221:05:302
3613013994231,6cyclictest3661674-21grep23:50:280
3613013994231,6cyclictest3661674-21grep23:50:280
361301399422,4cyclictest3642710-21irqstats22:00:230
361301399421,38cyclictest3662865-21dropbear00:00:160
3613016994127,9cyclictest0-21swapper/223:20:222
3613016994127,8cyclictest0-21swapper/221:10:302
3613016994127,7cyclictest0-21swapper/220:35:302
3613013994135,3cyclictest167350irq/118-8000000.ethernet-tx022:25:120
3613013994135,3cyclictest167350irq/118-8000000.ethernet-tx022:25:120
3613013994134,4cyclictest20650irq/252-8000000.ethernet21:10:250
3613013994133,5cyclictest3658627-21df_inode23:35:150
3613013994131,6cyclictest0-21swapper/000:40:000
3613013994124,15cyclictest0-21swapper/022:50:220
3613016994033,4cyclictest3621772-21kworker/u8:0-events_freezable_power_20:15:252
3613016994033,4cyclictest3621772-21kworker/u8:0-events_freezable_power_20:15:252
3613016994030,5cyclictest30-21rcuc/223:55:192
3613016994026,9cyclictest0-21swapper/222:25:272
3613016994026,9cyclictest0-21swapper/222:25:272
3613016994026,7cyclictest0-21swapper/221:45:302
3613016994026,7cyclictest0-21swapper/221:45:302
3613013994033,4cyclictest0-21swapper/020:00:110
3613013994030,6cyclictest0-21swapper/022:10:170
3613013994029,7cyclictest0-21swapper/022:45:000
3613013994021,10cyclictest0-21swapper/021:35:010
361301399401,5cyclictest3623184-21/usr/sbin/munin20:05:260
361301399401,36cyclictest0-21swapper/019:35:250
361301399401,36cyclictest0-21swapper/019:35:250
361301399401,2cyclictest0-21swapper/023:15:010
3613016993929,6cyclictest3626778-21grep20:25:302
3613016993926,5cyclictest0-21swapper/223:50:282
3613016993926,5cyclictest0-21swapper/223:50:282
3613013993934,3cyclictest0-21swapper/020:45:160
3613013993933,4cyclictest3628568-21apt-get20:40:000
3613013993932,5cyclictest0-21swapper/021:35:240
3613013993931,5cyclictest131ktimers/000:20:220
3613013993931,4cyclictest19750irq/27-20000000.i2c21:00:170
3613013993927,7cyclictest0-21swapper/020:25:200
3613013993926,9cyclictest3635402-21sendmail21:20:000
361301399392,4cyclictest3654049-21tail23:05:290
3613013993922,15cyclictest0-21swapper/023:25:200
361301399391,4cyclictest0-21swapper/023:30:230
361301399391,3cyclictest3636448-21apt-get21:25:110
361301399391,3cyclictest3631374-21apt-get20:55:120
361301399391,36cyclictest0-21swapper/023:55:150
361301399391,36cyclictest0-21swapper/022:20:130
3613016993831,4cyclictest0-21swapper/221:15:272
3613016993830,5cyclictest0-21swapper/222:15:122
3613016993829,6cyclictest311ktimers/222:40:192
3613016993828,6cyclictest250-21jbd2/mmcblk1p2-822:45:052
3613016993828,6cyclictest250-21jbd2/mmcblk1p2-822:45:052
3613016993826,6cyclictest0-21swapper/221:00:232
3613016993820,11cyclictest0-21swapper/223:10:282
361301699381,28cyclictest3626856-21kworker/u8:4+rpciod21:21:162
361301699381,28cyclictest3626856-21kworker/u8:4+rpciod21:21:162
3613013993822,13cyclictest0-21swapper/019:45:000
361301399381,5cyclictest3633677-21unixbench_singl21:05:300
361301399381,35cyclictest0-21swapper/000:05:110
3613016993729,4cyclictest311ktimers/221:40:002
3613016993727,7cyclictest311ktimers/223:00:292
3613016993726,8cyclictest311ktimers/220:55:012
3613016993726,7cyclictest0-21swapper/220:55:282
3613016993726,5cyclictest0-21swapper/200:20:202
3613016993723,10cyclictest0-21swapper/200:15:282
3613016993721,9cyclictest30-21rcuc/219:20:202
3613013993733,2cyclictest0-21swapper/021:40:110
3613013993732,3cyclictest0-21swapper/022:05:270
3613013993730,4cyclictest0-21swapper/019:55:200
3613013993729,5cyclictest0-21swapper/023:16:250
3613013993723,12cyclictest3616907-21/usr/sbin/munin19:30:170
3613013993723,10cyclictest0-21swapper/021:55:260
361301399372,2cyclictest0-21swapper/019:10:000
361301399371,34cyclictest0-21swapper/023:40:080
361301399371,34cyclictest0-21swapper/000:10:150
3613016993631,3cyclictest14-21rcu_preempt21:25:252
3613016993628,5cyclictest311ktimers/220:20:232
3613016993627,5cyclictest0-21swapper/221:40:172
3613013993629,4cyclictest20850irq/208-8000000.ethernet23:00:180
361301399362,2cyclictest0-21swapper/020:45:010
361301399362,2cyclictest0-21swapper/020:45:010
361301399361,3cyclictest0-21swapper/020:30:130
361301399361,33cyclictest0-21swapper/000:15:210
3613016993525,7cyclictest3659421-21/usr/sbin/munin23:40:182
3613016993522,8cyclictest0-21swapper/223:30:282
3613016993520,10cyclictest311ktimers/223:25:192
361301699351,28cyclictest1660-21snmpd19:15:062
3613013993528,4cyclictest20850irq/208-8000000.ethernet19:20:150
361301399351,32cyclictest0-21swapper/020:52:420
3613016993427,5cyclictest311ktimers/221:50:242
3613016993425,6cyclictest311ktimers/220:30:232
3613016993425,6cyclictest311ktimers/219:50:292
3613016993425,5cyclictest0-21swapper/200:35:282
3613016993424,7cyclictest311ktimers/219:45:122
3613016993422,8cyclictest0-21swapper/220:05:192
361301399341,31cyclictest0-21swapper/021:23:280
361301399341,31cyclictest0-21swapper/021:23:280
3613016993323,7cyclictest3621141-21/usr/sbin/munin19:55:232
3613016993323,6cyclictest0-21swapper/223:40:012
361301699326,18cyclictest3613835-21munin-node19:15:012
3613016993222,5cyclictest14-21rcu_preempt22:30:192
3613016993221,7cyclictest3668384-21grep00:30:282
3613016993221,7cyclictest3668384-21grep00:30:282
3613016993221,7cyclictest311ktimers/222:00:202
361301699321,25cyclictest0-21swapper/222:20:162
3613016993125,3cyclictest14-21rcu_preempt00:25:162
3613016993123,5cyclictest0-21swapper/219:35:282
3613016993123,5cyclictest0-21swapper/219:35:282
3613016993121,7cyclictest311ktimers/200:00:122
3613016993121,6cyclictest30-21rcuc/200:05:262
3613016993119,7cyclictest3655761-21grep23:15:282
361301399312,26cyclictest0-21swapper/019:45:180
3613016993024,4cyclictest51-21kcompactd019:40:162
3613016993022,5cyclictest30-21rcuc/219:25:122
3613016993020,6cyclictest311ktimers/221:30:242
3613016992920,6cyclictest311ktimers/222:50:272
3613016992918,7cyclictest30-21rcuc/222:35:232
3613016992817,8cyclictest30-21rcuc/220:40:152
3613016992817,8cyclictest30-21rcuc/220:40:142
3613016992116,3cyclictest30-21rcuc/219:10:012
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional