You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-17 - 10:45

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Aug 17, 2026 00:44:52)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
2279229997248,14cyclictest22-21rcuc/119:10:011
2279229997230,3cyclictest0-21swapper/121:00:011
2279229997012,32cyclictest2298357-21/usr/sbin/munin21:00:211
2279229997012,32cyclictest2298357-21/usr/sbin/munin21:00:211
2279230996713,10cyclictest0-21swapper/222:55:012
2279230996621,36cyclictest0-21swapper/200:20:312
2279230996618,8cyclictest0-21swapper/219:35:262
2279230996230,24cyclictest0-21swapper/219:30:282
2279230996230,24cyclictest0-21swapper/219:30:282
2279230996228,30cyclictest1660-21snmpd21:55:252
2279229996248,10cyclictest1283-21cron20:15:011
2279230996140,18cyclictest2320266-21munin-run23:09:592
227923099612,23cyclictest0-21swapper/221:40:012
2279229996014,20cyclictest2295821-21/usr/sbin/munin20:45:201
227922699601,4cyclictest0-21swapper/019:45:130
227922699601,4cyclictest0-21swapper/019:45:130
2279230995823,26cyclictest0-21swapper/220:25:272
2279230995727,25cyclictest2311645-21unixbench_multi22:15:282
2279230995723,31cyclictest2287823-21grep19:55:292
2279230995722,30cyclictest0-21swapper/222:25:212
2279230995720,5cyclictest0-21swapper/222:35:202
2279230995720,31cyclictest0-21swapper/223:35:302
2279230995623,30cyclictest2292312-21gpg-connect-age20:25:002
2279230995621,4cyclictest0-21swapper/200:35:302
2279229995611,18cyclictest231ktimers/119:35:011
2279229995611,18cyclictest231ktimers/119:35:011
2279230995522,5cyclictest0-21swapper/223:20:182
2279230995521,31cyclictest2289522-21grep20:05:282
2279230995423,27cyclictest0-21swapper/200:05:292
2279226995425,26cyclictest0-21swapper/022:10:260
227922699542,49cyclictest2326172-21unixbench_multi23:40:280
227923099533,4cyclictest2281127-21users19:15:292
2279230995327,22cyclictest2329640-21cron00:05:002
2279230995319,4cyclictest0-21swapper/220:40:222
2279230995218,6cyclictest0-21swapper/223:00:222
2279230995217,4cyclictest0-21swapper/223:10:202
2279230995217,4cyclictest0-21swapper/223:10:202
2279230995214,7cyclictest0-21swapper/219:45:312
2279230995214,7cyclictest0-21swapper/219:45:302
2279226995245,4cyclictest167350irq/118-8000000.ethernet-tx022:05:240
2279230995139,8cyclictest2285395-21munin-plugin-st19:45:002
2279230995119,7cyclictest311ktimers/220:15:232
2279229995129,15cyclictest231ktimers/122:30:131
2279229995129,15cyclictest231ktimers/122:30:131
2279226995035,10cyclictest0-21swapper/023:00:310
2279230994921,5cyclictest2309410-21/usr/sbin/munin22:05:232
2279230994917,4cyclictest0-21swapper/221:45:202
2279226994941,4cyclictest167350irq/118-8000000.ethernet-tx021:20:000
2279226994938,5cyclictest2322742-21sed23:20:260
2279230994821,3cyclictest47-21kauditd22:40:022
2279229994840,4cyclictest2327112-21munin-plugin-st23:50:001
2279229994838,6cyclictest231ktimers/122:10:121
2279230994720,22cyclictest0-21swapper/221:30:222
2279230994717,6cyclictest311ktimers/221:05:112
227922699477,2cyclictest0-21swapper/019:40:010
2279226994742,4cyclictest131ktimers/021:55:170
2279226994740,4cyclictest167350irq/118-8000000.ethernet-tx021:30:200
2279226994740,4cyclictest167350irq/118-8000000.ethernet-tx021:25:240
2279226994736,8cyclictest0-21swapper/020:45:290
2279226994715,29cyclictest2334483-21ptp4l00:30:300
2279226994715,29cyclictest2334483-21ptp4l00:30:300
227923099462,26cyclictest0-21swapper/200:29:172
2279230994622,4cyclictest2316736-21head22:45:302
2279230994620,21cyclictest0-21swapper/222:20:212
227922999468,8cyclictest0-21swapper/123:45:011
227922999466,11cyclictest22-21rcuc/123:05:011
2279226994638,4cyclictest167350irq/118-8000000.ethernet-tx019:20:190
2279226994636,5cyclictest0-21swapper/021:00:290
2279226994636,5cyclictest0-21swapper/021:00:280
227922699462,4cyclictest2318589-21sendmail-msp23:00:000
227922699462,4cyclictest2318589-21sendmail-msp23:00:000
227922699462,42cyclictest0-21swapper/021:24:590
227922699462,41cyclictest2315101-21cron22:40:000
2279230994518,5cyclictest311ktimers/221:15:232
2279230994516,4cyclictest0-21swapper/221:10:232
227922699452,40cyclictest2332960-21grep00:20:300
227922699452,15cyclictest1660-21snmpd23:35:000
227923099448,11cyclictest2306875-21/usr/sbin/munin21:50:192
227923099448,11cyclictest2306875-21/usr/sbin/munin21:50:192
2279230994425,15cyclictest0-21swapper/223:15:302
2279229994436,5cyclictest0-21swapper/119:20:011
2279226994413,24cyclictest0-21swapper/023:30:010
2279230994336,4cyclictest2332170-21munin-plugin-st00:20:012
227922999436,18cyclictest231ktimers/120:00:021
2279229994332,8cyclictest0-21swapper/119:20:311
2279229994327,11cyclictest0-21swapper/119:45:211
2279229994327,11cyclictest0-21swapper/119:45:211
2279226994335,5cyclictest20850irq/208-8000000.ethernet22:54:590
2279229994231,6cyclictest231ktimers/100:00:311
2279229994231,5cyclictest0-21swapper/120:40:281
2279229994230,7cyclictest231ktimers/121:20:281
2279229994225,12cyclictest231ktimers/121:30:141
2279229994222,11cyclictest231ktimers/122:35:141
2279226994216,24cyclictest0-21swapper/020:10:270
227922699421,38cyclictest0-21swapper/019:15:030
2279229994130,5cyclictest0-21swapper/119:15:011
2279226994133,5cyclictest0-21swapper/019:30:290
2279226994133,5cyclictest0-21swapper/019:30:290
2279226994133,4cyclictest167350irq/118-8000000.ethernet-tx023:35:180
2279226994129,8cyclictest2282546-21phc2sys19:25:270
227922699411,5cyclictest2299270-21diskstats21:05:200
227922699411,38cyclictest0-21swapper/019:10:210
2279230994032,4cyclictest167550irq/134-8000000.ethernet-tx221:40:282
2279230994032,4cyclictest167550irq/134-8000000.ethernet-tx221:40:282
2279230994013,10cyclictest2317929-21/usr/sbin/munin22:55:222
2279230994013,10cyclictest2317929-21/usr/sbin/munin22:55:212
2279229994031,4cyclictest0-21swapper/122:05:291
2279229994024,10cyclictest0-21swapper/120:15:291
227922999401,4cyclictest0-21swapper/119:30:011
2279229994012,22cyclictest24-21ksoftirqd/119:45:011
227922699406,2cyclictest0-21swapper/022:47:590
2279226994034,2cyclictest0-21swapper/023:15:010
2279226994034,2cyclictest0-21swapper/023:15:010
2279226994030,7cyclictest2305749-21munin-plugin-st21:45:010
2279226994030,7cyclictest2305749-21munin-plugin-st21:45:000
227922699401,4cyclictest2320140-21/usr/sbin/munin23:05:260
227922699401,37cyclictest0-21swapper/023:50:200
227922699401,37cyclictest0-21swapper/023:50:200
227922699401,37cyclictest0-21swapper/000:00:270
2279226994013,24cyclictest15-21rcuc/020:55:200
227922999394,17cyclictest2306596-21apt-key21:50:001
2279229993932,4cyclictest231ktimers/123:15:131
2279229993930,6cyclictest231ktimers/123:05:261
2279229993929,6cyclictest2297303-21munin-plugin-st20:55:011
2279229993926,9cyclictest2293041-21grep20:25:301
2279229993926,8cyclictest0-21swapper/100:35:301
2279229993922,9cyclictest0-21swapper/100:10:271
227922999391,2cyclictest0-21swapper/120:40:011
2279226993933,4cyclictest0-21swapper/000:25:170
2279226993932,4cyclictest0-21swapper/022:15:150
227922699392,4cyclictest0-21swapper/020:15:270
227922699391,36cyclictest0-21swapper/023:55:170
2279229993829,5cyclictest0-21swapper/100:15:301
2279229993827,7cyclictest2322740-21grep23:20:261
2279229993827,7cyclictest2292098-21grep20:20:291
2279229993825,7cyclictest22-21rcuc/121:35:211
2279229993820,2cyclictest0-21swapper/120:05:021
2279226993832,4cyclictest0-21swapper/020:40:130
2279226993832,4cyclictest0-21swapper/000:35:300
2279226993831,4cyclictest0-21swapper/020:30:210
2279226993830,4cyclictest167350irq/118-8000000.ethernet-tx020:25:010
227922699382,8cyclictest2307521-21latency_hist21:55:010
227922699382,8cyclictest2307521-21latency_hist21:55:010
2279226993827,6cyclictest2289791-21latency_hist20:10:010
227922699381,3cyclictest2331823-21meminfo00:15:250
227922699381,3cyclictest2311950-21apt-get22:20:130
227922699381,35cyclictest0-21swapper/020:00:240
2279229993726,7cyclictest14-21rcu_preempt21:40:171
2279229993726,7cyclictest14-21rcu_preempt21:40:171
2279229993724,8cyclictest0-21swapper/119:35:261
2279229993723,10cyclictest0-21swapper/122:20:281
2279229993722,10cyclictest0-21swapper/122:45:281
2279226993730,4cyclictest19750irq/27-20000000.i2c21:50:010
2279226993730,4cyclictest0-21swapper/019:55:240
2279226993728,4cyclictest0-21swapper/022:40:280
2279226993726,8cyclictest0-21swapper/022:00:270
2279226993721,14cyclictest0-21swapper/023:18:030
2279230993627,4cyclictest2302307-21head21:20:292
2279230993621,9cyclictest2328794-21munin-plugin-st00:00:002
227922999365,25cyclictest22-21rcuc/122:00:001
2279229993625,7cyclictest22-21rcuc/122:55:011
2279229993625,7cyclictest0-21swapper/123:50:291
2279229993625,7cyclictest0-21swapper/123:50:281
2279229993614,15cyclictest231ktimers/123:10:131
2279229993614,15cyclictest231ktimers/123:10:131
2279229993611,13cyclictest231ktimers/100:30:181
2279229993611,13cyclictest231ktimers/100:30:171
227922699361,3cyclictest0-21swapper/020:35:120
227922699361,33cyclictest0-21swapper/022:25:180
227922699361,33cyclictest0-21swapper/020:54:090
227922699361,33cyclictest0-21swapper/000:10:250
227923099354,23cyclictest311ktimers/219:25:202
227923099353,4cyclictest0-21swapper/220:35:292
2279230993524,7cyclictest0-21swapper/219:50:292
2279230993523,8cyclictest0-21swapper/223:25:342
2279229993528,4cyclictest231ktimers/100:25:201
2279229993527,4cyclictest2324641-21latency_hist23:35:011
2279229993520,8cyclictest0-21swapper/119:55:001
2279226993530,2cyclictest0-21swapper/021:15:010
2279226993529,4cyclictest20850irq/208-8000000.ethernet19:50:160
2279226993529,4cyclictest0-21swapper/021:35:290
2279226993528,4cyclictest0-21swapper/020:25:150
2279226993521,10cyclictest0-21swapper/019:10:010
227922699351,32cyclictest0-21swapper/023:47:440
227922999347,13cyclictest2315324-21/usr/sbin/munin22:40:181
227922999344,18cyclictest24-21ksoftirqd/121:55:011
227922999344,18cyclictest24-21ksoftirqd/121:55:011
2279229993426,4cyclictest2318487-21unixbench_multi22:55:311
2279229993426,4cyclictest2318487-21unixbench_multi22:55:311
2279229993425,4cyclictest2313326-21grep22:25:311
2279230993327,4cyclictest2298357-21/usr/sbin/munin21:00:212
2279230993327,4cyclictest2298357-21/usr/sbin/munin21:00:212
2279229993324,5cyclictest0-21swapper/123:35:301
2279229993324,5cyclictest0-21swapper/122:00:271
2279226993317,14cyclictest0-21swapper/000:05:090
2279230993223,7cyclictest2293282-21/usr/sbin/munin20:30:252
2279230993222,7cyclictest1660-21snmpd20:58:272
227922999324,12cyclictest2323004-21/usr/sbin/munin23:25:221
2279229993224,4cyclictest0-21swapper/121:25:311
227923099317,2cyclictest0-21swapper/222:05:012
227923099312,3cyclictest0-21swapper/223:55:012
227923099312,3cyclictest0-21swapper/223:55:012
2279230993123,4cyclictest0-21swapper/223:50:002
2279229993122,6cyclictest2301526-21sendmail21:20:001
2279229993121,7cyclictest1660-21snmpd21:10:141
2279229993121,6cyclictest0-21swapper/100:05:291
227922999311,2cyclictest2299199-21apt-get21:05:161
2279226993125,4cyclictest20850irq/208-8000000.ethernet19:40:180
2279230993024,4cyclictest167550irq/134-8000000.ethernet-tx223:30:292
2279230993022,6cyclictest2279389-21/usr/sbin/munin19:10:242
2279229993023,4cyclictest22-21rcuc/120:05:291
2279226993022,4cyclictest0-21swapper/022:30:210
2279226993022,4cyclictest0-21swapper/022:30:210
2279230992922,3cyclictest0-21swapper/220:45:282
2279230992921,5cyclictest0-21swapper/220:10:202
2279230992919,7cyclictest0-21swapper/222:30:202
2279230992919,7cyclictest0-21swapper/222:30:202
2279230992919,7cyclictest0-21swapper/200:30:262
2279230992919,7cyclictest0-21swapper/200:30:262
227922999291,2cyclictest0-21swapper/100:00:001
2279230992820,6cyclictest2282006-21sshd19:24:282
2279229992821,5cyclictest205-21ptp022:15:211
2279229992817,7cyclictest22-21rcuc/120:35:001
227922999281,3cyclictest0-21swapper/100:25:021
2279230992715,8cyclictest0-21swapper/221:25:322
227923099271,24cyclictest0-21swapper/222:10:142
227923099261,2cyclictest0-21swapper/200:10:192
2279230992515,7cyclictest0-21swapper/220:00:232
227923099251,3cyclictest0-21swapper/223:42:282
227923099244,12cyclictest2296660-21/usr/sbin/munin20:50:202
2279230992013,5cyclictest311ktimers/219:10:022
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional