You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-04-15 - 11:07

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Wed Apr 15, 2026 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
189693499125108,13cyclictest1896925-21cyclictest19:55:012
189693199861,2cyclictest0-21swapper/023:55:010
189693199735,64cyclictest0-21swapper/020:15:010
189693199735,64cyclictest0-21swapper/020:15:010
189693199714,59cyclictest0-21swapper/000:20:200
189693499701,22cyclictest1950297-21/usr/sbin/munin00:20:192
189693199703,27cyclictest0-21swapper/023:50:000
189693199702,4cyclictest1936206-21/usr/sbin/munin22:55:270
1896931996846,18cyclictest1905811-21sendmail20:00:000
1896931996846,18cyclictest1905811-21sendmail20:00:000
189693199666,36cyclictest0-21swapper/022:10:020
1896931996436,23cyclictest20850irq/208-8000000.ethernet00:00:010
189693199642,6cyclictest1902553-21/usr/sbin/munin19:40:250
189693199632,4cyclictest1920726-21irqstats21:25:230
189693199631,3cyclictest0-21swapper/022:45:300
189693199621,59cyclictest0-21swapper/000:15:020
189693199621,3cyclictest0-21swapper/022:40:010
1896934996151,5cyclictest1897887-21latency_hist19:15:012
1896934996151,5cyclictest1897887-21latency_hist19:15:012
189693199612,3cyclictest1936681-21diskstats23:00:190
1896931996041,15cyclictest20650irq/252-8000000.ethernet21:40:270
189693199602,4cyclictest1907251-21meminfo20:05:240
1896931996024,32cyclictest20650irq/252-8000000.ethernet23:30:000
189693199601,4cyclictest1914723-21perl20:50:210
189693199601,4cyclictest1914723-21perl20:50:210
189693199593,52cyclictest0-21swapper/023:35:250
1896931995933,22cyclictest0-21swapper/019:50:010
189693199592,4cyclictest1928221-21diskstats22:10:160
189693199592,4cyclictest1928221-21diskstats22:10:160
1896931995921,34cyclictest20650irq/252-8000000.ethernet20:55:270
189693199591,3cyclictest0-21swapper/023:05:270
189693199591,3cyclictest0-21swapper/019:25:210
1896932995810,15cyclictest1921305-21/usr/sbin/munin21:30:211
1896932995810,15cyclictest1921305-21/usr/sbin/munin21:30:211
1896931995826,27cyclictest0-21swapper/021:45:290
189693199582,4cyclictest1926605-21cat22:00:220
189693199581,4cyclictest1940822-21sed23:25:010
189693199581,4cyclictest1906075-21df20:00:150
189693199571,49cyclictest1933960-21latency_hist22:45:000
189693299563,25cyclictest24-21ksoftirqd/119:35:061
189693199562,50cyclictest1922147-21apt-get21:35:160
1896931995524,27cyclictest0-21swapper/019:10:250
1896931995524,27cyclictest0-21swapper/019:10:240
1896931995523,28cyclictest20650irq/252-8000000.ethernet22:20:250
189693199551,51cyclictest1931688-21sh22:30:210
1896932995439,9cyclictest1910069-21grep20:20:281
189693199541,3cyclictest1951397-21irqstats00:25:230
189693199541,3cyclictest1929657-21grep22:20:000
189693199540,2cyclictest1924684-21apt-get21:50:110
1896931995328,23cyclictest20850irq/208-8000000.ethernet20:45:260
1896931995316,33cyclictest0-21swapper/020:40:300
1896931995313,35cyclictest0-21swapper/021:30:300
1896931995313,35cyclictest0-21swapper/021:30:300
1896932995238,7cyclictest231ktimers/120:45:011
189693299523,20cyclictest24-21ksoftirqd/120:00:011
189693299523,20cyclictest24-21ksoftirqd/120:00:011
1896931995245,5cyclictest1931329-21munin-plugin-st22:30:000
189693199523,43cyclictest1952527-21grep00:30:280
1896931995227,21cyclictest20850irq/208-8000000.ethernet21:05:130
189693199521,5cyclictest1901231-21mailstats19:30:270
189693199521,4cyclictest0-21swapper/023:10:160
1896934995142,6cyclictest1900511-21grep19:25:292
189693199515,37cyclictest0-21swapper/000:05:010
1896931995143,4cyclictest0-21swapper/020:35:300
1896931995127,20cyclictest167350irq/118-8000000.ethernet-tx021:10:180
1896931995125,23cyclictest1942336-21grep23:30:290
189693199512,45cyclictest1952832-21apt-get00:35:140
1896931995117,29cyclictest0-21swapper/000:15:290
189693199511,4cyclictest0-21swapper/020:25:250
189693199511,3cyclictest1925570-21/usr/sbin/munin21:55:160
1896934995042,4cyclictest1903194-21munin-plugin-st19:45:002
189693199502,6cyclictest1918831-21df_inode21:15:190
1896931995025,21cyclictest20850irq/208-8000000.ethernet00:05:300
1896931995025,20cyclictest0-21swapper/019:20:260
1896931995020,26cyclictest20650irq/252-8000000.ethernet20:30:100
189693199501,7cyclictest1920106-21cut21:20:270
1896931995016,29cyclictest0-21swapper/021:00:260
189693199501,4cyclictest1943521-21df_inode23:40:170
189693199501,4cyclictest1943521-21df_inode23:40:170
1896932994943,4cyclictest231ktimers/123:20:191
189693199491,8cyclictest1909192-21/usr/sbin/munin20:15:290
189693199491,3cyclictest0-21swapper/020:20:230
1896932994837,6cyclictest0-21swapper/120:35:001
189693199481,8cyclictest1934968-21/usr/sbin/munin22:50:170
189693199481,8cyclictest1934968-21/usr/sbin/munin22:50:170
189693199481,4cyclictest1902001-21awk19:35:260
189693199481,43cyclictest1660-21snmpd23:15:210
1896934994738,5cyclictest1935551-21munin-plugin-st22:55:002
1896934994738,5cyclictest1935551-21munin-plugin-st22:55:002
1896932994736,6cyclictest0-21swapper/121:25:281
189693199473,40cyclictest1898015-21grep19:15:030
189693199472,6cyclictest1904859-21grep19:50:270
1896932994637,5cyclictest1934701-21cron22:50:001
1896934994523,15cyclictest311ktimers/221:40:112
1896934994436,4cyclictest14-21rcu_preempt23:55:242
1896934994427,12cyclictest311ktimers/221:00:152
1896934994414,22cyclictest1927844-21kworker/u8:3-events_freezable_power_22:31:182
189693499436,32cyclictest32-21ksoftirqd/221:15:212
1896934994320,13cyclictest0-21swapper/220:45:222
1896932994333,8cyclictest231ktimers/120:55:011
1896932994333,8cyclictest231ktimers/120:55:011
1896932994329,9cyclictest0-21swapper/123:25:211
1896932994328,11cyclictest0-21swapper/122:10:261
1896932994328,11cyclictest0-21swapper/122:10:261
1896932994327,7cyclictest0-21swapper/122:35:281
1896931994311,28cyclictest0-21swapper/019:10:000
1896934994227,9cyclictest1916029-21sendmail21:00:002
1896934994227,10cyclictest0-21swapper/221:10:222
1896932994231,7cyclictest0-21swapper/120:45:301
1896932994230,8cyclictest1283-21cron23:05:001
1896932994227,10cyclictest0-21swapper/119:45:261
1896932994227,10cyclictest0-21swapper/119:40:291
1896934994130,7cyclictest1921837-21grep21:30:302
1896934994130,7cyclictest1921837-21grep21:30:302
1896934994128,10cyclictest0-21swapper/222:40:002
1896934994118,12cyclictest311ktimers/200:25:142
1896932994131,5cyclictest0-21swapper/123:15:311
1896932994127,8cyclictest0-21swapper/123:40:001
1896932994123,10cyclictest0-21swapper/122:50:291
1896932994123,10cyclictest0-21swapper/122:50:291
189693499409,15cyclictest1945129-21/usr/sbin/munin23:50:162
1896934994033,3cyclictest1902337-21latency_hist19:40:002
1896934994026,9cyclictest0-21swapper/200:00:292
1896934994025,11cyclictest311ktimers/221:25:112
1896934994017,12cyclictest311ktimers/223:20:122
1896934993931,4cyclictest1924177-21phc2sys21:45:262
1896934993925,6cyclictest0-21swapper/200:15:002
1896934993920,13cyclictest311ktimers/223:25:122
1896932993931,5cyclictest167450irq/126-8000000.ethernet-tx100:29:151
1896932993930,5cyclictest1949186-21grep00:10:291
1896932993929,7cyclictest231ktimers/123:55:271
1896932993927,7cyclictest0-21swapper/100:05:021
1896932993912,10cyclictest24-21ksoftirqd/123:55:011
1896932993831,5cyclictest231ktimers/119:15:041
1896932993828,6cyclictest0-21swapper/119:20:281
1896932993822,7cyclictest0-21swapper/119:30:281
1896934993729,4cyclictest0-21swapper/222:40:292
189693299377,24cyclictest0-21swapper/121:15:181
189693299375,6cyclictest0-21swapper/120:30:011
189693299373,28cyclictest0-21swapper/121:45:191
1896932993728,5cyclictest0-21swapper/119:10:261
1896932993728,5cyclictest0-21swapper/119:10:261
1896932993726,7cyclictest0-21swapper/122:25:281
1896932993725,7cyclictest0-21swapper/123:05:281
1896932993725,6cyclictest0-21swapper/121:05:271
189693299372,30cyclictest0-21swapper/120:55:161
189693299371,30cyclictest22-21rcuc/121:35:111
189693499366,25cyclictest30-21rcuc/222:00:192
1896934993625,7cyclictest0-21swapper/219:15:302
189693499361,29cyclictest1938285-21/usr/sbin/munin23:10:112
189693499361,29cyclictest0-21swapper/221:35:172
1896934993612,12cyclictest311ktimers/223:40:142
1896934993612,12cyclictest311ktimers/223:40:142
1896932993628,4cyclictest231ktimers/121:50:201
1896932993627,5cyclictest0-21swapper/122:15:291
1896932993627,4cyclictest231ktimers/122:40:291
1896932993626,7cyclictest231ktimers/122:00:111
1896932993620,8cyclictest231ktimers/123:30:151
1896934993525,5cyclictest0-21swapper/223:30:192
1896934993523,8cyclictest0-21swapper/223:45:282
1896934993521,9cyclictest0-21swapper/220:30:202
1896934993517,6cyclictest30-21rcuc/221:55:012
1896934993517,13cyclictest1899084-21/usr/sbin/munin19:20:192
1896932993527,6cyclictest231ktimers/119:50:191
1896932993527,5cyclictest231ktimers/120:05:011
1896932993524,8cyclictest22-21rcuc/100:25:001
1896932993517,9cyclictest231ktimers/121:10:171
1896934993427,4cyclictest1934657-21grep22:45:302
1896934993426,4cyclictest1929158-21fschecks_time22:15:212
1896934993421,8cyclictest0-21swapper/200:15:192
1896934993421,7cyclictest1901410-21http19:35:002
1896932993425,4cyclictest14-21rcu_preempt20:05:271
1896932993425,4cyclictest0-21swapper/100:31:131
1896932993423,7cyclictest1923541-21grep21:40:281
1896932993419,7cyclictest0-21swapper/122:20:201
1896932993418,8cyclictest0-21swapper/123:45:291
1896932993410,2cyclictest0-21swapper/122:58:111
1896934993323,7cyclictest1938086-21munin-plugin-st23:10:002
1896934993323,6cyclictest0-21swapper/200:35:272
1896934993320,8cyclictest0-21swapper/223:35:202
1896934993319,7cyclictest30-21rcuc/220:15:212
1896934993319,7cyclictest0-21swapper/220:00:262
1896934993316,10cyclictest1927278-21dropbear22:05:162
189693499331,26cyclictest0-21swapper/222:20:232
189693499331,26cyclictest0-21swapper/220:25:552
1896934993311,12cyclictest1912009-21/usr/sbin/munin20:35:202
1896932993326,5cyclictest231ktimers/119:25:161
1896932993325,5cyclictest231ktimers/120:10:171
1896932993325,5cyclictest231ktimers/120:10:171
1896932993324,6cyclictest231ktimers/123:15:001
1896932993323,6cyclictest1953354-21grep00:35:271
1896932993319,5cyclictest0-21swapper/122:10:011
1896932993317,10cyclictest231ktimers/121:20:211
1896932993315,16cyclictest231ktimers/100:15:161
1896934993225,4cyclictest1931321-21cron22:30:002
1896934993220,9cyclictest0-21swapper/220:00:012
1896934993220,9cyclictest0-21swapper/220:00:012
1896934993216,10cyclictest0-21swapper/219:10:012
1896932993225,4cyclictest231ktimers/120:15:181
1896932993223,5cyclictest0-21swapper/121:00:171
1896932993219,7cyclictest231ktimers/122:30:171
1896934993126,3cyclictest0-21swapper/219:45:222
1896934993124,4cyclictest167550irq/134-8000000.ethernet-tx221:55:252
1896934993119,7cyclictest0-21swapper/200:05:302
1896934993118,9cyclictest0-21swapper/222:55:262
1896934993114,9cyclictest0-21swapper/220:55:012
1896934993114,9cyclictest0-21swapper/220:55:012
1896934993112,4cyclictest8321systemd-network21:06:242
1896932993121,6cyclictest231ktimers/121:55:161
189693299311,6cyclictest22-21rcuc/120:35:281
1896932993115,12cyclictest0-21swapper/100:10:001
1896934993022,6cyclictest0-21swapper/221:25:012
1896934993021,6cyclictest0-21swapper/220:10:282
1896934993021,6cyclictest0-21swapper/220:10:282
1896934993021,5cyclictest30-21rcuc/200:35:012
1896934993020,6cyclictest0-21swapper/222:10:172
1896934993020,6cyclictest0-21swapper/222:10:172
1896932993025,3cyclictest14-21rcu_preempt23:40:221
1896932993025,3cyclictest14-21rcu_preempt23:40:221
1896934992919,5cyclictest0-21swapper/223:05:012
1896934992815,9cyclictest1913197-21phc2sys20:40:272
1896934992813,9cyclictest1906951-21/usr/sbin/munin20:05:182
1896934992714,7cyclictest311ktimers/223:15:142
1896932992517,4cyclictest231ktimers/119:10:011
1896934992411,9cyclictest0-21swapper/220:20:282
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional