You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-29 - 00:41

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of all highest latencies:
System rackeslot6s.osadl.org (updated Sat Mar 28, 2026 12:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
3198460997736,36cyclictest3248326-21sendmail12:00:000
3198460997710,9cyclictest3199284-21munin-node07:15:010
319846299696,21cyclictest3216826-21/usr/sbin/munin08:55:201
3198460996838,23cyclictest167350irq/118-8000000.ethernet-tx010:25:010
3198465996726,37cyclictest3227792-21tail09:55:262
319846299663,32cyclictest3240075-21/usr/sbin/munin11:10:191
3198465996526,34cyclictest0-21swapper/207:40:252
3198460996310,6cyclictest131ktimers/009:55:230
3198460996234,4cyclictest167350irq/118-8000000.ethernet-tx007:45:160
3198460996228,8cyclictest0-21swapper/011:40:270
3198465995919,32cyclictest0-21swapper/211:05:282
319846099593,18cyclictest0-21swapper/007:35:010
3198465995727,26cyclictest0-21swapper/208:00:212
3198465995727,26cyclictest0-21swapper/208:00:212
319846599572,19cyclictest0-21swapper/209:10:012
319846599572,19cyclictest0-21swapper/209:10:012
3198465995720,30cyclictest0-21swapper/212:15:292
3198465995720,30cyclictest0-21swapper/212:15:282
3198460995634,4cyclictest167350irq/118-8000000.ethernet-tx008:10:250
319846599555,41cyclictest0-21swapper/210:50:012
319846599555,41cyclictest0-21swapper/210:50:012
319846599554,43cyclictest3230799-21cut10:15:212
319846599553,6cyclictest3214007-21grep08:35:282
319846599552,15cyclictest3250221-21apt-get12:10:142
319846599552,10cyclictest3220747-21wc09:15:292
319846599552,10cyclictest3220747-21wc09:15:292
319846599551,13cyclictest3229965-21lsblk10:10:212
319846599551,11cyclictest3216912-21/usr/sbin/munin08:55:202
319846599542,12cyclictest3231770-21meminfo10:20:272
319846599542,10cyclictest3205966-21/usr/sbin/munin07:50:222
3198465995413,34cyclictest0-21swapper/210:25:252
319846099541,51cyclictest0-21swapper/007:15:120
319846599534,40cyclictest0-21swapper/211:40:282
3198465995329,19cyclictest3238123-21grep10:55:292
3198465995320,29cyclictest3202092-21latency_hist07:30:022
3198465995312,32cyclictest0-21swapper/210:30:272
3198462995312,13cyclictest24-21ksoftirqd/108:15:011
3198460995345,4cyclictest0-21swapper/008:00:210
3198460995345,4cyclictest0-21swapper/008:00:210
319846599525,38cyclictest0-21swapper/209:45:292
319846599523,4cyclictest3214743-21/usr/sbin/munin08:40:272
319846599523,4cyclictest3214743-21/usr/sbin/munin08:40:272
319846599521,8cyclictest3234336-21/usr/sbin/munin10:35:222
319846599521,8cyclictest3234336-21/usr/sbin/munin10:35:222
319846599521,8cyclictest3225008-21/usr/sbin/munin09:40:242
319846599521,8cyclictest3225008-21/usr/sbin/munin09:40:242
3198465995218,26cyclictest0-21swapper/209:20:192
319846599516,37cyclictest0-21swapper/209:05:012
319846599515,38cyclictest3209790-21grep08:10:302
319846599515,38cyclictest0-21swapper/210:05:262
3198465995128,19cyclictest3202990-21grep07:30:302
319846599512,5cyclictest3201223-21/usr/sbin/munin07:20:292
3198465995125,21cyclictest0-21swapper/207:15:282
319846599512,10cyclictest3199498-21cpu07:15:022
3198465995116,30cyclictest0-21swapper/207:45:092
319846599511,13cyclictest3240380-21memory11:10:252
319846599507,35cyclictest0-21swapper/209:10:252
319846599503,4cyclictest3243630-21cut11:30:202
319846599503,3cyclictest3215951-21wc08:50:012
319846599502,6cyclictest3248539-21/usr/sbin/munin12:00:272
3198465995024,23cyclictest3234933-21/usr/sbin/munin10:40:262
319846599501,9cyclictest3210288-21/usr/sbin/munin08:15:222
319846599501,8cyclictest3247244-21/usr/sbin/munin11:50:252
319846599501,6cyclictest3210990-21/usr/sbin/munin08:20:172
3198465995014,28cyclictest0-21swapper/208:25:192
3198460995037,10cyclictest3244954-21sendmail11:40:000
3198460995023,24cyclictest3216055-21df_inode08:50:180
319846599497,34cyclictest3241458-21grep11:15:322
319846599496,34cyclictest0-21swapper/212:25:282
319846599493,4cyclictest3242973-21/usr/sbin/munin11:25:262
319846599492,4cyclictest3238853-21/usr/sbin/munin11:00:282
319846599492,4cyclictest3238853-21/usr/sbin/munin11:00:282
319846599491,8cyclictest3228329-21/usr/sbin/munin10:00:232
319846599491,6cyclictest3247680-21/usr/sbin/munin11:55:292
3198465994911,32cyclictest1660-21snmpd12:08:392
3198460994942,4cyclictest3237343-21munin-plugin-st10:54:590
3198460994941,4cyclictest167350irq/118-8000000.ethernet-tx011:30:270
319846599488,34cyclictest3254974-21grep12:35:292
319846599485,35cyclictest0-21swapper/207:55:322
319846599485,35cyclictest0-21swapper/207:35:282
319846599483,5cyclictest3242316-21grep11:20:292
319846599482,8cyclictest3246158-21tune2fs11:45:212
3198465994826,17cyclictest0-21swapper/208:05:202
319846599482,11cyclictest3223361-21cut09:30:262
319846599481,7cyclictest3212927-21/usr/sbin/munin08:30:272
3198465994811,29cyclictest0-21swapper/211:35:272
3198465994810,32cyclictest0-21swapper/209:50:252
319846599473,4cyclictest0-21swapper/212:30:202
319846599471,5cyclictest3216593-21/usr/sbin/munin08:50:292
319846599471,4cyclictest3252648-21wc12:25:012
3198462994738,5cyclictest3216628-21munin-plugin-st08:55:001
3198462994714,6cyclictest832-21systemd-network11:50:011
3198460994730,15cyclictest167350irq/118-8000000.ethernet-tx010:00:160
319846099471,39cyclictest0-21swapper/012:35:010
319846599466,33cyclictest0-21swapper/207:10:012
319846599464,34cyclictest0-21swapper/209:35:192
319846599464,34cyclictest0-21swapper/209:25:172
3198462994634,6cyclictest3254774-21phc2sys12:35:281
319846099462,41cyclictest0-21swapper/010:30:130
3198462994536,4cyclictest3247483-21munin-plugin-st11:55:011
3198462994531,9cyclictest0-21swapper/112:35:011
3198462994531,9cyclictest0-21swapper/110:50:011
3198462994531,9cyclictest0-21swapper/110:50:011
3198460994539,3cyclictest167350irq/118-8000000.ethernet-tx011:05:140
319846599442,3cyclictest3236756-21/usr/sbin/munin10:50:162
3198462994431,9cyclictest0-21swapper/109:20:011
3198462994431,9cyclictest0-21swapper/109:20:011
3198462994423,10cyclictest0-21swapper/112:25:271
3198460994439,3cyclictest0-21swapper/008:20:200
3198460994436,4cyclictest167350irq/118-8000000.ethernet-tx012:10:230
319846099442,38cyclictest0-21swapper/008:45:280
319846099441,41cyclictest0-21swapper/011:10:160
319846299434,4cyclictest0-21swapper/108:20:011
319846299434,21cyclictest24-21ksoftirqd/108:30:151
3198462994333,7cyclictest0-21swapper/110:35:281
3198462994333,7cyclictest0-21swapper/110:35:281
3198462994333,5cyclictest0-21swapper/109:50:271
3198462994330,9cyclictest0-21swapper/109:25:001
319846299431,19cyclictest24-21ksoftirqd/112:20:011
319846099431,40cyclictest0-21swapper/009:45:220
3198460994235,4cyclictest0-21swapper/012:15:260
3198460994235,4cyclictest0-21swapper/012:15:260
3198460994232,6cyclictest3203816-21grep07:35:280
319846099422,6cyclictest3232107-21apt-get10:25:030
3198460994226,14cyclictest20850irq/208-8000000.ethernet09:25:080
319846099421,39cyclictest0-21swapper/012:25:210
319846099421,10cyclictest0-21swapper/012:05:020
319846299416,5cyclictest0-21swapper/107:50:011
3198462994132,5cyclictest0-21swapper/108:45:001
3198462994132,5cyclictest0-21swapper/108:45:001
3198462994120,10cyclictest231ktimers/109:25:111
319846299411,5cyclictest0-21swapper/109:10:011
319846299411,5cyclictest0-21swapper/109:10:011
3198460994135,3cyclictest20650irq/252-8000000.ethernet09:40:220
3198460994135,3cyclictest20650irq/252-8000000.ethernet09:40:220
3198460994134,4cyclictest167350irq/118-8000000.ethernet-tx009:50:150
3198460994134,4cyclictest0-21swapper/010:45:120
3198460994134,4cyclictest0-21swapper/010:45:120
3198460994133,5cyclictest0-21swapper/009:15:200
3198460994133,5cyclictest0-21swapper/009:15:200
319846099412,9cyclictest3252635-21latency_hist12:25:000
3198460994129,8cyclictest0-21swapper/011:25:290
3198460994129,8cyclictest0-21swapper/007:55:010
319846099412,4cyclictest3223684-21date09:35:010
319846099411,4cyclictest3229233-21memory10:05:240
319846099411,3cyclictest3241220-21memory11:15:300
3198462994016,9cyclictest22-21rcuc/111:40:011
3198460994033,4cyclictest0-21swapper/008:05:190
3198460994031,5cyclictest19750irq/27-20000000.i2c08:15:280
319846099402,3cyclictest0-21swapper/009:10:280
3198460994022,9cyclictest0-21swapper/009:25:010
319846099401,37cyclictest0-21swapper/009:00:170
319846099401,37cyclictest0-21swapper/007:25:290
319846099401,36cyclictest0-21swapper/011:45:160
3198462993927,8cyclictest231ktimers/109:55:091
3198462993927,6cyclictest0-21swapper/110:55:281
3198462993926,8cyclictest0-21swapper/107:55:011
3198462993925,9cyclictest231ktimers/110:15:011
3198462993924,6cyclictest0-21swapper/107:20:221
3198460993922,15cyclictest0-21swapper/012:05:250
3198460993921,14cyclictest0-21swapper/009:05:030
3198460993921,14cyclictest0-21swapper/009:05:030
319846099391,2cyclictest0-21swapper/007:10:000
3198462993828,5cyclictest0-21swapper/111:44:591
3198462993828,5cyclictest0-21swapper/111:15:331
3198462993826,7cyclictest0-21swapper/109:30:271
3198462993822,8cyclictest0-21swapper/112:05:261
3198460993823,13cyclictest0-21swapper/008:29:010
319846099381,7cyclictest3224449-21head09:35:270
3198462993728,5cyclictest0-21swapper/112:15:291
3198462993728,5cyclictest0-21swapper/112:15:291
3198462993725,7cyclictest0-21swapper/108:45:281
3198462993722,6cyclictest0-21swapper/107:20:011
3198460993729,5cyclictest20850irq/208-8000000.ethernet10:40:290
319846099372,5cyclictest3204234-21grep07:40:200
3198460993721,14cyclictest0-21swapper/008:30:250
319846099371,4cyclictest0-21swapper/012:40:000
319846099371,3cyclictest0-21swapper/010:20:010
319846099371,34cyclictest0-21swapper/010:55:240
3198462993629,4cyclictest231ktimers/110:05:261
3198462993629,4cyclictest167450irq/126-8000000.ethernet-tx111:05:181
3198462993619,9cyclictest0-21swapper/112:10:271
319846299361,29cyclictest231ktimers/107:25:241
3198460993631,2cyclictest0-21swapper/008:55:200
3198460993631,2cyclictest0-21swapper/007:55:160
3198460993630,4cyclictest0-21swapper/011:04:120
3198460993630,4cyclictest0-21swapper/011:04:120
3198460993629,4cyclictest167350irq/118-8000000.ethernet-tx008:35:170
319846099361,33cyclictest0-21swapper/011:20:140
319846099361,33cyclictest0-21swapper/008:40:140
319846099361,33cyclictest0-21swapper/008:40:140
3198462993529,4cyclictest231ktimers/109:35:211
3198462993527,5cyclictest231ktimers/109:05:001
3198462993526,6cyclictest231ktimers/107:10:291
3198462993525,5cyclictest0-21swapper/110:25:281
3198462993514,12cyclictest3231466-21/usr/sbin/munin10:20:211
3198460993528,4cyclictest20850irq/208-8000000.ethernet11:50:220
319846299349,17cyclictest167450irq/126-8000000.ethernet-tx110:30:171
3198462993425,6cyclictest3234940-21sshd10:40:161
3198462993423,7cyclictest231ktimers/111:55:111
3198462993423,5cyclictest0-21swapper/110:15:271
3198462993415,11cyclictest3248542-21apt-get12:00:131
319846299341,2cyclictest0-21swapper/111:30:011
3198462993325,5cyclictest3243459-21/usr/sbin/munin11:30:191
3198462993325,4cyclictest231ktimers/108:00:011
3198462993323,5cyclictest0-21swapper/108:35:211
3198462993321,7cyclictest231ktimers/108:20:221
3198460993323,6cyclictest3234601-21grep10:35:290
3198460993323,6cyclictest3234601-21grep10:35:280
3198462993224,5cyclictest231ktimers/111:00:121
3198462993224,5cyclictest231ktimers/111:00:111
3198462993222,5cyclictest231ktimers/109:45:011
3198462993222,5cyclictest231ktimers/109:45:011
3198462993220,8cyclictest0-21swapper/109:10:161
3198462993215,12cyclictest3241781-21apt-get11:20:161
3198460993225,5cyclictest20850irq/208-8000000.ethernet10:10:110
319846299319,11cyclictest3198455-21cyclictest08:00:121
319846299319,11cyclictest3198455-21cyclictest08:00:121
319846299317,17cyclictest3225548-21/usr/sbin/munin09:45:201
3198462993123,5cyclictest231ktimers/107:30:291
3198462993122,6cyclictest231ktimers/107:35:171
3198462993119,7cyclictest22-21rcuc/108:05:131
3198462993115,9cyclictest0-21swapper/110:00:211
319846299311,25cyclictest1660-21snmpd08:27:541
3198462993024,4cyclictest231ktimers/107:45:001
3198462993022,6cyclictest231ktimers/110:50:161
319846099301,27cyclictest0-21swapper/007:21:130
3198462992718,5cyclictest231ktimers/107:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional