You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-01-01 - 22:55

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Jan 01, 2026 12:44:47)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
250962199137129,6cyclictest0-21swapper/110:00:011
2509625997210,51cyclictest2516821-21/usr/sbin/munin07:50:182
2509625996824,38cyclictest0-21swapper/211:40:272
2509625996824,38cyclictest0-21swapper/211:40:272
2509619996713,32cyclictest15-21rcuc/007:30:010
2509619996713,32cyclictest15-21rcuc/007:30:010
250962599652,44cyclictest2552574-21/usr/sbin/munin11:20:202
250962599626,44cyclictest2534826-21fschecks_count09:35:192
2509625996220,34cyclictest0-21swapper/212:00:312
2509625996117,35cyclictest2514934-21sendmail07:40:002
250962599604,47cyclictest2552264-21grep11:15:292
2509625996030,24cyclictest0-21swapper/210:50:292
2509625996030,24cyclictest0-21swapper/210:50:292
250962599601,2cyclictest0-21swapper/208:30:012
2509625995936,20cyclictest2525154-21sendmail08:40:002
2509625995930,25cyclictest0-21swapper/209:25:292
2509625995923,32cyclictest2565408-21/usr/sbin/munin12:35:122
2509625995921,33cyclictest0-21swapper/208:05:262
250962599592,12cyclictest2521373-21phc2sys08:15:282
250962599586,39cyclictest0-21swapper/207:20:282
250962599583,9cyclictest2525531-21grep08:40:202
250962599583,12cyclictest2561518-21cut12:10:292
250962599582,14cyclictest2529580-21apt-get09:05:152
2509625995816,35cyclictest0-21swapper/212:00:012
2509625995715,34cyclictest2549780-21grep11:00:312
250962599569,38cyclictest2544719-21grep10:30:302
250962599565,42cyclictest2548929-21grep10:55:282
250962599565,42cyclictest2516325-21phc2sys-jitter07:45:252
2509625995631,20cyclictest2524225-21grep08:30:302
250962599562,12cyclictest2527883-21apt-get08:55:152
2509625995612,35cyclictest0-21swapper/211:10:292
2509625995612,33cyclictest0-21swapper/208:10:262
2509625995612,33cyclictest0-21swapper/208:10:252
2509619995638,14cyclictest167350irq/118-8000000.ethernet-tx007:15:040
250962599556,41cyclictest0-21swapper/210:25:292
250962599555,40cyclictest0-21swapper/208:25:012
250962599551,13cyclictest2539057-21apt-get10:00:172
250962599546,38cyclictest2547258-21grep10:45:302
250962599545,39cyclictest2515702-21unixbench_multi07:40:272
250962599545,39cyclictest2515702-21unixbench_multi07:40:272
250962599544,41cyclictest2563436-21grep12:20:292
250962599543,9cyclictest2510330-21grep07:10:282
250962599543,41cyclictest2564455-21cat12:30:002
2509625995421,25cyclictest0-21swapper/209:20:022
2509625995418,28cyclictest0-21swapper/208:50:302
2509625995418,27cyclictest0-21swapper/211:05:172
2509625995418,26cyclictest0-21swapper/209:00:312
2509625995414,32cyclictest2542118-21grep10:15:292
2509621995417,21cyclictest1660-21snmpd12:35:011
2509619995410,14cyclictest12-21ksoftirqd/008:45:020
250962599536,23cyclictest2545815-21/usr/sbin/munin10:40:202
250962599535,40cyclictest0-21swapper/209:20:302
250962599534,42cyclictest2534463-21grep09:30:312
250962599534,42cyclictest2534463-21grep09:30:312
2509625995316,30cyclictest0-21swapper/209:55:292
250962599531,45cyclictest1660-21snmpd11:38:422
250962599531,13cyclictest0-21swapper/211:45:152
250962599531,10cyclictest2541150-21cut10:10:262
2509619995349,2cyclictest0-21swapper/012:20:110
2509619995334,15cyclictest131ktimers/012:25:150
250962599525,38cyclictest0-21swapper/211:50:222
250962599522,40cyclictest2537953-21head09:50:312
2509625995215,30cyclictest2545053-21dropbear10:35:182
2509625995213,32cyclictest2560466-21cut12:05:212
2509619995246,4cyclictest0-21swapper/010:10:160
250962599514,38cyclictest2543087-21latency_hist10:25:022
250962599513,35cyclictest2553415-21/usr/sbin/munin11:25:272
250962599512,5cyclictest2510803-21cut07:15:032
250962599512,11cyclictest2512770-21grep07:25:212
250962599512,11cyclictest2512770-21grep07:25:212
250962599511,8cyclictest2564923-21/usr/sbin/munin12:30:272
250962599511,10cyclictest2518521-21apt-get08:00:152
2509625995110,33cyclictest2540094-21sh10:05:202
2509619995136,11cyclictest0-21swapper/011:25:290
250962599503,6cyclictest2517959-21/usr/sbin/munin07:55:212
250962599503,6cyclictest2517959-21/usr/sbin/munin07:55:212
250962599502,5cyclictest2537073-21grep09:45:272
250962599502,4cyclictest2562098-21/usr/sbin/munin12:15:172
2509625995019,17cyclictest2535675-21/usr/sbin/munin09:40:192
250962599501,8cyclictest2513707-21/usr/sbin/munin07:30:262
250962599501,7cyclictest2526381-21/usr/sbin/munin08:45:212
250962599501,6cyclictest2530731-21/usr/sbin/munin09:10:262
2509619995042,4cyclictest167350irq/118-8000000.ethernet-tx008:10:230
2509619995042,4cyclictest167350irq/118-8000000.ethernet-tx008:10:230
2509619995031,15cyclictest131ktimers/011:15:130
250962599492,11cyclictest2554319-21dropbear11:30:172
250961999498,38cyclictest15-21rcuc/012:05:200
2509621994832,10cyclictest2534451-21grep09:30:321
2509621994832,10cyclictest2534451-21grep09:30:321
2509619994829,12cyclictest131ktimers/009:20:120
250961999482,42cyclictest2518012-21phc2sys-jitter07:55:230
250961999482,42cyclictest2518012-21phc2sys-jitter07:55:230
250961999481,6cyclictest0-21swapper/007:55:010
250961999481,45cyclictest0-21swapper/009:15:090
250961999481,43cyclictest0-21swapper/012:20:010
250962199474,34cyclictest24-21ksoftirqd/108:45:011
2509621994739,5cyclictest2527683-21munin-plugin-st08:55:001
2509621994734,8cyclictest0-21swapper/108:45:291
2509619994739,5cyclictest20850irq/208-8000000.ethernet10:30:280
250961999472,4cyclictest2510441-21munin-node07:15:010
2509621994635,8cyclictest0-21swapper/110:10:281
2509621994631,8cyclictest0-21swapper/110:35:291
2509619994639,4cyclictest167350irq/118-8000000.ethernet-tx011:00:000
2509619994635,8cyclictest0-21swapper/009:35:290
2509621994537,5cyclictest0-21swapper/108:25:021
2509621994535,7cyclictest2536262-21unixbench_singl09:40:301
2509621994525,13cyclictest231ktimers/107:45:111
250961999452,6cyclictest2566021-21users12:35:320
250961999452,6cyclictest2523966-21meminfo08:30:250
250961999452,40cyclictest0-21swapper/008:00:260
2509619994520,20cyclictest15-21rcuc/009:00:190
250961999451,42cyclictest0-21swapper/011:40:280
250961999451,42cyclictest0-21swapper/011:40:280
250961999451,37cyclictest131ktimers/009:45:010
2509621994437,4cyclictest2543918-21munin-plugin-st10:30:001
2509621994433,6cyclictest0-21swapper/109:50:311
2509621994432,8cyclictest0-21swapper/110:55:281
2509621994431,8cyclictest0-21swapper/109:40:011
2509621994420,14cyclictest231ktimers/109:10:131
250961999445,37cyclictest0-21swapper/010:45:220
2509619994437,4cyclictest167350irq/118-8000000.ethernet-tx011:45:280
2509619994436,4cyclictest167350irq/118-8000000.ethernet-tx008:25:020
250961999441,18cyclictest15-21rcuc/008:25:010
250962599432,11cyclictest2509626-21latency_hist07:10:002
2509621994335,5cyclictest2528521-21sh09:00:001
2509621994332,7cyclictest0-21swapper/112:00:301
2509621994329,7cyclictest2523468-21munin-plugin-st08:30:001
2509621994328,9cyclictest0-21swapper/107:20:281
2509621994324,15cyclictest880-21avahi-daemon09:20:121
2509619994329,10cyclictest15-21rcuc/011:10:290
250961999432,6cyclictest2542008-21ptp4l-jitter10:15:270
2509621994234,5cyclictest2530223-21munin-plugin-st09:10:001
2509621994231,7cyclictest0-21swapper/107:10:281
2509621994230,8cyclictest0-21swapper/111:45:291
2509621994230,8cyclictest0-21swapper/107:50:281
2509621994229,8cyclictest0-21swapper/110:20:321
2509621994228,7cyclictest0-21swapper/109:45:281
2509621994226,9cyclictest0-21swapper/110:30:311
250961999423,37cyclictest0-21swapper/010:05:150
2509619994231,9cyclictest15-21rcuc/008:15:150
2509619994231,7cyclictest2534481-21grep09:30:310
2509619994231,7cyclictest2534481-21grep09:30:310
250962199415,19cyclictest2560347-21/usr/sbin/munin12:05:191
2509621994131,6cyclictest2515683-21unixbench_multi07:40:271
2509621994131,6cyclictest2515683-21unixbench_multi07:40:271
2509621994130,7cyclictest0-21swapper/108:15:301
2509621994129,9cyclictest0-21swapper/107:15:281
2509621994128,8cyclictest0-21swapper/111:05:291
2509621994124,9cyclictest0-21swapper/108:30:271
250961999415,7cyclictest0-21swapper/009:55:020
2509619994136,2cyclictest0-21swapper/010:50:140
2509619994136,2cyclictest0-21swapper/010:50:140
2509619994134,3cyclictest2546278-21mailstats10:40:290
2509619994130,8cyclictest0-21swapper/007:45:000
2509619994130,8cyclictest0-21swapper/007:45:000
250961999412,4cyclictest2558068-21irqstats11:50:260
2509619994124,15cyclictest0-21swapper/011:20:150
250961999411,38cyclictest0-21swapper/008:35:190
250961999411,37cyclictest0-21swapper/008:50:190
2509621994029,8cyclictest0-21swapper/107:55:261
2509621994029,8cyclictest0-21swapper/107:55:261
2509621994029,7cyclictest2520787-21grep08:10:281
2509621994029,7cyclictest2520787-21grep08:10:281
2509621994020,9cyclictest231ktimers/110:15:111
2509621994012,14cyclictest231ktimers/111:15:101
2509619994026,10cyclictest0-21swapper/008:05:270
2509619994024,13cyclictest0-21swapper/007:20:220
250961999401,4cyclictest2545601-21munin-run10:40:000
250961999401,37cyclictest0-21swapper/009:05:280
250961999401,36cyclictest2538807-21users09:55:290
2509621993928,8cyclictest231ktimers/110:05:111
2509621993928,8cyclictest0-21swapper/109:25:291
2509621993926,9cyclictest0-21swapper/108:05:271
2509619993932,4cyclictest14-21rcu_preempt07:35:000
2509619993924,8cyclictest2550220-21fschecks_time11:05:210
250961999392,35cyclictest0-21swapper/011:55:290
250961999391,3cyclictest2536814-21meminfo09:45:240
250961999391,36cyclictest0-21swapper/012:00:300
250961999391,36cyclictest0-21swapper/008:45:200
2509619993832,4cyclictest2528412-21unixbench_multi08:55:290
2509619993831,4cyclictest20850irq/208-8000000.ethernet12:30:290
2509621993731,4cyclictest51-21kcompactd012:20:271
2509621993726,7cyclictest0-21swapper/111:25:301
2509621993725,8cyclictest0-21swapper/111:35:311
2509621993722,8cyclictest0-21swapper/111:40:301
2509621993722,8cyclictest0-21swapper/111:40:301
2509621993718,13cyclictest231ktimers/112:25:151
250961999372,33cyclictest0-21swapper/011:01:040
2509619993721,15cyclictest0-21swapper/011:35:170
2509619993717,18cyclictest0-21swapper/011:30:140
250961999371,34cyclictest0-21swapper/010:29:570
250961999371,34cyclictest0-21swapper/010:20:180
250961999371,34cyclictest0-21swapper/007:45:280
250961999371,2cyclictest0-21swapper/007:10:010
250962199363,12cyclictest22-21rcuc/107:30:011
250962199363,12cyclictest22-21rcuc/107:30:011
2509621993628,4cyclictest22-21rcuc/111:00:311
2509621993623,9cyclictest231ktimers/112:10:131
2509619993632,2cyclictest0-21swapper/012:15:000
250961999361,33cyclictest2539565-21find10:00:300
2509621993527,4cyclictest0-21swapper/108:35:301
2509621993526,5cyclictest0-21swapper/109:15:271
2509621993524,5cyclictest0-21swapper/108:05:001
2509621993519,9cyclictest0-21swapper/111:20:271
250961999351,32cyclictest0-21swapper/009:25:070
2509621993427,4cyclictest22-21rcuc/110:05:001
2509621993425,6cyclictest0-21swapper/111:10:201
2509621993422,8cyclictest0-21swapper/112:35:301
2509621993422,8cyclictest0-21swapper/111:30:291
2509621993421,8cyclictest0-21swapper/111:55:291
250962199341,4cyclictest0-21swapper/109:05:011
2509621993315,11cyclictest231ktimers/112:15:141
250961999335,21cyclictest12-21ksoftirqd/007:35:190
250961999331,5cyclictest2530541-21sh09:10:190
2509621993122,6cyclictest2558413-21grep11:50:321
2509621993122,5cyclictest0-21swapper/107:10:011
2509621993122,4cyclictest0-21swapper/110:45:271
2509621993024,4cyclictest0-21swapper/110:40:281
2509621993023,4cyclictest231ktimers/110:50:121
2509621993023,4cyclictest231ktimers/110:50:121
2509621993021,6cyclictest0-21swapper/107:30:311
2509621992918,8cyclictest0-21swapper/107:35:211
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional