You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2025-12-25 - 12:57

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Thu Dec 25, 2025 00:44:49)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
27148999185,4cyclictest0-21swapper/021:40:200
2715399831,41cyclictest0-21swapper/220:05:012
2715399813,72cyclictest60078-21/usr/sbin/munin22:20:192
2715399813,72cyclictest60078-21/usr/sbin/munin22:20:182
2715399782,68cyclictest45514-21/usr/sbin/munin20:55:182
2715399730,58cyclictest0-21swapper/223:40:132
2715399730,58cyclictest0-21swapper/223:40:132
2715199736,21cyclictest55548-21apt-get21:55:021
2715399721,56cyclictest0-21swapper/223:10:152
2715399711,56cyclictest0-21swapper/219:30:102
2715399681,54cyclictest0-21swapper/221:45:112
2715399681,53cyclictest0-21swapper/200:00:172
2715399671,53cyclictest0-21swapper/222:05:112
2715399671,53cyclictest0-21swapper/222:05:112
2715399671,53cyclictest0-21swapper/221:00:142
2715399671,53cyclictest0-21swapper/200:35:102
2715399661,52cyclictest0-21swapper/222:55:132
2715399661,52cyclictest0-21swapper/222:10:122
2715399661,51cyclictest0-21swapper/222:25:112
2715399661,51cyclictest0-21swapper/219:10:102
2715399651,50cyclictest0-21swapper/219:50:132
27151996550,12cyclictest231ktimers/123:20:131
2715399641,47cyclictest0-21swapper/222:45:122
27148996456,5cyclictest0-21swapper/021:30:120
27153996338,21cyclictest30775-21cron19:30:002
2715399631,51cyclictest0-21swapper/223:20:122
2715399631,50cyclictest0-21swapper/221:50:122
2715399631,50cyclictest0-21swapper/219:20:132
2715399631,50cyclictest0-21swapper/219:20:132
2715399631,49cyclictest0-21swapper/221:35:142
2715399631,48cyclictest0-21swapper/222:50:152
2715399622,52cyclictest75459-21apt-get23:50:162
2715399621,50cyclictest0-21swapper/223:30:152
2715399621,49cyclictest0-21swapper/223:15:162
2715399621,48cyclictest0-21swapper/219:45:122
2715399611,47cyclictest0-21swapper/221:05:142
2715399611,47cyclictest0-21swapper/219:40:132
2715399601,48cyclictest0-21swapper/220:20:122
2715399601,45cyclictest0-21swapper/219:55:142
2715399591,44cyclictest27145-21cyclictest21:20:132
2715399591,33cyclictest0-21swapper/223:40:012
2715399582,45cyclictest0-21swapper/220:50:142
2715399581,48cyclictest48987-21apt-get21:15:162
2715399581,48cyclictest48987-21apt-get21:15:152
2715399581,45cyclictest0-21swapper/200:25:142
2715399581,44cyclictest0-21swapper/200:30:152
27153995718,35cyclictest0-21swapper/220:10:192
2715399571,49cyclictest59218-21munin-node22:15:112
2715399561,45cyclictest80630-21apt-get00:20:142
2715399561,42cyclictest0-21swapper/221:10:122
2715399552,45cyclictest37146-21/usr/sbin/munin20:05:212
2715399552,44cyclictest42140-21apt-get20:35:142
2715399551,48cyclictest71061-21apt-get23:25:172
2715399551,46cyclictest55915-21/usr/sbin/munin21:55:182
2715399551,41cyclictest0-21swapper/223:55:112
2715199559,25cyclictest22-21rcuc/120:50:011
2715199554,14cyclictest72538-21apt-get23:35:021
2715399541,47cyclictest78925-21/usr/sbin/munin00:10:132
2715399541,46cyclictest78218-21/usr/sbin/munin00:05:232
2715399541,46cyclictest63526-21/usr/sbin/munin22:40:172
2715399541,46cyclictest56697-21/usr/sbin/munin22:00:122
2715399541,45cyclictest62679-21/usr/sbin/munin22:35:192
2715399541,45cyclictest62679-21/usr/sbin/munin22:35:192
2715399541,44cyclictest39054-21/usr/sbin/munin20:15:232
2715399541,42cyclictest0-21swapper/221:25:112
27148995446,3cyclictest0-21swapper/023:45:120
27148995442,5cyclictest167350irq/118-8000000.ethernet-tx022:50:270
27148995438,11cyclictest0-21swapper/019:10:270
2715399533,43cyclictest67201-21/usr/sbin/munin23:00:262
2715399531,46cyclictest75153-21sshd23:47:222
2715399531,45cyclictest40519-21/usr/sbin/munin20:25:172
2715399531,45cyclictest28756-21/usr/sbin/munin19:15:252
2715399531,44cyclictest79770-21apt-get00:15:162
2715399531,44cyclictest79770-21apt-get00:15:162
2715399531,44cyclictest67805-21/usr/sbin/munin23:05:202
2715399531,40cyclictest0-21swapper/222:30:152
2715399531,40cyclictest0-21swapper/221:30:122
2715399531,39cyclictest0-21swapper/219:35:112
2715399531,39cyclictest0-21swapper/219:35:112
27151995345,5cyclictest231ktimers/120:35:011
27151995335,11cyclictest0-21swapper/121:50:221
2715399521,44cyclictest44259-21/usr/sbin/munin20:45:272
2715399521,44cyclictest43198-21/usr/sbin/munin20:40:202
2715399521,44cyclictest41746-21/usr/sbin/munin20:30:292
27151995228,14cyclictest231ktimers/123:40:161
27151995228,14cyclictest231ktimers/123:40:161
27151995142,5cyclictest54711-21munin-plugin-st21:50:001
27151995029,14cyclictest231ktimers/121:20:111
2715399491,42cyclictest53793-21/usr/sbin/munin21:40:292
2714899493,42cyclictest57302-21grep22:00:290
27148994920,19cyclictest14-21rcu_preempt23:55:010
2715199474,18cyclictest22-21rcuc/120:15:011
27151994735,8cyclictest0-21swapper/121:10:001
27151994733,9cyclictest73412-21grep23:35:301
27151994733,8cyclictest63158-21grep22:35:291
27151994733,8cyclictest63158-21grep22:35:291
27151994729,10cyclictest0-21swapper/120:35:281
27151994727,14cyclictest231ktimers/119:40:151
27148994740,4cyclictest167350irq/118-8000000.ethernet-tx019:35:210
27148994740,4cyclictest167350irq/118-8000000.ethernet-tx019:35:200
2714899471,9cyclictest0-21swapper/000:30:010
27151994640,4cyclictest231ktimers/120:30:021
27151994632,9cyclictest0-21swapper/123:05:271
27151994630,11cyclictest0-21swapper/100:30:301
27151994627,12cyclictest0-21swapper/121:30:221
2714899461,39cyclictest63431-21sed22:40:020
2714899461,39cyclictest63431-21sed22:40:010
27151994536,5cyclictest0-21swapper/120:20:011
27151994533,7cyclictest65674-21grep22:50:281
27151994528,13cyclictest0-21swapper/119:50:271
27151994527,14cyclictest231ktimers/123:00:151
27151994525,14cyclictest231ktimers/121:35:131
27151994436,5cyclictest231ktimers/123:50:121
27151994433,6cyclictest30699-21grep19:25:271
27151994424,16cyclictest22-21rcuc/120:00:011
27148994431,8cyclictest0-21swapper/000:15:280
27148994431,8cyclictest0-21swapper/000:15:280
2714899441,40cyclictest0-21swapper/021:50:250
27151994330,6cyclictest0-21swapper/122:25:281
27148994331,9cyclictest0-21swapper/020:35:280
2714899432,6cyclictest48203-21df21:10:170
2714899432,5cyclictest79153-21/usr/sbin/munin00:10:230
2714899432,5cyclictest30206-21df_inode19:25:160
2714899432,5cyclictest28502-21df_inode19:15:170
2714899431,37cyclictest0-21swapper/000:20:010
27151994231,6cyclictest0-21swapper/123:55:281
27151994230,7cyclictest31513-21grep19:30:271
27151994227,5cyclictest0-21swapper/100:10:011
27151994227,10cyclictest231ktimers/122:45:141
27151994222,12cyclictest0-21swapper/122:10:271
2714899424,4cyclictest35097-21apt-key19:55:010
27148994236,3cyclictest70011-21sendmail23:20:000
27148994229,9cyclictest0-21swapper/022:20:000
2714899421,5cyclictest83458-21memory00:35:230
2714899421,4cyclictest0-21swapper/023:05:120
2714899421,39cyclictest0-21swapper/020:50:190
2715399411,34cyclictest27197-21latency_hist19:10:012
2715399411,34cyclictest27197-21latency_hist19:10:012
27148994135,4cyclictest0-21swapper/021:45:210
27148994134,4cyclictest0-21swapper/021:55:210
2714899413,36cyclictest0-21swapper/000:05:220
2714899412,5cyclictest71428-21ps23:25:280
2714899412,4cyclictest43636-21munin-run20:45:000
2714899412,35cyclictest82503-21fschecks_time00:30:220
27148994123,16cyclictest0-21swapper/022:40:280
2714899411,5cyclictest60278-21perl22:20:210
2714899411,5cyclictest60278-21perl22:20:210
2714899411,5cyclictest33571-21df19:45:160
2714899411,4cyclictest47856-21munin-run21:10:000
2714899411,38cyclictest0-21swapper/022:25:230
2714899411,37cyclictest67014-21perl23:00:210
2715199401,4cyclictest0-21swapper/119:40:011
2715199401,4cyclictest0-21swapper/119:40:011
27148994033,4cyclictest0-21swapper/020:12:310
27148994029,6cyclictest131ktimers/020:20:280
2714899402,4cyclictest71903-21cpu23:30:170
2714899402,3cyclictest52464-21grep21:35:190
2714899401,37cyclictest0-21swapper/022:30:300
2714899400,38cyclictest0-21swapper/020:25:240
27151993932,5cyclictest22-21rcuc/120:05:011
27151993931,6cyclictest1-21systemd20:08:321
27151993930,6cyclictest0-21swapper/122:00:211
27151993923,10cyclictest0-21swapper/121:15:211
27151993923,10cyclictest0-21swapper/121:15:211
27148993930,6cyclictest31617-21latency_hist19:35:000
27148993929,6cyclictest46963-21grep21:00:280
2714899391,4cyclictest1660-21snmpd21:20:190
2714899391,36cyclictest0-21swapper/019:55:190
2714899391,36cyclictest0-21swapper/019:20:230
2714899391,36cyclictest0-21swapper/019:20:230
2715199383,2cyclictest0-21swapper/121:05:011
27151993829,5cyclictest0-21swapper/100:20:001
27151993829,5cyclictest0-21swapper/100:20:001
27151993822,9cyclictest0-21swapper/122:30:241
2715199381,2cyclictest0-21swapper/120:55:011
27148993832,4cyclictest0-21swapper/021:16:340
27148993832,4cyclictest0-21swapper/021:16:340
27148993831,4cyclictest0-21swapper/023:35:160
2714899381,35cyclictest0-21swapper/023:20:160
27151993725,8cyclictest0-21swapper/119:45:251
27151993722,8cyclictest0-21swapper/120:55:281
2714899373,8cyclictest58744-21proc_pri22:10:250
27148993729,4cyclictest131ktimers/022:55:290
2714899372,32cyclictest74016-21tail23:40:270
2714899372,32cyclictest74016-21tail23:40:270
2714899371,4cyclictest0-21swapper/020:20:010
27151993627,5cyclictest0-21swapper/119:15:281
27151993625,7cyclictest0-21swapper/122:40:281
27151993619,4cyclictest64085-21kworker/u8:1+events_power_efficient23:25:171
27148993630,4cyclictest20850irq/208-8000000.ethernet20:55:200
27148993620,14cyclictest0-21swapper/023:50:230
2714899361,33cyclictest0-21swapper/020:45:130
2714899361,33cyclictest0-21swapper/020:05:170
27151993520,8cyclictest0-21swapper/121:40:271
27151993516,9cyclictest50689-21/usr/sbin/munin21:25:191
27148993524,8cyclictest36773-21unixbench_multi20:00:300
2714899351,31cyclictest0-21swapper/023:10:180
2715199345,10cyclictest14-21rcu_preempt19:25:011
2715199345,10cyclictest14-21rcu_preempt19:25:011
27151993423,7cyclictest0-21swapper/122:15:181
27151993420,9cyclictest0-21swapper/122:55:211
27151993420,8cyclictest0-21swapper/120:40:261
27148993427,4cyclictest0-21swapper/000:00:360
27151993328,3cyclictest167450irq/126-8000000.ethernet-tx121:10:221
27151993324,5cyclictest0-21swapper/123:15:201
27151993323,6cyclictest0-21swapper/122:10:011
27151993323,6cyclictest0-21swapper/122:10:011
27151993321,8cyclictest0-21swapper/100:25:261
27148993327,4cyclictest20850irq/208-8000000.ethernet19:40:120
27148993326,4cyclictest131ktimers/022:45:290
27148993310,21cyclictest14-21rcu_preempt20:30:190
27148993226,4cyclictest20850irq/208-8000000.ethernet22:05:110
27148993226,4cyclictest20850irq/208-8000000.ethernet22:05:110
27148993223,6cyclictest131ktimers/021:25:270
2715199311,24cyclictest0-21swapper/100:20:191
27151993021,5cyclictest0-21swapper/123:45:101
27151993017,11cyclictest77794-21cron00:05:001
2715199301,2cyclictest0-21swapper/100:40:011
2715199301,26cyclictest60331-21interrupts22:20:221
2715199301,26cyclictest60331-21interrupts22:20:221
2714899301,24cyclictest0-21swapper/019:10:010
2714899301,24cyclictest0-21swapper/019:10:010
27151992917,7cyclictest27909-21grep19:10:271
27151992820,4cyclictest0-21swapper/123:10:191
2715199281,2cyclictest0-21swapper/120:25:021
27151992620,3cyclictest79381-21sendmail_mailqu00:10:281
27151992417,4cyclictest0-21swapper/119:10:011
27151992417,4cyclictest0-21swapper/119:10:011
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional