You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-03-16 - 10:02

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the highest latencies:
System rackeslot6s.osadl.org (updated Mon Mar 16, 2026 00:44:53)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
53232099922,63cyclictest0-21swapper/022:45:100
53232099922,63cyclictest0-21swapper/022:45:100
532320998567,15cyclictest23850irq/422-mmc119:25:010
532324998211,27cyclictest557518-21/usr/sbin/munin21:35:192
532324998211,27cyclictest557518-21/usr/sbin/munin21:35:192
532324997927,23cyclictest14-21rcu_preempt21:50:012
532324997927,23cyclictest14-21rcu_preempt21:50:012
53232399759,49cyclictest533123-21apt-get19:15:021
53232399741,65cyclictest0-21swapper/123:35:011
532323996726,37cyclictest0-21swapper/119:45:281
53232399671,53cyclictest0-21swapper/122:55:131
53232399651,53cyclictest0-21swapper/119:50:121
532324996412,15cyclictest578910-21/usr/sbin/munin23:40:192
53232399641,56cyclictest575534-21munin-node23:20:111
53232399631,50cyclictest0-21swapper/123:05:151
532323996219,36cyclictest0-21swapper/120:55:261
532323996219,36cyclictest0-21swapper/120:55:261
53232399621,45cyclictest0-21swapper/120:00:021
53232399621,45cyclictest0-21swapper/120:00:021
532320996253,6cyclictest20850irq/208-8000000.ethernet19:15:140
532323996120,34cyclictest0-21swapper/120:00:231
53232399611,47cyclictest0-21swapper/123:15:121
53232099610,34cyclictest0-21swapper/021:40:020
53232099610,34cyclictest0-21swapper/021:40:020
53232399601,47cyclictest0-21swapper/123:45:131
53232399601,45cyclictest0-21swapper/123:50:121
532323995925,27cyclictest0-21swapper/122:20:291
53232399591,50cyclictest570459-21apt-get22:50:161
532320995951,5cyclictest565086-21cron22:19:590
532320995951,5cyclictest565086-21cron22:19:590
53232399581,46cyclictest0-21swapper/100:25:141
53232399573,46cyclictest543917-21/usr/sbin/munin20:15:291
53232399572,47cyclictest538300-21/usr/sbin/munin19:40:251
53232399572,46cyclictest544781-21apt-get20:20:151
532323995717,33cyclictest0-21swapper/121:35:271
532323995717,33cyclictest0-21swapper/121:35:271
53232399571,48cyclictest568378-21/usr/sbin/munin22:35:251
53232399571,48cyclictest554143-21apt-get21:15:131
53232399571,48cyclictest0-21swapper/121:30:111
53232099576,21cyclictest0-21swapper/000:05:020
532324995646,6cyclictest534350-21sendmail19:20:012
53232399563,45cyclictest573836-21apt-get23:10:161
532323995616,34cyclictest585091-21sh00:15:221
532323995616,34cyclictest585091-21sh00:15:221
53232399561,48cyclictest548317-21/usr/sbin/munin20:40:181
53232399561,48cyclictest536236-21munin-node19:30:101
53232399561,47cyclictest582742-21/usr/sbin/munin00:00:271
53232399561,46cyclictest547458-21/usr/sbin/munin20:35:191
53232399561,43cyclictest0-21swapper/121:00:091
532320995645,6cyclictest545349-21grep20:20:280
53232499556,15cyclictest32-21ksoftirqd/219:40:012
532323995532,18cyclictest0-21swapper/119:25:291
532323995521,26cyclictest564148-21tail22:10:271
53232399551,48cyclictest572154-21/usr/sbin/munin23:00:111
53232399551,46cyclictest587739-21/usr/sbin/munin00:30:251
53232399551,46cyclictest583572-21/usr/sbin/munin00:05:251
53232399551,46cyclictest576784-21/usr/sbin/munin23:25:251
53232399551,46cyclictest576784-21/usr/sbin/munin23:25:251
53232399551,46cyclictest555178-21perl21:20:201
53232399551,46cyclictest552462-21apt-get21:05:121
53232399551,46cyclictest550284-21/usr/sbin/munin20:50:261
53232399551,45cyclictest585831-21/usr/sbin/munin00:20:191
532323995514,34cyclictest0-21swapper/122:30:201
532323995511,37cyclictest549250-21tune2fs20:45:211
532320995547,4cyclictest167350irq/118-8000000.ethernet-tx022:05:000
53232399542,45cyclictest543153-21/usr/sbin/munin20:10:191
53232399542,44cyclictest584059-21apt-get00:10:121
53232399542,43cyclictest560147-21apt-get21:50:161
53232399541,46cyclictest546145-21/usr/sbin/munin20:25:281
53232399541,45cyclictest556066-21/usr/sbin/munin21:25:221
53232399541,45cyclictest537351-21/usr/sbin/munin19:35:231
53232399541,44cyclictest563229-21/usr/sbin/munin22:05:261
53232399541,44cyclictest563229-21/usr/sbin/munin22:05:261
532320995438,10cyclictest0-21swapper/019:15:010
532324995334,14cyclictest311ktimers/222:05:152
532324995334,14cyclictest311ktimers/222:05:152
53232399532,44cyclictest579113-21/usr/sbin/munin23:40:211
53232399532,43cyclictest561915-21diskstats22:00:201
532323995317,28cyclictest581990-21grep23:55:291
53232399531,46cyclictest0-21swapper/119:20:251
53232399531,45cyclictest588491-21/usr/sbin/munin00:35:221
53232399531,45cyclictest588491-21/usr/sbin/munin00:35:221
53232399531,45cyclictest558606-21/usr/sbin/munin21:40:221
53232399531,44cyclictest566316-21/usr/sbin/munin22:25:181
53232399531,44cyclictest542355-21/usr/sbin/munin20:05:221
53232399531,44cyclictest542355-21/usr/sbin/munin20:05:211
53232399522,43cyclictest568778-21munin-node22:40:101
53232399522,43cyclictest553839-21tail21:10:291
53232399522,42cyclictest559519-21meminfo21:45:261
53232399522,42cyclictest559519-21meminfo21:45:261
532323995216,32cyclictest0-21swapper/122:20:011
532323995216,32cyclictest0-21swapper/122:20:011
53232399521,48cyclictest578355-21/usr/sbin/munin23:35:261
53232399521,43cyclictest546548-21apt-get20:30:121
532320995242,5cyclictest20850irq/208-8000000.ethernet21:40:250
53232099513,7cyclictest274-21systemd-journal23:34:590
532324995027,17cyclictest311ktimers/220:20:122
53232399502,43cyclictest533700-21apt-get19:15:161
53232399501,42cyclictest561057-21diskstats21:55:201
532320995043,5cyclictest0-21swapper/022:54:590
53232399492,40cyclictest532332-21grep19:10:011
532320994930,14cyclictest131ktimers/020:05:140
532320994930,14cyclictest131ktimers/020:05:140
53232399481,41cyclictest569684-21df_inode22:45:141
53232399481,41cyclictest569684-21df_inode22:45:141
532320994841,4cyclictest565570-21sshd22:20:200
53232099481,4cyclictest0-21swapper/022:00:010
53232099475,6cyclictest0-21swapper/022:35:010
532320994738,5cyclictest560734-21grep21:50:290
532324994632,10cyclictest0-21swapper/219:15:012
532324994627,13cyclictest311ktimers/222:45:102
532324994627,13cyclictest311ktimers/222:45:102
532320994639,4cyclictest167350irq/118-8000000.ethernet-tx022:05:240
532320994639,4cyclictest167350irq/118-8000000.ethernet-tx022:05:240
532320994630,13cyclictest0-21swapper/022:40:150
532324994534,6cyclictest0-21swapper/222:15:282
532324994534,6cyclictest0-21swapper/222:15:282
532324994530,9cyclictest0-21swapper/222:35:192
532324994530,9cyclictest0-21swapper/220:40:262
532324994524,14cyclictest311ktimers/222:25:112
53232099454,2cyclictest0-21swapper/020:45:010
532320994535,6cyclictest573577-21grep23:05:300
532320994526,14cyclictest131ktimers/019:30:120
53232099451,4cyclictest0-21swapper/023:50:110
53232099451,3cyclictest0-21swapper/023:00:000
53232499446,19cyclictest311ktimers/223:25:012
532324994433,6cyclictest567668-21grep22:30:282
532324994427,9cyclictest0-21swapper/200:30:272
532320994434,5cyclictest0-21swapper/023:50:000
532320994429,10cyclictest574908-21sshd23:15:220
532324994334,4cyclictest14-21rcu_preempt20:35:262
532320994332,8cyclictest0-21swapper/000:20:000
532320994332,8cyclictest0-21swapper/000:19:590
532320994236,2cyclictest0-21swapper/020:55:260
532320994236,2cyclictest0-21swapper/020:55:250
532320994235,4cyclictest20650irq/252-8000000.ethernet23:25:180
532320994235,4cyclictest20650irq/252-8000000.ethernet23:25:180
532324994131,7cyclictest535199-21grep19:24:592
532324994128,8cyclictest0-21swapper/222:50:292
532324994117,18cyclictest30-21rcuc/221:55:012
532320994134,4cyclictest0-21swapper/021:10:230
532320994133,4cyclictest0-21swapper/021:50:000
532320994133,4cyclictest0-21swapper/021:50:000
532320994130,7cyclictest0-21swapper/022:35:220
532320994128,8cyclictest0-21swapper/020:00:300
532320994127,9cyclictest131ktimers/023:10:280
532320994120,6cyclictest581733-1kworker/0:2H+mmc_complete00:00:020
53232099411,5cyclictest0-21swapper/019:40:010
532324994031,5cyclictest167550irq/134-8000000.ethernet-tx219:40:272
532324994025,9cyclictest0-21swapper/223:55:282
532320994033,4cyclictest167350irq/118-8000000.ethernet-tx020:10:050
532320994023,12cyclictest532317-21cyclictest00:35:190
532320994023,12cyclictest532317-21cyclictest00:35:190
53232499399,20cyclictest32-21ksoftirqd/200:40:002
53232499399,20cyclictest32-21ksoftirqd/200:40:002
532324993930,4cyclictest0-21swapper/221:00:262
532324993924,8cyclictest0-21swapper/220:00:292
532324993916,12cyclictest311ktimers/220:30:152
532320993928,7cyclictest552171-21grep21:00:250
53232099392,4cyclictest538526-21head19:40:270
53232099391,4cyclictest582071-21apt-get00:00:040
53232099391,3cyclictest0-21swapper/019:55:170
53232099391,3cyclictest0-21swapper/019:55:160
53232099391,36cyclictest0-21swapper/000:25:290
53232099391,2cyclictest547387-21apt-get20:35:140
53232499388,23cyclictest30-21rcuc/222:25:012
532324993831,3cyclictest578695-21sh23:40:002
532324993827,5cyclictest0-21swapper/219:55:212
532324993827,5cyclictest0-21swapper/219:55:202
532320993832,3cyclictest167350irq/118-8000000.ethernet-tx021:19:030
532320993831,4cyclictest0-21swapper/020:25:160
532320993831,4cyclictest0-21swapper/019:25:140
532320993828,6cyclictest584661-21grep00:10:270
532320993828,5cyclictest0-21swapper/000:20:200
53232099382,5cyclictest0-21swapper/023:05:020
53232099382,33cyclictest0-21swapper/019:45:270
532320993822,14cyclictest0-21swapper/021:05:000
532320993822,12cyclictest0-21swapper/022:10:280
53232099381,2cyclictest0-21swapper/023:45:020
532324993728,4cyclictest562427-21grep22:00:302
532324993728,4cyclictest0-21swapper/219:55:012
532324993726,8cyclictest1660-21snmpd23:25:232
532324993726,8cyclictest1660-21snmpd23:25:232
532324993723,9cyclictest0-21swapper/220:05:282
532324993723,9cyclictest0-21swapper/220:05:282
532324993720,10cyclictest311ktimers/200:05:272
53232499371,18cyclictest30-21rcuc/221:25:002
532320993722,13cyclictest0-21swapper/020:15:200
53232099371,3cyclictest0-21swapper/019:50:150
53232099371,34cyclictest0-21swapper/023:35:150
53232099371,34cyclictest0-21swapper/021:30:210
53232099371,34cyclictest0-21swapper/021:20:190
53232099371,34cyclictest0-21swapper/020:50:230
53232499366,23cyclictest560985-21/usr/sbin/munin21:55:192
532324993628,4cyclictest14-21rcu_preempt00:20:282
532324993625,6cyclictest0-21swapper/200:15:222
532324993625,6cyclictest0-21swapper/200:15:222
53232499362,4cyclictest0-21swapper/223:55:002
532324993624,7cyclictest0-21swapper/220:55:262
532324993624,7cyclictest0-21swapper/220:55:262
532324993623,9cyclictest0-21swapper/222:40:282
532324993620,11cyclictest311ktimers/219:25:112
53232099361,3cyclictest0-21swapper/021:30:020
53232099361,33cyclictest0-21swapper/022:25:140
532324993528,4cyclictest167550irq/134-8000000.ethernet-tx221:40:232
532324993523,5cyclictest30-21rcuc/220:50:282
532324993516,11cyclictest0-21swapper/223:35:012
532320993528,5cyclictest20850irq/208-8000000.ethernet00:35:000
532320993522,9cyclictest0-21swapper/020:30:200
532324993426,4cyclictest0-21swapper/220:45:282
532324993423,7cyclictest0-21swapper/221:25:272
53232499341,28cyclictest0-21swapper/220:10:182
53232499331,27cyclictest30-21rcuc/221:15:252
532320993327,3cyclictest575827-21cut23:20:230
532324993224,5cyclictest0-21swapper/222:15:012
532324993222,6cyclictest580320-21grep23:45:292
532324993221,6cyclictest0-21swapper/221:05:282
532324993218,8cyclictest30-21rcuc/221:30:252
532324993121,7cyclictest574365-21unixbench_multi23:10:272
53232499311,25cyclictest0-21swapper/222:55:172
532324993021,5cyclictest0-21swapper/221:10:212
53232499301,27cyclictest30-21rcuc/200:00:282
532324993012,13cyclictest311ktimers/200:10:112
53232499301,10cyclictest205-21ptp000:25:152
532320993023,4cyclictest0-21swapper/020:45:170
53232099301,2cyclictest0-21swapper/019:10:000
532324992918,5cyclictest0-21swapper/219:10:012
532324992916,9cyclictest0-21swapper/219:45:282
532324992915,9cyclictest0-21swapper/220:20:012
532324992820,5cyclictest536403-21tune2fs19:30:202
532324992818,4cyclictest0-21swapper/220:25:252
532324992817,8cyclictest575310-21cron23:20:002
532324992618,6cyclictest0-21swapper/223:10:012
532324992618,5cyclictest30-21rcuc/223:00:192
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional