You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-10 - 06:18

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Mon Aug 10, 2026 00:44:45)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
29847399634,45cyclictest0-21swapper/221:10:012
29846999631,60cyclictest0-21swapper/022:05:180
29847399598,31cyclictest326385-21/usr/sbin/munin21:50:192
298472995431,15cyclictest231ktimers/122:45:121
298469995114,34cyclictest0-21swapper/021:50:200
298469995041,4cyclictest20650irq/252-8000000.ethernet20:45:010
29846999501,45cyclictest355220-21wc00:40:010
298472994931,8cyclictest231ktimers/121:20:131
298472994927,16cyclictest231ktimers/123:00:131
298472994839,5cyclictest316800-21cron20:55:001
29846999481,8cyclictest347412-21grep23:50:280
29846999481,39cyclictest0-21swapper/023:30:030
298473994710,16cyclictest0-21swapper/222:55:012
29846999471,41cyclictest300582-21latency_hist19:20:010
29847399468,9cyclictest30-21rcuc/200:35:032
29846999462,42cyclictest0-21swapper/022:45:290
298469994616,15cyclictest322173-21/usr/sbin/munin21:25:180
29846999461,38cyclictest309028-21apt-get20:10:010
298473994537,3cyclictest347473-21munin-plugin-st23:55:012
298473994517,14cyclictest0-21swapper/200:05:162
29847299457,19cyclictest24-21ksoftirqd/122:55:011
298472994511,28cyclictest320162-21unixbench_multi21:10:321
298469994538,5cyclictest12-21ksoftirqd/021:00:120
29846999452,40cyclictest0-21swapper/021:20:220
29846999451,37cyclictest350200-21latency_hist00:10:010
298473994426,12cyclictest351696-21sendmail00:20:002
298473994426,12cyclictest351696-21sendmail00:20:002
29847299443,9cyclictest24-21ksoftirqd/120:40:001
298472994431,7cyclictest0-21swapper/121:35:271
298472994427,12cyclictest231ktimers/100:15:131
298472994427,12cyclictest231ktimers/100:15:131
298469994414,5cyclictest341470-21apt-get23:20:010
29846999441,40cyclictest0-21swapper/021:10:190
298473994327,10cyclictest0-21swapper/200:30:292
298473994322,15cyclictest0-21swapper/220:10:162
298473994314,19cyclictest30-21rcuc/223:40:012
298473994314,19cyclictest30-21rcuc/223:40:012
298472994334,5cyclictest0-21swapper/120:00:381
298472994334,5cyclictest0-21swapper/120:00:381
298472994327,3cyclictest0-21swapper/119:10:011
298472994324,15cyclictest231ktimers/121:40:151
298472994324,15cyclictest231ktimers/121:40:151
29846999434,36cyclictest0-21swapper/021:30:300
298469994336,4cyclictest167350irq/118-8000000.ethernet-tx022:25:240
298469994336,3cyclictest167350irq/118-8000000.ethernet-tx023:30:170
298469994333,6cyclictest0-21swapper/021:10:020
298469994331,6cyclictest324454-21grep21:35:270
29846999431,39cyclictest299292-21munin-node19:15:010
298473994231,6cyclictest0-21swapper/220:20:292
298473994228,8cyclictest0-21swapper/221:55:272
298473994222,14cyclictest0-21swapper/223:20:112
298472994229,8cyclictest0-21swapper/123:20:021
298472994229,8cyclictest0-21swapper/120:45:291
298472994222,15cyclictest231ktimers/122:05:141
29847299421,4cyclictest0-21swapper/119:55:011
29846999423,35cyclictest351383-21phc2sys00:15:280
29846999423,35cyclictest351383-21phc2sys00:15:280
298469994230,8cyclictest0-21swapper/019:35:010
298473994134,4cyclictest0-21swapper/220:05:022
298473994134,4cyclictest0-21swapper/220:05:012
298473994125,8cyclictest0-21swapper/220:00:002
29847299415,17cyclictest24-21ksoftirqd/122:25:011
298472994131,5cyclictest0-21swapper/123:30:211
298472994130,8cyclictest1283-21cron23:44:591
298472994129,6cyclictest0-21swapper/100:05:321
298472994122,14cyclictest231ktimers/123:25:121
29846999413,8cyclictest274-21systemd-journal23:40:010
29846999413,8cyclictest274-21systemd-journal23:40:010
298469994133,5cyclictest20850irq/208-8000000.ethernet21:00:000
29846999413,34cyclictest327325-21sh21:55:180
29846999412,37cyclictest0-21swapper/019:20:200
29846999411,38cyclictest0-21swapper/022:35:200
29846999411,38cyclictest0-21swapper/021:45:000
29846999411,38cyclictest0-21swapper/021:45:000
29846999411,35cyclictest339891-21cat23:10:010
29846999411,33cyclictest330590-21sed22:15:010
298473994027,9cyclictest0-21swapper/223:05:222
298473994026,9cyclictest0-21swapper/221:40:312
298473994026,9cyclictest0-21swapper/221:40:302
29847399401,16cyclictest30-21rcuc/222:50:012
298472994033,4cyclictest347472-21munin-plugin-st23:55:001
298472994027,7cyclictest332014-21grep22:20:291
298472994024,8cyclictest0-21swapper/120:10:311
29847299402,35cyclictest0-21swapper/123:15:001
298472994021,16cyclictest231ktimers/120:25:141
29847299401,31cyclictest0-21swapper/122:15:231
298469994034,4cyclictest0-21swapper/019:35:210
29846999402,3cyclictest0-21swapper/020:35:020
29846999402,36cyclictest0-21swapper/022:30:150
29846999401,3cyclictest330974-21ps22:15:260
29846999401,37cyclictest0-21swapper/023:20:170
298473993930,5cyclictest0-21swapper/221:20:002
298473993929,5cyclictest333694-21grep22:30:272
298473993926,8cyclictest0-21swapper/222:15:292
298473993926,6cyclictest0-21swapper/222:55:292
298473993925,8cyclictest338749-21grep23:00:292
298473993918,14cyclictest330066-21memory22:10:252
29847399391,2cyclictest0-21swapper/221:35:012
298472993925,9cyclictest0-21swapper/100:30:281
29847299392,30cyclictest0-21swapper/120:05:241
298472993920,13cyclictest231ktimers/123:05:121
298472993917,14cyclictest231ktimers/123:35:121
298472993917,14cyclictest231ktimers/123:35:121
298472993915,17cyclictest231ktimers/119:15:161
29847299391,2cyclictest0-21swapper/100:05:021
29846999393,8cyclictest0-21swapper/020:05:010
29846999393,8cyclictest0-21swapper/020:05:010
298469993933,3cyclictest167350irq/118-8000000.ethernet-tx023:00:200
298469993925,8cyclictest0-21swapper/021:45:290
29846999392,35cyclictest0-21swapper/020:35:190
29846999391,3cyclictest315034-21apt-get20:45:040
298473993826,7cyclictest313536-21/usr/sbin/munin20:35:192
298473993816,10cyclictest0-21swapper/220:45:122
298472993827,6cyclictest0-21swapper/122:05:001
298472993827,5cyclictest0-21swapper/122:35:191
298472993825,7cyclictest327808-21grep21:55:271
298472993819,14cyclictest231ktimers/120:30:121
298472993818,15cyclictest231ktimers/121:45:161
298472993818,14cyclictest231ktimers/122:55:131
298472993815,17cyclictest231ktimers/119:20:131
29847299381,31cyclictest0-21swapper/120:40:161
298469993830,5cyclictest20850irq/208-8000000.ethernet22:40:180
298469993824,8cyclictest0-21swapper/023:40:290
29846999382,30cyclictest0-21swapper/000:25:000
29846999381,35cyclictest0-21swapper/022:20:110
29846999381,35cyclictest0-21swapper/022:00:210
29846999381,35cyclictest0-21swapper/020:50:100
29846999381,35cyclictest0-21swapper/020:20:200
29846999381,35cyclictest0-21swapper/020:15:240
29846999381,35cyclictest0-21swapper/020:05:130
29846999381,26cyclictest337139-21kworker/u8:0+events_power_efficient22:55:020
298473993728,4cyclictest0-21swapper/220:30:282
298473993722,9cyclictest332947-21munin-run22:30:002
298473993718,9cyclictest0-21swapper/219:25:292
298472993729,5cyclictest0-21swapper/120:00:001
298472993728,6cyclictest0-21swapper/123:55:281
298472993726,5cyclictest0-21swapper/121:25:171
298472993722,9cyclictest0-21swapper/119:35:311
298469993731,3cyclictest301914-21sendmail_mailqu19:25:280
298469993729,4cyclictest167350irq/118-8000000.ethernet-tx000:30:220
298469993721,14cyclictest0-21swapper/019:58:120
29846999371,34cyclictest0-21swapper/000:12:260
29846999371,33cyclictest306541-21grep19:55:010
29846999371,32cyclictest348253-21unixbench_singl23:55:280
29847399365,5cyclictest0-21swapper/222:35:202
298473993625,5cyclictest0-21swapper/220:25:262
298473993620,10cyclictest0-21swapper/219:20:232
298473993617,12cyclictest0-21swapper/219:10:202
298473993616,13cyclictest0-21swapper/223:15:142
298473993614,11cyclictest0-21swapper/223:55:152
298473993613,17cyclictest2-21kthreadd21:28:222
298472993622,9cyclictest0-21swapper/120:55:231
298472993616,14cyclictest231ktimers/121:30:151
298472993616,14cyclictest231ktimers/119:10:121
298472993615,13cyclictest231ktimers/122:30:121
29846999368,26cyclictest131ktimers/000:00:190
298469993630,4cyclictest0-21swapper/022:55:150
298469993629,4cyclictest19750irq/27-20000000.i2c21:15:310
298469993625,5cyclictest131ktimers/023:10:280
29846999361,7cyclictest304336-21sh19:40:220
29846999361,4cyclictest0-21swapper/020:27:040
29846999361,3cyclictest0-21swapper/000:25:320
29847399359,15cyclictest351909-21/usr/sbin/munin00:20:172
29847399358,2cyclictest0-21swapper/219:35:002
298473993519,9cyclictest0-21swapper/221:45:282
298473993516,15cyclictest319341-21apt-get21:10:052
298473993515,13cyclictest308444-21/usr/sbin/munin20:05:172
29847399351,28cyclictest317004-21/usr/sbin/munin20:55:322
29847399351,28cyclictest0-21swapper/219:45:172
29847399351,24cyclictest311642-21kworker/u8:0+rpciod20:43:232
298472993528,4cyclictest167450irq/126-8000000.ethernet-tx122:10:281
298472993526,5cyclictest0-21swapper/100:10:281
298472993526,4cyclictest0-21swapper/119:40:291
298472993525,6cyclictest305572-21grep19:45:291
29847299352,3cyclictest0-21swapper/121:10:021
298472993520,9cyclictest0-21swapper/123:45:281
298472993515,14cyclictest231ktimers/121:50:131
298469993527,4cyclictest167350irq/118-8000000.ethernet-tx023:45:220
29846999351,4cyclictest0-21swapper/019:45:200
298473993423,8cyclictest0-21swapper/223:44:592
298473993423,7cyclictest0-21swapper/223:10:292
298473993422,7cyclictest0-21swapper/220:15:252
298473993413,14cyclictest343876-21/usr/sbin/munin23:30:282
298473993410,18cyclictest0-21swapper/219:40:002
298472993413,14cyclictest231ktimers/119:30:131
29847299341,27cyclictest0-21swapper/122:40:111
29846999341,27cyclictest0-21swapper/019:10:010
298473993326,4cyclictest304368-21lsblk19:40:222
298473993323,7cyclictest311ktimers/219:50:152
298473993319,10cyclictest0-21swapper/221:00:112
298473993313,13cyclictest321411-21/usr/sbin/munin21:20:192
29847399331,2cyclictest0-21swapper/219:20:022
29847399331,26cyclictest0-21swapper/223:25:182
29847399331,26cyclictest0-21swapper/220:51:342
29847399331,22cyclictest348291-21kworker/u8:0+rpciod00:01:212
298472993325,6cyclictest0-21swapper/123:20:271
298472993324,4cyclictest0-21swapper/100:20:191
298472993323,6cyclictest0-21swapper/100:25:311
298472993320,9cyclictest311551-21grep20:20:281
298473993224,4cyclictest0-21swapper/221:40:012
298473993222,5cyclictest0-21swapper/222:05:012
29847399321,26cyclictest0-21swapper/200:10:162
29847399321,22cyclictest352533-21kworker/u8:3+rpciod00:29:262
298473993212,13cyclictest298466-21cyclictest23:45:142
298473993123,5cyclictest0-21swapper/222:05:292
298473993121,5cyclictest0-21swapper/222:20:302
298473993117,8cyclictest335327-21/usr/sbin/munin22:40:272
298472993125,4cyclictest0-21swapper/121:00:271
298472993123,5cyclictest1660-21snmpd21:16:221
298472993120,8cyclictest0-21swapper/120:15:211
298472993015,10cyclictest0-21swapper/100:35:271
298473992816,8cyclictest0-21swapper/219:10:012
298472992819,6cyclictest301983-21grep19:25:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional