You are here: Home / Technical Services / OSADL QA Farm Real-time / 
2026-08-16 - 10:28

OSADL QA Farm on Real-time of Mainline Linux

About - Hardware - CPUs - Benchmarks - Graphics - Benchmarks - Kernels - Boards/Distros - Latency monitoring - Latency plots - System data - Profiles - Compare - Awards

Default latency plot of shadow in rack #e, slot #6

Rack #0/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #1/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #2/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #3/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #4/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #5/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #6/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #7/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #8/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #9/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #a/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #b/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #c/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #d/#0 #1 #2 #3 #4 #5 #6 #7 #8 -
Rack #e/#0 #1 #2 #3 #4 #5 #6 #7 #8 - Rack #f/#0 #1 #2 #3 #4 #5 #6 #7 #8 
Special  All - All RT - Optimization - Ethernet - Thumbnails - Next
  TI
Click here to display the system's profile data or here to proceed to next system.
Click on a legend element to toggle display of that core, ctrl-click inverts display, shift-click enables all.

Data to construct the above plot have been generated using the RT test utility cyclictest.

Total number of samples: 100 million
Resolution of latency scale: normal
Duration: 5 hours, 33 minutes
Compare latency of primary with shadow system
Characteristics of the 792 highest latencies:
System rackeslot6s.osadl.org (updated Sun Aug 16, 2026 00:44:50)
Delayed (victim)Switcher (culprit)TimestampCPU
PIDPrioTotal
latency
(µs)
T*(,W**)
latency
(µs)
CmdPIDPrioCmd
1406928991023,68cyclictest0-21swapper/122:00:011
1406928999013,15cyclictest1423512-21/usr/sbin/munin20:45:201
1406929996818,12cyclictest30-21rcuc/200:35:192
1406929996152,4cyclictest1459206-21munin-plugin-st00:15:002
1406929995846,6cyclictest1454848-21unixbench_singl23:45:282
140692899585,33cyclictest1406922-21cyclictest20:40:021
1406925995711,8cyclictest1407750-21munin-node19:15:010
1406928995610,18cyclictest1454264-21/usr/sbin/munin23:45:181
140692599532,47cyclictest1459517-21fschecks_count00:15:200
1406928995139,8cyclictest1408864-21sendmail19:20:001
1406928995038,8cyclictest1413932-21munin-plugin-st19:50:001
1406928995037,10cyclictest1442856-21unixbench_singl22:35:301
140692999491,30cyclictest30-21rcuc/200:25:022
1406925994943,3cyclictest1451527-21munin-plugin-st23:30:000
1406925994942,4cyclictest167350irq/118-8000000.ethernet-tx022:55:200
1406929994836,6cyclictest1443756-21munin-plugin-st22:45:002
1406929994830,12cyclictest0-21swapper/222:05:282
1406928994841,2cyclictest0-21swapper/122:45:011
1406928994838,7cyclictest1460057-21sendmail00:20:001
1406928994828,10cyclictest0-21swapper/100:25:021
140692599483,7cyclictest1408847-21sshd19:19:400
1406929994738,6cyclictest1458368-21munin-plugin-st00:10:012
1406929994738,5cyclictest0-21swapper/220:10:292
1406929994738,5cyclictest0-21swapper/220:10:292
1406929994734,10cyclictest1415617-21sendmail20:00:002
1406929994732,9cyclictest0-21swapper/221:20:282
1406929994723,13cyclictest311ktimers/223:00:102
1406929994714,17cyclictest32-21ksoftirqd/200:05:012
140692599472,14cyclictest14-21rcu_preempt23:55:010
1406928994611,29cyclictest1450336-21kernelversion23:20:241
1406928994611,29cyclictest1450336-21kernelversion23:20:241
1406925994639,4cyclictest167350irq/118-8000000.ethernet-tx022:15:010
1406929994533,7cyclictest0-21swapper/222:50:212
140692999452,29cyclictest0-21swapper/223:26:182
1406929994517,22cyclictest30-21rcuc/221:50:012
1406928994529,11cyclictest0-21swapper/120:25:011
1406925994536,4cyclictest20650irq/252-8000000.ethernet21:10:220
1406925994533,8cyclictest0-21swapper/023:35:000
1406925994529,10cyclictest0-21swapper/023:35:200
1406925994528,13cyclictest15-21rcuc/021:30:150
140692599452,39cyclictest1461777-21grep00:25:280
140692599452,39cyclictest1461777-21grep00:25:270
140692599451,37cyclictest1459398-21sed00:15:010
1406929994436,4cyclictest1430998-21munin-plugin-st21:30:002
1406929994421,11cyclictest311ktimers/223:05:132
1406929994421,11cyclictest311ktimers/223:05:132
140692899449,26cyclictest1410845-21fschecks_count19:30:201
1406925994437,4cyclictest167350irq/118-8000000.ethernet-tx021:40:120
1406925994437,4cyclictest167350irq/118-8000000.ethernet-tx019:25:230
1406925994432,9cyclictest1460936-21apt-key00:25:010
1406929994334,5cyclictest1446366-21run-parts23:00:012
1406929994333,5cyclictest0-21swapper/222:10:292
1406929994323,10cyclictest0-21swapper/220:45:222
140692999431,16cyclictest0-21swapper/221:10:022
140692899436,16cyclictest1448898-21apt-get23:15:011
1406928994335,5cyclictest1431837-21munin-plugin-st21:34:591
1406928994333,7cyclictest0-21swapper/119:55:301
1406928994326,12cyclictest0-21swapper/120:35:301
1406928994326,12cyclictest0-21swapper/120:35:301
1406928994326,10cyclictest0-21swapper/123:55:291
1406925994336,4cyclictest0-21swapper/000:05:250
1406925994328,11cyclictest1414318-21tune2fs19:50:220
140692599432,5cyclictest1453725-21meminfo23:40:270
140692599431,7cyclictest1411292-21tail19:30:310
1406929994232,6cyclictest1460051-21latency_hist00:20:002
1406929994230,7cyclictest1435169-21unixbench_singl21:50:282
1406929994229,7cyclictest1449831-21latency_hist23:20:002
1406929994229,7cyclictest1429142-21grep21:15:282
1406929994229,10cyclictest1419083-21sendmail20:20:002
1406929994228,8cyclictest0-21swapper/222:35:302
1406929994226,11cyclictest311ktimers/220:25:182
1406928994228,9cyclictest0-21swapper/121:25:291
1406928994228,9cyclictest0-21swapper/119:40:291
1406928994228,9cyclictest0-21swapper/119:10:291
1406928994228,10cyclictest0-21swapper/121:05:281
140692899422,22cyclictest1414129-21/usr/sbin/munin19:50:201
140692599423,5cyclictest1437370-21irqstats22:05:220
1406925994235,5cyclictest0-21swapper/019:35:140
1406925994234,4cyclictest167350irq/118-8000000.ethernet-tx023:50:010
1406925994233,5cyclictest167350irq/118-8000000.ethernet-tx020:15:210
140692599422,5cyclictest1444938-21df22:50:170
140692599421,39cyclictest0-21swapper/020:20:180
140692599421,35cyclictest0-21swapper/019:45:000
1406925994212,27cyclictest131ktimers/020:00:310
1406925994212,27cyclictest131ktimers/020:00:310
1406929994129,8cyclictest1461851-21munin-plugin-st00:30:002
1406929994129,8cyclictest1461851-21munin-plugin-st00:30:002
1406929994122,11cyclictest0-21swapper/222:25:022
1406928994129,7cyclictest0-21swapper/121:20:001
1406928994128,9cyclictest0-21swapper/122:00:321
1406928994127,7cyclictest0-21swapper/121:50:191
1406928994125,10cyclictest0-21swapper/119:25:281
1406928994122,13cyclictest0-21swapper/120:10:281
1406928994122,13cyclictest0-21swapper/120:10:281
1406925994129,8cyclictest0-21swapper/021:00:290
1406925994128,8cyclictest0-21swapper/000:30:310
1406925994127,9cyclictest0-21swapper/022:45:010
140692599412,4cyclictest1440757-21perl22:25:200
140692599411,5cyclictest1448035-21users23:05:310
140692599411,5cyclictest1448035-21users23:05:310
140692599411,4cyclictest1444222-21perl22:45:220
140692599411,38cyclictest0-21swapper/023:15:330
140692599411,37cyclictest1430665-21open_files21:25:250
140692599411,11cyclictest1417089-21tail20:05:280
1406929994034,3cyclictest0-21swapper/222:45:282
1406929994031,4cyclictest0-21swapper/223:30:222
1406929994030,4cyclictest311ktimers/221:00:282
1406929994029,6cyclictest0-21swapper/220:20:272
1406929994027,8cyclictest0-21swapper/223:50:292
1406928994027,8cyclictest0-21swapper/122:55:301
1406928994026,9cyclictest0-21swapper/100:05:011
1406928994026,8cyclictest0-21swapper/100:35:281
1406925994036,2cyclictest0-21swapper/020:40:180
1406925994034,3cyclictest167350irq/118-8000000.ethernet-tx021:50:210
1406925994033,4cyclictest0-21swapper/021:20:230
1406925994028,9cyclictest1456585-21sendmail00:00:000
1406925994027,9cyclictest0-21swapper/021:35:310
140692599402,3cyclictest1433991-21irqstats21:45:230
140692599401,34cyclictest0-21swapper/023:20:010
140692599401,34cyclictest0-21swapper/023:20:010
1406929993931,5cyclictest311ktimers/220:30:122
1406929993931,5cyclictest1439435-21munin-plugin-st22:20:002
1406929993926,7cyclictest1412196-21grep19:35:302
1406929993923,10cyclictest311ktimers/222:00:162
1406929993919,10cyclictest311ktimers/219:30:142
140692999391,32cyclictest1645-21sshd20:01:442
140692999391,32cyclictest1645-21sshd20:01:432
1406928993931,4cyclictest167450irq/126-8000000.ethernet-tx122:25:221
1406928993931,4cyclictest167450irq/126-8000000.ethernet-tx121:35:251
1406928993928,8cyclictest0-21swapper/122:50:291
1406928993928,8cyclictest0-21swapper/121:45:291
1406928993927,8cyclictest0-21swapper/121:10:291
1406928993924,8cyclictest0-21swapper/120:30:291
140692599393,20cyclictest15-21rcuc/023:15:010
1406925993931,5cyclictest0-21swapper/019:45:180
1406925993930,5cyclictest167350irq/118-8000000.ethernet-tx020:55:220
140692599391,4cyclictest1421897-21fschecks_count20:35:210
140692599391,4cyclictest1421897-21fschecks_count20:35:210
140692599391,36cyclictest0-21swapper/022:15:210
140692599391,36cyclictest0-21swapper/020:15:010
140692599391,36cyclictest0-21swapper/020:15:010
140692999389,23cyclictest0-21swapper/223:41:202
1406929993832,4cyclictest14-21rcu_preempt21:40:212
1406929993830,4cyclictest311ktimers/219:15:172
1406929993827,6cyclictest311ktimers/222:25:252
1406929993823,8cyclictest0-21swapper/221:30:282
1406929993823,11cyclictest0-21swapper/221:35:312
140692899383,4cyclictest1412239-21pluginstate19:40:001
1406928993831,4cyclictest167450irq/126-8000000.ethernet-tx123:00:251
1406928993831,4cyclictest167450irq/126-8000000.ethernet-tx100:25:251
1406928993831,4cyclictest167450irq/126-8000000.ethernet-tx100:25:251
1406928993827,8cyclictest0-21swapper/123:40:001
1406928993827,7cyclictest0-21swapper/120:05:291
1406928993826,8cyclictest0-21swapper/122:10:291
1406928993823,10cyclictest0-21swapper/123:10:291
1406928993816,15cyclictest0-21swapper/100:10:311
140692899381,31cyclictest1425187-21/usr/sbin/munin20:55:161
1406925993832,4cyclictest1463523-21cron00:40:000
1406925993832,4cyclictest0-21swapper/021:55:260
1406925993822,14cyclictest0-21swapper/021:05:200
140692599381,35cyclictest0-21swapper/022:20:300
140692599381,35cyclictest0-21swapper/022:20:300
140692599381,35cyclictest0-21swapper/022:00:280
1406929993725,6cyclictest311ktimers/219:50:242
1406929993725,5cyclictest30-21rcuc/222:30:192
1406929993724,7cyclictest0-21swapper/221:55:212
1406929993723,8cyclictest30-21rcuc/220:05:272
1406929993722,8cyclictest30-21rcuc/220:40:252
1406929993718,9cyclictest0-21swapper/219:15:022
140692899378,19cyclictest1426045-21/usr/sbin/munin21:00:201
1406928993725,8cyclictest0-21swapper/121:20:291
1406928993723,9cyclictest0-21swapper/120:50:271
140692599377,24cyclictest12-21ksoftirqd/021:20:020
1406925993720,15cyclictest0-21swapper/023:04:090
1406929993625,8cyclictest311ktimers/223:10:302
1406929993621,10cyclictest0-21swapper/223:55:272
1406929993617,12cyclictest0-21swapper/219:25:272
1406928993630,4cyclictest167450irq/126-8000000.ethernet-tx123:30:301
1406928993624,7cyclictest0-21swapper/119:20:291
1406928993624,7cyclictest0-21swapper/119:20:291
140692599361,2cyclictest1456802-21apt-get00:00:160
1406929993531,2cyclictest0-21swapper/221:10:222
1406929993523,8cyclictest30-21rcuc/220:55:252
1406929993523,7cyclictest311ktimers/219:45:172
140692999351,29cyclictest0-21swapper/220:35:212
140692999351,29cyclictest0-21swapper/220:35:202
1406929993512,18cyclictest30-21rcuc/200:30:202
140692899355,13cyclictest1455103-21/usr/sbin/munin23:50:191
1406928993528,5cyclictest0-21swapper/122:05:221
1406928993525,6cyclictest0-21swapper/120:25:321
1406928993523,9cyclictest0-21swapper/122:45:301
1406925993520,11cyclictest0-21swapper/022:35:300
140692599351,4cyclictest0-21swapper/020:30:020
1406929993427,3cyclictest2-21kthreadd19:21:172
1406929993427,3cyclictest2-21kthreadd19:21:172
1406929993424,7cyclictest1412452-21/usr/sbin/munin19:40:192
140692999341,28cyclictest0-21swapper/220:50:202
1406928993428,3cyclictest167450irq/126-8000000.ethernet-tx100:30:291
1406928993425,5cyclictest0-21swapper/121:45:001
1406928993423,7cyclictest0-21swapper/120:00:211
1406928993423,7cyclictest0-21swapper/120:00:211
1406928993422,8cyclictest0-21swapper/122:30:291
1406925993427,4cyclictest20850irq/208-8000000.ethernet20:50:000
1406925993425,5cyclictest1442022-21grep22:30:290
1406928993321,8cyclictest0-21swapper/123:40:231
140692899331,2cyclictest0-21swapper/122:15:291
140692599331,5cyclictest0-21swapper/020:35:010
140692599331,3cyclictest0-21swapper/020:55:010
140692599331,3cyclictest0-21swapper/019:56:430
1406929993219,4cyclictest0-21swapper/222:25:012
140692599321,3cyclictest0-21swapper/019:10:000
1406928993118,8cyclictest0-21swapper/122:25:011
1406928993118,8cyclictest0-21swapper/122:25:011
140692899311,3cyclictest0-21swapper/100:05:031
140692899311,27cyclictest0-21swapper/123:05:241
140692899311,27cyclictest0-21swapper/123:05:241
140692599311,28cyclictest0-21swapper/019:21:100
140692599311,28cyclictest0-21swapper/019:21:100
1406928993020,7cyclictest0-21swapper/119:10:011
1406928993012,12cyclictest231ktimers/123:25:221
1406929992922,4cyclictest30-21rcuc/219:10:012
1406929992920,5cyclictest0-21swapper/223:20:292
1406929992920,5cyclictest0-21swapper/223:20:282
140692999291,4cyclictest0-21swapper/223:40:012
1406928992816,9cyclictest0-21swapper/120:15:291
*Timer  **Wakeup  (latency=timer+wakeup+contextswitch)

 

Valid XHTML 1.0 Transitional